2024-04-26T20:39:43.566 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-26T20:39:43.566 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --description fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/alternate-pool} --name rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675178 -- /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675178/orig.config.yaml 2024-04-26T20:39:43.611 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T20:39:43.701 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675178 branch: wip-rishabh-testing-20240426.111959 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/alternate-pool} email: null first_in_suite: false job_id: '7675178' kernel: client: branch: testing flavor: default kdb: true sha1: 806ec36b21129f113ce356c007dd59694d340b37 ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-rishabh-testing-20240426.111959 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - bad backtrace - object missing on disk - error reading table object - error reading sessionmap - unmatched fragstat - unmatched rstat - was unreadable, recreating it now - Scrub error on inode - Metadata damage detected - MDS_FAILED - MDS_DAMAGE sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 kclient: syntax: v2 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240426.111959 sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 owner: scheduled_rishabh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 816 sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 sleep_before_teardown: 0 subset: 166/512 suite: fs suite_branch: wip-rishabh-testing-20240426.111959 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi138.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGvKzFpf2CeNwdh4s2cQvmSlP5LKGMHurBQuxvyytt7suRwDDpprTNZHn7H6mqdvjq1qg5RrQb7TmmQDsWEBMkk= smithi143.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLU7D57Kk9pW/kWJTFBPeov+OzKWsZpqROP7lwjKFlyX1FfEkkpGYAwXZxi0FusPFF/G3wFBKiEA8xDgJSun2G8= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_recovery_pool teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-26_19:30:57 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-26T20:39:43.701 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa; will attempt to use it 2024-04-26T20:39:43.702 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks 2024-04-26T20:39:43.702 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-26T20:39:43.703 INFO:teuthology.task.internal:Checking packages... 2024-04-26T20:39:43.725 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'bc612ffb9c1d5bc27536bc917a705262a36d4387' 2024-04-26T20:39:43.725 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T20:39:43.725 INFO:teuthology.packaging:ref: None 2024-04-26T20:39:43.725 INFO:teuthology.packaging:tag: None 2024-04-26T20:39:43.725 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240426.111959 2024-04-26T20:39:43.725 INFO:teuthology.packaging:sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T20:39:43.725 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-rishabh-testing-20240426.111959 2024-04-26T20:39:43.941 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3306-gbc612ffb-1jammy 2024-04-26T20:39:43.942 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-26T20:39:43.948 INFO:teuthology.task.internal:no buildpackages task found 2024-04-26T20:39:43.949 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-26T20:39:43.979 INFO:teuthology.task.internal:Saving configuration 2024-04-26T20:39:43.995 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-26T20:39:44.001 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T20:39:44.025 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi138.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675178', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 20:34:05.500808', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBuHgmU9TwL/r4hkSZy13AGMTKuL1xPwEFcT3PcK35bZ'} 2024-04-26T20:39:44.050 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi143.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675178', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 20:34:05.502256', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIETaGTAuwHROdQgHiIlipC//zCm5F6E8wx4mIgGw94yv'} 2024-04-26T20:39:44.050 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-26T20:39:44.056 INFO:teuthology.task.internal:roles: ubuntu@smithi138.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-04-26T20:39:44.056 INFO:teuthology.task.internal:roles: ubuntu@smithi143.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-04-26T20:39:44.056 INFO:teuthology.run_tasks:Running task console_log... 2024-04-26T20:39:44.125 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5852a6b4c0>, signals=[15]) 2024-04-26T20:39:44.126 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-26T20:39:44.132 INFO:teuthology.task.internal:Opening connections... 2024-04-26T20:39:44.133 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi138.front.sepia.ceph.com 2024-04-26T20:39:44.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T20:39:44.212 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi143.front.sepia.ceph.com 2024-04-26T20:39:44.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T20:39:44.289 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-26T20:39:44.294 DEBUG:teuthology.orchestra.run.smithi138:> uname -m 2024-04-26T20:39:44.299 INFO:teuthology.orchestra.run.smithi138.stdout:x86_64 2024-04-26T20:39:44.300 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release 2024-04-26T20:39:44.347 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-26T20:39:44.347 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="Ubuntu" 2024-04-26T20:39:44.347 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="22.04" 2024-04-26T20:39:44.347 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-26T20:39:44.347 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_CODENAME=jammy 2024-04-26T20:39:44.347 INFO:teuthology.orchestra.run.smithi138.stdout:ID=ubuntu 2024-04-26T20:39:44.347 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE=debian 2024-04-26T20:39:44.347 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-26T20:39:44.347 INFO:teuthology.orchestra.run.smithi138.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-26T20:39:44.348 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-26T20:39:44.348 INFO:teuthology.orchestra.run.smithi138.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-26T20:39:44.348 INFO:teuthology.orchestra.run.smithi138.stdout:UBUNTU_CODENAME=jammy 2024-04-26T20:39:44.348 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2024-04-26T20:39:44.367 DEBUG:teuthology.orchestra.run.smithi143:> uname -m 2024-04-26T20:39:44.372 INFO:teuthology.orchestra.run.smithi143.stdout:x86_64 2024-04-26T20:39:44.373 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release 2024-04-26T20:39:44.419 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-26T20:39:44.420 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="Ubuntu" 2024-04-26T20:39:44.420 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="22.04" 2024-04-26T20:39:44.420 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-26T20:39:44.420 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_CODENAME=jammy 2024-04-26T20:39:44.420 INFO:teuthology.orchestra.run.smithi143.stdout:ID=ubuntu 2024-04-26T20:39:44.420 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE=debian 2024-04-26T20:39:44.420 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-26T20:39:44.420 INFO:teuthology.orchestra.run.smithi143.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-26T20:39:44.420 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-26T20:39:44.420 INFO:teuthology.orchestra.run.smithi143.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-26T20:39:44.420 INFO:teuthology.orchestra.run.smithi143.stdout:UBUNTU_CODENAME=jammy 2024-04-26T20:39:44.420 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2024-04-26T20:39:44.442 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-26T20:39:44.452 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-26T20:39:44.457 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-26T20:39:44.457 DEBUG:teuthology.orchestra.run.smithi138:> test '!' -e /home/ubuntu/cephtest 2024-04-26T20:39:44.460 DEBUG:teuthology.orchestra.run.smithi143:> test '!' -e /home/ubuntu/cephtest 2024-04-26T20:39:44.467 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-26T20:39:44.475 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-26T20:39:44.476 DEBUG:teuthology.orchestra.run.smithi138:> test -z $(ls -A /var/lib/ceph) 2024-04-26T20:39:44.504 DEBUG:teuthology.orchestra.run.smithi143:> test -z $(ls -A /var/lib/ceph) 2024-04-26T20:39:44.538 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-26T20:39:44.590 INFO:teuthology.run_tasks:Running task kernel... 2024-04-26T20:39:44.603 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'} 2024-04-26T20:39:44.604 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-04-26T20:39:44.604 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-04-26T20:39:44.604 DEBUG:teuthology.orchestra.run.smithi138:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T20:39:44.605 DEBUG:teuthology.orchestra.run.smithi143:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T20:39:44.611 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:39:44.611 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:39:44.611 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-04-26T20:39:44.613 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-04-26T20:39:44.787 DEBUG:teuthology.task.kernel:sha1 for client.1 is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T20:39:44.787 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-26T20:39:44.787 DEBUG:teuthology.orchestra.run.smithi143:> uname -r 2024-04-26T20:39:44.793 INFO:teuthology.orchestra.run.smithi143.stdout:5.15.0-56-generic 2024-04-26T20:39:44.793 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T20:39:44.793 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-26T20:39:44.793 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2024-04-26T20:39:44.793 DEBUG:teuthology.orchestra.run.smithi143:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-04-26T20:39:44.845 DEBUG:teuthology.task.kernel:sha1 for client.0 is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T20:39:44.845 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-26T20:39:44.846 DEBUG:teuthology.orchestra.run.smithi138:> uname -r 2024-04-26T20:39:44.849 INFO:teuthology.orchestra.run.smithi143.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-04-26T20:39:44.851 INFO:teuthology.orchestra.run.smithi138.stdout:5.15.0-56-generic 2024-04-26T20:39:44.851 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T20:39:44.852 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-26T20:39:44.852 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2024-04-26T20:39:44.852 DEBUG:teuthology.orchestra.run.smithi138:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-04-26T20:39:44.913 INFO:teuthology.orchestra.run.smithi138.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-04-26T20:39:44.961 INFO:teuthology.orchestra.run.smithi143.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-04-26T20:39:44.961 INFO:teuthology.orchestra.run.smithi143.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-04-26T20:39:44.961 INFO:teuthology.orchestra.run.smithi143.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-04-26T20:39:44.961 INFO:teuthology.orchestra.run.smithi143.stderr:hint: 2024-04-26T20:39:44.962 INFO:teuthology.orchestra.run.smithi143.stderr:hint: git config --global init.defaultBranch 2024-04-26T20:39:44.962 INFO:teuthology.orchestra.run.smithi143.stderr:hint: 2024-04-26T20:39:44.962 INFO:teuthology.orchestra.run.smithi143.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-04-26T20:39:44.962 INFO:teuthology.orchestra.run.smithi143.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-04-26T20:39:44.962 INFO:teuthology.orchestra.run.smithi143.stderr:hint: 2024-04-26T20:39:44.962 INFO:teuthology.orchestra.run.smithi143.stderr:hint: git branch -m 2024-04-26T20:39:44.963 INFO:teuthology.orchestra.run.smithi143.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-04-26T20:39:44.965 DEBUG:teuthology.orchestra.run.smithi143:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-04-26T20:39:45.031 DEBUG:teuthology.orchestra.run.smithi143:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-04-26T20:39:45.045 INFO:teuthology.orchestra.run.smithi138.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-04-26T20:39:45.045 INFO:teuthology.orchestra.run.smithi138.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-04-26T20:39:45.046 INFO:teuthology.orchestra.run.smithi138.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-04-26T20:39:45.046 INFO:teuthology.orchestra.run.smithi138.stderr:hint: 2024-04-26T20:39:45.046 INFO:teuthology.orchestra.run.smithi138.stderr:hint: git config --global init.defaultBranch 2024-04-26T20:39:45.046 INFO:teuthology.orchestra.run.smithi138.stderr:hint: 2024-04-26T20:39:45.046 INFO:teuthology.orchestra.run.smithi138.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-04-26T20:39:45.046 INFO:teuthology.orchestra.run.smithi138.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-04-26T20:39:45.046 INFO:teuthology.orchestra.run.smithi138.stderr:hint: 2024-04-26T20:39:45.046 INFO:teuthology.orchestra.run.smithi138.stderr:hint: git branch -m 2024-04-26T20:39:45.047 INFO:teuthology.orchestra.run.smithi138.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-04-26T20:39:45.049 DEBUG:teuthology.orchestra.run.smithi138:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-04-26T20:39:45.086 DEBUG:teuthology.orchestra.run.smithi143:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-04-26T20:39:45.114 DEBUG:teuthology.orchestra.run.smithi138:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-04-26T20:39:45.173 DEBUG:teuthology.orchestra.run.smithi138:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-04-26T20:41:16.034 INFO:teuthology.orchestra.run.smithi143.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-04-26T20:41:16.034 INFO:teuthology.orchestra.run.smithi143.stderr: * [new branch] main -> origin/main 2024-04-26T20:41:16.062 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20190312 -> 20190312 2024-04-26T20:41:16.062 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20190416 -> 20190416 2024-04-26T20:41:16.062 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20190514 -> 20190514 2024-04-26T20:41:16.062 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20190618 -> 20190618 2024-04-26T20:41:16.062 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20190717 -> 20190717 2024-04-26T20:41:16.062 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20190815 -> 20190815 2024-04-26T20:41:16.062 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20190923 -> 20190923 2024-04-26T20:41:16.063 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20191022 -> 20191022 2024-04-26T20:41:16.063 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20191215 -> 20191215 2024-04-26T20:41:16.063 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20200122 -> 20200122 2024-04-26T20:41:16.063 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20200316 -> 20200316 2024-04-26T20:41:16.063 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20200421 -> 20200421 2024-04-26T20:41:16.063 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20200519 -> 20200519 2024-04-26T20:41:16.063 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20200619 -> 20200619 2024-04-26T20:41:16.063 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20200721 -> 20200721 2024-04-26T20:41:16.063 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20200817 -> 20200817 2024-04-26T20:41:16.063 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20200918 -> 20200918 2024-04-26T20:41:16.063 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20201022 -> 20201022 2024-04-26T20:41:16.063 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20201118 -> 20201118 2024-04-26T20:41:16.064 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20201218 -> 20201218 2024-04-26T20:41:16.064 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20210208 -> 20210208 2024-04-26T20:41:16.064 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20210315 -> 20210315 2024-04-26T20:41:16.064 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20210511 -> 20210511 2024-04-26T20:41:16.064 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20210716 -> 20210716 2024-04-26T20:41:16.067 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20210818 -> 20210818 2024-04-26T20:41:16.067 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20210919 -> 20210919 2024-04-26T20:41:16.068 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20211027 -> 20211027 2024-04-26T20:41:16.068 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20211216 -> 20211216 2024-04-26T20:41:16.068 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20220209 -> 20220209 2024-04-26T20:41:16.068 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20220310 -> 20220310 2024-04-26T20:41:16.068 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20220411 -> 20220411 2024-04-26T20:41:16.068 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20220509 -> 20220509 2024-04-26T20:41:16.068 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20220610 -> 20220610 2024-04-26T20:41:16.068 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20220708 -> 20220708 2024-04-26T20:41:16.068 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20220815 -> 20220815 2024-04-26T20:41:16.068 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20220913 -> 20220913 2024-04-26T20:41:16.068 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20221012 -> 20221012 2024-04-26T20:41:16.069 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20221109 -> 20221109 2024-04-26T20:41:16.069 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20221214 -> 20221214 2024-04-26T20:41:16.069 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20230117 -> 20230117 2024-04-26T20:41:16.069 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20230210 -> 20230210 2024-04-26T20:41:16.069 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20230310 -> 20230310 2024-04-26T20:41:16.069 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20230404 -> 20230404 2024-04-26T20:41:16.069 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20230515 -> 20230515 2024-04-26T20:41:16.069 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20230625 -> 20230625 2024-04-26T20:41:16.069 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20230804 -> 20230804 2024-04-26T20:41:16.069 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20230919 -> 20230919 2024-04-26T20:41:16.069 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20231030 -> 20231030 2024-04-26T20:41:16.069 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20231111 -> 20231111 2024-04-26T20:41:16.069 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20231211 -> 20231211 2024-04-26T20:41:16.070 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20240115 -> 20240115 2024-04-26T20:41:16.070 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20240220 -> 20240220 2024-04-26T20:41:16.070 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20240312 -> 20240312 2024-04-26T20:41:16.070 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20240410 -> 20240410 2024-04-26T20:41:20.328 INFO:teuthology.orchestra.run.smithi143.stderr:Updating files: 45% (1538/3390) Updating files: 46% (1560/3390) Updating files: 47% (1594/3390) Updating files: 48% (1628/3390) Updating files: 49% (1662/3390) Updating files: 50% (1695/3390) Updating files: 51% (1729/3390) Updating files: 52% (1763/3390) Updating files: 53% (1797/3390) Updating files: 54% (1831/3390) Updating files: 55% (1865/3390) Updating files: 56% (1899/3390) Updating files: 57% (1933/3390) Updating files: 58% (1967/3390) Updating files: 59% (2001/3390) Updating files: 59% (2020/3390) Updating files: 60% (2034/3390) Updating files: 61% (2068/3390) Updating files: 62% (2102/3390) Updating files: 63% (2136/3390) Updating files: 64% (2170/3390) Updating files: 65% (2204/3390) Updating files: 66% (2238/3390) Updating files: 67% (2272/3390) Updating files: 68% (2306/3390) Updating files: 69% (2340/3390) Updating files: 69% (2371/3390) Updating files: 70% (2373/3390) Updating files: 71% (2407/3390) Updating files: 72% (2441/3390) Updating files: 73% (2475/3390) Updating files: 74% (2509/3390) Updating files: 75% (2543/3390) Updating files: 76% (2577/3390) Updating files: 77% (2611/3390) Updating files: 78% (2645/3390) Updating files: 79% (2679/3390) Updating files: 80% (2712/3390) Updating files: 81% (2746/3390) Updating files: 82% (2780/3390) Updating files: 83% (2814/3390) Updating files: 83% (2822/3390) Updating files: 84% (2848/3390) Updating files: 85% (2882/3390) Updating files: 86% (2916/3390) Updating files: 87% (2950/3390) Updating files: 88% (2984/3390) Updating files: 89% (3018/3390) Updating files: 90% (3051/3390) Updating files: 91% (3085/3390) Updating files: 92% (3119/3390) Updating files: 93% (3153/3390) Updating files: 94% (3187/3390) Updating files: 95% (3221/3390) Updating files: 96% (3255/3390) Updating files: 97% (3289/3390) Updating files: 98% (3323/3390) Updating files: 99% (3357/3390) Updating files: 100% (3390/3390) Updating files: 100% (3390/3390), done. 2024-04-26T20:41:20.333 INFO:teuthology.orchestra.run.smithi143.stdout:HEAD is now at fc21f475 Merge branch 'robot/pr-0-1714105941' into 'main' 2024-04-26T20:41:20.355 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.1... 2024-04-26T20:41:20.355 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T20:41:20.504 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ 2024-04-26T20:41:20.505 DEBUG:teuthology.orchestra.run.smithi143:> rm -f /tmp/linux-image.deb && echo linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ --input-file=- 2024-04-26T20:41:20.508 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi143.front.sepia.ceph.com to complete... 2024-04-26T20:41:22.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26 20:41:22 URL:https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb [44805284/44805284] -> "/tmp/linux-image.deb" [1] 2024-04-26T20:41:22.203 INFO:teuthology.orchestra.run.smithi143.stderr:FINISHED --2024-04-26 20:41:22-- 2024-04-26T20:41:22.203 INFO:teuthology.orchestra.run.smithi143.stderr:Total wall clock time: 1.7s 2024-04-26T20:41:22.203 INFO:teuthology.orchestra.run.smithi143.stderr:Downloaded: 1 files, 43M in 1.5s (27.7 MB/s) 2024-04-26T20:41:22.208 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.1... 2024-04-26T20:41:22.208 DEBUG:teuthology.orchestra.run.smithi143:> sudo dpkg -i /tmp/linux-image.deb 2024-04-26T20:41:22.549 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package linux-image-6.9.0-rc3-g806ec36b2112. 2024-04-26T20:41:22.957 INFO:teuthology.orchestra.run.smithi138.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-04-26T20:41:22.957 INFO:teuthology.orchestra.run.smithi138.stderr: * [new branch] main -> origin/main 2024-04-26T20:41:22.991 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20190312 -> 20190312 2024-04-26T20:41:22.992 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20190416 -> 20190416 2024-04-26T20:41:22.992 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20190514 -> 20190514 2024-04-26T20:41:22.992 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20190618 -> 20190618 2024-04-26T20:41:22.992 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20190717 -> 20190717 2024-04-26T20:41:22.992 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20190815 -> 20190815 2024-04-26T20:41:22.992 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20190923 -> 20190923 2024-04-26T20:41:22.992 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20191022 -> 20191022 2024-04-26T20:41:22.992 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20191215 -> 20191215 2024-04-26T20:41:22.992 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20200122 -> 20200122 2024-04-26T20:41:22.993 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20200316 -> 20200316 2024-04-26T20:41:22.999 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20200421 -> 20200421 2024-04-26T20:41:22.999 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20200519 -> 20200519 2024-04-26T20:41:23.000 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20200619 -> 20200619 2024-04-26T20:41:23.000 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20200721 -> 20200721 2024-04-26T20:41:23.000 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20200817 -> 20200817 2024-04-26T20:41:23.000 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20200918 -> 20200918 2024-04-26T20:41:23.000 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20201022 -> 20201022 2024-04-26T20:41:23.000 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20201118 -> 20201118 2024-04-26T20:41:23.000 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20201218 -> 20201218 2024-04-26T20:41:23.000 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20210208 -> 20210208 2024-04-26T20:41:23.001 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20210315 -> 20210315 2024-04-26T20:41:23.001 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20210511 -> 20210511 2024-04-26T20:41:23.001 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20210716 -> 20210716 2024-04-26T20:41:23.001 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20210818 -> 20210818 2024-04-26T20:41:23.001 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20210919 -> 20210919 2024-04-26T20:41:23.001 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20211027 -> 20211027 2024-04-26T20:41:23.001 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20211216 -> 20211216 2024-04-26T20:41:23.001 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20220209 -> 20220209 2024-04-26T20:41:23.001 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20220310 -> 20220310 2024-04-26T20:41:23.002 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20220411 -> 20220411 2024-04-26T20:41:23.002 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20220509 -> 20220509 2024-04-26T20:41:23.002 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20220610 -> 20220610 2024-04-26T20:41:23.002 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20220708 -> 20220708 2024-04-26T20:41:23.002 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20220815 -> 20220815 2024-04-26T20:41:23.002 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20220913 -> 20220913 2024-04-26T20:41:23.002 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20221012 -> 20221012 2024-04-26T20:41:23.002 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20221109 -> 20221109 2024-04-26T20:41:23.002 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20221214 -> 20221214 2024-04-26T20:41:23.003 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20230117 -> 20230117 2024-04-26T20:41:23.003 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20230210 -> 20230210 2024-04-26T20:41:23.003 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20230310 -> 20230310 2024-04-26T20:41:23.003 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20230404 -> 20230404 2024-04-26T20:41:23.003 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20230515 -> 20230515 2024-04-26T20:41:23.003 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20230625 -> 20230625 2024-04-26T20:41:23.003 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20230804 -> 20230804 2024-04-26T20:41:23.003 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20230919 -> 20230919 2024-04-26T20:41:23.003 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20231030 -> 20231030 2024-04-26T20:41:23.003 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20231111 -> 20231111 2024-04-26T20:41:23.003 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20231211 -> 20231211 2024-04-26T20:41:23.003 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20240115 -> 20240115 2024-04-26T20:41:23.004 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20240220 -> 20240220 2024-04-26T20:41:23.004 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20240312 -> 20240312 2024-04-26T20:41:23.004 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20240410 -> 20240410 2024-04-26T20:41:24.558 INFO:teuthology.orchestra.run.smithi143.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-04-26T20:41:24.563 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-04-26T20:41:24.679 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-26T20:41:27.271 INFO:teuthology.orchestra.run.smithi138.stderr:Updating files: 45% (1530/3390) Updating files: 46% (1560/3390) Updating files: 47% (1594/3390) Updating files: 48% (1628/3390) Updating files: 49% (1662/3390) Updating files: 50% (1695/3390) Updating files: 51% (1729/3390) Updating files: 52% (1763/3390) Updating files: 53% (1797/3390) Updating files: 54% (1831/3390) Updating files: 55% (1865/3390) Updating files: 56% (1899/3390) Updating files: 57% (1933/3390) Updating files: 58% (1967/3390) Updating files: 59% (2001/3390) Updating files: 59% (2015/3390) Updating files: 60% (2034/3390) Updating files: 61% (2068/3390) Updating files: 62% (2102/3390) Updating files: 63% (2136/3390) Updating files: 64% (2170/3390) Updating files: 65% (2204/3390) Updating files: 66% (2238/3390) Updating files: 67% (2272/3390) Updating files: 68% (2306/3390) Updating files: 69% (2340/3390) Updating files: 69% (2371/3390) Updating files: 70% (2373/3390) Updating files: 71% (2407/3390) Updating files: 72% (2441/3390) Updating files: 73% (2475/3390) Updating files: 74% (2509/3390) Updating files: 75% (2543/3390) Updating files: 76% (2577/3390) Updating files: 77% (2611/3390) Updating files: 78% (2645/3390) Updating files: 79% (2679/3390) Updating files: 80% (2712/3390) Updating files: 81% (2746/3390) Updating files: 82% (2780/3390) Updating files: 83% (2814/3390) Updating files: 83% (2819/3390) Updating files: 84% (2848/3390) Updating files: 85% (2882/3390) Updating files: 86% (2916/3390) Updating files: 87% (2950/3390) Updating files: 88% (2984/3390) Updating files: 89% (3018/3390) Updating files: 90% (3051/3390) Updating files: 91% (3085/3390) Updating files: 92% (3119/3390) Updating files: 93% (3153/3390) Updating files: 94% (3187/3390) Updating files: 95% (3221/3390) Updating files: 96% (3255/3390) Updating files: 97% (3289/3390) Updating files: 98% (3323/3390) Updating files: 99% (3357/3390) Updating files: 100% (3390/3390) Updating files: 100% (3390/3390), done. 2024-04-26T20:41:27.278 INFO:teuthology.orchestra.run.smithi138.stdout:HEAD is now at fc21f475 Merge branch 'robot/pr-0-1714105941' into 'main' 2024-04-26T20:41:27.296 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-04-26T20:41:27.296 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T20:41:27.517 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ 2024-04-26T20:41:27.517 DEBUG:teuthology.orchestra.run.smithi138:> rm -f /tmp/linux-image.deb && echo linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ --input-file=- 2024-04-26T20:41:27.520 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi138.front.sepia.ceph.com to complete... 2024-04-26T20:41:28.530 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-26T20:41:28.642 INFO:teuthology.orchestra.run.smithi143.stderr:update-initramfs: Generating /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-26T20:41:29.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26 20:41:29 URL:https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb [44805284/44805284] -> "/tmp/linux-image.deb" [1] 2024-04-26T20:41:29.318 INFO:teuthology.orchestra.run.smithi138.stderr:FINISHED --2024-04-26 20:41:29-- 2024-04-26T20:41:29.318 INFO:teuthology.orchestra.run.smithi138.stderr:Total wall clock time: 1.7s 2024-04-26T20:41:29.318 INFO:teuthology.orchestra.run.smithi138.stderr:Downloaded: 1 files, 43M in 1.6s (27.0 MB/s) 2024-04-26T20:41:29.322 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-04-26T20:41:29.323 DEBUG:teuthology.orchestra.run.smithi138:> sudo dpkg -i /tmp/linux-image.deb 2024-04-26T20:41:29.735 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package linux-image-6.9.0-rc3-g806ec36b2112. 2024-04-26T20:41:31.729 INFO:teuthology.orchestra.run.smithi138.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-04-26T20:41:31.734 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-04-26T20:41:31.841 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-26T20:41:35.310 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-26T20:41:35.419 INFO:teuthology.orchestra.run.smithi138.stderr:update-initramfs: Generating /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-26T20:41:51.165 INFO:teuthology.orchestra.run.smithi143.stderr:Sourcing file `/etc/default/grub' 2024-04-26T20:41:51.179 INFO:teuthology.orchestra.run.smithi143.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T20:41:51.205 INFO:teuthology.orchestra.run.smithi143.stderr:Generating grub configuration file ... 2024-04-26T20:41:51.500 INFO:teuthology.orchestra.run.smithi143.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-26T20:41:51.519 INFO:teuthology.orchestra.run.smithi143.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-26T20:41:51.798 INFO:teuthology.orchestra.run.smithi143.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T20:41:51.814 INFO:teuthology.orchestra.run.smithi143.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T20:41:51.876 INFO:teuthology.orchestra.run.smithi143.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T20:41:51.882 INFO:teuthology.orchestra.run.smithi143.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T20:41:52.021 INFO:teuthology.orchestra.run.smithi143.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T20:41:52.021 INFO:teuthology.orchestra.run.smithi143.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T20:41:52.021 INFO:teuthology.orchestra.run.smithi143.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T20:41:52.060 INFO:teuthology.orchestra.run.smithi143.stderr:done 2024-04-26T20:41:52.241 DEBUG:teuthology.orchestra.run.smithi143:> dpkg-deb -c /tmp/linux-image.deb 2024-04-26T20:41:52.249 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./ 2024-04-26T20:41:52.250 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./boot/ 2024-04-26T20:41:52.250 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7002012 2024-04-19 08:55 ./boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-26T20:41:52.264 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 172073 2024-04-19 08:55 ./boot/config-6.9.0-rc3-g806ec36b2112 2024-04-26T20:41:52.264 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13120512 2024-04-19 08:55 ./boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-26T20:41:52.286 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/ 2024-04-26T20:41:52.286 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/ 2024-04-26T20:41:52.286 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postinst.d/ 2024-04-26T20:41:52.286 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postrm.d/ 2024-04-26T20:41:52.286 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/preinst.d/ 2024-04-26T20:41:52.286 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/prerm.d/ 2024-04-26T20:41:52.286 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/ 2024-04-26T20:41:52.286 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/ 2024-04-26T20:41:52.286 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/ 2024-04-26T20:41:52.286 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/ 2024-04-26T20:41:52.286 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/ 2024-04-26T20:41:52.287 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/ 2024-04-26T20:41:52.287 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ 2024-04-26T20:41:52.287 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 507569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/aesni-intel.ko 2024-04-26T20:41:52.287 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-26T20:41:52.287 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-26T20:41:52.287 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-26T20:41:52.287 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-26T20:41:52.287 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 109905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-26T20:41:52.287 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 155249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-26T20:41:52.287 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-26T20:41:52.287 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-26T20:41:52.287 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 87009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-26T20:41:52.287 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-26T20:41:52.287 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 50305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-26T20:41:52.288 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 50377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-26T20:41:52.288 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 54513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-26T20:41:52.288 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-26T20:41:52.288 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 48049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-26T20:41:52.288 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 62873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-26T20:41:52.288 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 53569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-26T20:41:52.288 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-26T20:41:52.288 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-26T20:41:52.288 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/ 2024-04-26T20:41:52.288 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/ 2024-04-26T20:41:52.288 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/ 2024-04-26T20:41:52.288 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-26T20:41:52.288 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpuid.ko 2024-04-26T20:41:52.288 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/msr.ko 2024-04-26T20:41:52.289 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/ 2024-04-26T20:41:52.289 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 444425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-26T20:41:52.289 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1035881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-26T20:41:52.289 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 2849609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-26T20:41:52.348 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ 2024-04-26T20:41:52.349 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 65025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/af_alg.ko 2024-04-26T20:41:52.349 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_hash.ko 2024-04-26T20:41:52.349 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_skcipher.ko 2024-04-26T20:41:52.349 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-26T20:41:52.349 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-26T20:41:52.349 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-26T20:41:52.349 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/ 2024-04-26T20:41:52.349 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-04-26T20:41:52.349 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/ 2024-04-26T20:41:52.349 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-26T20:41:52.349 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-26T20:41:52.349 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-26T20:41:52.349 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-26T20:41:52.349 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-26T20:41:52.350 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-26T20:41:52.350 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-26T20:41:52.350 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-26T20:41:52.350 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-26T20:41:52.350 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-26T20:41:52.350 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-26T20:41:52.350 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-26T20:41:52.350 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-26T20:41:52.350 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-26T20:41:52.350 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-26T20:41:52.350 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 43281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-26T20:41:52.350 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-26T20:41:52.350 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-26T20:41:52.351 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 59129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cryptd.ko 2024-04-26T20:41:52.351 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 48113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-26T20:41:52.351 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_simd.ko 2024-04-26T20:41:52.351 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-26T20:41:52.351 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-26T20:41:52.351 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-26T20:41:52.351 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-26T20:41:52.351 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-26T20:41:52.351 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-26T20:41:52.351 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-26T20:41:52.351 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-26T20:41:52.351 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lrw.ko 2024-04-26T20:41:52.351 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-26T20:41:52.351 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-26T20:41:52.351 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-26T20:41:52.352 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-26T20:41:52.352 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-26T20:41:52.352 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-26T20:41:52.352 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-26T20:41:52.352 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-26T20:41:52.352 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-26T20:41:52.352 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 169065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-26T20:41:52.352 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-26T20:41:52.352 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-26T20:41:52.352 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-26T20:41:52.352 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-26T20:41:52.352 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-26T20:41:52.352 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-26T20:41:52.352 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-26T20:41:52.352 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xts.ko 2024-04-26T20:41:52.353 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-26T20:41:52.353 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ 2024-04-26T20:41:52.353 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ 2024-04-26T20:41:52.353 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_extlog.ko 2024-04-26T20:41:52.353 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-26T20:41:52.353 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-26T20:41:52.353 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/ 2024-04-26T20:41:52.353 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/einj.ko 2024-04-26T20:41:52.353 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-26T20:41:52.353 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-26T20:41:52.353 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-26T20:41:52.353 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-26T20:41:52.353 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 119033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-26T20:41:52.353 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ 2024-04-26T20:41:52.354 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-26T20:41:52.354 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 96825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci.ko 2024-04-26T20:41:52.354 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-26T20:41:52.354 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 107737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci.ko 2024-04-26T20:41:52.354 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 42001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-26T20:41:52.354 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-26T20:41:52.354 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-26T20:41:52.354 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-26T20:41:52.354 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-26T20:41:52.354 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-26T20:41:52.354 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-26T20:41:52.354 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-26T20:41:52.354 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-26T20:41:52.355 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-26T20:41:52.355 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-26T20:41:52.355 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-26T20:41:52.355 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-26T20:41:52.355 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-26T20:41:52.355 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-26T20:41:52.355 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-26T20:41:52.355 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-26T20:41:52.355 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-26T20:41:52.355 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 60257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_legacy.ko 2024-04-26T20:41:52.355 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-26T20:41:52.355 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-26T20:41:52.355 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-26T20:41:52.355 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-26T20:41:52.355 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-26T20:41:52.356 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-26T20:41:52.356 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-26T20:41:52.356 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-26T20:41:52.356 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-26T20:41:52.356 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-26T20:41:52.356 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 43009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-26T20:41:52.356 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-26T20:41:52.356 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-26T20:41:52.356 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_radisys.ko 2024-04-26T20:41:52.356 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-26T20:41:52.356 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rz1000.ko 2024-04-26T20:41:52.356 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-26T20:41:52.356 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-26T20:41:52.356 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-26T20:41:52.356 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-26T20:41:52.357 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-26T20:41:52.357 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-26T20:41:52.357 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-26T20:41:52.357 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-26T20:41:52.357 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 102121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-26T20:41:52.357 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 85409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-26T20:41:52.357 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-26T20:41:52.357 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-26T20:41:52.357 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-26T20:41:52.357 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 45905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-26T20:41:52.357 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-26T20:41:52.357 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-26T20:41:52.357 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 53353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-26T20:41:52.358 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-26T20:41:52.358 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-26T20:41:52.358 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-26T20:41:52.358 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ 2024-04-26T20:41:52.358 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-26T20:41:52.358 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/ 2024-04-26T20:41:52.358 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 163969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-26T20:41:52.358 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/ 2024-04-26T20:41:52.358 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/ 2024-04-26T20:41:52.358 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 140865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-26T20:41:52.358 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/ 2024-04-26T20:41:52.358 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1241657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-26T20:41:52.358 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 203289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-26T20:41:52.359 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/ 2024-04-26T20:41:52.359 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 115265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-26T20:41:52.359 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 143433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-26T20:41:52.359 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/ 2024-04-26T20:41:52.359 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 126617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-26T20:41:52.359 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 119873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-26T20:41:52.359 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 313217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-26T20:41:52.359 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/ 2024-04-26T20:41:52.359 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 117233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-26T20:41:52.359 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/ 2024-04-26T20:41:52.359 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 70385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-26T20:41:52.359 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ 2024-04-26T20:41:52.359 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/applicom.ko 2024-04-26T20:41:52.359 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-26T20:41:52.359 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/ 2024-04-26T20:41:52.360 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-26T20:41:52.360 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-26T20:41:52.360 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-26T20:41:52.360 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-26T20:41:52.360 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-26T20:41:52.360 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ 2024-04-26T20:41:52.360 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-26T20:41:52.360 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 186921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-26T20:41:52.360 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-26T20:41:52.360 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 179561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-26T20:41:52.360 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 85441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-26T20:41:52.360 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 65313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-26T20:41:52.360 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 43857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-26T20:41:52.360 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/ 2024-04-26T20:41:52.360 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 103409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-26T20:41:52.360 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/nvram.ko 2024-04-26T20:41:52.361 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-26T20:41:52.361 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 59241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-26T20:41:52.361 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/ 2024-04-26T20:41:52.361 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-26T20:41:52.361 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-04-26T20:41:52.361 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-04-26T20:41:52.361 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-04-26T20:41:52.361 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-26T20:41:52.361 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-26T20:41:52.361 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-04-26T20:41:52.361 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/ 2024-04-26T20:41:52.361 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_class.ko 2024-04-26T20:41:52.361 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 62545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_core.ko 2024-04-26T20:41:52.361 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-04-26T20:41:52.361 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/ 2024-04-26T20:41:52.361 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-palmas.ko 2024-04-26T20:41:52.362 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 57289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-si5351.ko 2024-04-26T20:41:52.362 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-twl6040.ko 2024-04-26T20:41:52.362 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-wm831x.ko 2024-04-26T20:41:52.362 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/ 2024-04-26T20:41:52.362 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-26T20:41:52.362 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-26T20:41:52.362 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-26T20:41:52.362 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ 2024-04-26T20:41:52.362 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ 2024-04-26T20:41:52.362 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 89257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-26T20:41:52.362 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 333657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-26T20:41:52.362 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/ 2024-04-26T20:41:52.362 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/ 2024-04-26T20:41:52.362 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/ 2024-04-26T20:41:52.362 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 751713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-26T20:41:52.363 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-04-26T20:41:52.363 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-26T20:41:52.363 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-26T20:41:52.363 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-26T20:41:52.363 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/ 2024-04-26T20:41:52.363 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 90441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-26T20:41:52.363 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/ 2024-04-26T20:41:52.363 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-26T20:41:52.363 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ 2024-04-26T20:41:52.363 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/ 2024-04-26T20:41:52.363 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-26T20:41:52.363 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ 2024-04-26T20:41:52.363 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 146769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-26T20:41:52.363 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ 2024-04-26T20:41:52.363 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 96145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-26T20:41:52.364 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-26T20:41:52.364 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 51105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-26T20:41:52.364 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-26T20:41:52.364 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-26T20:41:52.364 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-26T20:41:52.364 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-26T20:41:52.364 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-26T20:41:52.364 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 64161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-26T20:41:52.364 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-26T20:41:52.364 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-26T20:41:52.364 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 68697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-26T20:41:52.364 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-26T20:41:52.364 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/ 2024-04-26T20:41:52.364 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-gpio.ko 2024-04-26T20:41:52.364 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max14577.ko 2024-04-26T20:41:52.365 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max77693.ko 2024-04-26T20:41:52.365 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max8997.ko 2024-04-26T20:41:52.365 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-palmas.ko 2024-04-26T20:41:52.365 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-rt8973a.ko 2024-04-26T20:41:52.365 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-sm5502.ko 2024-04-26T20:41:52.365 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/ 2024-04-26T20:41:52.365 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 42953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/dmi-sysfs.ko 2024-04-26T20:41:52.365 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/ 2024-04-26T20:41:52.365 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/efi-pstore.ko 2024-04-26T20:41:52.365 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-26T20:41:52.365 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/ 2024-04-26T20:41:52.365 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-adp5520.ko 2024-04-26T20:41:52.365 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-amd8111.ko 2024-04-26T20:41:52.365 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-arizona.ko 2024-04-26T20:41:52.365 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9052.ko 2024-04-26T20:41:52.366 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9055.ko 2024-04-26T20:41:52.366 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-dln2.ko 2024-04-26T20:41:52.366 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 81073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-f7188x.ko 2024-04-26T20:41:52.366 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 40761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-generic.ko 2024-04-26T20:41:52.366 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-26T20:41:52.366 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-04-26T20:41:52.366 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-kempld.ko 2024-04-26T20:41:52.366 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-lp3943.ko 2024-04-26T20:41:52.366 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max7300.ko 2024-04-26T20:41:52.366 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max730x.ko 2024-04-26T20:41:52.366 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max732x.ko 2024-04-26T20:41:52.366 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-04-26T20:41:52.366 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pca953x.ko 2024-04-26T20:41:52.366 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pcf857x.ko 2024-04-26T20:41:52.367 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-rdc321x.ko 2024-04-26T20:41:52.367 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch.ko 2024-04-26T20:41:52.367 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch311x.ko 2024-04-26T20:41:52.367 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-tps65912.ko 2024-04-26T20:41:52.367 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl4030.ko 2024-04-26T20:41:52.367 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl6040.ko 2024-04-26T20:41:52.367 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-26T20:41:52.367 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-vx855.ko 2024-04-26T20:41:52.367 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm831x.ko 2024-04-26T20:41:52.367 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8350.ko 2024-04-26T20:41:52.367 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8994.ko 2024-04-26T20:41:52.367 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/ 2024-04-26T20:41:52.367 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-a4tech.ko 2024-04-26T20:41:52.367 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-apple.ko 2024-04-26T20:41:52.367 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-26T20:41:52.367 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-26T20:41:52.368 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-26T20:41:52.368 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-belkin.ko 2024-04-26T20:41:52.368 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cherry.ko 2024-04-26T20:41:52.368 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-chicony.ko 2024-04-26T20:41:52.368 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 74393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cp2112.ko 2024-04-26T20:41:52.368 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cypress.ko 2024-04-26T20:41:52.368 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-26T20:41:52.368 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-26T20:41:52.368 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-26T20:41:52.368 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-26T20:41:52.368 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ezkey.ko 2024-04-26T20:41:52.368 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-26T20:41:52.368 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-generic.ko 2024-04-26T20:41:52.368 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-26T20:41:52.369 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-26T20:41:52.369 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-26T20:41:52.369 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-26T20:41:52.369 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-26T20:41:52.369 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-26T20:41:52.369 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-26T20:41:52.369 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kensington.ko 2024-04-26T20:41:52.369 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-26T20:41:52.369 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-26T20:41:52.369 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-26T20:41:52.369 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-26T20:41:52.369 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 54217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-26T20:41:52.369 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lg-g15.ko 2024-04-26T20:41:52.369 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 68081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-26T20:41:52.369 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 121369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-26T20:41:52.370 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech.ko 2024-04-26T20:41:52.370 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-magicmouse.ko 2024-04-26T20:41:52.370 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-microsoft.ko 2024-04-26T20:41:52.370 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-monterey.ko 2024-04-26T20:41:52.370 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 59001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-26T20:41:52.370 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ntrig.ko 2024-04-26T20:41:52.370 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-26T20:41:52.370 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-26T20:41:52.370 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-26T20:41:52.370 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 91241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-26T20:41:52.370 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-26T20:41:52.370 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-26T20:41:52.370 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-26T20:41:52.371 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-26T20:41:52.371 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-26T20:41:52.371 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-26T20:41:52.371 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-26T20:41:52.371 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-26T20:41:52.371 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-26T20:41:52.371 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-26T20:41:52.371 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-26T20:41:52.371 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-26T20:41:52.371 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-26T20:41:52.371 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-26T20:41:52.371 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-26T20:41:52.371 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-26T20:41:52.371 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-26T20:41:52.372 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 42305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-26T20:41:52.372 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 43609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-26T20:41:52.372 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-26T20:41:52.372 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 62129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-26T20:41:52.372 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-26T20:41:52.372 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-26T20:41:52.372 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-26T20:41:52.372 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-26T20:41:52.372 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-26T20:41:52.372 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-26T20:41:52.372 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-26T20:41:52.372 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-26T20:41:52.372 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 81113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-26T20:41:52.372 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-26T20:41:52.372 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 184745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-26T20:41:52.373 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-26T20:41:52.373 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-26T20:41:52.373 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-26T20:41:52.373 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 319921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid.ko 2024-04-26T20:41:52.373 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-26T20:41:52.373 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/ 2024-04-26T20:41:52.373 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 153633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbhid.ko 2024-04-26T20:41:52.373 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbkbd.ko 2024-04-26T20:41:52.373 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbmouse.ko 2024-04-26T20:41:52.373 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 261945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-26T20:41:52.373 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/ 2024-04-26T20:41:52.373 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 75065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-26T20:41:52.373 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 110681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-26T20:41:52.373 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 382033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-26T20:41:52.373 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ 2024-04-26T20:41:52.374 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 77153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-26T20:41:52.374 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 67009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-26T20:41:52.374 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-26T20:41:52.374 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-26T20:41:52.374 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-26T20:41:52.374 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-26T20:41:52.374 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-26T20:41:52.374 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 115057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-26T20:41:52.374 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-26T20:41:52.374 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 55225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-26T20:41:52.374 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-26T20:41:52.374 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-26T20:41:52.374 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-26T20:41:52.374 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-26T20:41:52.375 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 89025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-26T20:41:52.375 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 49153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-26T20:41:52.375 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 81473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-26T20:41:52.375 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-26T20:41:52.375 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 48177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-26T20:41:52.375 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 68865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-26T20:41:52.375 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 60193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-26T20:41:52.375 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 69009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-26T20:41:52.375 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 47977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-26T20:41:52.375 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-26T20:41:52.375 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-26T20:41:52.375 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9052-hwmon.ko 2024-04-26T20:41:52.375 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9055-hwmon.ko 2024-04-26T20:41:52.375 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-26T20:41:52.375 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 113201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-26T20:41:52.376 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-26T20:41:52.376 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-26T20:41:52.376 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-26T20:41:52.376 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 40177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc2103.ko 2024-04-26T20:41:52.376 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-26T20:41:52.376 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 78921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-26T20:41:52.376 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 108961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-26T20:41:52.376 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 50697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-26T20:41:52.376 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-26T20:41:52.376 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 65769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-26T20:41:52.376 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-26T20:41:52.376 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-26T20:41:52.376 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 59761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-26T20:41:52.376 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 56313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-26T20:41:52.376 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hih6130.ko 2024-04-26T20:41:52.377 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-26T20:41:52.377 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-26T20:41:52.377 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-26T20:41:52.377 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 42585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-26T20:41:52.377 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-26T20:41:52.377 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-26T20:41:52.377 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-26T20:41:52.377 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 156465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-26T20:41:52.377 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/jc42.ko 2024-04-26T20:41:52.377 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-26T20:41:52.377 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-26T20:41:52.377 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-26T20:41:52.377 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 57769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-26T20:41:52.377 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-26T20:41:52.378 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-26T20:41:52.378 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-26T20:41:52.378 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-26T20:41:52.378 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-26T20:41:52.378 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-26T20:41:52.378 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 86497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-26T20:41:52.378 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 55641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-26T20:41:52.378 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-26T20:41:52.378 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-26T20:41:52.378 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 131505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-26T20:41:52.378 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 40225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-26T20:41:52.378 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-26T20:41:52.378 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-26T20:41:52.378 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-26T20:41:52.379 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-26T20:41:52.379 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-26T20:41:52.379 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-26T20:41:52.379 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-26T20:41:52.379 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-26T20:41:52.379 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-26T20:41:52.379 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-26T20:41:52.379 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-26T20:41:52.379 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-26T20:41:52.379 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-26T20:41:52.379 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-26T20:41:52.379 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-26T20:41:52.379 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-26T20:41:52.379 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mc13783-adc.ko 2024-04-26T20:41:52.379 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-26T20:41:52.380 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-04-26T20:41:52.380 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 56505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-26T20:41:52.380 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 141353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-26T20:41:52.380 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 72737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-26T20:41:52.380 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 67841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-26T20:41:52.380 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 97777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-26T20:41:52.380 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 61921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-26T20:41:52.380 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-26T20:41:52.380 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ 2024-04-26T20:41:52.380 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-26T20:41:52.380 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-26T20:41:52.380 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-26T20:41:52.380 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-26T20:41:52.380 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-26T20:41:52.380 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-26T20:41:52.380 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-26T20:41:52.381 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 101233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-26T20:41:52.381 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-26T20:41:52.381 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-26T20:41:52.381 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-26T20:41:52.381 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-26T20:41:52.381 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-26T20:41:52.381 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-26T20:41:52.381 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-26T20:41:52.381 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-26T20:41:52.381 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 40849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-26T20:41:52.381 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-26T20:41:52.381 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-26T20:41:52.381 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 48713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-26T20:41:52.381 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-26T20:41:52.381 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 46473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-26T20:41:52.382 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-26T20:41:52.382 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-26T20:41:52.382 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-26T20:41:52.382 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-26T20:41:52.382 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-26T20:41:52.382 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-26T20:41:52.382 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-26T20:41:52.382 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 50217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-26T20:41:52.382 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 59665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-26T20:41:52.382 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 62737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-26T20:41:52.382 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 71169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-26T20:41:52.382 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 96577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-26T20:41:52.382 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 85913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-26T20:41:52.382 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 75129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-26T20:41:52.383 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 83425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-26T20:41:52.383 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 116777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-26T20:41:52.383 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 134441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-26T20:41:52.383 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-26T20:41:52.383 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 43385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-26T20:41:52.383 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-04-26T20:41:52.383 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-04-26T20:41:52.383 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/ 2024-04-26T20:41:52.383 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/ 2024-04-26T20:41:52.383 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-26T20:41:52.383 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-26T20:41:52.383 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/ 2024-04-26T20:41:52.383 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-04-26T20:41:52.383 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-04-26T20:41:52.383 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-04-26T20:41:52.383 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-26T20:41:52.384 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-26T20:41:52.384 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-26T20:41:52.384 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-04-26T20:41:52.384 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-26T20:41:52.384 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-04-26T20:41:52.384 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 64233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-26T20:41:52.384 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-26T20:41:52.384 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-26T20:41:52.384 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-26T20:41:52.384 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-04-26T20:41:52.384 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-04-26T20:41:52.384 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 76969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-26T20:41:52.384 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-26T20:41:52.384 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 52937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-26T20:41:52.385 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-04-26T20:41:52.385 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-26T20:41:52.385 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-26T20:41:52.385 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-04-26T20:41:52.385 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-26T20:41:52.385 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-26T20:41:52.385 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 57217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-26T20:41:52.385 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-04-26T20:41:52.385 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-26T20:41:52.385 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-26T20:41:52.385 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-04-26T20:41:52.385 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-04-26T20:41:52.385 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-26T20:41:52.385 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-04-26T20:41:52.385 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-26T20:41:52.386 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-26T20:41:52.386 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-26T20:41:52.386 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-26T20:41:52.386 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 59193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-04-26T20:41:52.386 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-26T20:41:52.386 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-26T20:41:52.386 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-26T20:41:52.386 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/ 2024-04-26T20:41:52.386 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-04-26T20:41:52.386 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-04-26T20:41:52.386 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-04-26T20:41:52.386 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ 2024-04-26T20:41:52.386 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ 2024-04-26T20:41:52.386 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 329697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-26T20:41:52.387 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1119913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-26T20:41:52.387 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 83905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-26T20:41:52.387 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 408433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-26T20:41:52.387 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 120921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-26T20:41:52.387 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 347217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-26T20:41:52.387 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 84945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-26T20:41:52.387 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ 2024-04-26T20:41:52.387 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/ 2024-04-26T20:41:52.387 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 590929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-26T20:41:52.387 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/ 2024-04-26T20:41:52.387 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 514641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-26T20:41:52.387 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/ 2024-04-26T20:41:52.387 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 911665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-26T20:41:52.387 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ 2024-04-26T20:41:52.387 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 375545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-26T20:41:52.387 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ 2024-04-26T20:41:52.388 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 197121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-04-26T20:41:52.388 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/ 2024-04-26T20:41:52.388 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 212553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-04-26T20:41:52.388 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ 2024-04-26T20:41:52.388 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ 2024-04-26T20:41:52.388 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 334401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-26T20:41:52.388 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ 2024-04-26T20:41:52.388 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 120673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-26T20:41:52.388 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ 2024-04-26T20:41:52.388 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 132585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-26T20:41:52.388 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ 2024-04-26T20:41:52.388 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 157937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-26T20:41:52.388 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ 2024-04-26T20:41:52.388 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 156673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-26T20:41:52.388 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ 2024-04-26T20:41:52.388 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/evbug.ko 2024-04-26T20:41:52.389 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ff-memless.ko 2024-04-26T20:41:52.389 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/ 2024-04-26T20:41:52.389 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-26T20:41:52.389 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-26T20:41:52.389 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 50713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-26T20:41:52.389 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 49441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-26T20:41:52.389 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/ 2024-04-26T20:41:52.389 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-04-26T20:41:52.389 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-04-26T20:41:52.389 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-04-26T20:41:52.389 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-04-26T20:41:52.389 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 45473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-26T20:41:52.389 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-04-26T20:41:52.389 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lkkbd.ko 2024-04-26T20:41:52.389 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8323.ko 2024-04-26T20:41:52.389 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8333.ko 2024-04-26T20:41:52.389 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-04-26T20:41:52.390 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-04-26T20:41:52.390 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-04-26T20:41:52.390 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-04-26T20:41:52.390 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/newtonkbd.ko 2024-04-26T20:41:52.390 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-04-26T20:41:52.390 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt1070.ko 2024-04-26T20:41:52.390 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt2160.ko 2024-04-26T20:41:52.390 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-04-26T20:41:52.390 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/stowaway.ko 2024-04-26T20:41:52.390 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/sunkbd.ko 2024-04-26T20:41:52.390 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-04-26T20:41:52.390 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-04-26T20:41:52.390 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-04-26T20:41:52.390 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/xtkbd.ko 2024-04-26T20:41:52.390 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/matrix-keymap.ko 2024-04-26T20:41:52.391 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/ 2024-04-26T20:41:52.391 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 40617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-26T20:41:52.391 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-26T20:41:52.391 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 160017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-26T20:41:52.391 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 114273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-26T20:41:52.391 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/gpio_mouse.ko 2024-04-26T20:41:52.391 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 428185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/psmouse.ko 2024-04-26T20:41:52.391 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-26T20:41:52.391 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-26T20:41:52.391 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-26T20:41:52.391 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-26T20:41:52.391 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/ 2024-04-26T20:41:52.391 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 140969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-26T20:41:52.391 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ 2024-04-26T20:41:52.391 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-26T20:41:52.391 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-26T20:41:52.392 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ct82c710.ko 2024-04-26T20:41:52.392 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-26T20:41:52.392 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/parkbd.ko 2024-04-26T20:41:52.392 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/pcips2.ko 2024-04-26T20:41:52.392 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ps2mult.ko 2024-04-26T20:41:52.392 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-26T20:41:52.392 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serport.ko 2024-04-26T20:41:52.392 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-26T20:41:52.392 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/ 2024-04-26T20:41:52.392 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-88pm860x.ko 2024-04-26T20:41:52.392 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-adp5520.ko 2024-04-26T20:41:52.392 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 77265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-bd2802.ko 2024-04-26T20:41:52.392 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-26T20:41:52.392 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da903x.ko 2024-04-26T20:41:52.393 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da9052.ko 2024-04-26T20:41:52.393 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-gpio.ko 2024-04-26T20:41:52.393 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-26T20:41:52.393 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3533.ko 2024-04-26T20:41:52.393 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm355x.ko 2024-04-26T20:41:52.393 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3642.ko 2024-04-26T20:41:52.393 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-26T20:41:52.393 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp8788.ko 2024-04-26T20:41:52.393 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-max8997.ko 2024-04-26T20:41:52.393 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-mc13783.ko 2024-04-26T20:41:52.393 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-menf21bmc.ko 2024-04-26T20:41:52.393 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca9532.ko 2024-04-26T20:41:52.393 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca955x.ko 2024-04-26T20:41:52.393 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca963x.ko 2024-04-26T20:41:52.393 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-26T20:41:52.393 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-tca6507.ko 2024-04-26T20:41:52.393 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm831x-status.ko 2024-04-26T20:41:52.394 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm8350.ko 2024-04-26T20:41:52.394 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ 2024-04-26T20:41:52.394 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-26T20:41:52.394 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-26T20:41:52.394 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-26T20:41:52.394 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-26T20:41:52.394 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-26T20:41:52.394 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-26T20:41:52.394 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-26T20:41:52.394 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-26T20:41:52.394 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-26T20:41:52.394 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/ 2024-04-26T20:41:52.394 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/ 2024-04-26T20:41:52.394 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 790753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-26T20:41:52.395 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-26T20:41:52.395 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 116825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bufio.ko 2024-04-26T20:41:52.395 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 58281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-26T20:41:52.395 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 199041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-26T20:41:52.395 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 134945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-26T20:41:52.395 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-26T20:41:52.395 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 67497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-era.ko 2024-04-26T20:41:52.395 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-26T20:41:52.395 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 50457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-26T20:41:52.395 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log.ko 2024-04-26T20:41:52.395 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 60977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-mirror.ko 2024-04-26T20:41:52.395 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 97209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-26T20:41:52.395 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-26T20:41:52.395 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 85689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-26T20:41:52.395 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-region-hash.ko 2024-04-26T20:41:52.396 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-26T20:41:52.396 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-26T20:41:52.396 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-snapshot.ko 2024-04-26T20:41:52.396 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-26T20:41:52.396 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 234457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-26T20:41:52.396 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 66425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-26T20:41:52.396 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-zero.ko 2024-04-26T20:41:52.396 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/ 2024-04-26T20:41:52.396 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 264329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-26T20:41:52.396 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 43137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-26T20:41:52.396 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 125009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-26T20:41:52.396 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 157681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-26T20:41:52.396 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 444665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-26T20:41:52.441 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/ 2024-04-26T20:41:52.441 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/ 2024-04-26T20:41:52.441 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 214841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-26T20:41:52.441 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 77985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-26T20:41:52.441 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 54785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-26T20:41:52.441 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-26T20:41:52.441 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 150761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-26T20:41:52.441 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 97281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-26T20:41:52.441 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 63873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-26T20:41:52.441 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/ 2024-04-26T20:41:52.441 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm800.ko 2024-04-26T20:41:52.442 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm805.ko 2024-04-26T20:41:52.442 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm80x.ko 2024-04-26T20:41:52.442 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona-i2c.ko 2024-04-26T20:41:52.442 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 148633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona.ko 2024-04-26T20:41:52.442 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/bcm590xx.ko 2024-04-26T20:41:52.442 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/cros_ec_dev.ko 2024-04-26T20:41:52.442 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/dln2.ko 2024-04-26T20:41:52.442 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/janz-cmodio.ko 2024-04-26T20:41:52.442 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 59089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/kempld-core.ko 2024-04-26T20:41:52.442 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-core.ko 2024-04-26T20:41:52.442 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-04-26T20:41:52.442 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lp3943.ko 2024-04-26T20:41:52.442 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 60497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-26T20:41:52.442 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-26T20:41:52.442 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/max8907.ko 2024-04-26T20:41:52.442 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-core.ko 2024-04-26T20:41:52.443 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-04-26T20:41:52.443 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/menf21bmc.ko 2024-04-26T20:41:52.443 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-adc.ko 2024-04-26T20:41:52.443 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-gpio.ko 2024-04-26T20:41:52.443 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633.ko 2024-04-26T20:41:52.443 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-04-26T20:41:52.443 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/retu-mfd.ko 2024-04-26T20:41:52.443 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 99425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/si476x-core.ko 2024-04-26T20:41:52.443 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 58057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-26T20:41:52.443 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 60681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps65010.ko 2024-04-26T20:41:52.443 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps6507x.ko 2024-04-26T20:41:52.443 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-26T20:41:52.443 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-26T20:41:52.443 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-26T20:41:52.443 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 52361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wm8994.ko 2024-04-26T20:41:52.443 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ 2024-04-26T20:41:52.444 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-04-26T20:41:52.444 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 64265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot.ko 2024-04-26T20:41:52.444 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/ 2024-04-26T20:41:52.444 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 57521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-26T20:41:52.444 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-26T20:41:52.444 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-26T20:41:52.444 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 58633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-26T20:41:52.444 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/ 2024-04-26T20:41:52.444 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-04-26T20:41:52.444 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 47449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/core.ko 2024-04-26T20:41:52.444 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/ 2024-04-26T20:41:52.444 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-26T20:41:52.444 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ds1682.ko 2024-04-26T20:41:52.444 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/dummy-irq.ko 2024-04-26T20:41:52.444 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/ 2024-04-26T20:41:52.444 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/echo.ko 2024-04-26T20:41:52.445 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/ 2024-04-26T20:41:52.445 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 43041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-26T20:41:52.445 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-26T20:41:52.445 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-26T20:41:52.445 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-26T20:41:52.445 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/ 2024-04-26T20:41:52.445 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 191649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-04-26T20:41:52.445 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hmc6352.ko 2024-04-26T20:41:52.445 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-26T20:41:52.445 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ 2024-04-26T20:41:52.445 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 92345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-04-26T20:41:52.445 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ics932s401.ko 2024-04-26T20:41:52.445 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-26T20:41:52.445 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-26T20:41:52.445 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/ 2024-04-26T20:41:52.445 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 54865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-26T20:41:52.446 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-26T20:41:52.446 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/ 2024-04-26T20:41:52.446 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 154169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-26T20:41:52.446 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 69809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-26T20:41:52.446 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 389033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-26T20:41:52.446 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/phantom.ko 2024-04-26T20:41:52.446 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/ 2024-04-26T20:41:52.446 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 91145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/st_drv.ko 2024-04-26T20:41:52.446 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-26T20:41:52.446 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-26T20:41:52.446 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-26T20:41:52.446 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 55793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-26T20:41:52.446 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/ 2024-04-26T20:41:52.446 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 234905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-26T20:41:52.446 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ 2024-04-26T20:41:52.447 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/ 2024-04-26T20:41:52.447 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 620961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-26T20:41:52.447 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/ 2024-04-26T20:41:52.447 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/ 2024-04-26T20:41:52.447 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-26T20:41:52.447 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 49545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-26T20:41:52.447 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-26T20:41:52.447 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/ 2024-04-26T20:41:52.447 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 587065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-26T20:41:52.447 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-26T20:41:52.447 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-26T20:41:52.447 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ 2024-04-26T20:41:52.447 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/ 2024-04-26T20:41:52.447 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 53753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-26T20:41:52.447 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 49201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-26T20:41:52.448 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 158649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-26T20:41:52.448 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 85953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-26T20:41:52.448 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ 2024-04-26T20:41:52.448 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-26T20:41:52.448 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-26T20:41:52.448 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-26T20:41:52.448 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 109521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-26T20:41:52.448 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/ 2024-04-26T20:41:52.448 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 64705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-26T20:41:52.448 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/ 2024-04-26T20:41:52.448 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 84329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-26T20:41:52.448 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/ 2024-04-26T20:41:52.448 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 70737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-26T20:41:52.448 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/ 2024-04-26T20:41:52.448 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 52705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-26T20:41:52.449 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/ 2024-04-26T20:41:52.449 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 65857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-26T20:41:52.449 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 56057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-26T20:41:52.449 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 115881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-26T20:41:52.449 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/ 2024-04-26T20:41:52.449 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/ 2024-04-26T20:41:52.449 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 124497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-26T20:41:52.449 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-04-26T20:41:52.449 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 128409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-26T20:41:52.449 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-04-26T20:41:52.449 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 110345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-26T20:41:52.449 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/ 2024-04-26T20:41:52.449 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 101857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-26T20:41:52.449 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 88953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-26T20:41:52.449 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/ 2024-04-26T20:41:52.449 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 105633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-26T20:41:52.449 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 228985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-26T20:41:52.450 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-04-26T20:41:52.450 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1733353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-26T20:41:52.450 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 167185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-26T20:41:52.450 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/ 2024-04-26T20:41:52.450 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 161417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-26T20:41:52.450 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 440625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-26T20:41:52.450 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/ 2024-04-26T20:41:52.450 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/ 2024-04-26T20:41:52.450 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 432201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-26T20:41:52.450 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/ 2024-04-26T20:41:52.450 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-04-26T20:41:52.450 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 257201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-26T20:41:52.450 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-04-26T20:41:52.450 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 446177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-26T20:41:52.450 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-04-26T20:41:52.450 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1311433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-26T20:41:52.451 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-04-26T20:41:52.451 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 206689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-26T20:41:52.451 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-04-26T20:41:52.451 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 40161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-26T20:41:52.451 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/ 2024-04-26T20:41:52.451 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/ 2024-04-26T20:41:52.451 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 269313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-26T20:41:52.451 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/ 2024-04-26T20:41:52.451 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/ 2024-04-26T20:41:52.451 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 85385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-26T20:41:52.451 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 77457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-26T20:41:52.451 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 169089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-26T20:41:52.451 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-26T20:41:52.451 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 76209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-26T20:41:52.451 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-26T20:41:52.451 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/ 2024-04-26T20:41:52.452 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 75945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-26T20:41:52.452 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 78705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-26T20:41:52.452 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-26T20:41:52.452 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ec_bhf.ko 2024-04-26T20:41:52.452 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/ 2024-04-26T20:41:52.452 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/ 2024-04-26T20:41:52.452 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 356377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-26T20:41:52.452 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 61737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-26T20:41:52.452 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 63185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-26T20:41:52.452 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/ 2024-04-26T20:41:52.452 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 51513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-04-26T20:41:52.452 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ 2024-04-26T20:41:52.452 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 115569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-26T20:41:52.452 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/ 2024-04-26T20:41:52.452 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 366217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-26T20:41:52.452 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/ 2024-04-26T20:41:52.453 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 755793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-26T20:41:52.453 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/ 2024-04-26T20:41:52.453 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 324577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-26T20:41:52.453 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/ 2024-04-26T20:41:52.453 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1196297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-26T20:41:52.453 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/ 2024-04-26T20:41:52.453 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 362593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-26T20:41:52.453 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/ 2024-04-26T20:41:52.453 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 671801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-26T20:41:52.453 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/ 2024-04-26T20:41:52.453 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 121537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-26T20:41:52.453 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-04-26T20:41:52.453 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 966705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-26T20:41:52.453 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-04-26T20:41:52.453 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 193585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-26T20:41:52.454 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 108633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-26T20:41:52.454 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/ 2024-04-26T20:41:52.454 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-26T20:41:52.454 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 126881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-26T20:41:52.454 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 150777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-26T20:41:52.454 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/ 2024-04-26T20:41:52.454 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-04-26T20:41:52.454 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 905033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-26T20:41:52.454 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 344145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-26T20:41:52.454 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-04-26T20:41:52.454 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-04-26T20:41:52.454 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1412417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-26T20:41:52.454 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ 2024-04-26T20:41:52.454 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-04-26T20:41:52.454 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 54497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-04-26T20:41:52.454 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-04-26T20:41:52.455 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 117353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-26T20:41:52.455 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/ 2024-04-26T20:41:52.455 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-04-26T20:41:52.455 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 131425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-26T20:41:52.455 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ 2024-04-26T20:41:52.455 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 91465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-26T20:41:52.455 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 56689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-26T20:41:52.455 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/ 2024-04-26T20:41:52.455 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 181081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-26T20:41:52.455 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/ 2024-04-26T20:41:52.455 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 171417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-26T20:41:52.455 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/ 2024-04-26T20:41:52.455 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 58249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-26T20:41:52.455 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 50121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-26T20:41:52.455 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/ 2024-04-26T20:41:52.455 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-04-26T20:41:52.456 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 300817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-26T20:41:52.456 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 105689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-26T20:41:52.456 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-04-26T20:41:52.456 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 885129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-26T20:41:52.456 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/ 2024-04-26T20:41:52.456 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 52305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-26T20:41:52.456 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/ 2024-04-26T20:41:52.456 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 81641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-26T20:41:52.456 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 100689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-26T20:41:52.456 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-26T20:41:52.456 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 264161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-26T20:41:52.456 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/ 2024-04-26T20:41:52.456 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-04-26T20:41:52.456 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 142449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-04-26T20:41:52.456 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/ 2024-04-26T20:41:52.456 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1350385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-26T20:41:52.457 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/ 2024-04-26T20:41:52.457 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 57953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-26T20:41:52.457 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/ 2024-04-26T20:41:52.457 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 66505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-26T20:41:52.457 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 80065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-26T20:41:52.457 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/ 2024-04-26T20:41:52.457 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 74289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-26T20:41:52.457 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 79457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-26T20:41:52.457 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 100785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-26T20:41:52.457 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 83441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-26T20:41:52.457 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/ 2024-04-26T20:41:52.457 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-04-26T20:41:52.457 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-04-26T20:41:52.457 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 46985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-26T20:41:52.457 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-04-26T20:41:52.458 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 644537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-26T20:41:52.458 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/ 2024-04-26T20:41:52.458 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 128497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-26T20:41:52.458 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 207993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-26T20:41:52.458 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 82633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-26T20:41:52.458 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 91353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-26T20:41:52.458 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/ 2024-04-26T20:41:52.458 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 59865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-26T20:41:52.458 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/ 2024-04-26T20:41:52.458 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 110729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-26T20:41:52.458 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/ 2024-04-26T20:41:52.458 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 98689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-26T20:41:52.458 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 102513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-26T20:41:52.458 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/ 2024-04-26T20:41:52.458 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 61497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-26T20:41:52.459 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 40609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-26T20:41:52.459 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/ 2024-04-26T20:41:52.459 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 69913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-26T20:41:52.459 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/ 2024-04-26T20:41:52.459 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 49449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/defxx.ko 2024-04-26T20:41:52.459 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/ 2024-04-26T20:41:52.459 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 275801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/skfp.ko 2024-04-26T20:41:52.459 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 91105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-26T20:41:52.459 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/ 2024-04-26T20:41:52.459 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 290441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-26T20:41:52.459 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/ 2024-04-26T20:41:52.459 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-26T20:41:52.459 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-26T20:41:52.459 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ 2024-04-26T20:41:52.459 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 108329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-26T20:41:52.459 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 78065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-26T20:41:52.460 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-26T20:41:52.460 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/ 2024-04-26T20:41:52.460 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-26T20:41:52.460 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-26T20:41:52.460 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-gpio.ko 2024-04-26T20:41:52.460 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-26T20:41:52.460 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-26T20:41:52.460 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-26T20:41:52.460 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 62681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-26T20:41:52.460 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-26T20:41:52.460 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/ 2024-04-26T20:41:52.460 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-26T20:41:52.460 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 48313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-26T20:41:52.460 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ 2024-04-26T20:41:52.460 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-26T20:41:52.460 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 61985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-26T20:41:52.461 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 52865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-26T20:41:52.461 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-26T20:41:52.461 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 53409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-26T20:41:52.461 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-26T20:41:52.461 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-26T20:41:52.461 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-26T20:41:52.461 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-26T20:41:52.461 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-26T20:41:52.461 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 103377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-26T20:41:52.461 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 96025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-26T20:41:52.461 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-26T20:41:52.461 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 121105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-26T20:41:52.461 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-26T20:41:52.461 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 62113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-26T20:41:52.461 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-26T20:41:52.461 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-26T20:41:52.462 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-26T20:41:52.462 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/ 2024-04-26T20:41:52.462 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 55353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/plip.ko 2024-04-26T20:41:52.462 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ 2024-04-26T20:41:52.462 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-26T20:41:52.462 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-26T20:41:52.462 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-26T20:41:52.462 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-26T20:41:52.462 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-26T20:41:52.462 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 53233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-26T20:41:52.462 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-26T20:41:52.462 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-26T20:41:52.462 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sb1000.ko 2024-04-26T20:41:52.462 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/ 2024-04-26T20:41:52.462 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 52073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-26T20:41:52.462 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 42409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-26T20:41:52.463 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 80161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-26T20:41:52.463 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/ 2024-04-26T20:41:52.463 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 137321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-26T20:41:52.463 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-26T20:41:52.463 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-26T20:41:52.463 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-26T20:41:52.463 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-26T20:41:52.463 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-26T20:41:52.463 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 108089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-26T20:41:52.463 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/ 2024-04-26T20:41:52.463 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 176497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-26T20:41:52.463 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/ 2024-04-26T20:41:52.463 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 383593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-26T20:41:52.463 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/ 2024-04-26T20:41:52.463 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 175537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-26T20:41:52.463 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ 2024-04-26T20:41:52.464 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-26T20:41:52.464 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/ 2024-04-26T20:41:52.464 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/ 2024-04-26T20:41:52.464 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 335857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-26T20:41:52.464 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 126553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-26T20:41:52.464 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/ 2024-04-26T20:41:52.464 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 168145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-26T20:41:52.464 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-26T20:41:52.464 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 103889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-26T20:41:52.464 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-26T20:41:52.464 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/ 2024-04-26T20:41:52.464 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/ 2024-04-26T20:41:52.464 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-26T20:41:52.464 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-04-26T20:41:52.464 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-04-26T20:41:52.464 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pci-stub.ko 2024-04-26T20:41:52.464 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 55329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-26T20:41:52.465 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/ 2024-04-26T20:41:52.465 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-26T20:41:52.465 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 179961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia.ko 2024-04-26T20:41:52.465 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 78161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_core.ko 2024-04-26T20:41:52.465 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-04-26T20:41:52.465 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 40457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-26T20:41:52.465 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 133753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-26T20:41:52.465 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/ 2024-04-26T20:41:52.465 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/ 2024-04-26T20:41:52.465 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-04-26T20:41:52.465 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/ 2024-04-26T20:41:52.465 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-04-26T20:41:52.465 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/ 2024-04-26T20:41:52.465 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/ 2024-04-26T20:41:52.465 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 78193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-26T20:41:52.465 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/ 2024-04-26T20:41:52.465 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/ 2024-04-26T20:41:52.466 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 61041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-04-26T20:41:52.466 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec.ko 2024-04-26T20:41:52.466 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-04-26T20:41:52.466 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-04-26T20:41:52.466 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-04-26T20:41:52.466 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-04-26T20:41:52.466 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-04-26T20:41:52.466 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ 2024-04-26T20:41:52.466 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 87481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-26T20:41:52.466 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-26T20:41:52.466 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 48257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-26T20:41:52.466 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-26T20:41:52.466 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-26T20:41:52.466 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 164769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-26T20:41:52.466 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 46185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-26T20:41:52.467 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 62073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-26T20:41:52.467 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-26T20:41:52.467 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 51881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-26T20:41:52.467 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-26T20:41:52.467 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 42761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-26T20:41:52.467 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ibm_rtl.ko 2024-04-26T20:41:52.467 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/ 2024-04-26T20:41:52.467 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-26T20:41:52.467 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-04-26T20:41:52.467 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 54001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-26T20:41:52.467 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-26T20:41:52.467 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-26T20:41:52.467 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 43753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-26T20:41:52.467 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-26T20:41:52.467 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-26T20:41:52.468 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-26T20:41:52.468 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-26T20:41:52.468 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-26T20:41:52.468 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-26T20:41:52.468 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 61417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-26T20:41:52.468 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/ 2024-04-26T20:41:52.468 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ 2024-04-26T20:41:52.468 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_battery.ko 2024-04-26T20:41:52.468 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 40425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_charger.ko 2024-04-26T20:41:52.468 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 68833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq2415x_charger.ko 2024-04-26T20:41:52.468 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 73073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24190_charger.ko 2024-04-26T20:41:52.468 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24735-charger.ko 2024-04-26T20:41:52.468 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-04-26T20:41:52.468 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9030_battery.ko 2024-04-26T20:41:52.468 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9052-battery.ko 2024-04-26T20:41:52.468 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2760_battery.ko 2024-04-26T20:41:52.469 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2780_battery.ko 2024-04-26T20:41:52.469 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2781_battery.ko 2024-04-26T20:41:52.469 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2782_battery.ko 2024-04-26T20:41:52.469 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/gpio-charger.ko 2024-04-26T20:41:52.469 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/isp1704_charger.ko 2024-04-26T20:41:52.469 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/lp8727_charger.ko 2024-04-26T20:41:52.469 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max14577_charger.ko 2024-04-26T20:41:52.469 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max17042_battery.ko 2024-04-26T20:41:52.469 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8903_charger.ko 2024-04-26T20:41:52.469 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8925_power.ko 2024-04-26T20:41:52.469 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/pcf50633-charger.ko 2024-04-26T20:41:52.469 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/sbs-battery.ko 2024-04-26T20:41:52.469 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/test_power.ko 2024-04-26T20:41:52.469 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/tps65090-charger.ko 2024-04-26T20:41:52.469 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_backup.ko 2024-04-26T20:41:52.469 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_power.ko 2024-04-26T20:41:52.470 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm8350_power.ko 2024-04-26T20:41:52.470 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/ 2024-04-26T20:41:52.470 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 73297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-26T20:41:52.470 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-26T20:41:52.470 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/ 2024-04-26T20:41:52.470 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/ 2024-04-26T20:41:52.470 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-26T20:41:52.470 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-26T20:41:52.470 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-26T20:41:52.470 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 49817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-26T20:41:52.470 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ 2024-04-26T20:41:52.470 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 91393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-26T20:41:52.470 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-26T20:41:52.471 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/ 2024-04-26T20:41:52.471 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/ 2024-04-26T20:41:52.471 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/ 2024-04-26T20:41:52.471 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 67513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-26T20:41:52.471 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 47137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-26T20:41:52.471 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/ 2024-04-26T20:41:52.471 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm80x.ko 2024-04-26T20:41:52.471 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm860x.ko 2024-04-26T20:41:52.471 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-26T20:41:52.471 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9052.ko 2024-04-26T20:41:52.471 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9055.ko 2024-04-26T20:41:52.471 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9063.ko 2024-04-26T20:41:52.471 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-26T20:41:52.471 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 82225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-26T20:41:52.471 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-26T20:41:52.471 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-26T20:41:52.471 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-26T20:41:52.472 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-26T20:41:52.472 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-26T20:41:52.472 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-26T20:41:52.472 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-26T20:41:52.472 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-26T20:41:52.472 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-26T20:41:52.472 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-26T20:41:52.472 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-26T20:41:52.472 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-lp8788.ko 2024-04-26T20:41:52.472 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 46913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-26T20:41:52.472 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-26T20:41:52.472 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-26T20:41:52.472 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t86.ko 2024-04-26T20:41:52.472 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-26T20:41:52.472 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8907.ko 2024-04-26T20:41:52.472 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8925.ko 2024-04-26T20:41:52.473 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8997.ko 2024-04-26T20:41:52.473 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8998.ko 2024-04-26T20:41:52.473 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-04-26T20:41:52.473 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-26T20:41:52.473 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-palmas.ko 2024-04-26T20:41:52.473 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 56777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-26T20:41:52.473 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf50633.ko 2024-04-26T20:41:52.473 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-26T20:41:52.473 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-26T20:41:52.473 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-26T20:41:52.473 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-26T20:41:52.473 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rc5t583.ko 2024-04-26T20:41:52.473 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-26T20:41:52.473 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-26T20:41:52.473 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-26T20:41:52.473 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-26T20:41:52.474 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-26T20:41:52.474 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-s35390a.ko 2024-04-26T20:41:52.474 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-26T20:41:52.474 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps6586x.ko 2024-04-26T20:41:52.474 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps65910.ko 2024-04-26T20:41:52.474 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm831x.ko 2024-04-26T20:41:52.474 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm8350.ko 2024-04-26T20:41:52.474 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-26T20:41:52.474 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ 2024-04-26T20:41:52.474 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 90377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-26T20:41:52.474 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 69593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-26T20:41:52.474 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 65945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-26T20:41:52.474 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 164569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-26T20:41:52.474 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-26T20:41:52.474 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/ 2024-04-26T20:41:52.474 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 340721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-26T20:41:52.475 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 120337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-26T20:41:52.475 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/ 2024-04-26T20:41:52.475 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 468081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-26T20:41:52.475 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 380673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-26T20:41:52.475 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/ 2024-04-26T20:41:52.475 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 243705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-04-26T20:41:52.475 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-26T20:41:52.475 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/ 2024-04-26T20:41:52.475 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 135617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-26T20:41:52.475 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-26T20:41:52.475 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/ 2024-04-26T20:41:52.475 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 304993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-26T20:41:52.475 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/ 2024-04-26T20:41:52.475 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1527113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-26T20:41:52.475 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/ 2024-04-26T20:41:52.475 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 297801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-26T20:41:52.476 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/ 2024-04-26T20:41:52.476 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 144401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-26T20:41:52.476 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 47457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-26T20:41:52.476 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/ 2024-04-26T20:41:52.476 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 390713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-26T20:41:52.476 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/ 2024-04-26T20:41:52.476 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-04-26T20:41:52.476 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 88881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-26T20:41:52.476 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-04-26T20:41:52.476 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 117481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-26T20:41:52.476 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 173017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-26T20:41:52.476 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 91569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-26T20:41:52.476 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 45401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-26T20:41:52.476 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/ 2024-04-26T20:41:52.476 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 267577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-26T20:41:52.477 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-26T20:41:52.477 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/ 2024-04-26T20:41:52.477 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 95329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-26T20:41:52.477 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 194017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-26T20:41:52.477 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fdomain.ko 2024-04-26T20:41:52.477 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/ 2024-04-26T20:41:52.477 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 366529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-26T20:41:52.477 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 251505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-26T20:41:52.477 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 65761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-26T20:41:52.477 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 57097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-26T20:41:52.477 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/imm.ko 2024-04-26T20:41:52.477 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 55153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-26T20:41:52.477 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 327841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-26T20:41:52.477 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 129785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-26T20:41:52.477 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/ 2024-04-26T20:41:52.477 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 397785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-26T20:41:52.478 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-26T20:41:52.478 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 63121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-26T20:41:52.478 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/ 2024-04-26T20:41:52.478 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 386849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-26T20:41:52.478 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 178177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-26T20:41:52.478 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 64809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-26T20:41:52.478 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/ 2024-04-26T20:41:52.478 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 274009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-26T20:41:52.478 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/ 2024-04-26T20:41:52.478 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 2736001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-26T20:41:52.478 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/ 2024-04-26T20:41:52.478 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 88529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-26T20:41:52.478 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 40145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-26T20:41:52.478 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 389177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-26T20:41:52.478 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 104769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-26T20:41:52.479 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/ 2024-04-26T20:41:52.479 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 836945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-26T20:41:52.479 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/ 2024-04-26T20:41:52.479 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 158729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-26T20:41:52.479 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 96537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-26T20:41:52.479 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/ 2024-04-26T20:41:52.479 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 101625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-04-26T20:41:52.479 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-04-26T20:41:52.479 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-04-26T20:41:52.479 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-04-26T20:41:52.479 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/ 2024-04-26T20:41:52.479 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 443745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-26T20:41:52.479 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 152033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-26T20:41:52.479 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ppa.ko 2024-04-26T20:41:52.479 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 66977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-26T20:41:52.479 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/ 2024-04-26T20:41:52.479 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 2324809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-26T20:41:52.516 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 103601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-26T20:41:52.516 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/ 2024-04-26T20:41:52.516 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 697337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-26T20:41:52.516 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qlogicfas408.ko 2024-04-26T20:41:52.516 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-26T20:41:52.516 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 322865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-26T20:41:52.517 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 219857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-26T20:41:52.517 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 357153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-26T20:41:52.517 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 121185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-26T20:41:52.517 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 93481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-26T20:41:52.517 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 55401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-26T20:41:52.517 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-26T20:41:52.517 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 138121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-26T20:41:52.517 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 57401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-26T20:41:52.517 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/ 2024-04-26T20:41:52.517 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 205025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-26T20:41:52.517 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 55425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-26T20:41:52.517 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 59185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-26T20:41:52.517 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 48777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-26T20:41:52.517 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 59417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/xen-scsifront.ko 2024-04-26T20:41:52.517 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ 2024-04-26T20:41:52.517 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 174913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-26T20:41:52.517 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/ 2024-04-26T20:41:52.518 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/ 2024-04-26T20:41:52.518 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 920169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-26T20:41:52.518 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/ 2024-04-26T20:41:52.518 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 60321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-26T20:41:52.518 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 48129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-26T20:41:52.518 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 54233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-26T20:41:52.518 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1170033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-26T20:41:52.518 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-26T20:41:52.518 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 149721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-26T20:41:52.518 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/ 2024-04-26T20:41:52.518 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 90057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-26T20:41:52.518 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/ 2024-04-26T20:41:52.518 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/ 2024-04-26T20:41:52.518 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/ 2024-04-26T20:41:52.518 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-26T20:41:52.519 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-26T20:41:52.519 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-26T20:41:52.519 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-26T20:41:52.519 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-26T20:41:52.519 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-26T20:41:52.519 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-26T20:41:52.519 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-26T20:41:52.519 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-26T20:41:52.519 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-26T20:41:52.519 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-26T20:41:52.519 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-26T20:41:52.519 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 46065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-26T20:41:52.519 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-26T20:41:52.519 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-26T20:41:52.519 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-04-26T20:41:52.520 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-26T20:41:52.520 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-26T20:41:52.520 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-26T20:41:52.520 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ 2024-04-26T20:41:52.520 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ 2024-04-26T20:41:52.520 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 99313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-26T20:41:52.520 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 69729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/moxa.ko 2024-04-26T20:41:52.520 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 61649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/mxser.ko 2024-04-26T20:41:52.520 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 134401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-26T20:41:52.520 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-26T20:41:52.520 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-26T20:41:52.520 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/ 2024-04-26T20:41:52.520 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/ 2024-04-26T20:41:52.520 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-04-26T20:41:52.521 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 65121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-26T20:41:52.521 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-04-26T20:41:52.521 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_uart.ko 2024-04-26T20:41:52.521 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-26T20:41:52.521 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 91665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-04-26T20:41:52.521 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/ 2024-04-26T20:41:52.521 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 120577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-26T20:41:52.521 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/rp2.ko 2024-04-26T20:41:52.521 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 65641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/sc16is7xx.ko 2024-04-26T20:41:52.521 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/ 2024-04-26T20:41:52.521 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ 2024-04-26T20:41:52.521 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 693081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-26T20:41:52.521 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ 2024-04-26T20:41:52.521 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-26T20:41:52.521 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-04-26T20:41:52.522 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/ 2024-04-26T20:41:52.522 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 55617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-26T20:41:52.522 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-26T20:41:52.522 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-26T20:41:52.522 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_dmem_genirq.ko 2024-04-26T20:41:52.522 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_mf624.ko 2024-04-26T20:41:52.522 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_netx.ko 2024-04-26T20:41:52.522 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-26T20:41:52.522 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-04-26T20:41:52.522 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-26T20:41:52.522 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/ 2024-04-26T20:41:52.522 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/ 2024-04-26T20:41:52.522 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 90321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/c67x00.ko 2024-04-26T20:41:52.522 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ 2024-04-26T20:41:52.523 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 189209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-04-26T20:41:52.523 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-04-26T20:41:52.523 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-04-26T20:41:52.523 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-04-26T20:41:52.523 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-04-26T20:41:52.523 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/ 2024-04-26T20:41:52.523 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 101545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-26T20:41:52.523 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 63073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-26T20:41:52.523 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 56721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-26T20:41:52.523 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 107417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-26T20:41:52.523 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ 2024-04-26T20:41:52.523 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ulpi.ko 2024-04-26T20:41:52.523 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/ 2024-04-26T20:41:52.523 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-04-26T20:41:52.523 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/ 2024-04-26T20:41:52.523 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-04-26T20:41:52.524 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-04-26T20:41:52.524 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 574593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3.ko 2024-04-26T20:41:52.524 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/ 2024-04-26T20:41:52.524 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/ 2024-04-26T20:41:52.524 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 72249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_ether.ko 2024-04-26T20:41:52.524 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 61953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_serial.ko 2024-04-26T20:41:52.524 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-04-26T20:41:52.524 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 49737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-04-26T20:41:52.524 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-04-26T20:41:52.524 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-04-26T20:41:52.524 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 131345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-04-26T20:41:52.524 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 62321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-04-26T20:41:52.524 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 146617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-04-26T20:41:52.524 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 70689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-04-26T20:41:52.524 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-04-26T20:41:52.525 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-04-26T20:41:52.525 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 70017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-04-26T20:41:52.525 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 101249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-04-26T20:41:52.525 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-04-26T20:41:52.525 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 71257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-04-26T20:41:52.525 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 84937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-04-26T20:41:52.525 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/ 2024-04-26T20:41:52.525 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-04-26T20:41:52.525 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-04-26T20:41:52.525 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-04-26T20:41:52.525 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-04-26T20:41:52.525 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-04-26T20:41:52.525 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-04-26T20:41:52.525 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-04-26T20:41:52.525 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-04-26T20:41:52.526 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-04-26T20:41:52.526 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-04-26T20:41:52.526 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-04-26T20:41:52.526 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-04-26T20:41:52.526 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 78073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-04-26T20:41:52.526 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-04-26T20:41:52.526 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 204049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/libcomposite.ko 2024-04-26T20:41:52.526 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/ 2024-04-26T20:41:52.526 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-04-26T20:41:52.526 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/ 2024-04-26T20:41:52.526 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 182561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-04-26T20:41:52.526 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 45545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-04-26T20:41:52.526 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 66513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-04-26T20:41:52.526 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 85217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-04-26T20:41:52.526 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 69313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-04-26T20:41:52.527 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 90313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2272.ko 2024-04-26T20:41:52.527 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 90361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2280.ko 2024-04-26T20:41:52.527 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 94841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-04-26T20:41:52.527 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-04-26T20:41:52.527 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 87465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-04-26T20:41:52.527 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 95441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-04-26T20:41:52.527 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 195969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-04-26T20:41:52.527 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ 2024-04-26T20:41:52.527 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/bcma-hcd.ko 2024-04-26T20:41:52.527 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 108321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/isp116x-hcd.ko 2024-04-26T20:41:52.527 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 104377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-04-26T20:41:52.527 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 102273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-04-26T20:41:52.527 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 60105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-26T20:41:52.527 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811_cs.ko 2024-04-26T20:41:52.527 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ssb-hcd.ko 2024-04-26T20:41:52.527 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-04-26T20:41:52.528 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/ 2024-04-26T20:41:52.528 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 40409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-26T20:41:52.528 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-26T20:41:52.528 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ 2024-04-26T20:41:52.528 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 47353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-26T20:41:52.528 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-26T20:41:52.528 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-04-26T20:41:52.528 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cytherm.ko 2024-04-26T20:41:52.528 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ehset.ko 2024-04-26T20:41:52.528 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-26T20:41:52.528 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-26T20:41:52.528 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-26T20:41:52.528 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-26T20:41:52.528 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 42729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-26T20:41:52.528 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-26T20:41:52.529 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 42241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-26T20:41:52.529 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 42233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-26T20:41:52.529 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/lvstest.ko 2024-04-26T20:41:52.529 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/ 2024-04-26T20:41:52.529 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 85313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-26T20:41:52.529 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-26T20:41:52.529 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-26T20:41:52.529 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-26T20:41:52.529 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-26T20:41:52.529 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 84265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbtest.ko 2024-04-26T20:41:52.529 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 52065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-26T20:41:52.529 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-26T20:41:52.529 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/ 2024-04-26T20:41:52.529 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 91529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/usbmon.ko 2024-04-26T20:41:52.529 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/ 2024-04-26T20:41:52.530 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 396209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/musb_hdrc.ko 2024-04-26T20:41:52.530 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/ 2024-04-26T20:41:52.530 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-26T20:41:52.530 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-04-26T20:41:52.530 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-isp1301.ko 2024-04-26T20:41:52.530 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-tahvo.ko 2024-04-26T20:41:52.530 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ 2024-04-26T20:41:52.530 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-26T20:41:52.530 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-26T20:41:52.530 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-26T20:41:52.530 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-26T20:41:52.530 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-26T20:41:52.530 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-26T20:41:52.530 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 66873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-26T20:41:52.530 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 58329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-26T20:41:52.531 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-26T20:41:52.531 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 53009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/f81232.ko 2024-04-26T20:41:52.531 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 188609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-26T20:41:52.531 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 61489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-26T20:41:52.531 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 152305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-26T20:41:52.531 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 142833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-26T20:41:52.531 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 69217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-26T20:41:52.531 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-26T20:41:52.531 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-26T20:41:52.531 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-26T20:41:52.531 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 122329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-26T20:41:52.531 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-26T20:41:52.531 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-26T20:41:52.531 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-26T20:41:52.531 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-26T20:41:52.532 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/metro-usb.ko 2024-04-26T20:41:52.532 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-26T20:41:52.532 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 89969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-26T20:41:52.532 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 65073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mxuport.ko 2024-04-26T20:41:52.532 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-26T20:41:52.532 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-26T20:41:52.532 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-26T20:41:52.532 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 193857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-26T20:41:52.532 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 45337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-26T20:41:52.532 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 61761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-26T20:41:52.532 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-26T20:41:52.532 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-26T20:41:52.532 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 40529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-26T20:41:52.532 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-26T20:41:52.532 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 59345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-26T20:41:52.532 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-26T20:41:52.533 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-26T20:41:52.533 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-26T20:41:52.533 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 70497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-26T20:41:52.533 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-26T20:41:52.533 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-26T20:41:52.533 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-26T20:41:52.533 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 151137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usbserial.ko 2024-04-26T20:41:52.533 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-26T20:41:52.533 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 43577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-26T20:41:52.533 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/wishbone-serial.ko 2024-04-26T20:41:52.533 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-26T20:41:52.533 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ 2024-04-26T20:41:52.533 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 64049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-26T20:41:52.533 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-26T20:41:52.534 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-26T20:41:52.534 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-26T20:41:52.534 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-26T20:41:52.534 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-26T20:41:52.534 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-26T20:41:52.534 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-26T20:41:52.534 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-26T20:41:52.534 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-26T20:41:52.534 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-26T20:41:52.534 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-26T20:41:52.534 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-26T20:41:52.534 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-26T20:41:52.534 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 201193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-26T20:41:52.534 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/ 2024-04-26T20:41:52.534 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 76041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-26T20:41:52.535 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 85257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-26T20:41:52.535 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 122321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-26T20:41:52.535 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/ 2024-04-26T20:41:52.535 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/ 2024-04-26T20:41:52.535 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 206921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-26T20:41:52.535 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-26T20:41:52.535 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 134265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-26T20:41:52.535 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 93673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-26T20:41:52.535 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/ 2024-04-26T20:41:52.535 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 138721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-26T20:41:52.535 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-26T20:41:52.535 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 71281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-26T20:41:52.535 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 107905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-26T20:41:52.535 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/ 2024-04-26T20:41:52.535 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/ 2024-04-26T20:41:52.536 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-04-26T20:41:52.536 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/aat2870_bl.ko 2024-04-26T20:41:52.536 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp5520_bl.ko 2024-04-26T20:41:52.536 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8860_bl.ko 2024-04-26T20:41:52.536 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 51745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8870_bl.ko 2024-04-26T20:41:52.536 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-26T20:41:52.536 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/as3711_bl.ko 2024-04-26T20:41:52.536 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/bd6107.ko 2024-04-26T20:41:52.536 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da903x_bl.ko 2024-04-26T20:41:52.536 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da9052_bl.ko 2024-04-26T20:41:52.536 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/gpio_backlight.ko 2024-04-26T20:41:52.536 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/kb3886_bl.ko 2024-04-26T20:41:52.536 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-26T20:41:52.536 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3533_bl.ko 2024-04-26T20:41:52.536 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3639_bl.ko 2024-04-26T20:41:52.537 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lv5207lp.ko 2024-04-26T20:41:52.537 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/max8925_bl.ko 2024-04-26T20:41:52.537 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pandora_bl.ko 2024-04-26T20:41:52.537 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-04-26T20:41:52.537 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-26T20:41:52.537 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/wm831x_bl.ko 2024-04-26T20:41:52.537 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/ 2024-04-26T20:41:52.537 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ 2024-04-26T20:41:52.537 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-26T20:41:52.537 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 46801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-26T20:41:52.537 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/matrox_w1.ko 2024-04-26T20:41:52.537 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/w1-gpio.ko 2024-04-26T20:41:52.537 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/ 2024-04-26T20:41:52.537 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-26T20:41:52.537 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-26T20:41:52.537 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-26T20:41:52.538 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-26T20:41:52.538 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-26T20:41:52.538 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-26T20:41:52.538 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-26T20:41:52.538 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-26T20:41:52.538 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-26T20:41:52.538 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-26T20:41:52.538 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 70369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-26T20:41:52.538 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 129433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-26T20:41:52.538 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ 2024-04-26T20:41:52.538 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/acquirewdt.ko 2024-04-26T20:41:52.538 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/advantechwdt.ko 2024-04-26T20:41:52.539 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-26T20:41:52.539 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-26T20:41:52.539 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/cpu5wdt.ko 2024-04-26T20:41:52.539 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9052_wdt.ko 2024-04-26T20:41:52.539 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9055_wdt.ko 2024-04-26T20:41:52.539 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9063_wdt.ko 2024-04-26T20:41:52.539 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/dw_wdt.ko 2024-04-26T20:41:52.539 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/eurotechwdt.ko 2024-04-26T20:41:52.539 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-26T20:41:52.539 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-26T20:41:52.539 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-26T20:41:52.539 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-26T20:41:52.539 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-26T20:41:52.539 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-26T20:41:52.540 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-26T20:41:52.540 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-26T20:41:52.540 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-26T20:41:52.540 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-26T20:41:52.540 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/kempld_wdt.ko 2024-04-26T20:41:52.540 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-26T20:41:52.540 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/mena21_wdt.ko 2024-04-26T20:41:52.540 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-04-26T20:41:52.540 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-26T20:41:52.540 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-04-26T20:41:52.540 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pc87413_wdt.ko 2024-04-26T20:41:52.540 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 46953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-26T20:41:52.540 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-26T20:41:52.540 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/retu_wdt.ko 2024-04-26T20:41:52.540 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-04-26T20:41:52.541 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-04-26T20:41:52.541 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-26T20:41:52.541 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sc1200wdt.ko 2024-04-26T20:41:52.541 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-26T20:41:52.541 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-04-26T20:41:52.541 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-26T20:41:52.541 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-26T20:41:52.541 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/twl4030_wdt.ko 2024-04-26T20:41:52.541 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-26T20:41:52.541 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-26T20:41:52.541 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-26T20:41:52.541 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-26T20:41:52.541 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wafer5823wdt.ko 2024-04-26T20:41:52.541 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-26T20:41:52.542 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm831x_wdt.ko 2024-04-26T20:41:52.542 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm8350_wdt.ko 2024-04-26T20:41:52.542 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-26T20:41:52.542 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/ 2024-04-26T20:41:52.542 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-26T20:41:52.542 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-26T20:41:52.542 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-26T20:41:52.542 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/ 2024-04-26T20:41:52.542 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 213913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-26T20:41:52.542 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-26T20:41:52.542 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 85713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-scsiback.ko 2024-04-26T20:41:52.542 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/ 2024-04-26T20:41:52.542 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-26T20:41:52.542 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ 2024-04-26T20:41:52.542 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/ 2024-04-26T20:41:52.543 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 192617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-26T20:41:52.543 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/ 2024-04-26T20:41:52.543 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 78153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/adfs.ko 2024-04-26T20:41:52.543 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/ 2024-04-26T20:41:52.543 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 197849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-26T20:41:52.543 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/ 2024-04-26T20:41:52.543 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1261113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/kafs.ko 2024-04-26T20:41:52.543 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/ 2024-04-26T20:41:52.543 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 127377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/autofs4.ko 2024-04-26T20:41:52.543 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/ 2024-04-26T20:41:52.543 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-26T20:41:52.543 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/ 2024-04-26T20:41:52.543 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 50473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/bfs.ko 2024-04-26T20:41:52.543 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 45561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-26T20:41:52.543 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/ 2024-04-26T20:41:52.543 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 4489593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-26T20:41:52.544 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/ 2024-04-26T20:41:52.544 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 376857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-26T20:41:52.544 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ 2024-04-26T20:41:52.544 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1586065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-26T20:41:52.544 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/ 2024-04-26T20:41:52.544 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 130073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-26T20:41:52.544 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/ 2024-04-26T20:41:52.544 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 139081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/configfs.ko 2024-04-26T20:41:52.544 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/ 2024-04-26T20:41:52.544 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-26T20:41:52.544 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/ 2024-04-26T20:41:52.544 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 813225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-26T20:41:52.544 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/ 2024-04-26T20:41:52.544 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 46409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/efs.ko 2024-04-26T20:41:52.544 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/ 2024-04-26T20:41:52.545 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1906817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-26T20:41:52.545 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/ 2024-04-26T20:41:52.545 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-26T20:41:52.545 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/ 2024-04-26T20:41:52.545 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/freevxfs.ko 2024-04-26T20:41:52.545 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/ 2024-04-26T20:41:52.545 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-26T20:41:52.545 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/ 2024-04-26T20:41:52.545 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1486521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-26T20:41:52.545 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/ 2024-04-26T20:41:52.545 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 183305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-26T20:41:52.545 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/ 2024-04-26T20:41:52.545 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 282097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-26T20:41:52.545 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/ 2024-04-26T20:41:52.545 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 249009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/hpfs.ko 2024-04-26T20:41:52.545 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/ 2024-04-26T20:41:52.545 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 93033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-26T20:41:52.546 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/ 2024-04-26T20:41:52.546 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 533073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-26T20:41:52.546 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/ 2024-04-26T20:41:52.546 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 361369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-26T20:41:52.546 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/ 2024-04-26T20:41:52.546 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 112609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-26T20:41:52.546 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/ 2024-04-26T20:41:52.546 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 591585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-26T20:41:52.546 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/ 2024-04-26T20:41:52.546 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/ 2024-04-26T20:41:52.546 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 102561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-26T20:41:52.546 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/ 2024-04-26T20:41:52.546 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 74353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-26T20:41:52.546 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/ 2024-04-26T20:41:52.546 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 147689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-26T20:41:52.547 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1320249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-26T20:41:52.547 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 82105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv2.ko 2024-04-26T20:41:52.547 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 151641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-26T20:41:52.547 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 2518505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-26T20:41:52.547 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/ 2024-04-26T20:41:52.547 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-26T20:41:52.547 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-26T20:41:52.547 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/ 2024-04-26T20:41:52.547 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 2024049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-26T20:41:52.547 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/ 2024-04-26T20:41:52.547 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 734025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-26T20:41:52.547 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/ 2024-04-26T20:41:52.547 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-26T20:41:52.547 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-26T20:41:52.547 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-26T20:41:52.547 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-26T20:41:52.548 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-26T20:41:52.548 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-26T20:41:52.548 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-26T20:41:52.548 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-26T20:41:52.548 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-26T20:41:52.548 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-26T20:41:52.548 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-26T20:41:52.548 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ascii.ko 2024-04-26T20:41:52.548 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-26T20:41:52.548 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-26T20:41:52.548 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-26T20:41:52.548 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-26T20:41:52.548 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-26T20:41:52.548 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-26T20:41:52.549 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-26T20:41:52.549 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-26T20:41:52.549 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-26T20:41:52.549 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-26T20:41:52.549 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-26T20:41:52.549 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-26T20:41:52.549 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-26T20:41:52.549 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-26T20:41:52.549 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-26T20:41:52.549 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-26T20:41:52.549 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-26T20:41:52.549 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-26T20:41:52.549 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 95625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-26T20:41:52.549 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 144209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-26T20:41:52.549 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 167137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-26T20:41:52.549 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 119513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-26T20:41:52.549 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-26T20:41:52.550 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-26T20:41:52.550 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-26T20:41:52.550 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-26T20:41:52.550 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-26T20:41:52.550 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-26T20:41:52.550 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-26T20:41:52.550 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-26T20:41:52.550 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-26T20:41:52.550 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-26T20:41:52.550 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-26T20:41:52.550 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-26T20:41:52.550 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-26T20:41:52.550 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-26T20:41:52.550 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-26T20:41:52.551 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-26T20:41:52.551 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-26T20:41:52.551 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ 2024-04-26T20:41:52.551 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ 2024-04-26T20:41:52.551 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 302073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-26T20:41:52.551 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ 2024-04-26T20:41:52.551 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 548169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-26T20:41:52.551 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ 2024-04-26T20:41:52.551 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-26T20:41:52.551 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 3245617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-26T20:41:52.586 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-26T20:41:52.586 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-26T20:41:52.586 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 43073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-26T20:41:52.586 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/ 2024-04-26T20:41:52.586 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 67489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/omfs.ko 2024-04-26T20:41:52.586 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/ 2024-04-26T20:41:52.586 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 462873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-26T20:41:52.586 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ 2024-04-26T20:41:52.587 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 67977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-26T20:41:52.587 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/ 2024-04-26T20:41:52.587 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/qnx4.ko 2024-04-26T20:41:52.587 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/ 2024-04-26T20:41:52.587 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 56097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/qnx6.ko 2024-04-26T20:41:52.587 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/ 2024-04-26T20:41:52.587 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 40313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_tree.ko 2024-04-26T20:41:52.587 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v1.ko 2024-04-26T20:41:52.587 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v2.ko 2024-04-26T20:41:52.587 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/ 2024-04-26T20:41:52.587 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 684841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-26T20:41:52.587 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/ 2024-04-26T20:41:52.587 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-26T20:41:52.587 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/ 2024-04-26T20:41:52.587 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/ 2024-04-26T20:41:52.587 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 3319041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-26T20:41:52.588 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/ 2024-04-26T20:41:52.588 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-26T20:41:52.588 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-26T20:41:52.588 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/ 2024-04-26T20:41:52.588 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 164185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-26T20:41:52.588 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/ 2024-04-26T20:41:52.588 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 115977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-26T20:41:52.588 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/ 2024-04-26T20:41:52.588 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 310017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-26T20:41:52.588 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ 2024-04-26T20:41:52.588 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 198233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-26T20:41:52.588 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/ 2024-04-26T20:41:52.588 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 5192705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-26T20:41:52.588 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/ 2024-04-26T20:41:52.588 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/ 2024-04-26T20:41:52.588 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 97625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/locktorture.ko 2024-04-26T20:41:52.589 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/ 2024-04-26T20:41:52.589 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/test_udelay.ko 2024-04-26T20:41:52.589 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 72665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-26T20:41:52.589 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ 2024-04-26T20:41:52.589 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-26T20:41:52.589 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc7.ko 2024-04-26T20:41:52.589 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-26T20:41:52.589 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/ 2024-04-26T20:41:52.589 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-26T20:41:52.589 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-26T20:41:52.589 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/interval_tree_test.ko 2024-04-26T20:41:52.589 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-26T20:41:52.589 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-26T20:41:52.589 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/ 2024-04-26T20:41:52.589 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-26T20:41:52.590 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-26T20:41:52.590 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/ 2024-04-26T20:41:52.590 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-26T20:41:52.590 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/memory-notifier-error-inject.ko 2024-04-26T20:41:52.590 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/notifier-error-inject.ko 2024-04-26T20:41:52.590 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/percpu_test.ko 2024-04-26T20:41:52.590 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/pm-notifier-error-inject.ko 2024-04-26T20:41:52.590 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/ 2024-04-26T20:41:52.590 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 152025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-26T20:41:52.590 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/rbtree_test.ko 2024-04-26T20:41:52.590 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/ 2024-04-26T20:41:52.590 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-26T20:41:52.590 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 40969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test-kstrtox.ko 2024-04-26T20:41:52.590 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 4912441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_bpf.ko 2024-04-26T20:41:52.590 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 61169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_firmware.ko 2024-04-26T20:41:52.591 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_module.ko 2024-04-26T20:41:52.591 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_user_copy.ko 2024-04-26T20:41:52.591 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-26T20:41:52.591 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-26T20:41:52.591 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-26T20:41:52.591 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/ 2024-04-26T20:41:52.591 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/xz_dec_test.ko 2024-04-26T20:41:52.591 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/ 2024-04-26T20:41:52.591 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-26T20:41:52.591 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ 2024-04-26T20:41:52.591 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/ 2024-04-26T20:41:52.591 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 66969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-26T20:41:52.591 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-26T20:41:52.591 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-26T20:41:52.591 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-26T20:41:52.592 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-26T20:41:52.592 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-26T20:41:52.592 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-26T20:41:52.592 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-26T20:41:52.592 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/ 2024-04-26T20:41:52.592 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-26T20:41:52.592 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-26T20:41:52.592 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-26T20:41:52.592 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-26T20:41:52.592 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-26T20:41:52.592 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/ 2024-04-26T20:41:52.592 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 106793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-26T20:41:52.592 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/ 2024-04-26T20:41:52.592 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 236793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-26T20:41:52.592 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-26T20:41:52.593 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-26T20:41:52.593 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-26T20:41:52.593 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/ 2024-04-26T20:41:52.593 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 879697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-26T20:41:52.593 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/ 2024-04-26T20:41:52.593 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 84761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-26T20:41:52.593 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1030873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-26T20:41:52.593 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ 2024-04-26T20:41:52.593 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-26T20:41:52.593 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-26T20:41:52.593 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-26T20:41:52.593 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-26T20:41:52.593 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-26T20:41:52.593 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-26T20:41:52.593 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-26T20:41:52.594 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-26T20:41:52.594 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-26T20:41:52.594 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-26T20:41:52.594 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-26T20:41:52.594 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-26T20:41:52.594 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-26T20:41:52.594 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-26T20:41:52.594 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-26T20:41:52.594 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-26T20:41:52.594 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-26T20:41:52.594 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-26T20:41:52.594 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-26T20:41:52.594 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-26T20:41:52.594 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 70529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-26T20:41:52.594 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-26T20:41:52.594 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-26T20:41:52.595 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/ 2024-04-26T20:41:52.595 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1243505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-26T20:41:52.595 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/ 2024-04-26T20:41:52.595 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 153801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-26T20:41:52.595 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/ 2024-04-26T20:41:52.595 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 244889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-26T20:41:52.595 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-26T20:41:52.595 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 71033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-26T20:41:52.595 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 74993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-26T20:41:52.595 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/ 2024-04-26T20:41:52.595 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 507705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-26T20:41:52.595 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-26T20:41:52.595 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-26T20:41:52.596 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-26T20:41:52.596 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-26T20:41:52.596 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/ 2024-04-26T20:41:52.596 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 128873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/hsr.ko 2024-04-26T20:41:52.596 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ 2024-04-26T20:41:52.596 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ 2024-04-26T20:41:52.596 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-26T20:41:52.596 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 357425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-26T20:41:52.596 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 59393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-26T20:41:52.596 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ 2024-04-26T20:41:52.596 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-26T20:41:52.596 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 46417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-26T20:41:52.596 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 60233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-26T20:41:52.596 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-26T20:41:52.596 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 65665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-26T20:41:52.597 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 75489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-26T20:41:52.597 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 77721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-26T20:41:52.597 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 43705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-26T20:41:52.597 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-26T20:41:52.597 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-26T20:41:52.597 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ 2024-04-26T20:41:52.597 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 45521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-26T20:41:52.597 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-26T20:41:52.597 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-26T20:41:52.597 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 50169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ip_tables.ko 2024-04-26T20:41:52.597 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-26T20:41:52.597 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-04-26T20:41:52.597 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-26T20:41:52.597 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-26T20:41:52.597 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-26T20:41:52.597 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-04-26T20:41:52.598 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-26T20:41:52.598 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-26T20:41:52.598 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-26T20:41:52.598 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-26T20:41:52.598 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-26T20:41:52.598 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-26T20:41:52.598 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-26T20:41:52.598 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-26T20:41:52.598 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-26T20:41:52.598 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-04-26T20:41:52.598 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-26T20:41:52.598 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-26T20:41:52.598 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-26T20:41:52.598 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-26T20:41:52.598 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-26T20:41:52.598 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-26T20:41:52.599 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-26T20:41:52.599 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-26T20:41:52.599 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-26T20:41:52.599 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-26T20:41:52.599 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-26T20:41:52.599 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-26T20:41:52.599 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-26T20:41:52.599 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-26T20:41:52.599 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-26T20:41:52.599 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-26T20:41:52.599 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-26T20:41:52.599 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-26T20:41:52.599 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-26T20:41:52.599 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-26T20:41:52.599 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 54441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-26T20:41:52.599 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-26T20:41:52.600 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ 2024-04-26T20:41:52.600 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-26T20:41:52.600 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 47433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-26T20:41:52.600 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-26T20:41:52.600 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 103177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_gre.ko 2024-04-26T20:41:52.600 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 118881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-26T20:41:52.600 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-26T20:41:52.600 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 71089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-26T20:41:52.600 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-26T20:41:52.600 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/mip6.ko 2024-04-26T20:41:52.600 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ 2024-04-26T20:41:52.600 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 50673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-26T20:41:52.600 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-04-26T20:41:52.600 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-26T20:41:52.600 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-26T20:41:52.601 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-26T20:41:52.601 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-26T20:41:52.601 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-26T20:41:52.601 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-26T20:41:52.601 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-26T20:41:52.601 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-26T20:41:52.601 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-26T20:41:52.601 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-26T20:41:52.601 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-26T20:41:52.601 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-26T20:41:52.601 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-26T20:41:52.601 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-26T20:41:52.601 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-26T20:41:52.601 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 46313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-26T20:41:52.601 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-26T20:41:52.601 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-26T20:41:52.602 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-26T20:41:52.602 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-26T20:41:52.602 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-26T20:41:52.602 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-26T20:41:52.602 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-26T20:41:52.602 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 94089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-26T20:41:52.602 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-26T20:41:52.602 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-26T20:41:52.602 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/ 2024-04-26T20:41:52.602 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 106369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-26T20:41:52.602 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/ 2024-04-26T20:41:52.602 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 153217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-26T20:41:52.602 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-26T20:41:52.602 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-26T20:41:52.602 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 43641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-26T20:41:52.603 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-26T20:41:52.603 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 42049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-26T20:41:52.603 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 66241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-26T20:41:52.603 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/ 2024-04-26T20:41:52.603 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 63345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/lapb.ko 2024-04-26T20:41:52.603 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/ 2024-04-26T20:41:52.603 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-26T20:41:52.603 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 332889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc2.ko 2024-04-26T20:41:52.603 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/ 2024-04-26T20:41:52.603 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 388873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-26T20:41:52.603 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/ 2024-04-26T20:41:52.603 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-26T20:41:52.603 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ 2024-04-26T20:41:52.603 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ 2024-04-26T20:41:52.603 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 147745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-26T20:41:52.603 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-26T20:41:52.604 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-26T20:41:52.604 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-26T20:41:52.604 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 124041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-26T20:41:52.604 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 124345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-26T20:41:52.604 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 126681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-26T20:41:52.604 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 126473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-26T20:41:52.604 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 137833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-26T20:41:52.604 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 72353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-26T20:41:52.604 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 133681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-26T20:41:52.604 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 139073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-26T20:41:52.604 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 138265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-26T20:41:52.604 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 136177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-26T20:41:52.604 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 139897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-26T20:41:52.604 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-26T20:41:52.604 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ 2024-04-26T20:41:52.605 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 534113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-26T20:41:52.605 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-26T20:41:52.605 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-26T20:41:52.605 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-26T20:41:52.605 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-26T20:41:52.605 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-26T20:41:52.605 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-26T20:41:52.605 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-26T20:41:52.605 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-26T20:41:52.605 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-26T20:41:52.605 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-26T20:41:52.605 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-26T20:41:52.605 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-26T20:41:52.605 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-26T20:41:52.605 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 55217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-26T20:41:52.605 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 496817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-26T20:41:52.606 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-26T20:41:52.606 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-26T20:41:52.606 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-26T20:41:52.606 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 134377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-26T20:41:52.606 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-26T20:41:52.606 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-26T20:41:52.606 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 140801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-26T20:41:52.606 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-26T20:41:52.606 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-26T20:41:52.606 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 79873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-26T20:41:52.606 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-26T20:41:52.606 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-26T20:41:52.606 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-26T20:41:52.606 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 117201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-26T20:41:52.606 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-26T20:41:52.606 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 46105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-26T20:41:52.607 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 118369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-26T20:41:52.607 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-26T20:41:52.607 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-26T20:41:52.607 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-26T20:41:52.607 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-26T20:41:52.607 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-26T20:41:52.607 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 53393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-26T20:41:52.607 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 807985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-26T20:41:52.607 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 53049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-26T20:41:52.607 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-26T20:41:52.607 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-04-26T20:41:52.607 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 49297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-26T20:41:52.607 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-26T20:41:52.607 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 65145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-26T20:41:52.607 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-26T20:41:52.607 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-26T20:41:52.607 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 50657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-26T20:41:52.608 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-26T20:41:52.608 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-26T20:41:52.608 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-26T20:41:52.608 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-26T20:41:52.608 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-26T20:41:52.608 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-26T20:41:52.608 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-26T20:41:52.608 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-26T20:41:52.608 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-26T20:41:52.608 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_osf.ko 2024-04-26T20:41:52.608 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-26T20:41:52.608 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-26T20:41:52.608 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-26T20:41:52.608 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-26T20:41:52.608 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-26T20:41:52.608 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_synproxy.ko 2024-04-26T20:41:52.609 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tproxy.ko 2024-04-26T20:41:52.609 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 108393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/x_tables.ko 2024-04-26T20:41:52.609 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-26T20:41:52.609 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-26T20:41:52.609 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-26T20:41:52.609 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-26T20:41:52.609 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-26T20:41:52.609 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-26T20:41:52.609 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-26T20:41:52.609 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-26T20:41:52.609 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 45217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-26T20:41:52.609 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-26T20:41:52.609 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-26T20:41:52.609 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-26T20:41:52.609 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-26T20:41:52.609 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-26T20:41:52.610 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-26T20:41:52.610 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-26T20:41:52.610 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-26T20:41:52.610 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-26T20:41:52.610 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-26T20:41:52.610 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-26T20:41:52.610 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-26T20:41:52.610 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-26T20:41:52.610 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-26T20:41:52.610 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-26T20:41:52.610 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-26T20:41:52.610 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-26T20:41:52.610 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-26T20:41:52.610 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-26T20:41:52.610 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-26T20:41:52.611 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-26T20:41:52.611 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-26T20:41:52.611 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-26T20:41:52.611 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-26T20:41:52.611 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-26T20:41:52.611 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-26T20:41:52.611 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-26T20:41:52.611 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-26T20:41:52.611 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-26T20:41:52.611 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-26T20:41:52.611 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 52817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-26T20:41:52.611 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-26T20:41:52.611 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-26T20:41:52.611 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-26T20:41:52.611 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-26T20:41:52.611 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-26T20:41:52.612 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-26T20:41:52.612 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-26T20:41:52.612 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-26T20:41:52.612 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-26T20:41:52.612 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-26T20:41:52.612 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-26T20:41:52.612 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-26T20:41:52.612 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-26T20:41:52.612 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-26T20:41:52.612 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-26T20:41:52.612 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-26T20:41:52.612 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-26T20:41:52.612 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-26T20:41:52.612 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-26T20:41:52.612 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-26T20:41:52.612 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-26T20:41:52.613 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 43465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-26T20:41:52.613 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-26T20:41:52.613 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-26T20:41:52.613 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-26T20:41:52.613 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-26T20:41:52.613 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-26T20:41:52.613 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-26T20:41:52.613 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-26T20:41:52.613 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpudp.ko 2024-04-26T20:41:52.613 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-26T20:41:52.613 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-26T20:41:52.613 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/ 2024-04-26T20:41:52.613 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-26T20:41:52.613 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/ 2024-04-26T20:41:52.613 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-26T20:41:52.613 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/ 2024-04-26T20:41:52.614 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 488825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-26T20:41:52.614 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-26T20:41:52.614 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-26T20:41:52.614 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-26T20:41:52.614 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/ 2024-04-26T20:41:52.614 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-26T20:41:52.614 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/ 2024-04-26T20:41:52.614 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 142025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/phonet.ko 2024-04-26T20:41:52.614 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 68817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/pn_pep.ko 2024-04-26T20:41:52.614 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/ 2024-04-26T20:41:52.614 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 318617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-26T20:41:52.614 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 202305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-26T20:41:52.614 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 85105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-26T20:41:52.614 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/ 2024-04-26T20:41:52.614 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1027897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/rxrpc.ko 2024-04-26T20:41:52.615 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/ 2024-04-26T20:41:52.615 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-26T20:41:52.615 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-26T20:41:52.615 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 45409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-26T20:41:52.615 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-26T20:41:52.615 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 53465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-26T20:41:52.615 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-26T20:41:52.615 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-26T20:41:52.615 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 43417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-26T20:41:52.615 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 45673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-26T20:41:52.615 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-26T20:41:52.615 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-26T20:41:52.615 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_cgroup.ko 2024-04-26T20:41:52.615 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-26T20:41:52.616 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-26T20:41:52.616 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 49321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-26T20:41:52.616 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 79145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-26T20:41:52.616 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-26T20:41:52.616 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-26T20:41:52.616 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 48785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-26T20:41:52.616 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-26T20:41:52.616 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-26T20:41:52.616 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-26T20:41:52.616 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-26T20:41:52.616 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-26T20:41:52.616 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 43481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-26T20:41:52.616 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 43153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-26T20:41:52.616 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq_codel.ko 2024-04-26T20:41:52.616 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-26T20:41:52.616 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 62817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-26T20:41:52.616 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-26T20:41:52.617 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 81833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-26T20:41:52.617 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-26T20:41:52.617 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-26T20:41:52.617 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-26T20:41:52.617 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-26T20:41:52.617 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-26T20:41:52.617 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-26T20:41:52.617 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-26T20:41:52.617 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-26T20:41:52.617 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 60249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-26T20:41:52.617 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-26T20:41:52.617 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-26T20:41:52.617 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-26T20:41:52.617 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-26T20:41:52.617 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-26T20:41:52.617 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/ 2024-04-26T20:41:52.618 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1187313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-26T20:41:52.618 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-26T20:41:52.618 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/ 2024-04-26T20:41:52.618 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/ 2024-04-26T20:41:52.618 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 432409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-26T20:41:52.618 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 70113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-26T20:41:52.618 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1940889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-26T20:41:52.618 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/ 2024-04-26T20:41:52.618 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 890729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-26T20:41:52.618 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/ 2024-04-26T20:41:52.618 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1122337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-26T20:41:52.618 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-26T20:41:52.618 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/ 2024-04-26T20:41:52.618 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-26T20:41:52.618 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/ 2024-04-26T20:41:52.619 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 105609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-26T20:41:52.619 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 90265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-26T20:41:52.619 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 123769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-26T20:41:52.619 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-26T20:41:52.619 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-26T20:41:52.619 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/ 2024-04-26T20:41:52.619 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 165841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/x25.ko 2024-04-26T20:41:52.619 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/ 2024-04-26T20:41:52.619 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_algo.ko 2024-04-26T20:41:52.619 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-26T20:41:52.619 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 131865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_user.ko 2024-04-26T20:41:52.619 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 644769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-26T20:41:52.619 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 628542 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-26T20:41:52.619 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7706 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-26T20:41:52.619 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-26T20:41:52.619 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9941 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-26T20:41:52.620 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 70990 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-26T20:41:52.620 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 146959 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-26T20:41:52.620 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 232835 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-26T20:41:52.620 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 210 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-26T20:41:52.620 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 72602 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-26T20:41:52.620 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 879 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-26T20:41:52.620 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 258450 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-26T20:41:52.620 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 313019 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-26T20:41:52.620 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/ 2024-04-26T20:41:52.620 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/ 2024-04-26T20:41:52.620 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/ 2024-04-26T20:41:52.620 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/ 2024-04-26T20:41:52.620 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 172 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/changelog.Debian.gz 2024-04-26T20:41:52.620 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 691 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/copyright 2024-04-26T20:41:52.626 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-26T20:41:52.626 INFO:teuthology.task.kernel:searching for kernel 6.9.0-rc3-g806ec36b2112 2024-04-26T20:41:52.626 DEBUG:teuthology.orchestra.run.smithi143:> egrep '(submenu|menuentry.*6.9.0-rc3-g806ec36b2112).*{' /boot/grub/grub.cfg 2024-04-26T20:41:52.634 INFO:teuthology.orchestra.run.smithi143.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-26T20:41:52.635 INFO:teuthology.orchestra.run.smithi143.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-26T20:41:52.635 INFO:teuthology.orchestra.run.smithi143.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-26T20:41:52.635 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-04-26T20:41:52.635 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 2024-04-26T20:41:52.635 DEBUG:teuthology.orchestra.run.smithi143:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-04-26T20:41:52.679 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi143.front.sepia.ceph.com to complete... 2024-04-26T20:41:53.094 INFO:teuthology.orchestra.run.smithi143.stderr:Sourcing file `/etc/default/grub' 2024-04-26T20:41:53.095 INFO:teuthology.orchestra.run.smithi143.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T20:41:53.120 INFO:teuthology.orchestra.run.smithi143.stderr:Generating grub configuration file ... 2024-04-26T20:41:53.337 INFO:teuthology.orchestra.run.smithi143.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-26T20:41:53.344 INFO:teuthology.orchestra.run.smithi143.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-26T20:41:53.565 INFO:teuthology.orchestra.run.smithi143.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T20:41:53.569 INFO:teuthology.orchestra.run.smithi143.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T20:41:53.607 INFO:teuthology.orchestra.run.smithi143.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T20:41:53.612 INFO:teuthology.orchestra.run.smithi143.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T20:41:53.751 INFO:teuthology.orchestra.run.smithi143.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T20:41:53.751 INFO:teuthology.orchestra.run.smithi143.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T20:41:53.751 INFO:teuthology.orchestra.run.smithi143.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T20:41:53.761 INFO:teuthology.orchestra.run.smithi143.stderr:done 2024-04-26T20:41:56.734 INFO:teuthology.orchestra.run.smithi138.stderr:Sourcing file `/etc/default/grub' 2024-04-26T20:41:56.744 INFO:teuthology.orchestra.run.smithi138.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T20:41:56.784 INFO:teuthology.orchestra.run.smithi138.stderr:Generating grub configuration file ... 2024-04-26T20:41:57.075 INFO:teuthology.orchestra.run.smithi138.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-26T20:41:57.095 INFO:teuthology.orchestra.run.smithi138.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-26T20:41:57.393 INFO:teuthology.orchestra.run.smithi138.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T20:41:57.407 INFO:teuthology.orchestra.run.smithi138.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T20:41:57.469 INFO:teuthology.orchestra.run.smithi138.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T20:41:57.474 INFO:teuthology.orchestra.run.smithi138.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T20:41:57.605 INFO:teuthology.orchestra.run.smithi138.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T20:41:57.605 INFO:teuthology.orchestra.run.smithi138.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T20:41:57.605 INFO:teuthology.orchestra.run.smithi138.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T20:41:57.650 INFO:teuthology.orchestra.run.smithi138.stderr:done 2024-04-26T20:41:57.833 DEBUG:teuthology.orchestra.run.smithi138:> dpkg-deb -c /tmp/linux-image.deb 2024-04-26T20:41:57.841 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./ 2024-04-26T20:41:57.841 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./boot/ 2024-04-26T20:41:57.841 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7002012 2024-04-19 08:55 ./boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-26T20:41:57.859 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 172073 2024-04-19 08:55 ./boot/config-6.9.0-rc3-g806ec36b2112 2024-04-26T20:41:57.859 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13120512 2024-04-19 08:55 ./boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-26T20:41:57.879 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/ 2024-04-26T20:41:57.879 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/ 2024-04-26T20:41:57.879 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postinst.d/ 2024-04-26T20:41:57.879 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postrm.d/ 2024-04-26T20:41:57.879 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/preinst.d/ 2024-04-26T20:41:57.879 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/prerm.d/ 2024-04-26T20:41:57.879 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/ 2024-04-26T20:41:57.879 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/ 2024-04-26T20:41:57.879 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/ 2024-04-26T20:41:57.879 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/ 2024-04-26T20:41:57.880 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/ 2024-04-26T20:41:57.880 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/ 2024-04-26T20:41:57.880 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ 2024-04-26T20:41:57.880 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 507569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/aesni-intel.ko 2024-04-26T20:41:57.882 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-26T20:41:57.882 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-26T20:41:57.883 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-26T20:41:57.883 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-26T20:41:57.883 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 109905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-26T20:41:57.883 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 155249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-26T20:41:57.883 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-26T20:41:57.883 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-26T20:41:57.883 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 87009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-26T20:41:57.883 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-26T20:41:57.883 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 50305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-26T20:41:57.883 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 50377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-26T20:41:57.883 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 54513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-26T20:41:57.883 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 44657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-26T20:41:57.883 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 48049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-26T20:41:57.883 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 62873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-26T20:41:57.884 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 53569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-26T20:41:57.884 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-26T20:41:57.884 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-26T20:41:57.884 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/ 2024-04-26T20:41:57.884 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/ 2024-04-26T20:41:57.884 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/ 2024-04-26T20:41:57.884 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-26T20:41:57.884 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpuid.ko 2024-04-26T20:41:57.884 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/msr.ko 2024-04-26T20:41:57.884 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/ 2024-04-26T20:41:57.884 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 444425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-26T20:41:57.884 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 1035881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-26T20:41:57.885 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 2849609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-26T20:41:57.898 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ 2024-04-26T20:41:57.898 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 65025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/af_alg.ko 2024-04-26T20:41:57.898 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_hash.ko 2024-04-26T20:41:57.898 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_skcipher.ko 2024-04-26T20:41:57.899 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-26T20:41:57.899 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-26T20:41:57.899 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-26T20:41:57.899 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/ 2024-04-26T20:41:57.899 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-04-26T20:41:57.899 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/ 2024-04-26T20:41:57.899 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-26T20:41:57.899 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-26T20:41:57.899 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-26T20:41:57.899 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-26T20:41:57.899 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-26T20:41:57.899 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-26T20:41:57.899 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-26T20:41:57.899 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-26T20:41:57.900 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-26T20:41:57.900 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-26T20:41:57.900 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-26T20:41:57.900 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-26T20:41:57.900 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-26T20:41:57.900 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-26T20:41:57.900 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-26T20:41:57.900 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 43281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-26T20:41:57.900 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-26T20:41:57.900 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-26T20:41:57.900 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 59129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cryptd.ko 2024-04-26T20:41:57.900 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 48113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-26T20:41:57.900 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 32169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_simd.ko 2024-04-26T20:41:57.900 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-26T20:41:57.900 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-26T20:41:57.901 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-26T20:41:57.901 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-26T20:41:57.901 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-26T20:41:57.901 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-26T20:41:57.901 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-26T20:41:57.901 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-26T20:41:57.901 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lrw.ko 2024-04-26T20:41:57.901 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-26T20:41:57.901 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-26T20:41:57.901 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-26T20:41:57.901 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-26T20:41:57.901 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-26T20:41:57.901 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-26T20:41:57.901 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-26T20:41:57.902 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-26T20:41:57.902 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-26T20:41:57.902 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 169065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-26T20:41:57.902 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-26T20:41:57.902 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-26T20:41:57.902 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-26T20:41:57.902 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-26T20:41:57.902 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-26T20:41:57.902 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-26T20:41:57.902 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-26T20:41:57.902 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xts.ko 2024-04-26T20:41:57.902 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-26T20:41:57.902 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ 2024-04-26T20:41:57.902 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ 2024-04-26T20:41:57.903 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_extlog.ko 2024-04-26T20:41:57.903 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-26T20:41:57.903 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 32281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-26T20:41:57.903 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/ 2024-04-26T20:41:57.903 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 44705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/einj.ko 2024-04-26T20:41:57.903 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-26T20:41:57.903 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-26T20:41:57.903 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-26T20:41:57.903 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-26T20:41:57.903 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 119033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-26T20:41:57.903 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ 2024-04-26T20:41:57.903 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-26T20:41:57.903 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 96825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci.ko 2024-04-26T20:41:57.903 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-26T20:41:57.904 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 107737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci.ko 2024-04-26T20:41:57.904 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 42001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-26T20:41:57.904 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-26T20:41:57.904 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-26T20:41:57.904 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-26T20:41:57.904 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-26T20:41:57.904 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-26T20:41:57.904 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-26T20:41:57.904 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-26T20:41:57.904 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-26T20:41:57.904 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-26T20:41:57.904 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-26T20:41:57.904 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-26T20:41:57.904 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 38913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-26T20:41:57.904 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-26T20:41:57.905 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-26T20:41:57.905 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-26T20:41:57.905 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 41289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-26T20:41:57.905 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-26T20:41:57.905 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 60257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_legacy.ko 2024-04-26T20:41:57.905 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-26T20:41:57.905 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-26T20:41:57.905 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-26T20:41:57.905 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-26T20:41:57.905 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-26T20:41:57.905 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-26T20:41:57.905 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-26T20:41:57.905 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-26T20:41:57.905 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-26T20:41:57.906 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-26T20:41:57.906 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 43009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-26T20:41:57.906 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-26T20:41:57.906 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-26T20:41:57.906 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_radisys.ko 2024-04-26T20:41:57.906 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-26T20:41:57.906 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rz1000.ko 2024-04-26T20:41:57.906 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-26T20:41:57.906 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-26T20:41:57.906 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-26T20:41:57.906 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-26T20:41:57.906 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-26T20:41:57.906 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-26T20:41:57.906 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-26T20:41:57.907 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-26T20:41:57.907 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 102121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-26T20:41:57.907 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 85409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-26T20:41:57.907 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-26T20:41:57.907 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-26T20:41:57.907 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-26T20:41:57.907 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 45905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-26T20:41:57.907 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-26T20:41:57.907 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-26T20:41:57.907 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 53353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-26T20:41:57.907 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-26T20:41:57.907 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 41049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-26T20:41:57.907 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-26T20:41:57.907 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ 2024-04-26T20:41:57.907 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-26T20:41:57.908 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/ 2024-04-26T20:41:57.908 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 163969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-26T20:41:57.908 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/ 2024-04-26T20:41:57.908 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/ 2024-04-26T20:41:57.908 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 140865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-26T20:41:57.908 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/ 2024-04-26T20:41:57.908 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 1241657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-26T20:41:57.963 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 203289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-26T20:41:57.963 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/ 2024-04-26T20:41:57.963 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 115265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-26T20:41:57.963 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 143433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-26T20:41:57.964 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/ 2024-04-26T20:41:57.964 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 126617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-26T20:41:57.964 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 119873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-26T20:41:57.964 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 313217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-26T20:41:57.964 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/ 2024-04-26T20:41:57.964 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 117233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-26T20:41:57.964 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/ 2024-04-26T20:41:57.964 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 70385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-26T20:41:57.964 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ 2024-04-26T20:41:57.964 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/applicom.ko 2024-04-26T20:41:57.964 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-26T20:41:57.964 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/ 2024-04-26T20:41:57.964 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-26T20:41:57.964 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-26T20:41:57.965 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-26T20:41:57.965 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-26T20:41:57.965 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-26T20:41:57.965 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ 2024-04-26T20:41:57.965 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 37257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-26T20:41:57.965 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 186921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-26T20:41:57.965 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 32521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-26T20:41:57.965 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 179561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-26T20:41:57.965 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 85441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-26T20:41:57.965 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 65313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-26T20:41:57.965 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 43857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-26T20:41:57.965 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/ 2024-04-26T20:41:57.965 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 103409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-26T20:41:57.965 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/nvram.ko 2024-04-26T20:41:57.965 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 38977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-26T20:41:57.966 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 59241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-26T20:41:57.966 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/ 2024-04-26T20:41:57.966 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-26T20:41:57.966 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-04-26T20:41:57.966 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-04-26T20:41:57.966 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 39193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-04-26T20:41:57.966 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-26T20:41:57.966 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-26T20:41:57.966 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-04-26T20:41:57.966 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/ 2024-04-26T20:41:57.966 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_class.ko 2024-04-26T20:41:57.966 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 62545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_core.ko 2024-04-26T20:41:57.966 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-04-26T20:41:57.966 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/ 2024-04-26T20:41:57.966 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-palmas.ko 2024-04-26T20:41:57.966 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 57289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-si5351.ko 2024-04-26T20:41:57.967 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-twl6040.ko 2024-04-26T20:41:57.967 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-wm831x.ko 2024-04-26T20:41:57.967 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/ 2024-04-26T20:41:57.967 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-26T20:41:57.967 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-26T20:41:57.967 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-26T20:41:57.967 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ 2024-04-26T20:41:57.967 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ 2024-04-26T20:41:57.967 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 89257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-26T20:41:57.967 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 333657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-26T20:41:57.967 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/ 2024-04-26T20:41:57.967 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/ 2024-04-26T20:41:57.967 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/ 2024-04-26T20:41:57.967 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 751713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-26T20:41:57.967 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-04-26T20:41:57.968 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-26T20:41:57.968 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-26T20:41:57.968 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-26T20:41:57.968 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/ 2024-04-26T20:41:57.968 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 90441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-26T20:41:57.968 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/ 2024-04-26T20:41:57.968 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-26T20:41:57.968 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ 2024-04-26T20:41:57.968 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/ 2024-04-26T20:41:57.968 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-26T20:41:57.968 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ 2024-04-26T20:41:57.968 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 146769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-26T20:41:57.968 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ 2024-04-26T20:41:57.968 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 96145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-26T20:41:57.968 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 41993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-26T20:41:57.969 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 51105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-26T20:41:57.969 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-26T20:41:57.969 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-26T20:41:57.969 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-26T20:41:57.969 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-26T20:41:57.969 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-26T20:41:57.969 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 64161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-26T20:41:57.969 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-26T20:41:57.969 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-26T20:41:57.969 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 68697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-26T20:41:57.969 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-26T20:41:57.969 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/ 2024-04-26T20:41:57.969 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-gpio.ko 2024-04-26T20:41:57.969 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max14577.ko 2024-04-26T20:41:57.969 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max77693.ko 2024-04-26T20:41:57.969 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max8997.ko 2024-04-26T20:41:57.970 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-palmas.ko 2024-04-26T20:41:57.970 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-rt8973a.ko 2024-04-26T20:41:57.970 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-sm5502.ko 2024-04-26T20:41:57.970 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/ 2024-04-26T20:41:57.970 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 42953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/dmi-sysfs.ko 2024-04-26T20:41:57.970 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/ 2024-04-26T20:41:57.970 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/efi-pstore.ko 2024-04-26T20:41:57.970 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-26T20:41:57.970 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/ 2024-04-26T20:41:57.970 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-adp5520.ko 2024-04-26T20:41:57.970 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-amd8111.ko 2024-04-26T20:41:57.970 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-arizona.ko 2024-04-26T20:41:57.970 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9052.ko 2024-04-26T20:41:57.970 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9055.ko 2024-04-26T20:41:57.970 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-dln2.ko 2024-04-26T20:41:57.971 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 81073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-f7188x.ko 2024-04-26T20:41:57.971 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 40761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-generic.ko 2024-04-26T20:41:57.971 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-26T20:41:57.971 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-04-26T20:41:57.971 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-kempld.ko 2024-04-26T20:41:57.971 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-lp3943.ko 2024-04-26T20:41:57.971 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max7300.ko 2024-04-26T20:41:57.971 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max730x.ko 2024-04-26T20:41:57.971 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max732x.ko 2024-04-26T20:41:57.971 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-04-26T20:41:57.971 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pca953x.ko 2024-04-26T20:41:57.971 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pcf857x.ko 2024-04-26T20:41:57.971 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-rdc321x.ko 2024-04-26T20:41:57.971 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch.ko 2024-04-26T20:41:57.971 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch311x.ko 2024-04-26T20:41:57.972 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-tps65912.ko 2024-04-26T20:41:57.972 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl4030.ko 2024-04-26T20:41:57.972 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl6040.ko 2024-04-26T20:41:57.972 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-26T20:41:57.972 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-vx855.ko 2024-04-26T20:41:57.972 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm831x.ko 2024-04-26T20:41:57.972 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8350.ko 2024-04-26T20:41:57.972 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8994.ko 2024-04-26T20:41:57.972 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/ 2024-04-26T20:41:57.972 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-a4tech.ko 2024-04-26T20:41:57.972 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-apple.ko 2024-04-26T20:41:57.972 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-26T20:41:57.972 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-26T20:41:57.972 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-26T20:41:57.972 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-belkin.ko 2024-04-26T20:41:57.973 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cherry.ko 2024-04-26T20:41:57.973 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-chicony.ko 2024-04-26T20:41:57.973 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 74393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cp2112.ko 2024-04-26T20:41:57.973 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cypress.ko 2024-04-26T20:41:57.973 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-26T20:41:57.973 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-26T20:41:57.973 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-26T20:41:57.973 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-26T20:41:57.973 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ezkey.ko 2024-04-26T20:41:57.973 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-26T20:41:57.973 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-generic.ko 2024-04-26T20:41:57.973 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-26T20:41:57.973 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-26T20:41:57.973 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-26T20:41:57.973 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-26T20:41:57.974 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-26T20:41:57.974 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-26T20:41:57.974 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-26T20:41:57.974 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kensington.ko 2024-04-26T20:41:57.974 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-26T20:41:57.974 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-26T20:41:57.974 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-26T20:41:57.974 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-26T20:41:57.974 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 54217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-26T20:41:57.974 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 37553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lg-g15.ko 2024-04-26T20:41:57.974 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 68081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-26T20:41:57.974 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 121369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-26T20:41:57.974 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech.ko 2024-04-26T20:41:57.974 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-magicmouse.ko 2024-04-26T20:41:57.974 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-microsoft.ko 2024-04-26T20:41:57.975 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-monterey.ko 2024-04-26T20:41:57.975 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 59001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-26T20:41:57.975 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 39697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ntrig.ko 2024-04-26T20:41:57.975 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-26T20:41:57.975 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-26T20:41:57.975 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-26T20:41:57.975 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 91241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-26T20:41:57.975 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-26T20:41:57.975 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-26T20:41:57.975 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-26T20:41:57.975 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-26T20:41:57.975 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-26T20:41:57.975 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-26T20:41:57.975 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 38865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-26T20:41:57.975 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-26T20:41:57.975 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 38073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-26T20:41:57.976 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-26T20:41:57.976 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-26T20:41:57.976 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-26T20:41:57.976 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-26T20:41:57.976 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-26T20:41:57.976 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-26T20:41:57.976 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-26T20:41:57.976 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-26T20:41:57.976 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 42305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-26T20:41:57.976 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 43609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-26T20:41:57.976 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-26T20:41:57.976 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 62129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-26T20:41:57.976 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-26T20:41:57.976 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-26T20:41:57.976 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-26T20:41:57.977 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-26T20:41:57.977 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-26T20:41:57.977 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-26T20:41:57.977 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-26T20:41:57.977 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-26T20:41:57.977 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 81113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-26T20:41:57.977 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-26T20:41:57.977 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 184745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-26T20:41:57.977 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-26T20:41:57.977 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-26T20:41:57.977 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-26T20:41:57.977 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 319921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid.ko 2024-04-26T20:41:57.977 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 39529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-26T20:41:57.977 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/ 2024-04-26T20:41:57.977 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 153633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbhid.ko 2024-04-26T20:41:57.977 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbkbd.ko 2024-04-26T20:41:57.978 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbmouse.ko 2024-04-26T20:41:57.978 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 261945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-26T20:41:57.978 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/ 2024-04-26T20:41:57.978 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 75065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-26T20:41:57.978 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 110681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-26T20:41:57.978 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 382033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-26T20:41:57.978 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ 2024-04-26T20:41:57.978 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 77153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-26T20:41:57.978 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 67009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-26T20:41:57.978 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-26T20:41:57.978 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-26T20:41:57.978 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-26T20:41:57.978 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-26T20:41:57.978 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 38097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-26T20:41:57.978 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 115057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-26T20:41:57.979 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-26T20:41:57.979 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 55225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-26T20:41:57.979 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-26T20:41:57.979 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-26T20:41:57.979 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-26T20:41:57.979 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-26T20:41:57.979 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 89025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-26T20:41:57.979 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 49153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-26T20:41:57.979 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 81473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-26T20:41:57.979 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-26T20:41:57.979 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 48177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-26T20:41:57.979 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 68865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-26T20:41:57.979 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 60193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-26T20:41:57.979 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 69009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-26T20:41:57.979 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 47977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-26T20:41:57.980 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-26T20:41:57.980 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-26T20:41:57.980 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9052-hwmon.ko 2024-04-26T20:41:57.980 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9055-hwmon.ko 2024-04-26T20:41:57.980 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-26T20:41:57.980 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 113201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-26T20:41:57.980 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-26T20:41:57.980 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-26T20:41:57.980 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-26T20:41:57.980 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 40177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc2103.ko 2024-04-26T20:41:57.980 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-26T20:41:57.980 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 78921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-26T20:41:57.980 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 108961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-26T20:41:57.980 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 50697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-26T20:41:57.980 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-26T20:41:57.980 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 65769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-26T20:41:57.981 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-26T20:41:57.981 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-26T20:41:57.981 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 59761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-26T20:41:57.981 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 56313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-26T20:41:57.981 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hih6130.ko 2024-04-26T20:41:57.981 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-26T20:41:57.981 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-26T20:41:57.981 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-26T20:41:57.981 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 42585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-26T20:41:57.981 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-26T20:41:57.981 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-26T20:41:57.981 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-26T20:41:57.981 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 156465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-26T20:41:57.981 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/jc42.ko 2024-04-26T20:41:57.981 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-26T20:41:57.981 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-26T20:41:57.982 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-26T20:41:57.982 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 57769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-26T20:41:57.982 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-26T20:41:57.982 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 44121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-26T20:41:57.982 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-26T20:41:57.982 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 41473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-26T20:41:57.982 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 37049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-26T20:41:57.982 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-26T20:41:57.982 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 86497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-26T20:41:57.982 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 55641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-26T20:41:57.982 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-26T20:41:57.982 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-26T20:41:57.982 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 131505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-26T20:41:57.982 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 40225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-26T20:41:57.982 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-26T20:41:57.983 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-26T20:41:57.983 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-26T20:41:57.983 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-26T20:41:57.983 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-26T20:41:57.983 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-26T20:41:57.983 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-26T20:41:57.983 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-26T20:41:57.983 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-26T20:41:57.983 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-26T20:41:57.983 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-26T20:41:57.983 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-26T20:41:57.983 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-26T20:41:57.983 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-26T20:41:57.983 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-26T20:41:57.983 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 39729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-26T20:41:57.983 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mc13783-adc.ko 2024-04-26T20:41:57.984 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-26T20:41:57.984 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-04-26T20:41:57.984 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 56505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-26T20:41:57.984 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 141353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-26T20:41:57.984 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 72737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-26T20:41:57.984 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 67841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-26T20:41:57.984 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 97777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-26T20:41:57.984 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 61921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-26T20:41:57.984 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-26T20:41:57.984 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ 2024-04-26T20:41:57.984 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-26T20:41:57.984 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-26T20:41:57.984 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-26T20:41:57.984 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-26T20:41:57.984 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-26T20:41:57.985 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-26T20:41:57.985 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-26T20:41:57.985 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 101233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-26T20:41:57.985 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-26T20:41:57.985 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-26T20:41:57.985 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-26T20:41:57.985 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-26T20:41:57.985 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-26T20:41:57.985 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-26T20:41:57.985 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 32945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-26T20:41:57.985 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-26T20:41:57.985 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 40849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-26T20:41:57.985 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-26T20:41:57.985 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-26T20:41:57.985 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 48713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-26T20:41:57.985 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-26T20:41:57.986 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 46473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-26T20:41:57.986 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-26T20:41:57.986 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-26T20:41:57.986 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-26T20:41:57.986 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-26T20:41:57.986 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-26T20:41:57.986 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-26T20:41:57.986 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-26T20:41:57.986 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 50217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-26T20:41:57.986 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 59665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-26T20:41:57.986 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 62737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-26T20:41:57.986 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 71169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-26T20:41:57.986 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 96577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-26T20:41:57.986 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 85913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-26T20:41:57.987 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 75129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-26T20:41:57.987 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 83425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-26T20:41:57.987 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 116777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-26T20:41:57.987 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 134441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-26T20:41:57.987 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-26T20:41:57.987 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 43385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-26T20:41:57.987 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-04-26T20:41:57.987 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-04-26T20:41:57.987 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/ 2024-04-26T20:41:57.987 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/ 2024-04-26T20:41:57.987 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-26T20:41:57.987 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-26T20:41:57.987 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/ 2024-04-26T20:41:57.987 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-04-26T20:41:57.987 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-04-26T20:41:57.987 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 32905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-04-26T20:41:57.988 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-26T20:41:57.988 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-26T20:41:57.988 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-26T20:41:57.988 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-04-26T20:41:57.988 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-26T20:41:57.988 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-04-26T20:41:57.988 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 64233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-26T20:41:57.988 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-26T20:41:57.988 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-26T20:41:57.988 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-26T20:41:57.988 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-04-26T20:41:57.988 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-04-26T20:41:57.988 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 76969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-26T20:41:57.988 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-26T20:41:57.988 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 52937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-26T20:41:57.989 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-04-26T20:41:57.989 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-26T20:41:57.989 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-26T20:41:57.989 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-04-26T20:41:57.989 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-26T20:41:57.989 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-26T20:41:57.989 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 57217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-26T20:41:57.989 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-04-26T20:41:57.989 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-26T20:41:57.989 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-26T20:41:57.989 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-04-26T20:41:57.989 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 32585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-04-26T20:41:57.989 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-26T20:41:57.989 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-04-26T20:41:57.989 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-26T20:41:57.990 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-26T20:41:57.990 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-26T20:41:57.990 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-26T20:41:57.990 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 59193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-04-26T20:41:57.990 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-26T20:41:57.990 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-26T20:41:57.990 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-26T20:41:57.990 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/ 2024-04-26T20:41:57.990 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-04-26T20:41:57.990 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-04-26T20:41:57.990 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-04-26T20:41:57.990 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ 2024-04-26T20:41:57.990 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ 2024-04-26T20:41:57.990 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 329697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-26T20:41:57.990 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 1119913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-26T20:41:57.991 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 83905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-26T20:41:57.991 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 408433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-26T20:41:57.991 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 120921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-26T20:41:57.991 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 347217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-26T20:41:57.991 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 84945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-26T20:41:57.991 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ 2024-04-26T20:41:57.991 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/ 2024-04-26T20:41:57.991 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 590929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-26T20:41:57.991 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/ 2024-04-26T20:41:57.991 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 514641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-26T20:41:57.991 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/ 2024-04-26T20:41:57.991 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 911665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-26T20:41:57.991 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ 2024-04-26T20:41:57.991 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 375545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-26T20:41:57.991 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ 2024-04-26T20:41:57.991 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 197121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-04-26T20:41:57.992 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/ 2024-04-26T20:41:57.992 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 212553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-04-26T20:41:57.992 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ 2024-04-26T20:41:57.992 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ 2024-04-26T20:41:57.992 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 334401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-26T20:41:57.992 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ 2024-04-26T20:41:57.992 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 120673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-26T20:41:57.992 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ 2024-04-26T20:41:57.992 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 132585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-26T20:41:57.992 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ 2024-04-26T20:41:57.992 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 157937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-26T20:41:57.992 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ 2024-04-26T20:41:57.992 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 156673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-26T20:41:57.992 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ 2024-04-26T20:41:57.992 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/evbug.ko 2024-04-26T20:41:57.992 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ff-memless.ko 2024-04-26T20:41:57.993 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/ 2024-04-26T20:41:57.993 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-26T20:41:57.993 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-26T20:41:57.993 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 50713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-26T20:41:57.993 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 49441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-26T20:41:57.993 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/ 2024-04-26T20:41:57.993 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-04-26T20:41:57.993 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-04-26T20:41:57.993 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-04-26T20:41:57.993 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-04-26T20:41:57.993 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 45473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-26T20:41:57.993 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-04-26T20:41:57.993 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lkkbd.ko 2024-04-26T20:41:57.993 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8323.ko 2024-04-26T20:41:57.993 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8333.ko 2024-04-26T20:41:57.994 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-04-26T20:41:57.994 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-04-26T20:41:57.994 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-04-26T20:41:57.994 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-04-26T20:41:57.994 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/newtonkbd.ko 2024-04-26T20:41:57.994 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-04-26T20:41:57.994 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt1070.ko 2024-04-26T20:41:57.994 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt2160.ko 2024-04-26T20:41:57.994 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-04-26T20:41:57.994 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/stowaway.ko 2024-04-26T20:41:57.994 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/sunkbd.ko 2024-04-26T20:41:57.994 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-04-26T20:41:57.994 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-04-26T20:41:57.994 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-04-26T20:41:57.994 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/xtkbd.ko 2024-04-26T20:41:57.995 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/matrix-keymap.ko 2024-04-26T20:41:57.995 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/ 2024-04-26T20:41:57.995 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 40617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-26T20:41:57.995 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 39553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-26T20:41:57.995 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 160017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-26T20:41:57.995 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 114273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-26T20:41:57.995 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/gpio_mouse.ko 2024-04-26T20:41:57.995 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 428185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/psmouse.ko 2024-04-26T20:41:57.995 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-26T20:41:57.995 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-26T20:41:57.995 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-26T20:41:57.995 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-26T20:41:57.995 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/ 2024-04-26T20:41:57.995 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 140969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-26T20:41:57.995 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ 2024-04-26T20:41:57.995 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-26T20:41:57.996 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-26T20:41:57.996 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ct82c710.ko 2024-04-26T20:41:57.996 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-26T20:41:57.996 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/parkbd.ko 2024-04-26T20:41:57.996 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/pcips2.ko 2024-04-26T20:41:57.996 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ps2mult.ko 2024-04-26T20:41:57.996 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-26T20:41:57.996 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serport.ko 2024-04-26T20:41:57.996 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-26T20:41:57.996 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/ 2024-04-26T20:41:57.996 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-88pm860x.ko 2024-04-26T20:41:57.996 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-adp5520.ko 2024-04-26T20:41:57.996 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 77265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-bd2802.ko 2024-04-26T20:41:57.996 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-26T20:41:57.996 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da903x.ko 2024-04-26T20:41:57.997 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da9052.ko 2024-04-26T20:41:57.997 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-gpio.ko 2024-04-26T20:41:57.997 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-26T20:41:57.997 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3533.ko 2024-04-26T20:41:57.997 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm355x.ko 2024-04-26T20:41:57.997 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3642.ko 2024-04-26T20:41:57.997 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-26T20:41:57.997 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp8788.ko 2024-04-26T20:41:57.997 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-max8997.ko 2024-04-26T20:41:57.997 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-mc13783.ko 2024-04-26T20:41:57.997 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-menf21bmc.ko 2024-04-26T20:41:57.997 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca9532.ko 2024-04-26T20:41:57.997 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca955x.ko 2024-04-26T20:41:57.997 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca963x.ko 2024-04-26T20:41:57.997 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 38113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-26T20:41:57.997 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-tca6507.ko 2024-04-26T20:41:57.997 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm831x-status.ko 2024-04-26T20:41:57.998 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm8350.ko 2024-04-26T20:41:57.998 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ 2024-04-26T20:41:57.998 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-26T20:41:57.998 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-26T20:41:57.998 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-26T20:41:57.998 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-26T20:41:57.998 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-26T20:41:57.998 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-26T20:41:57.998 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-26T20:41:57.998 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-26T20:41:57.998 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-26T20:41:57.998 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/ 2024-04-26T20:41:57.998 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/ 2024-04-26T20:41:57.998 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 790753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-26T20:41:57.999 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-26T20:41:57.999 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 116825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bufio.ko 2024-04-26T20:41:57.999 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 58281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-26T20:41:57.999 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 199041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-26T20:41:57.999 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 134945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-26T20:41:57.999 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-26T20:41:57.999 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 67497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-era.ko 2024-04-26T20:41:57.999 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-26T20:41:57.999 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 50457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-26T20:41:57.999 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 41145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log.ko 2024-04-26T20:41:57.999 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 60977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-mirror.ko 2024-04-26T20:41:57.999 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 97209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-26T20:41:57.999 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-26T20:41:57.999 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 85689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-26T20:41:57.999 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-region-hash.ko 2024-04-26T20:41:58.000 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-26T20:41:58.000 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-26T20:41:58.000 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-snapshot.ko 2024-04-26T20:41:58.000 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-26T20:41:58.000 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 234457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-26T20:41:58.000 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 66425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-26T20:41:58.000 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-zero.ko 2024-04-26T20:41:58.000 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/ 2024-04-26T20:41:58.000 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 264329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-26T20:41:58.000 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 43137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-26T20:41:58.000 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 125009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-26T20:41:58.000 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 157681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-26T20:41:58.000 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 444665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-26T20:41:58.000 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/ 2024-04-26T20:41:58.000 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/ 2024-04-26T20:41:58.001 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 214841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-26T20:41:58.001 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 77985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-26T20:41:58.001 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 54785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-26T20:41:58.001 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 44633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-26T20:41:58.001 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 150761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-26T20:41:58.001 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 97281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-26T20:41:58.001 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 63873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-26T20:41:58.001 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/ 2024-04-26T20:41:58.001 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm800.ko 2024-04-26T20:41:58.001 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm805.ko 2024-04-26T20:41:58.001 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm80x.ko 2024-04-26T20:41:58.001 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona-i2c.ko 2024-04-26T20:41:58.001 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 148633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona.ko 2024-04-26T20:41:58.001 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/bcm590xx.ko 2024-04-26T20:41:58.002 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/cros_ec_dev.ko 2024-04-26T20:41:58.002 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 41009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/dln2.ko 2024-04-26T20:41:58.002 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/janz-cmodio.ko 2024-04-26T20:41:58.002 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 59089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/kempld-core.ko 2024-04-26T20:41:58.002 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-core.ko 2024-04-26T20:41:58.002 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-04-26T20:41:58.002 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lp3943.ko 2024-04-26T20:41:58.002 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 60497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-26T20:41:58.002 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-26T20:41:58.002 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/max8907.ko 2024-04-26T20:41:58.002 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-core.ko 2024-04-26T20:41:58.002 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-04-26T20:41:58.002 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/menf21bmc.ko 2024-04-26T20:41:58.002 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-adc.ko 2024-04-26T20:41:58.002 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-gpio.ko 2024-04-26T20:41:58.003 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633.ko 2024-04-26T20:41:58.003 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-04-26T20:41:58.003 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/retu-mfd.ko 2024-04-26T20:41:58.003 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 99425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/si476x-core.ko 2024-04-26T20:41:58.003 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 58057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-26T20:41:58.003 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 60681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps65010.ko 2024-04-26T20:41:58.003 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps6507x.ko 2024-04-26T20:41:58.003 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-26T20:41:58.003 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-26T20:41:58.003 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-26T20:41:58.003 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 52361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wm8994.ko 2024-04-26T20:41:58.003 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ 2024-04-26T20:41:58.003 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-04-26T20:41:58.003 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 64265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot.ko 2024-04-26T20:41:58.003 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/ 2024-04-26T20:41:58.004 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 57521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-26T20:41:58.004 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-26T20:41:58.004 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-26T20:41:58.004 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 58633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-26T20:41:58.004 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/ 2024-04-26T20:41:58.004 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-04-26T20:41:58.004 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 47449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/core.ko 2024-04-26T20:41:58.004 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/ 2024-04-26T20:41:58.004 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-26T20:41:58.004 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ds1682.ko 2024-04-26T20:41:58.004 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/dummy-irq.ko 2024-04-26T20:41:58.004 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/ 2024-04-26T20:41:58.004 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/echo.ko 2024-04-26T20:41:58.004 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/ 2024-04-26T20:41:58.005 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 43041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-26T20:41:58.005 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-26T20:41:58.005 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-26T20:41:58.005 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 41185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-26T20:41:58.005 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/ 2024-04-26T20:41:58.005 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 191649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-04-26T20:41:58.005 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hmc6352.ko 2024-04-26T20:41:58.005 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 37761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-26T20:41:58.005 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ 2024-04-26T20:41:58.005 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 92345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-04-26T20:41:58.005 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ics932s401.ko 2024-04-26T20:41:58.005 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-26T20:41:58.005 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-26T20:41:58.005 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/ 2024-04-26T20:41:58.005 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 54865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-26T20:41:58.005 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-26T20:41:58.006 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/ 2024-04-26T20:41:58.006 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 154169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-26T20:41:58.006 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 69809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-26T20:41:58.006 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 389033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-26T20:41:58.006 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 37961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/phantom.ko 2024-04-26T20:41:58.006 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/ 2024-04-26T20:41:58.006 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 91145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/st_drv.ko 2024-04-26T20:41:58.006 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-26T20:41:58.006 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-26T20:41:58.006 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-26T20:41:58.006 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 55793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-26T20:41:58.006 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/ 2024-04-26T20:41:58.006 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 234905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-26T20:41:58.006 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ 2024-04-26T20:41:58.006 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/ 2024-04-26T20:41:58.007 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 620961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-26T20:41:58.007 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/ 2024-04-26T20:41:58.007 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/ 2024-04-26T20:41:58.007 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-26T20:41:58.007 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 49545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-26T20:41:58.007 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-26T20:41:58.007 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/ 2024-04-26T20:41:58.007 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 587065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-26T20:41:58.045 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-26T20:41:58.045 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-26T20:41:58.045 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ 2024-04-26T20:41:58.045 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/ 2024-04-26T20:41:58.046 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 53753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-26T20:41:58.046 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 49201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-26T20:41:58.046 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 158649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-26T20:41:58.046 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 85953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-26T20:41:58.046 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ 2024-04-26T20:41:58.046 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 44161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-26T20:41:58.046 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-26T20:41:58.046 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-26T20:41:58.046 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 109521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-26T20:41:58.046 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/ 2024-04-26T20:41:58.046 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 64705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-26T20:41:58.046 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/ 2024-04-26T20:41:58.046 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 84329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-26T20:41:58.046 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/ 2024-04-26T20:41:58.046 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 70737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-26T20:41:58.047 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/ 2024-04-26T20:41:58.047 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 52705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-26T20:41:58.047 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/ 2024-04-26T20:41:58.047 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 65857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-26T20:41:58.047 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 56057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-26T20:41:58.047 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 115881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-26T20:41:58.047 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/ 2024-04-26T20:41:58.047 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/ 2024-04-26T20:41:58.047 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 124497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-26T20:41:58.047 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-04-26T20:41:58.047 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 128409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-26T20:41:58.047 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-04-26T20:41:58.047 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 110345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-26T20:41:58.047 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/ 2024-04-26T20:41:58.047 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 101857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-26T20:41:58.048 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 88953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-26T20:41:58.048 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/ 2024-04-26T20:41:58.048 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 105633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-26T20:41:58.048 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 228985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-26T20:41:58.048 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-04-26T20:41:58.048 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 1733353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-26T20:41:58.048 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 167185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-26T20:41:58.048 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/ 2024-04-26T20:41:58.048 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 161417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-26T20:41:58.048 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 440625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-26T20:41:58.048 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/ 2024-04-26T20:41:58.048 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/ 2024-04-26T20:41:58.048 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 432201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-26T20:41:58.048 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/ 2024-04-26T20:41:58.048 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-04-26T20:41:58.048 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 257201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-26T20:41:58.048 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-04-26T20:41:58.049 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 446177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-26T20:41:58.049 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-04-26T20:41:58.049 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 1311433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-26T20:41:58.049 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-04-26T20:41:58.049 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 206689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-26T20:41:58.049 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-04-26T20:41:58.049 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 40161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-26T20:41:58.049 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/ 2024-04-26T20:41:58.049 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/ 2024-04-26T20:41:58.049 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 269313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-26T20:41:58.049 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/ 2024-04-26T20:41:58.049 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/ 2024-04-26T20:41:58.049 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 85385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-26T20:41:58.049 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 77457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-26T20:41:58.049 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 169089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-26T20:41:58.050 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-26T20:41:58.050 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 76209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-26T20:41:58.050 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 38065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-26T20:41:58.050 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/ 2024-04-26T20:41:58.050 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 75945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-26T20:41:58.050 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 78705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-26T20:41:58.050 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-26T20:41:58.050 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ec_bhf.ko 2024-04-26T20:41:58.050 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/ 2024-04-26T20:41:58.050 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/ 2024-04-26T20:41:58.050 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 356377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-26T20:41:58.050 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 61737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-26T20:41:58.050 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 63185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-26T20:41:58.050 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/ 2024-04-26T20:41:58.050 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 51513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-04-26T20:41:58.051 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ 2024-04-26T20:41:58.051 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 115569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-26T20:41:58.051 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/ 2024-04-26T20:41:58.051 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 366217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-26T20:41:58.051 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/ 2024-04-26T20:41:58.051 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 755793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-26T20:41:58.051 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/ 2024-04-26T20:41:58.051 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 324577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-26T20:41:58.051 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/ 2024-04-26T20:41:58.051 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 1196297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-26T20:41:58.051 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/ 2024-04-26T20:41:58.051 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 362593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-26T20:41:58.051 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/ 2024-04-26T20:41:58.051 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 671801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-26T20:41:58.051 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/ 2024-04-26T20:41:58.052 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 121537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-26T20:41:58.052 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-04-26T20:41:58.052 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 966705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-26T20:41:58.052 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-04-26T20:41:58.052 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 193585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-26T20:41:58.052 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 108633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-26T20:41:58.052 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/ 2024-04-26T20:41:58.052 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-26T20:41:58.052 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 126881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-26T20:41:58.052 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 150777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-26T20:41:58.052 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/ 2024-04-26T20:41:58.052 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-04-26T20:41:58.052 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 905033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-26T20:41:58.052 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 344145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-26T20:41:58.052 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-04-26T20:41:58.052 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-04-26T20:41:58.053 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 1412417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-26T20:41:58.053 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ 2024-04-26T20:41:58.053 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-04-26T20:41:58.053 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 54497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-04-26T20:41:58.053 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-04-26T20:41:58.053 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 117353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-26T20:41:58.053 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/ 2024-04-26T20:41:58.053 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-04-26T20:41:58.053 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 131425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-26T20:41:58.053 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ 2024-04-26T20:41:58.053 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 91465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-26T20:41:58.053 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 56689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-26T20:41:58.053 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/ 2024-04-26T20:41:58.053 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 181081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-26T20:41:58.053 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/ 2024-04-26T20:41:58.054 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 171417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-26T20:41:58.054 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/ 2024-04-26T20:41:58.054 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 58249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-26T20:41:58.054 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 50121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-26T20:41:58.054 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/ 2024-04-26T20:41:58.054 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-04-26T20:41:58.054 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 300817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-26T20:41:58.054 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 105689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-26T20:41:58.054 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-04-26T20:41:58.054 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 885129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-26T20:41:58.054 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/ 2024-04-26T20:41:58.054 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 52305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-26T20:41:58.054 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/ 2024-04-26T20:41:58.054 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 81641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-26T20:41:58.055 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 100689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-26T20:41:58.055 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-26T20:41:58.055 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 264161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-26T20:41:58.055 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/ 2024-04-26T20:41:58.055 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-04-26T20:41:58.055 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 142449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-04-26T20:41:58.055 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/ 2024-04-26T20:41:58.055 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 1350385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-26T20:41:58.055 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/ 2024-04-26T20:41:58.055 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 57953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-26T20:41:58.055 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/ 2024-04-26T20:41:58.055 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 66505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-26T20:41:58.055 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 80065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-26T20:41:58.055 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/ 2024-04-26T20:41:58.055 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 74289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-26T20:41:58.055 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 79457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-26T20:41:58.056 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 100785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-26T20:41:58.056 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 83441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-26T20:41:58.056 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/ 2024-04-26T20:41:58.056 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-04-26T20:41:58.056 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-04-26T20:41:58.056 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 46985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-26T20:41:58.056 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-04-26T20:41:58.056 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 644537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-26T20:41:58.056 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/ 2024-04-26T20:41:58.056 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 128497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-26T20:41:58.056 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 207993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-26T20:41:58.056 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 82633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-26T20:41:58.056 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 91353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-26T20:41:58.056 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/ 2024-04-26T20:41:58.056 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 59865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-26T20:41:58.057 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/ 2024-04-26T20:41:58.057 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 110729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-26T20:41:58.057 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/ 2024-04-26T20:41:58.057 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 98689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-26T20:41:58.057 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 102513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-26T20:41:58.057 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/ 2024-04-26T20:41:58.057 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 61497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-26T20:41:58.057 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 40609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-26T20:41:58.057 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/ 2024-04-26T20:41:58.057 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 69913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-26T20:41:58.057 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/ 2024-04-26T20:41:58.057 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 49449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/defxx.ko 2024-04-26T20:41:58.057 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/ 2024-04-26T20:41:58.057 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 275801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/skfp.ko 2024-04-26T20:41:58.057 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 91105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-26T20:41:58.057 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/ 2024-04-26T20:41:58.057 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 290441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-26T20:41:58.058 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/ 2024-04-26T20:41:58.058 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-26T20:41:58.058 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-26T20:41:58.058 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ 2024-04-26T20:41:58.058 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 108329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-26T20:41:58.058 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 78065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-26T20:41:58.058 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-26T20:41:58.058 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/ 2024-04-26T20:41:58.058 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-26T20:41:58.058 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-26T20:41:58.058 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-gpio.ko 2024-04-26T20:41:58.058 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-26T20:41:58.058 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-26T20:41:58.059 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-26T20:41:58.059 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 62681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-26T20:41:58.059 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-26T20:41:58.059 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/ 2024-04-26T20:41:58.059 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-26T20:41:58.059 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 48313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-26T20:41:58.059 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ 2024-04-26T20:41:58.059 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-26T20:41:58.059 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 61985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-26T20:41:58.059 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 52865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-26T20:41:58.059 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-26T20:41:58.059 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 53409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-26T20:41:58.059 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-26T20:41:58.059 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-26T20:41:58.059 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-26T20:41:58.059 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-26T20:41:58.060 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-26T20:41:58.060 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 103377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-26T20:41:58.060 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 96025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-26T20:41:58.060 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-26T20:41:58.060 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 121105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-26T20:41:58.060 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-26T20:41:58.060 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 62113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-26T20:41:58.060 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-26T20:41:58.060 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-26T20:41:58.060 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-26T20:41:58.060 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/ 2024-04-26T20:41:58.060 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 55353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/plip.ko 2024-04-26T20:41:58.060 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ 2024-04-26T20:41:58.060 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-26T20:41:58.060 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-26T20:41:58.060 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-26T20:41:58.061 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-26T20:41:58.061 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-26T20:41:58.061 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 53233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-26T20:41:58.061 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-26T20:41:58.061 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-26T20:41:58.061 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sb1000.ko 2024-04-26T20:41:58.061 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/ 2024-04-26T20:41:58.061 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 52073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-26T20:41:58.061 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 42409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-26T20:41:58.061 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 80161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-26T20:41:58.061 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/ 2024-04-26T20:41:58.061 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 137321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-26T20:41:58.061 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-26T20:41:58.061 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-26T20:41:58.061 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-26T20:41:58.061 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-26T20:41:58.061 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-26T20:41:58.062 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 108089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-26T20:41:58.062 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/ 2024-04-26T20:41:58.062 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 176497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-26T20:41:58.062 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/ 2024-04-26T20:41:58.062 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 383593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-26T20:41:58.062 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/ 2024-04-26T20:41:58.062 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 175537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-26T20:41:58.062 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ 2024-04-26T20:41:58.062 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-26T20:41:58.062 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/ 2024-04-26T20:41:58.062 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/ 2024-04-26T20:41:58.062 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 335857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-26T20:41:58.062 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 126553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-26T20:41:58.062 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/ 2024-04-26T20:41:58.062 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 168145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-26T20:41:58.063 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-26T20:41:58.063 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 103889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-26T20:41:58.063 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-26T20:41:58.063 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/ 2024-04-26T20:41:58.063 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/ 2024-04-26T20:41:58.063 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-26T20:41:58.063 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-04-26T20:41:58.063 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-04-26T20:41:58.063 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pci-stub.ko 2024-04-26T20:41:58.063 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 55329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-26T20:41:58.063 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/ 2024-04-26T20:41:58.063 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-26T20:41:58.063 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 179961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia.ko 2024-04-26T20:41:58.063 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 78161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_core.ko 2024-04-26T20:41:58.063 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 41945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-04-26T20:41:58.063 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 40457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-26T20:41:58.064 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 133753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-26T20:41:58.064 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/ 2024-04-26T20:41:58.064 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/ 2024-04-26T20:41:58.064 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-04-26T20:41:58.064 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/ 2024-04-26T20:41:58.064 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-04-26T20:41:58.064 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/ 2024-04-26T20:41:58.064 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/ 2024-04-26T20:41:58.064 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 78193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-26T20:41:58.064 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/ 2024-04-26T20:41:58.064 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/ 2024-04-26T20:41:58.064 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 61041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-04-26T20:41:58.064 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec.ko 2024-04-26T20:41:58.064 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-04-26T20:41:58.064 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-04-26T20:41:58.065 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-04-26T20:41:58.065 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-04-26T20:41:58.065 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-04-26T20:41:58.065 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ 2024-04-26T20:41:58.065 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 87481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-26T20:41:58.065 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 44105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-26T20:41:58.065 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 48257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-26T20:41:58.065 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-26T20:41:58.065 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-26T20:41:58.065 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 164769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-26T20:41:58.065 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 46185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-26T20:41:58.065 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 62073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-26T20:41:58.065 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-26T20:41:58.065 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 51881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-26T20:41:58.066 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-26T20:41:58.066 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 42761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-26T20:41:58.066 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ibm_rtl.ko 2024-04-26T20:41:58.066 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/ 2024-04-26T20:41:58.066 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-26T20:41:58.066 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-04-26T20:41:58.066 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 54001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-26T20:41:58.066 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-26T20:41:58.066 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-26T20:41:58.066 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 43753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-26T20:41:58.066 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-26T20:41:58.066 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-26T20:41:58.066 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-26T20:41:58.066 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-26T20:41:58.067 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-26T20:41:58.067 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-26T20:41:58.067 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 61417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-26T20:41:58.067 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/ 2024-04-26T20:41:58.067 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ 2024-04-26T20:41:58.067 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_battery.ko 2024-04-26T20:41:58.067 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 40425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_charger.ko 2024-04-26T20:41:58.067 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 68833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq2415x_charger.ko 2024-04-26T20:41:58.067 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 73073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24190_charger.ko 2024-04-26T20:41:58.067 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24735-charger.ko 2024-04-26T20:41:58.067 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-04-26T20:41:58.067 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9030_battery.ko 2024-04-26T20:41:58.067 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9052-battery.ko 2024-04-26T20:41:58.067 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2760_battery.ko 2024-04-26T20:41:58.067 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2780_battery.ko 2024-04-26T20:41:58.067 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2781_battery.ko 2024-04-26T20:41:58.067 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2782_battery.ko 2024-04-26T20:41:58.068 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/gpio-charger.ko 2024-04-26T20:41:58.068 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/isp1704_charger.ko 2024-04-26T20:41:58.068 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/lp8727_charger.ko 2024-04-26T20:41:58.068 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max14577_charger.ko 2024-04-26T20:41:58.068 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 37833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max17042_battery.ko 2024-04-26T20:41:58.068 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8903_charger.ko 2024-04-26T20:41:58.068 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8925_power.ko 2024-04-26T20:41:58.068 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/pcf50633-charger.ko 2024-04-26T20:41:58.068 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 44841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/sbs-battery.ko 2024-04-26T20:41:58.068 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/test_power.ko 2024-04-26T20:41:58.068 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/tps65090-charger.ko 2024-04-26T20:41:58.068 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_backup.ko 2024-04-26T20:41:58.068 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_power.ko 2024-04-26T20:41:58.068 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm8350_power.ko 2024-04-26T20:41:58.068 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/ 2024-04-26T20:41:58.069 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 73297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-26T20:41:58.069 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-26T20:41:58.069 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/ 2024-04-26T20:41:58.069 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/ 2024-04-26T20:41:58.069 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-26T20:41:58.069 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-26T20:41:58.069 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-26T20:41:58.069 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 49817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-26T20:41:58.069 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ 2024-04-26T20:41:58.069 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 91393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-26T20:41:58.069 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-26T20:41:58.069 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/ 2024-04-26T20:41:58.069 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/ 2024-04-26T20:41:58.069 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/ 2024-04-26T20:41:58.069 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 67513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-26T20:41:58.069 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 47137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-26T20:41:58.070 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/ 2024-04-26T20:41:58.070 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm80x.ko 2024-04-26T20:41:58.070 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm860x.ko 2024-04-26T20:41:58.070 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-26T20:41:58.070 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9052.ko 2024-04-26T20:41:58.070 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9055.ko 2024-04-26T20:41:58.070 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9063.ko 2024-04-26T20:41:58.070 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-26T20:41:58.070 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 82225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-26T20:41:58.070 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-26T20:41:58.070 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-26T20:41:58.070 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-26T20:41:58.070 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-26T20:41:58.070 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-26T20:41:58.070 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-26T20:41:58.071 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-26T20:41:58.071 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-26T20:41:58.071 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-26T20:41:58.071 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-26T20:41:58.071 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 44129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-26T20:41:58.071 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-lp8788.ko 2024-04-26T20:41:58.071 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 46913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-26T20:41:58.071 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-26T20:41:58.071 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-26T20:41:58.071 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t86.ko 2024-04-26T20:41:58.071 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-26T20:41:58.071 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8907.ko 2024-04-26T20:41:58.071 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8925.ko 2024-04-26T20:41:58.071 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8997.ko 2024-04-26T20:41:58.071 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8998.ko 2024-04-26T20:41:58.072 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-04-26T20:41:58.072 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-26T20:41:58.072 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-palmas.ko 2024-04-26T20:41:58.072 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 56777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-26T20:41:58.072 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf50633.ko 2024-04-26T20:41:58.072 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 32657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-26T20:41:58.072 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-26T20:41:58.072 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-26T20:41:58.072 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-26T20:41:58.072 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rc5t583.ko 2024-04-26T20:41:58.072 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-26T20:41:58.072 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-26T20:41:58.072 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-26T20:41:58.072 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-26T20:41:58.072 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-26T20:41:58.072 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-s35390a.ko 2024-04-26T20:41:58.072 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-26T20:41:58.073 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps6586x.ko 2024-04-26T20:41:58.073 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps65910.ko 2024-04-26T20:41:58.073 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm831x.ko 2024-04-26T20:41:58.073 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm8350.ko 2024-04-26T20:41:58.073 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-26T20:41:58.073 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ 2024-04-26T20:41:58.073 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 90377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-26T20:41:58.073 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 69593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-26T20:41:58.073 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 65945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-26T20:41:58.073 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 164569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-26T20:41:58.073 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-26T20:41:58.073 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/ 2024-04-26T20:41:58.073 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 340721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-26T20:41:58.073 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 120337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-26T20:41:58.073 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/ 2024-04-26T20:41:58.074 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 468081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-26T20:41:58.074 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 380673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-26T20:41:58.074 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/ 2024-04-26T20:41:58.074 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 243705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-04-26T20:41:58.074 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-26T20:41:58.074 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/ 2024-04-26T20:41:58.074 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 135617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-26T20:41:58.074 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-26T20:41:58.074 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/ 2024-04-26T20:41:58.074 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 304993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-26T20:41:58.074 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/ 2024-04-26T20:41:58.074 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 1527113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-26T20:41:58.074 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/ 2024-04-26T20:41:58.074 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 297801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-26T20:41:58.075 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/ 2024-04-26T20:41:58.075 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 144401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-26T20:41:58.075 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 47457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-26T20:41:58.075 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/ 2024-04-26T20:41:58.075 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 390713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-26T20:41:58.075 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/ 2024-04-26T20:41:58.075 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-04-26T20:41:58.075 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 88881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-26T20:41:58.075 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-04-26T20:41:58.075 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 117481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-26T20:41:58.075 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 173017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-26T20:41:58.075 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 91569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-26T20:41:58.075 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 45401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-26T20:41:58.075 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/ 2024-04-26T20:41:58.075 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 267577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-26T20:41:58.075 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-26T20:41:58.076 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/ 2024-04-26T20:41:58.076 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 95329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-26T20:41:58.076 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 194017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-26T20:41:58.076 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fdomain.ko 2024-04-26T20:41:58.076 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/ 2024-04-26T20:41:58.076 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 366529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-26T20:41:58.076 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 251505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-26T20:41:58.076 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 65761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-26T20:41:58.076 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 57097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-26T20:41:58.076 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 44689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/imm.ko 2024-04-26T20:41:58.076 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 55153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-26T20:41:58.076 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 327841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-26T20:41:58.076 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 129785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-26T20:41:58.076 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/ 2024-04-26T20:41:58.076 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 397785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-26T20:41:58.076 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 32017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-26T20:41:58.077 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 63121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-26T20:41:58.077 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/ 2024-04-26T20:41:58.077 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 386849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-26T20:41:58.077 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 178177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-26T20:41:58.077 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 64809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-26T20:41:58.077 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/ 2024-04-26T20:41:58.077 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 274009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-26T20:41:58.077 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/ 2024-04-26T20:41:58.077 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 2736001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-26T20:41:58.077 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/ 2024-04-26T20:41:58.077 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 88529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-26T20:41:58.077 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 40145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-26T20:41:58.077 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 389177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-26T20:41:58.077 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 104769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-26T20:41:58.077 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/ 2024-04-26T20:41:58.078 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 836945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-26T20:41:58.078 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/ 2024-04-26T20:41:58.078 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 158729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-26T20:41:58.078 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 96537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-26T20:41:58.078 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/ 2024-04-26T20:41:58.078 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 101625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-04-26T20:41:58.078 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-04-26T20:41:58.078 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-04-26T20:41:58.078 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-04-26T20:41:58.078 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/ 2024-04-26T20:41:58.078 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 443745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-26T20:41:58.078 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 152033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-26T20:41:58.112 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 41625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ppa.ko 2024-04-26T20:41:58.112 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 66977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-26T20:41:58.112 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/ 2024-04-26T20:41:58.112 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 2324809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-26T20:41:58.112 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 103601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-26T20:41:58.112 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/ 2024-04-26T20:41:58.113 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 697337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-26T20:41:58.113 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qlogicfas408.ko 2024-04-26T20:41:58.113 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-26T20:41:58.113 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 322865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-26T20:41:58.113 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 219857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-26T20:41:58.113 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 357153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-26T20:41:58.113 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 121185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-26T20:41:58.113 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 93481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-26T20:41:58.113 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 55401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-26T20:41:58.113 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-26T20:41:58.113 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 138121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-26T20:41:58.113 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 57401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-26T20:41:58.113 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/ 2024-04-26T20:41:58.113 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 205025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-26T20:41:58.113 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 55425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-26T20:41:58.114 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 59185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-26T20:41:58.114 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 48777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-26T20:41:58.114 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 59417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/xen-scsifront.ko 2024-04-26T20:41:58.114 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ 2024-04-26T20:41:58.114 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 174913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-26T20:41:58.114 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/ 2024-04-26T20:41:58.114 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/ 2024-04-26T20:41:58.114 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 920169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-26T20:41:58.114 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/ 2024-04-26T20:41:58.114 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 60321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-26T20:41:58.114 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 48129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-26T20:41:58.114 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 54233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-26T20:41:58.114 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 1170033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-26T20:41:58.114 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-26T20:41:58.115 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 149721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-26T20:41:58.115 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/ 2024-04-26T20:41:58.115 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 90057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-26T20:41:58.115 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/ 2024-04-26T20:41:58.115 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/ 2024-04-26T20:41:58.115 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/ 2024-04-26T20:41:58.115 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-26T20:41:58.115 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-26T20:41:58.115 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-26T20:41:58.115 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-26T20:41:58.115 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-26T20:41:58.115 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-26T20:41:58.115 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-26T20:41:58.115 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-26T20:41:58.115 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-26T20:41:58.115 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-26T20:41:58.116 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-26T20:41:58.116 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-26T20:41:58.116 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 46065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-26T20:41:58.116 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-26T20:41:58.116 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-26T20:41:58.116 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-04-26T20:41:58.116 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-26T20:41:58.116 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-26T20:41:58.116 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-26T20:41:58.116 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ 2024-04-26T20:41:58.116 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ 2024-04-26T20:41:58.116 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 99313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-26T20:41:58.116 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 69729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/moxa.ko 2024-04-26T20:41:58.116 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 61649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/mxser.ko 2024-04-26T20:41:58.117 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 134401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-26T20:41:58.117 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 37905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-26T20:41:58.117 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-26T20:41:58.117 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/ 2024-04-26T20:41:58.117 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/ 2024-04-26T20:41:58.117 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 44057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-04-26T20:41:58.117 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 65121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-26T20:41:58.117 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-04-26T20:41:58.117 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_uart.ko 2024-04-26T20:41:58.117 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-26T20:41:58.117 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 91665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-04-26T20:41:58.117 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/ 2024-04-26T20:41:58.117 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 120577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-26T20:41:58.117 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/rp2.ko 2024-04-26T20:41:58.117 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 65641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/sc16is7xx.ko 2024-04-26T20:41:58.118 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/ 2024-04-26T20:41:58.118 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ 2024-04-26T20:41:58.118 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 693081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-26T20:41:58.118 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ 2024-04-26T20:41:58.118 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-26T20:41:58.118 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-04-26T20:41:58.118 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/ 2024-04-26T20:41:58.118 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 55617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-26T20:41:58.118 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-26T20:41:58.118 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-26T20:41:58.118 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_dmem_genirq.ko 2024-04-26T20:41:58.118 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_mf624.ko 2024-04-26T20:41:58.118 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_netx.ko 2024-04-26T20:41:58.118 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-26T20:41:58.118 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-04-26T20:41:58.119 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-26T20:41:58.119 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/ 2024-04-26T20:41:58.119 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/ 2024-04-26T20:41:58.119 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 90321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/c67x00.ko 2024-04-26T20:41:58.119 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ 2024-04-26T20:41:58.119 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 189209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-04-26T20:41:58.119 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-04-26T20:41:58.119 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-04-26T20:41:58.119 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-04-26T20:41:58.119 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-04-26T20:41:58.119 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/ 2024-04-26T20:41:58.119 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 101545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-26T20:41:58.119 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 63073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-26T20:41:58.119 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 56721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-26T20:41:58.119 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 107417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-26T20:41:58.119 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ 2024-04-26T20:41:58.120 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ulpi.ko 2024-04-26T20:41:58.120 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/ 2024-04-26T20:41:58.120 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-04-26T20:41:58.120 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/ 2024-04-26T20:41:58.120 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-04-26T20:41:58.120 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-04-26T20:41:58.120 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 574593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3.ko 2024-04-26T20:41:58.120 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/ 2024-04-26T20:41:58.120 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/ 2024-04-26T20:41:58.120 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 72249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_ether.ko 2024-04-26T20:41:58.120 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 61953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_serial.ko 2024-04-26T20:41:58.120 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-04-26T20:41:58.120 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 49737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-04-26T20:41:58.120 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-04-26T20:41:58.120 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-04-26T20:41:58.121 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 131345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-04-26T20:41:58.121 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 62321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-04-26T20:41:58.121 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 146617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-04-26T20:41:58.121 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 70689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-04-26T20:41:58.121 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-04-26T20:41:58.121 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 37649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-04-26T20:41:58.121 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 70017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-04-26T20:41:58.121 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 101249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-04-26T20:41:58.121 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-04-26T20:41:58.121 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 71257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-04-26T20:41:58.121 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 84937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-04-26T20:41:58.121 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/ 2024-04-26T20:41:58.121 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-04-26T20:41:58.121 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-04-26T20:41:58.121 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-04-26T20:41:58.121 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-04-26T20:41:58.122 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-04-26T20:41:58.122 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-04-26T20:41:58.122 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-04-26T20:41:58.122 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-04-26T20:41:58.122 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-04-26T20:41:58.122 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-04-26T20:41:58.122 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-04-26T20:41:58.122 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-04-26T20:41:58.122 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 78073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-04-26T20:41:58.122 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-04-26T20:41:58.122 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 204049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/libcomposite.ko 2024-04-26T20:41:58.122 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/ 2024-04-26T20:41:58.122 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-04-26T20:41:58.122 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/ 2024-04-26T20:41:58.122 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 182561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-04-26T20:41:58.123 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 45545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-04-26T20:41:58.123 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 66513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-04-26T20:41:58.123 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 85217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-04-26T20:41:58.123 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 69313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-04-26T20:41:58.123 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 90313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2272.ko 2024-04-26T20:41:58.123 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 90361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2280.ko 2024-04-26T20:41:58.123 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 94841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-04-26T20:41:58.123 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-04-26T20:41:58.123 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 87465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-04-26T20:41:58.123 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 95441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-04-26T20:41:58.123 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 195969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-04-26T20:41:58.123 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ 2024-04-26T20:41:58.123 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/bcma-hcd.ko 2024-04-26T20:41:58.123 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 108321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/isp116x-hcd.ko 2024-04-26T20:41:58.123 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 104377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-04-26T20:41:58.124 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 102273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-04-26T20:41:58.124 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 60105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-26T20:41:58.124 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811_cs.ko 2024-04-26T20:41:58.124 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ssb-hcd.ko 2024-04-26T20:41:58.124 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-04-26T20:41:58.124 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/ 2024-04-26T20:41:58.124 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 40409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-26T20:41:58.124 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-26T20:41:58.124 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ 2024-04-26T20:41:58.124 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 47353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-26T20:41:58.124 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-26T20:41:58.124 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-04-26T20:41:58.124 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cytherm.ko 2024-04-26T20:41:58.124 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ehset.ko 2024-04-26T20:41:58.124 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-26T20:41:58.124 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-26T20:41:58.124 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-26T20:41:58.125 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-26T20:41:58.125 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 42729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-26T20:41:58.125 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-26T20:41:58.125 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 42241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-26T20:41:58.125 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 42233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-26T20:41:58.125 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/lvstest.ko 2024-04-26T20:41:58.125 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/ 2024-04-26T20:41:58.125 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 85313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-26T20:41:58.125 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-26T20:41:58.125 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-26T20:41:58.125 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-26T20:41:58.125 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-26T20:41:58.125 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 84265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbtest.ko 2024-04-26T20:41:58.125 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 52065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-26T20:41:58.125 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 32345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-26T20:41:58.125 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/ 2024-04-26T20:41:58.126 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 91529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/usbmon.ko 2024-04-26T20:41:58.126 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/ 2024-04-26T20:41:58.126 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 396209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/musb_hdrc.ko 2024-04-26T20:41:58.126 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/ 2024-04-26T20:41:58.126 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-26T20:41:58.126 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-04-26T20:41:58.126 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-isp1301.ko 2024-04-26T20:41:58.126 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-tahvo.ko 2024-04-26T20:41:58.126 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ 2024-04-26T20:41:58.126 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-26T20:41:58.126 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-26T20:41:58.126 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-26T20:41:58.126 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 44329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-26T20:41:58.126 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-26T20:41:58.126 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-26T20:41:58.127 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 66873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-26T20:41:58.127 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 58329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-26T20:41:58.127 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-26T20:41:58.127 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 53009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/f81232.ko 2024-04-26T20:41:58.127 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 188609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-26T20:41:58.127 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 61489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-26T20:41:58.127 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 152305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-26T20:41:58.127 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 142833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-26T20:41:58.127 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 69217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-26T20:41:58.127 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-26T20:41:58.127 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-26T20:41:58.127 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-26T20:41:58.127 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 122329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-26T20:41:58.127 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 41297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-26T20:41:58.127 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-26T20:41:58.127 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 38049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-26T20:41:58.128 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 38041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-26T20:41:58.128 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/metro-usb.ko 2024-04-26T20:41:58.128 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-26T20:41:58.128 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 89969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-26T20:41:58.128 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 65073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mxuport.ko 2024-04-26T20:41:58.128 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-26T20:41:58.128 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-26T20:41:58.128 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-26T20:41:58.128 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 193857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-26T20:41:58.128 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 45337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-26T20:41:58.128 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 61761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-26T20:41:58.128 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-26T20:41:58.128 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 39985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-26T20:41:58.128 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 40529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-26T20:41:58.128 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-26T20:41:58.129 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 59345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-26T20:41:58.129 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-26T20:41:58.129 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-26T20:41:58.129 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-26T20:41:58.129 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 70497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-26T20:41:58.129 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-26T20:41:58.129 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-26T20:41:58.129 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 39321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-26T20:41:58.129 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 151137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usbserial.ko 2024-04-26T20:41:58.129 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-26T20:41:58.129 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 43577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-26T20:41:58.129 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/wishbone-serial.ko 2024-04-26T20:41:58.129 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-26T20:41:58.129 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ 2024-04-26T20:41:58.129 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 64049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-26T20:41:58.129 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-26T20:41:58.130 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-26T20:41:58.130 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-26T20:41:58.130 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 41073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-26T20:41:58.130 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-26T20:41:58.130 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-26T20:41:58.130 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-26T20:41:58.130 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-26T20:41:58.130 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-26T20:41:58.130 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-26T20:41:58.130 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-26T20:41:58.130 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-26T20:41:58.130 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 41785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-26T20:41:58.130 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 201193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-26T20:41:58.130 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/ 2024-04-26T20:41:58.131 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 76041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-26T20:41:58.131 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 85257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-26T20:41:58.131 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 122321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-26T20:41:58.131 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/ 2024-04-26T20:41:58.131 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/ 2024-04-26T20:41:58.131 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 206921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-26T20:41:58.131 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-26T20:41:58.131 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 134265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-26T20:41:58.131 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 93673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-26T20:41:58.131 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/ 2024-04-26T20:41:58.131 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 138721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-26T20:41:58.131 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-26T20:41:58.131 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 71281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-26T20:41:58.131 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 107905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-26T20:41:58.131 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/ 2024-04-26T20:41:58.131 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/ 2024-04-26T20:41:58.132 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-04-26T20:41:58.132 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/aat2870_bl.ko 2024-04-26T20:41:58.132 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp5520_bl.ko 2024-04-26T20:41:58.132 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 41169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8860_bl.ko 2024-04-26T20:41:58.132 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 51745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8870_bl.ko 2024-04-26T20:41:58.132 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-26T20:41:58.132 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/as3711_bl.ko 2024-04-26T20:41:58.132 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/bd6107.ko 2024-04-26T20:41:58.132 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da903x_bl.ko 2024-04-26T20:41:58.132 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da9052_bl.ko 2024-04-26T20:41:58.132 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/gpio_backlight.ko 2024-04-26T20:41:58.132 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/kb3886_bl.ko 2024-04-26T20:41:58.132 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-26T20:41:58.132 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3533_bl.ko 2024-04-26T20:41:58.132 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3639_bl.ko 2024-04-26T20:41:58.132 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lv5207lp.ko 2024-04-26T20:41:58.133 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/max8925_bl.ko 2024-04-26T20:41:58.133 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pandora_bl.ko 2024-04-26T20:41:58.133 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-04-26T20:41:58.133 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-26T20:41:58.133 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/wm831x_bl.ko 2024-04-26T20:41:58.133 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/ 2024-04-26T20:41:58.133 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ 2024-04-26T20:41:58.133 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-26T20:41:58.133 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 46801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-26T20:41:58.133 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/matrox_w1.ko 2024-04-26T20:41:58.133 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/w1-gpio.ko 2024-04-26T20:41:58.133 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/ 2024-04-26T20:41:58.133 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-26T20:41:58.133 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-26T20:41:58.134 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-26T20:41:58.134 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-26T20:41:58.134 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-26T20:41:58.134 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-26T20:41:58.134 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-26T20:41:58.134 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-26T20:41:58.134 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-26T20:41:58.134 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-26T20:41:58.134 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 70369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-26T20:41:58.134 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 129433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-26T20:41:58.134 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ 2024-04-26T20:41:58.134 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/acquirewdt.ko 2024-04-26T20:41:58.134 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/advantechwdt.ko 2024-04-26T20:41:58.134 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-26T20:41:58.135 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-26T20:41:58.135 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/cpu5wdt.ko 2024-04-26T20:41:58.135 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9052_wdt.ko 2024-04-26T20:41:58.135 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9055_wdt.ko 2024-04-26T20:41:58.135 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9063_wdt.ko 2024-04-26T20:41:58.135 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/dw_wdt.ko 2024-04-26T20:41:58.135 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/eurotechwdt.ko 2024-04-26T20:41:58.135 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-26T20:41:58.135 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 32857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-26T20:41:58.135 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-26T20:41:58.135 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-26T20:41:58.135 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-26T20:41:58.135 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-26T20:41:58.135 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-26T20:41:58.136 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-26T20:41:58.136 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-26T20:41:58.136 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-26T20:41:58.136 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/kempld_wdt.ko 2024-04-26T20:41:58.136 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-26T20:41:58.136 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/mena21_wdt.ko 2024-04-26T20:41:58.136 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-04-26T20:41:58.136 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-26T20:41:58.136 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-04-26T20:41:58.136 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pc87413_wdt.ko 2024-04-26T20:41:58.136 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 46953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-26T20:41:58.136 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 37193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-26T20:41:58.136 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/retu_wdt.ko 2024-04-26T20:41:58.136 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-04-26T20:41:58.136 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-04-26T20:41:58.137 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-26T20:41:58.137 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sc1200wdt.ko 2024-04-26T20:41:58.137 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-26T20:41:58.137 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-04-26T20:41:58.137 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-26T20:41:58.137 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-26T20:41:58.137 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/twl4030_wdt.ko 2024-04-26T20:41:58.137 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-26T20:41:58.137 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-26T20:41:58.137 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-26T20:41:58.137 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 32481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-26T20:41:58.137 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wafer5823wdt.ko 2024-04-26T20:41:58.137 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-26T20:41:58.137 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm831x_wdt.ko 2024-04-26T20:41:58.137 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm8350_wdt.ko 2024-04-26T20:41:58.137 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-26T20:41:58.137 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/ 2024-04-26T20:41:58.138 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-26T20:41:58.138 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-26T20:41:58.138 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-26T20:41:58.138 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/ 2024-04-26T20:41:58.138 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 213913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-26T20:41:58.138 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-26T20:41:58.138 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 85713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-scsiback.ko 2024-04-26T20:41:58.138 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/ 2024-04-26T20:41:58.138 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-26T20:41:58.138 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ 2024-04-26T20:41:58.138 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/ 2024-04-26T20:41:58.138 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 192617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-26T20:41:58.138 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/ 2024-04-26T20:41:58.138 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 78153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/adfs.ko 2024-04-26T20:41:58.139 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/ 2024-04-26T20:41:58.139 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 197849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-26T20:41:58.139 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/ 2024-04-26T20:41:58.139 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 1261113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/kafs.ko 2024-04-26T20:41:58.139 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/ 2024-04-26T20:41:58.139 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 127377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/autofs4.ko 2024-04-26T20:41:58.139 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/ 2024-04-26T20:41:58.139 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-26T20:41:58.139 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/ 2024-04-26T20:41:58.139 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 50473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/bfs.ko 2024-04-26T20:41:58.139 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 45561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-26T20:41:58.139 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/ 2024-04-26T20:41:58.139 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 4489593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-26T20:41:58.139 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/ 2024-04-26T20:41:58.139 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 376857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-26T20:41:58.140 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ 2024-04-26T20:41:58.140 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 1586065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-26T20:41:58.140 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/ 2024-04-26T20:41:58.140 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 130073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-26T20:41:58.140 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/ 2024-04-26T20:41:58.140 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 139081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/configfs.ko 2024-04-26T20:41:58.140 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/ 2024-04-26T20:41:58.140 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-26T20:41:58.140 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/ 2024-04-26T20:41:58.140 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 813225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-26T20:41:58.140 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/ 2024-04-26T20:41:58.140 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 46409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/efs.ko 2024-04-26T20:41:58.140 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/ 2024-04-26T20:41:58.140 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 1906817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-26T20:41:58.140 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/ 2024-04-26T20:41:58.140 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-26T20:41:58.141 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/ 2024-04-26T20:41:58.141 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/freevxfs.ko 2024-04-26T20:41:58.141 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/ 2024-04-26T20:41:58.141 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-26T20:41:58.141 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/ 2024-04-26T20:41:58.141 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 1486521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-26T20:41:58.141 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/ 2024-04-26T20:41:58.141 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 183305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-26T20:41:58.141 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/ 2024-04-26T20:41:58.141 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 282097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-26T20:41:58.141 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/ 2024-04-26T20:41:58.141 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 249009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/hpfs.ko 2024-04-26T20:41:58.141 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/ 2024-04-26T20:41:58.141 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 93033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-26T20:41:58.141 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/ 2024-04-26T20:41:58.141 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 533073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-26T20:41:58.142 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/ 2024-04-26T20:41:58.142 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 361369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-26T20:41:58.142 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/ 2024-04-26T20:41:58.142 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 112609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-26T20:41:58.142 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/ 2024-04-26T20:41:58.142 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 591585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-26T20:41:58.142 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/ 2024-04-26T20:41:58.142 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/ 2024-04-26T20:41:58.142 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 102561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-26T20:41:58.142 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/ 2024-04-26T20:41:58.142 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 74353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-26T20:41:58.142 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/ 2024-04-26T20:41:58.142 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 147689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-26T20:41:58.142 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 1320249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-26T20:41:58.157 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 82105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv2.ko 2024-04-26T20:41:58.157 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 151641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-26T20:41:58.157 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 2518505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-26T20:41:58.157 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/ 2024-04-26T20:41:58.157 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-26T20:41:58.157 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-26T20:41:58.157 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/ 2024-04-26T20:41:58.157 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 2024049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-26T20:41:58.157 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/ 2024-04-26T20:41:58.157 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 734025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-26T20:41:58.157 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/ 2024-04-26T20:41:58.157 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-26T20:41:58.158 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-26T20:41:58.158 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-26T20:41:58.158 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-26T20:41:58.158 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-26T20:41:58.158 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-26T20:41:58.158 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-26T20:41:58.158 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-26T20:41:58.158 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-26T20:41:58.158 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-26T20:41:58.158 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-26T20:41:58.158 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ascii.ko 2024-04-26T20:41:58.158 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-26T20:41:58.158 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-26T20:41:58.158 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-26T20:41:58.159 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-26T20:41:58.159 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-26T20:41:58.159 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-26T20:41:58.159 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-26T20:41:58.159 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-26T20:41:58.159 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-26T20:41:58.159 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-26T20:41:58.159 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-26T20:41:58.159 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-26T20:41:58.159 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-26T20:41:58.159 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-26T20:41:58.159 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-26T20:41:58.159 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-26T20:41:58.159 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-26T20:41:58.160 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-26T20:41:58.160 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 95625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-26T20:41:58.160 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 144209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-26T20:41:58.160 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 167137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-26T20:41:58.160 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 119513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-26T20:41:58.160 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-26T20:41:58.160 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-26T20:41:58.160 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-26T20:41:58.160 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-26T20:41:58.160 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-26T20:41:58.160 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-26T20:41:58.160 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-26T20:41:58.160 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-26T20:41:58.160 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-26T20:41:58.160 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-26T20:41:58.161 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-26T20:41:58.161 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-26T20:41:58.161 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-26T20:41:58.161 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-26T20:41:58.161 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-26T20:41:58.161 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-26T20:41:58.161 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-26T20:41:58.161 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ 2024-04-26T20:41:58.161 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ 2024-04-26T20:41:58.161 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 302073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-26T20:41:58.161 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ 2024-04-26T20:41:58.161 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 548169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-26T20:41:58.161 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ 2024-04-26T20:41:58.161 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-26T20:41:58.161 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 3245617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-26T20:41:58.162 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-26T20:41:58.162 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 39313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-26T20:41:58.162 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 43073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-26T20:41:58.162 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/ 2024-04-26T20:41:58.162 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 67489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/omfs.ko 2024-04-26T20:41:58.162 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/ 2024-04-26T20:41:58.162 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 462873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-26T20:41:58.162 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ 2024-04-26T20:41:58.162 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 67977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-26T20:41:58.162 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/ 2024-04-26T20:41:58.162 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/qnx4.ko 2024-04-26T20:41:58.162 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/ 2024-04-26T20:41:58.162 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 56097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/qnx6.ko 2024-04-26T20:41:58.162 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/ 2024-04-26T20:41:58.163 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 40313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_tree.ko 2024-04-26T20:41:58.163 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v1.ko 2024-04-26T20:41:58.163 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v2.ko 2024-04-26T20:41:58.163 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/ 2024-04-26T20:41:58.163 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 684841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-26T20:41:58.163 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/ 2024-04-26T20:41:58.163 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-26T20:41:58.163 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/ 2024-04-26T20:41:58.163 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/ 2024-04-26T20:41:58.163 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 3319041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-26T20:41:58.163 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/ 2024-04-26T20:41:58.163 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-26T20:41:58.163 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-26T20:41:58.163 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/ 2024-04-26T20:41:58.163 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 164185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-26T20:41:58.164 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/ 2024-04-26T20:41:58.164 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 115977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-26T20:41:58.164 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/ 2024-04-26T20:41:58.164 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 310017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-26T20:41:58.164 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ 2024-04-26T20:41:58.164 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 198233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-26T20:41:58.164 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/ 2024-04-26T20:41:58.164 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 5192705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-26T20:41:58.164 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/ 2024-04-26T20:41:58.164 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/ 2024-04-26T20:41:58.164 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 97625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/locktorture.ko 2024-04-26T20:41:58.164 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/ 2024-04-26T20:41:58.164 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/test_udelay.ko 2024-04-26T20:41:58.164 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 72665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-26T20:41:58.165 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ 2024-04-26T20:41:58.165 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-26T20:41:58.165 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc7.ko 2024-04-26T20:41:58.165 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-26T20:41:58.165 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/ 2024-04-26T20:41:58.165 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-26T20:41:58.165 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 38985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-26T20:41:58.165 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/interval_tree_test.ko 2024-04-26T20:41:58.165 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-26T20:41:58.165 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-26T20:41:58.165 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/ 2024-04-26T20:41:58.165 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-26T20:41:58.165 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-26T20:41:58.165 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/ 2024-04-26T20:41:58.165 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-26T20:41:58.166 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/memory-notifier-error-inject.ko 2024-04-26T20:41:58.166 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/notifier-error-inject.ko 2024-04-26T20:41:58.166 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/percpu_test.ko 2024-04-26T20:41:58.166 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/pm-notifier-error-inject.ko 2024-04-26T20:41:58.166 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/ 2024-04-26T20:41:58.166 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 152025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-26T20:41:58.166 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/rbtree_test.ko 2024-04-26T20:41:58.166 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/ 2024-04-26T20:41:58.166 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-26T20:41:58.166 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 40969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test-kstrtox.ko 2024-04-26T20:41:58.166 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 4912441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_bpf.ko 2024-04-26T20:41:58.166 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 61169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_firmware.ko 2024-04-26T20:41:58.166 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_module.ko 2024-04-26T20:41:58.166 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_user_copy.ko 2024-04-26T20:41:58.166 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-26T20:41:58.167 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-26T20:41:58.167 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-26T20:41:58.167 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/ 2024-04-26T20:41:58.167 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/xz_dec_test.ko 2024-04-26T20:41:58.167 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/ 2024-04-26T20:41:58.167 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-26T20:41:58.167 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ 2024-04-26T20:41:58.167 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/ 2024-04-26T20:41:58.167 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 66969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-26T20:41:58.167 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-26T20:41:58.167 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-26T20:41:58.167 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-26T20:41:58.167 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-26T20:41:58.167 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-26T20:41:58.167 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-26T20:41:58.167 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-26T20:41:58.168 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/ 2024-04-26T20:41:58.168 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-26T20:41:58.168 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-26T20:41:58.168 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-26T20:41:58.168 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-26T20:41:58.168 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-26T20:41:58.168 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/ 2024-04-26T20:41:58.168 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 106793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-26T20:41:58.168 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/ 2024-04-26T20:41:58.168 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 236793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-26T20:41:58.168 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 44449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-26T20:41:58.168 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 32209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-26T20:41:58.168 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 39513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-26T20:41:58.168 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/ 2024-04-26T20:41:58.168 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 879697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-26T20:41:58.169 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/ 2024-04-26T20:41:58.169 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 84761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-26T20:41:58.169 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 1030873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-26T20:41:58.200 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ 2024-04-26T20:41:58.200 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-26T20:41:58.200 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-26T20:41:58.200 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-26T20:41:58.200 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-26T20:41:58.200 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-26T20:41:58.201 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-26T20:41:58.201 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-26T20:41:58.201 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-26T20:41:58.201 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-26T20:41:58.201 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-26T20:41:58.201 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-26T20:41:58.201 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-26T20:41:58.201 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-26T20:41:58.201 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-26T20:41:58.201 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-26T20:41:58.201 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-26T20:41:58.201 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-26T20:41:58.201 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-26T20:41:58.201 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-26T20:41:58.201 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-26T20:41:58.202 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 70529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-26T20:41:58.202 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-26T20:41:58.202 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-26T20:41:58.202 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/ 2024-04-26T20:41:58.202 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 1243505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-26T20:41:58.202 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/ 2024-04-26T20:41:58.202 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 153801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-26T20:41:58.202 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/ 2024-04-26T20:41:58.202 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 244889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-26T20:41:58.202 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-26T20:41:58.202 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 71033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-26T20:41:58.202 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 74993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-26T20:41:58.202 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/ 2024-04-26T20:41:58.202 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 507705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-26T20:41:58.202 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-26T20:41:58.203 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-26T20:41:58.203 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-26T20:41:58.203 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-26T20:41:58.203 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/ 2024-04-26T20:41:58.203 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 128873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/hsr.ko 2024-04-26T20:41:58.203 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ 2024-04-26T20:41:58.203 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ 2024-04-26T20:41:58.203 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-26T20:41:58.203 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 357425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-26T20:41:58.203 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 59393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-26T20:41:58.203 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ 2024-04-26T20:41:58.203 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-26T20:41:58.203 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 46417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-26T20:41:58.203 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 60233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-26T20:41:58.203 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-26T20:41:58.203 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 65665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-26T20:41:58.204 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 75489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-26T20:41:58.204 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 77721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-26T20:41:58.204 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 43705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-26T20:41:58.204 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-26T20:41:58.204 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-26T20:41:58.204 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ 2024-04-26T20:41:58.204 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 45521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-26T20:41:58.204 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-26T20:41:58.204 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-26T20:41:58.204 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 50169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ip_tables.ko 2024-04-26T20:41:58.204 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-26T20:41:58.204 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-04-26T20:41:58.204 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-26T20:41:58.204 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-26T20:41:58.204 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-26T20:41:58.204 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-04-26T20:41:58.205 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-26T20:41:58.205 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-26T20:41:58.205 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-26T20:41:58.205 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-26T20:41:58.205 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-26T20:41:58.205 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-26T20:41:58.205 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 32473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-26T20:41:58.205 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-26T20:41:58.205 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-26T20:41:58.205 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-04-26T20:41:58.205 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-26T20:41:58.205 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-26T20:41:58.205 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-26T20:41:58.205 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-26T20:41:58.205 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-26T20:41:58.205 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-26T20:41:58.206 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-26T20:41:58.206 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-26T20:41:58.206 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-26T20:41:58.206 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-26T20:41:58.206 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-26T20:41:58.206 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-26T20:41:58.206 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-26T20:41:58.206 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-26T20:41:58.206 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-26T20:41:58.206 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-26T20:41:58.206 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-26T20:41:58.206 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-26T20:41:58.206 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-26T20:41:58.206 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-26T20:41:58.206 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 54441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-26T20:41:58.207 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-26T20:41:58.207 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ 2024-04-26T20:41:58.207 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-26T20:41:58.207 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 47433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-26T20:41:58.207 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-26T20:41:58.207 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 103177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_gre.ko 2024-04-26T20:41:58.207 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 118881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-26T20:41:58.207 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-26T20:41:58.207 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 71089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-26T20:41:58.207 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-26T20:41:58.207 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/mip6.ko 2024-04-26T20:41:58.207 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ 2024-04-26T20:41:58.207 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 50673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-26T20:41:58.207 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-04-26T20:41:58.207 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-26T20:41:58.207 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-26T20:41:58.208 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-26T20:41:58.208 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-26T20:41:58.208 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-26T20:41:58.208 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-26T20:41:58.208 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-26T20:41:58.208 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-26T20:41:58.208 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-26T20:41:58.208 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-26T20:41:58.208 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-26T20:41:58.208 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-26T20:41:58.208 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-26T20:41:58.208 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-26T20:41:58.208 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-26T20:41:58.208 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 46313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-26T20:41:58.208 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-26T20:41:58.208 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-26T20:41:58.209 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-26T20:41:58.209 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-26T20:41:58.209 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-26T20:41:58.209 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-26T20:41:58.209 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-26T20:41:58.209 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 94089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-26T20:41:58.209 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-26T20:41:58.209 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-26T20:41:58.209 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/ 2024-04-26T20:41:58.209 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 106369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-26T20:41:58.209 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/ 2024-04-26T20:41:58.209 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 153217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-26T20:41:58.209 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-26T20:41:58.209 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-26T20:41:58.209 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 43641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-26T20:41:58.210 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 44993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-26T20:41:58.210 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 42049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-26T20:41:58.210 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 66241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-26T20:41:58.210 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/ 2024-04-26T20:41:58.210 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 63345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/lapb.ko 2024-04-26T20:41:58.210 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/ 2024-04-26T20:41:58.210 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-26T20:41:58.210 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 332889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc2.ko 2024-04-26T20:41:58.210 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/ 2024-04-26T20:41:58.210 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 388873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-26T20:41:58.210 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/ 2024-04-26T20:41:58.210 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-26T20:41:58.210 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ 2024-04-26T20:41:58.210 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ 2024-04-26T20:41:58.210 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 147745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-26T20:41:58.211 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-26T20:41:58.211 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-26T20:41:58.211 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-26T20:41:58.211 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 124041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-26T20:41:58.211 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 124345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-26T20:41:58.211 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 126681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-26T20:41:58.211 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 126473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-26T20:41:58.211 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 137833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-26T20:41:58.211 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 72353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-26T20:41:58.211 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 133681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-26T20:41:58.211 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 139073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-26T20:41:58.211 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 138265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-26T20:41:58.211 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 136177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-26T20:41:58.211 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 139897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-26T20:41:58.212 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 37129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-26T20:41:58.212 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ 2024-04-26T20:41:58.212 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 534113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-26T20:41:58.212 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-26T20:41:58.212 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-26T20:41:58.212 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-26T20:41:58.212 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-26T20:41:58.212 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-26T20:41:58.212 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-26T20:41:58.212 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-26T20:41:58.212 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-26T20:41:58.212 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-26T20:41:58.212 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-26T20:41:58.212 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-26T20:41:58.212 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-26T20:41:58.213 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-26T20:41:58.213 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 55217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-26T20:41:58.213 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 496817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-26T20:41:58.213 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-26T20:41:58.213 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-26T20:41:58.213 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 37865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-26T20:41:58.213 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 134377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-26T20:41:58.213 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-26T20:41:58.213 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-26T20:41:58.213 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 140801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-26T20:41:58.213 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 38305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-26T20:41:58.213 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-26T20:41:58.213 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 79873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-26T20:41:58.213 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-26T20:41:58.214 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-26T20:41:58.214 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-26T20:41:58.214 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 117201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-26T20:41:58.214 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-26T20:41:58.214 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 46105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-26T20:41:58.214 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 118369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-26T20:41:58.214 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-26T20:41:58.214 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-26T20:41:58.214 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-26T20:41:58.214 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-26T20:41:58.214 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-26T20:41:58.214 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 53393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-26T20:41:58.214 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 807985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-26T20:41:58.214 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 53049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-26T20:41:58.214 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-26T20:41:58.215 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 37209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-04-26T20:41:58.215 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 49297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-26T20:41:58.215 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-26T20:41:58.215 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 65145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-26T20:41:58.215 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-26T20:41:58.215 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 41769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-26T20:41:58.215 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 50657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-26T20:41:58.215 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-26T20:41:58.215 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-26T20:41:58.215 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-26T20:41:58.215 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-26T20:41:58.215 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-26T20:41:58.215 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-26T20:41:58.215 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-26T20:41:58.215 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-26T20:41:58.216 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-26T20:41:58.216 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_osf.ko 2024-04-26T20:41:58.216 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-26T20:41:58.216 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-26T20:41:58.216 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-26T20:41:58.216 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-26T20:41:58.216 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-26T20:41:58.216 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_synproxy.ko 2024-04-26T20:41:58.216 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tproxy.ko 2024-04-26T20:41:58.216 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 108393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/x_tables.ko 2024-04-26T20:41:58.216 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-26T20:41:58.216 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-26T20:41:58.216 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-26T20:41:58.216 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-26T20:41:58.216 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-26T20:41:58.216 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-26T20:41:58.217 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-26T20:41:58.217 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-26T20:41:58.217 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 45217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-26T20:41:58.217 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-26T20:41:58.217 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-26T20:41:58.217 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-26T20:41:58.217 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-26T20:41:58.217 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-26T20:41:58.217 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-26T20:41:58.217 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-26T20:41:58.217 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-26T20:41:58.217 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-26T20:41:58.217 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-26T20:41:58.217 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-26T20:41:58.217 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-26T20:41:58.218 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-26T20:41:58.218 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-26T20:41:58.218 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-26T20:41:58.218 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-26T20:41:58.218 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-26T20:41:58.218 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-26T20:41:58.218 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-26T20:41:58.218 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-26T20:41:58.218 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-26T20:41:58.218 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-26T20:41:58.218 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-26T20:41:58.218 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-26T20:41:58.218 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-26T20:41:58.218 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-26T20:41:58.219 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-26T20:41:58.219 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-26T20:41:58.219 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-26T20:41:58.219 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-26T20:41:58.219 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 52817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-26T20:41:58.219 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-26T20:41:58.219 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-26T20:41:58.219 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-26T20:41:58.219 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-26T20:41:58.219 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-26T20:41:58.219 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-26T20:41:58.219 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-26T20:41:58.219 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-26T20:41:58.219 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-26T20:41:58.219 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-26T20:41:58.219 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-26T20:41:58.219 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-26T20:41:58.220 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-26T20:41:58.220 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-26T20:41:58.220 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-26T20:41:58.220 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-26T20:41:58.220 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-26T20:41:58.220 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-26T20:41:58.220 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-26T20:41:58.220 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-26T20:41:58.220 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-26T20:41:58.220 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 43465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-26T20:41:58.220 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-26T20:41:58.220 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-26T20:41:58.220 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-26T20:41:58.220 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-26T20:41:58.220 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-26T20:41:58.221 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-26T20:41:58.221 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-26T20:41:58.221 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpudp.ko 2024-04-26T20:41:58.221 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-26T20:41:58.221 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-26T20:41:58.221 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/ 2024-04-26T20:41:58.221 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-26T20:41:58.221 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/ 2024-04-26T20:41:58.221 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-26T20:41:58.221 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/ 2024-04-26T20:41:58.221 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 488825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-26T20:41:58.221 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-26T20:41:58.221 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-26T20:41:58.221 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-26T20:41:58.221 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/ 2024-04-26T20:41:58.221 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-26T20:41:58.222 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/ 2024-04-26T20:41:58.222 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 142025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/phonet.ko 2024-04-26T20:41:58.222 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 68817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/pn_pep.ko 2024-04-26T20:41:58.222 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/ 2024-04-26T20:41:58.222 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 318617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-26T20:41:58.222 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 202305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-26T20:41:58.222 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 85105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-26T20:41:58.222 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/ 2024-04-26T20:41:58.222 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 1027897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/rxrpc.ko 2024-04-26T20:41:58.222 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/ 2024-04-26T20:41:58.222 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 39001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-26T20:41:58.222 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-26T20:41:58.222 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 45409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-26T20:41:58.222 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-26T20:41:58.223 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 53465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-26T20:41:58.223 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 38705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-26T20:41:58.223 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-26T20:41:58.223 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 43417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-26T20:41:58.223 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 45673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-26T20:41:58.223 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 32129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-26T20:41:58.223 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 41457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-26T20:41:58.223 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_cgroup.ko 2024-04-26T20:41:58.223 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 37305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-26T20:41:58.223 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 39601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-26T20:41:58.223 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 49321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-26T20:41:58.223 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 79145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-26T20:41:58.223 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-26T20:41:58.223 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-26T20:41:58.223 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 48785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-26T20:41:58.223 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-26T20:41:58.224 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-26T20:41:58.224 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-26T20:41:58.224 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-26T20:41:58.224 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-26T20:41:58.224 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 43481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-26T20:41:58.224 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 43153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-26T20:41:58.224 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 39177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq_codel.ko 2024-04-26T20:41:58.224 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-26T20:41:58.224 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 62817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-26T20:41:58.224 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-26T20:41:58.224 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 81833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-26T20:41:58.224 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-26T20:41:58.224 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-26T20:41:58.224 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-26T20:41:58.224 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-26T20:41:58.224 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 44793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-26T20:41:58.224 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 32833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-26T20:41:58.225 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-26T20:41:58.225 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-26T20:41:58.225 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 60249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-26T20:41:58.225 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-26T20:41:58.225 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-26T20:41:58.225 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-26T20:41:58.225 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-26T20:41:58.225 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-26T20:41:58.225 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/ 2024-04-26T20:41:58.225 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 1187313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-26T20:41:58.225 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-26T20:41:58.225 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/ 2024-04-26T20:41:58.225 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/ 2024-04-26T20:41:58.225 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 432409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-26T20:41:58.225 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 70113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-26T20:41:58.225 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 1940889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-26T20:41:58.226 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/ 2024-04-26T20:41:58.226 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 890729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-26T20:41:58.226 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/ 2024-04-26T20:41:58.226 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 1122337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-26T20:41:58.226 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-26T20:41:58.226 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/ 2024-04-26T20:41:58.226 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-26T20:41:58.226 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/ 2024-04-26T20:41:58.226 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 105609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-26T20:41:58.226 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 90265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-26T20:41:58.226 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 123769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-26T20:41:58.226 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-26T20:41:58.226 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-26T20:41:58.226 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/ 2024-04-26T20:41:58.226 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 165841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/x25.ko 2024-04-26T20:41:58.226 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/ 2024-04-26T20:41:58.226 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_algo.ko 2024-04-26T20:41:58.227 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-26T20:41:58.227 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 131865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_user.ko 2024-04-26T20:41:58.227 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 644769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-26T20:41:58.227 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 628542 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-26T20:41:58.227 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7706 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-26T20:41:58.227 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-26T20:41:58.227 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9941 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-26T20:41:58.227 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 70990 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-26T20:41:58.227 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 146959 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-26T20:41:58.227 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 232835 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-26T20:41:58.227 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 210 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-26T20:41:58.227 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 72602 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-26T20:41:58.227 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 879 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-26T20:41:58.227 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 258450 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-26T20:41:58.227 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 313019 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-26T20:41:58.228 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/ 2024-04-26T20:41:58.228 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/ 2024-04-26T20:41:58.229 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/ 2024-04-26T20:41:58.229 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/ 2024-04-26T20:41:58.229 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 172 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/changelog.Debian.gz 2024-04-26T20:41:58.229 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 691 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/copyright 2024-04-26T20:41:58.233 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-26T20:41:58.233 INFO:teuthology.task.kernel:searching for kernel 6.9.0-rc3-g806ec36b2112 2024-04-26T20:41:58.234 DEBUG:teuthology.orchestra.run.smithi138:> egrep '(submenu|menuentry.*6.9.0-rc3-g806ec36b2112).*{' /boot/grub/grub.cfg 2024-04-26T20:41:58.275 INFO:teuthology.orchestra.run.smithi138.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-26T20:41:58.275 INFO:teuthology.orchestra.run.smithi138.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-26T20:41:58.275 INFO:teuthology.orchestra.run.smithi138.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-26T20:41:58.276 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-04-26T20:41:58.276 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 2024-04-26T20:41:58.276 DEBUG:teuthology.orchestra.run.smithi138:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-04-26T20:41:58.319 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi138.front.sepia.ceph.com to complete... 2024-04-26T20:41:58.668 INFO:teuthology.orchestra.run.smithi138.stderr:Sourcing file `/etc/default/grub' 2024-04-26T20:41:58.669 INFO:teuthology.orchestra.run.smithi138.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T20:41:58.698 INFO:teuthology.orchestra.run.smithi138.stderr:Generating grub configuration file ... 2024-04-26T20:41:58.879 INFO:teuthology.orchestra.run.smithi138.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-26T20:41:58.884 INFO:teuthology.orchestra.run.smithi138.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-26T20:41:59.121 INFO:teuthology.orchestra.run.smithi138.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T20:41:59.127 INFO:teuthology.orchestra.run.smithi138.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T20:41:59.170 INFO:teuthology.orchestra.run.smithi138.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T20:41:59.176 INFO:teuthology.orchestra.run.smithi138.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T20:41:59.301 INFO:teuthology.orchestra.run.smithi138.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T20:41:59.301 INFO:teuthology.orchestra.run.smithi138.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T20:41:59.301 INFO:teuthology.orchestra.run.smithi138.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T20:41:59.315 INFO:teuthology.orchestra.run.smithi138.stderr:done 2024-04-26T20:42:00.437 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2024-04-26T20:42:24.894 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-04-26T20:42:24.894 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-04-26T20:42:24.895 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T20:42:30.442 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-04-26T20:42:30.442 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-04-26T20:42:30.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T20:42:43.359 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.143 2024-04-26T20:42:48.990 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-04-26T20:42:52.362 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-04-26T20:42:52.363 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T20:42:55.426 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.143 2024-04-26T20:42:57.994 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-04-26T20:42:57.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T20:43:01.054 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-04-26T20:43:07.430 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-04-26T20:43:07.431 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T20:43:13.056 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-04-26T20:43:13.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T20:43:25.854 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.143 2024-04-26T20:43:31.490 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-04-26T20:43:40.861 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-04-26T20:43:40.862 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T20:43:41.433 DEBUG:teuthology.orchestra.run.smithi143:> true 2024-04-26T20:43:42.477 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-04-26T20:43:42.477 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.9.0-rc3-g806ec36b2112"... 2024-04-26T20:43:42.477 DEBUG:teuthology.orchestra.run.smithi143:> uname -r 2024-04-26T20:43:42.528 INFO:teuthology.orchestra.run.smithi143.stdout:6.9.0-rc3-g806ec36b2112 2024-04-26T20:43:42.528 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-26T20:43:42.528 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T20:43:42.529 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-26T20:43:43.529 DEBUG:teuthology.parallel:result is None 2024-04-26T20:43:46.491 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-04-26T20:43:46.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T20:43:47.435 DEBUG:teuthology.orchestra.run.smithi138:> true 2024-04-26T20:43:48.376 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-04-26T20:43:48.376 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-rc3-g806ec36b2112"... 2024-04-26T20:43:48.376 DEBUG:teuthology.orchestra.run.smithi138:> uname -r 2024-04-26T20:43:48.429 INFO:teuthology.orchestra.run.smithi138.stdout:6.9.0-rc3-g806ec36b2112 2024-04-26T20:43:48.430 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-26T20:43:48.430 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T20:43:48.430 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-26T20:43:49.431 DEBUG:teuthology.parallel:result is None 2024-04-26T20:43:49.431 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-26T20:43:49.442 INFO:teuthology.task.internal:Creating test directory... 2024-04-26T20:43:49.443 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T20:43:49.446 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T20:43:49.456 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-26T20:43:49.462 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-26T20:43:49.514 INFO:teuthology.task.internal:Creating archive directory... 2024-04-26T20:43:49.515 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T20:43:49.518 DEBUG:teuthology.orchestra.run.smithi143:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T20:43:49.614 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-26T20:43:49.620 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-26T20:43:49.620 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T20:43:49.623 DEBUG:teuthology.orchestra.run.smithi143:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T20:43:49.691 INFO:teuthology.orchestra.run.smithi143.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T20:43:49.709 INFO:teuthology.orchestra.run.smithi143.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T20:43:49.721 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T20:43:49.738 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T20:43:49.741 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-26T20:43:49.748 INFO:teuthology.task.internal:Configuring sudo... 2024-04-26T20:43:49.748 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T20:43:49.752 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T20:43:49.773 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-26T20:43:49.782 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-26T20:43:49.782 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T20:43:49.819 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T20:43:49.828 DEBUG:teuthology.orchestra.run.smithi138:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T20:43:49.873 DEBUG:teuthology.orchestra.run.smithi138:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T20:43:49.929 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-26T20:43:49.929 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T20:43:49.992 DEBUG:teuthology.orchestra.run.smithi143:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T20:43:50.005 DEBUG:teuthology.orchestra.run.smithi143:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T20:43:50.062 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T20:43:50.062 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T20:43:50.137 DEBUG:teuthology.orchestra.run.smithi138:> sudo service rsyslog restart 2024-04-26T20:43:50.152 DEBUG:teuthology.orchestra.run.smithi143:> sudo service rsyslog restart 2024-04-26T20:43:50.267 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-26T20:43:50.300 INFO:teuthology.task.internal:Starting timer... 2024-04-26T20:43:50.301 INFO:teuthology.run_tasks:Running task pcp... 2024-04-26T20:43:50.353 INFO:teuthology.run_tasks:Running task selinux... 2024-04-26T20:43:50.419 DEBUG:teuthology.task.selinux:Excluding smithi138: OS 'ubuntu' does not support SELinux 2024-04-26T20:43:50.419 DEBUG:teuthology.task.selinux:Excluding smithi143: OS 'ubuntu' does not support SELinux 2024-04-26T20:43:50.420 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-26T20:43:50.420 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-26T20:43:50.420 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-26T20:43:50.420 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-26T20:43:50.441 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-26T20:43:50.457 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-26T20:43:50.458 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi138.front.sepia.ceph.com,smithi143.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-26T20:51:40.251 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi138.front.sepia.ceph.com'), Remote(name='ubuntu@smithi143.front.sepia.ceph.com')] 2024-04-26T20:51:40.253 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-04-26T20:51:40.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T20:51:40.339 DEBUG:teuthology.orchestra.run.smithi138:> true 2024-04-26T20:51:40.449 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-04-26T20:51:40.449 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-04-26T20:51:40.450 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T20:51:40.535 DEBUG:teuthology.orchestra.run.smithi143:> true 2024-04-26T20:51:40.677 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-04-26T20:51:40.677 INFO:teuthology.run_tasks:Running task clock... 2024-04-26T20:51:40.689 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-26T20:51:40.689 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T20:51:40.689 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T20:51:40.692 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T20:51:40.692 DEBUG:teuthology.orchestra.run.smithi143:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T20:51:40.727 INFO:teuthology.orchestra.run.smithi138.stdout:26 Apr 20:51:40 ntpd[17199]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-26T20:51:40.728 INFO:teuthology.orchestra.run.smithi138.stdout:26 Apr 20:51:40 ntpd[17199]: Command line: ntpd -gq 2024-04-26T20:51:40.728 INFO:teuthology.orchestra.run.smithi138.stdout:26 Apr 20:51:40 ntpd[17199]: ---------------------------------------------------- 2024-04-26T20:51:40.728 INFO:teuthology.orchestra.run.smithi138.stdout:26 Apr 20:51:40 ntpd[17199]: ntp-4 is maintained by Network Time Foundation, 2024-04-26T20:51:40.728 INFO:teuthology.orchestra.run.smithi138.stdout:26 Apr 20:51:40 ntpd[17199]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-26T20:51:40.728 INFO:teuthology.orchestra.run.smithi138.stdout:26 Apr 20:51:40 ntpd[17199]: corporation. Support and training for ntp-4 are 2024-04-26T20:51:40.728 INFO:teuthology.orchestra.run.smithi138.stdout:26 Apr 20:51:40 ntpd[17199]: available at https://www.nwtime.org/support 2024-04-26T20:51:40.728 INFO:teuthology.orchestra.run.smithi138.stdout:26 Apr 20:51:40 ntpd[17199]: ---------------------------------------------------- 2024-04-26T20:51:40.729 INFO:teuthology.orchestra.run.smithi138.stdout:26 Apr 20:51:40 ntpd[17199]: proto: precision = 0.040 usec (-24) 2024-04-26T20:51:40.730 INFO:teuthology.orchestra.run.smithi138.stdout:26 Apr 20:51:40 ntpd[17199]: basedate set to 2022-02-04 2024-04-26T20:51:40.730 INFO:teuthology.orchestra.run.smithi138.stdout:26 Apr 20:51:40 ntpd[17199]: gps base set to 2022-02-06 (week 2196) 2024-04-26T20:51:40.730 INFO:teuthology.orchestra.run.smithi138.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T20:51:40.731 INFO:teuthology.orchestra.run.smithi138.stdout:26 Apr 20:51:40 ntpd[17199]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T20:51:40.731 INFO:teuthology.orchestra.run.smithi138.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-26T20:51:40.733 INFO:teuthology.orchestra.run.smithi138.stdout:26 Apr 20:51:40 ntpd[17199]: restrict ::: KOD does nothing without LIMITED. 2024-04-26T20:51:40.733 INFO:teuthology.orchestra.run.smithi138.stdout:26 Apr 20:51:40 ntpd[17199]: Listen and drop on 0 v6wildcard [::]:123 2024-04-26T20:51:40.733 INFO:teuthology.orchestra.run.smithi138.stdout:26 Apr 20:51:40 ntpd[17199]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-26T20:51:40.733 INFO:teuthology.orchestra.run.smithi138.stdout:26 Apr 20:51:40 ntpd[17199]: Listen normally on 2 lo 127.0.0.1:123 2024-04-26T20:51:40.734 INFO:teuthology.orchestra.run.smithi138.stdout:26 Apr 20:51:40 ntpd[17199]: Listen normally on 3 enp3s0f1 172.21.15.138:123 2024-04-26T20:51:40.735 INFO:teuthology.orchestra.run.smithi138.stdout:26 Apr 20:51:40 ntpd[17199]: Listen normally on 4 lo [::1]:123 2024-04-26T20:51:40.735 INFO:teuthology.orchestra.run.smithi138.stdout:26 Apr 20:51:40 ntpd[17199]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6f71%5]:123 2024-04-26T20:51:40.735 INFO:teuthology.orchestra.run.smithi138.stdout:26 Apr 20:51:40 ntpd[17199]: Listening on routing socket on fd #22 for interface updates 2024-04-26T20:51:40.759 INFO:teuthology.orchestra.run.smithi143.stdout:26 Apr 20:51:40 ntpd[17203]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-26T20:51:40.760 INFO:teuthology.orchestra.run.smithi143.stdout:26 Apr 20:51:40 ntpd[17203]: Command line: ntpd -gq 2024-04-26T20:51:40.760 INFO:teuthology.orchestra.run.smithi143.stdout:26 Apr 20:51:40 ntpd[17203]: ---------------------------------------------------- 2024-04-26T20:51:40.760 INFO:teuthology.orchestra.run.smithi143.stdout:26 Apr 20:51:40 ntpd[17203]: ntp-4 is maintained by Network Time Foundation, 2024-04-26T20:51:40.760 INFO:teuthology.orchestra.run.smithi143.stdout:26 Apr 20:51:40 ntpd[17203]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-26T20:51:40.760 INFO:teuthology.orchestra.run.smithi143.stdout:26 Apr 20:51:40 ntpd[17203]: corporation. Support and training for ntp-4 are 2024-04-26T20:51:40.760 INFO:teuthology.orchestra.run.smithi143.stdout:26 Apr 20:51:40 ntpd[17203]: available at https://www.nwtime.org/support 2024-04-26T20:51:40.760 INFO:teuthology.orchestra.run.smithi143.stdout:26 Apr 20:51:40 ntpd[17203]: ---------------------------------------------------- 2024-04-26T20:51:40.761 INFO:teuthology.orchestra.run.smithi143.stdout:26 Apr 20:51:40 ntpd[17203]: proto: precision = 0.043 usec (-24) 2024-04-26T20:51:40.761 INFO:teuthology.orchestra.run.smithi143.stdout:26 Apr 20:51:40 ntpd[17203]: basedate set to 2022-02-04 2024-04-26T20:51:40.761 INFO:teuthology.orchestra.run.smithi143.stdout:26 Apr 20:51:40 ntpd[17203]: gps base set to 2022-02-06 (week 2196) 2024-04-26T20:51:40.761 INFO:teuthology.orchestra.run.smithi143.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T20:51:40.761 INFO:teuthology.orchestra.run.smithi143.stdout:26 Apr 20:51:40 ntpd[17203]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T20:51:40.762 INFO:teuthology.orchestra.run.smithi143.stdout:26 Apr 20:51:40 ntpd[17203]: restrict ::: KOD does nothing without LIMITED. 2024-04-26T20:51:40.762 INFO:teuthology.orchestra.run.smithi143.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-26T20:51:40.763 INFO:teuthology.orchestra.run.smithi143.stdout:26 Apr 20:51:40 ntpd[17203]: Listen and drop on 0 v6wildcard [::]:123 2024-04-26T20:51:40.763 INFO:teuthology.orchestra.run.smithi143.stdout:26 Apr 20:51:40 ntpd[17203]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-26T20:51:40.763 INFO:teuthology.orchestra.run.smithi143.stdout:26 Apr 20:51:40 ntpd[17203]: Listen normally on 2 lo 127.0.0.1:123 2024-04-26T20:51:40.763 INFO:teuthology.orchestra.run.smithi143.stdout:26 Apr 20:51:40 ntpd[17203]: Listen normally on 3 enp3s0f1 172.21.15.143:123 2024-04-26T20:51:40.763 INFO:teuthology.orchestra.run.smithi143.stdout:26 Apr 20:51:40 ntpd[17203]: Listen normally on 4 lo [::1]:123 2024-04-26T20:51:40.763 INFO:teuthology.orchestra.run.smithi143.stdout:26 Apr 20:51:40 ntpd[17203]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7783%5]:123 2024-04-26T20:51:40.763 INFO:teuthology.orchestra.run.smithi143.stdout:26 Apr 20:51:40 ntpd[17203]: Listening on routing socket on fd #22 for interface updates 2024-04-26T20:51:41.728 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:41 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:51:41.728 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:41 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:51:41.729 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:41 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:51:41.729 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:41 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:51:41.729 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:41 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T20:51:41.729 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:41 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T20:51:41.760 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:41 ntpd[17203]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:51:41.760 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:41 ntpd[17203]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:51:42.728 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:42 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:51:42.728 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:42 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:51:42.728 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:42 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:51:42.729 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:42 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:51:42.729 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:42 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T20:51:42.729 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:42 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T20:51:42.760 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:42 ntpd[17203]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:51:42.760 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:42 ntpd[17203]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:51:42.760 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:42 ntpd[17203]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:51:42.761 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:42 ntpd[17203]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:51:42.761 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:42 ntpd[17203]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T20:51:42.761 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:42 ntpd[17203]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T20:51:43.728 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:43 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:51:43.728 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:43 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:51:43.728 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:43 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:51:43.729 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:43 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:51:43.729 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:43 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T20:51:43.729 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:43 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T20:51:44.729 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:44 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:51:44.729 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:44 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:51:44.730 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:44 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:51:44.730 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:44 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:51:44.730 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:44 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:51:44.730 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:44 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:51:44.730 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:44 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:51:44.730 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:44 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:51:44.730 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:44 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T20:51:44.730 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:44 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T20:51:44.730 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:44 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:51:44.730 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:44 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:51:44.730 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:44 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T20:51:44.730 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:44 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T20:51:44.761 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:44 ntpd[17203]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:51:44.761 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:44 ntpd[17203]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:51:44.761 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:44 ntpd[17203]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:51:44.761 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:44 ntpd[17203]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:51:44.761 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:44 ntpd[17203]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:51:44.761 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:44 ntpd[17203]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:51:44.761 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:44 ntpd[17203]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T20:51:44.761 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:44 ntpd[17203]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T20:51:44.761 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:44 ntpd[17203]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:51:44.761 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:44 ntpd[17203]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:51:44.761 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:44 ntpd[17203]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T20:51:44.761 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:44 ntpd[17203]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T20:51:45.728 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:45 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:51:45.729 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:45 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:51:45.729 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:45 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:51:45.729 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:45 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:51:45.729 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:45 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T20:51:45.729 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:45 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T20:51:45.760 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:45 ntpd[17203]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:51:45.760 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:45 ntpd[17203]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:51:45.760 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:45 ntpd[17203]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:51:45.760 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:45 ntpd[17203]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:51:45.760 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:45 ntpd[17203]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T20:51:45.760 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:45 ntpd[17203]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T20:51:46.729 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:46 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:51:46.729 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:46 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:51:46.729 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:46 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:51:46.729 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:46 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:51:46.729 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:46 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:51:46.729 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:46 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:51:46.729 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:46 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T20:51:46.729 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:46 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T20:51:46.730 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:46 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:51:46.730 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:46 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:51:46.730 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:46 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T20:51:46.730 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:46 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T20:51:46.761 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:46 ntpd[17203]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:51:46.761 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:46 ntpd[17203]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:51:46.761 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:46 ntpd[17203]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:51:46.761 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:46 ntpd[17203]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:51:46.761 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:46 ntpd[17203]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:51:46.761 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:46 ntpd[17203]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:51:46.761 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:46 ntpd[17203]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T20:51:46.761 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:46 ntpd[17203]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T20:51:46.761 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:46 ntpd[17203]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:51:46.761 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:46 ntpd[17203]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:51:46.761 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:46 ntpd[17203]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T20:51:46.762 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:46 ntpd[17203]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T20:51:47.728 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:47 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:51:47.729 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:47 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:51:47.729 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:47 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:51:47.729 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:47 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:51:47.729 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:47 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T20:51:47.729 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:47 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T20:51:47.729 INFO:teuthology.orchestra.run.smithi138.stdout:26 Apr 20:51:47 ntpd[17199]: ntpd: time slew +0.001056 s 2024-04-26T20:51:47.729 INFO:teuthology.orchestra.run.smithi138.stdout:ntpd: time slew +0.001056s 2024-04-26T20:51:47.730 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:47 ntpd[17199]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-26T20:51:47.730 INFO:teuthology.orchestra.run.smithi138.stderr:26 Apr 20:51:47 ntpd[17199]: can't open /var/log/ntpstats/loopstats.20240426: Permission denied 2024-04-26T20:51:47.760 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:47 ntpd[17203]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:51:47.760 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:47 ntpd[17203]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:51:47.760 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:47 ntpd[17203]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:51:47.760 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:47 ntpd[17203]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:51:47.760 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:47 ntpd[17203]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T20:51:47.760 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:47 ntpd[17203]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T20:51:47.816 INFO:teuthology.orchestra.run.smithi138.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T20:51:47.816 INFO:teuthology.orchestra.run.smithi138.stdout:============================================================================== 2024-04-26T20:51:47.816 INFO:teuthology.orchestra.run.smithi138.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T20:51:47.816 INFO:teuthology.orchestra.run.smithi138.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T20:51:47.816 INFO:teuthology.orchestra.run.smithi138.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T20:51:47.816 INFO:teuthology.orchestra.run.smithi138.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T20:51:48.761 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:48 ntpd[17203]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:51:48.761 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:48 ntpd[17203]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:51:48.761 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:48 ntpd[17203]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:51:48.761 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:48 ntpd[17203]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:51:48.761 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:48 ntpd[17203]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:51:48.761 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:48 ntpd[17203]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:51:48.761 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:48 ntpd[17203]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T20:51:48.761 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:48 ntpd[17203]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T20:51:48.761 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:48 ntpd[17203]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:51:48.761 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:48 ntpd[17203]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:51:48.761 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:48 ntpd[17203]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T20:51:48.762 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:48 ntpd[17203]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T20:51:48.762 INFO:teuthology.orchestra.run.smithi143.stdout:26 Apr 20:51:48 ntpd[17203]: ntpd: time slew +0.000076 s 2024-04-26T20:51:48.762 INFO:teuthology.orchestra.run.smithi143.stdout:ntpd: time slew +0.000076s 2024-04-26T20:51:48.762 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:48 ntpd[17203]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-26T20:51:48.763 INFO:teuthology.orchestra.run.smithi143.stderr:26 Apr 20:51:48 ntpd[17203]: can't open /var/log/ntpstats/loopstats.20240426: Permission denied 2024-04-26T20:51:48.884 INFO:teuthology.orchestra.run.smithi143.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T20:51:48.884 INFO:teuthology.orchestra.run.smithi143.stdout:============================================================================== 2024-04-26T20:51:48.885 INFO:teuthology.orchestra.run.smithi143.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T20:51:48.885 INFO:teuthology.orchestra.run.smithi143.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T20:51:48.885 INFO:teuthology.orchestra.run.smithi143.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T20:51:48.885 INFO:teuthology.orchestra.run.smithi143.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T20:51:48.886 INFO:teuthology.run_tasks:Running task install... 2024-04-26T20:51:48.894 DEBUG:teuthology.task.install:project ceph 2024-04-26T20:51:48.895 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}} 2024-04-26T20:51:48.895 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'} 2024-04-26T20:51:48.895 INFO:teuthology.task.install:Using flavor: default 2024-04-26T20:51:48.901 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-26T20:51:48.901 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-26T20:51:48.901 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-key list | grep Ceph 2024-04-26T20:51:48.902 DEBUG:teuthology.orchestra.run.smithi143:> sudo apt-key list | grep Ceph 2024-04-26T20:51:49.006 INFO:teuthology.orchestra.run.smithi138.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-26T20:51:49.034 INFO:teuthology.orchestra.run.smithi143.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-26T20:51:49.057 INFO:teuthology.orchestra.run.smithi138.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-26T20:51:49.057 INFO:teuthology.orchestra.run.smithi138.stdout:uid [ unknown] Ceph.com (release key) 2024-04-26T20:51:49.058 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-26T20:51:49.059 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-26T20:51:49.059 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T20:51:49.093 INFO:teuthology.orchestra.run.smithi143.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-26T20:51:49.093 INFO:teuthology.orchestra.run.smithi143.stdout:uid [ unknown] Ceph.com (release key) 2024-04-26T20:51:49.094 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-26T20:51:49.094 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-26T20:51:49.094 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T20:51:49.208 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default/ 2024-04-26T20:51:49.208 INFO:teuthology.task.install.deb:Package version is 19.0.0-3306-gbc612ffb-1jammy 2024-04-26T20:51:49.228 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default/ 2024-04-26T20:51:49.228 INFO:teuthology.task.install.deb:Package version is 19.0.0-3306-gbc612ffb-1jammy 2024-04-26T20:51:49.384 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-26T20:51:49.384 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-26T20:51:49.397 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T20:51:49.397 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-26T20:51:49.403 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-get update 2024-04-26T20:51:49.416 DEBUG:teuthology.orchestra.run.smithi143:> sudo apt-get update 2024-04-26T20:51:49.594 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T20:51:49.599 INFO:teuthology.orchestra.run.smithi143.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T20:51:49.604 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-26T20:51:49.606 INFO:teuthology.orchestra.run.smithi143.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-26T20:51:49.607 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:3 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-26T20:51:49.609 INFO:teuthology.orchestra.run.smithi143.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-26T20:51:49.625 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-26T20:51:49.628 INFO:teuthology.orchestra.run.smithi143.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-26T20:51:49.637 INFO:teuthology.orchestra.run.smithi138.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy InRelease 2024-04-26T20:51:49.644 INFO:teuthology.orchestra.run.smithi143.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy InRelease 2024-04-26T20:51:49.658 INFO:teuthology.orchestra.run.smithi138.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-26T20:51:49.665 INFO:teuthology.orchestra.run.smithi143.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-26T20:51:49.680 INFO:teuthology.orchestra.run.smithi138.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-26T20:51:49.687 INFO:teuthology.orchestra.run.smithi143.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-26T20:51:49.702 INFO:teuthology.orchestra.run.smithi138.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-26T20:51:49.708 INFO:teuthology.orchestra.run.smithi143.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-26T20:51:49.734 INFO:teuthology.orchestra.run.smithi138.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-04-26T20:51:49.740 INFO:teuthology.orchestra.run.smithi143.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-04-26T20:51:50.178 INFO:teuthology.orchestra.run.smithi138.stdout:Fetched 29.2 kB in 1s (52.9 kB/s) 2024-04-26T20:51:50.187 INFO:teuthology.orchestra.run.smithi143.stdout:Fetched 29.2 kB in 1s (52.9 kB/s) 2024-04-26T20:51:51.160 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2024-04-26T20:51:51.175 DEBUG:teuthology.orchestra.run.smithi138:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3306-gbc612ffb-1jammy cephadm=19.0.0-3306-gbc612ffb-1jammy ceph-mds=19.0.0-3306-gbc612ffb-1jammy ceph-mgr=19.0.0-3306-gbc612ffb-1jammy ceph-common=19.0.0-3306-gbc612ffb-1jammy ceph-fuse=19.0.0-3306-gbc612ffb-1jammy ceph-test=19.0.0-3306-gbc612ffb-1jammy ceph-volume=19.0.0-3306-gbc612ffb-1jammy radosgw=19.0.0-3306-gbc612ffb-1jammy python3-rados=19.0.0-3306-gbc612ffb-1jammy python3-rgw=19.0.0-3306-gbc612ffb-1jammy python3-cephfs=19.0.0-3306-gbc612ffb-1jammy python3-rbd=19.0.0-3306-gbc612ffb-1jammy libcephfs2=19.0.0-3306-gbc612ffb-1jammy libcephfs-dev=19.0.0-3306-gbc612ffb-1jammy librados2=19.0.0-3306-gbc612ffb-1jammy librbd1=19.0.0-3306-gbc612ffb-1jammy rbd-fuse=19.0.0-3306-gbc612ffb-1jammy python3-cephfs=19.0.0-3306-gbc612ffb-1jammy cephfs-shell=19.0.0-3306-gbc612ffb-1jammy cephfs-top=19.0.0-3306-gbc612ffb-1jammy cephfs-mirror=19.0.0-3306-gbc612ffb-1jammy 2024-04-26T20:51:51.178 INFO:teuthology.orchestra.run.smithi143.stdout:Reading package lists... 2024-04-26T20:51:51.193 DEBUG:teuthology.orchestra.run.smithi143:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3306-gbc612ffb-1jammy cephadm=19.0.0-3306-gbc612ffb-1jammy ceph-mds=19.0.0-3306-gbc612ffb-1jammy ceph-mgr=19.0.0-3306-gbc612ffb-1jammy ceph-common=19.0.0-3306-gbc612ffb-1jammy ceph-fuse=19.0.0-3306-gbc612ffb-1jammy ceph-test=19.0.0-3306-gbc612ffb-1jammy ceph-volume=19.0.0-3306-gbc612ffb-1jammy radosgw=19.0.0-3306-gbc612ffb-1jammy python3-rados=19.0.0-3306-gbc612ffb-1jammy python3-rgw=19.0.0-3306-gbc612ffb-1jammy python3-cephfs=19.0.0-3306-gbc612ffb-1jammy python3-rbd=19.0.0-3306-gbc612ffb-1jammy libcephfs2=19.0.0-3306-gbc612ffb-1jammy libcephfs-dev=19.0.0-3306-gbc612ffb-1jammy librados2=19.0.0-3306-gbc612ffb-1jammy librbd1=19.0.0-3306-gbc612ffb-1jammy rbd-fuse=19.0.0-3306-gbc612ffb-1jammy python3-cephfs=19.0.0-3306-gbc612ffb-1jammy cephfs-shell=19.0.0-3306-gbc612ffb-1jammy cephfs-top=19.0.0-3306-gbc612ffb-1jammy cephfs-mirror=19.0.0-3306-gbc612ffb-1jammy 2024-04-26T20:51:51.248 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2024-04-26T20:51:51.266 INFO:teuthology.orchestra.run.smithi143.stdout:Reading package lists... 2024-04-26T20:51:51.431 INFO:teuthology.orchestra.run.smithi138.stdout:Building dependency tree... 2024-04-26T20:51:51.431 INFO:teuthology.orchestra.run.smithi138.stdout:Reading state information... 2024-04-26T20:51:51.441 INFO:teuthology.orchestra.run.smithi143.stdout:Building dependency tree... 2024-04-26T20:51:51.442 INFO:teuthology.orchestra.run.smithi143.stdout:Reading state information... 2024-04-26T20:51:51.613 INFO:teuthology.orchestra.run.smithi143.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T20:51:51.614 INFO:teuthology.orchestra.run.smithi143.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T20:51:51.614 INFO:teuthology.orchestra.run.smithi143.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T20:51:51.614 INFO:teuthology.orchestra.run.smithi143.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T20:51:51.616 INFO:teuthology.orchestra.run.smithi138.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T20:51:51.616 INFO:teuthology.orchestra.run.smithi138.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T20:51:51.616 INFO:teuthology.orchestra.run.smithi138.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T20:51:51.616 INFO:teuthology.orchestra.run.smithi138.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T20:51:51.616 INFO:teuthology.orchestra.run.smithi138.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T20:51:51.616 INFO:teuthology.orchestra.run.smithi138.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T20:51:51.616 INFO:teuthology.orchestra.run.smithi138.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T20:51:51.618 INFO:teuthology.orchestra.run.smithi143.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T20:51:51.618 INFO:teuthology.orchestra.run.smithi143.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T20:51:51.618 INFO:teuthology.orchestra.run.smithi143.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T20:51:51.618 INFO:teuthology.orchestra.run.smithi143.stdout:The following additional packages will be installed: 2024-04-26T20:51:51.618 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-26T20:51:51.618 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-26T20:51:51.618 INFO:teuthology.orchestra.run.smithi143.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-26T20:51:51.618 INFO:teuthology.orchestra.run.smithi143.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-26T20:51:51.618 INFO:teuthology.orchestra.run.smithi143.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-26T20:51:51.618 INFO:teuthology.orchestra.run.smithi143.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-26T20:51:51.619 INFO:teuthology.orchestra.run.smithi143.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-26T20:51:51.619 INFO:teuthology.orchestra.run.smithi143.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-26T20:51:51.619 INFO:teuthology.orchestra.run.smithi143.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-26T20:51:51.619 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-26T20:51:51.619 INFO:teuthology.orchestra.run.smithi143.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-26T20:51:51.619 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-26T20:51:51.619 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-26T20:51:51.619 INFO:teuthology.orchestra.run.smithi143.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-26T20:51:51.619 INFO:teuthology.orchestra.run.smithi143.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-26T20:51:51.619 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-26T20:51:51.619 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-26T20:51:51.619 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-26T20:51:51.619 INFO:teuthology.orchestra.run.smithi143.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-26T20:51:51.619 INFO:teuthology.orchestra.run.smithi143.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-26T20:51:51.620 INFO:teuthology.orchestra.run.smithi143.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-26T20:51:51.620 INFO:teuthology.orchestra.run.smithi143.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-26T20:51:51.620 INFO:teuthology.orchestra.run.smithi143.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-26T20:51:51.620 INFO:teuthology.orchestra.run.smithi143.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-26T20:51:51.620 INFO:teuthology.orchestra.run.smithi143.stdout:Suggested packages: 2024-04-26T20:51:51.620 INFO:teuthology.orchestra.run.smithi143.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-26T20:51:51.620 INFO:teuthology.orchestra.run.smithi143.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-26T20:51:51.620 INFO:teuthology.orchestra.run.smithi143.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-26T20:51:51.620 INFO:teuthology.orchestra.run.smithi143.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-26T20:51:51.620 INFO:teuthology.orchestra.run.smithi143.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-26T20:51:51.620 INFO:teuthology.orchestra.run.smithi143.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-26T20:51:51.620 INFO:teuthology.orchestra.run.smithi143.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-26T20:51:51.620 INFO:teuthology.orchestra.run.smithi143.stdout:Recommended packages: 2024-04-26T20:51:51.620 INFO:teuthology.orchestra.run.smithi143.stdout: btrfs-tools 2024-04-26T20:51:51.623 INFO:teuthology.orchestra.run.smithi138.stdout:The following additional packages will be installed: 2024-04-26T20:51:51.623 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-26T20:51:51.623 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-26T20:51:51.623 INFO:teuthology.orchestra.run.smithi138.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-26T20:51:51.623 INFO:teuthology.orchestra.run.smithi138.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-26T20:51:51.623 INFO:teuthology.orchestra.run.smithi138.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-26T20:51:51.623 INFO:teuthology.orchestra.run.smithi138.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-26T20:51:51.623 INFO:teuthology.orchestra.run.smithi138.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-26T20:51:51.623 INFO:teuthology.orchestra.run.smithi138.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-26T20:51:51.623 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-26T20:51:51.623 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-26T20:51:51.623 INFO:teuthology.orchestra.run.smithi138.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-26T20:51:51.623 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-26T20:51:51.623 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-26T20:51:51.624 INFO:teuthology.orchestra.run.smithi138.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-26T20:51:51.624 INFO:teuthology.orchestra.run.smithi138.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-26T20:51:51.624 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-26T20:51:51.624 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-26T20:51:51.624 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-26T20:51:51.624 INFO:teuthology.orchestra.run.smithi138.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-26T20:51:51.624 INFO:teuthology.orchestra.run.smithi138.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-26T20:51:51.624 INFO:teuthology.orchestra.run.smithi138.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-26T20:51:51.624 INFO:teuthology.orchestra.run.smithi138.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-26T20:51:51.624 INFO:teuthology.orchestra.run.smithi138.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-26T20:51:51.624 INFO:teuthology.orchestra.run.smithi138.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-26T20:51:51.624 INFO:teuthology.orchestra.run.smithi138.stdout:Suggested packages: 2024-04-26T20:51:51.624 INFO:teuthology.orchestra.run.smithi138.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-26T20:51:51.624 INFO:teuthology.orchestra.run.smithi138.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-26T20:51:51.624 INFO:teuthology.orchestra.run.smithi138.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-26T20:51:51.625 INFO:teuthology.orchestra.run.smithi138.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-26T20:51:51.625 INFO:teuthology.orchestra.run.smithi138.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-26T20:51:51.625 INFO:teuthology.orchestra.run.smithi138.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-26T20:51:51.625 INFO:teuthology.orchestra.run.smithi138.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-26T20:51:51.625 INFO:teuthology.orchestra.run.smithi138.stdout:Recommended packages: 2024-04-26T20:51:51.625 INFO:teuthology.orchestra.run.smithi138.stdout: btrfs-tools 2024-04-26T20:51:51.769 INFO:teuthology.orchestra.run.smithi138.stdout:The following NEW packages will be installed: 2024-04-26T20:51:51.769 INFO:teuthology.orchestra.run.smithi138.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-26T20:51:51.769 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-26T20:51:51.769 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-26T20:51:51.770 INFO:teuthology.orchestra.run.smithi138.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-26T20:51:51.770 INFO:teuthology.orchestra.run.smithi138.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-26T20:51:51.770 INFO:teuthology.orchestra.run.smithi138.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-26T20:51:51.770 INFO:teuthology.orchestra.run.smithi138.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-26T20:51:51.770 INFO:teuthology.orchestra.run.smithi138.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-26T20:51:51.770 INFO:teuthology.orchestra.run.smithi138.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-26T20:51:51.770 INFO:teuthology.orchestra.run.smithi138.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-26T20:51:51.770 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-26T20:51:51.770 INFO:teuthology.orchestra.run.smithi138.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-26T20:51:51.770 INFO:teuthology.orchestra.run.smithi138.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-26T20:51:51.770 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-26T20:51:51.770 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-26T20:51:51.770 INFO:teuthology.orchestra.run.smithi138.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-26T20:51:51.770 INFO:teuthology.orchestra.run.smithi138.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-26T20:51:51.771 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-26T20:51:51.771 INFO:teuthology.orchestra.run.smithi138.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-26T20:51:51.771 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-26T20:51:51.771 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-26T20:51:51.771 INFO:teuthology.orchestra.run.smithi138.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-26T20:51:51.771 INFO:teuthology.orchestra.run.smithi138.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-26T20:51:51.771 INFO:teuthology.orchestra.run.smithi138.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-26T20:51:51.771 INFO:teuthology.orchestra.run.smithi138.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-26T20:51:51.771 INFO:teuthology.orchestra.run.smithi138.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-26T20:51:51.771 INFO:teuthology.orchestra.run.smithi138.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-26T20:51:51.771 INFO:teuthology.orchestra.run.smithi138.stdout: socat unzip xmlstarlet zip 2024-04-26T20:51:51.774 INFO:teuthology.orchestra.run.smithi143.stdout:The following NEW packages will be installed: 2024-04-26T20:51:51.774 INFO:teuthology.orchestra.run.smithi143.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-26T20:51:51.774 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-26T20:51:51.774 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-26T20:51:51.775 INFO:teuthology.orchestra.run.smithi143.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-26T20:51:51.775 INFO:teuthology.orchestra.run.smithi143.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-26T20:51:51.775 INFO:teuthology.orchestra.run.smithi143.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-26T20:51:51.775 INFO:teuthology.orchestra.run.smithi143.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-26T20:51:51.775 INFO:teuthology.orchestra.run.smithi143.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-26T20:51:51.775 INFO:teuthology.orchestra.run.smithi143.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-26T20:51:51.775 INFO:teuthology.orchestra.run.smithi143.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-26T20:51:51.775 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-26T20:51:51.775 INFO:teuthology.orchestra.run.smithi143.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-26T20:51:51.775 INFO:teuthology.orchestra.run.smithi143.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-26T20:51:51.775 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-26T20:51:51.775 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-26T20:51:51.775 INFO:teuthology.orchestra.run.smithi143.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-26T20:51:51.775 INFO:teuthology.orchestra.run.smithi143.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-26T20:51:51.776 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-26T20:51:51.776 INFO:teuthology.orchestra.run.smithi143.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-26T20:51:51.776 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-26T20:51:51.776 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-26T20:51:51.776 INFO:teuthology.orchestra.run.smithi143.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-26T20:51:51.776 INFO:teuthology.orchestra.run.smithi143.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-26T20:51:51.776 INFO:teuthology.orchestra.run.smithi143.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-26T20:51:51.776 INFO:teuthology.orchestra.run.smithi143.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-26T20:51:51.776 INFO:teuthology.orchestra.run.smithi143.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-26T20:51:51.776 INFO:teuthology.orchestra.run.smithi143.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-26T20:51:51.776 INFO:teuthology.orchestra.run.smithi143.stdout: socat unzip xmlstarlet zip 2024-04-26T20:51:51.859 INFO:teuthology.orchestra.run.smithi138.stdout:0 upgraded, 124 newly installed, 0 to remove and 305 not upgraded. 2024-04-26T20:51:51.860 INFO:teuthology.orchestra.run.smithi138.stdout:Need to get 182 MB of archives. 2024-04-26T20:51:51.860 INFO:teuthology.orchestra.run.smithi138.stdout:After this operation, 830 MB of additional disk space will be used. 2024-04-26T20:51:51.860 INFO:teuthology.orchestra.run.smithi138.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-26T20:51:51.861 INFO:teuthology.orchestra.run.smithi143.stdout:0 upgraded, 124 newly installed, 0 to remove and 305 not upgraded. 2024-04-26T20:51:51.861 INFO:teuthology.orchestra.run.smithi143.stdout:Need to get 182 MB of archives. 2024-04-26T20:51:51.861 INFO:teuthology.orchestra.run.smithi143.stdout:After this operation, 830 MB of additional disk space will be used. 2024-04-26T20:51:51.861 INFO:teuthology.orchestra.run.smithi143.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-26T20:51:51.880 INFO:teuthology.orchestra.run.smithi138.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-26T20:51:51.883 INFO:teuthology.orchestra.run.smithi143.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-26T20:51:51.893 INFO:teuthology.orchestra.run.smithi138.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-26T20:51:51.895 INFO:teuthology.orchestra.run.smithi143.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-26T20:51:51.942 INFO:teuthology.orchestra.run.smithi138.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3306-gbc612ffb-1jammy [3,556 kB] 2024-04-26T20:51:51.948 INFO:teuthology.orchestra.run.smithi138.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-26T20:51:51.951 INFO:teuthology.orchestra.run.smithi143.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-26T20:51:51.970 INFO:teuthology.orchestra.run.smithi138.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-26T20:51:51.974 INFO:teuthology.orchestra.run.smithi143.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-26T20:51:51.975 INFO:teuthology.orchestra.run.smithi138.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-26T20:51:51.977 INFO:teuthology.orchestra.run.smithi143.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-26T20:51:51.987 INFO:teuthology.orchestra.run.smithi138.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-26T20:51:51.991 INFO:teuthology.orchestra.run.smithi143.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-26T20:51:52.021 INFO:teuthology.orchestra.run.smithi143.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3306-gbc612ffb-1jammy [3,556 kB] 2024-04-26T20:51:52.036 INFO:teuthology.orchestra.run.smithi138.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-26T20:51:52.039 INFO:teuthology.orchestra.run.smithi138.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-26T20:51:52.044 INFO:teuthology.orchestra.run.smithi143.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-26T20:51:52.048 INFO:teuthology.orchestra.run.smithi143.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-26T20:51:52.050 INFO:teuthology.orchestra.run.smithi138.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-26T20:51:52.054 INFO:teuthology.orchestra.run.smithi138.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-26T20:51:52.055 INFO:teuthology.orchestra.run.smithi138.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-26T20:51:52.062 INFO:teuthology.orchestra.run.smithi143.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-26T20:51:52.064 INFO:teuthology.orchestra.run.smithi138.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-26T20:51:52.067 INFO:teuthology.orchestra.run.smithi138.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-26T20:51:52.068 INFO:teuthology.orchestra.run.smithi143.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-26T20:51:52.068 INFO:teuthology.orchestra.run.smithi143.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-26T20:51:52.070 INFO:teuthology.orchestra.run.smithi138.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-26T20:51:52.072 INFO:teuthology.orchestra.run.smithi138.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-26T20:51:52.078 INFO:teuthology.orchestra.run.smithi138.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-26T20:51:52.080 INFO:teuthology.orchestra.run.smithi143.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-26T20:51:52.082 INFO:teuthology.orchestra.run.smithi143.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-26T20:51:52.084 INFO:teuthology.orchestra.run.smithi143.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-26T20:51:52.085 INFO:teuthology.orchestra.run.smithi143.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-26T20:51:52.085 INFO:teuthology.orchestra.run.smithi143.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-26T20:51:52.096 INFO:teuthology.orchestra.run.smithi138.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-26T20:51:52.098 INFO:teuthology.orchestra.run.smithi138.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-26T20:51:52.100 INFO:teuthology.orchestra.run.smithi138.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-26T20:51:52.101 INFO:teuthology.orchestra.run.smithi138.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-26T20:51:52.101 INFO:teuthology.orchestra.run.smithi138.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-26T20:51:52.102 INFO:teuthology.orchestra.run.smithi138.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-26T20:51:52.102 INFO:teuthology.orchestra.run.smithi138.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-26T20:51:52.103 INFO:teuthology.orchestra.run.smithi138.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-26T20:51:52.103 INFO:teuthology.orchestra.run.smithi138.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-26T20:51:52.106 INFO:teuthology.orchestra.run.smithi143.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-26T20:51:52.109 INFO:teuthology.orchestra.run.smithi143.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-26T20:51:52.112 INFO:teuthology.orchestra.run.smithi143.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-26T20:51:52.112 INFO:teuthology.orchestra.run.smithi143.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-26T20:51:52.113 INFO:teuthology.orchestra.run.smithi143.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-26T20:51:52.114 INFO:teuthology.orchestra.run.smithi143.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-26T20:51:52.120 INFO:teuthology.orchestra.run.smithi138.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-26T20:51:52.123 INFO:teuthology.orchestra.run.smithi138.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-26T20:51:52.124 INFO:teuthology.orchestra.run.smithi138.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-26T20:51:52.126 INFO:teuthology.orchestra.run.smithi138.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-26T20:51:52.126 INFO:teuthology.orchestra.run.smithi138.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-26T20:51:52.127 INFO:teuthology.orchestra.run.smithi143.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-26T20:51:52.127 INFO:teuthology.orchestra.run.smithi138.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-26T20:51:52.127 INFO:teuthology.orchestra.run.smithi138.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-26T20:51:52.128 INFO:teuthology.orchestra.run.smithi143.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-26T20:51:52.128 INFO:teuthology.orchestra.run.smithi143.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-26T20:51:52.128 INFO:teuthology.orchestra.run.smithi143.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-26T20:51:52.129 INFO:teuthology.orchestra.run.smithi138.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-26T20:51:52.129 INFO:teuthology.orchestra.run.smithi138.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-26T20:51:52.140 INFO:teuthology.orchestra.run.smithi138.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-26T20:51:52.151 INFO:teuthology.orchestra.run.smithi143.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-26T20:51:52.151 INFO:teuthology.orchestra.run.smithi143.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-26T20:51:52.154 INFO:teuthology.orchestra.run.smithi138.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-26T20:51:52.154 INFO:teuthology.orchestra.run.smithi143.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-26T20:51:52.155 INFO:teuthology.orchestra.run.smithi143.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-26T20:51:52.155 INFO:teuthology.orchestra.run.smithi138.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-26T20:51:52.155 INFO:teuthology.orchestra.run.smithi138.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-26T20:51:52.156 INFO:teuthology.orchestra.run.smithi143.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-26T20:51:52.156 INFO:teuthology.orchestra.run.smithi143.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-26T20:51:52.160 INFO:teuthology.orchestra.run.smithi138.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-26T20:51:52.160 INFO:teuthology.orchestra.run.smithi138.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-26T20:51:52.160 INFO:teuthology.orchestra.run.smithi138.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-26T20:51:52.161 INFO:teuthology.orchestra.run.smithi138.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-26T20:51:52.162 INFO:teuthology.orchestra.run.smithi138.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-26T20:51:52.164 INFO:teuthology.orchestra.run.smithi138.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-26T20:51:52.171 INFO:teuthology.orchestra.run.smithi143.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-26T20:51:52.171 INFO:teuthology.orchestra.run.smithi143.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-26T20:51:52.172 INFO:teuthology.orchestra.run.smithi143.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-26T20:51:52.173 INFO:teuthology.orchestra.run.smithi143.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-26T20:51:52.173 INFO:teuthology.orchestra.run.smithi138.stdout:Get:47 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3306-gbc612ffb-1jammy [3,224 kB] 2024-04-26T20:51:52.181 INFO:teuthology.orchestra.run.smithi138.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-26T20:51:52.182 INFO:teuthology.orchestra.run.smithi138.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-26T20:51:52.183 INFO:teuthology.orchestra.run.smithi138.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-26T20:51:52.185 INFO:teuthology.orchestra.run.smithi138.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-26T20:51:52.186 INFO:teuthology.orchestra.run.smithi138.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-26T20:51:52.192 INFO:teuthology.orchestra.run.smithi143.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-26T20:51:52.192 INFO:teuthology.orchestra.run.smithi143.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-26T20:51:52.198 INFO:teuthology.orchestra.run.smithi143.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-26T20:51:52.198 INFO:teuthology.orchestra.run.smithi143.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-26T20:51:52.199 INFO:teuthology.orchestra.run.smithi143.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-26T20:51:52.199 INFO:teuthology.orchestra.run.smithi143.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-26T20:51:52.207 INFO:teuthology.orchestra.run.smithi138.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-26T20:51:52.209 INFO:teuthology.orchestra.run.smithi138.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-26T20:51:52.227 INFO:teuthology.orchestra.run.smithi143.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-26T20:51:52.230 INFO:teuthology.orchestra.run.smithi143.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-26T20:51:52.231 INFO:teuthology.orchestra.run.smithi143.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-26T20:51:52.233 INFO:teuthology.orchestra.run.smithi143.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-26T20:51:52.265 INFO:teuthology.orchestra.run.smithi143.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-26T20:51:52.267 INFO:teuthology.orchestra.run.smithi138.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-26T20:51:52.268 INFO:teuthology.orchestra.run.smithi143.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-26T20:51:52.268 INFO:teuthology.orchestra.run.smithi143.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-26T20:51:52.269 INFO:teuthology.orchestra.run.smithi143.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-26T20:51:52.269 INFO:teuthology.orchestra.run.smithi138.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-26T20:51:52.270 INFO:teuthology.orchestra.run.smithi138.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-26T20:51:52.271 INFO:teuthology.orchestra.run.smithi143.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-26T20:51:52.271 INFO:teuthology.orchestra.run.smithi138.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-26T20:51:52.272 INFO:teuthology.orchestra.run.smithi138.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-26T20:51:52.276 INFO:teuthology.orchestra.run.smithi138.stdout:Get:60 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3306-gbc612ffb-1jammy [712 kB] 2024-04-26T20:51:52.303 INFO:teuthology.orchestra.run.smithi138.stdout:Get:61 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3306-gbc612ffb-1jammy [356 kB] 2024-04-26T20:51:52.314 INFO:teuthology.orchestra.run.smithi138.stdout:Get:62 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3306-gbc612ffb-1jammy [32.8 kB] 2024-04-26T20:51:52.315 INFO:teuthology.orchestra.run.smithi138.stdout:Get:63 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3306-gbc612ffb-1jammy [180 kB] 2024-04-26T20:51:52.321 INFO:teuthology.orchestra.run.smithi138.stdout:Get:64 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3306-gbc612ffb-1jammy [67.1 kB] 2024-04-26T20:51:52.324 INFO:teuthology.orchestra.run.smithi138.stdout:Get:65 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3306-gbc612ffb-1jammy [330 kB] 2024-04-26T20:51:52.334 INFO:teuthology.orchestra.run.smithi138.stdout:Get:66 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3306-gbc612ffb-1jammy [6,892 kB] 2024-04-26T20:51:52.385 INFO:teuthology.orchestra.run.smithi138.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-26T20:51:52.387 INFO:teuthology.orchestra.run.smithi138.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-26T20:51:52.387 INFO:teuthology.orchestra.run.smithi138.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-26T20:51:52.402 INFO:teuthology.orchestra.run.smithi143.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-26T20:51:52.403 INFO:teuthology.orchestra.run.smithi143.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-26T20:51:52.404 INFO:teuthology.orchestra.run.smithi143.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-26T20:51:52.405 INFO:teuthology.orchestra.run.smithi143.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-26T20:51:52.406 INFO:teuthology.orchestra.run.smithi138.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-26T20:51:52.406 INFO:teuthology.orchestra.run.smithi138.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-26T20:51:52.407 INFO:teuthology.orchestra.run.smithi143.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-26T20:51:52.407 INFO:teuthology.orchestra.run.smithi138.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-26T20:51:52.407 INFO:teuthology.orchestra.run.smithi138.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-26T20:51:52.408 INFO:teuthology.orchestra.run.smithi138.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-26T20:51:52.408 INFO:teuthology.orchestra.run.smithi138.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-26T20:51:52.411 INFO:teuthology.orchestra.run.smithi138.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-26T20:51:52.426 INFO:teuthology.orchestra.run.smithi143.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-26T20:51:52.428 INFO:teuthology.orchestra.run.smithi143.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-26T20:51:52.428 INFO:teuthology.orchestra.run.smithi143.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-26T20:51:52.436 INFO:teuthology.orchestra.run.smithi138.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-26T20:51:52.440 INFO:teuthology.orchestra.run.smithi138.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-26T20:51:52.442 INFO:teuthology.orchestra.run.smithi138.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-26T20:51:52.443 INFO:teuthology.orchestra.run.smithi138.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-26T20:51:52.444 INFO:teuthology.orchestra.run.smithi138.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-26T20:51:52.448 INFO:teuthology.orchestra.run.smithi138.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-26T20:51:52.453 INFO:teuthology.orchestra.run.smithi138.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-26T20:51:52.453 INFO:teuthology.orchestra.run.smithi138.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-26T20:51:52.454 INFO:teuthology.orchestra.run.smithi138.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-26T20:51:52.455 INFO:teuthology.orchestra.run.smithi143.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-26T20:51:52.456 INFO:teuthology.orchestra.run.smithi143.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-26T20:51:52.456 INFO:teuthology.orchestra.run.smithi143.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-26T20:51:52.457 INFO:teuthology.orchestra.run.smithi143.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-26T20:51:52.458 INFO:teuthology.orchestra.run.smithi143.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-26T20:51:52.458 INFO:teuthology.orchestra.run.smithi143.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-26T20:51:52.459 INFO:teuthology.orchestra.run.smithi143.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-26T20:51:52.459 INFO:teuthology.orchestra.run.smithi143.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-26T20:51:52.463 INFO:teuthology.orchestra.run.smithi143.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-26T20:51:52.466 INFO:teuthology.orchestra.run.smithi138.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-26T20:51:52.471 INFO:teuthology.orchestra.run.smithi138.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-26T20:51:52.471 INFO:teuthology.orchestra.run.smithi138.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-26T20:51:52.475 INFO:teuthology.orchestra.run.smithi138.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-26T20:51:52.475 INFO:teuthology.orchestra.run.smithi138.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-26T20:51:52.477 INFO:teuthology.orchestra.run.smithi143.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-26T20:51:52.486 INFO:teuthology.orchestra.run.smithi138.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-26T20:51:52.486 INFO:teuthology.orchestra.run.smithi143.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-26T20:51:52.487 INFO:teuthology.orchestra.run.smithi138.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-26T20:51:52.487 INFO:teuthology.orchestra.run.smithi143.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-26T20:51:52.490 INFO:teuthology.orchestra.run.smithi138.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-26T20:51:52.494 INFO:teuthology.orchestra.run.smithi138.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-26T20:51:52.495 INFO:teuthology.orchestra.run.smithi143.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-26T20:51:52.502 INFO:teuthology.orchestra.run.smithi143.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-26T20:51:52.502 INFO:teuthology.orchestra.run.smithi143.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-26T20:51:52.502 INFO:teuthology.orchestra.run.smithi143.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-26T20:51:52.502 INFO:teuthology.orchestra.run.smithi143.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-26T20:51:52.508 INFO:teuthology.orchestra.run.smithi138.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-26T20:51:52.510 INFO:teuthology.orchestra.run.smithi143.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-26T20:51:52.511 INFO:teuthology.orchestra.run.smithi143.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-26T20:51:52.513 INFO:teuthology.orchestra.run.smithi138.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-26T20:51:52.514 INFO:teuthology.orchestra.run.smithi138.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-26T20:51:52.516 INFO:teuthology.orchestra.run.smithi138.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-26T20:51:52.517 INFO:teuthology.orchestra.run.smithi138.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-26T20:51:52.535 INFO:teuthology.orchestra.run.smithi143.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-26T20:51:52.535 INFO:teuthology.orchestra.run.smithi143.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-26T20:51:52.536 INFO:teuthology.orchestra.run.smithi143.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-26T20:51:52.536 INFO:teuthology.orchestra.run.smithi143.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-26T20:51:52.538 INFO:teuthology.orchestra.run.smithi143.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-26T20:51:52.539 INFO:teuthology.orchestra.run.smithi143.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-26T20:51:52.550 INFO:teuthology.orchestra.run.smithi143.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-26T20:51:52.574 INFO:teuthology.orchestra.run.smithi138.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3306-gbc612ffb-1jammy [112 kB] 2024-04-26T20:51:52.575 INFO:teuthology.orchestra.run.smithi143.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-26T20:51:52.575 INFO:teuthology.orchestra.run.smithi143.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-26T20:51:52.576 INFO:teuthology.orchestra.run.smithi138.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3306-gbc612ffb-1jammy [466 kB] 2024-04-26T20:51:52.578 INFO:teuthology.orchestra.run.smithi143.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-26T20:51:52.591 INFO:teuthology.orchestra.run.smithi138.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3306-gbc612ffb-1jammy [25.8 MB] 2024-04-26T20:51:52.596 INFO:teuthology.orchestra.run.smithi143.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-26T20:51:53.499 INFO:teuthology.orchestra.run.smithi138.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3306-gbc612ffb-1jammy [5,094 kB] 2024-04-26T20:51:53.671 INFO:teuthology.orchestra.run.smithi138.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3306-gbc612ffb-1jammy [244 kB] 2024-04-26T20:51:53.679 INFO:teuthology.orchestra.run.smithi138.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3306-gbc612ffb-1jammy [124 kB] 2024-04-26T20:51:53.684 INFO:teuthology.orchestra.run.smithi138.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3306-gbc612ffb-1jammy [1,544 kB] 2024-04-26T20:51:53.738 INFO:teuthology.orchestra.run.smithi138.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3306-gbc612ffb-1jammy [6,261 kB] 2024-04-26T20:51:53.961 INFO:teuthology.orchestra.run.smithi138.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3306-gbc612ffb-1jammy [22.8 MB] 2024-04-26T20:51:54.101 INFO:teuthology.orchestra.run.smithi143.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3306-gbc612ffb-1jammy [3,224 kB] 2024-04-26T20:51:54.765 INFO:teuthology.orchestra.run.smithi138.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3306-gbc612ffb-1jammy [14.1 kB] 2024-04-26T20:51:54.765 INFO:teuthology.orchestra.run.smithi138.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3306-gbc612ffb-1jammy [870 kB] 2024-04-26T20:51:54.790 INFO:teuthology.orchestra.run.smithi138.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3306-gbc612ffb-1jammy [2,437 kB] 2024-04-26T20:51:54.875 INFO:teuthology.orchestra.run.smithi138.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3306-gbc612ffb-1jammy [791 kB] 2024-04-26T20:51:54.902 INFO:teuthology.orchestra.run.smithi138.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3306-gbc612ffb-1jammy [148 kB] 2024-04-26T20:51:54.908 INFO:teuthology.orchestra.run.smithi138.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3306-gbc612ffb-1jammy [2,297 kB] 2024-04-26T20:51:54.990 INFO:teuthology.orchestra.run.smithi138.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3306-gbc612ffb-1jammy [8,625 kB] 2024-04-26T20:51:55.294 INFO:teuthology.orchestra.run.smithi138.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3306-gbc612ffb-1jammy [14.2 kB] 2024-04-26T20:51:55.294 INFO:teuthology.orchestra.run.smithi138.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3306-gbc612ffb-1jammy [51.7 MB] 2024-04-26T20:51:55.700 INFO:teuthology.orchestra.run.smithi143.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3306-gbc612ffb-1jammy [712 kB] 2024-04-26T20:51:56.081 INFO:teuthology.orchestra.run.smithi143.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3306-gbc612ffb-1jammy [356 kB] 2024-04-26T20:51:56.266 INFO:teuthology.orchestra.run.smithi143.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3306-gbc612ffb-1jammy [32.8 kB] 2024-04-26T20:51:56.280 INFO:teuthology.orchestra.run.smithi143.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3306-gbc612ffb-1jammy [180 kB] 2024-04-26T20:51:56.392 INFO:teuthology.orchestra.run.smithi143.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3306-gbc612ffb-1jammy [67.1 kB] 2024-04-26T20:51:56.424 INFO:teuthology.orchestra.run.smithi143.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3306-gbc612ffb-1jammy [330 kB] 2024-04-26T20:51:56.600 INFO:teuthology.orchestra.run.smithi143.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3306-gbc612ffb-1jammy [6,892 kB] 2024-04-26T20:51:57.125 INFO:teuthology.orchestra.run.smithi138.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3306-gbc612ffb-1jammy [124 kB] 2024-04-26T20:51:57.126 INFO:teuthology.orchestra.run.smithi138.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3306-gbc612ffb-1jammy [232 kB] 2024-04-26T20:51:57.128 INFO:teuthology.orchestra.run.smithi138.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3306-gbc612ffb-1jammy [33.9 kB] 2024-04-26T20:51:57.128 INFO:teuthology.orchestra.run.smithi138.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3306-gbc612ffb-1jammy [23.4 kB] 2024-04-26T20:51:57.129 INFO:teuthology.orchestra.run.smithi138.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3306-gbc612ffb-1jammy [38.9 kB] 2024-04-26T20:51:57.129 INFO:teuthology.orchestra.run.smithi138.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3306-gbc612ffb-1jammy [13.6 MB] 2024-04-26T20:51:57.602 INFO:teuthology.orchestra.run.smithi138.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3306-gbc612ffb-1jammy [91.2 kB] 2024-04-26T20:51:58.236 INFO:teuthology.orchestra.run.smithi138.stdout:Fetched 182 MB in 6s (31.2 MB/s) 2024-04-26T20:51:58.389 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-26T20:51:58.455 INFO:teuthology.orchestra.run.smithi138.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132922 files and directories currently installed.) 2024-04-26T20:51:58.459 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-26T20:51:58.505 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-26T20:51:58.777 INFO:teuthology.orchestra.run.smithi143.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3306-gbc612ffb-1jammy [112 kB] 2024-04-26T20:51:58.784 INFO:teuthology.orchestra.run.smithi143.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3306-gbc612ffb-1jammy [466 kB] 2024-04-26T20:51:58.807 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-26T20:51:58.821 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-26T20:51:58.858 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T20:51:58.890 INFO:teuthology.orchestra.run.smithi143.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3306-gbc612ffb-1jammy [25.8 MB] 2024-04-26T20:51:59.127 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-cmd2. 2024-04-26T20:51:59.140 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-26T20:51:59.177 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-26T20:51:59.463 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-26T20:51:59.476 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-26T20:51:59.564 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T20:51:59.925 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-26T20:51:59.938 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-26T20:51:59.975 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T20:52:00.295 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-26T20:52:00.308 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-26T20:52:00.353 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T20:52:00.698 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-26T20:52:00.712 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T20:52:00.756 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T20:52:01.151 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-26T20:52:01.165 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T20:52:01.210 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T20:52:01.538 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-26T20:52:01.551 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T20:52:01.596 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T20:52:01.966 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-26T20:52:01.979 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-26T20:52:02.024 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T20:52:02.318 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package librados2. 2024-04-26T20:52:02.331 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../010-librados2_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:52:02.376 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking librados2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:02.813 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package librbd1. 2024-04-26T20:52:02.826 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../011-librbd1_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:52:02.871 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking librbd1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:03.299 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libcephfs2. 2024-04-26T20:52:03.312 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:52:03.332 INFO:teuthology.orchestra.run.smithi143.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3306-gbc612ffb-1jammy [5,094 kB] 2024-04-26T20:52:03.349 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libcephfs2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:03.868 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-rados. 2024-04-26T20:52:03.881 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:52:03.904 INFO:teuthology.orchestra.run.smithi143.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3306-gbc612ffb-1jammy [244 kB] 2024-04-26T20:52:03.926 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-rados (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:03.929 INFO:teuthology.orchestra.run.smithi143.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3306-gbc612ffb-1jammy [124 kB] 2024-04-26T20:52:03.941 INFO:teuthology.orchestra.run.smithi143.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3306-gbc612ffb-1jammy [1,544 kB] 2024-04-26T20:52:04.108 INFO:teuthology.orchestra.run.smithi143.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3306-gbc612ffb-1jammy [6,261 kB] 2024-04-26T20:52:04.262 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-26T20:52:04.276 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T20:52:04.321 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-ceph-argparse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:04.573 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-cephfs. 2024-04-26T20:52:04.587 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:52:04.632 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-cephfs (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:04.720 INFO:teuthology.orchestra.run.smithi143.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3306-gbc612ffb-1jammy [22.8 MB] 2024-04-26T20:52:04.934 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-26T20:52:04.947 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T20:52:04.984 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:05.321 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-prettytable. 2024-04-26T20:52:05.334 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-26T20:52:05.404 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-26T20:52:05.648 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-rbd. 2024-04-26T20:52:05.662 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:52:05.698 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-rbd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:06.009 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-26T20:52:06.024 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-26T20:52:06.068 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T20:52:06.320 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-26T20:52:06.333 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-26T20:52:06.362 INFO:teuthology.orchestra.run.smithi143.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3306-gbc612ffb-1jammy [14.1 kB] 2024-04-26T20:52:06.362 INFO:teuthology.orchestra.run.smithi143.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3306-gbc612ffb-1jammy [870 kB] 2024-04-26T20:52:06.370 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T20:52:06.424 INFO:teuthology.orchestra.run.smithi143.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3306-gbc612ffb-1jammy [2,437 kB] 2024-04-26T20:52:06.672 INFO:teuthology.orchestra.run.smithi143.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3306-gbc612ffb-1jammy [791 kB] 2024-04-26T20:52:06.690 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-26T20:52:06.703 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-26T20:52:06.726 INFO:teuthology.orchestra.run.smithi143.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3306-gbc612ffb-1jammy [148 kB] 2024-04-26T20:52:06.735 INFO:teuthology.orchestra.run.smithi143.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3306-gbc612ffb-1jammy [2,297 kB] 2024-04-26T20:52:06.748 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T20:52:06.886 INFO:teuthology.orchestra.run.smithi143.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3306-gbc612ffb-1jammy [8,625 kB] 2024-04-26T20:52:07.034 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package lua5.1. 2024-04-26T20:52:07.048 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-26T20:52:07.093 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-26T20:52:07.351 INFO:teuthology.orchestra.run.smithi143.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3306-gbc612ffb-1jammy [14.2 kB] 2024-04-26T20:52:07.352 INFO:teuthology.orchestra.run.smithi143.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3306-gbc612ffb-1jammy [51.7 MB] 2024-04-26T20:52:07.387 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package lua-any. 2024-04-26T20:52:07.400 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-26T20:52:07.445 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-26T20:52:07.707 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package zip. 2024-04-26T20:52:07.720 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-26T20:52:07.765 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking zip (3.0-12build2) ... 2024-04-26T20:52:08.077 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package unzip. 2024-04-26T20:52:08.090 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-26T20:52:08.135 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-26T20:52:08.480 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package luarocks. 2024-04-26T20:52:08.493 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-26T20:52:08.530 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-26T20:52:08.996 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package librgw2. 2024-04-26T20:52:09.010 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../027-librgw2_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:52:09.054 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking librgw2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:09.358 INFO:teuthology.orchestra.run.smithi143.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3306-gbc612ffb-1jammy [124 kB] 2024-04-26T20:52:09.359 INFO:teuthology.orchestra.run.smithi143.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3306-gbc612ffb-1jammy [232 kB] 2024-04-26T20:52:09.361 INFO:teuthology.orchestra.run.smithi143.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3306-gbc612ffb-1jammy [33.9 kB] 2024-04-26T20:52:09.361 INFO:teuthology.orchestra.run.smithi143.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3306-gbc612ffb-1jammy [23.4 kB] 2024-04-26T20:52:09.362 INFO:teuthology.orchestra.run.smithi143.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3306-gbc612ffb-1jammy [38.9 kB] 2024-04-26T20:52:09.362 INFO:teuthology.orchestra.run.smithi143.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3306-gbc612ffb-1jammy [13.6 MB] 2024-04-26T20:52:09.591 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-rgw. 2024-04-26T20:52:09.605 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:52:09.674 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-rgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:09.818 INFO:teuthology.orchestra.run.smithi143.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3306-gbc612ffb-1jammy [91.2 kB] 2024-04-26T20:52:10.035 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-26T20:52:10.050 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-26T20:52:10.093 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T20:52:10.404 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libradosstriper1. 2024-04-26T20:52:10.419 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:52:10.453 INFO:teuthology.orchestra.run.smithi143.stdout:Fetched 182 MB in 18s (10.1 MB/s) 2024-04-26T20:52:10.462 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libradosstriper1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:10.602 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-26T20:52:10.671 INFO:teuthology.orchestra.run.smithi143.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132922 files and directories currently installed.) 2024-04-26T20:52:10.674 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-26T20:52:10.717 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-26T20:52:10.808 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-common. 2024-04-26T20:52:10.822 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:52:10.866 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:11.003 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-26T20:52:11.017 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-26T20:52:11.054 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T20:52:11.348 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-cmd2. 2024-04-26T20:52:11.361 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-26T20:52:11.422 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-26T20:52:11.750 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-26T20:52:11.764 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-26T20:52:11.850 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T20:52:12.021 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-base. 2024-04-26T20:52:12.036 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:52:12.088 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-base (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:12.204 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-26T20:52:12.219 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-26T20:52:12.262 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T20:52:12.598 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-26T20:52:12.613 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-26T20:52:12.656 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T20:52:12.659 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-26T20:52:12.672 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-26T20:52:12.717 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-26T20:52:13.010 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-26T20:52:13.020 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-cheroot. 2024-04-26T20:52:13.025 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T20:52:13.034 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-26T20:52:13.067 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T20:52:13.078 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T20:52:13.406 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-26T20:52:13.420 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-26T20:52:13.464 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-26T20:52:13.488 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-26T20:52:13.503 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T20:52:13.546 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T20:52:13.750 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-26T20:52:13.765 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-26T20:52:13.800 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-26T20:52:13.890 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-26T20:52:13.905 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T20:52:13.974 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T20:52:14.061 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-26T20:52:14.075 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-26T20:52:14.120 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-26T20:52:14.285 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-26T20:52:14.300 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-26T20:52:14.334 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T20:52:14.423 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-tempora. 2024-04-26T20:52:14.437 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-26T20:52:14.481 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-26T20:52:14.596 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package librados2. 2024-04-26T20:52:14.611 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../010-librados2_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:52:14.654 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking librados2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:14.809 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-portend. 2024-04-26T20:52:14.824 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-26T20:52:14.867 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-26T20:52:15.048 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package librbd1. 2024-04-26T20:52:15.063 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../011-librbd1_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:52:15.120 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-26T20:52:15.123 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking librbd1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:15.134 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-26T20:52:15.170 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-26T20:52:15.473 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-26T20:52:15.488 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-26T20:52:15.526 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libcephfs2. 2024-04-26T20:52:15.539 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-26T20:52:15.540 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:52:15.584 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libcephfs2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:15.853 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-rados. 2024-04-26T20:52:15.860 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-natsort. 2024-04-26T20:52:15.867 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:52:15.874 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-26T20:52:15.902 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-rados (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:15.917 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-26T20:52:16.155 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-26T20:52:16.170 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T20:52:16.187 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-logutils. 2024-04-26T20:52:16.202 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-26T20:52:16.213 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-ceph-argparse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:16.237 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-26T20:52:16.508 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-cephfs. 2024-04-26T20:52:16.515 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-26T20:52:16.522 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:52:16.529 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-26T20:52:16.574 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-26T20:52:16.574 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-cephfs (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:16.852 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-mako. 2024-04-26T20:52:16.865 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-26T20:52:16.885 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-26T20:52:16.900 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T20:52:16.901 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T20:52:16.976 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:17.221 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-26T20:52:17.236 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-26T20:52:17.271 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-26T20:52:17.346 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-prettytable. 2024-04-26T20:52:17.361 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-26T20:52:17.413 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-26T20:52:17.576 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-26T20:52:17.591 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-26T20:52:17.634 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-26T20:52:17.715 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-rbd. 2024-04-26T20:52:17.730 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:52:17.782 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-rbd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:17.904 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-webob. 2024-04-26T20:52:17.919 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-26T20:52:17.954 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-26T20:52:18.151 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-26T20:52:18.166 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-26T20:52:18.217 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T20:52:18.299 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-waitress. 2024-04-26T20:52:18.314 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-26T20:52:18.352 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T20:52:18.537 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-26T20:52:18.552 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-26T20:52:18.612 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T20:52:18.645 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-tempita. 2024-04-26T20:52:18.659 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-26T20:52:18.703 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T20:52:18.981 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-26T20:52:18.997 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-26T20:52:19.048 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T20:52:19.165 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-paste. 2024-04-26T20:52:19.180 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-26T20:52:19.223 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T20:52:19.443 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package lua5.1. 2024-04-26T20:52:19.458 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-26T20:52:19.510 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-26T20:52:19.577 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-26T20:52:19.591 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-26T20:52:19.627 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T20:52:19.845 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package lua-any. 2024-04-26T20:52:19.860 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-26T20:52:19.912 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-26T20:52:19.913 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-26T20:52:19.928 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-26T20:52:19.972 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-26T20:52:20.206 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package zip. 2024-04-26T20:52:20.221 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-26T20:52:20.273 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking zip (3.0-12build2) ... 2024-04-26T20:52:20.275 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-webtest. 2024-04-26T20:52:20.291 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-26T20:52:20.342 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-26T20:52:20.601 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package unzip. 2024-04-26T20:52:20.616 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-26T20:52:20.675 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-26T20:52:20.679 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pecan. 2024-04-26T20:52:20.694 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-26T20:52:20.729 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T20:52:21.038 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package luarocks. 2024-04-26T20:52:21.051 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-certifi. 2024-04-26T20:52:21.053 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-26T20:52:21.065 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-26T20:52:21.096 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-26T20:52:21.101 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-26T20:52:21.396 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-idna. 2024-04-26T20:52:21.411 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-26T20:52:21.454 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-26T20:52:21.494 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package librgw2. 2024-04-26T20:52:21.508 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../027-librgw2_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:52:21.552 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking librgw2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:21.799 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-urllib3. 2024-04-26T20:52:21.814 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-26T20:52:21.857 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T20:52:22.022 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-rgw. 2024-04-26T20:52:22.035 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:52:22.080 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-rgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:22.195 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-requests. 2024-04-26T20:52:22.209 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-26T20:52:22.253 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T20:52:22.433 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-26T20:52:22.447 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-26T20:52:22.491 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T20:52:22.565 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-26T20:52:22.580 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-26T20:52:22.623 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T20:52:22.810 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libradosstriper1. 2024-04-26T20:52:22.824 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:52:22.869 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libradosstriper1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:22.927 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-26T20:52:22.942 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T20:52:22.986 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:23.324 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-26T20:52:23.338 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:52:23.382 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:23.622 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-common. 2024-04-26T20:52:23.637 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:52:23.672 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:24.419 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-26T20:52:24.434 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-26T20:52:24.477 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-26T20:52:24.781 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-openssl. 2024-04-26T20:52:24.785 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-base. 2024-04-26T20:52:24.796 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-26T20:52:24.800 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:52:24.831 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-26T20:52:25.134 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr. 2024-04-26T20:52:25.149 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:52:25.192 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:25.528 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-base (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:25.580 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mon. 2024-04-26T20:52:25.595 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:52:25.629 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mon (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:26.114 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-26T20:52:26.129 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-26T20:52:26.172 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-26T20:52:26.217 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-osd. 2024-04-26T20:52:26.231 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:52:26.275 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-osd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:26.541 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-cheroot. 2024-04-26T20:52:26.556 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-26T20:52:26.608 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T20:52:27.019 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-26T20:52:27.034 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-26T20:52:27.079 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph. 2024-04-26T20:52:27.086 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-26T20:52:27.094 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../068-ceph_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:52:27.138 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:27.457 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-fuse. 2024-04-26T20:52:27.464 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-26T20:52:27.471 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:52:27.479 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-26T20:52:27.515 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:27.530 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-26T20:52:27.861 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mds. 2024-04-26T20:52:27.876 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:52:27.900 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-26T20:52:27.914 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-26T20:52:27.919 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mds (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:27.957 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-26T20:52:28.297 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package cephadm. 2024-04-26T20:52:28.302 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-tempora. 2024-04-26T20:52:28.313 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../071-cephadm_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:52:28.317 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-26T20:52:28.355 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:28.368 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-26T20:52:28.667 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-26T20:52:28.682 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-26T20:52:28.725 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-26T20:52:28.746 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-portend. 2024-04-26T20:52:28.761 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-26T20:52:28.813 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-26T20:52:29.183 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-26T20:52:29.197 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-26T20:52:29.249 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-26T20:52:29.262 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-26T20:52:29.277 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T20:52:29.329 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T20:52:29.585 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-26T20:52:29.600 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-26T20:52:29.643 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-26T20:52:30.005 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-natsort. 2024-04-26T20:52:30.020 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-26T20:52:30.063 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-26T20:52:30.309 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-babel. 2024-04-26T20:52:30.316 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T20:52:30.341 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-logutils. 2024-04-26T20:52:30.356 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-26T20:52:30.359 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T20:52:30.391 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-26T20:52:30.663 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-jinja2. 2024-04-26T20:52:30.674 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-26T20:52:30.693 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-26T20:52:30.708 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-26T20:52:30.712 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T20:52:30.752 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-26T20:52:31.049 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-26T20:52:31.058 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T20:52:31.063 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-mako. 2024-04-26T20:52:31.078 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-26T20:52:31.099 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:31.121 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T20:52:31.458 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-26T20:52:31.461 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-26T20:52:31.470 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-26T20:52:31.472 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-26T20:52:31.512 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-26T20:52:31.524 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-26T20:52:31.774 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-routes. 2024-04-26T20:52:31.782 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-26T20:52:31.815 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T20:52:31.868 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-26T20:52:31.883 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-26T20:52:31.918 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-26T20:52:32.144 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-26T20:52:32.153 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T20:52:32.153 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-webob. 2024-04-26T20:52:32.168 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-26T20:52:32.185 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:32.212 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-26T20:52:32.548 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-waitress. 2024-04-26T20:52:32.563 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-26T20:52:32.609 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T20:52:32.918 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-tempita. 2024-04-26T20:52:32.933 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-26T20:52:32.976 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T20:52:33.279 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-paste. 2024-04-26T20:52:33.294 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-26T20:52:33.337 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T20:52:33.416 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-26T20:52:33.425 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-26T20:52:33.483 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T20:52:33.649 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-26T20:52:33.663 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-26T20:52:33.706 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T20:52:33.970 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-joblib. 2024-04-26T20:52:33.979 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-26T20:52:33.992 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-26T20:52:34.007 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-26T20:52:34.022 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T20:52:34.051 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-26T20:52:34.328 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-webtest. 2024-04-26T20:52:34.343 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-26T20:52:34.374 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-26T20:52:34.378 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-26T20:52:34.383 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-26T20:52:34.510 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-26T20:52:34.622 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pecan. 2024-04-26T20:52:34.637 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-26T20:52:34.672 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T20:52:34.788 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-sklearn. 2024-04-26T20:52:34.797 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-26T20:52:34.830 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T20:52:35.010 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-certifi. 2024-04-26T20:52:35.024 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-26T20:52:35.060 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-26T20:52:35.365 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-idna. 2024-04-26T20:52:35.379 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-26T20:52:35.423 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-26T20:52:35.491 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-26T20:52:35.499 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T20:52:35.540 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:35.759 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-urllib3. 2024-04-26T20:52:35.774 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-26T20:52:35.818 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T20:52:36.138 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-requests. 2024-04-26T20:52:36.147 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-26T20:52:36.188 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T20:52:36.453 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-cachetools. 2024-04-26T20:52:36.462 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-26T20:52:36.482 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-26T20:52:36.494 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-26T20:52:36.494 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-26T20:52:36.532 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T20:52:36.778 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-26T20:52:36.781 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-26T20:52:36.787 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T20:52:36.791 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-26T20:52:36.819 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:36.831 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-26T20:52:37.174 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-26T20:52:37.186 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:52:37.224 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:37.243 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-26T20:52:37.253 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-26T20:52:37.293 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T20:52:37.527 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-26T20:52:37.537 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-26T20:52:37.577 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-26T20:52:37.605 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-rsa. 2024-04-26T20:52:37.615 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-26T20:52:37.655 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-26T20:52:37.880 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-openssl. 2024-04-26T20:52:37.893 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-26T20:52:37.938 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-26T20:52:37.976 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-google-auth. 2024-04-26T20:52:37.986 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-26T20:52:38.025 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-26T20:52:38.275 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-mgr. 2024-04-26T20:52:38.286 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:52:38.325 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-mgr (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:38.371 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-26T20:52:38.381 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-26T20:52:38.421 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T20:52:38.691 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-websocket. 2024-04-26T20:52:38.701 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-26T20:52:38.712 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-mon. 2024-04-26T20:52:38.722 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:52:38.733 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-26T20:52:38.761 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-mon (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:39.037 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-26T20:52:39.047 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-26T20:52:39.087 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T20:52:39.357 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-osd. 2024-04-26T20:52:39.368 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:52:39.407 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-osd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:39.977 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-26T20:52:39.983 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T20:52:40.027 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:40.169 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph. 2024-04-26T20:52:40.182 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../068-ceph_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:52:40.219 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:40.372 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-26T20:52:40.378 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-26T20:52:40.422 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T20:52:40.513 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-fuse. 2024-04-26T20:52:40.525 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:52:40.566 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:40.751 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-26T20:52:40.756 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T20:52:40.801 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T20:52:40.900 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-mds. 2024-04-26T20:52:40.911 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:52:40.950 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-mds (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:41.053 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package jq. 2024-04-26T20:52:41.060 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T20:52:41.095 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-26T20:52:41.332 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package socat. 2024-04-26T20:52:41.336 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package cephadm. 2024-04-26T20:52:41.338 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-26T20:52:41.347 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../071-cephadm_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:52:41.381 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-26T20:52:41.386 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:41.694 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package xmlstarlet. 2024-04-26T20:52:41.697 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-26T20:52:41.703 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-26T20:52:41.708 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-26T20:52:41.743 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-26T20:52:41.747 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-26T20:52:42.050 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-26T20:52:42.061 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T20:52:42.082 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-test. 2024-04-26T20:52:42.089 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:52:42.100 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T20:52:42.123 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-test (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:42.997 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-babel. 2024-04-26T20:52:43.008 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T20:52:43.047 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T20:52:43.342 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-jinja2. 2024-04-26T20:52:43.353 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-26T20:52:43.392 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T20:52:43.912 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-26T20:52:43.923 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T20:52:43.961 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:44.195 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-volume. 2024-04-26T20:52:44.204 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T20:52:44.245 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-volume (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:44.256 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-26T20:52:44.268 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-26T20:52:44.307 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-26T20:52:44.567 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-26T20:52:44.574 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:52:44.593 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-routes. 2024-04-26T20:52:44.604 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-26T20:52:44.616 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking cephfs-mirror (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:44.642 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T20:52:44.996 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-26T20:52:45.007 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T20:52:45.092 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-colorama. 2024-04-26T20:52:45.100 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-26T20:52:45.145 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-26T20:52:45.196 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:45.406 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package cephfs-shell. 2024-04-26T20:52:45.414 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T20:52:45.456 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking cephfs-shell (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:45.685 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package cephfs-top. 2024-04-26T20:52:45.693 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T20:52:45.726 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking cephfs-top (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:45.963 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-26T20:52:45.971 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:52:46.012 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libcephfs-dev (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:46.357 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-26T20:52:46.365 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-26T20:52:46.377 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-26T20:52:46.386 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-26T20:52:46.407 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T20:52:46.426 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T20:52:46.729 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-26T20:52:46.740 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-26T20:52:46.779 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-26T20:52:46.922 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-joblib. 2024-04-26T20:52:46.933 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-26T20:52:46.972 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T20:52:47.150 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package nvme-cli. 2024-04-26T20:52:47.158 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-26T20:52:47.200 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T20:52:47.301 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-26T20:52:47.310 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-26T20:52:47.420 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-26T20:52:47.631 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package pkg-config. 2024-04-26T20:52:47.639 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-26T20:52:47.681 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T20:52:47.723 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-sklearn. 2024-04-26T20:52:47.732 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-26T20:52:47.773 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T20:52:47.926 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-26T20:52:47.934 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-26T20:52:47.976 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-26T20:52:48.371 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-26T20:52:48.382 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-26T20:52:48.399 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-26T20:52:48.409 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T20:52:48.421 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-26T20:52:48.449 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:48.750 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pastescript. 2024-04-26T20:52:48.758 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-26T20:52:48.799 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-26T20:52:49.120 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pluggy. 2024-04-26T20:52:49.129 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-26T20:52:49.170 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-26T20:52:49.448 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-psutil. 2024-04-26T20:52:49.457 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-26T20:52:49.495 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-cachetools. 2024-04-26T20:52:49.498 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-26T20:52:49.506 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-26T20:52:49.544 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-26T20:52:49.814 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-26T20:52:49.824 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-26T20:52:49.855 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-26T20:52:49.868 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-py. 2024-04-26T20:52:49.877 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-26T20:52:49.918 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-26T20:52:50.168 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-26T20:52:50.178 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-26T20:52:50.217 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T20:52:50.481 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pygments. 2024-04-26T20:52:50.490 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-26T20:52:50.531 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T20:52:50.554 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-rsa. 2024-04-26T20:52:50.564 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-26T20:52:50.604 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-26T20:52:50.900 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-google-auth. 2024-04-26T20:52:50.910 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-26T20:52:50.950 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-26T20:52:50.968 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-26T20:52:50.977 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-26T20:52:51.010 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-26T20:52:51.245 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-26T20:52:51.254 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-26T20:52:51.286 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T20:52:51.338 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-toml. 2024-04-26T20:52:51.347 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-26T20:52:51.388 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-26T20:52:51.598 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-websocket. 2024-04-26T20:52:51.611 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-26T20:52:51.648 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-26T20:52:51.700 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pytest. 2024-04-26T20:52:51.709 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-26T20:52:51.750 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T20:52:51.943 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-26T20:52:51.954 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-26T20:52:51.985 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T20:52:52.114 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-simplejson. 2024-04-26T20:52:52.123 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-26T20:52:52.164 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-26T20:52:52.434 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-26T20:52:52.443 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-26T20:52:52.484 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-26T20:52:52.633 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-26T20:52:52.643 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T20:52:52.682 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:52.994 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-26T20:52:53.004 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-26T20:52:53.035 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T20:52:53.255 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package radosgw. 2024-04-26T20:52:53.264 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../122-radosgw_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:52:53.305 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking radosgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:53.363 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-26T20:52:53.374 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T20:52:53.413 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T20:52:53.667 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package jq. 2024-04-26T20:52:53.677 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T20:52:53.716 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-26T20:52:53.917 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package rbd-fuse. 2024-04-26T20:52:53.927 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:52:53.958 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking rbd-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:53.961 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package socat. 2024-04-26T20:52:53.972 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-26T20:52:54.011 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-26T20:52:54.241 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-26T20:52:54.306 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package xmlstarlet. 2024-04-26T20:52:54.317 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-26T20:52:54.355 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-26T20:52:54.532 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T20:52:54.658 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T20:52:54.677 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-test. 2024-04-26T20:52:54.688 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:52:54.718 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-test (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:54.916 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-26T20:52:55.330 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-26T20:52:55.993 INFO:teuthology.orchestra.run.smithi138.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-26T20:52:56.008 INFO:teuthology.orchestra.run.smithi138.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-04-26T20:52:56.102 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:56.690 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-volume. 2024-04-26T20:52:56.702 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T20:52:56.706 INFO:teuthology.orchestra.run.smithi138.stdout:Adding system user cephadm....done 2024-04-26T20:52:56.739 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-volume (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:56.861 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T20:52:57.119 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-26T20:52:57.131 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:52:57.186 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking cephfs-mirror (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:57.497 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-colorama. 2024-04-26T20:52:57.508 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-26T20:52:57.521 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-26T20:52:57.547 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-26T20:52:57.781 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-26T20:52:57.825 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package cephfs-shell. 2024-04-26T20:52:57.836 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T20:52:57.866 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking cephfs-shell (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:57.907 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-26T20:52:58.119 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package cephfs-top. 2024-04-26T20:52:58.131 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T20:52:58.169 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking cephfs-top (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:58.175 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-26T20:52:58.405 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-26T20:52:58.417 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:52:58.443 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T20:52:58.455 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libcephfs-dev (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:52:58.570 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-26T20:52:58.775 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-26T20:52:58.787 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-26T20:52:58.825 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T20:52:58.890 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T20:52:59.257 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-26T20:52:59.371 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-26T20:52:59.383 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-26T20:52:59.421 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-26T20:52:59.525 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-26T20:52:59.793 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-26T20:52:59.809 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package nvme-cli. 2024-04-26T20:52:59.823 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-26T20:52:59.867 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T20:53:00.187 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-26T20:53:00.256 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package pkg-config. 2024-04-26T20:53:00.267 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-26T20:53:00.298 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T20:53:00.431 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-26T20:53:00.517 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-26T20:53:00.528 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-26T20:53:00.567 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-26T20:53:00.681 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-26T20:53:00.949 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-26T20:53:00.987 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-26T20:53:00.999 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-26T20:53:01.037 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-26T20:53:01.226 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-ceph-argparse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:01.340 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pastescript. 2024-04-26T20:53:01.351 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-26T20:53:01.390 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-26T20:53:01.494 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T20:53:01.620 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T20:53:01.727 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pluggy. 2024-04-26T20:53:01.738 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-26T20:53:01.746 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-26T20:53:01.777 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-26T20:53:02.014 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T20:53:02.080 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-psutil. 2024-04-26T20:53:02.091 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-26T20:53:02.130 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-26T20:53:02.140 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-26T20:53:02.408 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-26T20:53:02.458 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-py. 2024-04-26T20:53:02.469 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-26T20:53:02.507 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-26T20:53:02.820 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pygments. 2024-04-26T20:53:02.832 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-26T20:53:02.834 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-26T20:53:02.864 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-26T20:53:02.869 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T20:53:02.912 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T20:53:03.013 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-26T20:53:03.299 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-26T20:53:03.310 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-26T20:53:03.365 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T20:53:03.373 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-26T20:53:03.516 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-26T20:53:03.643 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-toml. 2024-04-26T20:53:03.654 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-26T20:53:03.693 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-26T20:53:03.792 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T20:53:03.996 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pytest. 2024-04-26T20:53:04.007 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-26T20:53:04.046 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T20:53:04.085 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-26T20:53:04.350 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-simplejson. 2024-04-26T20:53:04.361 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-26T20:53:04.395 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up zip (3.0-12build2) ... 2024-04-26T20:53:04.399 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-26T20:53:04.521 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T20:53:04.661 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-26T20:53:04.673 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-26T20:53:04.702 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-26T20:53:05.215 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T20:53:05.483 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T20:53:05.515 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package radosgw. 2024-04-26T20:53:05.527 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../122-radosgw_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:53:05.565 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking radosgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:05.609 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-26T20:53:05.736 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T20:53:06.087 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-26T20:53:06.185 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package rbd-fuse. 2024-04-26T20:53:06.197 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:53:06.235 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking rbd-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:06.480 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-26T20:53:06.526 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-26T20:53:06.731 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T20:53:06.790 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T20:53:06.908 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T20:53:07.117 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T20:53:07.156 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-26T20:53:07.418 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-26T20:53:07.555 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-26T20:53:07.736 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T20:53:08.079 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-26T20:53:08.234 INFO:teuthology.orchestra.run.smithi143.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-26T20:53:08.248 INFO:teuthology.orchestra.run.smithi143.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-04-26T20:53:08.294 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:08.372 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-26T20:53:08.498 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:08.800 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-idna (3.3-1) ... 2024-04-26T20:53:08.829 INFO:teuthology.orchestra.run.smithi143.stdout:Adding system user cephadm....done 2024-04-26T20:53:08.983 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T20:53:09.143 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T20:53:09.310 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-26T20:53:09.569 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-26T20:53:09.695 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-26T20:53:09.955 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-26T20:53:10.223 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T20:53:10.349 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-26T20:53:10.367 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T20:53:10.669 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T20:53:10.676 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T20:53:10.812 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-26T20:53:11.045 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-26T20:53:11.080 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T20:53:11.206 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-26T20:53:11.305 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-26T20:53:11.332 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T20:53:11.556 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-26T20:53:11.634 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-26T20:53:11.840 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-26T20:53:11.910 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-26T20:53:12.093 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-26T20:53:12.170 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T20:53:12.296 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-26T20:53:12.361 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-26T20:53:12.606 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-26T20:53:12.745 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-26T20:53:12.891 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-26T20:53:13.004 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-ceph-argparse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:13.159 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-26T20:53:13.264 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T20:53:13.373 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T20:53:13.427 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-26T20:53:13.499 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-26T20:53:13.695 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-26T20:53:13.776 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T20:53:13.885 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-26T20:53:13.954 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T20:53:14.081 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-26T20:53:14.137 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-26T20:53:14.357 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T20:53:14.483 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T20:53:14.656 INFO:teuthology.orchestra.run.smithi143.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-26T20:53:14.785 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-26T20:53:14.934 INFO:teuthology.orchestra.run.smithi143.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-26T20:53:14.998 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T20:53:15.103 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-26T20:53:15.124 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-26T20:53:15.362 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T20:53:15.463 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-26T20:53:15.503 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T20:53:15.598 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T20:53:15.629 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-26T20:53:15.687 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-26T20:53:15.897 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T20:53:15.942 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T20:53:16.068 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T20:53:16.173 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-26T20:53:16.499 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up zip (3.0-12build2) ... 2024-04-26T20:53:16.503 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-26T20:53:16.609 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T20:53:16.771 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-26T20:53:16.889 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-26T20:53:17.157 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T20:53:17.278 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T20:53:17.283 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T20:53:17.554 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T20:53:17.634 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T20:53:17.680 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-26T20:53:17.806 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T20:53:17.944 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T20:53:18.132 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-26T20:53:18.229 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-26T20:53:18.482 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-26T20:53:18.542 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-26T20:53:18.759 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-26T20:53:18.802 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T20:53:19.035 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T20:53:19.187 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T20:53:19.303 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-26T20:53:19.488 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-26T20:53:19.665 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-26T20:53:19.798 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T20:53:19.949 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T20:53:20.157 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-26T20:53:20.302 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T20:53:20.417 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-26T20:53:20.428 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up librados2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:20.552 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:20.554 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:20.681 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-26T20:53:20.861 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-idna (3.3-1) ... 2024-04-26T20:53:21.196 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T20:53:21.351 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libcephfs2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:21.477 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libradosstriper1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:21.603 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-26T20:53:21.888 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up librbd1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:22.032 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-modules-core (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:22.158 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:22.367 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T20:53:22.367 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T20:53:22.419 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T20:53:22.663 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T20:53:22.789 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-26T20:53:23.017 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libcephfs-dev (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:23.048 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T20:53:23.168 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-rados (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:23.174 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-26T20:53:23.292 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T20:53:23.294 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up librgw2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:23.421 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up cephfs-top (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:23.547 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T20:53:23.577 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-26T20:53:23.875 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-26T20:53:24.138 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T20:53:24.264 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-26T20:53:24.582 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-26T20:53:24.835 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-rbd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:24.850 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-26T20:53:24.953 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up rbd-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:25.054 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-rgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:25.155 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-cephfs (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:25.168 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-26T20:53:25.290 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up cephfs-shell (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:25.444 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-26T20:53:25.449 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:25.737 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-26T20:53:25.961 INFO:teuthology.orchestra.run.smithi138.stdout:Adding group ceph....done 2024-04-26T20:53:26.005 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T20:53:26.131 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-26T20:53:26.313 INFO:teuthology.orchestra.run.smithi138.stdout:Adding system user ceph....done 2024-04-26T20:53:26.415 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T20:53:26.491 INFO:teuthology.orchestra.run.smithi138.stdout:Setting system user ceph properties....done 2024-04-26T20:53:26.506 INFO:teuthology.orchestra.run.smithi138.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-26T20:53:26.550 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T20:53:26.648 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-26T20:53:26.843 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-26T20:53:27.049 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-26T20:53:27.161 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-26T20:53:27.437 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T20:53:27.586 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-26T20:53:27.689 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T20:53:27.711 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up cephfs-mirror (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:27.778 INFO:teuthology.orchestra.run.smithi143.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-26T20:53:27.911 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-26T20:53:27.911 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-26T20:53:28.033 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T20:53:28.142 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T20:53:28.528 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-26T20:53:28.537 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-test (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:28.638 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up radosgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:28.795 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-26T20:53:28.921 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-26T20:53:29.164 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T20:53:29.164 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T20:53:29.181 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T20:53:29.307 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T20:53:29.642 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T20:53:29.807 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-base (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:29.951 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T20:53:30.191 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-26T20:53:30.236 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-26T20:53:30.447 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-26T20:53:30.724 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-26T20:53:30.884 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mds (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:31.000 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T20:53:31.107 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T20:53:31.108 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T20:53:31.298 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-26T20:53:31.687 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-26T20:53:31.754 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:31.965 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T20:53:31.965 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T20:53:31.980 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T20:53:32.316 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T20:53:32.442 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up librados2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:32.593 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:32.606 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-osd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:32.728 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-26T20:53:32.942 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T20:53:32.942 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T20:53:33.039 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libcephfs2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:33.190 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libradosstriper1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:33.316 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-26T20:53:33.549 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:33.601 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up librbd1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:33.675 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:33.727 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-mgr-modules-core (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:33.818 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mon (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:33.853 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:34.017 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T20:53:34.017 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T20:53:34.060 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T20:53:34.061 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T20:53:34.653 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:34.688 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libcephfs-dev (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:34.790 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-rados (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:34.796 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:34.906 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-dashboard (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:34.915 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up librgw2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:35.049 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-volume (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:35.066 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up cephfs-top (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:35.194 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T20:53:35.435 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-26T20:53:35.536 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-26T20:53:35.688 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-26T20:53:36.463 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-rbd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:36.573 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up rbd-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:36.699 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-rgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:36.826 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-cephfs (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:36.942 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-26T20:53:36.976 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up cephfs-shell (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:37.111 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:37.622 INFO:teuthology.orchestra.run.smithi143.stdout:Adding group ceph....done 2024-04-26T20:53:37.632 INFO:teuthology.orchestra.run.smithi138.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T20:53:37.637 DEBUG:teuthology.orchestra.run.smithi138:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-26T20:53:37.710 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2024-04-26T20:53:37.886 INFO:teuthology.orchestra.run.smithi138.stdout:Building dependency tree... 2024-04-26T20:53:37.887 INFO:teuthology.orchestra.run.smithi138.stdout:Reading state information... 2024-04-26T20:53:37.999 INFO:teuthology.orchestra.run.smithi143.stdout:Adding system user ceph....done 2024-04-26T20:53:38.064 INFO:teuthology.orchestra.run.smithi138.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-26T20:53:38.064 INFO:teuthology.orchestra.run.smithi138.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-26T20:53:38.064 INFO:teuthology.orchestra.run.smithi138.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-26T20:53:38.064 INFO:teuthology.orchestra.run.smithi138.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T20:53:38.064 INFO:teuthology.orchestra.run.smithi138.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T20:53:38.064 INFO:teuthology.orchestra.run.smithi138.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T20:53:38.064 INFO:teuthology.orchestra.run.smithi138.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T20:53:38.065 INFO:teuthology.orchestra.run.smithi138.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T20:53:38.065 INFO:teuthology.orchestra.run.smithi138.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T20:53:38.065 INFO:teuthology.orchestra.run.smithi138.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T20:53:38.066 INFO:teuthology.orchestra.run.smithi138.stdout:The following additional packages will be installed: 2024-04-26T20:53:38.066 INFO:teuthology.orchestra.run.smithi138.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-26T20:53:38.066 INFO:teuthology.orchestra.run.smithi138.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-26T20:53:38.066 INFO:teuthology.orchestra.run.smithi138.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-26T20:53:38.066 INFO:teuthology.orchestra.run.smithi138.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-26T20:53:38.066 INFO:teuthology.orchestra.run.smithi138.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-26T20:53:38.067 INFO:teuthology.orchestra.run.smithi138.stdout:Suggested packages: 2024-04-26T20:53:38.067 INFO:teuthology.orchestra.run.smithi138.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-26T20:53:38.068 INFO:teuthology.orchestra.run.smithi138.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-26T20:53:38.068 INFO:teuthology.orchestra.run.smithi138.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-26T20:53:38.121 INFO:teuthology.orchestra.run.smithi138.stdout:The following NEW packages will be installed: 2024-04-26T20:53:38.122 INFO:teuthology.orchestra.run.smithi138.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-26T20:53:38.122 INFO:teuthology.orchestra.run.smithi138.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-26T20:53:38.122 INFO:teuthology.orchestra.run.smithi138.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-26T20:53:38.122 INFO:teuthology.orchestra.run.smithi138.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-26T20:53:38.122 INFO:teuthology.orchestra.run.smithi138.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-26T20:53:38.122 INFO:teuthology.orchestra.run.smithi138.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-26T20:53:38.122 INFO:teuthology.orchestra.run.smithi138.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-26T20:53:38.123 INFO:teuthology.orchestra.run.smithi138.stdout:The following packages will be upgraded: 2024-04-26T20:53:38.123 INFO:teuthology.orchestra.run.smithi138.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-26T20:53:38.126 INFO:teuthology.orchestra.run.smithi143.stdout:Setting system user ceph properties....done 2024-04-26T20:53:38.141 INFO:teuthology.orchestra.run.smithi143.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-26T20:53:38.187 INFO:teuthology.orchestra.run.smithi138.stdout:4 upgraded, 39 newly installed, 0 to remove and 301 not upgraded. 2024-04-26T20:53:38.187 INFO:teuthology.orchestra.run.smithi138.stdout:Need to get 55.7 MB of archives. 2024-04-26T20:53:38.187 INFO:teuthology.orchestra.run.smithi138.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-26T20:53:38.187 INFO:teuthology.orchestra.run.smithi138.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-26T20:53:38.280 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-26T20:53:38.350 INFO:teuthology.orchestra.run.smithi138.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-26T20:53:38.355 INFO:teuthology.orchestra.run.smithi138.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-26T20:53:38.388 INFO:teuthology.orchestra.run.smithi138.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-26T20:53:38.389 INFO:teuthology.orchestra.run.smithi138.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-26T20:53:38.390 INFO:teuthology.orchestra.run.smithi138.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-26T20:53:38.398 INFO:teuthology.orchestra.run.smithi138.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-26T20:53:38.399 INFO:teuthology.orchestra.run.smithi138.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-26T20:53:38.401 INFO:teuthology.orchestra.run.smithi138.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-26T20:53:38.402 INFO:teuthology.orchestra.run.smithi138.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-26T20:53:38.403 INFO:teuthology.orchestra.run.smithi138.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-26T20:53:38.404 INFO:teuthology.orchestra.run.smithi138.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-26T20:53:38.414 INFO:teuthology.orchestra.run.smithi138.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-26T20:53:38.414 INFO:teuthology.orchestra.run.smithi138.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-26T20:53:38.435 INFO:teuthology.orchestra.run.smithi138.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-26T20:53:38.436 INFO:teuthology.orchestra.run.smithi138.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-26T20:53:38.666 INFO:teuthology.orchestra.run.smithi138.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-26T20:53:38.668 INFO:teuthology.orchestra.run.smithi138.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-26T20:53:38.668 INFO:teuthology.orchestra.run.smithi138.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-26T20:53:38.671 INFO:teuthology.orchestra.run.smithi138.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-26T20:53:38.672 INFO:teuthology.orchestra.run.smithi138.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-26T20:53:38.676 INFO:teuthology.orchestra.run.smithi138.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-26T20:53:38.678 INFO:teuthology.orchestra.run.smithi138.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-26T20:53:38.678 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-26T20:53:38.685 INFO:teuthology.orchestra.run.smithi138.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-26T20:53:38.685 INFO:teuthology.orchestra.run.smithi138.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-26T20:53:38.707 INFO:teuthology.orchestra.run.smithi138.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-26T20:53:38.708 INFO:teuthology.orchestra.run.smithi138.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-26T20:53:38.718 INFO:teuthology.orchestra.run.smithi138.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-26T20:53:38.739 INFO:teuthology.orchestra.run.smithi138.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-26T20:53:38.743 INFO:teuthology.orchestra.run.smithi138.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-26T20:53:38.743 INFO:teuthology.orchestra.run.smithi138.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-26T20:53:38.744 INFO:teuthology.orchestra.run.smithi138.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-26T20:53:38.745 INFO:teuthology.orchestra.run.smithi138.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-26T20:53:38.756 INFO:teuthology.orchestra.run.smithi138.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-26T20:53:38.758 INFO:teuthology.orchestra.run.smithi138.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-26T20:53:38.911 INFO:teuthology.orchestra.run.smithi138.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-26T20:53:38.911 INFO:teuthology.orchestra.run.smithi138.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-26T20:53:38.911 INFO:teuthology.orchestra.run.smithi138.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-26T20:53:38.912 INFO:teuthology.orchestra.run.smithi138.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-26T20:53:38.912 INFO:teuthology.orchestra.run.smithi138.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-26T20:53:38.912 INFO:teuthology.orchestra.run.smithi138.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-26T20:53:38.925 INFO:teuthology.orchestra.run.smithi138.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-26T20:53:38.926 INFO:teuthology.orchestra.run.smithi138.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-26T20:53:39.301 INFO:teuthology.orchestra.run.smithi138.stdout:Preconfiguring packages ... 2024-04-26T20:53:39.449 INFO:teuthology.orchestra.run.smithi138.stdout:Fetched 55.7 MB in 1s (70.1 MB/s) 2024-04-26T20:53:39.454 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up cephfs-mirror (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:39.645 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-26T20:53:39.646 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-26T20:53:39.736 INFO:teuthology.orchestra.run.smithi138.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140922 files and directories currently installed.) 2024-04-26T20:53:39.740 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T20:53:39.882 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T20:53:40.289 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-test (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:40.578 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-26T20:53:40.888 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up radosgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:41.411 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T20:53:41.411 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T20:53:41.654 INFO:teuthology.orchestra.run.smithi138.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-26T20:53:42.031 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-base (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:42.052 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package flex. 2024-04-26T20:53:42.123 INFO:teuthology.orchestra.run.smithi138.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140922 files and directories currently installed.) 2024-04-26T20:53:42.127 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-26T20:53:42.192 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-26T20:53:42.386 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-26T20:53:42.722 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-26T20:53:42.901 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-26T20:53:43.050 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-mds (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:43.289 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T20:53:43.290 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T20:53:43.298 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T20:53:43.828 INFO:teuthology.orchestra.run.smithi138.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140995 files and directories currently installed.) 2024-04-26T20:53:43.832 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T20:53:43.910 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-mgr (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:43.941 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T20:53:44.106 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T20:53:44.106 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T20:53:44.344 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T20:53:44.481 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T20:53:44.720 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-osd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:44.795 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-26T20:53:45.027 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T20:53:45.027 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T20:53:45.189 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package bison. 2024-04-26T20:53:45.258 INFO:teuthology.orchestra.run.smithi138.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140995 files and directories currently installed.) 2024-04-26T20:53:45.262 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-26T20:53:45.308 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-26T20:53:45.655 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:45.710 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-26T20:53:45.724 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-26T20:53:45.768 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-26T20:53:46.033 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:46.123 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package dump. 2024-04-26T20:53:46.137 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-26T20:53:46.179 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking dump (0.4b47-3) ... 2024-04-26T20:53:46.185 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-mon (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:46.401 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T20:53:46.401 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T20:53:46.432 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package indent. 2024-04-26T20:53:46.447 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-26T20:53:46.491 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-26T20:53:46.760 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-26T20:53:46.775 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-26T20:53:46.819 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-26T20:53:47.044 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-mgr-cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:47.187 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:47.198 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-26T20:53:47.213 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-26T20:53:47.281 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-26T20:53:47.313 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-mgr-dashboard (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:47.456 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-volume (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:53:47.526 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-26T20:53:47.541 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-26T20:53:47.584 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-26T20:53:47.817 INFO:teuthology.orchestra.run.smithi143.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-26T20:53:47.913 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-26T20:53:47.926 INFO:teuthology.orchestra.run.smithi143.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-26T20:53:47.928 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-26T20:53:47.971 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-26T20:53:48.120 INFO:teuthology.orchestra.run.smithi143.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-26T20:53:48.290 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-26T20:53:48.306 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-26T20:53:48.348 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-26T20:53:48.618 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libjson-perl. 2024-04-26T20:53:48.632 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-26T20:53:48.668 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-26T20:53:48.954 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-26T20:53:48.969 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-26T20:53:49.004 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-26T20:53:49.263 INFO:teuthology.orchestra.run.smithi143.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-26T20:53:49.937 INFO:teuthology.orchestra.run.smithi143.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T20:53:49.941 DEBUG:teuthology.orchestra.run.smithi143:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-26T20:53:50.014 INFO:teuthology.orchestra.run.smithi143.stdout:Reading package lists... 2024-04-26T20:53:50.190 INFO:teuthology.orchestra.run.smithi143.stdout:Building dependency tree... 2024-04-26T20:53:50.191 INFO:teuthology.orchestra.run.smithi143.stdout:Reading state information... 2024-04-26T20:53:50.323 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-26T20:53:50.339 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-26T20:53:50.363 INFO:teuthology.orchestra.run.smithi143.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-26T20:53:50.364 INFO:teuthology.orchestra.run.smithi143.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-26T20:53:50.364 INFO:teuthology.orchestra.run.smithi143.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-26T20:53:50.364 INFO:teuthology.orchestra.run.smithi143.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T20:53:50.364 INFO:teuthology.orchestra.run.smithi143.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T20:53:50.364 INFO:teuthology.orchestra.run.smithi143.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T20:53:50.364 INFO:teuthology.orchestra.run.smithi143.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T20:53:50.365 INFO:teuthology.orchestra.run.smithi143.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T20:53:50.365 INFO:teuthology.orchestra.run.smithi143.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T20:53:50.365 INFO:teuthology.orchestra.run.smithi143.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T20:53:50.365 INFO:teuthology.orchestra.run.smithi143.stdout:The following additional packages will be installed: 2024-04-26T20:53:50.365 INFO:teuthology.orchestra.run.smithi143.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-26T20:53:50.365 INFO:teuthology.orchestra.run.smithi143.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-26T20:53:50.366 INFO:teuthology.orchestra.run.smithi143.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-26T20:53:50.366 INFO:teuthology.orchestra.run.smithi143.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-26T20:53:50.366 INFO:teuthology.orchestra.run.smithi143.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-26T20:53:50.367 INFO:teuthology.orchestra.run.smithi143.stdout:Suggested packages: 2024-04-26T20:53:50.367 INFO:teuthology.orchestra.run.smithi143.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-26T20:53:50.367 INFO:teuthology.orchestra.run.smithi143.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-26T20:53:50.367 INFO:teuthology.orchestra.run.smithi143.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-26T20:53:50.381 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T20:53:50.420 INFO:teuthology.orchestra.run.smithi143.stdout:The following NEW packages will be installed: 2024-04-26T20:53:50.421 INFO:teuthology.orchestra.run.smithi143.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-26T20:53:50.421 INFO:teuthology.orchestra.run.smithi143.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-26T20:53:50.422 INFO:teuthology.orchestra.run.smithi143.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-26T20:53:50.422 INFO:teuthology.orchestra.run.smithi143.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-26T20:53:50.422 INFO:teuthology.orchestra.run.smithi143.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-26T20:53:50.422 INFO:teuthology.orchestra.run.smithi143.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-26T20:53:50.422 INFO:teuthology.orchestra.run.smithi143.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-26T20:53:50.423 INFO:teuthology.orchestra.run.smithi143.stdout:The following packages will be upgraded: 2024-04-26T20:53:50.424 INFO:teuthology.orchestra.run.smithi143.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-26T20:53:50.651 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-26T20:53:50.667 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-26T20:53:50.676 INFO:teuthology.orchestra.run.smithi143.stdout:4 upgraded, 39 newly installed, 0 to remove and 301 not upgraded. 2024-04-26T20:53:50.676 INFO:teuthology.orchestra.run.smithi143.stdout:Need to get 55.7 MB of archives. 2024-04-26T20:53:50.676 INFO:teuthology.orchestra.run.smithi143.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-26T20:53:50.676 INFO:teuthology.orchestra.run.smithi143.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-26T20:53:50.710 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T20:53:51.012 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-26T20:53:51.028 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-26T20:53:51.070 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T20:53:51.322 INFO:teuthology.orchestra.run.smithi143.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-26T20:53:51.339 INFO:teuthology.orchestra.run.smithi143.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-26T20:53:51.365 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-26T20:53:51.381 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-26T20:53:51.415 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-26T20:53:51.465 INFO:teuthology.orchestra.run.smithi143.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-26T20:53:51.465 INFO:teuthology.orchestra.run.smithi143.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-26T20:53:51.467 INFO:teuthology.orchestra.run.smithi143.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-26T20:53:51.496 INFO:teuthology.orchestra.run.smithi143.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-26T20:53:51.496 INFO:teuthology.orchestra.run.smithi143.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-26T20:53:51.500 INFO:teuthology.orchestra.run.smithi143.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-26T20:53:51.502 INFO:teuthology.orchestra.run.smithi143.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-26T20:53:51.503 INFO:teuthology.orchestra.run.smithi143.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-26T20:53:51.669 INFO:teuthology.orchestra.run.smithi143.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-26T20:53:51.735 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-26T20:53:51.751 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-26T20:53:51.793 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-26T20:53:51.949 INFO:teuthology.orchestra.run.smithi143.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-26T20:53:51.959 INFO:teuthology.orchestra.run.smithi143.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-26T20:53:51.965 INFO:teuthology.orchestra.run.smithi143.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-26T20:53:52.053 INFO:teuthology.orchestra.run.smithi143.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-26T20:53:52.531 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-26T20:53:52.547 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-26T20:53:52.589 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T20:53:52.900 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-26T20:53:52.916 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-26T20:53:52.958 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T20:53:53.022 INFO:teuthology.orchestra.run.smithi143.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-26T20:53:53.023 INFO:teuthology.orchestra.run.smithi143.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-26T20:53:53.024 INFO:teuthology.orchestra.run.smithi143.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-26T20:53:53.050 INFO:teuthology.orchestra.run.smithi143.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-26T20:53:53.050 INFO:teuthology.orchestra.run.smithi143.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-26T20:53:53.055 INFO:teuthology.orchestra.run.smithi143.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-26T20:53:53.220 INFO:teuthology.orchestra.run.smithi143.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-26T20:53:53.253 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-26T20:53:53.269 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-26T20:53:53.311 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T20:53:53.589 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-26T20:53:53.605 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-26T20:53:53.647 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T20:53:54.084 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-26T20:53:54.099 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-26T20:53:54.142 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-26T20:53:54.441 INFO:teuthology.orchestra.run.smithi143.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-26T20:53:54.447 INFO:teuthology.orchestra.run.smithi143.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-26T20:53:54.470 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package modemmanager. 2024-04-26T20:53:54.485 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-26T20:53:54.528 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T20:53:55.168 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package network-manager. 2024-04-26T20:53:55.184 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-26T20:53:55.234 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-26T20:53:55.834 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ppp. 2024-04-26T20:53:55.850 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-26T20:53:56.216 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-26T20:53:56.530 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package pptp-linux. 2024-04-26T20:53:56.544 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-26T20:53:56.588 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-26T20:53:56.841 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-26T20:53:56.855 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-26T20:53:56.899 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-26T20:53:57.194 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-26T20:53:57.209 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-26T20:53:57.244 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking postgresql-client-common (238) ... 2024-04-26T20:53:57.566 INFO:teuthology.orchestra.run.smithi143.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-26T20:53:57.570 INFO:teuthology.orchestra.run.smithi143.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-26T20:53:57.658 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-26T20:53:57.673 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-26T20:53:57.716 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T20:53:57.925 INFO:teuthology.orchestra.run.smithi143.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-26T20:53:58.313 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package postgresql-common. 2024-04-26T20:53:58.328 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-26T20:53:58.390 INFO:teuthology.orchestra.run.smithi138.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-26T20:53:58.420 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking postgresql-common (238) ... 2024-04-26T20:53:58.887 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package postgresql-14. 2024-04-26T20:53:58.901 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-26T20:53:58.948 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T20:54:00.098 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package postgresql. 2024-04-26T20:54:00.113 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-26T20:54:00.156 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking postgresql (14+238) ... 2024-04-26T20:54:00.400 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package postgresql-client. 2024-04-26T20:54:00.414 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-26T20:54:00.458 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking postgresql-client (14+238) ... 2024-04-26T20:54:00.710 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-26T20:54:00.725 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-26T20:54:00.760 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-26T20:54:01.038 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package tcl8.6. 2024-04-26T20:54:01.052 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-26T20:54:01.096 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-26T20:54:01.382 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package tcl. 2024-04-26T20:54:01.397 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-26T20:54:01.445 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-26T20:54:01.810 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package wpasupplicant. 2024-04-26T20:54:01.826 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-26T20:54:01.868 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-26T20:54:02.066 INFO:teuthology.orchestra.run.smithi143.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-26T20:54:02.197 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-26T20:54:02.212 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-26T20:54:02.247 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-26T20:54:02.634 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-26T20:54:02.648 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-26T20:54:02.700 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-26T20:54:02.935 INFO:teuthology.orchestra.run.smithi143.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-26T20:54:02.958 INFO:teuthology.orchestra.run.smithi143.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-26T20:54:02.976 INFO:teuthology.orchestra.run.smithi143.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-26T20:54:02.995 INFO:teuthology.orchestra.run.smithi143.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-26T20:54:03.018 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up postgresql-client-common (238) ... 2024-04-26T20:54:03.231 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-26T20:54:03.357 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-26T20:54:03.483 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T20:54:03.618 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-26T20:54:03.643 INFO:teuthology.orchestra.run.smithi143.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-26T20:54:03.719 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-26T20:54:03.862 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T20:54:04.154 INFO:teuthology.orchestra.run.smithi143.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-26T20:54:04.840 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-26T20:54:04.942 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-26T20:54:05.354 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-26T20:54:05.354 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-26T20:54:06.079 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-26T20:54:06.204 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-26T20:54:06.355 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T20:54:06.481 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-26T20:54:06.607 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-26T20:54:06.742 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-26T20:54:06.868 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-26T20:54:06.985 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-26T20:54:08.124 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-26T20:54:08.250 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up dump (0.4b47-3) ... 2024-04-26T20:54:08.345 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-26T20:54:08.402 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T20:54:08.511 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-26T20:54:08.671 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-26T20:54:08.797 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-26T20:54:08.923 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-26T20:54:09.012 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-26T20:54:09.074 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-26T20:54:09.200 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-26T20:54:09.385 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-26T20:54:09.503 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T20:54:09.612 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-26T20:54:09.813 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up postgresql-client (14+238) ... 2024-04-26T20:54:09.939 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-26T20:54:10.553 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:54:10.553 INFO:teuthology.orchestra.run.smithi138.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-26T20:54:10.554 INFO:teuthology.orchestra.run.smithi138.stdout:which means they are currently configured by ifupdown: 2024-04-26T20:54:10.554 INFO:teuthology.orchestra.run.smithi138.stdout:- enp3s0f1 2024-04-26T20:54:10.554 INFO:teuthology.orchestra.run.smithi138.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-26T20:54:10.554 INFO:teuthology.orchestra.run.smithi138.stdout:remove their configuration from /etc/network/interfaces. 2024-04-26T20:54:10.554 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:54:10.685 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-26T20:54:11.090 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-26T20:54:11.508 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-26T20:54:12.291 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T20:54:12.435 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-26T20:54:12.561 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-26T20:54:12.687 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up postgresql-common (238) ... 2024-04-26T20:54:13.655 INFO:teuthology.orchestra.run.smithi138.stdout:Adding user postgres to group ssl-cert 2024-04-26T20:54:13.901 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:54:13.902 INFO:teuthology.orchestra.run.smithi138.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-26T20:54:14.172 INFO:teuthology.orchestra.run.smithi138.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-26T20:54:14.172 INFO:teuthology.orchestra.run.smithi138.stdout:Removing obsolete dictionary files: 2024-04-26T20:54:14.938 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-26T20:54:15.547 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T20:54:15.881 INFO:teuthology.orchestra.run.smithi138.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-26T20:54:15.904 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-26T20:54:15.956 INFO:teuthology.orchestra.run.smithi138.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-26T20:54:15.956 INFO:teuthology.orchestra.run.smithi138.stdout:This user must also own the server process. 2024-04-26T20:54:15.957 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:54:15.957 INFO:teuthology.orchestra.run.smithi138.stdout:The database cluster will be initialized with locale "en_US". 2024-04-26T20:54:15.957 INFO:teuthology.orchestra.run.smithi138.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-26T20:54:15.957 INFO:teuthology.orchestra.run.smithi138.stdout:The default text search configuration will be set to "english". 2024-04-26T20:54:15.957 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:54:15.957 INFO:teuthology.orchestra.run.smithi138.stdout:Data page checksums are disabled. 2024-04-26T20:54:15.957 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:54:15.957 INFO:teuthology.orchestra.run.smithi138.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-26T20:54:15.958 INFO:teuthology.orchestra.run.smithi138.stdout:creating subdirectories ... ok 2024-04-26T20:54:15.958 INFO:teuthology.orchestra.run.smithi138.stdout:selecting dynamic shared memory implementation ... posix 2024-04-26T20:54:15.981 INFO:teuthology.orchestra.run.smithi138.stdout:selecting default max_connections ... 100 2024-04-26T20:54:16.014 INFO:teuthology.orchestra.run.smithi138.stdout:selecting default shared_buffers ... 128MB 2024-04-26T20:54:16.029 INFO:teuthology.orchestra.run.smithi138.stdout:selecting default time zone ... Etc/UTC 2024-04-26T20:54:16.030 INFO:teuthology.orchestra.run.smithi138.stdout:creating configuration files ... ok 2024-04-26T20:54:16.194 INFO:teuthology.orchestra.run.smithi138.stdout:running bootstrap script ... ok 2024-04-26T20:54:16.828 INFO:teuthology.orchestra.run.smithi138.stdout:performing post-bootstrap initialization ... ok 2024-04-26T20:54:17.415 INFO:teuthology.orchestra.run.smithi138.stdout:syncing data to disk ... ok 2024-04-26T20:54:17.958 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-26T20:54:20.912 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T20:54:21.030 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-26T20:54:21.156 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up postgresql (14+238) ... 2024-04-26T20:54:21.307 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T20:54:21.433 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T20:54:21.711 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-26T20:54:21.712 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-26T20:54:22.494 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-26T20:54:22.594 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-26T20:54:22.896 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-26T20:54:23.048 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-26T20:54:24.501 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-26T20:54:24.618 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-26T20:54:25.177 INFO:teuthology.orchestra.run.smithi138.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T20:54:25.184 DEBUG:teuthology.parallel:result is None 2024-04-26T20:54:47.351 INFO:teuthology.orchestra.run.smithi143.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-26T20:54:47.374 INFO:teuthology.orchestra.run.smithi143.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-26T20:54:47.399 INFO:teuthology.orchestra.run.smithi143.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-26T20:54:47.413 INFO:teuthology.orchestra.run.smithi143.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-26T20:54:47.452 INFO:teuthology.orchestra.run.smithi143.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-26T20:54:47.455 INFO:teuthology.orchestra.run.smithi143.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-26T20:54:51.329 INFO:teuthology.orchestra.run.smithi143.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-26T20:54:51.484 INFO:teuthology.orchestra.run.smithi143.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-26T20:54:52.003 INFO:teuthology.orchestra.run.smithi143.stdout:Preconfiguring packages ... 2024-04-26T20:54:52.172 INFO:teuthology.orchestra.run.smithi143.stdout:Fetched 55.7 MB in 1min 1s (911 kB/s) 2024-04-26T20:54:52.460 INFO:teuthology.orchestra.run.smithi143.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140922 files and directories currently installed.) 2024-04-26T20:54:52.464 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T20:54:52.614 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T20:54:53.256 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-26T20:54:54.352 INFO:teuthology.orchestra.run.smithi143.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-26T20:54:54.579 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package flex. 2024-04-26T20:54:54.651 INFO:teuthology.orchestra.run.smithi143.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140922 files and directories currently installed.) 2024-04-26T20:54:54.655 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-26T20:54:54.694 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-26T20:54:55.214 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-26T20:54:55.392 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-26T20:54:55.782 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T20:54:56.295 INFO:teuthology.orchestra.run.smithi143.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140995 files and directories currently installed.) 2024-04-26T20:54:56.299 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T20:54:56.426 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T20:54:56.797 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T20:54:56.916 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T20:54:57.240 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-26T20:54:57.592 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package bison. 2024-04-26T20:54:57.667 INFO:teuthology.orchestra.run.smithi143.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140995 files and directories currently installed.) 2024-04-26T20:54:57.671 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-26T20:54:57.711 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-26T20:54:58.112 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-26T20:54:58.127 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-26T20:54:58.171 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-26T20:54:58.491 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package dump. 2024-04-26T20:54:58.506 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-26T20:54:58.549 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking dump (0.4b47-3) ... 2024-04-26T20:54:58.845 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package indent. 2024-04-26T20:54:58.861 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-26T20:54:58.903 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-26T20:54:59.181 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-26T20:54:59.197 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-26T20:54:59.239 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-26T20:54:59.577 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-26T20:54:59.593 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-26T20:54:59.635 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-26T20:54:59.871 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-26T20:54:59.887 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-26T20:54:59.921 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-26T20:55:00.242 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-26T20:55:00.257 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-26T20:55:00.300 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-26T20:55:00.586 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-26T20:55:00.602 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-26T20:55:00.644 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-26T20:55:00.872 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libjson-perl. 2024-04-26T20:55:00.888 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-26T20:55:00.922 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-26T20:55:01.184 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-26T20:55:01.200 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-26T20:55:01.242 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-26T20:55:02.604 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-26T20:55:02.620 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-26T20:55:02.662 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T20:55:02.906 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-26T20:55:02.921 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-26T20:55:02.956 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T20:55:03.226 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-26T20:55:03.242 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-26T20:55:03.284 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T20:55:03.629 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-26T20:55:03.645 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-26T20:55:03.687 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-26T20:55:03.991 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-26T20:55:04.006 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-26T20:55:04.040 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-26T20:55:04.394 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-26T20:55:04.410 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-26T20:55:04.444 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T20:55:04.764 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-26T20:55:04.780 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-26T20:55:04.822 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T20:55:05.117 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-26T20:55:05.133 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-26T20:55:05.175 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T20:55:05.413 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-26T20:55:05.428 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-26T20:55:05.471 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T20:55:05.958 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-26T20:55:05.972 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-26T20:55:06.016 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-26T20:55:06.369 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package modemmanager. 2024-04-26T20:55:06.384 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-26T20:55:06.418 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T20:55:07.033 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package network-manager. 2024-04-26T20:55:07.049 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-26T20:55:07.099 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-26T20:55:07.665 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ppp. 2024-04-26T20:55:07.680 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-26T20:55:08.040 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-26T20:55:08.378 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package pptp-linux. 2024-04-26T20:55:08.392 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-26T20:55:08.436 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-26T20:55:08.689 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-26T20:55:08.703 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-26T20:55:08.747 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-26T20:55:09.050 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-26T20:55:09.064 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-26T20:55:09.108 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking postgresql-client-common (238) ... 2024-04-26T20:55:09.378 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-26T20:55:09.393 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-26T20:55:09.436 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T20:55:10.016 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package postgresql-common. 2024-04-26T20:55:10.031 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-26T20:55:10.092 INFO:teuthology.orchestra.run.smithi143.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-26T20:55:10.122 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking postgresql-common (238) ... 2024-04-26T20:55:10.556 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package postgresql-14. 2024-04-26T20:55:10.571 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-26T20:55:10.617 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T20:55:11.638 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package postgresql. 2024-04-26T20:55:11.653 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-26T20:55:11.699 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking postgresql (14+238) ... 2024-04-26T20:55:11.943 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package postgresql-client. 2024-04-26T20:55:11.958 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-26T20:55:12.018 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking postgresql-client (14+238) ... 2024-04-26T20:55:12.254 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-26T20:55:12.268 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-26T20:55:12.312 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-26T20:55:12.614 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package tcl8.6. 2024-04-26T20:55:12.629 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-26T20:55:12.672 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-26T20:55:12.950 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package tcl. 2024-04-26T20:55:12.966 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-26T20:55:13.013 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-26T20:55:13.361 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package wpasupplicant. 2024-04-26T20:55:13.377 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-26T20:55:13.419 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-26T20:55:13.748 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-26T20:55:13.764 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-26T20:55:13.806 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-26T20:55:14.168 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-26T20:55:14.184 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-26T20:55:14.235 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-26T20:55:14.512 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up postgresql-client-common (238) ... 2024-04-26T20:55:14.723 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-26T20:55:14.849 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-26T20:55:14.975 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T20:55:15.093 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-26T20:55:15.202 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-26T20:55:15.303 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T20:55:16.286 INFO:teuthology.orchestra.run.smithi143.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-26T20:55:16.383 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-26T20:55:16.761 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-26T20:55:16.761 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-26T20:55:17.478 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-26T20:55:17.587 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-26T20:55:17.696 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T20:55:17.797 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-26T20:55:18.231 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-26T20:55:18.357 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-26T20:55:18.483 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-26T20:55:18.609 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-26T20:55:19.239 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-26T20:55:19.365 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up dump (0.4b47-3) ... 2024-04-26T20:55:19.460 INFO:teuthology.orchestra.run.smithi143.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-26T20:55:19.516 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T20:55:19.642 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-26T20:55:19.768 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-26T20:55:19.894 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-26T20:55:20.020 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-26T20:55:20.110 INFO:teuthology.orchestra.run.smithi143.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-26T20:55:20.171 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-26T20:55:20.298 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-26T20:55:20.474 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-26T20:55:20.599 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T20:55:20.725 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-26T20:55:20.876 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up postgresql-client (14+238) ... 2024-04-26T20:55:21.011 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-26T20:55:21.591 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:55:21.591 INFO:teuthology.orchestra.run.smithi143.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-26T20:55:21.591 INFO:teuthology.orchestra.run.smithi143.stdout:which means they are currently configured by ifupdown: 2024-04-26T20:55:21.592 INFO:teuthology.orchestra.run.smithi143.stdout:- enp3s0f1 2024-04-26T20:55:21.592 INFO:teuthology.orchestra.run.smithi143.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-26T20:55:21.592 INFO:teuthology.orchestra.run.smithi143.stdout:remove their configuration from /etc/network/interfaces. 2024-04-26T20:55:21.592 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:55:21.723 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-26T20:55:22.129 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-26T20:55:22.537 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-26T20:55:23.222 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T20:55:23.381 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-26T20:55:23.507 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-26T20:55:23.633 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up postgresql-common (238) ... 2024-04-26T20:55:24.595 INFO:teuthology.orchestra.run.smithi143.stdout:Adding user postgres to group ssl-cert 2024-04-26T20:55:24.939 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:55:24.939 INFO:teuthology.orchestra.run.smithi143.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-26T20:55:25.179 INFO:teuthology.orchestra.run.smithi143.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-26T20:55:25.180 INFO:teuthology.orchestra.run.smithi143.stdout:Removing obsolete dictionary files: 2024-04-26T20:55:25.904 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-26T20:55:26.367 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T20:55:26.707 INFO:teuthology.orchestra.run.smithi143.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-26T20:55:26.737 INFO:teuthology.orchestra.run.smithi143.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-26T20:55:26.780 INFO:teuthology.orchestra.run.smithi143.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-26T20:55:26.780 INFO:teuthology.orchestra.run.smithi143.stdout:This user must also own the server process. 2024-04-26T20:55:26.780 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:55:26.780 INFO:teuthology.orchestra.run.smithi143.stdout:The database cluster will be initialized with locale "en_US". 2024-04-26T20:55:26.780 INFO:teuthology.orchestra.run.smithi143.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-26T20:55:26.780 INFO:teuthology.orchestra.run.smithi143.stdout:The default text search configuration will be set to "english". 2024-04-26T20:55:26.780 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:55:26.780 INFO:teuthology.orchestra.run.smithi143.stdout:Data page checksums are disabled. 2024-04-26T20:55:26.780 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:55:26.781 INFO:teuthology.orchestra.run.smithi143.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-26T20:55:26.781 INFO:teuthology.orchestra.run.smithi143.stdout:creating subdirectories ... ok 2024-04-26T20:55:26.781 INFO:teuthology.orchestra.run.smithi143.stdout:selecting dynamic shared memory implementation ... posix 2024-04-26T20:55:26.804 INFO:teuthology.orchestra.run.smithi143.stdout:selecting default max_connections ... 100 2024-04-26T20:55:26.838 INFO:teuthology.orchestra.run.smithi143.stdout:selecting default shared_buffers ... 128MB 2024-04-26T20:55:26.852 INFO:teuthology.orchestra.run.smithi143.stdout:selecting default time zone ... Etc/UTC 2024-04-26T20:55:26.853 INFO:teuthology.orchestra.run.smithi143.stdout:creating configuration files ... ok 2024-04-26T20:55:27.017 INFO:teuthology.orchestra.run.smithi143.stdout:running bootstrap script ... ok 2024-04-26T20:55:27.649 INFO:teuthology.orchestra.run.smithi143.stdout:performing post-bootstrap initialization ... ok 2024-04-26T20:55:28.175 INFO:teuthology.orchestra.run.smithi143.stdout:syncing data to disk ... ok 2024-04-26T20:55:28.689 INFO:teuthology.orchestra.run.smithi143.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-26T20:55:31.741 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T20:55:31.850 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-26T20:55:31.976 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up postgresql (14+238) ... 2024-04-26T20:55:32.127 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T20:55:32.253 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T20:55:32.531 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-26T20:55:32.531 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-26T20:55:33.297 INFO:teuthology.orchestra.run.smithi143.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-26T20:55:33.389 INFO:teuthology.orchestra.run.smithi143.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-26T20:55:33.708 INFO:teuthology.orchestra.run.smithi143.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-26T20:55:33.851 INFO:teuthology.orchestra.run.smithi143.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-26T20:55:35.253 INFO:teuthology.orchestra.run.smithi143.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-26T20:55:35.344 INFO:teuthology.orchestra.run.smithi143.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-26T20:55:35.894 INFO:teuthology.orchestra.run.smithi143.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T20:55:35.901 DEBUG:teuthology.parallel:result is None 2024-04-26T20:55:35.901 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T20:55:36.040 DEBUG:teuthology.orchestra.run.smithi138:> dpkg-query -W -f '${Version}' ceph 2024-04-26T20:55:36.064 INFO:teuthology.orchestra.run.smithi138.stdout:19.0.0-3306-gbc612ffb-1jammy 2024-04-26T20:55:36.064 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3306-gbc612ffb-1jammy 2024-04-26T20:55:36.064 INFO:teuthology.task.install:The correct ceph version 19.0.0-3306-gbc612ffb-1jammy is installed. 2024-04-26T20:55:36.066 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T20:55:36.391 DEBUG:teuthology.orchestra.run.smithi143:> dpkg-query -W -f '${Version}' ceph 2024-04-26T20:55:36.413 INFO:teuthology.orchestra.run.smithi143.stdout:19.0.0-3306-gbc612ffb-1jammy 2024-04-26T20:55:36.413 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3306-gbc612ffb-1jammy 2024-04-26T20:55:36.413 INFO:teuthology.task.install:The correct ceph version 19.0.0-3306-gbc612ffb-1jammy is installed. 2024-04-26T20:55:36.415 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-26T20:55:36.415 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-26T20:55:36.415 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T20:55:36.437 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T20:55:36.437 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T20:55:36.478 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-26T20:55:36.479 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-26T20:55:36.479 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T20:55:36.500 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T20:55:36.561 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T20:55:36.561 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T20:55:36.580 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T20:55:36.646 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-26T20:55:36.646 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-26T20:55:36.646 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T20:55:36.667 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T20:55:36.734 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T20:55:36.734 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T20:55:36.753 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T20:55:36.817 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-26T20:55:36.818 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-26T20:55:36.818 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T20:55:36.839 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T20:55:36.901 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T20:55:36.901 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T20:55:36.920 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T20:55:36.986 INFO:teuthology.run_tasks:Running task ceph... 2024-04-26T20:55:37.081 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-26T20:55:37.081 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 777 /var/log/ceph 2024-04-26T20:55:37.084 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 777 /var/log/ceph 2024-04-26T20:55:37.103 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-26T20:55:37.103 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T20:55:37.148 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T20:55:37.169 INFO:tasks.ceph:Creating extra log directories... 2024-04-26T20:55:37.170 DEBUG:teuthology.orchestra.run.smithi138:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T20:55:37.213 DEBUG:teuthology.orchestra.run.smithi143:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T20:55:37.238 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-26T20:55:37.239 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-26T20:55:37.239 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-26T20:55:37.239 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-26T20:55:37.239 DEBUG:teuthology.orchestra.run.smithi138:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-26T20:55:37.282 DEBUG:teuthology.orchestra.run.smithi138:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-26T20:55:37.374 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T20:55:37.374 DEBUG:teuthology.orchestra.run.smithi143:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-26T20:55:37.382 DEBUG:teuthology.orchestra.run.smithi143:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-26T20:55:37.475 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-26T20:55:37.475 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'bad backtrace', 'object missing on disk', 'error reading table object', 'error reading sessionmap', 'unmatched fragstat', 'unmatched rstat', 'was unreadable, recreating it now', 'Scrub error on inode', 'Metadata damage detected', 'MDS_FAILED', 'MDS_DAMAGE'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-26T20:55:37.476 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675178', 'branch': 'wip-rishabh-testing-20240426.111959', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/alternate-pool}', 'email': None, 'first_in_suite': False, 'job_id': '7675178', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-testing-20240426.111959'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'bad backtrace', 'object missing on disk', 'error reading table object', 'error reading sessionmap', 'unmatched fragstat', 'unmatched rstat', 'was unreadable, recreating it now', 'Scrub error on inode', 'Metadata damage detected', 'MDS_FAILED', 'MDS_DAMAGE'], 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}}, 'kclient': {'syntax': 'v2'}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-testing-20240426.111959', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 816, 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'sleep_before_teardown': 0, 'subset': '166/512', 'suite': 'fs', 'suite_branch': 'wip-rishabh-testing-20240426.111959', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi138.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGvKzFpf2CeNwdh4s2cQvmSlP5LKGMHurBQuxvyytt7suRwDDpprTNZHn7H6mqdvjq1qg5RrQb7TmmQDsWEBMkk=', 'smithi143.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLU7D57Kk9pW/kWJTFBPeov+OzKWsZpqROP7lwjKFlyX1FfEkkpGYAwXZxi0FusPFF/G3wFBKiEA8xDgJSun2G8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'bad backtrace', 'object missing on disk', 'error reading table object', 'error reading sessionmap', 'unmatched fragstat', 'unmatched rstat', 'was unreadable, recreating it now', 'Scrub error on inode', 'Metadata damage detected', 'MDS_FAILED', 'MDS_DAMAGE'], 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_recovery_pool']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-26_19:30:57', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-26T20:55:37.476 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T20:55:37.479 DEBUG:teuthology.orchestra.run.smithi143:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T20:55:37.488 DEBUG:teuthology.orchestra.run.smithi138:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T20:55:37.528 DEBUG:teuthology.orchestra.run.smithi143:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T20:55:37.551 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-26T20:55:37.551 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T20:55:37.602 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T20:55:37.602 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_1 2024-04-26T20:55:37.658 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T20:55:37.658 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T20:55:37.658 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 6h/6d Inode: 885 Links: 1 2024-04-26T20:55:37.658 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T20:55:37.658 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-04-26 20:47:55.897868243 +0000 2024-04-26T20:55:37.658 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-04-26 20:47:55.629870638 +0000 2024-04-26T20:55:37.658 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-04-26 20:47:55.629870638 +0000 2024-04-26T20:55:37.658 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: 2024-04-26 20:47:55.629870638 +0000 2024-04-26T20:55:37.659 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T20:55:37.720 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-04-26T20:55:37.720 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-04-26T20:55:37.720 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000394798 s, 1.3 MB/s 2024-04-26T20:55:37.722 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T20:55:37.775 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_2 2024-04-26T20:55:37.826 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T20:55:37.826 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T20:55:37.826 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 6h/6d Inode: 901 Links: 1 2024-04-26T20:55:37.826 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T20:55:37.826 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-04-26 20:47:56.429863493 +0000 2024-04-26T20:55:37.826 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-04-26 20:47:56.161865885 +0000 2024-04-26T20:55:37.826 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-04-26 20:47:56.161865885 +0000 2024-04-26T20:55:37.827 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: 2024-04-26 20:47:56.161865885 +0000 2024-04-26T20:55:37.827 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T20:55:37.889 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-04-26T20:55:37.889 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-04-26T20:55:37.890 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000653393 s, 784 kB/s 2024-04-26T20:55:37.892 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T20:55:37.948 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_3 2024-04-26T20:55:38.002 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T20:55:38.002 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T20:55:38.002 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 6h/6d Inode: 917 Links: 1 2024-04-26T20:55:38.002 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T20:55:38.003 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-04-26 20:47:56.985858526 +0000 2024-04-26T20:55:38.003 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-04-26 20:47:56.729860813 +0000 2024-04-26T20:55:38.003 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-04-26 20:47:56.729860813 +0000 2024-04-26T20:55:38.003 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: 2024-04-26 20:47:56.729860813 +0000 2024-04-26T20:55:38.003 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T20:55:38.064 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-04-26T20:55:38.064 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-04-26T20:55:38.064 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000380991 s, 1.3 MB/s 2024-04-26T20:55:38.066 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T20:55:38.120 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_4 2024-04-26T20:55:38.170 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T20:55:38.170 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T20:55:38.170 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 6h/6d Inode: 936 Links: 1 2024-04-26T20:55:38.170 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T20:55:38.170 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-04-26 20:47:57.301855703 +0000 2024-04-26T20:55:38.170 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-04-26 20:47:57.297855739 +0000 2024-04-26T20:55:38.170 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-04-26 20:47:57.297855739 +0000 2024-04-26T20:55:38.170 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: 2024-04-26 20:47:57.297855739 +0000 2024-04-26T20:55:38.171 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T20:55:38.233 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-04-26T20:55:38.233 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-04-26T20:55:38.233 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000397823 s, 1.3 MB/s 2024-04-26T20:55:38.235 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T20:55:38.288 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T20:55:38.288 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T20:55:38.288 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T20:55:38.297 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T20:55:38.297 DEBUG:teuthology.orchestra.run.smithi143:> stat /dev/vg_nvme/lv_1 2024-04-26T20:55:38.348 INFO:teuthology.orchestra.run.smithi143.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T20:55:38.348 INFO:teuthology.orchestra.run.smithi143.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T20:55:38.348 INFO:teuthology.orchestra.run.smithi143.stdout:Device: 6h/6d Inode: 887 Links: 1 2024-04-26T20:55:38.348 INFO:teuthology.orchestra.run.smithi143.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T20:55:38.348 INFO:teuthology.orchestra.run.smithi143.stdout:Access: 2024-04-26 20:48:15.505575459 +0000 2024-04-26T20:55:38.348 INFO:teuthology.orchestra.run.smithi143.stdout:Modify: 2024-04-26 20:48:15.241577817 +0000 2024-04-26T20:55:38.348 INFO:teuthology.orchestra.run.smithi143.stdout:Change: 2024-04-26 20:48:15.241577817 +0000 2024-04-26T20:55:38.348 INFO:teuthology.orchestra.run.smithi143.stdout: Birth: 2024-04-26 20:48:15.241577817 +0000 2024-04-26T20:55:38.349 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T20:55:38.410 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records in 2024-04-26T20:55:38.410 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records out 2024-04-26T20:55:38.410 INFO:teuthology.orchestra.run.smithi143.stderr:512 bytes copied, 0.000415337 s, 1.2 MB/s 2024-04-26T20:55:38.412 DEBUG:teuthology.orchestra.run.smithi143:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T20:55:38.465 DEBUG:teuthology.orchestra.run.smithi143:> stat /dev/vg_nvme/lv_2 2024-04-26T20:55:38.519 INFO:teuthology.orchestra.run.smithi143.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T20:55:38.519 INFO:teuthology.orchestra.run.smithi143.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T20:55:38.520 INFO:teuthology.orchestra.run.smithi143.stdout:Device: 6h/6d Inode: 905 Links: 1 2024-04-26T20:55:38.520 INFO:teuthology.orchestra.run.smithi143.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T20:55:38.520 INFO:teuthology.orchestra.run.smithi143.stdout:Access: 2024-04-26 20:48:16.085570278 +0000 2024-04-26T20:55:38.520 INFO:teuthology.orchestra.run.smithi143.stdout:Modify: 2024-04-26 20:48:15.821572636 +0000 2024-04-26T20:55:38.520 INFO:teuthology.orchestra.run.smithi143.stdout:Change: 2024-04-26 20:48:15.821572636 +0000 2024-04-26T20:55:38.520 INFO:teuthology.orchestra.run.smithi143.stdout: Birth: 2024-04-26 20:48:15.821572636 +0000 2024-04-26T20:55:38.520 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T20:55:38.582 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records in 2024-04-26T20:55:38.582 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records out 2024-04-26T20:55:38.582 INFO:teuthology.orchestra.run.smithi143.stderr:512 bytes copied, 0.000379871 s, 1.3 MB/s 2024-04-26T20:55:38.584 DEBUG:teuthology.orchestra.run.smithi143:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T20:55:38.637 DEBUG:teuthology.orchestra.run.smithi143:> stat /dev/vg_nvme/lv_3 2024-04-26T20:55:38.688 INFO:teuthology.orchestra.run.smithi143.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T20:55:38.688 INFO:teuthology.orchestra.run.smithi143.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T20:55:38.688 INFO:teuthology.orchestra.run.smithi143.stdout:Device: 6h/6d Inode: 920 Links: 1 2024-04-26T20:55:38.688 INFO:teuthology.orchestra.run.smithi143.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T20:55:38.688 INFO:teuthology.orchestra.run.smithi143.stdout:Access: 2024-04-26 20:48:16.741564419 +0000 2024-04-26T20:55:38.688 INFO:teuthology.orchestra.run.smithi143.stdout:Modify: 2024-04-26 20:48:16.437567134 +0000 2024-04-26T20:55:38.688 INFO:teuthology.orchestra.run.smithi143.stdout:Change: 2024-04-26 20:48:16.437567134 +0000 2024-04-26T20:55:38.688 INFO:teuthology.orchestra.run.smithi143.stdout: Birth: 2024-04-26 20:48:16.437567134 +0000 2024-04-26T20:55:38.689 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T20:55:38.750 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records in 2024-04-26T20:55:38.750 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records out 2024-04-26T20:55:38.750 INFO:teuthology.orchestra.run.smithi143.stderr:512 bytes copied, 0.000411201 s, 1.2 MB/s 2024-04-26T20:55:38.752 DEBUG:teuthology.orchestra.run.smithi143:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T20:55:38.805 DEBUG:teuthology.orchestra.run.smithi143:> stat /dev/vg_nvme/lv_4 2024-04-26T20:55:38.856 INFO:teuthology.orchestra.run.smithi143.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T20:55:38.856 INFO:teuthology.orchestra.run.smithi143.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T20:55:38.856 INFO:teuthology.orchestra.run.smithi143.stdout:Device: 6h/6d Inode: 938 Links: 1 2024-04-26T20:55:38.856 INFO:teuthology.orchestra.run.smithi143.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T20:55:38.856 INFO:teuthology.orchestra.run.smithi143.stdout:Access: 2024-04-26 20:48:17.301559416 +0000 2024-04-26T20:55:38.856 INFO:teuthology.orchestra.run.smithi143.stdout:Modify: 2024-04-26 20:48:17.001562097 +0000 2024-04-26T20:55:38.856 INFO:teuthology.orchestra.run.smithi143.stdout:Change: 2024-04-26 20:48:17.001562097 +0000 2024-04-26T20:55:38.856 INFO:teuthology.orchestra.run.smithi143.stdout: Birth: 2024-04-26 20:48:17.001562097 +0000 2024-04-26T20:55:38.856 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T20:55:38.918 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records in 2024-04-26T20:55:38.918 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records out 2024-04-26T20:55:38.918 INFO:teuthology.orchestra.run.smithi143.stderr:512 bytes copied, 0.000399002 s, 1.3 MB/s 2024-04-26T20:55:38.920 DEBUG:teuthology.orchestra.run.smithi143:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T20:55:38.974 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T20:55:38.974 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi138.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi143.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-26T20:55:38.974 INFO:tasks.ceph:Generating config... 2024-04-26T20:55:38.975 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-26T20:55:38.975 INFO:tasks.ceph:[client] debug client = 20 2024-04-26T20:55:38.975 INFO:tasks.ceph:[client] debug ms = 1 2024-04-26T20:55:38.975 INFO:tasks.ceph:[client] pid file = 2024-04-26T20:55:38.975 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-26T20:55:38.975 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-26T20:55:38.976 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-04-26T20:55:38.976 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-26T20:55:38.976 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-26T20:55:38.976 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-26T20:55:38.976 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-26T20:55:38.976 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-26T20:55:38.976 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-26T20:55:38.976 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-26T20:55:38.976 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-26T20:55:38.976 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-26T20:55:38.976 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-26T20:55:38.976 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-26T20:55:38.976 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-26T20:55:38.976 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-26T20:55:38.977 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-26T20:55:38.977 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-26T20:55:38.977 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-26T20:55:38.977 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-26T20:55:38.977 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-26T20:55:38.977 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-26T20:55:38.977 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-26T20:55:38.977 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-26T20:55:38.977 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-26T20:55:38.977 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-26T20:55:38.977 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-26T20:55:38.977 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-26T20:55:38.977 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-26T20:55:38.977 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-26T20:55:38.978 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-26T20:55:38.978 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-26T20:55:38.978 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-26T20:55:38.978 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-26T20:55:38.978 INFO:tasks.ceph:Setting up mon.a... 2024-04-26T20:55:38.978 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-26T20:55:39.023 INFO:teuthology.orchestra.run.smithi138.stdout:creating /etc/ceph/ceph.keyring 2024-04-26T20:55:39.040 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-26T20:55:39.129 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T20:55:39.148 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.138'), ('mon.b', '172.21.15.143'), ('mon.c', '[v2:172.21.15.143:3301,v1:172.21.15.143:6790]')] 2024-04-26T20:55:39.149 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.138,172.21.15.143,[v2:172.21.15.143:3301,v1:172.21.15.143:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-26T20:55:39.150 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-26T20:55:39.150 DEBUG:teuthology.orchestra.run.smithi138:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T20:55:39.201 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.138 --add b 172.21.15.143 --addv c '[v2:172.21.15.143:3301,v1:172.21.15.143:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-26T20:55:39.292 INFO:teuthology.orchestra.run.smithi138.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-26T20:55:39.292 INFO:teuthology.orchestra.run.smithi138.stdout:monmaptool: generated fsid c22b4730-12cc-4558-8535-b965384398c0 2024-04-26T20:55:39.292 INFO:teuthology.orchestra.run.smithi138.stdout:setting min_mon_release = quincy 2024-04-26T20:55:39.292 INFO:teuthology.orchestra.run.smithi138.stdout:epoch 0 2024-04-26T20:55:39.292 INFO:teuthology.orchestra.run.smithi138.stdout:fsid c22b4730-12cc-4558-8535-b965384398c0 2024-04-26T20:55:39.292 INFO:teuthology.orchestra.run.smithi138.stdout:last_changed 2024-04-26T20:55:39.294394+0000 2024-04-26T20:55:39.292 INFO:teuthology.orchestra.run.smithi138.stdout:created 2024-04-26T20:55:39.294394+0000 2024-04-26T20:55:39.292 INFO:teuthology.orchestra.run.smithi138.stdout:min_mon_release 17 (quincy) 2024-04-26T20:55:39.292 INFO:teuthology.orchestra.run.smithi138.stdout:election_strategy: 1 2024-04-26T20:55:39.292 INFO:teuthology.orchestra.run.smithi138.stdout:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-04-26T20:55:39.293 INFO:teuthology.orchestra.run.smithi138.stdout:1: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.b 2024-04-26T20:55:39.293 INFO:teuthology.orchestra.run.smithi138.stdout:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-04-26T20:55:39.293 INFO:teuthology.orchestra.run.smithi138.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-26T20:55:39.295 DEBUG:teuthology.orchestra.run.smithi138:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T20:55:39.303 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c22b4730-12cc-4558-8535-b965384398c0... 2024-04-26T20:55:39.304 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T20:55:39.348 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T20:55:39.387 INFO:teuthology.orchestra.run.smithi138.stdout:[global] 2024-04-26T20:55:39.388 INFO:teuthology.orchestra.run.smithi138.stdout: chdir = "" 2024-04-26T20:55:39.388 INFO:teuthology.orchestra.run.smithi138.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T20:55:39.388 INFO:teuthology.orchestra.run.smithi138.stdout: auth supported = cephx 2024-04-26T20:55:39.388 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:55:39.388 INFO:teuthology.orchestra.run.smithi138.stdout: filestore xattr use omap = true 2024-04-26T20:55:39.388 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:55:39.388 INFO:teuthology.orchestra.run.smithi138.stdout: mon clock drift allowed = 1.000 2024-04-26T20:55:39.388 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:55:39.388 INFO:teuthology.orchestra.run.smithi138.stdout: osd crush chooseleaf type = 0 2024-04-26T20:55:39.388 INFO:teuthology.orchestra.run.smithi138.stdout: auth debug = true 2024-04-26T20:55:39.388 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:55:39.388 INFO:teuthology.orchestra.run.smithi138.stdout: ms die on old message = true 2024-04-26T20:55:39.389 INFO:teuthology.orchestra.run.smithi138.stdout: ms die on bug = true 2024-04-26T20:55:39.389 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:55:39.389 INFO:teuthology.orchestra.run.smithi138.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T20:55:39.389 INFO:teuthology.orchestra.run.smithi138.stdout: mon pg warn max object skew = 0 2024-04-26T20:55:39.389 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:55:39.389 INFO:teuthology.orchestra.run.smithi138.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T20:55:39.389 INFO:teuthology.orchestra.run.smithi138.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T20:55:39.389 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:55:39.389 INFO:teuthology.orchestra.run.smithi138.stdout: osd pool default size = 2 2024-04-26T20:55:39.389 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:55:39.389 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd allow primary affinity = true 2024-04-26T20:55:39.389 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd allow pg remap = true 2024-04-26T20:55:39.389 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on legacy crush tunables = false 2024-04-26T20:55:39.389 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on crush straw calc version zero = false 2024-04-26T20:55:39.389 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on no sortbitwise = false 2024-04-26T20:55:39.389 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on osd down out interval zero = false 2024-04-26T20:55:39.390 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on too few osds = false 2024-04-26T20:55:39.390 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T20:55:39.390 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T20:55:39.390 INFO:teuthology.orchestra.run.smithi138.stdout: mon_allow_pool_size_one = true 2024-04-26T20:55:39.390 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:55:39.390 INFO:teuthology.orchestra.run.smithi138.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T20:55:39.390 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:55:39.390 INFO:teuthology.orchestra.run.smithi138.stdout: osd default data pool replay window = 5 2024-04-26T20:55:39.390 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:55:39.390 INFO:teuthology.orchestra.run.smithi138.stdout: mon allow pool delete = true 2024-04-26T20:55:39.390 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:55:39.390 INFO:teuthology.orchestra.run.smithi138.stdout: mon cluster log file level = debug 2024-04-26T20:55:39.390 INFO:teuthology.orchestra.run.smithi138.stdout: debug asserts on shutdown = true 2024-04-26T20:55:39.390 INFO:teuthology.orchestra.run.smithi138.stdout: mon health detail to clog = false 2024-04-26T20:55:39.390 INFO:teuthology.orchestra.run.smithi138.stdout: mon host = "172.21.15.138,172.21.15.143,[v2:172.21.15.143:3301,v1:172.21.15.143:6790]" 2024-04-26T20:55:39.391 INFO:teuthology.orchestra.run.smithi138.stdout: ms die on skipped message = False 2024-04-26T20:55:39.391 INFO:teuthology.orchestra.run.smithi138.stdout: fsid = c22b4730-12cc-4558-8535-b965384398c0 2024-04-26T20:55:39.391 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:55:39.391 INFO:teuthology.orchestra.run.smithi138.stdout:[osd] 2024-04-26T20:55:39.391 INFO:teuthology.orchestra.run.smithi138.stdout: osd journal size = 100 2024-04-26T20:55:39.391 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:55:39.391 INFO:teuthology.orchestra.run.smithi138.stdout: osd scrub load threshold = 5.0 2024-04-26T20:55:39.391 INFO:teuthology.orchestra.run.smithi138.stdout: osd scrub max interval = 600 2024-04-26T20:55:39.391 INFO:teuthology.orchestra.run.smithi138.stdout: osd mclock profile = high_recovery_ops 2024-04-26T20:55:39.391 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:55:39.391 INFO:teuthology.orchestra.run.smithi138.stdout: osd recover clone overlap = true 2024-04-26T20:55:39.391 INFO:teuthology.orchestra.run.smithi138.stdout: osd recovery max chunk = 1048576 2024-04-26T20:55:39.391 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:55:39.391 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug shutdown = true 2024-04-26T20:55:39.391 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug op order = true 2024-04-26T20:55:39.391 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug verify stray on activate = true 2024-04-26T20:55:39.391 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug trim objects = true 2024-04-26T20:55:39.392 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:55:39.392 INFO:teuthology.orchestra.run.smithi138.stdout: osd open classes on start = true 2024-04-26T20:55:39.392 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug pg log writeout = true 2024-04-26T20:55:39.392 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:55:39.392 INFO:teuthology.orchestra.run.smithi138.stdout: osd deep scrub update digest min age = 30 2024-04-26T20:55:39.392 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:55:39.392 INFO:teuthology.orchestra.run.smithi138.stdout: osd map max advance = 10 2024-04-26T20:55:39.392 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:55:39.392 INFO:teuthology.orchestra.run.smithi138.stdout: journal zero on create = true 2024-04-26T20:55:39.392 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:55:39.392 INFO:teuthology.orchestra.run.smithi138.stdout: filestore ondisk finisher threads = 3 2024-04-26T20:55:39.392 INFO:teuthology.orchestra.run.smithi138.stdout: filestore apply finisher threads = 3 2024-04-26T20:55:39.392 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:55:39.392 INFO:teuthology.orchestra.run.smithi138.stdout: bdev debug aio = true 2024-04-26T20:55:39.393 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug misdirected ops = true 2024-04-26T20:55:39.393 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore block size = 96636764160 2024-04-26T20:55:39.393 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore fsck on mount = True 2024-04-26T20:55:39.393 INFO:teuthology.orchestra.run.smithi138.stdout: debug bluefs = 20 2024-04-26T20:55:39.393 INFO:teuthology.orchestra.run.smithi138.stdout: debug bluestore = 20 2024-04-26T20:55:39.393 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2024-04-26T20:55:39.393 INFO:teuthology.orchestra.run.smithi138.stdout: debug osd = 20 2024-04-26T20:55:39.393 INFO:teuthology.orchestra.run.smithi138.stdout: debug rocksdb = 10 2024-04-26T20:55:39.393 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T20:55:39.393 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd full ratio = 0.9 2024-04-26T20:55:39.393 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd nearfull ratio = 0.8 2024-04-26T20:55:39.393 INFO:teuthology.orchestra.run.smithi138.stdout: osd failsafe full ratio = 0.95 2024-04-26T20:55:39.393 INFO:teuthology.orchestra.run.smithi138.stdout: osd objectstore = bluestore 2024-04-26T20:55:39.393 INFO:teuthology.orchestra.run.smithi138.stdout: osd op complaint time = 180 2024-04-26T20:55:39.393 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:55:39.394 INFO:teuthology.orchestra.run.smithi138.stdout:[mgr] 2024-04-26T20:55:39.394 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2024-04-26T20:55:39.394 INFO:teuthology.orchestra.run.smithi138.stdout: debug mgr = 20 2024-04-26T20:55:39.394 INFO:teuthology.orchestra.run.smithi138.stdout: debug mon = 20 2024-04-26T20:55:39.394 INFO:teuthology.orchestra.run.smithi138.stdout: debug auth = 20 2024-04-26T20:55:39.394 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min pgs per osd = 4 2024-04-26T20:55:39.394 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min bytes per osd = 10 2024-04-26T20:55:39.394 INFO:teuthology.orchestra.run.smithi138.stdout: mgr/telemetry/nag = false 2024-04-26T20:55:39.394 INFO:teuthology.orchestra.run.smithi138.stdout: debug client = 20 2024-04-26T20:55:39.394 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:55:39.394 INFO:teuthology.orchestra.run.smithi138.stdout:[mon] 2024-04-26T20:55:39.394 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2024-04-26T20:55:39.394 INFO:teuthology.orchestra.run.smithi138.stdout: debug mon = 20 2024-04-26T20:55:39.394 INFO:teuthology.orchestra.run.smithi138.stdout: debug paxos = 20 2024-04-26T20:55:39.394 INFO:teuthology.orchestra.run.smithi138.stdout: debug auth = 20 2024-04-26T20:55:39.395 INFO:teuthology.orchestra.run.smithi138.stdout: mon data avail warn = 5 2024-04-26T20:55:39.395 INFO:teuthology.orchestra.run.smithi138.stdout: mon mgr mkfs grace = 240 2024-04-26T20:55:39.395 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min pgs per osd = 4 2024-04-26T20:55:39.395 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd reporter subtree level = osd 2024-04-26T20:55:39.395 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd prime pg temp = true 2024-04-26T20:55:39.395 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min bytes per osd = 10 2024-04-26T20:55:39.395 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:55:39.395 INFO:teuthology.orchestra.run.smithi138.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T20:55:39.395 INFO:teuthology.orchestra.run.smithi138.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T20:55:39.395 INFO:teuthology.orchestra.run.smithi138.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T20:55:39.395 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:55:39.395 INFO:teuthology.orchestra.run.smithi138.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T20:55:39.395 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T20:55:39.395 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T20:55:39.395 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:55:39.395 INFO:teuthology.orchestra.run.smithi138.stdout: # 1m isn't quite enough 2024-04-26T20:55:39.396 INFO:teuthology.orchestra.run.smithi138.stdout: mon_down_mkfs_grace = 2m 2024-04-26T20:55:39.396 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:55:39.396 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_filestore_osds = false 2024-04-26T20:55:39.396 INFO:teuthology.orchestra.run.smithi138.stdout: mon down mkfs grace = 300 2024-04-26T20:55:39.396 INFO:teuthology.orchestra.run.smithi138.stdout: mon op complaint time = 120 2024-04-26T20:55:39.396 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:55:39.396 INFO:teuthology.orchestra.run.smithi138.stdout:[client] 2024-04-26T20:55:39.396 INFO:teuthology.orchestra.run.smithi138.stdout: rgw cache enabled = true 2024-04-26T20:55:39.396 INFO:teuthology.orchestra.run.smithi138.stdout: rgw enable ops log = true 2024-04-26T20:55:39.396 INFO:teuthology.orchestra.run.smithi138.stdout: rgw enable usage log = true 2024-04-26T20:55:39.396 INFO:teuthology.orchestra.run.smithi138.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T20:55:39.396 INFO:teuthology.orchestra.run.smithi138.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T20:55:39.396 INFO:teuthology.orchestra.run.smithi138.stdout: client mount timeout = 600 2024-04-26T20:55:39.396 INFO:teuthology.orchestra.run.smithi138.stdout: debug client = 20 2024-04-26T20:55:39.396 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2024-04-26T20:55:39.396 INFO:teuthology.orchestra.run.smithi138.stdout: pid file = "" 2024-04-26T20:55:39.397 INFO:teuthology.orchestra.run.smithi138.stdout: rados mon op timeout = 900 2024-04-26T20:55:39.397 INFO:teuthology.orchestra.run.smithi138.stdout: rados osd op timeout = 900 2024-04-26T20:55:39.397 INFO:teuthology.orchestra.run.smithi138.stdout:[mon.a] 2024-04-26T20:55:39.397 INFO:teuthology.orchestra.run.smithi138.stdout:[mon.b] 2024-04-26T20:55:39.397 INFO:teuthology.orchestra.run.smithi138.stdout:[mon.c] 2024-04-26T20:55:39.397 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.a] 2024-04-26T20:55:39.397 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.c] 2024-04-26T20:55:39.397 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.b] 2024-04-26T20:55:39.397 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.d] 2024-04-26T20:55:39.397 INFO:teuthology.orchestra.run.smithi138.stdout:[mds] 2024-04-26T20:55:39.397 INFO:teuthology.orchestra.run.smithi138.stdout: debug mds = 20 2024-04-26T20:55:39.397 INFO:teuthology.orchestra.run.smithi138.stdout: debug mds balancer = 20 2024-04-26T20:55:39.397 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2024-04-26T20:55:39.397 INFO:teuthology.orchestra.run.smithi138.stdout: mds debug frag = True 2024-04-26T20:55:39.398 INFO:teuthology.orchestra.run.smithi138.stdout: mds debug scatterstat = True 2024-04-26T20:55:39.398 INFO:teuthology.orchestra.run.smithi138.stdout: mds op complaint time = 180 2024-04-26T20:55:39.398 INFO:teuthology.orchestra.run.smithi138.stdout: mds verify scatter = True 2024-04-26T20:55:39.398 INFO:teuthology.orchestra.run.smithi138.stdout: osd op complaint time = 180 2024-04-26T20:55:39.398 INFO:teuthology.orchestra.run.smithi138.stdout: rados mon op timeout = 900 2024-04-26T20:55:39.398 INFO:teuthology.orchestra.run.smithi138.stdout: rados osd op timeout = 900 2024-04-26T20:55:39.398 INFO:teuthology.orchestra.run.smithi143.stdout:[global] 2024-04-26T20:55:39.398 INFO:teuthology.orchestra.run.smithi143.stdout: chdir = "" 2024-04-26T20:55:39.398 INFO:teuthology.orchestra.run.smithi143.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T20:55:39.398 INFO:teuthology.orchestra.run.smithi143.stdout: auth supported = cephx 2024-04-26T20:55:39.398 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:55:39.399 INFO:teuthology.orchestra.run.smithi143.stdout: filestore xattr use omap = true 2024-04-26T20:55:39.399 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:55:39.399 INFO:teuthology.orchestra.run.smithi143.stdout: mon clock drift allowed = 1.000 2024-04-26T20:55:39.399 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:55:39.399 INFO:teuthology.orchestra.run.smithi143.stdout: osd crush chooseleaf type = 0 2024-04-26T20:55:39.399 INFO:teuthology.orchestra.run.smithi143.stdout: auth debug = true 2024-04-26T20:55:39.399 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:55:39.399 INFO:teuthology.orchestra.run.smithi143.stdout: ms die on old message = true 2024-04-26T20:55:39.399 INFO:teuthology.orchestra.run.smithi143.stdout: ms die on bug = true 2024-04-26T20:55:39.399 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:55:39.399 INFO:teuthology.orchestra.run.smithi143.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T20:55:39.399 INFO:teuthology.orchestra.run.smithi143.stdout: mon pg warn max object skew = 0 2024-04-26T20:55:39.399 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:55:39.400 INFO:teuthology.orchestra.run.smithi143.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T20:55:39.400 INFO:teuthology.orchestra.run.smithi143.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T20:55:39.400 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:55:39.400 INFO:teuthology.orchestra.run.smithi143.stdout: osd pool default size = 2 2024-04-26T20:55:39.400 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:55:39.400 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd allow primary affinity = true 2024-04-26T20:55:39.400 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd allow pg remap = true 2024-04-26T20:55:39.400 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on legacy crush tunables = false 2024-04-26T20:55:39.400 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on crush straw calc version zero = false 2024-04-26T20:55:39.400 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on no sortbitwise = false 2024-04-26T20:55:39.400 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on osd down out interval zero = false 2024-04-26T20:55:39.400 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on too few osds = false 2024-04-26T20:55:39.400 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T20:55:39.400 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T20:55:39.400 INFO:teuthology.orchestra.run.smithi143.stdout: mon_allow_pool_size_one = true 2024-04-26T20:55:39.401 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:55:39.401 INFO:teuthology.orchestra.run.smithi143.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T20:55:39.401 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:55:39.401 INFO:teuthology.orchestra.run.smithi143.stdout: osd default data pool replay window = 5 2024-04-26T20:55:39.401 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:55:39.401 INFO:teuthology.orchestra.run.smithi143.stdout: mon allow pool delete = true 2024-04-26T20:55:39.401 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:55:39.401 INFO:teuthology.orchestra.run.smithi143.stdout: mon cluster log file level = debug 2024-04-26T20:55:39.401 INFO:teuthology.orchestra.run.smithi143.stdout: debug asserts on shutdown = true 2024-04-26T20:55:39.401 INFO:teuthology.orchestra.run.smithi143.stdout: mon health detail to clog = false 2024-04-26T20:55:39.401 INFO:teuthology.orchestra.run.smithi143.stdout: mon host = "172.21.15.138,172.21.15.143,[v2:172.21.15.143:3301,v1:172.21.15.143:6790]" 2024-04-26T20:55:39.401 INFO:teuthology.orchestra.run.smithi143.stdout: ms die on skipped message = False 2024-04-26T20:55:39.401 INFO:teuthology.orchestra.run.smithi143.stdout: fsid = c22b4730-12cc-4558-8535-b965384398c0 2024-04-26T20:55:39.401 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:55:39.401 INFO:teuthology.orchestra.run.smithi143.stdout:[osd] 2024-04-26T20:55:39.401 INFO:teuthology.orchestra.run.smithi143.stdout: osd journal size = 100 2024-04-26T20:55:39.401 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:55:39.402 INFO:teuthology.orchestra.run.smithi143.stdout: osd scrub load threshold = 5.0 2024-04-26T20:55:39.402 INFO:teuthology.orchestra.run.smithi143.stdout: osd scrub max interval = 600 2024-04-26T20:55:39.402 INFO:teuthology.orchestra.run.smithi143.stdout: osd mclock profile = high_recovery_ops 2024-04-26T20:55:39.402 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:55:39.402 INFO:teuthology.orchestra.run.smithi143.stdout: osd recover clone overlap = true 2024-04-26T20:55:39.402 INFO:teuthology.orchestra.run.smithi143.stdout: osd recovery max chunk = 1048576 2024-04-26T20:55:39.402 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:55:39.402 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug shutdown = true 2024-04-26T20:55:39.402 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug op order = true 2024-04-26T20:55:39.402 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug verify stray on activate = true 2024-04-26T20:55:39.402 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug trim objects = true 2024-04-26T20:55:39.402 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:55:39.402 INFO:teuthology.orchestra.run.smithi143.stdout: osd open classes on start = true 2024-04-26T20:55:39.402 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug pg log writeout = true 2024-04-26T20:55:39.403 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:55:39.403 INFO:teuthology.orchestra.run.smithi143.stdout: osd deep scrub update digest min age = 30 2024-04-26T20:55:39.403 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:55:39.403 INFO:teuthology.orchestra.run.smithi143.stdout: osd map max advance = 10 2024-04-26T20:55:39.403 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:55:39.403 INFO:teuthology.orchestra.run.smithi143.stdout: journal zero on create = true 2024-04-26T20:55:39.403 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:55:39.403 INFO:teuthology.orchestra.run.smithi143.stdout: filestore ondisk finisher threads = 3 2024-04-26T20:55:39.403 INFO:teuthology.orchestra.run.smithi143.stdout: filestore apply finisher threads = 3 2024-04-26T20:55:39.403 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:55:39.403 INFO:teuthology.orchestra.run.smithi143.stdout: bdev debug aio = true 2024-04-26T20:55:39.403 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug misdirected ops = true 2024-04-26T20:55:39.403 INFO:teuthology.orchestra.run.smithi143.stdout: bluestore block size = 96636764160 2024-04-26T20:55:39.403 INFO:teuthology.orchestra.run.smithi143.stdout: bluestore fsck on mount = True 2024-04-26T20:55:39.403 INFO:teuthology.orchestra.run.smithi143.stdout: debug bluefs = 20 2024-04-26T20:55:39.403 INFO:teuthology.orchestra.run.smithi143.stdout: debug bluestore = 20 2024-04-26T20:55:39.404 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2024-04-26T20:55:39.404 INFO:teuthology.orchestra.run.smithi143.stdout: debug osd = 20 2024-04-26T20:55:39.404 INFO:teuthology.orchestra.run.smithi143.stdout: debug rocksdb = 10 2024-04-26T20:55:39.404 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T20:55:39.404 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd full ratio = 0.9 2024-04-26T20:55:39.404 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd nearfull ratio = 0.8 2024-04-26T20:55:39.404 INFO:teuthology.orchestra.run.smithi143.stdout: osd failsafe full ratio = 0.95 2024-04-26T20:55:39.404 INFO:teuthology.orchestra.run.smithi143.stdout: osd objectstore = bluestore 2024-04-26T20:55:39.404 INFO:teuthology.orchestra.run.smithi143.stdout: osd op complaint time = 180 2024-04-26T20:55:39.404 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:55:39.404 INFO:teuthology.orchestra.run.smithi143.stdout:[mgr] 2024-04-26T20:55:39.404 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2024-04-26T20:55:39.404 INFO:teuthology.orchestra.run.smithi143.stdout: debug mgr = 20 2024-04-26T20:55:39.404 INFO:teuthology.orchestra.run.smithi143.stdout: debug mon = 20 2024-04-26T20:55:39.405 INFO:teuthology.orchestra.run.smithi143.stdout: debug auth = 20 2024-04-26T20:55:39.405 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min pgs per osd = 4 2024-04-26T20:55:39.405 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min bytes per osd = 10 2024-04-26T20:55:39.405 INFO:teuthology.orchestra.run.smithi143.stdout: mgr/telemetry/nag = false 2024-04-26T20:55:39.405 INFO:teuthology.orchestra.run.smithi143.stdout: debug client = 20 2024-04-26T20:55:39.405 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:55:39.405 INFO:teuthology.orchestra.run.smithi143.stdout:[mon] 2024-04-26T20:55:39.405 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2024-04-26T20:55:39.405 INFO:teuthology.orchestra.run.smithi143.stdout: debug mon = 20 2024-04-26T20:55:39.405 INFO:teuthology.orchestra.run.smithi143.stdout: debug paxos = 20 2024-04-26T20:55:39.405 INFO:teuthology.orchestra.run.smithi143.stdout: debug auth = 20 2024-04-26T20:55:39.405 INFO:teuthology.orchestra.run.smithi143.stdout: mon data avail warn = 5 2024-04-26T20:55:39.405 INFO:teuthology.orchestra.run.smithi143.stdout: mon mgr mkfs grace = 240 2024-04-26T20:55:39.405 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min pgs per osd = 4 2024-04-26T20:55:39.405 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd reporter subtree level = osd 2024-04-26T20:55:39.405 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd prime pg temp = true 2024-04-26T20:55:39.406 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min bytes per osd = 10 2024-04-26T20:55:39.406 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:55:39.406 INFO:teuthology.orchestra.run.smithi143.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T20:55:39.406 INFO:teuthology.orchestra.run.smithi143.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T20:55:39.406 INFO:teuthology.orchestra.run.smithi143.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T20:55:39.406 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:55:39.406 INFO:teuthology.orchestra.run.smithi143.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T20:55:39.406 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T20:55:39.406 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T20:55:39.406 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:55:39.406 INFO:teuthology.orchestra.run.smithi143.stdout: # 1m isn't quite enough 2024-04-26T20:55:39.406 INFO:teuthology.orchestra.run.smithi143.stdout: mon_down_mkfs_grace = 2m 2024-04-26T20:55:39.406 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:55:39.406 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_filestore_osds = false 2024-04-26T20:55:39.406 INFO:teuthology.orchestra.run.smithi143.stdout: mon down mkfs grace = 300 2024-04-26T20:55:39.407 INFO:teuthology.orchestra.run.smithi143.stdout: mon op complaint time = 120 2024-04-26T20:55:39.407 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:55:39.407 INFO:teuthology.orchestra.run.smithi143.stdout:[client] 2024-04-26T20:55:39.407 INFO:teuthology.orchestra.run.smithi143.stdout: rgw cache enabled = true 2024-04-26T20:55:39.407 INFO:teuthology.orchestra.run.smithi143.stdout: rgw enable ops log = true 2024-04-26T20:55:39.407 INFO:teuthology.orchestra.run.smithi143.stdout: rgw enable usage log = true 2024-04-26T20:55:39.407 INFO:teuthology.orchestra.run.smithi143.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T20:55:39.407 INFO:teuthology.orchestra.run.smithi143.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T20:55:39.407 INFO:teuthology.orchestra.run.smithi143.stdout: client mount timeout = 600 2024-04-26T20:55:39.407 INFO:teuthology.orchestra.run.smithi143.stdout: debug client = 20 2024-04-26T20:55:39.407 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2024-04-26T20:55:39.407 INFO:teuthology.orchestra.run.smithi143.stdout: pid file = "" 2024-04-26T20:55:39.407 INFO:teuthology.orchestra.run.smithi143.stdout: rados mon op timeout = 900 2024-04-26T20:55:39.407 INFO:teuthology.orchestra.run.smithi143.stdout: rados osd op timeout = 900 2024-04-26T20:55:39.407 INFO:teuthology.orchestra.run.smithi143.stdout:[mon.a] 2024-04-26T20:55:39.408 INFO:teuthology.orchestra.run.smithi143.stdout:[mon.b] 2024-04-26T20:55:39.408 INFO:teuthology.orchestra.run.smithi143.stdout:[mon.c] 2024-04-26T20:55:39.408 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.a] 2024-04-26T20:55:39.408 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.c] 2024-04-26T20:55:39.408 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.b] 2024-04-26T20:55:39.408 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.d] 2024-04-26T20:55:39.408 INFO:teuthology.orchestra.run.smithi143.stdout:[mds] 2024-04-26T20:55:39.408 INFO:teuthology.orchestra.run.smithi143.stdout: debug mds = 20 2024-04-26T20:55:39.408 INFO:teuthology.orchestra.run.smithi143.stdout: debug mds balancer = 20 2024-04-26T20:55:39.408 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2024-04-26T20:55:39.408 INFO:teuthology.orchestra.run.smithi143.stdout: mds debug frag = True 2024-04-26T20:55:39.408 INFO:teuthology.orchestra.run.smithi143.stdout: mds debug scatterstat = True 2024-04-26T20:55:39.408 INFO:teuthology.orchestra.run.smithi143.stdout: mds op complaint time = 180 2024-04-26T20:55:39.408 INFO:teuthology.orchestra.run.smithi143.stdout: mds verify scatter = True 2024-04-26T20:55:39.408 INFO:teuthology.orchestra.run.smithi143.stdout: osd op complaint time = 180 2024-04-26T20:55:39.408 INFO:teuthology.orchestra.run.smithi143.stdout: rados mon op timeout = 900 2024-04-26T20:55:39.409 INFO:teuthology.orchestra.run.smithi143.stdout: rados osd op timeout = 900 2024-04-26T20:55:39.410 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-26T20:55:39.410 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-26T20:55:39.510 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-26T20:55:39.510 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-26T20:55:39.510 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-26T20:55:39.519 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-26T20:55:39.519 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-26T20:55:39.569 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi138.front.sepia.ceph.com 2024-04-26T20:55:39.569 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-26T20:55:39.569 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T20:55:39.569 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T20:55:39.640 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-26T20:55:39.640 DEBUG:teuthology.orchestra.run.smithi138:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T20:55:39.689 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi143.front.sepia.ceph.com 2024-04-26T20:55:39.689 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T20:55:39.689 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T20:55:39.689 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T20:55:39.725 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T20:55:39.725 DEBUG:teuthology.orchestra.run.smithi143:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T20:55:39.780 INFO:tasks.ceph:Setting up mon nodes... 2024-04-26T20:55:39.780 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-26T20:55:39.780 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T20:55:39.832 INFO:teuthology.orchestra.run.smithi138.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T20:55:39.838 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T20:55:39.897 INFO:teuthology.orchestra.run.smithi143.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T20:55:39.914 INFO:tasks.ceph:Setting up mds nodes... 2024-04-26T20:55:39.914 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T20:55:39.968 INFO:teuthology.orchestra.run.smithi138.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T20:55:39.972 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-26T20:55:39.992 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-26T20:55:40.090 INFO:teuthology.orchestra.run.smithi138.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-26T20:55:40.094 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-26T20:55:40.113 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-26T20:55:40.171 INFO:teuthology.orchestra.run.smithi143.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-26T20:55:40.176 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-26T20:55:40.197 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-26T20:55:40.293 INFO:teuthology.orchestra.run.smithi143.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-26T20:55:40.298 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-26T20:55:40.318 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-26T20:55:40.318 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-26T20:55:40.361 INFO:teuthology.orchestra.run.smithi138.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-26T20:55:40.377 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-04-26T20:55:40.459 INFO:teuthology.orchestra.run.smithi138.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-04-26T20:55:40.475 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-26T20:55:40.517 INFO:teuthology.orchestra.run.smithi143.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-26T20:55:40.534 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-04-26T20:55:40.615 INFO:teuthology.orchestra.run.smithi143.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-04-26T20:55:40.632 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-26T20:55:40.632 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi138.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi143.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-26T20:55:40.632 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-26T20:55:40.651 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T20:55:40.651 INFO:tasks.ceph:role: osd.0 2024-04-26T20:55:40.651 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi138.front.sepia.ceph.com 2024-04-26T20:55:40.651 DEBUG:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T20:55:40.719 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T20:55:40.719 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T20:55:40.719 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T20:55:40.719 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T20:55:40.719 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T20:55:40.719 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2024-04-26T20:55:40.719 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T20:55:40.720 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T20:55:40.720 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T20:55:40.720 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T20:55:41.103 INFO:teuthology.orchestra.run.smithi138.stdout:Discarding blocks...Done. 2024-04-26T20:55:41.106 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2024-04-26T20:55:41.106 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-26T20:55:41.200 DEBUG:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-26T20:55:41.216 INFO:teuthology.orchestra.run.smithi138.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T20:55:41.216 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:55:41.217 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-26T20:55:41.276 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T20:55:41.277 INFO:tasks.ceph:role: osd.1 2024-04-26T20:55:41.277 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi138.front.sepia.ceph.com 2024-04-26T20:55:41.277 DEBUG:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-26T20:55:41.348 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T20:55:41.348 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T20:55:41.348 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T20:55:41.348 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T20:55:41.348 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T20:55:41.348 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2024-04-26T20:55:41.348 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T20:55:41.348 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T20:55:41.348 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T20:55:41.349 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T20:55:41.744 INFO:teuthology.orchestra.run.smithi138.stdout:Discarding blocks...Done. 2024-04-26T20:55:41.747 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2024-04-26T20:55:41.747 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-26T20:55:41.889 DEBUG:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-26T20:55:41.905 INFO:teuthology.orchestra.run.smithi138.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T20:55:41.906 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:55:41.906 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-26T20:55:41.972 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T20:55:41.972 INFO:tasks.ceph:role: osd.2 2024-04-26T20:55:41.972 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi138.front.sepia.ceph.com 2024-04-26T20:55:41.973 DEBUG:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-26T20:55:42.040 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T20:55:42.040 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T20:55:42.040 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T20:55:42.040 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T20:55:42.040 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T20:55:42.040 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2024-04-26T20:55:42.040 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T20:55:42.041 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T20:55:42.041 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T20:55:42.041 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T20:55:42.452 INFO:teuthology.orchestra.run.smithi138.stdout:Discarding blocks...Done. 2024-04-26T20:55:42.455 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2024-04-26T20:55:42.455 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-26T20:55:42.598 DEBUG:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-26T20:55:42.615 INFO:teuthology.orchestra.run.smithi138.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T20:55:42.616 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:55:42.616 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-26T20:55:42.678 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T20:55:42.678 INFO:tasks.ceph:role: osd.3 2024-04-26T20:55:42.679 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi138.front.sepia.ceph.com 2024-04-26T20:55:42.679 DEBUG:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-26T20:55:42.753 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T20:55:42.754 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T20:55:42.754 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T20:55:42.754 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T20:55:42.754 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T20:55:42.754 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2024-04-26T20:55:42.754 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T20:55:42.754 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T20:55:42.754 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T20:55:42.754 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T20:55:43.113 INFO:teuthology.orchestra.run.smithi138.stdout:Discarding blocks...Done. 2024-04-26T20:55:43.116 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2024-04-26T20:55:43.116 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-26T20:55:43.201 DEBUG:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-26T20:55:43.258 INFO:teuthology.orchestra.run.smithi138.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T20:55:43.259 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:55:43.259 DEBUG:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T20:55:43.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:55:43.380+0000 7f29d01077c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-26T20:55:43.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:55:43.384+0000 7f29d01077c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-26T20:55:43.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:55:43.384+0000 7f29d01077c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T20:55:43.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:55:43.384+0000 7f29d01077c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T20:55:43.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:55:43.384+0000 7f29d01077c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T20:55:43.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:55:43.388+0000 7f29d01077c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-26T20:55:46.444 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-26T20:55:46.464 DEBUG:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T20:55:46.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:55:46.552+0000 7fc05d7fd7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-26T20:55:46.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:55:46.552+0000 7fc05d7fd7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-26T20:55:46.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:55:46.552+0000 7fc05d7fd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T20:55:46.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:55:46.552+0000 7fc05d7fd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T20:55:46.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:55:46.552+0000 7fc05d7fd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T20:55:46.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:55:46.552+0000 7fc05d7fd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-26T20:55:49.584 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-26T20:55:49.604 DEBUG:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T20:55:49.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:55:49.696+0000 7fa4d222d7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-26T20:55:49.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:55:49.696+0000 7fa4d222d7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-26T20:55:49.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:55:49.696+0000 7fa4d222d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T20:55:49.698 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:55:49.696+0000 7fa4d222d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T20:55:49.698 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:55:49.696+0000 7fa4d222d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T20:55:49.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:55:49.700+0000 7fa4d222d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-26T20:55:52.748 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-26T20:55:52.767 DEBUG:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T20:55:52.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:55:52.860+0000 7fd90ef5a7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-26T20:55:52.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:55:52.860+0000 7fd90ef5a7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-26T20:55:52.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:55:52.860+0000 7fd90ef5a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T20:55:52.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:55:52.860+0000 7fd90ef5a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T20:55:52.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:55:52.860+0000 7fd90ef5a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T20:55:52.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:55:52.864+0000 7fd90ef5a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-26T20:55:55.928 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-26T20:55:55.948 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-26T20:55:55.970 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T20:55:55.971 INFO:tasks.ceph:role: osd.4 2024-04-26T20:55:55.971 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi143.front.sepia.ceph.com 2024-04-26T20:55:55.971 DEBUG:teuthology.orchestra.run.smithi143:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T20:55:56.040 INFO:teuthology.orchestra.run.smithi143.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T20:55:56.040 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T20:55:56.040 INFO:teuthology.orchestra.run.smithi143.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T20:55:56.040 INFO:teuthology.orchestra.run.smithi143.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T20:55:56.041 INFO:teuthology.orchestra.run.smithi143.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T20:55:56.041 INFO:teuthology.orchestra.run.smithi143.stdout: = sunit=0 swidth=0 blks 2024-04-26T20:55:56.041 INFO:teuthology.orchestra.run.smithi143.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T20:55:56.041 INFO:teuthology.orchestra.run.smithi143.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T20:55:56.041 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T20:55:56.041 INFO:teuthology.orchestra.run.smithi143.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T20:55:56.441 INFO:teuthology.orchestra.run.smithi143.stdout:Discarding blocks...Done. 2024-04-26T20:55:56.443 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi143.front.sepia.ceph.com -o noatime 2024-04-26T20:55:56.444 DEBUG:teuthology.orchestra.run.smithi143:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-26T20:55:56.542 DEBUG:teuthology.orchestra.run.smithi143:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-26T20:55:56.558 INFO:teuthology.orchestra.run.smithi143.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T20:55:56.559 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:55:56.560 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-26T20:55:56.623 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T20:55:56.623 INFO:tasks.ceph:role: osd.5 2024-04-26T20:55:56.623 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi143.front.sepia.ceph.com 2024-04-26T20:55:56.623 DEBUG:teuthology.orchestra.run.smithi143:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-26T20:55:56.692 INFO:teuthology.orchestra.run.smithi143.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T20:55:56.692 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T20:55:56.692 INFO:teuthology.orchestra.run.smithi143.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T20:55:56.692 INFO:teuthology.orchestra.run.smithi143.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T20:55:56.692 INFO:teuthology.orchestra.run.smithi143.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T20:55:56.692 INFO:teuthology.orchestra.run.smithi143.stdout: = sunit=0 swidth=0 blks 2024-04-26T20:55:56.692 INFO:teuthology.orchestra.run.smithi143.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T20:55:56.692 INFO:teuthology.orchestra.run.smithi143.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T20:55:56.692 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T20:55:56.693 INFO:teuthology.orchestra.run.smithi143.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T20:55:57.089 INFO:teuthology.orchestra.run.smithi143.stdout:Discarding blocks...Done. 2024-04-26T20:55:57.092 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi143.front.sepia.ceph.com -o noatime 2024-04-26T20:55:57.092 DEBUG:teuthology.orchestra.run.smithi143:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-26T20:55:57.207 DEBUG:teuthology.orchestra.run.smithi143:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-26T20:55:57.225 INFO:teuthology.orchestra.run.smithi143.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T20:55:57.226 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:55:57.226 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-26T20:55:57.292 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T20:55:57.292 INFO:tasks.ceph:role: osd.6 2024-04-26T20:55:57.292 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi143.front.sepia.ceph.com 2024-04-26T20:55:57.292 DEBUG:teuthology.orchestra.run.smithi143:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-26T20:55:57.363 INFO:teuthology.orchestra.run.smithi143.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T20:55:57.363 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T20:55:57.363 INFO:teuthology.orchestra.run.smithi143.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T20:55:57.363 INFO:teuthology.orchestra.run.smithi143.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T20:55:57.363 INFO:teuthology.orchestra.run.smithi143.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T20:55:57.364 INFO:teuthology.orchestra.run.smithi143.stdout: = sunit=0 swidth=0 blks 2024-04-26T20:55:57.364 INFO:teuthology.orchestra.run.smithi143.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T20:55:57.364 INFO:teuthology.orchestra.run.smithi143.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T20:55:57.364 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T20:55:57.364 INFO:teuthology.orchestra.run.smithi143.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T20:55:57.776 INFO:teuthology.orchestra.run.smithi143.stdout:Discarding blocks...Done. 2024-04-26T20:55:57.779 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi143.front.sepia.ceph.com -o noatime 2024-04-26T20:55:57.779 DEBUG:teuthology.orchestra.run.smithi143:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-26T20:55:57.900 DEBUG:teuthology.orchestra.run.smithi143:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-26T20:55:57.917 INFO:teuthology.orchestra.run.smithi143.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T20:55:57.917 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:55:57.918 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-26T20:55:57.984 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T20:55:57.984 INFO:tasks.ceph:role: osd.7 2024-04-26T20:55:57.984 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi143.front.sepia.ceph.com 2024-04-26T20:55:57.984 DEBUG:teuthology.orchestra.run.smithi143:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-26T20:55:58.055 INFO:teuthology.orchestra.run.smithi143.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T20:55:58.055 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T20:55:58.055 INFO:teuthology.orchestra.run.smithi143.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T20:55:58.055 INFO:teuthology.orchestra.run.smithi143.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T20:55:58.055 INFO:teuthology.orchestra.run.smithi143.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T20:55:58.056 INFO:teuthology.orchestra.run.smithi143.stdout: = sunit=0 swidth=0 blks 2024-04-26T20:55:58.056 INFO:teuthology.orchestra.run.smithi143.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T20:55:58.056 INFO:teuthology.orchestra.run.smithi143.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T20:55:58.056 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T20:55:58.056 INFO:teuthology.orchestra.run.smithi143.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T20:55:58.415 INFO:teuthology.orchestra.run.smithi143.stdout:Discarding blocks...Done. 2024-04-26T20:55:58.418 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi143.front.sepia.ceph.com -o noatime 2024-04-26T20:55:58.418 DEBUG:teuthology.orchestra.run.smithi143:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-26T20:55:58.491 DEBUG:teuthology.orchestra.run.smithi143:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-26T20:55:58.548 INFO:teuthology.orchestra.run.smithi143.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T20:55:58.549 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:55:58.550 DEBUG:teuthology.orchestra.run.smithi143:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T20:55:58.692 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:55:58.689+0000 7f1ee2d577c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-26T20:55:58.693 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:55:58.693+0000 7f1ee2d577c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-26T20:55:58.693 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:55:58.693+0000 7f1ee2d577c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-26T20:55:58.693 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:55:58.693+0000 7f1ee2d577c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-26T20:55:58.693 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:55:58.693+0000 7f1ee2d577c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-26T20:55:58.700 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:55:58.701+0000 7f1ee2d577c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-26T20:56:01.739 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-26T20:56:01.759 DEBUG:teuthology.orchestra.run.smithi143:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T20:56:01.853 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:01.853+0000 7fa63382b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-26T20:56:01.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:01.853+0000 7fa63382b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-26T20:56:01.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:01.853+0000 7fa63382b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-26T20:56:01.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:01.853+0000 7fa63382b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-26T20:56:01.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:01.853+0000 7fa63382b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-26T20:56:01.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:01.853+0000 7fa63382b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-26T20:56:04.898 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-26T20:56:04.919 DEBUG:teuthology.orchestra.run.smithi143:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T20:56:05.013 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:05.013+0000 7f557e2dc7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-26T20:56:05.014 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:05.013+0000 7f557e2dc7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-26T20:56:05.014 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:05.013+0000 7f557e2dc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-26T20:56:05.014 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:05.013+0000 7f557e2dc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-26T20:56:05.014 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:05.013+0000 7f557e2dc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-26T20:56:05.016 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:05.013+0000 7f557e2dc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-26T20:56:07.478 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:56:07.482 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:56:08.071 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-26T20:56:08.092 DEBUG:teuthology.orchestra.run.smithi143:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T20:56:08.194 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:08.193+0000 7fa766c127c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-26T20:56:08.195 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:08.193+0000 7fa766c127c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-26T20:56:08.195 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:08.193+0000 7fa766c127c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-26T20:56:08.195 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:08.193+0000 7fa766c127c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-26T20:56:08.195 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:08.193+0000 7fa766c127c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-26T20:56:08.197 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:08.197+0000 7fa766c127c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-26T20:56:11.243 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-26T20:56:11.264 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-26T20:56:11.264 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-26T20:56:11.264 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-26T20:56:11.286 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-26T20:56:11.286 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-26T20:56:11.349 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-26T20:56:11.350 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-26T20:56:11.409 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-26T20:56:11.409 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-26T20:56:11.470 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-26T20:56:11.470 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-26T20:56:11.534 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-26T20:56:11.534 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-26T20:56:11.598 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-26T20:56:11.598 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-26T20:56:11.662 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T20:56:11.662 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-26T20:56:11.683 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T20:56:11.683 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-26T20:56:11.748 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T20:56:11.748 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-26T20:56:11.811 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T20:56:11.812 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-26T20:56:11.875 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T20:56:11.875 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-26T20:56:11.940 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T20:56:11.940 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-26T20:56:12.003 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T20:56:12.003 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-26T20:56:12.067 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-26T20:56:12.068 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-26T20:56:12.076 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-26T20:56:12.076 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-04-26T20:56:12.126 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T20:56:12.126 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-26T20:56:12.135 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T20:56:12.135 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-04-26T20:56:12.183 INFO:tasks.ceph:Adding keys to all mons... 2024-04-26T20:56:12.183 DEBUG:teuthology.orchestra.run.smithi138:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-26T20:56:12.187 DEBUG:teuthology.orchestra.run.smithi143:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-26T20:56:12.227 INFO:teuthology.orchestra.run.smithi138.stdout:[mgr.y] 2024-04-26T20:56:12.228 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQDLFCxmo2zDMRAApLkTdc3di8OH+n8zY8w1vg== 2024-04-26T20:56:12.228 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.a] 2024-04-26T20:56:12.228 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQDLFCxmrJXZORAARSUhmN08gIRiapGLE37gjw== 2024-04-26T20:56:12.228 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.c] 2024-04-26T20:56:12.228 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQDMFCxmiU2FBRAAOY06cfyEEKPfX1huoUL1QQ== 2024-04-26T20:56:12.228 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.0] 2024-04-26T20:56:12.228 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQDPFCxmTpwXFxAAQ6oQYPx1A3NitL7suYOEWw== 2024-04-26T20:56:12.228 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.1] 2024-04-26T20:56:12.228 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQDSFCxmx+0+IRAA0olAep0l6XtNS6QJ9S75+w== 2024-04-26T20:56:12.228 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.2] 2024-04-26T20:56:12.228 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQDVFCxmATOmKRAAxSBRQtLQq4KLYmyD+Voz4g== 2024-04-26T20:56:12.228 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.3] 2024-04-26T20:56:12.228 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQDYFCxmxdJlMxAAQ4lv8aphlApKCcW63BAGPw== 2024-04-26T20:56:12.228 INFO:teuthology.orchestra.run.smithi138.stdout:[mgr.x] 2024-04-26T20:56:12.229 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQDLFCxmkFapNRAA2ap9S6nUMWLIknwYDxh/QA== 2024-04-26T20:56:12.229 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.b] 2024-04-26T20:56:12.229 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQDMFCxmx/hwChAAyTzkas88xCkTCINNsLkRQw== 2024-04-26T20:56:12.229 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.d] 2024-04-26T20:56:12.229 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQDMFCxml8S1ERAAnCVWlnf6keN3XjgmQwZ92Q== 2024-04-26T20:56:12.229 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.4] 2024-04-26T20:56:12.229 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQDeFCxm1NhsKRAAbjGaVOy1yQMo2+I3byWC0w== 2024-04-26T20:56:12.229 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.5] 2024-04-26T20:56:12.229 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQDhFCxmjKAKMxAAvHCiEx7RXBd23JlHUYZkeQ== 2024-04-26T20:56:12.229 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.6] 2024-04-26T20:56:12.229 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQDlFCxmp8X7ABAAkhXysJolSCD3nlyOh905Lg== 2024-04-26T20:56:12.229 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.7] 2024-04-26T20:56:12.229 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQDoFCxm8cnBCxAAkhwWtq2IlJcXTQY2rfLdLw== 2024-04-26T20:56:12.229 INFO:teuthology.orchestra.run.smithi138.stdout:[client.0] 2024-04-26T20:56:12.229 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQDMFCxmYsCoFRAAxzCFa5FIV+BhZqore3n18A== 2024-04-26T20:56:12.229 INFO:teuthology.orchestra.run.smithi138.stdout:[client.2] 2024-04-26T20:56:12.230 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQDMFCxmMZeAGxAA46isUVFC9CHOwg04BWKyQA== 2024-04-26T20:56:12.230 INFO:teuthology.orchestra.run.smithi138.stdout:[client.1] 2024-04-26T20:56:12.230 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQDMFCxmm7MPHxAA+UHPXA6+oimymXDSAcBEgA== 2024-04-26T20:56:12.230 INFO:teuthology.orchestra.run.smithi138.stdout:[client.3] 2024-04-26T20:56:12.230 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQDMFCxmRrnmJBAAM2FqoVpEa6dMr6Ezfb1P8w== 2024-04-26T20:56:12.241 INFO:teuthology.orchestra.run.smithi143.stdout:[mgr.y] 2024-04-26T20:56:12.241 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQDLFCxmo2zDMRAApLkTdc3di8OH+n8zY8w1vg== 2024-04-26T20:56:12.241 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.a] 2024-04-26T20:56:12.241 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQDLFCxmrJXZORAARSUhmN08gIRiapGLE37gjw== 2024-04-26T20:56:12.241 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.c] 2024-04-26T20:56:12.241 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQDMFCxmiU2FBRAAOY06cfyEEKPfX1huoUL1QQ== 2024-04-26T20:56:12.241 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.0] 2024-04-26T20:56:12.241 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQDPFCxmTpwXFxAAQ6oQYPx1A3NitL7suYOEWw== 2024-04-26T20:56:12.242 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.1] 2024-04-26T20:56:12.242 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQDSFCxmx+0+IRAA0olAep0l6XtNS6QJ9S75+w== 2024-04-26T20:56:12.242 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.2] 2024-04-26T20:56:12.242 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQDVFCxmATOmKRAAxSBRQtLQq4KLYmyD+Voz4g== 2024-04-26T20:56:12.242 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.3] 2024-04-26T20:56:12.242 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQDYFCxmxdJlMxAAQ4lv8aphlApKCcW63BAGPw== 2024-04-26T20:56:12.242 INFO:teuthology.orchestra.run.smithi143.stdout:[mgr.x] 2024-04-26T20:56:12.242 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQDLFCxmkFapNRAA2ap9S6nUMWLIknwYDxh/QA== 2024-04-26T20:56:12.242 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.b] 2024-04-26T20:56:12.242 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQDMFCxmx/hwChAAyTzkas88xCkTCINNsLkRQw== 2024-04-26T20:56:12.242 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.d] 2024-04-26T20:56:12.242 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQDMFCxml8S1ERAAnCVWlnf6keN3XjgmQwZ92Q== 2024-04-26T20:56:12.242 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.4] 2024-04-26T20:56:12.242 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQDeFCxm1NhsKRAAbjGaVOy1yQMo2+I3byWC0w== 2024-04-26T20:56:12.242 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.5] 2024-04-26T20:56:12.243 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQDhFCxmjKAKMxAAvHCiEx7RXBd23JlHUYZkeQ== 2024-04-26T20:56:12.243 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.6] 2024-04-26T20:56:12.243 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQDlFCxmp8X7ABAAkhXysJolSCD3nlyOh905Lg== 2024-04-26T20:56:12.243 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.7] 2024-04-26T20:56:12.243 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQDoFCxm8cnBCxAAkhwWtq2IlJcXTQY2rfLdLw== 2024-04-26T20:56:12.243 INFO:teuthology.orchestra.run.smithi143.stdout:[client.0] 2024-04-26T20:56:12.243 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQDMFCxmYsCoFRAAxzCFa5FIV+BhZqore3n18A== 2024-04-26T20:56:12.243 INFO:teuthology.orchestra.run.smithi143.stdout:[client.2] 2024-04-26T20:56:12.243 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQDMFCxmMZeAGxAA46isUVFC9CHOwg04BWKyQA== 2024-04-26T20:56:12.243 INFO:teuthology.orchestra.run.smithi143.stdout:[client.1] 2024-04-26T20:56:12.243 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQDMFCxmm7MPHxAA+UHPXA6+oimymXDSAcBEgA== 2024-04-26T20:56:12.243 INFO:teuthology.orchestra.run.smithi143.stdout:[client.3] 2024-04-26T20:56:12.243 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQDMFCxmRrnmJBAAM2FqoVpEa6dMr6Ezfb1P8w== 2024-04-26T20:56:12.244 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T20:56:12.277 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T20:56:12.343 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T20:56:12.346 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T20:56:12.403 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T20:56:12.406 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T20:56:12.461 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T20:56:12.464 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T20:56:12.517 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T20:56:12.520 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T20:56:12.574 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T20:56:12.577 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T20:56:12.631 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T20:56:12.634 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T20:56:12.687 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T20:56:12.690 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T20:56:12.743 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T20:56:12.746 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T20:56:12.801 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T20:56:12.804 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T20:56:12.860 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T20:56:12.864 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T20:56:12.917 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T20:56:12.920 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T20:56:12.972 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T20:56:12.975 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T20:56:13.029 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T20:56:13.032 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T20:56:13.084 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T20:56:13.087 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T20:56:13.143 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T20:56:13.146 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T20:56:13.202 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T20:56:13.205 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T20:56:13.261 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T20:56:13.264 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T20:56:13.320 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-26T20:56:13.320 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-26T20:56:13.339 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T20:56:13.446 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-26T20:56:13.466 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-26T20:56:13.485 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T20:56:13.593 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-26T20:56:13.612 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-26T20:56:13.674 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T20:56:13.780 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-26T20:56:13.800 DEBUG:teuthology.orchestra.run.smithi138:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-26T20:56:13.803 DEBUG:teuthology.orchestra.run.smithi143:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-26T20:56:13.851 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-26T20:56:13.851 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-26T20:56:13.851 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-26T20:56:13.854 INFO:tasks.ceph.mon.a:Started 2024-04-26T20:56:13.854 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-26T20:56:13.854 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-26T20:56:13.894 INFO:tasks.ceph.mon.b:Started 2024-04-26T20:56:13.894 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-26T20:56:13.894 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-26T20:56:13.897 INFO:tasks.ceph.mon.c:Started 2024-04-26T20:56:13.897 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-26T20:56:13.897 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-26T20:56:13.898 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-26T20:56:13.900 INFO:tasks.ceph.mgr.y:Started 2024-04-26T20:56:13.901 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-26T20:56:13.901 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-26T20:56:13.904 INFO:tasks.ceph.mgr.x:Started 2024-04-26T20:56:13.904 INFO:tasks.ceph:Setting crush tunables to default 2024-04-26T20:56:13.904 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd crush tunables default 2024-04-26T20:56:14.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.039+0000 7f2a7a400640 1 Processor -- start 2024-04-26T20:56:14.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.039+0000 7f2a7a400640 1 -- start start 2024-04-26T20:56:14.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.043+0000 7f2a7a400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2a7415b730 0x7f2a74073e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:14.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.043+0000 7f2a7a400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2a7406ee80 0x7f2a740ce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:14.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.043+0000 7f2a7a400640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a740cbe40 con 0x7f2a740738e0 2024-04-26T20:56:14.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.043+0000 7f2a7a400640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f2a740cbbf0 con 0x7f2a7406ee80 2024-04-26T20:56:14.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.043+0000 7f2a7a400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f2a740731c0 con 0x7f2a7415b730 2024-04-26T20:56:14.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.043+0000 7f2a73e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2a7406ee80 0x7f2a740ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:14.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.043+0000 7f2a6aa00640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f2a740738e0 0x7f2a7406e770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.138:41424/0 (socket says 172.21.15.138:41424) 2024-04-26T20:56:14.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.043+0000 7f2a6aa00640 1 -- 172.21.15.138:0/172138338 learned_addr learned my addr 172.21.15.138:0/172138338 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:56:14.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.043+0000 7f2a73400640 1 --2- 172.21.15.138:0/172138338 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2a7415b730 0x7f2a74073e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:14.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.043+0000 7f2a73e00640 1 -- 172.21.15.138:0/172138338 >> v2:172.21.15.138:3300/0 conn(0x7f2a7406ee80 msgr2=0x7f2a740ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T20:56:14.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.043+0000 7f2a73e00640 1 -- 172.21.15.138:0/172138338 >> v2:172.21.15.138:3300/0 conn(0x7f2a7406ee80 msgr2=0x7f2a740ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T20:56:14.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.043+0000 7f2a73e00640 1 --2- 172.21.15.138:0/172138338 >> v2:172.21.15.138:3300/0 conn(0x7f2a7406ee80 0x7f2a740ce780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T20:56:14.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.043+0000 7f2a73400640 1 -- 172.21.15.138:0/172138338 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2a7415b730 msgr2=0x7f2a74073e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T20:56:14.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.043+0000 7f2a73400640 1 -- 172.21.15.138:0/172138338 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2a7415b730 msgr2=0x7f2a74073e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T20:56:14.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.043+0000 7f2a73400640 1 --2- 172.21.15.138:0/172138338 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2a7415b730 0x7f2a74073e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T20:56:14.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.043+0000 7f2a73400640 1 --2- 172.21.15.138:0/172138338 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2a7415b730 0x7f2a74073e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T20:56:14.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.043+0000 7f2a73e00640 1 --2- 172.21.15.138:0/172138338 >> v2:172.21.15.138:3300/0 conn(0x7f2a7406ee80 0x7f2a740ce780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T20:56:14.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.203+0000 7f2a72a00640 1 -- 172.21.15.138:0/172138338 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4141233063 0 0) 0x7f2a740cbe40 con 0x7f2a740738e0 2024-04-26T20:56:14.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.203+0000 7f2a72a00640 1 -- 172.21.15.138:0/172138338 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a58005740 con 0x7f2a740738e0 2024-04-26T20:56:14.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.207+0000 7f2a72a00640 1 -- 172.21.15.138:0/172138338 <== mon.1 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3576655561 0 0) 0x7f2a58005740 con 0x7f2a740738e0 2024-04-26T20:56:14.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.207+0000 7f2a72a00640 1 -- 172.21.15.138:0/172138338 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2a7415b730 msgr2=0x7f2a74073e10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:56:14.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.207+0000 7f2a72a00640 1 --2- 172.21.15.138:0/172138338 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2a7415b730 0x7f2a74073e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:14.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.207+0000 7f2a72a00640 1 -- 172.21.15.138:0/172138338 >> v2:172.21.15.138:3300/0 conn(0x7f2a7406ee80 msgr2=0x7f2a740ce780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:56:14.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.207+0000 7f2a72a00640 1 --2- 172.21.15.138:0/172138338 >> v2:172.21.15.138:3300/0 conn(0x7f2a7406ee80 0x7f2a740ce780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:14.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.207+0000 7f2a72a00640 1 -- 172.21.15.138:0/172138338 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a740cc120 con 0x7f2a740738e0 2024-04-26T20:56:14.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.207+0000 7f2a72a00640 1 -- 172.21.15.138:0/172138338 <== mon.1 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2715389689 0 0) 0x7f2a5c001680 con 0x7f2a740738e0 2024-04-26T20:56:14.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.207+0000 7f2a72a00640 1 -- 172.21.15.138:0/172138338 >> v1:172.21.15.143:6789/0 conn(0x7f2a740738e0 legacy=0x7f2a7406e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:14.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.207+0000 7f2a72a00640 1 --2- 172.21.15.138:0/172138338 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2a7415b730 0x7f2a58005c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:14.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.207+0000 7f2a72a00640 1 --2- 172.21.15.138:0/172138338 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2a58006180 0x7f2a58006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:14.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.207+0000 7f2a72a00640 1 --2- 172.21.15.138:0/172138338 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a58006f60 0x7f2a580073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:14.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.207+0000 7f2a72a00640 1 -- 172.21.15.138:0/172138338 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f2a740cbbf0 con 0x7f2a58006180 2024-04-26T20:56:14.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.207+0000 7f2a72a00640 1 -- 172.21.15.138:0/172138338 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f2a740731c0 con 0x7f2a58006f60 2024-04-26T20:56:14.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.207+0000 7f2a72a00640 1 -- 172.21.15.138:0/172138338 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f2a5800ffe0 con 0x7f2a7415b730 2024-04-26T20:56:14.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.207+0000 7f2a73400640 1 --2- 172.21.15.138:0/172138338 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2a7415b730 0x7f2a58005c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:14.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.207+0000 7f2a6aa00640 1 --2- 172.21.15.138:0/172138338 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2a58006180 0x7f2a58006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:14.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.207+0000 7f2a73e00640 1 --2- 172.21.15.138:0/172138338 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a58006f60 0x7f2a580073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:14.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.207+0000 7f2a6aa00640 1 -- 172.21.15.138:0/172138338 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2a7415b730 msgr2=0x7f2a58005c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:14.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.207+0000 7f2a6aa00640 1 --2- 172.21.15.138:0/172138338 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2a7415b730 0x7f2a58005c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:14.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.207+0000 7f2a6aa00640 1 -- 172.21.15.138:0/172138338 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a58006f60 msgr2=0x7f2a580073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:14.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.207+0000 7f2a6aa00640 1 --2- 172.21.15.138:0/172138338 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a58006f60 0x7f2a580073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:14.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.207+0000 7f2a6aa00640 1 -- 172.21.15.138:0/172138338 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a740cc120 con 0x7f2a58006180 2024-04-26T20:56:14.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.207+0000 7f2a73e00640 1 --2- 172.21.15.138:0/172138338 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a58006f60 0x7f2a580073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:56:14.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.211+0000 7f2a6aa00640 1 --2- 172.21.15.138:0/172138338 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2a58006180 0x7f2a58006a20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c00c340 tx=0x7f2a5c01f510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42c671f359ad9455 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:14.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.211+0000 7f2a72a00640 1 -- 172.21.15.138:0/172138338 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c007e60 con 0x7f2a58006180 2024-04-26T20:56:14.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.211+0000 7f2a72a00640 1 -- 172.21.15.138:0/172138338 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a5c005b00 con 0x7f2a58006180 2024-04-26T20:56:14.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.211+0000 7f2a72a00640 1 -- 172.21.15.138:0/172138338 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c007070 con 0x7f2a58006180 2024-04-26T20:56:14.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.211+0000 7f2a7a400640 1 -- 172.21.15.138:0/172138338 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2a58006180 msgr2=0x7f2a58006a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:14.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.211+0000 7f2a7a400640 1 --2- 172.21.15.138:0/172138338 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2a58006180 0x7f2a58006a20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c00c340 tx=0x7f2a5c01f510 comp rx=0 tx=0).stop 2024-04-26T20:56:14.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.211+0000 7f2a73e00640 1 -- 172.21.15.138:0/172138338 reap_dead start 2024-04-26T20:56:14.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.211+0000 7f2a7a400640 1 -- 172.21.15.138:0/172138338 shutdown_connections 2024-04-26T20:56:14.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.211+0000 7f2a7a400640 1 -- 172.21.15.138:0/172138338 >> 172.21.15.138:0/172138338 conn(0x7f2a740d0bb0 msgr2=0x7f2a740d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:14.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.211+0000 7f2a7a400640 1 -- 172.21.15.138:0/172138338 shutdown_connections 2024-04-26T20:56:14.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.211+0000 7f2a7a400640 1 -- 172.21.15.138:0/172138338 wait complete. 2024-04-26T20:56:14.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.215+0000 7f2a7a400640 1 Processor -- start 2024-04-26T20:56:14.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.215+0000 7f2a7a400640 1 -- start start 2024-04-26T20:56:14.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.215+0000 7f2a7a400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2a58006180 0x7f2a740c96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:14.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.215+0000 7f2a7a400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2a74154630 0x7f2a740c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:14.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.215+0000 7f2a7a400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a740b6010 0x7f2a740b64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:14.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.215+0000 7f2a7a400640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f2a74073650 con 0x7f2a74154630 2024-04-26T20:56:14.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.215+0000 7f2a7a400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f2a74072e50 con 0x7f2a740b6010 2024-04-26T20:56:14.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.215+0000 7f2a7a400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f2a74073e10 con 0x7f2a58006180 2024-04-26T20:56:14.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.215+0000 7f2a6aa00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2a74154630 0x7f2a740c8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:14.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.215+0000 7f2a73400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2a58006180 0x7f2a740c96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:14.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.215+0000 7f2a73400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2a58006180 0x7f2a740c96c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.138:58722/0 (socket says 172.21.15.138:58722) 2024-04-26T20:56:14.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.215+0000 7f2a73e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a740b6010 0x7f2a740b64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:14.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.215+0000 7f2a73400640 1 -- 172.21.15.138:0/2134764310 learned_addr learned my addr 172.21.15.138:0/2134764310 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:14.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.219+0000 7f2a6aa00640 1 -- 172.21.15.138:0/2134764310 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2a58006180 msgr2=0x7f2a740c96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:14.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.219+0000 7f2a6aa00640 1 --2- 172.21.15.138:0/2134764310 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2a58006180 0x7f2a740c96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:14.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.219+0000 7f2a6aa00640 1 -- 172.21.15.138:0/2134764310 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a740b6010 msgr2=0x7f2a740b64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:14.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.219+0000 7f2a6aa00640 1 --2- 172.21.15.138:0/2134764310 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a740b6010 0x7f2a740b64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:14.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.219+0000 7f2a6aa00640 1 -- 172.21.15.138:0/2134764310 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a740c9d50 con 0x7f2a74154630 2024-04-26T20:56:14.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.219+0000 7f2a73400640 1 --2- 172.21.15.138:0/2134764310 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2a58006180 0x7f2a740c96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:56:14.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.219+0000 7f2a73e00640 1 --2- 172.21.15.138:0/2134764310 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a740b6010 0x7f2a740b64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:56:14.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.219+0000 7f2a6aa00640 1 --2- 172.21.15.138:0/2134764310 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2a74154630 0x7f2a740c8c00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c009000 tx=0x7f2a58007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:14.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.219+0000 7f2a6be00640 1 -- 172.21.15.138:0/2134764310 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c005d30 con 0x7f2a74154630 2024-04-26T20:56:14.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.219+0000 7f2a6be00640 1 -- 172.21.15.138:0/2134764310 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a5c0047f0 con 0x7f2a74154630 2024-04-26T20:56:14.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.219+0000 7f2a6be00640 1 -- 172.21.15.138:0/2134764310 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c004ba0 con 0x7f2a74154630 2024-04-26T20:56:14.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.219+0000 7f2a7a400640 1 -- 172.21.15.138:0/2134764310 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a740ca030 con 0x7f2a74154630 2024-04-26T20:56:14.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.219+0000 7f2a7a400640 1 -- 172.21.15.138:0/2134764310 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a740b3c30 con 0x7f2a74154630 2024-04-26T20:56:14.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.219+0000 7f2a6be00640 1 -- 172.21.15.138:0/2134764310 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2a5c0b9030 con 0x7f2a74154630 2024-04-26T20:56:14.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.219+0000 7f2a6be00640 1 -- 172.21.15.138:0/2134764310 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2a5c0b0b60 con 0x7f2a74154630 2024-04-26T20:56:14.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.219+0000 7f2a7a400640 1 -- 172.21.15.138:0/2134764310 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a74069430 con 0x7f2a74154630 2024-04-26T20:56:14.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.243+0000 7f2a6be00640 1 -- 172.21.15.138:0/2134764310 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f2a5c0a8e20 con 0x7f2a74154630 2024-04-26T20:56:14.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.323+0000 7f2a7a400640 1 -- 172.21.15.138:0/2134764310 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f2a740d19c0 con 0x7f2a74154630 2024-04-26T20:56:14.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.327+0000 7f2a6be00640 1 -- 172.21.15.138:0/2134764310 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f2a5c019220 con 0x7f2a74154630 2024-04-26T20:56:14.328 INFO:teuthology.orchestra.run.smithi138.stderr:adjusted tunables profile to default 2024-04-26T20:56:14.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.327+0000 7f2a7a400640 1 -- 172.21.15.138:0/2134764310 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2a74154630 msgr2=0x7f2a740c8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:14.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.327+0000 7f2a7a400640 1 --2- 172.21.15.138:0/2134764310 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2a74154630 0x7f2a740c8c00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c009000 tx=0x7f2a58007a50 comp rx=0 tx=0).stop 2024-04-26T20:56:14.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.327+0000 7f2a7a400640 1 -- 172.21.15.138:0/2134764310 shutdown_connections 2024-04-26T20:56:14.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.327+0000 7f2a7a400640 1 --2- 172.21.15.138:0/2134764310 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a740b6010 0x7f2a740b64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:14.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.327+0000 7f2a7a400640 1 --2- 172.21.15.138:0/2134764310 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2a74154630 0x7f2a740c8c00 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:14.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.327+0000 7f2a7a400640 1 --2- 172.21.15.138:0/2134764310 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2a58006180 0x7f2a740c96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:14.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.327+0000 7f2a7a400640 1 -- 172.21.15.138:0/2134764310 >> 172.21.15.138:0/2134764310 conn(0x7f2a740d0bb0 msgr2=0x7f2a7406dee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:14.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.327+0000 7f2a7a400640 1 -- 172.21.15.138:0/2134764310 shutdown_connections 2024-04-26T20:56:14.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:14.327+0000 7f2a7a400640 1 -- 172.21.15.138:0/2134764310 wait complete. 2024-04-26T20:56:14.357 INFO:tasks.ceph:check_enable_crimson: False 2024-04-26T20:56:14.357 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-26T20:56:14.357 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-26T20:56:14.357 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-26T20:56:14.378 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-26T20:56:14.378 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-26T20:56:14.420 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-04-26T20:56:14.421+0000 7f3d6a42c180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T20:56:14.437 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-26T20:56:14.437 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-26T20:56:14.447 INFO:tasks.ceph.mgr.y.smithi138.stderr:2024-04-26T20:56:14.447+0000 7f146ec2c180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T20:56:14.467 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-26T20:56:14.467 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-26T20:56:14.530 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T20:56:14.530 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-26T20:56:14.549 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T20:56:14.549 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-26T20:56:14.611 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T20:56:14.611 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-26T20:56:14.674 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T20:56:14.674 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-26T20:56:14.739 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --cluster ceph osd new 3f9a2e34-3199-466f-a6cf-57927318121e 0 2024-04-26T20:56:14.911 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-04-26T20:56:14.909+0000 7f3d6a42c180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T20:56:14.915 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.913+0000 7fa6e6a00640 1 Processor -- start 2024-04-26T20:56:14.915 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.913+0000 7fa6e6a00640 1 -- start start 2024-04-26T20:56:14.916 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.917+0000 7fa6e6a00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa6e00b4750 0x7fa6e00b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:14.917 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.917+0000 7fa6e6a00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6e006e570 con 0x7fa6e0070020 2024-04-26T20:56:14.917 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.917+0000 7fa6e6a00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6e00b5f80 con 0x7fa6e00b5070 2024-04-26T20:56:14.917 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.917+0000 7fa6e6a00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fa6e00b6260 con 0x7fa6e00b4750 2024-04-26T20:56:14.917 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.917+0000 7fa6df400640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fa6e00b5070 0x7fa6e00b5500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:53778/0 (socket says 172.21.15.143:53778) 2024-04-26T20:56:14.917 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.917+0000 7fa6df400640 1 -- 172.21.15.143:0/531722685 learned_addr learned my addr 172.21.15.143:0/531722685 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-04-26T20:56:14.917 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.917+0000 7fa6dfe00640 1 --2- 172.21.15.143:0/531722685 >> v2:172.21.15.138:3300/0 conn(0x7fa6e00b4750 0x7fa6e00b4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:14.918 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.917+0000 7fa6dea00640 1 -- 172.21.15.143:0/531722685 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1680695788 0 0) 0x7fa6e00b5f80 con 0x7fa6e00b5070 2024-04-26T20:56:14.918 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.917+0000 7fa6dea00640 1 -- 172.21.15.143:0/531722685 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6c4003530 con 0x7fa6e00b5070 2024-04-26T20:56:14.918 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.917+0000 7fa6dea00640 1 -- 172.21.15.143:0/531722685 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1441846263 0 0) 0x7fa6e006e570 con 0x7fa6e0070020 2024-04-26T20:56:14.918 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.917+0000 7fa6dea00640 1 -- 172.21.15.143:0/531722685 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6e00b5f80 con 0x7fa6e0070020 2024-04-26T20:56:14.918 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.917+0000 7fa6dfe00640 1 -- 172.21.15.143:0/531722685 >> v1:172.21.15.143:6789/0 conn(0x7fa6e00b5070 legacy=0x7fa6e00b5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:14.918 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.917+0000 7fa6dfe00640 1 -- 172.21.15.143:0/531722685 >> v1:172.21.15.138:6789/0 conn(0x7fa6e0070020 legacy=0x7fa6e0168c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:14.918 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.917+0000 7fa6dfe00640 1 -- 172.21.15.143:0/531722685 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6e006e810 con 0x7fa6e00b4750 2024-04-26T20:56:14.920 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.921+0000 7fa6dfe00640 1 --2- 172.21.15.143:0/531722685 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6e00b4750 0x7fa6e00b4b30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa6d00097c0 tx=0x7fa6d001c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=254f1e89c57fd9d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:14.921 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.921+0000 7fa6dea00640 1 -- 172.21.15.143:0/531722685 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d00b0070 con 0x7fa6e00b4750 2024-04-26T20:56:14.921 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.921+0000 7fa6dea00640 1 -- 172.21.15.143:0/531722685 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6d00ab600 con 0x7fa6e00b4750 2024-04-26T20:56:14.921 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.921+0000 7fa6dea00640 1 -- 172.21.15.143:0/531722685 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d00ab9d0 con 0x7fa6e00b4750 2024-04-26T20:56:14.922 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.921+0000 7fa6e6a00640 1 -- 172.21.15.143:0/531722685 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6e00b4750 msgr2=0x7fa6e00b4b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:14.922 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.921+0000 7fa6e6a00640 1 --2- 172.21.15.143:0/531722685 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6e00b4750 0x7fa6e00b4b30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa6d00097c0 tx=0x7fa6d001c380 comp rx=0 tx=0).stop 2024-04-26T20:56:14.922 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.921+0000 7fa6e6a00640 1 -- 172.21.15.143:0/531722685 shutdown_connections 2024-04-26T20:56:14.922 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.921+0000 7fa6e6a00640 1 --2- 172.21.15.143:0/531722685 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6e00b4750 0x7fa6e00b4b30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:14.922 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.921+0000 7fa6e6a00640 1 -- 172.21.15.143:0/531722685 >> 172.21.15.143:0/531722685 conn(0x7fa6e00b2be0 msgr2=0x7fa6e00b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:14.922 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.921+0000 7fa6e6a00640 1 -- 172.21.15.143:0/531722685 shutdown_connections 2024-04-26T20:56:14.922 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.921+0000 7fa6e6a00640 1 -- 172.21.15.143:0/531722685 wait complete. 2024-04-26T20:56:14.923 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.921+0000 7fa6e6a00640 1 Processor -- start 2024-04-26T20:56:14.923 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.921+0000 7fa6e6a00640 1 -- start start 2024-04-26T20:56:14.925 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.921+0000 7fa6e6a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa6e00b4750 0x7fa6e015a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:14.925 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.925+0000 7fa6e6a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa6e00b5070 0x7fa6e00ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:14.925 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.925+0000 7fa6e6a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6e015dca0 0x7fa6e009dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:14.925 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.925+0000 7fa6e6a00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e016cf30 con 0x7fa6e015dca0 2024-04-26T20:56:14.925 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.925+0000 7fa6e6a00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e016cdb0 con 0x7fa6e00b5070 2024-04-26T20:56:14.925 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.925+0000 7fa6e6a00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fa6e016d0b0 con 0x7fa6e00b4750 2024-04-26T20:56:14.925 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.925+0000 7fa6df400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa6e00b5070 0x7fa6e00ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:14.925 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.925+0000 7fa6dfe00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa6e00b4750 0x7fa6e015a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:14.925 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.925+0000 7fa6df400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa6e00b5070 0x7fa6e00ccd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:42050/0 (socket says 172.21.15.143:42050) 2024-04-26T20:56:14.925 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.925+0000 7fa6df400640 1 -- 172.21.15.143:0/968552063 learned_addr learned my addr 172.21.15.143:0/968552063 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-04-26T20:56:14.925 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.925+0000 7fa6e4a00640 1 --2- 172.21.15.143:0/968552063 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6e015dca0 0x7fa6e009dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:14.925 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.925+0000 7fa6dfe00640 1 -- 172.21.15.143:0/968552063 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa6e00b5070 msgr2=0x7fa6e00ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:14.925 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.925+0000 7fa6dfe00640 1 --2- 172.21.15.143:0/968552063 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa6e00b5070 0x7fa6e00ccd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:14.926 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.925+0000 7fa6dfe00640 1 -- 172.21.15.143:0/968552063 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6e015dca0 msgr2=0x7fa6e009dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:14.926 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.925+0000 7fa6dfe00640 1 --2- 172.21.15.143:0/968552063 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6e015dca0 0x7fa6e009dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:14.926 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.925+0000 7fa6dfe00640 1 -- 172.21.15.143:0/968552063 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6e015e180 con 0x7fa6e00b4750 2024-04-26T20:56:14.927 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.925+0000 7fa6dfe00640 1 --2- 172.21.15.143:0/968552063 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa6e00b4750 0x7fa6e015a620 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa6e006e740 tx=0x7fa6d0019120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:14.927 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.925+0000 7fa6d7e00640 1 -- 172.21.15.143:0/968552063 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d00b0040 con 0x7fa6e00b4750 2024-04-26T20:56:14.927 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.925+0000 7fa6d7e00640 1 -- 172.21.15.143:0/968552063 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6d00b9070 con 0x7fa6e00b4750 2024-04-26T20:56:14.927 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.925+0000 7fa6d7e00640 1 -- 172.21.15.143:0/968552063 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d00b4670 con 0x7fa6e00b4750 2024-04-26T20:56:14.927 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.925+0000 7fa6e6a00640 1 -- 172.21.15.143:0/968552063 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6e015e460 con 0x7fa6e00b4750 2024-04-26T20:56:14.927 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.925+0000 7fa6e6a00640 1 -- 172.21.15.143:0/968552063 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6e00cefd0 con 0x7fa6e00b4750 2024-04-26T20:56:14.927 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.925+0000 7fa6d7e00640 1 -- 172.21.15.143:0/968552063 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa6d00b4810 con 0x7fa6e00b4750 2024-04-26T20:56:14.927 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.925+0000 7fa6d7e00640 1 -- 172.21.15.143:0/968552063 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fa6d00be780 con 0x7fa6e00b4750 2024-04-26T20:56:14.927 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.925+0000 7fa6e6a00640 1 -- 172.21.15.143:0/968552063 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6e0069b40 con 0x7fa6e00b4750 2024-04-26T20:56:14.929 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.929+0000 7fa6d7e00640 1 -- 172.21.15.143:0/968552063 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fa6d0016090 con 0x7fa6e00b4750 2024-04-26T20:56:14.956 INFO:tasks.ceph.mgr.y.smithi138.stderr:2024-04-26T20:56:14.955+0000 7f146ec2c180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T20:56:14.995 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:14.993+0000 7fa6e6a00640 1 -- 172.21.15.143:0/968552063 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3f9a2e34-3199-466f-a6cf-57927318121e", "id": 0} v 0) -- 0x7fa6e0074200 con 0x7fa6e00b4750 2024-04-26T20:56:15.001 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.001+0000 7fa6d7e00640 1 -- 172.21.15.143:0/968552063 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3f9a2e34-3199-466f-a6cf-57927318121e", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fa6d00059a0 con 0x7fa6e00b4750 2024-04-26T20:56:15.001 INFO:teuthology.orchestra.run.smithi143.stdout:0 2024-04-26T20:56:15.002 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.001+0000 7fa6e6a00640 1 -- 172.21.15.143:0/968552063 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa6e00b4750 msgr2=0x7fa6e015a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:15.002 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.001+0000 7fa6e6a00640 1 --2- 172.21.15.143:0/968552063 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa6e00b4750 0x7fa6e015a620 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa6e006e740 tx=0x7fa6d0019120 comp rx=0 tx=0).stop 2024-04-26T20:56:15.002 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.001+0000 7fa6e6a00640 1 -- 172.21.15.143:0/968552063 shutdown_connections 2024-04-26T20:56:15.002 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.001+0000 7fa6e6a00640 1 --2- 172.21.15.143:0/968552063 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6e015dca0 0x7fa6e009dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:15.002 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.001+0000 7fa6e6a00640 1 --2- 172.21.15.143:0/968552063 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa6e00b5070 0x7fa6e00ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:15.002 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.001+0000 7fa6e6a00640 1 --2- 172.21.15.143:0/968552063 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa6e00b4750 0x7fa6e015a620 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:15.002 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.001+0000 7fa6e6a00640 1 -- 172.21.15.143:0/968552063 >> 172.21.15.143:0/968552063 conn(0x7fa6e00b2be0 msgr2=0x7fa6e00b54e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:15.003 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.001+0000 7fa6e6a00640 1 -- 172.21.15.143:0/968552063 shutdown_connections 2024-04-26T20:56:15.003 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.001+0000 7fa6e6a00640 1 -- 172.21.15.143:0/968552063 wait complete. 2024-04-26T20:56:15.020 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --cluster ceph osd new e881fcf6-3248-4696-a2ef-95d206d77712 1 2024-04-26T20:56:15.150 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-04-26T20:56:15.149+0000 7f3d6a42c180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T20:56:15.155 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.153+0000 7f53dc800640 1 Processor -- start 2024-04-26T20:56:15.156 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.153+0000 7f53dc800640 1 -- start start 2024-04-26T20:56:15.157 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.157+0000 7f53dc800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f53d40d1a50 0x7f53d40d0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:15.157 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.157+0000 7f53dc800640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f53d40cfd40 0x7f53d40b2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:15.157 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.157+0000 7f53dc800640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53d40cedf0 con 0x7f53d415d0d0 2024-04-26T20:56:15.158 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.157+0000 7f53dc800640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f53d40d3920 con 0x7f53d40d1a50 2024-04-26T20:56:15.158 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.157+0000 7f53dc800640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f53d40d3c00 con 0x7f53d40cfd40 2024-04-26T20:56:15.158 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.157+0000 7f53d9e00640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f53d415d0d0 0x7f53d40d1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:53790/0 (socket says 172.21.15.143:53790) 2024-04-26T20:56:15.158 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.157+0000 7f53d9e00640 1 -- 172.21.15.143:0/2151937263 learned_addr learned my addr 172.21.15.143:0/2151937263 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-04-26T20:56:15.158 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.157+0000 7f53da800640 1 --2- 172.21.15.143:0/2151937263 >> v2:172.21.15.143:3300/0 conn(0x7f53d40cfd40 0x7f53d40b2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:15.158 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.157+0000 7f53d9400640 1 --2- 172.21.15.143:0/2151937263 >> v2:172.21.15.138:3300/0 conn(0x7f53d40d1a50 0x7f53d40d0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:15.158 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.157+0000 7f53d8a00640 1 -- 172.21.15.143:0/2151937263 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1250200738 0 0) 0x7f53d40cedf0 con 0x7f53d415d0d0 2024-04-26T20:56:15.158 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.157+0000 7f53d8a00640 1 -- 172.21.15.143:0/2151937263 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53bc003530 con 0x7f53d415d0d0 2024-04-26T20:56:15.158 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.157+0000 7f53da800640 1 -- 172.21.15.143:0/2151937263 >> v2:172.21.15.138:3300/0 conn(0x7f53d40d1a50 msgr2=0x7f53d40d0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:15.158 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.157+0000 7f53da800640 1 --2- 172.21.15.143:0/2151937263 >> v2:172.21.15.138:3300/0 conn(0x7f53d40d1a50 0x7f53d40d0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:15.158 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.157+0000 7f53da800640 1 -- 172.21.15.143:0/2151937263 >> v1:172.21.15.143:6789/0 conn(0x7f53d415d0d0 legacy=0x7f53d40d1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:15.158 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.157+0000 7f53da800640 1 -- 172.21.15.143:0/2151937263 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53d40b22f0 con 0x7f53d40cfd40 2024-04-26T20:56:15.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.161+0000 7f53da800640 1 --2- 172.21.15.143:0/2151937263 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f53d40cfd40 0x7f53d40b2ad0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f53d40d2b00 tx=0x7f53d001c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=addf8172a1dbc223 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:15.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.161+0000 7f53d8a00640 1 -- 172.21.15.143:0/2151937263 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d00b2070 con 0x7f53d40cfd40 2024-04-26T20:56:15.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.161+0000 7f53d8a00640 1 -- 172.21.15.143:0/2151937263 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53d00a59e0 con 0x7f53d40cfd40 2024-04-26T20:56:15.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.161+0000 7f53d8a00640 1 -- 172.21.15.143:0/2151937263 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d00a5db0 con 0x7f53d40cfd40 2024-04-26T20:56:15.162 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.161+0000 7f53dc800640 1 -- 172.21.15.143:0/2151937263 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f53d40cfd40 msgr2=0x7f53d40b2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:15.162 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.161+0000 7f53dc800640 1 --2- 172.21.15.143:0/2151937263 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f53d40cfd40 0x7f53d40b2ad0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f53d40d2b00 tx=0x7f53d001c900 comp rx=0 tx=0).stop 2024-04-26T20:56:15.162 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.161+0000 7f53dc800640 1 -- 172.21.15.143:0/2151937263 shutdown_connections 2024-04-26T20:56:15.162 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.161+0000 7f53dc800640 1 --2- 172.21.15.143:0/2151937263 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f53d40cfd40 0x7f53d40b2ad0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:15.162 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.161+0000 7f53dc800640 1 --2- 172.21.15.143:0/2151937263 >> v2:172.21.15.138:3300/0 conn(0x7f53d40d1a50 0x7f53d40d0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:15.162 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.161+0000 7f53dc800640 1 -- 172.21.15.143:0/2151937263 >> 172.21.15.143:0/2151937263 conn(0x7f53d40d2d60 msgr2=0x7f53d40d3170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:15.162 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.161+0000 7f53dc800640 1 -- 172.21.15.143:0/2151937263 shutdown_connections 2024-04-26T20:56:15.162 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.161+0000 7f53dc800640 1 -- 172.21.15.143:0/2151937263 wait complete. 2024-04-26T20:56:15.163 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.161+0000 7f53dc800640 1 Processor -- start 2024-04-26T20:56:15.163 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.161+0000 7f53dc800640 1 -- start start 2024-04-26T20:56:15.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.165+0000 7f53dc800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f53d40cfd40 0x7f53d40ca840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:15.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.165+0000 7f53dc800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f53d40d1a50 0x7f53d40c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:15.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.165+0000 7f53dc800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f53d415d0d0 0x7f53d40a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:15.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.165+0000 7f53dc800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f53d40b3820 con 0x7f53d40cfd40 2024-04-26T20:56:15.165 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.165+0000 7f53dc800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f53d40ceb90 con 0x7f53d40d1a50 2024-04-26T20:56:15.165 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.165+0000 7f53dc800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f53d40b39a0 con 0x7f53d415d0d0 2024-04-26T20:56:15.165 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.165+0000 7f53d9400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f53d40d1a50 0x7f53d40c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:15.165 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.165+0000 7f53d9400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f53d40d1a50 0x7f53d40c8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:42074/0 (socket says 172.21.15.143:42074) 2024-04-26T20:56:15.165 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.165+0000 7f53da800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f53d415d0d0 0x7f53d40a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:15.165 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.165+0000 7f53d9400640 1 -- 172.21.15.143:0/3475773414 learned_addr learned my addr 172.21.15.143:0/3475773414 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-04-26T20:56:15.166 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.165+0000 7f53da800640 1 -- 172.21.15.143:0/3475773414 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f53d40d1a50 msgr2=0x7f53d40c8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:15.166 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.165+0000 7f53d9e00640 1 --2- 172.21.15.143:0/3475773414 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f53d40cfd40 0x7f53d40ca840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:15.167 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.165+0000 7f53da800640 1 --2- 172.21.15.143:0/3475773414 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f53d40d1a50 0x7f53d40c8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:15.167 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.165+0000 7f53da800640 1 -- 172.21.15.143:0/3475773414 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f53d40cfd40 msgr2=0x7f53d40ca840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:15.167 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.165+0000 7f53da800640 1 --2- 172.21.15.143:0/3475773414 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f53d40cfd40 0x7f53d40ca840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:15.167 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.165+0000 7f53da800640 1 -- 172.21.15.143:0/3475773414 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53d40cb770 con 0x7f53d415d0d0 2024-04-26T20:56:15.167 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.165+0000 7f53d9400640 1 --2- 172.21.15.143:0/3475773414 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f53d40d1a50 0x7f53d40c8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:56:15.167 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.165+0000 7f53d9e00640 1 --2- 172.21.15.143:0/3475773414 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f53d40cfd40 0x7f53d40ca840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:56:15.167 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.165+0000 7f53da800640 1 --2- 172.21.15.143:0/3475773414 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f53d415d0d0 0x7f53d40a06b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f53d00ac000 tx=0x7f53d00196a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:15.167 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.165+0000 7f53ce000640 1 -- 172.21.15.143:0/3475773414 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d00b2050 con 0x7f53d415d0d0 2024-04-26T20:56:15.167 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.165+0000 7f53ce000640 1 -- 172.21.15.143:0/3475773414 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53d00b3040 con 0x7f53d415d0d0 2024-04-26T20:56:15.167 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.165+0000 7f53dc800640 1 -- 172.21.15.143:0/3475773414 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53d40caed0 con 0x7f53d415d0d0 2024-04-26T20:56:15.167 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.165+0000 7f53ce000640 1 -- 172.21.15.143:0/3475773414 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d00ad890 con 0x7f53d415d0d0 2024-04-26T20:56:15.167 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.165+0000 7f53dc800640 1 -- 172.21.15.143:0/3475773414 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f53d40cb490 con 0x7f53d415d0d0 2024-04-26T20:56:15.167 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.165+0000 7f53ce000640 1 -- 172.21.15.143:0/3475773414 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f53d00c0020 con 0x7f53d415d0d0 2024-04-26T20:56:15.167 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.165+0000 7f53ce000640 1 -- 172.21.15.143:0/3475773414 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f53d00b9c40 con 0x7f53d415d0d0 2024-04-26T20:56:15.167 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.165+0000 7f53dc800640 1 -- 172.21.15.143:0/3475773414 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53d4069430 con 0x7f53d415d0d0 2024-04-26T20:56:15.168 INFO:tasks.ceph.mgr.y.smithi138.stderr:2024-04-26T20:56:15.167+0000 7f146ec2c180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T20:56:15.169 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.169+0000 7f53ce000640 1 -- 172.21.15.143:0/3475773414 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f53d00c7020 con 0x7f53d415d0d0 2024-04-26T20:56:15.238 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.237+0000 7f53dc800640 1 -- 172.21.15.143:0/3475773414 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e881fcf6-3248-4696-a2ef-95d206d77712", "id": 1} v 0) -- 0x7f53d40b2df0 con 0x7f53d415d0d0 2024-04-26T20:56:15.244 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.245+0000 7f53ce000640 1 -- 172.21.15.143:0/3475773414 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e881fcf6-3248-4696-a2ef-95d206d77712", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f53d0016520 con 0x7f53d415d0d0 2024-04-26T20:56:15.245 INFO:teuthology.orchestra.run.smithi143.stdout:1 2024-04-26T20:56:15.245 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.245+0000 7f53dc800640 1 -- 172.21.15.143:0/3475773414 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f53d415d0d0 msgr2=0x7f53d40a06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:15.246 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.245+0000 7f53dc800640 1 --2- 172.21.15.143:0/3475773414 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f53d415d0d0 0x7f53d40a06b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f53d00ac000 tx=0x7f53d00196a0 comp rx=0 tx=0).stop 2024-04-26T20:56:15.246 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.245+0000 7f53dc800640 1 -- 172.21.15.143:0/3475773414 shutdown_connections 2024-04-26T20:56:15.246 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.245+0000 7f53dc800640 1 --2- 172.21.15.143:0/3475773414 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f53d415d0d0 0x7f53d40a06b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:15.246 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.245+0000 7f53dc800640 1 --2- 172.21.15.143:0/3475773414 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f53d40d1a50 0x7f53d40c8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:15.246 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.245+0000 7f53dc800640 1 --2- 172.21.15.143:0/3475773414 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f53d40cfd40 0x7f53d40ca840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:15.246 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.245+0000 7f53dc800640 1 -- 172.21.15.143:0/3475773414 >> 172.21.15.143:0/3475773414 conn(0x7f53d40d2d60 msgr2=0x7f53d4075930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:15.246 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.245+0000 7f53dc800640 1 -- 172.21.15.143:0/3475773414 shutdown_connections 2024-04-26T20:56:15.246 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.245+0000 7f53dc800640 1 -- 172.21.15.143:0/3475773414 wait complete. 2024-04-26T20:56:15.264 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --cluster ceph osd new f7d1db33-7672-4699-ae47-9f1e0a8e4222 2 2024-04-26T20:56:15.398 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.397+0000 7fa242600640 1 Processor -- start 2024-04-26T20:56:15.398 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.397+0000 7fa242600640 1 -- start start 2024-04-26T20:56:15.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.397+0000 7fa242600640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa23c0cfcf0 0x7fa23c0d1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:15.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.397+0000 7fa242600640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa23c0d3880 0x7fa23c0ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:15.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.397+0000 7fa242600640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa23c0d2250 con 0x7fa23c15f3b0 2024-04-26T20:56:15.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.397+0000 7fa242600640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fa23c0cdb80 con 0x7fa23c0d3880 2024-04-26T20:56:15.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.397+0000 7fa242600640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fa23c0cd530 con 0x7fa23c0cfcf0 2024-04-26T20:56:15.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.397+0000 7fa23aa00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa23c0cfcf0 0x7fa23c0d1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:15.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.397+0000 7fa23aa00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa23c0cfcf0 0x7fa23c0d1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:42086/0 (socket says 172.21.15.143:42086) 2024-04-26T20:56:15.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.397+0000 7fa23aa00640 1 -- 172.21.15.143:0/9644042 learned_addr learned my addr 172.21.15.143:0/9644042 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-04-26T20:56:15.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.397+0000 7fa23be00640 1 --2- 172.21.15.143:0/9644042 >> v2:172.21.15.138:3300/0 conn(0x7fa23c0d3880 0x7fa23c0ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:15.400 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.397+0000 7fa23aa00640 1 -- 172.21.15.143:0/9644042 >> v2:172.21.15.138:3300/0 conn(0x7fa23c0d3880 msgr2=0x7fa23c0ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:15.400 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.397+0000 7fa23aa00640 1 --2- 172.21.15.143:0/9644042 >> v2:172.21.15.138:3300/0 conn(0x7fa23c0d3880 0x7fa23c0ce010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:15.400 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.397+0000 7fa23aa00640 1 -- 172.21.15.143:0/9644042 >> v1:172.21.15.138:6789/0 conn(0x7fa23c15f3b0 legacy=0x7fa23c0cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:15.400 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.397+0000 7fa23aa00640 1 -- 172.21.15.143:0/9644042 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa23c0cd810 con 0x7fa23c0cfcf0 2024-04-26T20:56:15.400 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.397+0000 7fa23a000640 1 -- 172.21.15.143:0/9644042 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1524306955 0 0) 0x7fa23c0d2250 con 0x7fa23c15f3b0 2024-04-26T20:56:15.402 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.401+0000 7fa23aa00640 1 --2- 172.21.15.143:0/9644042 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa23c0cfcf0 0x7fa23c0d1090 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa23c069120 tx=0x7fa22801c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2ae9ed001c22331 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:15.402 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.401+0000 7fa23a000640 1 -- 172.21.15.143:0/9644042 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2280a9400 con 0x7fa23c0cfcf0 2024-04-26T20:56:15.402 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.401+0000 7fa23a000640 1 -- 172.21.15.143:0/9644042 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2280a95a0 con 0x7fa23c0cfcf0 2024-04-26T20:56:15.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.401+0000 7fa23a000640 1 -- 172.21.15.143:0/9644042 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2280a9970 con 0x7fa23c0cfcf0 2024-04-26T20:56:15.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.401+0000 7fa242600640 1 -- 172.21.15.143:0/9644042 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa23c0cfcf0 msgr2=0x7fa23c0d1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:15.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.401+0000 7fa242600640 1 --2- 172.21.15.143:0/9644042 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa23c0cfcf0 0x7fa23c0d1090 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa23c069120 tx=0x7fa22801c520 comp rx=0 tx=0).stop 2024-04-26T20:56:15.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.401+0000 7fa242600640 1 -- 172.21.15.143:0/9644042 shutdown_connections 2024-04-26T20:56:15.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.401+0000 7fa242600640 1 --2- 172.21.15.143:0/9644042 >> v2:172.21.15.138:3300/0 conn(0x7fa23c0d3880 0x7fa23c0ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:15.404 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.401+0000 7fa242600640 1 --2- 172.21.15.143:0/9644042 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa23c0cfcf0 0x7fa23c0d1090 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:15.404 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.401+0000 7fa242600640 1 -- 172.21.15.143:0/9644042 >> 172.21.15.143:0/9644042 conn(0x7fa23c0d2d60 msgr2=0x7fa23c0d3170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:15.404 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.401+0000 7fa242600640 1 -- 172.21.15.143:0/9644042 shutdown_connections 2024-04-26T20:56:15.404 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.401+0000 7fa242600640 1 -- 172.21.15.143:0/9644042 wait complete. 2024-04-26T20:56:15.405 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.405+0000 7fa242600640 1 Processor -- start 2024-04-26T20:56:15.405 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.405+0000 7fa242600640 1 -- start start 2024-04-26T20:56:15.407 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.405+0000 7fa242600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa23c0cfcf0 0x7fa23c0d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:15.408 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.405+0000 7fa242600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa23c0d3880 0x7fa23c09cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:15.408 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.405+0000 7fa242600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa23c15f3b0 0x7fa23c0b6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:15.408 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.405+0000 7fa242600640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fa23c0cf0f0 con 0x7fa23c0cfcf0 2024-04-26T20:56:15.408 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.405+0000 7fa242600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fa23c0cef70 con 0x7fa23c15f3b0 2024-04-26T20:56:15.408 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.405+0000 7fa242600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fa23c16bf70 con 0x7fa23c0d3880 2024-04-26T20:56:15.408 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.405+0000 7fa23aa00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa23c0d3880 0x7fa23c09cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:15.408 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.405+0000 7fa23be00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa23c15f3b0 0x7fa23c0b6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:15.408 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.405+0000 7fa23be00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa23c15f3b0 0x7fa23c0b6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:42096/0 (socket says 172.21.15.143:42096) 2024-04-26T20:56:15.408 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.405+0000 7fa23be00640 1 -- 172.21.15.143:0/4046284236 learned_addr learned my addr 172.21.15.143:0/4046284236 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-04-26T20:56:15.408 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.405+0000 7fa23b400640 1 --2- 172.21.15.143:0/4046284236 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa23c0cfcf0 0x7fa23c0d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:15.408 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.405+0000 7fa23be00640 1 -- 172.21.15.143:0/4046284236 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa23c0d3880 msgr2=0x7fa23c09cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:15.408 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.405+0000 7fa23be00640 1 --2- 172.21.15.143:0/4046284236 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa23c0d3880 0x7fa23c09cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:15.408 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.405+0000 7fa23be00640 1 -- 172.21.15.143:0/4046284236 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa23c0cfcf0 msgr2=0x7fa23c0d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:15.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.405+0000 7fa23be00640 1 --2- 172.21.15.143:0/4046284236 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa23c0cfcf0 0x7fa23c0d18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:15.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.405+0000 7fa23be00640 1 -- 172.21.15.143:0/4046284236 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa23c0b6290 con 0x7fa23c15f3b0 2024-04-26T20:56:15.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.405+0000 7fa23be00640 1 --2- 172.21.15.143:0/4046284236 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa23c15f3b0 0x7fa23c0b6d30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa23400efc0 tx=0x7fa23400c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:15.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.405+0000 7fa233400640 1 -- 172.21.15.143:0/4046284236 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa234018020 con 0x7fa23c15f3b0 2024-04-26T20:56:15.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.405+0000 7fa233400640 1 -- 172.21.15.143:0/4046284236 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa234014480 con 0x7fa23c15f3b0 2024-04-26T20:56:15.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.405+0000 7fa242600640 1 -- 172.21.15.143:0/4046284236 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa23c0b7f20 con 0x7fa23c15f3b0 2024-04-26T20:56:15.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.405+0000 7fa233400640 1 -- 172.21.15.143:0/4046284236 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa234014870 con 0x7fa23c15f3b0 2024-04-26T20:56:15.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.405+0000 7fa242600640 1 -- 172.21.15.143:0/4046284236 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa23c0b84e0 con 0x7fa23c15f3b0 2024-04-26T20:56:15.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.405+0000 7fa233400640 1 -- 172.21.15.143:0/4046284236 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa23401b020 con 0x7fa23c15f3b0 2024-04-26T20:56:15.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.405+0000 7fa233400640 1 -- 172.21.15.143:0/4046284236 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fa234013800 con 0x7fa23c15f3b0 2024-04-26T20:56:15.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.409+0000 7fa242600640 1 -- 172.21.15.143:0/4046284236 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa23c069430 con 0x7fa23c15f3b0 2024-04-26T20:56:15.411 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.409+0000 7fa233400640 1 -- 172.21.15.143:0/4046284236 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fa234022070 con 0x7fa23c15f3b0 2024-04-26T20:56:15.478 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.477+0000 7fa242600640 1 -- 172.21.15.143:0/4046284236 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f7d1db33-7672-4699-ae47-9f1e0a8e4222", "id": 2} v 0) -- 0x7fa23c0759d0 con 0x7fa23c15f3b0 2024-04-26T20:56:15.484 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.481+0000 7fa233400640 1 -- 172.21.15.143:0/4046284236 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f7d1db33-7672-4699-ae47-9f1e0a8e4222", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fa234010040 con 0x7fa23c15f3b0 2024-04-26T20:56:15.484 INFO:teuthology.orchestra.run.smithi143.stdout:2 2024-04-26T20:56:15.485 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.485+0000 7fa242600640 1 -- 172.21.15.143:0/4046284236 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa23c15f3b0 msgr2=0x7fa23c0b6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:15.485 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.485+0000 7fa242600640 1 --2- 172.21.15.143:0/4046284236 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa23c15f3b0 0x7fa23c0b6d30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa23400efc0 tx=0x7fa23400c490 comp rx=0 tx=0).stop 2024-04-26T20:56:15.485 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.485+0000 7fa242600640 1 -- 172.21.15.143:0/4046284236 shutdown_connections 2024-04-26T20:56:15.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.485+0000 7fa242600640 1 --2- 172.21.15.143:0/4046284236 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa23c15f3b0 0x7fa23c0b6d30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:15.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.485+0000 7fa242600640 1 --2- 172.21.15.143:0/4046284236 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa23c0d3880 0x7fa23c09cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:15.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.485+0000 7fa242600640 1 --2- 172.21.15.143:0/4046284236 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa23c0cfcf0 0x7fa23c0d18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:15.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.485+0000 7fa242600640 1 -- 172.21.15.143:0/4046284236 >> 172.21.15.143:0/4046284236 conn(0x7fa23c0d2d60 msgr2=0x7fa23c0d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:15.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.485+0000 7fa242600640 1 -- 172.21.15.143:0/4046284236 shutdown_connections 2024-04-26T20:56:15.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.485+0000 7fa242600640 1 -- 172.21.15.143:0/4046284236 wait complete. 2024-04-26T20:56:15.503 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --cluster ceph osd new 2f4e0a9a-b8f6-4468-844a-a4501cd85054 3 2024-04-26T20:56:15.639 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.637+0000 7f728fe00640 1 Processor -- start 2024-04-26T20:56:15.640 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.637+0000 7f728fe00640 1 -- start start 2024-04-26T20:56:15.641 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.641+0000 7f728fe00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f728815f3b0 0x7f72880d1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:15.641 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.641+0000 7f728fe00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f72880cfcf0 0x7f72880ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:15.641 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.641+0000 7f728fe00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72880d2250 con 0x7f72880d3880 2024-04-26T20:56:15.641 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.641+0000 7f728fe00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f72880cdb80 con 0x7f72880cfcf0 2024-04-26T20:56:15.642 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.641+0000 7f728fe00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f72880cd530 con 0x7f728815f3b0 2024-04-26T20:56:15.642 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.641+0000 7f728d400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f728815f3b0 0x7f72880d1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:15.642 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.641+0000 7f728d400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f728815f3b0 0x7f72880d1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.143:47308/0 (socket says 172.21.15.143:47308) 2024-04-26T20:56:15.642 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.641+0000 7f728d400640 1 -- 172.21.15.143:0/2657862934 learned_addr learned my addr 172.21.15.143:0/2657862934 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-04-26T20:56:15.642 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.641+0000 7f728de00640 1 --2- 172.21.15.143:0/2657862934 >> v2:172.21.15.138:3300/0 conn(0x7f72880cfcf0 0x7f72880ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:15.642 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.641+0000 7f728d400640 1 -- 172.21.15.143:0/2657862934 >> v2:172.21.15.138:3300/0 conn(0x7f72880cfcf0 msgr2=0x7f72880ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:15.642 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.641+0000 7f728d400640 1 --2- 172.21.15.143:0/2657862934 >> v2:172.21.15.138:3300/0 conn(0x7f72880cfcf0 0x7f72880ce010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:15.642 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.641+0000 7f728d400640 1 -- 172.21.15.143:0/2657862934 >> v1:172.21.15.138:6789/0 conn(0x7f72880d3880 legacy=0x7f72880cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:15.642 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.641+0000 7f728d400640 1 -- 172.21.15.143:0/2657862934 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72880cd810 con 0x7f728815f3b0 2024-04-26T20:56:15.644 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.645+0000 7f728d400640 1 --2- 172.21.15.143:0/2657862934 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f728815f3b0 0x7f72880d1090 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f727c009870 tx=0x7f727c01c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e6b1606973f334 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:15.645 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.645+0000 7f7287e00640 1 -- 172.21.15.143:0/2657862934 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727c0a9640 con 0x7f728815f3b0 2024-04-26T20:56:15.645 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.645+0000 7f7287e00640 1 -- 172.21.15.143:0/2657862934 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f727c0a97e0 con 0x7f728815f3b0 2024-04-26T20:56:15.645 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.645+0000 7f7287e00640 1 -- 172.21.15.143:0/2657862934 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727c0a9bb0 con 0x7f728815f3b0 2024-04-26T20:56:15.646 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.645+0000 7f728fe00640 1 -- 172.21.15.143:0/2657862934 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f728815f3b0 msgr2=0x7f72880d1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:15.646 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.645+0000 7f728fe00640 1 --2- 172.21.15.143:0/2657862934 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f728815f3b0 0x7f72880d1090 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f727c009870 tx=0x7f727c01c560 comp rx=0 tx=0).stop 2024-04-26T20:56:15.646 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.645+0000 7f728fe00640 1 -- 172.21.15.143:0/2657862934 shutdown_connections 2024-04-26T20:56:15.646 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.645+0000 7f728fe00640 1 --2- 172.21.15.143:0/2657862934 >> v2:172.21.15.138:3300/0 conn(0x7f72880cfcf0 0x7f72880ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:15.646 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.645+0000 7f728fe00640 1 --2- 172.21.15.143:0/2657862934 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f728815f3b0 0x7f72880d1090 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:15.646 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.645+0000 7f728fe00640 1 -- 172.21.15.143:0/2657862934 >> 172.21.15.143:0/2657862934 conn(0x7f72880d2d60 msgr2=0x7f72880d3170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:15.646 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.645+0000 7f728fe00640 1 -- 172.21.15.143:0/2657862934 shutdown_connections 2024-04-26T20:56:15.646 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.645+0000 7f728fe00640 1 -- 172.21.15.143:0/2657862934 wait complete. 2024-04-26T20:56:15.647 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.645+0000 7f728fe00640 1 Processor -- start 2024-04-26T20:56:15.647 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.645+0000 7f728fe00640 1 -- start start 2024-04-26T20:56:15.649 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.649+0000 7f728fe00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f72880cfcf0 0x7f72880cc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:15.649 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.649+0000 7f728fe00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f72880d3880 0x7f72881552a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:15.649 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.649+0000 7f728fe00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f728815f3b0 0x7f7288155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:15.649 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.649+0000 7f728fe00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f72880cf0f0 con 0x7f728815f3b0 2024-04-26T20:56:15.649 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.649+0000 7f728fe00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f72880cef70 con 0x7f72880d3880 2024-04-26T20:56:15.649 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.649+0000 7f728fe00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f728816bf70 con 0x7f72880cfcf0 2024-04-26T20:56:15.649 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.649+0000 7f728d400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f72880cfcf0 0x7f72880cc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:15.649 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.649+0000 7f728ca00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f72880d3880 0x7f72881552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:15.650 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.649+0000 7f728d400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f72880cfcf0 0x7f72880cc9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.143:47310/0 (socket says 172.21.15.143:47310) 2024-04-26T20:56:15.650 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.649+0000 7f728d400640 1 -- 172.21.15.143:0/2756612639 learned_addr learned my addr 172.21.15.143:0/2756612639 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-04-26T20:56:15.650 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.649+0000 7f728de00640 1 --2- 172.21.15.143:0/2756612639 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f728815f3b0 0x7f7288155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:15.650 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.649+0000 7f728d400640 1 -- 172.21.15.143:0/2756612639 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f72880d3880 msgr2=0x7f72881552a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:15.650 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.649+0000 7f728d400640 1 --2- 172.21.15.143:0/2756612639 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f72880d3880 0x7f72881552a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:15.650 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.649+0000 7f728d400640 1 -- 172.21.15.143:0/2756612639 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f728815f3b0 msgr2=0x7f7288155ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:15.650 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.649+0000 7f728d400640 1 --2- 172.21.15.143:0/2756612639 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f728815f3b0 0x7f7288155ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:15.650 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.649+0000 7f728d400640 1 -- 172.21.15.143:0/2756612639 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72880cb0e0 con 0x7f72880cfcf0 2024-04-26T20:56:15.650 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.649+0000 7f728d400640 1 --2- 172.21.15.143:0/2756612639 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f72880cfcf0 0x7f72880cc9b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f727c01a190 tx=0x7f727c01ada0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:15.651 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.649+0000 7f7285600640 1 -- 172.21.15.143:0/2756612639 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727c0b1800 con 0x7f72880cfcf0 2024-04-26T20:56:15.651 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.649+0000 7f7285600640 1 -- 172.21.15.143:0/2756612639 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f727c0b19c0 con 0x7f72880cfcf0 2024-04-26T20:56:15.651 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.649+0000 7f7285600640 1 -- 172.21.15.143:0/2756612639 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727c0b1db0 con 0x7f72880cfcf0 2024-04-26T20:56:15.651 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.649+0000 7f728fe00640 1 -- 172.21.15.143:0/2756612639 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72880cb3c0 con 0x7f72880cfcf0 2024-04-26T20:56:15.651 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.649+0000 7f728fe00640 1 -- 172.21.15.143:0/2756612639 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f72881557e0 con 0x7f72880cfcf0 2024-04-26T20:56:15.651 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.649+0000 7f7285600640 1 -- 172.21.15.143:0/2756612639 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f727c0bc7e0 con 0x7f72880cfcf0 2024-04-26T20:56:15.651 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.649+0000 7f7285600640 1 -- 172.21.15.143:0/2756612639 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f727c0a9660 con 0x7f72880cfcf0 2024-04-26T20:56:15.652 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.649+0000 7f728fe00640 1 -- 172.21.15.143:0/2756612639 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72880d2b70 con 0x7f72880cfcf0 2024-04-26T20:56:15.655 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.653+0000 7f7285600640 1 -- 172.21.15.143:0/2756612639 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f727c0c3030 con 0x7f72880cfcf0 2024-04-26T20:56:15.721 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.721+0000 7f728fe00640 1 -- 172.21.15.143:0/2756612639 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2f4e0a9a-b8f6-4468-844a-a4501cd85054", "id": 3} v 0) -- 0x7f7288069430 con 0x7f72880cfcf0 2024-04-26T20:56:15.727 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.725+0000 7f7285600640 1 -- 172.21.15.143:0/2756612639 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2f4e0a9a-b8f6-4468-844a-a4501cd85054", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f727c0ad020 con 0x7f72880cfcf0 2024-04-26T20:56:15.727 INFO:teuthology.orchestra.run.smithi143.stdout:3 2024-04-26T20:56:15.728 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.729+0000 7f728fe00640 1 -- 172.21.15.143:0/2756612639 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f72880cfcf0 msgr2=0x7f72880cc9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:15.729 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.729+0000 7f728fe00640 1 --2- 172.21.15.143:0/2756612639 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f72880cfcf0 0x7f72880cc9b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f727c01a190 tx=0x7f727c01ada0 comp rx=0 tx=0).stop 2024-04-26T20:56:15.729 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.729+0000 7f728fe00640 1 -- 172.21.15.143:0/2756612639 shutdown_connections 2024-04-26T20:56:15.729 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.729+0000 7f728fe00640 1 --2- 172.21.15.143:0/2756612639 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f728815f3b0 0x7f7288155ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:15.729 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.729+0000 7f728fe00640 1 --2- 172.21.15.143:0/2756612639 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f72880d3880 0x7f72881552a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:15.729 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.729+0000 7f728fe00640 1 --2- 172.21.15.143:0/2756612639 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f72880cfcf0 0x7f72880cc9b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:15.729 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.729+0000 7f728fe00640 1 -- 172.21.15.143:0/2756612639 >> 172.21.15.143:0/2756612639 conn(0x7f72880d2d60 msgr2=0x7f72880d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:15.729 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.729+0000 7f728fe00640 1 -- 172.21.15.143:0/2756612639 shutdown_connections 2024-04-26T20:56:15.729 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.729+0000 7f728fe00640 1 -- 172.21.15.143:0/2756612639 wait complete. 2024-04-26T20:56:15.747 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --cluster ceph osd new c85df99b-3624-410e-866b-86830af2cfe1 4 2024-04-26T20:56:15.780 INFO:tasks.ceph.mgr.y.smithi138.stderr:2024-04-26T20:56:15.779+0000 7f146ec2c180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T20:56:15.790 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-04-26T20:56:15.789+0000 7f3d6a42c180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T20:56:15.842 INFO:tasks.ceph.mgr.y.smithi138.stderr:2024-04-26T20:56:15.839+0000 7f146ec2c180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T20:56:15.854 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-04-26T20:56:15.853+0000 7f3d6a42c180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T20:56:15.881 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.881+0000 7f758a600640 1 Processor -- start 2024-04-26T20:56:15.882 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.881+0000 7f758a600640 1 -- start start 2024-04-26T20:56:15.883 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.881+0000 7f758a600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f758415d0d0 0x7f75840d0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:15.883 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.881+0000 7f758a600640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f75840d1a50 0x7f75840b2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:15.883 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.881+0000 7f758a600640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75840cedf0 con 0x7f75840cfd40 2024-04-26T20:56:15.883 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.881+0000 7f758a600640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f75840d3920 con 0x7f75840d1a50 2024-04-26T20:56:15.883 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.881+0000 7f758a600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f75840d3c00 con 0x7f758415d0d0 2024-04-26T20:56:15.883 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.881+0000 7f7583400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f758415d0d0 0x7f75840d0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:15.884 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.881+0000 7f7583400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f758415d0d0 0x7f75840d0b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.143:47312/0 (socket says 172.21.15.143:47312) 2024-04-26T20:56:15.884 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.881+0000 7f7583400640 1 -- 172.21.15.143:0/3455644154 learned_addr learned my addr 172.21.15.143:0/3455644154 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-04-26T20:56:15.884 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.881+0000 7f7583e00640 1 --2- 172.21.15.143:0/3455644154 >> v2:172.21.15.138:3300/0 conn(0x7f75840d1a50 0x7f75840b2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:15.884 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.881+0000 7f7583400640 1 -- 172.21.15.143:0/3455644154 >> v2:172.21.15.138:3300/0 conn(0x7f75840d1a50 msgr2=0x7f75840b2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:15.884 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.881+0000 7f7583400640 1 --2- 172.21.15.143:0/3455644154 >> v2:172.21.15.138:3300/0 conn(0x7f75840d1a50 0x7f75840b2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:15.884 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.881+0000 7f7583400640 1 -- 172.21.15.143:0/3455644154 >> v1:172.21.15.138:6789/0 conn(0x7f75840cfd40 legacy=0x7f75840d1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:15.884 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.881+0000 7f7583400640 1 -- 172.21.15.143:0/3455644154 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75840b22f0 con 0x7f758415d0d0 2024-04-26T20:56:15.886 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.885+0000 7f7583400640 1 --2- 172.21.15.143:0/3455644154 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f758415d0d0 0x7f75840d0b40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7574009870 tx=0x7f757401c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a638d9b2a3d7fcca server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:15.886 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.885+0000 7f7582a00640 1 -- 172.21.15.143:0/3455644154 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75740ab640 con 0x7f758415d0d0 2024-04-26T20:56:15.887 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.885+0000 7f7582a00640 1 -- 172.21.15.143:0/3455644154 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75740b0070 con 0x7f758415d0d0 2024-04-26T20:56:15.887 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.885+0000 7f7582a00640 1 -- 172.21.15.143:0/3455644154 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75740aba00 con 0x7f758415d0d0 2024-04-26T20:56:15.887 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.885+0000 7f758a600640 1 -- 172.21.15.143:0/3455644154 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f758415d0d0 msgr2=0x7f75840d0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:15.887 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.885+0000 7f758a600640 1 --2- 172.21.15.143:0/3455644154 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f758415d0d0 0x7f75840d0b40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7574009870 tx=0x7f757401c530 comp rx=0 tx=0).stop 2024-04-26T20:56:15.887 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.885+0000 7f758a600640 1 -- 172.21.15.143:0/3455644154 shutdown_connections 2024-04-26T20:56:15.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.885+0000 7f758a600640 1 --2- 172.21.15.143:0/3455644154 >> v2:172.21.15.138:3300/0 conn(0x7f75840d1a50 0x7f75840b2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:15.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.885+0000 7f758a600640 1 --2- 172.21.15.143:0/3455644154 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f758415d0d0 0x7f75840d0b40 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:15.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.885+0000 7f758a600640 1 -- 172.21.15.143:0/3455644154 >> 172.21.15.143:0/3455644154 conn(0x7f75840d2d60 msgr2=0x7f75840d3170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:15.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.885+0000 7f758a600640 1 -- 172.21.15.143:0/3455644154 shutdown_connections 2024-04-26T20:56:15.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.885+0000 7f758a600640 1 -- 172.21.15.143:0/3455644154 wait complete. 2024-04-26T20:56:15.889 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.889+0000 7f758a600640 1 Processor -- start 2024-04-26T20:56:15.889 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.889+0000 7f758a600640 1 -- start start 2024-04-26T20:56:15.891 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.889+0000 7f758a600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75840cfd40 0x7f7584167800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:15.891 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.889+0000 7f758a600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75840d1a50 0x7f75841650c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:15.891 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.889+0000 7f758a600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f758415d0d0 0x7f758415f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:15.891 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.889+0000 7f758a600640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f75840b3820 con 0x7f75840d1a50 2024-04-26T20:56:15.891 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.889+0000 7f758a600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f75840cebd0 con 0x7f758415d0d0 2024-04-26T20:56:15.891 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.889+0000 7f758a600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f75840b39a0 con 0x7f75840cfd40 2024-04-26T20:56:15.891 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.889+0000 7f7583400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75840cfd40 0x7f7584167800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:15.891 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.889+0000 7f7583e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f758415d0d0 0x7f758415f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:15.892 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.889+0000 7f7583400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75840cfd40 0x7f7584167800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.143:47314/0 (socket says 172.21.15.143:47314) 2024-04-26T20:56:15.892 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.889+0000 7f7583400640 1 -- 172.21.15.143:0/2903680795 learned_addr learned my addr 172.21.15.143:0/2903680795 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-04-26T20:56:15.892 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.889+0000 7f757be00640 1 --2- 172.21.15.143:0/2903680795 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75840d1a50 0x7f75841650c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:15.892 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.889+0000 7f7583e00640 1 -- 172.21.15.143:0/2903680795 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75840cfd40 msgr2=0x7f7584167800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:15.892 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.889+0000 7f7583e00640 1 --2- 172.21.15.143:0/2903680795 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75840cfd40 0x7f7584167800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:15.892 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.889+0000 7f7583e00640 1 -- 172.21.15.143:0/2903680795 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75840d1a50 msgr2=0x7f75841650c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:15.892 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.889+0000 7f7583e00640 1 --2- 172.21.15.143:0/2903680795 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75840d1a50 0x7f75841650c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:15.892 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.889+0000 7f7583e00640 1 -- 172.21.15.143:0/2903680795 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f758406efd0 con 0x7f758415d0d0 2024-04-26T20:56:15.892 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.889+0000 7f7583400640 1 --2- 172.21.15.143:0/2903680795 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75840cfd40 0x7f7584167800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:56:15.892 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.889+0000 7f7583e00640 1 --2- 172.21.15.143:0/2903680795 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f758415d0d0 0x7f758415f810 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f757c00efc0 tx=0x7f757c00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:15.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.889+0000 7f757b400640 1 -- 172.21.15.143:0/2903680795 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f757c018020 con 0x7f758415d0d0 2024-04-26T20:56:15.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.889+0000 7f757b400640 1 -- 172.21.15.143:0/2903680795 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f757c014480 con 0x7f758415d0d0 2024-04-26T20:56:15.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.889+0000 7f757b400640 1 -- 172.21.15.143:0/2903680795 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f757c014870 con 0x7f758415d0d0 2024-04-26T20:56:15.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.889+0000 7f758a600640 1 -- 172.21.15.143:0/2903680795 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f758406f2b0 con 0x7f758415d0d0 2024-04-26T20:56:15.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.889+0000 7f758a600640 1 -- 172.21.15.143:0/2903680795 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f758415fd50 con 0x7f758415d0d0 2024-04-26T20:56:15.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.889+0000 7f757b400640 1 -- 172.21.15.143:0/2903680795 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f757c01b020 con 0x7f758415d0d0 2024-04-26T20:56:15.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.893+0000 7f757b400640 1 -- 172.21.15.143:0/2903680795 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f757c014da0 con 0x7f758415d0d0 2024-04-26T20:56:15.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.893+0000 7f758a600640 1 -- 172.21.15.143:0/2903680795 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7584069430 con 0x7f758415d0d0 2024-04-26T20:56:15.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.893+0000 7f757b400640 1 -- 172.21.15.143:0/2903680795 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f757c022030 con 0x7f758415d0d0 2024-04-26T20:56:15.904 INFO:tasks.ceph.mgr.y.smithi138.stderr:2024-04-26T20:56:15.903+0000 7f146ec2c180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T20:56:15.920 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-04-26T20:56:15.921+0000 7f3d6a42c180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T20:56:15.961 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.961+0000 7f758a600640 1 -- 172.21.15.143:0/2903680795 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c85df99b-3624-410e-866b-86830af2cfe1", "id": 4} v 0) -- 0x7f75840afcf0 con 0x7f758415d0d0 2024-04-26T20:56:15.967 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.965+0000 7f757b400640 1 -- 172.21.15.143:0/2903680795 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c85df99b-3624-410e-866b-86830af2cfe1", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f757c010040 con 0x7f758415d0d0 2024-04-26T20:56:15.967 INFO:teuthology.orchestra.run.smithi143.stdout:4 2024-04-26T20:56:15.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.969+0000 7f758a600640 1 -- 172.21.15.143:0/2903680795 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f758415d0d0 msgr2=0x7f758415f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:15.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.969+0000 7f758a600640 1 --2- 172.21.15.143:0/2903680795 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f758415d0d0 0x7f758415f810 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f757c00efc0 tx=0x7f757c00c490 comp rx=0 tx=0).stop 2024-04-26T20:56:15.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.969+0000 7f758a600640 1 -- 172.21.15.143:0/2903680795 shutdown_connections 2024-04-26T20:56:15.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.969+0000 7f758a600640 1 --2- 172.21.15.143:0/2903680795 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f758415d0d0 0x7f758415f810 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:15.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.969+0000 7f758a600640 1 --2- 172.21.15.143:0/2903680795 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75840d1a50 0x7f75841650c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:15.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.969+0000 7f758a600640 1 --2- 172.21.15.143:0/2903680795 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75840cfd40 0x7f7584167800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:15.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.969+0000 7f758a600640 1 -- 172.21.15.143:0/2903680795 >> 172.21.15.143:0/2903680795 conn(0x7f75840d2d60 msgr2=0x7f7584160230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:15.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.969+0000 7f758a600640 1 -- 172.21.15.143:0/2903680795 shutdown_connections 2024-04-26T20:56:15.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:15.969+0000 7f758a600640 1 -- 172.21.15.143:0/2903680795 wait complete. 2024-04-26T20:56:15.987 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --cluster ceph osd new 9af1efb5-c416-4808-b5ef-de0679ab9705 5 2024-04-26T20:56:15.994 INFO:tasks.ceph.mgr.y.smithi138.stderr:2024-04-26T20:56:15.991+0000 7f146ec2c180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T20:56:16.014 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-04-26T20:56:16.013+0000 7f3d6a42c180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T20:56:16.054 INFO:tasks.ceph.mgr.y.smithi138.stderr:2024-04-26T20:56:16.051+0000 7f146ec2c180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T20:56:16.076 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-04-26T20:56:16.077+0000 7f3d6a42c180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T20:56:16.142 INFO:tasks.ceph.mgr.y.smithi138.stderr:2024-04-26T20:56:16.139+0000 7f146ec2c180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T20:56:16.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.145+0000 7f75c0a00640 1 Processor -- start 2024-04-26T20:56:16.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.145+0000 7f75c0a00640 1 -- start start 2024-04-26T20:56:16.149 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.149+0000 7f75c0a00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f75bc15d610 0x7f75bc06c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:16.149 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.149+0000 7f75c0a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75bc0b4400 0x7f75bc0b4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:16.149 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.149+0000 7f75c0a00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f75bc15d9f0 0x7f75bc15de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:16.150 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.149+0000 7f75c0a00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f75bc0ce230 con 0x7f75bc15d610 2024-04-26T20:56:16.150 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.149+0000 7f75c0a00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f75bc0b4f70 con 0x7f75bc15d9f0 2024-04-26T20:56:16.150 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.149+0000 7f75c0a00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f75bc0b5250 con 0x7f75bc0b4400 2024-04-26T20:56:16.150 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.149+0000 7f75b3e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75bc0b4400 0x7f75bc0b4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:16.150 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.149+0000 7f75b3e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75bc0b4400 0x7f75bc0b4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.143:47320/0 (socket says 172.21.15.143:47320) 2024-04-26T20:56:16.150 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.149+0000 7f75b3e00640 1 -- 172.21.15.143:0/1924718716 learned_addr learned my addr 172.21.15.143:0/1924718716 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-04-26T20:56:16.150 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.149+0000 7f75ba800640 1 --2- 172.21.15.143:0/1924718716 >> v2:172.21.15.143:3300/0 conn(0x7f75bc15d9f0 0x7f75bc15de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:16.150 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.149+0000 7f75b9e00640 1 --2- 172.21.15.143:0/1924718716 >> v2:172.21.15.138:3300/0 conn(0x7f75bc15d610 0x7f75bc06c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:16.150 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.149+0000 7f75b3e00640 1 -- 172.21.15.143:0/1924718716 >> v2:172.21.15.143:3300/0 conn(0x7f75bc15d9f0 msgr2=0x7f75bc15de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:16.150 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.149+0000 7f75b3e00640 1 --2- 172.21.15.143:0/1924718716 >> v2:172.21.15.143:3300/0 conn(0x7f75bc15d9f0 0x7f75bc15de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:16.150 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.149+0000 7f75b3e00640 1 -- 172.21.15.143:0/1924718716 >> v2:172.21.15.138:3300/0 conn(0x7f75bc15d610 msgr2=0x7f75bc06c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:16.150 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.149+0000 7f75b3e00640 1 --2- 172.21.15.143:0/1924718716 >> v2:172.21.15.138:3300/0 conn(0x7f75bc15d610 0x7f75bc06c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:16.150 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.149+0000 7f75b3e00640 1 -- 172.21.15.143:0/1924718716 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75bc0cfc00 con 0x7f75bc0b4400 2024-04-26T20:56:16.152 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.153+0000 7f75b3e00640 1 --2- 172.21.15.143:0/1924718716 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75bc0b4400 0x7f75bc0b4860 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f75bc0cf950 tx=0x7f75a401c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f19b49d64dafe578 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:16.152 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.153+0000 7f75b9400640 1 -- 172.21.15.143:0/1924718716 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a40b0070 con 0x7f75bc0b4400 2024-04-26T20:56:16.152 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.153+0000 7f75b9400640 1 -- 172.21.15.143:0/1924718716 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75a40ab600 con 0x7f75bc0b4400 2024-04-26T20:56:16.152 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.153+0000 7f75b9400640 1 -- 172.21.15.143:0/1924718716 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a40ab9d0 con 0x7f75bc0b4400 2024-04-26T20:56:16.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.153+0000 7f75c0a00640 1 -- 172.21.15.143:0/1924718716 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75bc0b4400 msgr2=0x7f75bc0b4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:16.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.153+0000 7f75c0a00640 1 --2- 172.21.15.143:0/1924718716 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75bc0b4400 0x7f75bc0b4860 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f75bc0cf950 tx=0x7f75a401c520 comp rx=0 tx=0).stop 2024-04-26T20:56:16.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.153+0000 7f75c0a00640 1 -- 172.21.15.143:0/1924718716 shutdown_connections 2024-04-26T20:56:16.154 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.153+0000 7f75c0a00640 1 --2- 172.21.15.143:0/1924718716 >> v2:172.21.15.143:3300/0 conn(0x7f75bc15d9f0 0x7f75bc15de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:16.154 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.153+0000 7f75c0a00640 1 --2- 172.21.15.143:0/1924718716 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75bc0b4400 0x7f75bc0b4860 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:16.154 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.153+0000 7f75c0a00640 1 --2- 172.21.15.143:0/1924718716 >> v2:172.21.15.138:3300/0 conn(0x7f75bc15d610 0x7f75bc06c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:16.154 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.153+0000 7f75c0a00640 1 -- 172.21.15.143:0/1924718716 >> 172.21.15.143:0/1924718716 conn(0x7f75bc0d1510 msgr2=0x7f75bc0d1920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:16.154 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.153+0000 7f75c0a00640 1 -- 172.21.15.143:0/1924718716 shutdown_connections 2024-04-26T20:56:16.154 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.153+0000 7f75c0a00640 1 -- 172.21.15.143:0/1924718716 wait complete. 2024-04-26T20:56:16.155 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.153+0000 7f75c0a00640 1 Processor -- start 2024-04-26T20:56:16.155 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.153+0000 7f75c0a00640 1 -- start start 2024-04-26T20:56:16.157 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.153+0000 7f75c0a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75bc0b4400 0x7f75bc143e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:16.157 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.153+0000 7f75c0a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f75bc15d610 0x7f75bc0aebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:16.158 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.153+0000 7f75c0a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75bc15d9f0 0x7f75bc06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:16.158 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.153+0000 7f75c0a00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f75bc0d1050 con 0x7f75bc0b4400 2024-04-26T20:56:16.158 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.153+0000 7f75c0a00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f75bc0d0ed0 con 0x7f75bc15d610 2024-04-26T20:56:16.158 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.153+0000 7f75c0a00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f75bc0d11d0 con 0x7f75bc15d9f0 2024-04-26T20:56:16.158 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.157+0000 7f75b3e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f75bc15d610 0x7f75bc0aebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:16.158 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.157+0000 7f75ba800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75bc15d9f0 0x7f75bc06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:16.158 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.157+0000 7f75b3e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f75bc15d610 0x7f75bc0aebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:42136/0 (socket says 172.21.15.143:42136) 2024-04-26T20:56:16.158 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.157+0000 7f75ba800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75bc15d9f0 0x7f75bc06ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.143:47328/0 (socket says 172.21.15.143:47328) 2024-04-26T20:56:16.158 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.157+0000 7f75b3e00640 1 -- 172.21.15.143:0/114424445 learned_addr learned my addr 172.21.15.143:0/114424445 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-04-26T20:56:16.158 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.157+0000 7f75b9e00640 1 --2- 172.21.15.143:0/114424445 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75bc0b4400 0x7f75bc143e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:16.158 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.157+0000 7f75b3e00640 1 -- 172.21.15.143:0/114424445 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75bc15d9f0 msgr2=0x7f75bc06ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:16.158 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.157+0000 7f75b3e00640 1 --2- 172.21.15.143:0/114424445 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75bc15d9f0 0x7f75bc06ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:16.158 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.157+0000 7f75b3e00640 1 -- 172.21.15.143:0/114424445 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75bc0b4400 msgr2=0x7f75bc143e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:16.159 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.157+0000 7f75b3e00640 1 --2- 172.21.15.143:0/114424445 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75bc0b4400 0x7f75bc143e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:16.159 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.157+0000 7f75b3e00640 1 -- 172.21.15.143:0/114424445 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75bc0af530 con 0x7f75bc15d610 2024-04-26T20:56:16.159 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.157+0000 7f75ba800640 1 --2- 172.21.15.143:0/114424445 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75bc15d9f0 0x7f75bc06ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:56:16.159 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.157+0000 7f75b3e00640 1 --2- 172.21.15.143:0/114424445 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f75bc15d610 0x7f75bc0aebc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f75a401abd0 tx=0x7f75a40192c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:16.159 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.157+0000 7f75b2000640 1 -- 172.21.15.143:0/114424445 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a40b0040 con 0x7f75bc15d610 2024-04-26T20:56:16.159 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.157+0000 7f75b2000640 1 -- 172.21.15.143:0/114424445 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75a40b4620 con 0x7f75bc15d610 2024-04-26T20:56:16.159 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.157+0000 7f75c0a00640 1 -- 172.21.15.143:0/114424445 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75bc0af810 con 0x7f75bc15d610 2024-04-26T20:56:16.159 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.157+0000 7f75b2000640 1 -- 172.21.15.143:0/114424445 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a40b4a10 con 0x7f75bc15d610 2024-04-26T20:56:16.159 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.157+0000 7f75c0a00640 1 -- 172.21.15.143:0/114424445 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75bc0afdd0 con 0x7f75bc15d610 2024-04-26T20:56:16.159 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.157+0000 7f75b2000640 1 -- 172.21.15.143:0/114424445 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f75a40ab4c0 con 0x7f75bc15d610 2024-04-26T20:56:16.159 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.157+0000 7f75b2000640 1 -- 172.21.15.143:0/114424445 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f75a40bda90 con 0x7f75bc15d610 2024-04-26T20:56:16.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.157+0000 7f75c0a00640 1 -- 172.21.15.143:0/114424445 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75bc069b40 con 0x7f75bc15d610 2024-04-26T20:56:16.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.161+0000 7f75b2000640 1 -- 172.21.15.143:0/114424445 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f75a4016110 con 0x7f75bc15d610 2024-04-26T20:56:16.169 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-04-26T20:56:16.169+0000 7f3d6a42c180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T20:56:16.206 INFO:tasks.ceph.mgr.y.smithi138.stderr:2024-04-26T20:56:16.207+0000 7f146ec2c180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T20:56:16.229 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.229+0000 7f75c0a00640 1 -- 172.21.15.143:0/114424445 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9af1efb5-c416-4808-b5ef-de0679ab9705", "id": 5} v 0) -- 0x7f75bc0b0270 con 0x7f75bc15d610 2024-04-26T20:56:16.234 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.233+0000 7f75b2000640 1 -- 172.21.15.143:0/114424445 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9af1efb5-c416-4808-b5ef-de0679ab9705", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f75a40bd400 con 0x7f75bc15d610 2024-04-26T20:56:16.235 INFO:teuthology.orchestra.run.smithi143.stdout:5 2024-04-26T20:56:16.236 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.233+0000 7f75c0a00640 1 -- 172.21.15.143:0/114424445 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f75bc15d610 msgr2=0x7f75bc0aebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:16.236 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.233+0000 7f75c0a00640 1 --2- 172.21.15.143:0/114424445 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f75bc15d610 0x7f75bc0aebc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f75a401abd0 tx=0x7f75a40192c0 comp rx=0 tx=0).stop 2024-04-26T20:56:16.236 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.233+0000 7f75c0a00640 1 -- 172.21.15.143:0/114424445 shutdown_connections 2024-04-26T20:56:16.236 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.233+0000 7f75c0a00640 1 --2- 172.21.15.143:0/114424445 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75bc15d9f0 0x7f75bc06ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:16.236 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.233+0000 7f75c0a00640 1 --2- 172.21.15.143:0/114424445 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f75bc15d610 0x7f75bc0aebc0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:16.236 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.233+0000 7f75c0a00640 1 --2- 172.21.15.143:0/114424445 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75bc0b4400 0x7f75bc143e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:16.236 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.233+0000 7f75c0a00640 1 -- 172.21.15.143:0/114424445 >> 172.21.15.143:0/114424445 conn(0x7f75bc0d1510 msgr2=0x7f75bc0734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:16.236 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.233+0000 7f75c0a00640 1 -- 172.21.15.143:0/114424445 shutdown_connections 2024-04-26T20:56:16.236 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.233+0000 7f75c0a00640 1 -- 172.21.15.143:0/114424445 wait complete. 2024-04-26T20:56:16.237 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-04-26T20:56:16.237+0000 7f3d6a42c180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T20:56:16.254 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --cluster ceph osd new d7138615-8838-45ff-9072-2fd0683362f4 6 2024-04-26T20:56:16.373 INFO:tasks.ceph.mgr.y.smithi138.stderr:2024-04-26T20:56:16.371+0000 7f146ec2c180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T20:56:16.387 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.385+0000 7fba46200640 1 Processor -- start 2024-04-26T20:56:16.388 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.385+0000 7fba46200640 1 -- start start 2024-04-26T20:56:16.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.389+0000 7fba46200640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fba4015f3b0 0x7fba400d1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:16.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.389+0000 7fba46200640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba400d2250 con 0x7fba400d3880 2024-04-26T20:56:16.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.389+0000 7fba46200640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba400cd530 con 0x7fba400cfcf0 2024-04-26T20:56:16.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.389+0000 7fba46200640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fba400cdb80 con 0x7fba4015f3b0 2024-04-26T20:56:16.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.389+0000 7fba3f400640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fba4015f3b0 0x7fba400d1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:16.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.389+0000 7fba3f400640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fba4015f3b0 0x7fba400d1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:42140/0 (socket says 172.21.15.143:42140) 2024-04-26T20:56:16.390 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.389+0000 7fba3f400640 1 -- 172.21.15.143:0/598596636 learned_addr learned my addr 172.21.15.143:0/598596636 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-04-26T20:56:16.390 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.389+0000 7fba3fe00640 1 --1- 172.21.15.143:0/598596636 >> v1:172.21.15.143:6789/0 conn(0x7fba400cfcf0 0x7fba400ce010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:53804/0 (socket says 172.21.15.143:53804) 2024-04-26T20:56:16.390 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.389+0000 7fba3f400640 1 -- 172.21.15.143:0/598596636 >> v1:172.21.15.143:6789/0 conn(0x7fba400cfcf0 legacy=0x7fba400ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:16.390 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.389+0000 7fba3f400640 1 -- 172.21.15.143:0/598596636 >> v1:172.21.15.138:6789/0 conn(0x7fba400d3880 legacy=0x7fba400cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:16.390 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.389+0000 7fba3f400640 1 -- 172.21.15.143:0/598596636 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba400cd810 con 0x7fba4015f3b0 2024-04-26T20:56:16.392 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.393+0000 7fba3f400640 1 --2- 172.21.15.143:0/598596636 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba4015f3b0 0x7fba400d1090 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fba30009870 tx=0x7fba3001c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3756e8de7849e7e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:16.392 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.393+0000 7fba3e000640 1 -- 172.21.15.143:0/598596636 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba300a9640 con 0x7fba4015f3b0 2024-04-26T20:56:16.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.393+0000 7fba3e000640 1 -- 172.21.15.143:0/598596636 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba300a97e0 con 0x7fba4015f3b0 2024-04-26T20:56:16.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.393+0000 7fba3e000640 1 -- 172.21.15.143:0/598596636 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba300a9bb0 con 0x7fba4015f3b0 2024-04-26T20:56:16.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.393+0000 7fba46200640 1 -- 172.21.15.143:0/598596636 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba4015f3b0 msgr2=0x7fba400d1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:16.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.393+0000 7fba46200640 1 --2- 172.21.15.143:0/598596636 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba4015f3b0 0x7fba400d1090 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fba30009870 tx=0x7fba3001c560 comp rx=0 tx=0).stop 2024-04-26T20:56:16.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.393+0000 7fba46200640 1 -- 172.21.15.143:0/598596636 shutdown_connections 2024-04-26T20:56:16.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.393+0000 7fba46200640 1 --2- 172.21.15.143:0/598596636 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba4015f3b0 0x7fba400d1090 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:16.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.393+0000 7fba46200640 1 -- 172.21.15.143:0/598596636 >> 172.21.15.143:0/598596636 conn(0x7fba400d2d60 msgr2=0x7fba400d3170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:16.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.393+0000 7fba46200640 1 -- 172.21.15.143:0/598596636 shutdown_connections 2024-04-26T20:56:16.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.393+0000 7fba46200640 1 -- 172.21.15.143:0/598596636 wait complete. 2024-04-26T20:56:16.395 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.393+0000 7fba46200640 1 Processor -- start 2024-04-26T20:56:16.395 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.393+0000 7fba46200640 1 -- start start 2024-04-26T20:56:16.398 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.397+0000 7fba46200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fba400cfcf0 0x7fba4014b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:16.398 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.397+0000 7fba46200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba400d3880 0x7fba401483d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:16.398 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.397+0000 7fba46200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba4015f3b0 0x7fba40154a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:16.398 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.397+0000 7fba46200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fba4016cf80 con 0x7fba400d3880 2024-04-26T20:56:16.398 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.397+0000 7fba46200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fba400cf140 con 0x7fba4015f3b0 2024-04-26T20:56:16.398 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.397+0000 7fba46200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fba4016d100 con 0x7fba400cfcf0 2024-04-26T20:56:16.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.397+0000 7fba3f400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fba400cfcf0 0x7fba4014b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:16.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.397+0000 7fba3fe00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba4015f3b0 0x7fba40154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:16.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.397+0000 7fba3f400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fba400cfcf0 0x7fba4014b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.143:47344/0 (socket says 172.21.15.143:47344) 2024-04-26T20:56:16.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.397+0000 7fba3f400640 1 -- 172.21.15.143:0/925927345 learned_addr learned my addr 172.21.15.143:0/925927345 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-04-26T20:56:16.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.397+0000 7fba3ea00640 1 --2- 172.21.15.143:0/925927345 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba400d3880 0x7fba401483d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:16.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.397+0000 7fba3fe00640 1 -- 172.21.15.143:0/925927345 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fba400cfcf0 msgr2=0x7fba4014b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:16.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.397+0000 7fba3fe00640 1 --2- 172.21.15.143:0/925927345 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fba400cfcf0 0x7fba4014b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:16.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.397+0000 7fba3fe00640 1 -- 172.21.15.143:0/925927345 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba400d3880 msgr2=0x7fba401483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:16.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.397+0000 7fba3fe00640 1 --2- 172.21.15.143:0/925927345 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba400d3880 0x7fba401483d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:16.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.397+0000 7fba3fe00640 1 -- 172.21.15.143:0/925927345 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba400b8be0 con 0x7fba4015f3b0 2024-04-26T20:56:16.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.397+0000 7fba3f400640 1 --2- 172.21.15.143:0/925927345 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fba400cfcf0 0x7fba4014b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:56:16.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.397+0000 7fba3fe00640 1 --2- 172.21.15.143:0/925927345 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba4015f3b0 0x7fba40154a30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fba3800c730 tx=0x7fba3800cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:16.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.397+0000 7fba37400640 1 -- 172.21.15.143:0/925927345 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba38018070 con 0x7fba4015f3b0 2024-04-26T20:56:16.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.397+0000 7fba37400640 1 -- 172.21.15.143:0/925927345 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba38004d70 con 0x7fba4015f3b0 2024-04-26T20:56:16.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.397+0000 7fba46200640 1 -- 172.21.15.143:0/925927345 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba400b8900 con 0x7fba4015f3b0 2024-04-26T20:56:16.400 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.397+0000 7fba37400640 1 -- 172.21.15.143:0/925927345 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba3800a860 con 0x7fba4015f3b0 2024-04-26T20:56:16.400 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.397+0000 7fba46200640 1 -- 172.21.15.143:0/925927345 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba400b7430 con 0x7fba4015f3b0 2024-04-26T20:56:16.400 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.397+0000 7fba37400640 1 -- 172.21.15.143:0/925927345 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fba3801b070 con 0x7fba4015f3b0 2024-04-26T20:56:16.400 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.397+0000 7fba37400640 1 -- 172.21.15.143:0/925927345 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fba38007960 con 0x7fba4015f3b0 2024-04-26T20:56:16.400 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.397+0000 7fba46200640 1 -- 172.21.15.143:0/925927345 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba40069430 con 0x7fba4015f3b0 2024-04-26T20:56:16.401 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.401+0000 7fba37400640 1 -- 172.21.15.143:0/925927345 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fba3800ac10 con 0x7fba4015f3b0 2024-04-26T20:56:16.411 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-04-26T20:56:16.409+0000 7f3d6a42c180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T20:56:16.445 INFO:tasks.ceph.mgr.y.smithi138.stderr:2024-04-26T20:56:16.443+0000 7f146ec2c180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T20:56:16.466 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.465+0000 7fba46200640 1 -- 172.21.15.143:0/925927345 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d7138615-8838-45ff-9072-2fd0683362f4", "id": 6} v 0) -- 0x7fba400ce2d0 con 0x7fba4015f3b0 2024-04-26T20:56:16.473 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.473+0000 7fba37400640 1 -- 172.21.15.143:0/925927345 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d7138615-8838-45ff-9072-2fd0683362f4", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fba3800adf0 con 0x7fba4015f3b0 2024-04-26T20:56:16.474 INFO:teuthology.orchestra.run.smithi143.stdout:6 2024-04-26T20:56:16.475 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.473+0000 7fba46200640 1 -- 172.21.15.143:0/925927345 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba4015f3b0 msgr2=0x7fba40154a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:16.475 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.473+0000 7fba46200640 1 --2- 172.21.15.143:0/925927345 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba4015f3b0 0x7fba40154a30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fba3800c730 tx=0x7fba3800cbf0 comp rx=0 tx=0).stop 2024-04-26T20:56:16.475 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.473+0000 7fba46200640 1 -- 172.21.15.143:0/925927345 shutdown_connections 2024-04-26T20:56:16.475 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.473+0000 7fba46200640 1 --2- 172.21.15.143:0/925927345 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba4015f3b0 0x7fba40154a30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:16.475 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.473+0000 7fba46200640 1 --2- 172.21.15.143:0/925927345 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba400d3880 0x7fba401483d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:16.475 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.473+0000 7fba46200640 1 --2- 172.21.15.143:0/925927345 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fba400cfcf0 0x7fba4014b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:16.475 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.473+0000 7fba46200640 1 -- 172.21.15.143:0/925927345 >> 172.21.15.143:0/925927345 conn(0x7fba400d2d60 msgr2=0x7fba40156e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:16.475 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.473+0000 7fba46200640 1 -- 172.21.15.143:0/925927345 shutdown_connections 2024-04-26T20:56:16.475 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.473+0000 7fba46200640 1 -- 172.21.15.143:0/925927345 wait complete. 2024-04-26T20:56:16.485 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-04-26T20:56:16.485+0000 7f3d6a42c180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T20:56:16.493 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --cluster ceph osd new 0c27172b-35c4-49ec-ba0b-0137b8ff0010 7 2024-04-26T20:56:16.628 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.629+0000 7fc675000640 1 Processor -- start 2024-04-26T20:56:16.628 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.629+0000 7fc675000640 1 -- start start 2024-04-26T20:56:16.630 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.629+0000 7fc675000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc67006e610 0x7fc67006fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:16.630 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.629+0000 7fc675000640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc67006eb80 con 0x7fc6700b4400 2024-04-26T20:56:16.630 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.629+0000 7fc675000640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc67006ee60 con 0x7fc670070160 2024-04-26T20:56:16.630 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.629+0000 7fc675000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fc67006f140 con 0x7fc67006e610 2024-04-26T20:56:16.630 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.629+0000 7fc66d400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc67006e610 0x7fc67006fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:16.630 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.629+0000 7fc66e800640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fc670070160 0x7fc6700b47e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:53806/0 (socket says 172.21.15.143:53806) 2024-04-26T20:56:16.631 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.629+0000 7fc66e800640 1 -- 172.21.15.143:0/1020050425 learned_addr learned my addr 172.21.15.143:0/1020050425 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-04-26T20:56:16.631 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.629+0000 7fc66d400640 1 -- 172.21.15.143:0/1020050425 >> v1:172.21.15.143:6789/0 conn(0x7fc670070160 legacy=0x7fc6700b47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:16.631 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.629+0000 7fc66d400640 1 -- 172.21.15.143:0/1020050425 >> v1:172.21.15.138:6789/0 conn(0x7fc6700b4400 legacy=0x7fc6700cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:16.631 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.629+0000 7fc66d400640 1 -- 172.21.15.143:0/1020050425 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc67006f420 con 0x7fc67006e610 2024-04-26T20:56:16.633 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.633+0000 7fc66d400640 1 --2- 172.21.15.143:0/1020050425 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc67006e610 0x7fc67006fc20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc65c00ba90 tx=0x7fc65c01eb40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2dd3b39c141b7166 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:16.633 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.633+0000 7fc66ca00640 1 -- 172.21.15.143:0/1020050425 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc65c0b4070 con 0x7fc67006e610 2024-04-26T20:56:16.633 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.633+0000 7fc66ca00640 1 -- 172.21.15.143:0/1020050425 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc65c0a7b20 con 0x7fc67006e610 2024-04-26T20:56:16.633 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.633+0000 7fc66ca00640 1 -- 172.21.15.143:0/1020050425 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc65c0af440 con 0x7fc67006e610 2024-04-26T20:56:16.634 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.633+0000 7fc675000640 1 -- 172.21.15.143:0/1020050425 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc67006e610 msgr2=0x7fc67006fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:16.634 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.633+0000 7fc675000640 1 --2- 172.21.15.143:0/1020050425 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc67006e610 0x7fc67006fc20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc65c00ba90 tx=0x7fc65c01eb40 comp rx=0 tx=0).stop 2024-04-26T20:56:16.634 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.633+0000 7fc675000640 1 -- 172.21.15.143:0/1020050425 shutdown_connections 2024-04-26T20:56:16.634 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.633+0000 7fc675000640 1 --2- 172.21.15.143:0/1020050425 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc67006e610 0x7fc67006fc20 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:16.634 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.633+0000 7fc675000640 1 -- 172.21.15.143:0/1020050425 >> 172.21.15.143:0/1020050425 conn(0x7fc6700d1510 msgr2=0x7fc6700d1920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:16.634 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.633+0000 7fc675000640 1 -- 172.21.15.143:0/1020050425 shutdown_connections 2024-04-26T20:56:16.635 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.633+0000 7fc675000640 1 -- 172.21.15.143:0/1020050425 wait complete. 2024-04-26T20:56:16.635 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.633+0000 7fc675000640 1 Processor -- start 2024-04-26T20:56:16.636 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.633+0000 7fc675000640 1 -- start start 2024-04-26T20:56:16.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.637+0000 7fc675000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc67006e610 0x7fc6701fbf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:16.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.637+0000 7fc675000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc6700b4400 0x7fc6701fb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:16.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.637+0000 7fc675000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc670148b80 0x7fc670149030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:16.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.637+0000 7fc675000640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc67006c300 con 0x7fc67006e610 2024-04-26T20:56:16.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.637+0000 7fc675000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fc6700cf5b0 con 0x7fc670148b80 2024-04-26T20:56:16.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.637+0000 7fc675000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fc67006c480 con 0x7fc6700b4400 2024-04-26T20:56:16.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.637+0000 7fc66e800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc670148b80 0x7fc670149030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:16.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.637+0000 7fc66d400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc6700b4400 0x7fc6701fb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:16.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.637+0000 7fc66e800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc670148b80 0x7fc670149030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:42160/0 (socket says 172.21.15.143:42160) 2024-04-26T20:56:16.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.637+0000 7fc66d400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc6700b4400 0x7fc6701fb640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.143:47358/0 (socket says 172.21.15.143:47358) 2024-04-26T20:56:16.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.637+0000 7fc66e800640 1 -- 172.21.15.143:0/3277263916 learned_addr learned my addr 172.21.15.143:0/3277263916 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-04-26T20:56:16.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.637+0000 7fc66de00640 1 --2- 172.21.15.143:0/3277263916 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc67006e610 0x7fc6701fbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:16.639 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.637+0000 7fc66d400640 1 -- 172.21.15.143:0/3277263916 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc670148b80 msgr2=0x7fc670149030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:16.639 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.637+0000 7fc66d400640 1 --2- 172.21.15.143:0/3277263916 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc670148b80 0x7fc670149030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:16.639 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.637+0000 7fc66d400640 1 -- 172.21.15.143:0/3277263916 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc67006e610 msgr2=0x7fc6701fbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:16.639 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.637+0000 7fc66d400640 1 --2- 172.21.15.143:0/3277263916 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc67006e610 0x7fc6701fbf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:16.639 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.637+0000 7fc66d400640 1 -- 172.21.15.143:0/3277263916 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6700cbf70 con 0x7fc6700b4400 2024-04-26T20:56:16.639 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.637+0000 7fc66de00640 1 --2- 172.21.15.143:0/3277263916 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc67006e610 0x7fc6701fbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:56:16.639 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.637+0000 7fc66d400640 1 --2- 172.21.15.143:0/3277263916 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc6700b4400 0x7fc6701fb640 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc6700b4180 tx=0x7fc65c01b8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:16.639 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.637+0000 7fc666000640 1 -- 172.21.15.143:0/3277263916 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc65c0b4040 con 0x7fc6700b4400 2024-04-26T20:56:16.639 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.637+0000 7fc666000640 1 -- 172.21.15.143:0/3277263916 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc65c0bd070 con 0x7fc6700b4400 2024-04-26T20:56:16.639 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.637+0000 7fc666000640 1 -- 172.21.15.143:0/3277263916 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc65c0b8440 con 0x7fc6700b4400 2024-04-26T20:56:16.639 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.637+0000 7fc675000640 1 -- 172.21.15.143:0/3277263916 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6700aa5d0 con 0x7fc6700b4400 2024-04-26T20:56:16.639 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.637+0000 7fc675000640 1 -- 172.21.15.143:0/3277263916 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6700aab90 con 0x7fc6700b4400 2024-04-26T20:56:16.640 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.637+0000 7fc666000640 1 -- 172.21.15.143:0/3277263916 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc65c0b85e0 con 0x7fc6700b4400 2024-04-26T20:56:16.640 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.637+0000 7fc666000640 1 -- 172.21.15.143:0/3277263916 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fc65c0c13c0 con 0x7fc6700b4400 2024-04-26T20:56:16.640 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.637+0000 7fc675000640 1 -- 172.21.15.143:0/3277263916 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6700aad90 con 0x7fc6700b4400 2024-04-26T20:56:16.641 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.641+0000 7fc666000640 1 -- 172.21.15.143:0/3277263916 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fc6700aad90 con 0x7fc6700b4400 2024-04-26T20:56:16.711 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.709+0000 7fc675000640 1 -- 172.21.15.143:0/3277263916 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0c27172b-35c4-49ec-ba0b-0137b8ff0010", "id": 7} v 0) -- 0x7fc670069b40 con 0x7fc6700b4400 2024-04-26T20:56:16.720 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.717+0000 7fc666000640 1 -- 172.21.15.143:0/3277263916 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0c27172b-35c4-49ec-ba0b-0137b8ff0010", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fc65c018760 con 0x7fc6700b4400 2024-04-26T20:56:16.720 INFO:teuthology.orchestra.run.smithi143.stdout:7 2024-04-26T20:56:16.721 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.721+0000 7fc675000640 1 -- 172.21.15.143:0/3277263916 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc6700b4400 msgr2=0x7fc6701fb640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:16.721 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.721+0000 7fc675000640 1 --2- 172.21.15.143:0/3277263916 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc6700b4400 0x7fc6701fb640 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc6700b4180 tx=0x7fc65c01b8e0 comp rx=0 tx=0).stop 2024-04-26T20:56:16.721 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.721+0000 7fc675000640 1 -- 172.21.15.143:0/3277263916 shutdown_connections 2024-04-26T20:56:16.721 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.721+0000 7fc675000640 1 --2- 172.21.15.143:0/3277263916 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc670148b80 0x7fc670149030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:16.722 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.721+0000 7fc675000640 1 --2- 172.21.15.143:0/3277263916 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc6700b4400 0x7fc6701fb640 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:16.722 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.721+0000 7fc675000640 1 --2- 172.21.15.143:0/3277263916 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc67006e610 0x7fc6701fbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:16.722 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.721+0000 7fc675000640 1 -- 172.21.15.143:0/3277263916 >> 172.21.15.143:0/3277263916 conn(0x7fc6700d1510 msgr2=0x7fc67015a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:16.722 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.721+0000 7fc675000640 1 -- 172.21.15.143:0/3277263916 shutdown_connections 2024-04-26T20:56:16.722 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:56:16.721+0000 7fc675000640 1 -- 172.21.15.143:0/3277263916 wait complete. 2024-04-26T20:56:16.739 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-26T20:56:16.739 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-26T20:56:16.742 INFO:tasks.ceph.osd.0:Started 2024-04-26T20:56:16.742 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-26T20:56:16.743 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-26T20:56:16.746 INFO:tasks.ceph.osd.1:Started 2024-04-26T20:56:16.746 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-26T20:56:16.746 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-26T20:56:16.749 INFO:tasks.ceph.osd.2:Started 2024-04-26T20:56:16.749 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-26T20:56:16.749 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-26T20:56:16.759 INFO:tasks.ceph.osd.3:Started 2024-04-26T20:56:16.759 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-26T20:56:16.759 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-26T20:56:16.762 INFO:tasks.ceph.osd.4:Started 2024-04-26T20:56:16.762 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-26T20:56:16.762 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-26T20:56:16.766 INFO:tasks.ceph.osd.5:Started 2024-04-26T20:56:16.766 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-26T20:56:16.767 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-26T20:56:16.770 INFO:tasks.ceph.osd.6:Started 2024-04-26T20:56:16.770 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-26T20:56:16.771 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-26T20:56:16.774 INFO:tasks.ceph.osd.7:Started 2024-04-26T20:56:16.775 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:56:16.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:16.971+0000 7f2cfb800640 1 Processor -- start 2024-04-26T20:56:16.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:16.971+0000 7f2cfb800640 1 -- start start 2024-04-26T20:56:16.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:16.971+0000 7f2cfb800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2cf40cedb0 0x7f2cf41637e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:16.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:16.971+0000 7f2cfb800640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cf40d12c0 con 0x7f2cf406d4b0 2024-04-26T20:56:16.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:16.971+0000 7f2cfb800640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cf40d15a0 con 0x7f2cf406e3c0 2024-04-26T20:56:16.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:16.971+0000 7f2cfb800640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f2cf40d2bb0 con 0x7f2cf40cedb0 2024-04-26T20:56:16.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:16.971+0000 7f2cf8e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2cf40cedb0 0x7f2cf41637e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:16.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:16.971+0000 7f2cf3e00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f2cf406d4b0 0x7f2cf406dcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:58346/0 (socket says 172.21.15.138:58346) 2024-04-26T20:56:16.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:16.971+0000 7f2cf3e00640 1 -- 172.21.15.138:0/498373384 learned_addr learned my addr 172.21.15.138:0/498373384 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:56:16.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:16.971+0000 7f2cf8e00640 1 -- 172.21.15.138:0/498373384 >> v1:172.21.15.143:6789/0 conn(0x7f2cf406e3c0 legacy=0x7f2cf415ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:16.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:16.971+0000 7f2cf8e00640 1 -- 172.21.15.138:0/498373384 >> v1:172.21.15.138:6789/0 conn(0x7f2cf406d4b0 legacy=0x7f2cf406dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:16.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:16.971+0000 7f2cf8e00640 1 -- 172.21.15.138:0/498373384 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cf40d1880 con 0x7f2cf40cedb0 2024-04-26T20:56:16.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:16.975+0000 7f2cf8e00640 1 --2- 172.21.15.138:0/498373384 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2cf40cedb0 0x7f2cf41637e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2ce80097c0 tx=0x7f2ce801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=643cfae3ae049f53 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:16.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:16.975+0000 7f2cf3400640 1 -- 172.21.15.138:0/498373384 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce80b1070 con 0x7f2cf40cedb0 2024-04-26T20:56:16.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:16.975+0000 7f2cf3400640 1 -- 172.21.15.138:0/498373384 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ce80ac410 con 0x7f2cf40cedb0 2024-04-26T20:56:16.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:16.975+0000 7f2cf3400640 1 -- 172.21.15.138:0/498373384 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce80ac7e0 con 0x7f2cf40cedb0 2024-04-26T20:56:16.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:16.975+0000 7f2cfb800640 1 -- 172.21.15.138:0/498373384 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2cf40cedb0 msgr2=0x7f2cf41637e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:16.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:16.975+0000 7f2cfb800640 1 --2- 172.21.15.138:0/498373384 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2cf40cedb0 0x7f2cf41637e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2ce80097c0 tx=0x7f2ce801c4a0 comp rx=0 tx=0).stop 2024-04-26T20:56:16.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:16.975+0000 7f2cfb800640 1 -- 172.21.15.138:0/498373384 shutdown_connections 2024-04-26T20:56:16.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:16.975+0000 7f2cfb800640 1 --2- 172.21.15.138:0/498373384 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2cf40cedb0 0x7f2cf41637e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:16.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:16.975+0000 7f2cfb800640 1 -- 172.21.15.138:0/498373384 >> 172.21.15.138:0/498373384 conn(0x7f2cf40d2df0 msgr2=0x7f2cf40d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:16.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:16.975+0000 7f2cfb800640 1 -- 172.21.15.138:0/498373384 shutdown_connections 2024-04-26T20:56:16.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:16.975+0000 7f2cfb800640 1 -- 172.21.15.138:0/498373384 wait complete. 2024-04-26T20:56:16.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:16.979+0000 7f2cfb800640 1 Processor -- start 2024-04-26T20:56:16.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:16.979+0000 7f2cfb800640 1 -- start start 2024-04-26T20:56:16.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:16.979+0000 7f2cfb800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2cf406d4b0 0x7f2cf4151a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:16.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:16.979+0000 7f2cfb800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2cf406e3c0 0x7f2cf415cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:16.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:16.979+0000 7f2cfb800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2cf40cedb0 0x7f2cf415d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:16.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:16.979+0000 7f2cfb800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf415f580 con 0x7f2cf40cedb0 2024-04-26T20:56:16.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:16.979+0000 7f2cfb800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf40ce450 con 0x7f2cf406d4b0 2024-04-26T20:56:16.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:16.979+0000 7f2cfb800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f2cf415f700 con 0x7f2cf406e3c0 2024-04-26T20:56:16.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:16.979+0000 7f2cf9800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2cf40cedb0 0x7f2cf415d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:16.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:16.979+0000 7f2cf9800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2cf40cedb0 0x7f2cf415d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:36152/0 (socket says 172.21.15.138:36152) 2024-04-26T20:56:16.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:16.979+0000 7f2cf9800640 1 -- 172.21.15.138:0/3891829871 learned_addr learned my addr 172.21.15.138:0/3891829871 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:16.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:16.979+0000 7f2cf8e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2cf406d4b0 0x7f2cf4151a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:16.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:16.979+0000 7f2cf3e00640 1 --2- 172.21.15.138:0/3891829871 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2cf406e3c0 0x7f2cf415cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:16.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:16.979+0000 7f2cf9800640 1 -- 172.21.15.138:0/3891829871 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2cf406e3c0 msgr2=0x7f2cf415cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:16.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:16.979+0000 7f2cf9800640 1 --2- 172.21.15.138:0/3891829871 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2cf406e3c0 0x7f2cf415cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:16.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:16.979+0000 7f2cf9800640 1 -- 172.21.15.138:0/3891829871 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2cf406d4b0 msgr2=0x7f2cf4151a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:16.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:16.979+0000 7f2cf9800640 1 --2- 172.21.15.138:0/3891829871 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2cf406d4b0 0x7f2cf4151a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:16.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:16.979+0000 7f2cf9800640 1 -- 172.21.15.138:0/3891829871 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cf415e2f0 con 0x7f2cf40cedb0 2024-04-26T20:56:16.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:16.979+0000 7f2cf8e00640 1 --2- 172.21.15.138:0/3891829871 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2cf406d4b0 0x7f2cf4151a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:56:16.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:16.979+0000 7f2cf9800640 1 --2- 172.21.15.138:0/3891829871 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2cf40cedb0 0x7f2cf415d4b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2cec00c760 tx=0x7f2cec00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:16.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:16.979+0000 7f2cf0c00640 1 -- 172.21.15.138:0/3891829871 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cec003b80 con 0x7f2cf40cedb0 2024-04-26T20:56:16.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:16.979+0000 7f2cf0c00640 1 -- 172.21.15.138:0/3891829871 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cec003d20 con 0x7f2cf40cedb0 2024-04-26T20:56:16.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:16.979+0000 7f2cfb800640 1 -- 172.21.15.138:0/3891829871 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cf415e010 con 0x7f2cf40cedb0 2024-04-26T20:56:16.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:16.979+0000 7f2cf0c00640 1 -- 172.21.15.138:0/3891829871 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cec005310 con 0x7f2cf40cedb0 2024-04-26T20:56:16.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:16.979+0000 7f2cfb800640 1 -- 172.21.15.138:0/3891829871 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cf414f0c0 con 0x7f2cf40cedb0 2024-04-26T20:56:16.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:16.979+0000 7f2cf0c00640 1 -- 172.21.15.138:0/3891829871 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2cec0054b0 con 0x7f2cf40cedb0 2024-04-26T20:56:16.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:16.979+0000 7f2cf0c00640 1 -- 172.21.15.138:0/3891829871 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f2cec012420 con 0x7f2cf40cedb0 2024-04-26T20:56:16.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:16.979+0000 7f2cfb800640 1 -- 172.21.15.138:0/3891829871 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cf4069b40 con 0x7f2cf40cedb0 2024-04-26T20:56:16.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:16.983+0000 7f2cf0c00640 1 -- 172.21.15.138:0/3891829871 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f2cec0057a0 con 0x7f2cf40cedb0 2024-04-26T20:56:17.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:17.039+0000 7f2cfb800640 1 -- 172.21.15.138:0/3891829871 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2cf40705f0 con 0x7f2cf40cedb0 2024-04-26T20:56:17.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:17.039+0000 7f2cf0c00640 1 -- 172.21.15.138:0/3891829871 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f2cec00a640 con 0x7f2cf40cedb0 2024-04-26T20:56:17.041 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:56:17.041 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":10,"fsid":"c22b4730-12cc-4558-8535-b965384398c0","created":"2024-04-26T20:56:14.182475+0000","modified":"2024-04-26T20:56:16.714055+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T20:56:16.714055+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"3f9a2e34-3199-466f-a6cf-57927318121e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e881fcf6-3248-4696-a2ef-95d206d77712","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f7d1db33-7672-4699-ae47-9f1e0a8e4222","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2f4e0a9a-b8f6-4468-844a-a4501cd85054","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c85df99b-3624-410e-866b-86830af2cfe1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9af1efb5-c416-4808-b5ef-de0679ab9705","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d7138615-8838-45ff-9072-2fd0683362f4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0c27172b-35c4-49ec-ba0b-0137b8ff0010","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:56:17.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:17.039+0000 7f2cfb800640 1 -- 172.21.15.138:0/3891829871 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2cf40cedb0 msgr2=0x7f2cf415d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:17.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:17.039+0000 7f2cfb800640 1 --2- 172.21.15.138:0/3891829871 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2cf40cedb0 0x7f2cf415d4b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2cec00c760 tx=0x7f2cec00cc20 comp rx=0 tx=0).stop 2024-04-26T20:56:17.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:17.039+0000 7f2cfb800640 1 -- 172.21.15.138:0/3891829871 shutdown_connections 2024-04-26T20:56:17.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:17.039+0000 7f2cfb800640 1 --2- 172.21.15.138:0/3891829871 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2cf40cedb0 0x7f2cf415d4b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:17.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:17.039+0000 7f2cfb800640 1 --2- 172.21.15.138:0/3891829871 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2cf406e3c0 0x7f2cf415cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:17.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:17.039+0000 7f2cfb800640 1 --2- 172.21.15.138:0/3891829871 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2cf406d4b0 0x7f2cf4151a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:17.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:17.039+0000 7f2cfb800640 1 -- 172.21.15.138:0/3891829871 >> 172.21.15.138:0/3891829871 conn(0x7f2cf40d2df0 msgr2=0x7f2cf40afaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:17.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:17.039+0000 7f2cfb800640 1 -- 172.21.15.138:0/3891829871 shutdown_connections 2024-04-26T20:56:17.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:17.039+0000 7f2cfb800640 1 -- 172.21.15.138:0/3891829871 wait complete. 2024-04-26T20:56:17.061 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-26T20:56:17.061 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-26T20:56:17.120 INFO:tasks.ceph.mgr.y.smithi138.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-26T20:56:17.121 INFO:tasks.ceph.mgr.y.smithi138.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-26T20:56:17.121 INFO:tasks.ceph.mgr.y.smithi138.stderr: from numpy import show_config as show_numpy_config 2024-04-26T20:56:17.144 INFO:tasks.ceph.mgr.x.smithi143.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-26T20:56:17.144 INFO:tasks.ceph.mgr.x.smithi143.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-26T20:56:17.144 INFO:tasks.ceph.mgr.x.smithi143.stderr: from numpy import show_config as show_numpy_config 2024-04-26T20:56:17.170 INFO:tasks.ceph.mgr.y.smithi138.stderr:2024-04-26T20:56:17.167+0000 7f146ec2c180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T20:56:17.186 INFO:tasks.ceph.osd.4.smithi143.stderr:2024-04-26T20:56:17.185+0000 7ff2154e87c0 -1 Falling back to public interface 2024-04-26T20:56:17.194 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-04-26T20:56:17.193+0000 7f3d6a42c180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T20:56:17.321 INFO:tasks.ceph.mgr.y.smithi138.stderr:2024-04-26T20:56:17.319+0000 7f146ec2c180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T20:56:17.345 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-04-26T20:56:17.345+0000 7f3d6a42c180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T20:56:17.424 INFO:tasks.ceph.osd.0.smithi138.stderr:2024-04-26T20:56:17.423+0000 7fa37167e7c0 -1 Falling back to public interface 2024-04-26T20:56:17.428 INFO:tasks.ceph.osd.2.smithi138.stderr:2024-04-26T20:56:17.427+0000 7f7015e5d7c0 -1 Falling back to public interface 2024-04-26T20:56:17.432 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-04-26T20:56:17.431+0000 7fb3dabfd7c0 -1 Falling back to public interface 2024-04-26T20:56:17.441 INFO:tasks.ceph.osd.5.smithi143.stderr:2024-04-26T20:56:17.441+0000 7fa59d3b67c0 -1 Falling back to public interface 2024-04-26T20:56:17.462 INFO:tasks.ceph.osd.6.smithi143.stderr:2024-04-26T20:56:17.461+0000 7f93f8ffb7c0 -1 Falling back to public interface 2024-04-26T20:56:17.467 INFO:tasks.ceph.osd.3.smithi138.stderr:2024-04-26T20:56:17.467+0000 7f622f1967c0 -1 Falling back to public interface 2024-04-26T20:56:17.481 INFO:tasks.ceph.osd.7.smithi143.stderr:2024-04-26T20:56:17.481+0000 7fd7a6dfb7c0 -1 Falling back to public interface 2024-04-26T20:56:17.508 INFO:tasks.ceph.mgr.y.smithi138.stderr:2024-04-26T20:56:17.507+0000 7f146ec2c180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T20:56:17.516 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-04-26T20:56:17.517+0000 7f3d6a42c180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T20:56:17.592 INFO:tasks.ceph.mgr.y.smithi138.stderr:2024-04-26T20:56:17.591+0000 7f146ec2c180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T20:56:17.602 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-04-26T20:56:17.601+0000 7f3d6a42c180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T20:56:17.747 INFO:tasks.ceph.mgr.y.smithi138.stderr:2024-04-26T20:56:17.747+0000 7f146ec2c180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T20:56:17.752 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-04-26T20:56:17.753+0000 7f3d6a42c180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T20:56:17.867 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T20:56:17.993 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:17.991+0000 7f758ca00640 1 Processor -- start 2024-04-26T20:56:17.993 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:17.991+0000 7f758ca00640 1 -- start start 2024-04-26T20:56:17.995 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:17.991+0000 7f758ca00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f75880cfce0 0x7f7588162ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:17.995 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:17.991+0000 7f758ca00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f75880d1bf0 0x7f7588163420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:17.995 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:17.991+0000 7f758ca00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7588163960 0x7f758806d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:17.995 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:17.991+0000 7f758ca00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f75880d21b0 con 0x7f75880d1bf0 2024-04-26T20:56:17.995 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:17.991+0000 7f758ca00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f75880d2490 con 0x7f75880cfce0 2024-04-26T20:56:17.996 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:17.991+0000 7f758ca00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f75880cd480 con 0x7f7588163960 2024-04-26T20:56:17.996 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:17.995+0000 7f7585400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f75880d1bf0 0x7f7588163420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:17.996 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:17.995+0000 7f7585400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f75880d1bf0 0x7f7588163420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:36154/0 (socket says 172.21.15.138:36154) 2024-04-26T20:56:17.996 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:17.995+0000 7f7585400640 1 -- 172.21.15.138:0/3246133548 learned_addr learned my addr 172.21.15.138:0/3246133548 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:17.996 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:17.995+0000 7f7586800640 1 --2- 172.21.15.138:0/3246133548 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7588163960 0x7f758806d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:17.996 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:17.995+0000 7f7585e00640 1 --2- 172.21.15.138:0/3246133548 >> v2:172.21.15.143:3300/0 conn(0x7f75880cfce0 0x7f7588162ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:17.996 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:17.995+0000 7f7585400640 1 -- 172.21.15.138:0/3246133548 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7588163960 msgr2=0x7f758806d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:17.996 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:17.995+0000 7f7585400640 1 --2- 172.21.15.138:0/3246133548 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7588163960 0x7f758806d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:17.996 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:17.995+0000 7f7585400640 1 -- 172.21.15.138:0/3246133548 >> v2:172.21.15.143:3300/0 conn(0x7f75880cfce0 msgr2=0x7f7588162ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:17.996 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:17.995+0000 7f7585400640 1 --2- 172.21.15.138:0/3246133548 >> v2:172.21.15.143:3300/0 conn(0x7f75880cfce0 0x7f7588162ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:17.996 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:17.995+0000 7f7585400640 1 -- 172.21.15.138:0/3246133548 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75880cd760 con 0x7f75880d1bf0 2024-04-26T20:56:17.998 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:17.995+0000 7f7585400640 1 --2- 172.21.15.138:0/3246133548 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75880d1bf0 0x7f7588163420 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f758806a100 tx=0x7f757401c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ba8b4e253569c2f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:17.998 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:17.995+0000 7f7584a00640 1 -- 172.21.15.138:0/3246133548 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75740b0070 con 0x7f75880d1bf0 2024-04-26T20:56:17.998 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:17.995+0000 7f7584a00640 1 -- 172.21.15.138:0/3246133548 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75740ab600 con 0x7f75880d1bf0 2024-04-26T20:56:17.998 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:17.995+0000 7f7584a00640 1 -- 172.21.15.138:0/3246133548 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75740ab9d0 con 0x7f75880d1bf0 2024-04-26T20:56:17.999 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:17.999+0000 7f758ca00640 1 -- 172.21.15.138:0/3246133548 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75880d1bf0 msgr2=0x7f7588163420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:17.999 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:17.999+0000 7f758ca00640 1 --2- 172.21.15.138:0/3246133548 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75880d1bf0 0x7f7588163420 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f758806a100 tx=0x7f757401c260 comp rx=0 tx=0).stop 2024-04-26T20:56:17.999 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:17.999+0000 7f758ca00640 1 -- 172.21.15.138:0/3246133548 shutdown_connections 2024-04-26T20:56:17.999 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:17.999+0000 7f758ca00640 1 --2- 172.21.15.138:0/3246133548 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7588163960 0x7f758806d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:17.999 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:17.999+0000 7f758ca00640 1 --2- 172.21.15.138:0/3246133548 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75880d1bf0 0x7f7588163420 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:18.000 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:17.999+0000 7f758ca00640 1 --2- 172.21.15.138:0/3246133548 >> v2:172.21.15.143:3300/0 conn(0x7f75880cfce0 0x7f7588162ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:18.000 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:17.999+0000 7f758ca00640 1 -- 172.21.15.138:0/3246133548 >> 172.21.15.138:0/3246133548 conn(0x7f75880d2d90 msgr2=0x7f75880d3170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:18.000 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:17.999+0000 7f758ca00640 1 -- 172.21.15.138:0/3246133548 shutdown_connections 2024-04-26T20:56:18.000 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:17.999+0000 7f758ca00640 1 -- 172.21.15.138:0/3246133548 wait complete. 2024-04-26T20:56:18.001 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:17.999+0000 7f758ca00640 1 Processor -- start 2024-04-26T20:56:18.001 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:17.999+0000 7f758ca00640 1 -- start start 2024-04-26T20:56:18.003 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:17.999+0000 7f758ca00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f75880cfce0 0x7f7588161600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:18.003 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:17.999+0000 7f758ca00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75880d1bf0 0x7f758815eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:18.003 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:17.999+0000 7f758ca00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7588163960 0x7f758815f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:18.004 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:17.999+0000 7f758ca00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f75880ce0e0 con 0x7f7588163960 2024-04-26T20:56:18.004 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:17.999+0000 7f758ca00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f75880cdf60 con 0x7f75880cfce0 2024-04-26T20:56:18.004 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:17.999+0000 7f758ca00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f75880ce260 con 0x7f75880d1bf0 2024-04-26T20:56:18.004 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:17.999+0000 7f7586800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7588163960 0x7f758815f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:18.004 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:17.999+0000 7f7586800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7588163960 0x7f758815f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:36162/0 (socket says 172.21.15.138:36162) 2024-04-26T20:56:18.004 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:17.999+0000 7f7586800640 1 -- 172.21.15.138:0/1865289558 learned_addr learned my addr 172.21.15.138:0/1865289558 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:18.004 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:17.999+0000 7f7585e00640 1 --2- 172.21.15.138:0/1865289558 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f75880cfce0 0x7f7588161600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:18.004 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:17.999+0000 7f7585400640 1 --2- 172.21.15.138:0/1865289558 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75880d1bf0 0x7f758815eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:18.004 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:17.999+0000 7f7586800640 1 -- 172.21.15.138:0/1865289558 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75880d1bf0 msgr2=0x7f758815eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:18.004 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:17.999+0000 7f7586800640 1 --2- 172.21.15.138:0/1865289558 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75880d1bf0 0x7f758815eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:18.004 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:17.999+0000 7f7586800640 1 -- 172.21.15.138:0/1865289558 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f75880cfce0 msgr2=0x7f7588161600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:18.004 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:17.999+0000 7f7586800640 1 --2- 172.21.15.138:0/1865289558 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f75880cfce0 0x7f7588161600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:18.005 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:17.999+0000 7f7586800640 1 -- 172.21.15.138:0/1865289558 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7588153660 con 0x7f7588163960 2024-04-26T20:56:18.005 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:18.003+0000 7f7586800640 1 --2- 172.21.15.138:0/1865289558 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7588163960 0x7f758815f060 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f758000efc0 tx=0x7f758000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:18.005 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:18.003+0000 7f757e000640 1 -- 172.21.15.138:0/1865289558 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7580018020 con 0x7f7588163960 2024-04-26T20:56:18.005 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:18.003+0000 7f757e000640 1 -- 172.21.15.138:0/1865289558 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7580014480 con 0x7f7588163960 2024-04-26T20:56:18.005 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:18.003+0000 7f758ca00640 1 -- 172.21.15.138:0/1865289558 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f758815f700 con 0x7f7588163960 2024-04-26T20:56:18.005 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:18.003+0000 7f757e000640 1 -- 172.21.15.138:0/1865289558 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7580014870 con 0x7f7588163960 2024-04-26T20:56:18.005 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:18.003+0000 7f758ca00640 1 -- 172.21.15.138:0/1865289558 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75880c6c40 con 0x7f7588163960 2024-04-26T20:56:18.005 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:18.003+0000 7f757e000640 1 -- 172.21.15.138:0/1865289558 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f758001b020 con 0x7f7588163960 2024-04-26T20:56:18.005 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:18.003+0000 7f757e000640 1 -- 172.21.15.138:0/1865289558 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f7580013ab0 con 0x7f7588163960 2024-04-26T20:56:18.005 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:18.003+0000 7f758ca00640 1 -- 172.21.15.138:0/1865289558 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7588069d60 con 0x7f7588163960 2024-04-26T20:56:18.006 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:18.003+0000 7f757e000640 1 -- 172.21.15.138:0/1865289558 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f7580022070 con 0x7f7588163960 2024-04-26T20:56:18.063 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:18.063+0000 7f758ca00640 1 -- 172.21.15.138:0/1865289558 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7588070930 con 0x7f7588163960 2024-04-26T20:56:18.064 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:18.063+0000 7f757e000640 1 -- 172.21.15.138:0/1865289558 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f7588153660 con 0x7f7588163960 2024-04-26T20:56:18.064 INFO:teuthology.misc.health.smithi138.stdout: 2024-04-26T20:56:18.064 INFO:teuthology.misc.health.smithi138.stdout:{"epoch":10,"fsid":"c22b4730-12cc-4558-8535-b965384398c0","created":"2024-04-26T20:56:14.182475+0000","modified":"2024-04-26T20:56:16.714055+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T20:56:16.714055+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"3f9a2e34-3199-466f-a6cf-57927318121e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e881fcf6-3248-4696-a2ef-95d206d77712","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f7d1db33-7672-4699-ae47-9f1e0a8e4222","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2f4e0a9a-b8f6-4468-844a-a4501cd85054","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c85df99b-3624-410e-866b-86830af2cfe1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9af1efb5-c416-4808-b5ef-de0679ab9705","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d7138615-8838-45ff-9072-2fd0683362f4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0c27172b-35c4-49ec-ba0b-0137b8ff0010","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:56:18.065 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:18.063+0000 7f758ca00640 1 -- 172.21.15.138:0/1865289558 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7588163960 msgr2=0x7f758815f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:18.065 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:18.063+0000 7f758ca00640 1 --2- 172.21.15.138:0/1865289558 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7588163960 0x7f758815f060 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f758000efc0 tx=0x7f758000c490 comp rx=0 tx=0).stop 2024-04-26T20:56:18.065 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:18.063+0000 7f758ca00640 1 -- 172.21.15.138:0/1865289558 shutdown_connections 2024-04-26T20:56:18.065 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:18.063+0000 7f758ca00640 1 --2- 172.21.15.138:0/1865289558 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7588163960 0x7f758815f060 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:18.066 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:18.063+0000 7f758ca00640 1 --2- 172.21.15.138:0/1865289558 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75880d1bf0 0x7f758815eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:18.066 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:18.063+0000 7f758ca00640 1 --2- 172.21.15.138:0/1865289558 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f75880cfce0 0x7f7588161600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:18.066 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:18.063+0000 7f758ca00640 1 -- 172.21.15.138:0/1865289558 >> 172.21.15.138:0/1865289558 conn(0x7f75880d2d90 msgr2=0x7f7588162bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:18.066 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:18.063+0000 7f758ca00640 1 -- 172.21.15.138:0/1865289558 shutdown_connections 2024-04-26T20:56:18.066 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:18.063+0000 7f758ca00640 1 -- 172.21.15.138:0/1865289558 wait complete. 2024-04-26T20:56:18.082 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-26T20:56:18.446 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-04-26T20:56:18.445+0000 7f3d6a42c180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T20:56:18.447 INFO:tasks.ceph.mgr.y.smithi138.stderr:2024-04-26T20:56:18.447+0000 7f146ec2c180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T20:56:18.533 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-04-26T20:56:18.533+0000 7f3d6a42c180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T20:56:18.534 INFO:tasks.ceph.mgr.y.smithi138.stderr:2024-04-26T20:56:18.531+0000 7f146ec2c180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T20:56:18.735 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-04-26T20:56:18.733+0000 7f3d6a42c180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T20:56:18.737 INFO:tasks.ceph.mgr.y.smithi138.stderr:2024-04-26T20:56:18.735+0000 7f146ec2c180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T20:56:18.821 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-04-26T20:56:18.821+0000 7f3d6a42c180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T20:56:18.822 INFO:tasks.ceph.mgr.y.smithi138.stderr:2024-04-26T20:56:18.823+0000 7f146ec2c180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T20:56:19.149 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-04-26T20:56:19.149+0000 7f3d6a42c180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T20:56:19.154 INFO:tasks.ceph.mgr.y.smithi138.stderr:2024-04-26T20:56:19.151+0000 7f146ec2c180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T20:56:19.220 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-04-26T20:56:19.217+0000 7f3d6a42c180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T20:56:19.225 INFO:tasks.ceph.mgr.y.smithi138.stderr:2024-04-26T20:56:19.223+0000 7f146ec2c180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T20:56:20.242 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-04-26T20:56:20.240+0000 7f3d0ea00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-26T20:56:20.242 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-04-26T20:56:20.240+0000 7f3d0ea00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-26T20:56:21.171 INFO:tasks.ceph.osd.4.smithi143.stderr:2024-04-26T20:56:21.168+0000 7ff2154e87c0 -1 osd.4 0 log_to_monitors true 2024-04-26T20:56:21.278 INFO:tasks.ceph.osd.0.smithi138.stderr:2024-04-26T20:56:21.275+0000 7fa37167e7c0 -1 osd.0 0 log_to_monitors true 2024-04-26T20:56:21.292 INFO:tasks.ceph.osd.5.smithi143.stderr:2024-04-26T20:56:21.292+0000 7fa59d3b67c0 -1 osd.5 0 log_to_monitors true 2024-04-26T20:56:21.354 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-04-26T20:56:21.351+0000 7fb3dabfd7c0 -1 osd.1 0 log_to_monitors true 2024-04-26T20:56:21.453 INFO:tasks.ceph.osd.3.smithi138.stderr:2024-04-26T20:56:21.451+0000 7f622f1967c0 -1 osd.3 0 log_to_monitors true 2024-04-26T20:56:21.458 INFO:tasks.ceph.osd.6.smithi143.stderr:2024-04-26T20:56:21.456+0000 7f93f8ffb7c0 -1 osd.6 0 log_to_monitors true 2024-04-26T20:56:21.467 INFO:tasks.ceph.osd.7.smithi143.stderr:2024-04-26T20:56:21.464+0000 7fd7a6dfb7c0 -1 osd.7 0 log_to_monitors true 2024-04-26T20:56:21.474 INFO:tasks.ceph.osd.2.smithi138.stderr:2024-04-26T20:56:21.471+0000 7f7015e5d7c0 -1 osd.2 0 log_to_monitors true 2024-04-26T20:56:23.133 INFO:tasks.ceph.osd.4.smithi143.stderr:2024-04-26T20:56:23.132+0000 7ff210400640 -1 osd.4 0 waiting for initial osdmap 2024-04-26T20:56:23.158 INFO:tasks.ceph.osd.4.smithi143.stderr:2024-04-26T20:56:23.156+0000 7ff206400640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T20:56:24.888 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T20:56:25.005 INFO:tasks.ceph.osd.5.smithi143.stderr:2024-04-26T20:56:25.004+0000 7fa598200640 -1 osd.5 0 waiting for initial osdmap 2024-04-26T20:56:25.030 INFO:tasks.ceph.osd.5.smithi143.stderr:2024-04-26T20:56:25.028+0000 7fa58e200640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T20:56:25.060 INFO:tasks.ceph.osd.7.smithi143.stderr:2024-04-26T20:56:25.056+0000 7fd7a2600640 -1 osd.7 0 waiting for initial osdmap 2024-04-26T20:56:25.070 INFO:tasks.ceph.osd.6.smithi143.stderr:2024-04-26T20:56:25.068+0000 7f93f3e00640 -1 osd.6 0 waiting for initial osdmap 2024-04-26T20:56:25.090 INFO:tasks.ceph.osd.7.smithi143.stderr:2024-04-26T20:56:25.088+0000 7fd797c00640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T20:56:25.097 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.094+0000 7ff562400640 1 Processor -- start 2024-04-26T20:56:25.097 INFO:tasks.ceph.osd.6.smithi143.stderr:2024-04-26T20:56:25.096+0000 7f93e9e00640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T20:56:25.098 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.094+0000 7ff562400640 1 -- start start 2024-04-26T20:56:25.099 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.098+0000 7ff562400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff55c0d1700 0x7ff55c06f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:25.100 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.098+0000 7ff562400640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff55c072600 0x7ff55c0cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:25.100 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.098+0000 7ff562400640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff55c070900 con 0x7ff55c0cb440 2024-04-26T20:56:25.100 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.098+0000 7ff562400640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7ff55c0cbde0 con 0x7ff55c072600 2024-04-26T20:56:25.100 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.098+0000 7ff562400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ff55c06e2d0 con 0x7ff55c0d1700 2024-04-26T20:56:25.100 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.098+0000 7ff55be00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff55c072600 0x7ff55c0cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:25.100 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.098+0000 7ff55be00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff55c072600 0x7ff55c0cb8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.138:50130/0 (socket says 172.21.15.138:50130) 2024-04-26T20:56:25.101 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.098+0000 7ff55be00640 1 -- 172.21.15.138:0/3972611019 learned_addr learned my addr 172.21.15.138:0/3972611019 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:25.101 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.098+0000 7ff55be00640 1 -- 172.21.15.138:0/3972611019 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff55c0d1700 msgr2=0x7ff55c06f370 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T20:56:25.101 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.098+0000 7ff55be00640 1 --2- 172.21.15.138:0/3972611019 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff55c0d1700 0x7ff55c06f370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:25.101 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.098+0000 7ff55be00640 1 -- 172.21.15.138:0/3972611019 >> v1:172.21.15.138:6789/0 conn(0x7ff55c0cb440 legacy=0x7ff55c071ef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:56:25.101 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.098+0000 7ff55be00640 1 -- 172.21.15.138:0/3972611019 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff55c06e5b0 con 0x7ff55c072600 2024-04-26T20:56:25.107 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.106+0000 7ff55be00640 1 --2- 172.21.15.138:0/3972611019 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff55c072600 0x7ff55c0cb8a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff554009e80 tx=0x7ff55401c9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa263688dcf7b154 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:25.108 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.106+0000 7ff55a000640 1 -- 172.21.15.138:0/3972611019 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5540a5760 con 0x7ff55c072600 2024-04-26T20:56:25.108 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.106+0000 7ff55a000640 1 -- 172.21.15.138:0/3972611019 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5540a5900 con 0x7ff55c072600 2024-04-26T20:56:25.108 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.106+0000 7ff55a000640 1 -- 172.21.15.138:0/3972611019 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5540a5cd0 con 0x7ff55c072600 2024-04-26T20:56:25.109 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.106+0000 7ff562400640 1 -- 172.21.15.138:0/3972611019 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff55c072600 msgr2=0x7ff55c0cb8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:25.109 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.106+0000 7ff562400640 1 --2- 172.21.15.138:0/3972611019 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff55c072600 0x7ff55c0cb8a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff554009e80 tx=0x7ff55401c9f0 comp rx=0 tx=0).stop 2024-04-26T20:56:25.110 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.106+0000 7ff562400640 1 -- 172.21.15.138:0/3972611019 shutdown_connections 2024-04-26T20:56:25.110 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.106+0000 7ff562400640 1 --2- 172.21.15.138:0/3972611019 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff55c072600 0x7ff55c0cb8a0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:25.110 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.106+0000 7ff562400640 1 --2- 172.21.15.138:0/3972611019 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff55c0d1700 0x7ff55c06f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:25.110 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.106+0000 7ff562400640 1 -- 172.21.15.138:0/3972611019 >> 172.21.15.138:0/3972611019 conn(0x7ff55c0d0be0 msgr2=0x7ff55c0d0ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:25.110 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.106+0000 7ff562400640 1 -- 172.21.15.138:0/3972611019 shutdown_connections 2024-04-26T20:56:25.111 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.106+0000 7ff562400640 1 -- 172.21.15.138:0/3972611019 wait complete. 2024-04-26T20:56:25.112 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.110+0000 7ff562400640 1 Processor -- start 2024-04-26T20:56:25.113 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.110+0000 7ff562400640 1 -- start start 2024-04-26T20:56:25.114 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.110+0000 7ff562400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff55c072600 0x7ff55c165900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:25.114 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.110+0000 7ff562400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff55c0cb440 0x7ff55c0c9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:25.114 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.110+0000 7ff562400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff55c0d1700 0x7ff55c15b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:25.114 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.110+0000 7ff562400640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff55c06def0 con 0x7ff55c0cb440 2024-04-26T20:56:25.114 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.110+0000 7ff562400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ff55c06f8b0 con 0x7ff55c072600 2024-04-26T20:56:25.114 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.110+0000 7ff562400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ff55c06e070 con 0x7ff55c0d1700 2024-04-26T20:56:25.115 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.110+0000 7ff55aa00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff55c0cb440 0x7ff55c0c9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:25.115 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.110+0000 7ff55aa00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff55c0cb440 0x7ff55c0c9f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:41882/0 (socket says 172.21.15.138:41882) 2024-04-26T20:56:25.115 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.110+0000 7ff55aa00640 1 -- 172.21.15.138:0/2807772126 learned_addr learned my addr 172.21.15.138:0/2807772126 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:25.115 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.110+0000 7ff55b400640 1 --2- 172.21.15.138:0/2807772126 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff55c072600 0x7ff55c165900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:25.115 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.110+0000 7ff55be00640 1 --2- 172.21.15.138:0/2807772126 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff55c0d1700 0x7ff55c15b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:25.115 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.110+0000 7ff55aa00640 1 -- 172.21.15.138:0/2807772126 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff55c0d1700 msgr2=0x7ff55c15b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:25.115 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.110+0000 7ff55aa00640 1 --2- 172.21.15.138:0/2807772126 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff55c0d1700 0x7ff55c15b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:25.115 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.110+0000 7ff55aa00640 1 -- 172.21.15.138:0/2807772126 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff55c072600 msgr2=0x7ff55c165900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:25.116 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.110+0000 7ff55aa00640 1 --2- 172.21.15.138:0/2807772126 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff55c072600 0x7ff55c165900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:25.116 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.110+0000 7ff55aa00640 1 -- 172.21.15.138:0/2807772126 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff55c15fc80 con 0x7ff55c0cb440 2024-04-26T20:56:25.116 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.114+0000 7ff55aa00640 1 --2- 172.21.15.138:0/2807772126 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff55c0cb440 0x7ff55c0c9f20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff54800b4a0 tx=0x7ff54800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:25.118 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.114+0000 7ff553400640 1 -- 172.21.15.138:0/2807772126 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff54801d070 con 0x7ff55c0cb440 2024-04-26T20:56:25.118 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.114+0000 7ff553400640 1 -- 172.21.15.138:0/2807772126 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff548010b10 con 0x7ff55c0cb440 2024-04-26T20:56:25.118 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.114+0000 7ff553400640 1 -- 172.21.15.138:0/2807772126 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff548018440 con 0x7ff55c0cb440 2024-04-26T20:56:25.118 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.114+0000 7ff562400640 1 -- 172.21.15.138:0/2807772126 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff55c15cf40 con 0x7ff55c0cb440 2024-04-26T20:56:25.118 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.114+0000 7ff562400640 1 -- 172.21.15.138:0/2807772126 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff55c15d500 con 0x7ff55c0cb440 2024-04-26T20:56:25.118 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.114+0000 7ff550c00640 1 -- 172.21.15.138:0/2807772126 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5300052a0 con 0x7ff55c0cb440 2024-04-26T20:56:25.122 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.118+0000 7ff553400640 1 -- 172.21.15.138:0/2807772126 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 4) ==== 87931+0+0 (secure 0 0 0) 0x7ff548020070 con 0x7ff55c0cb440 2024-04-26T20:56:25.123 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.122+0000 7ff553400640 1 --2- 172.21.15.138:0/2807772126 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff53c0682f0 0x7ff53c06a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:25.124 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.122+0000 7ff553400640 1 -- 172.21.15.138:0/2807772126 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2511+0+0 (secure 0 0 0) 0x7ff548089950 con 0x7ff55c0cb440 2024-04-26T20:56:25.124 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.122+0000 7ff55b400640 1 --2- 172.21.15.138:0/2807772126 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff53c0682f0 0x7ff53c06a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:25.124 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.122+0000 7ff55b400640 1 --2- 172.21.15.138:0/2807772126 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff53c0682f0 0x7ff53c06a7b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff55c06f760 tx=0x7ff54c009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:25.142 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.138+0000 7ff553400640 1 -- 172.21.15.138:0/2807772126 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff548027020 con 0x7ff55c0cb440 2024-04-26T20:56:25.463 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.458+0000 7ff550c00640 1 -- 172.21.15.138:0/2807772126 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff530005860 con 0x7ff55c0cb440 2024-04-26T20:56:25.465 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.462+0000 7ff553400640 1 -- 172.21.15.138:0/2807772126 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+7590 (secure 0 0 0) 0x7ff54805a690 con 0x7ff55c0cb440 2024-04-26T20:56:25.465 INFO:teuthology.misc.health.smithi138.stdout: 2024-04-26T20:56:25.465 INFO:teuthology.misc.health.smithi138.stdout:{"epoch":14,"fsid":"c22b4730-12cc-4558-8535-b965384398c0","created":"2024-04-26T20:56:14.182475+0000","modified":"2024-04-26T20:56:24.524082+0000","last_up_change":"2024-04-26T20:56:23.242412+0000","last_in_change":"2024-04-26T20:56:16.714055+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"3f9a2e34-3199-466f-a6cf-57927318121e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e881fcf6-3248-4696-a2ef-95d206d77712","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f7d1db33-7672-4699-ae47-9f1e0a8e4222","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2f4e0a9a-b8f6-4468-844a-a4501cd85054","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c85df99b-3624-410e-866b-86830af2cfe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6801","nonce":2942056312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6803","nonce":2942056312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6807","nonce":2942056312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6805","nonce":2942056312}]},"public_addr":"172.21.15.143:6801/2942056312","cluster_addr":"172.21.15.143:6803/2942056312","heartbeat_back_addr":"172.21.15.143:6807/2942056312","heartbeat_front_addr":"172.21.15.143:6805/2942056312","state":["exists","up"]},{"osd":5,"uuid":"9af1efb5-c416-4808-b5ef-de0679ab9705","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d7138615-8838-45ff-9072-2fd0683362f4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0c27172b-35c4-49ec-ba0b-0137b8ff0010","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.216947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:56:25.468 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.466+0000 7ff550c00640 1 -- 172.21.15.138:0/2807772126 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff53c0682f0 msgr2=0x7ff53c06a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:25.468 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.466+0000 7ff550c00640 1 --2- 172.21.15.138:0/2807772126 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff53c0682f0 0x7ff53c06a7b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff55c06f760 tx=0x7ff54c009060 comp rx=0 tx=0).stop 2024-04-26T20:56:25.468 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.466+0000 7ff550c00640 1 -- 172.21.15.138:0/2807772126 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff55c0cb440 msgr2=0x7ff55c0c9f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:25.468 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.466+0000 7ff550c00640 1 --2- 172.21.15.138:0/2807772126 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff55c0cb440 0x7ff55c0c9f20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff54800b4a0 tx=0x7ff54800b960 comp rx=0 tx=0).stop 2024-04-26T20:56:25.469 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.466+0000 7ff550c00640 1 -- 172.21.15.138:0/2807772126 shutdown_connections 2024-04-26T20:56:25.469 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.466+0000 7ff550c00640 1 --2- 172.21.15.138:0/2807772126 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff53c0682f0 0x7ff53c06a7b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:25.470 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.466+0000 7ff550c00640 1 --2- 172.21.15.138:0/2807772126 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff55c0d1700 0x7ff55c15b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:25.470 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.466+0000 7ff550c00640 1 --2- 172.21.15.138:0/2807772126 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff55c0cb440 0x7ff55c0c9f20 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:25.470 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.466+0000 7ff550c00640 1 --2- 172.21.15.138:0/2807772126 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff55c072600 0x7ff55c165900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:25.470 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.466+0000 7ff550c00640 1 -- 172.21.15.138:0/2807772126 >> 172.21.15.138:0/2807772126 conn(0x7ff55c0d0be0 msgr2=0x7ff55c071d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:25.471 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.470+0000 7ff550c00640 1 -- 172.21.15.138:0/2807772126 shutdown_connections 2024-04-26T20:56:25.471 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:25.470+0000 7ff550c00640 1 -- 172.21.15.138:0/2807772126 wait complete. 2024-04-26T20:56:25.501 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-04-26T20:56:25.629 INFO:tasks.ceph.osd.2.smithi138.stderr:2024-04-26T20:56:25.626+0000 7f7010e00640 -1 osd.2 0 waiting for initial osdmap 2024-04-26T20:56:25.641 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-04-26T20:56:25.638+0000 7fb3d5a00640 -1 osd.1 0 waiting for initial osdmap 2024-04-26T20:56:25.653 INFO:tasks.ceph.osd.0.smithi138.stderr:2024-04-26T20:56:25.650+0000 7fa36c600640 -1 osd.0 0 waiting for initial osdmap 2024-04-26T20:56:25.664 INFO:tasks.ceph.osd.2.smithi138.stderr:2024-04-26T20:56:25.662+0000 7f7006e00640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T20:56:25.684 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-04-26T20:56:25.682+0000 7fb3cba00640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T20:56:25.686 INFO:tasks.ceph.osd.3.smithi138.stderr:2024-04-26T20:56:25.682+0000 7f622a000640 -1 osd.3 0 waiting for initial osdmap 2024-04-26T20:56:25.688 INFO:tasks.ceph.osd.0.smithi138.stderr:2024-04-26T20:56:25.686+0000 7fa362600640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T20:56:25.720 INFO:tasks.ceph.osd.3.smithi138.stderr:2024-04-26T20:56:25.718+0000 7f6220000640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T20:56:32.308 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T20:56:32.443 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.442+0000 7fe54be00640 1 Processor -- start 2024-04-26T20:56:32.444 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.442+0000 7fe54be00640 1 -- start start 2024-04-26T20:56:32.445 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.442+0000 7fe54be00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe54c0cae70 0x7fe54c06c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:32.445 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.442+0000 7fe54be00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe54c0cb2c0 0x7fe54c06c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:32.445 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.442+0000 7fe54be00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe54c1489f0 con 0x7fe54c148610 2024-04-26T20:56:32.445 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.442+0000 7fe54be00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fe54c0cb880 con 0x7fe54c0cae70 2024-04-26T20:56:32.445 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.442+0000 7fe54be00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fe54c0cbb60 con 0x7fe54c0cb2c0 2024-04-26T20:56:32.445 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.442+0000 7fe54aa00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fe54c148610 0x7fe54c15fee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:37764/0 (socket says 172.21.15.138:37764) 2024-04-26T20:56:32.445 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.442+0000 7fe54aa00640 1 -- 172.21.15.138:0/1823054331 learned_addr learned my addr 172.21.15.138:0/1823054331 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:56:32.447 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.442+0000 7fe54b400640 1 --2- 172.21.15.138:0/1823054331 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe54c0cb2c0 0x7fe54c06c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:32.447 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.442+0000 7fe54a000640 1 --2- 172.21.15.138:0/1823054331 >> v2:172.21.15.143:3300/0 conn(0x7fe54c0cae70 0x7fe54c06c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:32.448 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.442+0000 7fe549600640 1 -- 172.21.15.138:0/1823054331 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2607499742 0 0) 0x7fe54c1489f0 con 0x7fe54c148610 2024-04-26T20:56:32.448 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.442+0000 7fe549600640 1 -- 172.21.15.138:0/1823054331 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe530003530 con 0x7fe54c148610 2024-04-26T20:56:32.448 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.442+0000 7fe549600640 1 -- 172.21.15.138:0/1823054331 <== mon.0 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3973865569 0 0) 0x7fe530003530 con 0x7fe54c148610 2024-04-26T20:56:32.448 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.442+0000 7fe549600640 1 -- 172.21.15.138:0/1823054331 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe54c0cb2c0 msgr2=0x7fe54c06c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:32.448 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.442+0000 7fe549600640 1 --2- 172.21.15.138:0/1823054331 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe54c0cb2c0 0x7fe54c06c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:32.448 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.442+0000 7fe549600640 1 -- 172.21.15.138:0/1823054331 >> v2:172.21.15.143:3300/0 conn(0x7fe54c0cae70 msgr2=0x7fe54c06c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:32.448 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.442+0000 7fe549600640 1 --2- 172.21.15.138:0/1823054331 >> v2:172.21.15.143:3300/0 conn(0x7fe54c0cae70 0x7fe54c06c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:32.448 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.442+0000 7fe549600640 1 -- 172.21.15.138:0/1823054331 --> v1:172.21.15.138:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe54c15f6e0 con 0x7fe54c148610 2024-04-26T20:56:32.448 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.442+0000 7fe549600640 1 -- 172.21.15.138:0/1823054331 <== mon.0 v1:172.21.15.138:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2715389689 0 0) 0x7fe53c0016a0 con 0x7fe54c148610 2024-04-26T20:56:32.448 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.442+0000 7fe549600640 1 -- 172.21.15.138:0/1823054331 >> v1:172.21.15.138:6789/0 conn(0x7fe54c148610 legacy=0x7fe54c15fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:32.448 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.442+0000 7fe549600640 1 --2- 172.21.15.138:0/1823054331 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe530003a30 0x7fe530003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:32.448 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.442+0000 7fe549600640 1 --2- 172.21.15.138:0/1823054331 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe530004810 0x7fe530004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:32.448 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.442+0000 7fe549600640 1 --2- 172.21.15.138:0/1823054331 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe5300051d0 0x7fe53000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:32.449 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.442+0000 7fe549600640 1 -- 172.21.15.138:0/1823054331 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe54c0cb880 con 0x7fe530003a30 2024-04-26T20:56:32.449 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.442+0000 7fe549600640 1 -- 172.21.15.138:0/1823054331 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fe54c0cbb60 con 0x7fe5300051d0 2024-04-26T20:56:32.449 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.442+0000 7fe549600640 1 -- 172.21.15.138:0/1823054331 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fe53000bf10 con 0x7fe530004810 2024-04-26T20:56:32.449 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.442+0000 7fe54b400640 1 --2- 172.21.15.138:0/1823054331 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe54c0cb2c0 0x7fe54c06c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:56:32.449 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.442+0000 7fe54a000640 1 --2- 172.21.15.138:0/1823054331 >> v2:172.21.15.143:3300/0 conn(0x7fe54c0cae70 0x7fe54c06c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:56:32.449 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.442+0000 7fe54aa00640 1 --2- 172.21.15.138:0/1823054331 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe530003a30 0x7fe530003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:32.449 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.442+0000 7fe54b400640 1 --2- 172.21.15.138:0/1823054331 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe5300051d0 0x7fe53000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:32.449 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.442+0000 7fe54a000640 1 --2- 172.21.15.138:0/1823054331 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe530004810 0x7fe530004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:32.449 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.442+0000 7fe54aa00640 1 -- 172.21.15.138:0/1823054331 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe530004810 msgr2=0x7fe530004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:32.449 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.442+0000 7fe54aa00640 1 --2- 172.21.15.138:0/1823054331 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe530004810 0x7fe530004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:32.449 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.442+0000 7fe54aa00640 1 -- 172.21.15.138:0/1823054331 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe5300051d0 msgr2=0x7fe53000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:32.449 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.442+0000 7fe54aa00640 1 --2- 172.21.15.138:0/1823054331 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe5300051d0 0x7fe53000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:32.449 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.442+0000 7fe54aa00640 1 -- 172.21.15.138:0/1823054331 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe530003530 con 0x7fe530003a30 2024-04-26T20:56:32.449 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.442+0000 7fe54a000640 1 --2- 172.21.15.138:0/1823054331 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe530004810 0x7fe530004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:56:32.450 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.446+0000 7fe54aa00640 1 --2- 172.21.15.138:0/1823054331 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe530003a30 0x7fe530003e50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe53c00c240 tx=0x7fe53c01cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d52ebc1b09c79bf7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:32.451 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.446+0000 7fe549600640 1 -- 172.21.15.138:0/1823054331 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53c007d70 con 0x7fe530003a30 2024-04-26T20:56:32.451 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.446+0000 7fe549600640 1 -- 172.21.15.138:0/1823054331 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe53c0a9020 con 0x7fe530003a30 2024-04-26T20:56:32.451 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.446+0000 7fe549600640 1 -- 172.21.15.138:0/1823054331 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53c005b20 con 0x7fe530003a30 2024-04-26T20:56:32.451 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.446+0000 7fe54be00640 1 -- 172.21.15.138:0/1823054331 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe530003a30 msgr2=0x7fe530003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:32.451 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.446+0000 7fe54be00640 1 --2- 172.21.15.138:0/1823054331 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe530003a30 0x7fe530003e50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe53c00c240 tx=0x7fe53c01cc20 comp rx=0 tx=0).stop 2024-04-26T20:56:32.451 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.446+0000 7fe54b400640 1 -- 172.21.15.138:0/1823054331 reap_dead start 2024-04-26T20:56:32.451 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.446+0000 7fe54be00640 1 -- 172.21.15.138:0/1823054331 shutdown_connections 2024-04-26T20:56:32.451 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.446+0000 7fe54be00640 1 -- 172.21.15.138:0/1823054331 >> 172.21.15.138:0/1823054331 conn(0x7fe54c0d1b20 msgr2=0x7fe54c0d1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:32.451 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.446+0000 7fe54be00640 1 -- 172.21.15.138:0/1823054331 shutdown_connections 2024-04-26T20:56:32.451 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.446+0000 7fe54be00640 1 -- 172.21.15.138:0/1823054331 wait complete. 2024-04-26T20:56:32.452 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.450+0000 7fe54be00640 1 Processor -- start 2024-04-26T20:56:32.452 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.450+0000 7fe54be00640 1 -- start start 2024-04-26T20:56:32.455 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.450+0000 7fe54be00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe530003a30 0x7fe54c145d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:32.455 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.450+0000 7fe54be00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe54c1f8700 0x7fe54c140e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:32.455 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.450+0000 7fe54be00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe54c0b6d20 0x7fe54c0b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:32.455 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.450+0000 7fe54be00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe54c0cdb30 con 0x7fe54c1f8700 2024-04-26T20:56:32.455 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.450+0000 7fe54be00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fe54c0cd9b0 con 0x7fe54c0b6d20 2024-04-26T20:56:32.455 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.450+0000 7fe54be00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fe54c06cc60 con 0x7fe530003a30 2024-04-26T20:56:32.455 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.450+0000 7fe54a000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe54c1f8700 0x7fe54c140e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:32.455 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.450+0000 7fe54a000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe54c1f8700 0x7fe54c140e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:41888/0 (socket says 172.21.15.138:41888) 2024-04-26T20:56:32.455 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.450+0000 7fe54a000640 1 -- 172.21.15.138:0/3003686314 learned_addr learned my addr 172.21.15.138:0/3003686314 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:32.455 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.450+0000 7fe54aa00640 1 --2- 172.21.15.138:0/3003686314 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe530003a30 0x7fe54c145d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:32.455 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.450+0000 7fe54b400640 1 --2- 172.21.15.138:0/3003686314 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe54c0b6d20 0x7fe54c0b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:32.455 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.450+0000 7fe54a000640 1 -- 172.21.15.138:0/3003686314 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe530003a30 msgr2=0x7fe54c145d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:32.455 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.450+0000 7fe54a000640 1 --2- 172.21.15.138:0/3003686314 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe530003a30 0x7fe54c145d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:32.455 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.450+0000 7fe54a000640 1 -- 172.21.15.138:0/3003686314 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe54c0b6d20 msgr2=0x7fe54c0b71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:32.456 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.450+0000 7fe54a000640 1 --2- 172.21.15.138:0/3003686314 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe54c0b6d20 0x7fe54c0b71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:32.456 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.450+0000 7fe54a000640 1 -- 172.21.15.138:0/3003686314 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe54c1f7c50 con 0x7fe54c1f8700 2024-04-26T20:56:32.456 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.450+0000 7fe54a000640 1 --2- 172.21.15.138:0/3003686314 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe54c1f8700 0x7fe54c140e00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe5380109d0 tx=0x7fe538010e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:32.456 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.450+0000 7fe542a00640 1 -- 172.21.15.138:0/3003686314 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53800f040 con 0x7fe54c1f8700 2024-04-26T20:56:32.456 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.450+0000 7fe542a00640 1 -- 172.21.15.138:0/3003686314 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe53800eca0 con 0x7fe54c1f8700 2024-04-26T20:56:32.456 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.450+0000 7fe54be00640 1 -- 172.21.15.138:0/3003686314 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe54c1f8b80 con 0x7fe54c1f8700 2024-04-26T20:56:32.456 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.450+0000 7fe542a00640 1 -- 172.21.15.138:0/3003686314 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53801c640 con 0x7fe54c1f8700 2024-04-26T20:56:32.456 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.450+0000 7fe54be00640 1 -- 172.21.15.138:0/3003686314 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe54c0b5650 con 0x7fe54c1f8700 2024-04-26T20:56:32.456 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.454+0000 7fe54be00640 1 -- 172.21.15.138:0/3003686314 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe54c0506d0 con 0x7fe54c1f8700 2024-04-26T20:56:32.457 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.454+0000 7fe542a00640 1 -- 172.21.15.138:0/3003686314 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe53801c7e0 con 0x7fe54c1f8700 2024-04-26T20:56:32.457 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.454+0000 7fe542a00640 1 --2- 172.21.15.138:0/3003686314 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe52c0683b0 0x7fe52c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:32.457 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.454+0000 7fe542a00640 1 -- 172.21.15.138:0/3003686314 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fe538086e30 con 0x7fe54c1f8700 2024-04-26T20:56:32.458 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.454+0000 7fe54aa00640 1 --2- 172.21.15.138:0/3003686314 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe52c0683b0 0x7fe52c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:32.458 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.454+0000 7fe54aa00640 1 --2- 172.21.15.138:0/3003686314 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe52c0683b0 0x7fe52c06a870 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe53c0aa000 tx=0x7fe53c001a70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:32.462 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.458+0000 7fe542a00640 1 -- 172.21.15.138:0/3003686314 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe538018030 con 0x7fe54c1f8700 2024-04-26T20:56:32.619 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.618+0000 7fe54be00640 1 -- 172.21.15.138:0/3003686314 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe54c0b7b80 con 0x7fe54c1f8700 2024-04-26T20:56:32.620 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.618+0000 7fe542a00640 1 -- 172.21.15.138:0/3003686314 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12944 (secure 0 0 0) 0x7fe5380576a0 con 0x7fe54c1f8700 2024-04-26T20:56:32.620 INFO:teuthology.misc.health.smithi138.stdout: 2024-04-26T20:56:32.621 INFO:teuthology.misc.health.smithi138.stdout:{"epoch":19,"fsid":"c22b4730-12cc-4558-8535-b965384398c0","created":"2024-04-26T20:56:14.182475+0000","modified":"2024-04-26T20:56:30.151540+0000","last_up_change":"2024-04-26T20:56:26.013243+0000","last_in_change":"2024-04-26T20:56:16.714055+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:56:27.265834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3f9a2e34-3199-466f-a6cf-57927318121e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6801","nonce":3534772245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6803","nonce":3534772245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6807","nonce":3534772245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6805","nonce":3534772245}]},"public_addr":"172.21.15.138:6801/3534772245","cluster_addr":"172.21.15.138:6803/3534772245","heartbeat_back_addr":"172.21.15.138:6807/3534772245","heartbeat_front_addr":"172.21.15.138:6805/3534772245","state":["exists","up"]},{"osd":1,"uuid":"e881fcf6-3248-4696-a2ef-95d206d77712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6817","nonce":1427635773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6819","nonce":1427635773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6823","nonce":1427635773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6821","nonce":1427635773}]},"public_addr":"172.21.15.138:6817/1427635773","cluster_addr":"172.21.15.138:6819/1427635773","heartbeat_back_addr":"172.21.15.138:6823/1427635773","heartbeat_front_addr":"172.21.15.138:6821/1427635773","state":["exists","up"]},{"osd":2,"uuid":"f7d1db33-7672-4699-ae47-9f1e0a8e4222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6809","nonce":4273721573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6811","nonce":4273721573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6815","nonce":4273721573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6813","nonce":4273721573}]},"public_addr":"172.21.15.138:6809/4273721573","cluster_addr":"172.21.15.138:6811/4273721573","heartbeat_back_addr":"172.21.15.138:6815/4273721573","heartbeat_front_addr":"172.21.15.138:6813/4273721573","state":["exists","up"]},{"osd":3,"uuid":"2f4e0a9a-b8f6-4468-844a-a4501cd85054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6825","nonce":3098242154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6827","nonce":3098242154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6831","nonce":3098242154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6829","nonce":3098242154}]},"public_addr":"172.21.15.138:6825/3098242154","cluster_addr":"172.21.15.138:6827/3098242154","heartbeat_back_addr":"172.21.15.138:6831/3098242154","heartbeat_front_addr":"172.21.15.138:6829/3098242154","state":["exists","up"]},{"osd":4,"uuid":"c85df99b-3624-410e-866b-86830af2cfe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6801","nonce":2942056312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6803","nonce":2942056312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6807","nonce":2942056312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6805","nonce":2942056312}]},"public_addr":"172.21.15.143:6801/2942056312","cluster_addr":"172.21.15.143:6803/2942056312","heartbeat_back_addr":"172.21.15.143:6807/2942056312","heartbeat_front_addr":"172.21.15.143:6805/2942056312","state":["exists","up"]},{"osd":5,"uuid":"9af1efb5-c416-4808-b5ef-de0679ab9705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6809","nonce":1910222887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6811","nonce":1910222887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6815","nonce":1910222887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6813","nonce":1910222887}]},"public_addr":"172.21.15.143:6809/1910222887","cluster_addr":"172.21.15.143:6811/1910222887","heartbeat_back_addr":"172.21.15.143:6815/1910222887","heartbeat_front_addr":"172.21.15.143:6813/1910222887","state":["exists","up"]},{"osd":6,"uuid":"d7138615-8838-45ff-9072-2fd0683362f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6817","nonce":1082239825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6819","nonce":1082239825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6823","nonce":1082239825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6821","nonce":1082239825}]},"public_addr":"172.21.15.143:6817/1082239825","cluster_addr":"172.21.15.143:6819/1082239825","heartbeat_back_addr":"172.21.15.143:6823/1082239825","heartbeat_front_addr":"172.21.15.143:6821/1082239825","state":["exists","up"]},{"osd":7,"uuid":"0c27172b-35c4-49ec-ba0b-0137b8ff0010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6825","nonce":3295508495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6827","nonce":3295508495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6831","nonce":3295508495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6829","nonce":3295508495}]},"public_addr":"172.21.15.143:6825/3295508495","cluster_addr":"172.21.15.143:6827/3295508495","heartbeat_back_addr":"172.21.15.143:6831/3295508495","heartbeat_front_addr":"172.21.15.143:6829/3295508495","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.326627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.396119+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.433915+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.414179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.216947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.329272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.503073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.436382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:56:32.622 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.618+0000 7fe54be00640 1 -- 172.21.15.138:0/3003686314 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe52c0683b0 msgr2=0x7fe52c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:32.623 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.618+0000 7fe54be00640 1 --2- 172.21.15.138:0/3003686314 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe52c0683b0 0x7fe52c06a870 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe53c0aa000 tx=0x7fe53c001a70 comp rx=0 tx=0).stop 2024-04-26T20:56:32.623 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.618+0000 7fe54be00640 1 -- 172.21.15.138:0/3003686314 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe54c1f8700 msgr2=0x7fe54c140e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:32.623 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.618+0000 7fe54be00640 1 --2- 172.21.15.138:0/3003686314 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe54c1f8700 0x7fe54c140e00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe5380109d0 tx=0x7fe538010e90 comp rx=0 tx=0).stop 2024-04-26T20:56:32.623 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.618+0000 7fe54be00640 1 -- 172.21.15.138:0/3003686314 shutdown_connections 2024-04-26T20:56:32.623 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.618+0000 7fe54be00640 1 --2- 172.21.15.138:0/3003686314 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe52c0683b0 0x7fe52c06a870 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:32.623 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.618+0000 7fe54be00640 1 --2- 172.21.15.138:0/3003686314 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe54c0b6d20 0x7fe54c0b71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:32.623 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.618+0000 7fe54be00640 1 --2- 172.21.15.138:0/3003686314 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe54c1f8700 0x7fe54c140e00 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:32.623 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.618+0000 7fe54be00640 1 --2- 172.21.15.138:0/3003686314 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe530003a30 0x7fe54c145d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:32.623 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.618+0000 7fe54be00640 1 -- 172.21.15.138:0/3003686314 >> 172.21.15.138:0/3003686314 conn(0x7fe54c0d1b20 msgr2=0x7fe54c147270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:32.623 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.618+0000 7fe54be00640 1 -- 172.21.15.138:0/3003686314 shutdown_connections 2024-04-26T20:56:32.623 INFO:teuthology.misc.health.smithi138.stderr:2024-04-26T20:56:32.618+0000 7fe54be00640 1 -- 172.21.15.138:0/3003686314 wait complete. 2024-04-26T20:56:32.640 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-26T20:56:32.640 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-26T20:56:32.640 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-26T20:56:32.640 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-26T20:56:32.644 INFO:tasks.ceph.mds.a:Started 2024-04-26T20:56:32.644 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-26T20:56:32.644 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-26T20:56:32.647 INFO:tasks.ceph.mds.c:Started 2024-04-26T20:56:32.647 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-26T20:56:32.647 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-26T20:56:32.651 INFO:tasks.ceph.mds.b:Started 2024-04-26T20:56:32.651 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-26T20:56:32.651 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-26T20:56:32.654 INFO:tasks.ceph.mds.d:Started 2024-04-26T20:56:32.655 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-26T20:56:32.655 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:56:32.746 INFO:tasks.ceph.mds.a.smithi138.stdout:starting mds.a at 2024-04-26T20:56:32.746 INFO:tasks.ceph.mds.c.smithi138.stdout:starting mds.c at 2024-04-26T20:56:32.754 INFO:tasks.ceph.mds.b.smithi143.stdout:starting mds.b at 2024-04-26T20:56:32.755 INFO:tasks.ceph.mds.d.smithi143.stdout:starting mds.d at 2024-04-26T20:56:32.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.798+0000 7f60d4800640 1 Processor -- start 2024-04-26T20:56:32.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.798+0000 7f60d4800640 1 -- start start 2024-04-26T20:56:32.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.798+0000 7f60d4800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60cc0b2280 0x7f60cc0b2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:32.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.798+0000 7f60d4800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f60cc0d1720 0x7f60cc0b30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:32.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.798+0000 7f60d4800640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60cc0ce540 con 0x7f60cc15d0f0 2024-04-26T20:56:32.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.798+0000 7f60d4800640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f60cc0d0e50 con 0x7f60cc0d1720 2024-04-26T20:56:32.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.798+0000 7f60d4800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f60cc0b26e0 con 0x7f60cc0b2280 2024-04-26T20:56:32.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.798+0000 7f60d2800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f60cc0d1720 0x7f60cc0b30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:32.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.798+0000 7f60d2800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f60cc0d1720 0x7f60cc0b30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:41944/0 (socket says 172.21.15.138:41944) 2024-04-26T20:56:32.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.798+0000 7f60d2800640 1 -- 172.21.15.138:0/1812979725 learned_addr learned my addr 172.21.15.138:0/1812979725 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:32.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.798+0000 7f60d1400640 1 --2- 172.21.15.138:0/1812979725 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60cc0b2280 0x7f60cc0b2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:32.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.798+0000 7f60d2800640 1 -- 172.21.15.138:0/1812979725 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60cc0b2280 msgr2=0x7f60cc0b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:32.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.798+0000 7f60d2800640 1 --2- 172.21.15.138:0/1812979725 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60cc0b2280 0x7f60cc0b2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:32.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.798+0000 7f60d2800640 1 -- 172.21.15.138:0/1812979725 >> v1:172.21.15.143:6789/0 conn(0x7f60cc15d0f0 legacy=0x7f60cc0d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:32.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.798+0000 7f60d2800640 1 -- 172.21.15.138:0/1812979725 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60cc0ce820 con 0x7f60cc0d1720 2024-04-26T20:56:32.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.798+0000 7f60d0a00640 1 -- 172.21.15.138:0/1812979725 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1222278654 0 0) 0x7f60cc0ce540 con 0x7f60cc15d0f0 2024-04-26T20:56:32.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.802+0000 7f60d2800640 1 --2- 172.21.15.138:0/1812979725 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f60cc0d1720 0x7f60cc0b30b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f60c8009e50 tx=0x7f60c801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98b512b3ccebec37 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:32.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.802+0000 7f60d0a00640 1 -- 172.21.15.138:0/1812979725 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c80a5790 con 0x7f60cc0d1720 2024-04-26T20:56:32.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.802+0000 7f60d0a00640 1 -- 172.21.15.138:0/1812979725 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60c80a5930 con 0x7f60cc0d1720 2024-04-26T20:56:32.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.802+0000 7f60d0a00640 1 -- 172.21.15.138:0/1812979725 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c80a5d00 con 0x7f60cc0d1720 2024-04-26T20:56:32.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.802+0000 7f60d4800640 1 -- 172.21.15.138:0/1812979725 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f60cc0d1720 msgr2=0x7f60cc0b30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:32.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.802+0000 7f60d4800640 1 --2- 172.21.15.138:0/1812979725 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f60cc0d1720 0x7f60cc0b30b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f60c8009e50 tx=0x7f60c801ca30 comp rx=0 tx=0).stop 2024-04-26T20:56:32.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.802+0000 7f60d4800640 1 -- 172.21.15.138:0/1812979725 shutdown_connections 2024-04-26T20:56:32.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.802+0000 7f60d4800640 1 --2- 172.21.15.138:0/1812979725 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f60cc0d1720 0x7f60cc0b30b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:32.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.802+0000 7f60d4800640 1 --2- 172.21.15.138:0/1812979725 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60cc0b2280 0x7f60cc0b2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:32.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.802+0000 7f60d4800640 1 -- 172.21.15.138:0/1812979725 >> 172.21.15.138:0/1812979725 conn(0x7f60cc0d2d80 msgr2=0x7f60cc0d3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:32.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.802+0000 7f60d4800640 1 -- 172.21.15.138:0/1812979725 shutdown_connections 2024-04-26T20:56:32.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.802+0000 7f60d4800640 1 -- 172.21.15.138:0/1812979725 wait complete. 2024-04-26T20:56:32.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.806+0000 7f60d4800640 1 Processor -- start 2024-04-26T20:56:32.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.806+0000 7f60d4800640 1 -- start start 2024-04-26T20:56:32.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.806+0000 7f60d4800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60cc0b2280 0x7f60cc0ca830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:32.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.806+0000 7f60d4800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f60cc0d1720 0x7f60cc0c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:32.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.806+0000 7f60d4800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60cc15d0f0 0x7f60cc09f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:32.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.806+0000 7f60d4800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f60cc169e30 con 0x7f60cc0d1720 2024-04-26T20:56:32.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.806+0000 7f60d4800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f60cc169cb0 con 0x7f60cc15d0f0 2024-04-26T20:56:32.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.806+0000 7f60d4800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f60cc169fb0 con 0x7f60cc0b2280 2024-04-26T20:56:32.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.806+0000 7f60d1400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f60cc0d1720 0x7f60cc0c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:32.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.806+0000 7f60d1400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f60cc0d1720 0x7f60cc0c8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:41958/0 (socket says 172.21.15.138:41958) 2024-04-26T20:56:32.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.806+0000 7f60d1400640 1 -- 172.21.15.138:0/1424239566 learned_addr learned my addr 172.21.15.138:0/1424239566 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:32.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.806+0000 7f60d1e00640 1 --2- 172.21.15.138:0/1424239566 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60cc0b2280 0x7f60cc0ca830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:32.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.806+0000 7f60d2800640 1 --2- 172.21.15.138:0/1424239566 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60cc15d0f0 0x7f60cc09f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:32.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.806+0000 7f60d1400640 1 -- 172.21.15.138:0/1424239566 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60cc0b2280 msgr2=0x7f60cc0ca830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:32.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.806+0000 7f60d1400640 1 --2- 172.21.15.138:0/1424239566 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60cc0b2280 0x7f60cc0ca830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:32.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.806+0000 7f60d1400640 1 -- 172.21.15.138:0/1424239566 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60cc15d0f0 msgr2=0x7f60cc09f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:32.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.806+0000 7f60d1400640 1 --2- 172.21.15.138:0/1424239566 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60cc15d0f0 0x7f60cc09f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:32.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.806+0000 7f60d1400640 1 -- 172.21.15.138:0/1424239566 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60cc0c92f0 con 0x7f60cc0d1720 2024-04-26T20:56:32.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.806+0000 7f60d1400640 1 --2- 172.21.15.138:0/1424239566 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f60cc0d1720 0x7f60cc0c8db0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f60bc00e930 tx=0x7f60bc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:32.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.806+0000 7f60c6000640 1 -- 172.21.15.138:0/1424239566 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60bc017070 con 0x7f60cc0d1720 2024-04-26T20:56:32.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.806+0000 7f60c6000640 1 -- 172.21.15.138:0/1424239566 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60bc00ca00 con 0x7f60cc0d1720 2024-04-26T20:56:32.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.806+0000 7f60d4800640 1 -- 172.21.15.138:0/1424239566 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60cc09faf0 con 0x7f60cc0d1720 2024-04-26T20:56:32.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.806+0000 7f60c6000640 1 -- 172.21.15.138:0/1424239566 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60bc00cdb0 con 0x7f60cc0d1720 2024-04-26T20:56:32.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.806+0000 7f60d4800640 1 -- 172.21.15.138:0/1424239566 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60cc0a0050 con 0x7f60cc0d1720 2024-04-26T20:56:32.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.806+0000 7f60d4800640 1 -- 172.21.15.138:0/1424239566 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60cc069510 con 0x7f60cc0d1720 2024-04-26T20:56:32.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.810+0000 7f60c6000640 1 -- 172.21.15.138:0/1424239566 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f60bc01a070 con 0x7f60cc0d1720 2024-04-26T20:56:32.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.810+0000 7f60c6000640 1 --2- 172.21.15.138:0/1424239566 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f60b0068380 0x7f60b006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:32.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.810+0000 7f60c6000640 1 -- 172.21.15.138:0/1424239566 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f60bc0866c0 con 0x7f60cc0d1720 2024-04-26T20:56:32.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.810+0000 7f60d1e00640 1 --2- 172.21.15.138:0/1424239566 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f60b0068380 0x7f60b006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:32.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.810+0000 7f60d1e00640 1 --2- 172.21.15.138:0/1424239566 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f60b0068380 0x7f60b006a840 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f60c0007fd0 tx=0x7f60c0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:32.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.814+0000 7f60c6000640 1 -- 172.21.15.138:0/1424239566 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f60cc09faf0 con 0x7f60cc0d1720 2024-04-26T20:56:32.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.970+0000 7f60d4800640 1 -- 172.21.15.138:0/1424239566 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f60cc0d3570 con 0x7f60cc0d1720 2024-04-26T20:56:32.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.974+0000 7f60c6000640 1 -- 172.21.15.138:0/1424239566 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12944 (secure 0 0 0) 0x7f60bc0569a0 con 0x7f60cc0d1720 2024-04-26T20:56:32.976 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:56:32.976 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":19,"fsid":"c22b4730-12cc-4558-8535-b965384398c0","created":"2024-04-26T20:56:14.182475+0000","modified":"2024-04-26T20:56:30.151540+0000","last_up_change":"2024-04-26T20:56:26.013243+0000","last_in_change":"2024-04-26T20:56:16.714055+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:56:27.265834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3f9a2e34-3199-466f-a6cf-57927318121e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6801","nonce":3534772245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6803","nonce":3534772245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6807","nonce":3534772245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6805","nonce":3534772245}]},"public_addr":"172.21.15.138:6801/3534772245","cluster_addr":"172.21.15.138:6803/3534772245","heartbeat_back_addr":"172.21.15.138:6807/3534772245","heartbeat_front_addr":"172.21.15.138:6805/3534772245","state":["exists","up"]},{"osd":1,"uuid":"e881fcf6-3248-4696-a2ef-95d206d77712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6817","nonce":1427635773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6819","nonce":1427635773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6823","nonce":1427635773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6821","nonce":1427635773}]},"public_addr":"172.21.15.138:6817/1427635773","cluster_addr":"172.21.15.138:6819/1427635773","heartbeat_back_addr":"172.21.15.138:6823/1427635773","heartbeat_front_addr":"172.21.15.138:6821/1427635773","state":["exists","up"]},{"osd":2,"uuid":"f7d1db33-7672-4699-ae47-9f1e0a8e4222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6809","nonce":4273721573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6811","nonce":4273721573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6815","nonce":4273721573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6813","nonce":4273721573}]},"public_addr":"172.21.15.138:6809/4273721573","cluster_addr":"172.21.15.138:6811/4273721573","heartbeat_back_addr":"172.21.15.138:6815/4273721573","heartbeat_front_addr":"172.21.15.138:6813/4273721573","state":["exists","up"]},{"osd":3,"uuid":"2f4e0a9a-b8f6-4468-844a-a4501cd85054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6825","nonce":3098242154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6827","nonce":3098242154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6831","nonce":3098242154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6829","nonce":3098242154}]},"public_addr":"172.21.15.138:6825/3098242154","cluster_addr":"172.21.15.138:6827/3098242154","heartbeat_back_addr":"172.21.15.138:6831/3098242154","heartbeat_front_addr":"172.21.15.138:6829/3098242154","state":["exists","up"]},{"osd":4,"uuid":"c85df99b-3624-410e-866b-86830af2cfe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6801","nonce":2942056312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6803","nonce":2942056312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6807","nonce":2942056312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6805","nonce":2942056312}]},"public_addr":"172.21.15.143:6801/2942056312","cluster_addr":"172.21.15.143:6803/2942056312","heartbeat_back_addr":"172.21.15.143:6807/2942056312","heartbeat_front_addr":"172.21.15.143:6805/2942056312","state":["exists","up"]},{"osd":5,"uuid":"9af1efb5-c416-4808-b5ef-de0679ab9705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6809","nonce":1910222887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6811","nonce":1910222887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6815","nonce":1910222887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6813","nonce":1910222887}]},"public_addr":"172.21.15.143:6809/1910222887","cluster_addr":"172.21.15.143:6811/1910222887","heartbeat_back_addr":"172.21.15.143:6815/1910222887","heartbeat_front_addr":"172.21.15.143:6813/1910222887","state":["exists","up"]},{"osd":6,"uuid":"d7138615-8838-45ff-9072-2fd0683362f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6817","nonce":1082239825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6819","nonce":1082239825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6823","nonce":1082239825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6821","nonce":1082239825}]},"public_addr":"172.21.15.143:6817/1082239825","cluster_addr":"172.21.15.143:6819/1082239825","heartbeat_back_addr":"172.21.15.143:6823/1082239825","heartbeat_front_addr":"172.21.15.143:6821/1082239825","state":["exists","up"]},{"osd":7,"uuid":"0c27172b-35c4-49ec-ba0b-0137b8ff0010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6825","nonce":3295508495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6827","nonce":3295508495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6831","nonce":3295508495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6829","nonce":3295508495}]},"public_addr":"172.21.15.143:6825/3295508495","cluster_addr":"172.21.15.143:6827/3295508495","heartbeat_back_addr":"172.21.15.143:6831/3295508495","heartbeat_front_addr":"172.21.15.143:6829/3295508495","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.326627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.396119+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.433915+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.414179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.216947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.329272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.503073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.436382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:56:32.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.974+0000 7f60d4800640 1 -- 172.21.15.138:0/1424239566 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f60b0068380 msgr2=0x7f60b006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:32.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.974+0000 7f60d4800640 1 --2- 172.21.15.138:0/1424239566 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f60b0068380 0x7f60b006a840 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f60c0007fd0 tx=0x7f60c0009040 comp rx=0 tx=0).stop 2024-04-26T20:56:32.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.974+0000 7f60d4800640 1 -- 172.21.15.138:0/1424239566 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f60cc0d1720 msgr2=0x7f60cc0c8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:32.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.974+0000 7f60d4800640 1 --2- 172.21.15.138:0/1424239566 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f60cc0d1720 0x7f60cc0c8db0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f60bc00e930 tx=0x7f60bc00edf0 comp rx=0 tx=0).stop 2024-04-26T20:56:32.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.974+0000 7f60d4800640 1 -- 172.21.15.138:0/1424239566 shutdown_connections 2024-04-26T20:56:32.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.974+0000 7f60d4800640 1 --2- 172.21.15.138:0/1424239566 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f60b0068380 0x7f60b006a840 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:32.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.974+0000 7f60d4800640 1 --2- 172.21.15.138:0/1424239566 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60cc15d0f0 0x7f60cc09f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:32.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.974+0000 7f60d4800640 1 --2- 172.21.15.138:0/1424239566 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f60cc0d1720 0x7f60cc0c8db0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:32.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.974+0000 7f60d4800640 1 --2- 172.21.15.138:0/1424239566 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60cc0b2280 0x7f60cc0ca830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:32.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.974+0000 7f60d4800640 1 -- 172.21.15.138:0/1424239566 >> 172.21.15.138:0/1424239566 conn(0x7f60cc0d2d80 msgr2=0x7f60cc158390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:32.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.974+0000 7f60d4800640 1 -- 172.21.15.138:0/1424239566 shutdown_connections 2024-04-26T20:56:32.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:32.974+0000 7f60d4800640 1 -- 172.21.15.138:0/1424239566 wait complete. 2024-04-26T20:56:32.996 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:56:27.265834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T20:56:32.997 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T20:56:33.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.130+0000 7f206a400640 1 Processor -- start 2024-04-26T20:56:33.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.130+0000 7f206a400640 1 -- start start 2024-04-26T20:56:33.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.134+0000 7f206a400640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f2064168410 0x7f206416a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:33.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.134+0000 7f206a400640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f206406e790 con 0x7f20640b34f0 2024-04-26T20:56:33.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.134+0000 7f206a400640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20640d04a0 con 0x7f20640b3b00 2024-04-26T20:56:33.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.134+0000 7f206a400640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f20640d3da0 con 0x7f2064168410 2024-04-26T20:56:33.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.134+0000 7f2063400640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f20640b34f0 0x7f20640cf680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:37778/0 (socket says 172.21.15.138:37778) 2024-04-26T20:56:33.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.134+0000 7f2063400640 1 -- 172.21.15.138:0/2961799718 learned_addr learned my addr 172.21.15.138:0/2961799718 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:56:33.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.134+0000 7f2063e00640 1 --2- 172.21.15.138:0/2961799718 >> v2:172.21.15.143:3300/0 conn(0x7f2064168410 0x7f206416a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:33.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.134+0000 7f2062a00640 1 -- 172.21.15.138:0/2961799718 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4182839036 0 0) 0x7f206406e790 con 0x7f20640b34f0 2024-04-26T20:56:33.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.134+0000 7f2062a00640 1 -- 172.21.15.138:0/2961799718 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2048003530 con 0x7f20640b34f0 2024-04-26T20:56:33.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.134+0000 7f2062a00640 1 -- 172.21.15.138:0/2961799718 <== mon.0 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4103359251 0 0) 0x7f2048003530 con 0x7f20640b34f0 2024-04-26T20:56:33.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.134+0000 7f2062a00640 1 -- 172.21.15.138:0/2961799718 >> v2:172.21.15.143:3300/0 conn(0x7f2064168410 msgr2=0x7f206416a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:33.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.134+0000 7f2062a00640 1 --2- 172.21.15.138:0/2961799718 >> v2:172.21.15.143:3300/0 conn(0x7f2064168410 0x7f206416a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:33.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.134+0000 7f2062a00640 1 -- 172.21.15.138:0/2961799718 >> v1:172.21.15.143:6789/0 conn(0x7f20640b3b00 legacy=0x7f20640cfd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:33.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.134+0000 7f2062a00640 1 -- 172.21.15.138:0/2961799718 --> v1:172.21.15.138:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20640d0fb0 con 0x7f20640b34f0 2024-04-26T20:56:33.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.134+0000 7f2062a00640 1 -- 172.21.15.138:0/2961799718 <== mon.0 v1:172.21.15.138:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2715389689 0 0) 0x7f2054001a00 con 0x7f20640b34f0 2024-04-26T20:56:33.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.134+0000 7f2062a00640 1 -- 172.21.15.138:0/2961799718 >> v1:172.21.15.138:6789/0 conn(0x7f20640b34f0 legacy=0x7f20640cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:33.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.134+0000 7f2062a00640 1 --2- 172.21.15.138:0/2961799718 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2048003a30 0x7f2048003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:33.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.134+0000 7f2062a00640 1 --2- 172.21.15.138:0/2961799718 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2048004810 0x7f2048004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:33.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.134+0000 7f2062a00640 1 --2- 172.21.15.138:0/2961799718 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f20480051d0 0x7f204800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:33.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.134+0000 7f2062a00640 1 -- 172.21.15.138:0/2961799718 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f204800bfc0 con 0x7f2048003a30 2024-04-26T20:56:33.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.134+0000 7f2062a00640 1 -- 172.21.15.138:0/2961799718 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f204800c140 con 0x7f2048004810 2024-04-26T20:56:33.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.134+0000 7f2062a00640 1 -- 172.21.15.138:0/2961799718 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f204800c340 con 0x7f20480051d0 2024-04-26T20:56:33.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.134+0000 7f2063400640 1 --2- 172.21.15.138:0/2961799718 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2048003a30 0x7f2048003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:33.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.134+0000 7f205aa00640 1 --2- 172.21.15.138:0/2961799718 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2048004810 0x7f2048004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:33.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.134+0000 7f2063e00640 1 --2- 172.21.15.138:0/2961799718 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f20480051d0 0x7f204800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:33.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.134+0000 7f2063400640 1 -- 172.21.15.138:0/2961799718 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f20480051d0 msgr2=0x7f204800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:33.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.134+0000 7f2063400640 1 --2- 172.21.15.138:0/2961799718 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f20480051d0 0x7f204800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:33.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.134+0000 7f2063400640 1 -- 172.21.15.138:0/2961799718 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2048004810 msgr2=0x7f2048004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:33.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.134+0000 7f2063400640 1 --2- 172.21.15.138:0/2961799718 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2048004810 0x7f2048004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:33.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.134+0000 7f2063400640 1 -- 172.21.15.138:0/2961799718 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2048003530 con 0x7f2048003a30 2024-04-26T20:56:33.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.134+0000 7f2063e00640 1 -- 172.21.15.138:0/2961799718 reap_dead start 2024-04-26T20:56:33.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.134+0000 7f205aa00640 1 --2- 172.21.15.138:0/2961799718 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2048004810 0x7f2048004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:56:33.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.138+0000 7f2063400640 1 --2- 172.21.15.138:0/2961799718 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2048003a30 0x7f2048003e10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f205400a7e0 tx=0x7f205401d260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62fdf0770f76152f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:33.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.138+0000 7f2062a00640 1 -- 172.21.15.138:0/2961799718 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f205400a430 con 0x7f2048003a30 2024-04-26T20:56:33.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.138+0000 7f2062a00640 1 -- 172.21.15.138:0/2961799718 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20540ad630 con 0x7f2048003a30 2024-04-26T20:56:33.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.138+0000 7f2062a00640 1 -- 172.21.15.138:0/2961799718 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20540ada20 con 0x7f2048003a30 2024-04-26T20:56:33.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.138+0000 7f206a400640 1 -- 172.21.15.138:0/2961799718 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2048003a30 msgr2=0x7f2048003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:33.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.138+0000 7f206a400640 1 --2- 172.21.15.138:0/2961799718 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2048003a30 0x7f2048003e10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f205400a7e0 tx=0x7f205401d260 comp rx=0 tx=0).stop 2024-04-26T20:56:33.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.138+0000 7f206a400640 1 -- 172.21.15.138:0/2961799718 shutdown_connections 2024-04-26T20:56:33.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.138+0000 7f206a400640 1 --2- 172.21.15.138:0/2961799718 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2048003a30 0x7f2048003e10 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:33.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.138+0000 7f206a400640 1 -- 172.21.15.138:0/2961799718 >> 172.21.15.138:0/2961799718 conn(0x7f20640d2e00 msgr2=0x7f20640d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:33.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.138+0000 7f206a400640 1 -- 172.21.15.138:0/2961799718 shutdown_connections 2024-04-26T20:56:33.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.138+0000 7f206a400640 1 -- 172.21.15.138:0/2961799718 wait complete. 2024-04-26T20:56:33.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.138+0000 7f206a400640 1 Processor -- start 2024-04-26T20:56:33.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.138+0000 7f206a400640 1 -- start start 2024-04-26T20:56:33.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.142+0000 7f206a400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2048003a30 0x7f20640afdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:33.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.142+0000 7f206a400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f20640b2240 0x7f2064152450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:33.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.142+0000 7f206a400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2064152990 0x7f2064153900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:33.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.142+0000 7f206a400640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f206406e1d0 con 0x7f2048003a30 2024-04-26T20:56:33.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.142+0000 7f206a400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f20640d3ac0 con 0x7f2064152990 2024-04-26T20:56:33.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.142+0000 7f206a400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f206406e4b0 con 0x7f20640b2240 2024-04-26T20:56:33.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.142+0000 7f2063400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2048003a30 0x7f20640afdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:33.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.142+0000 7f2063400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2048003a30 0x7f20640afdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:41970/0 (socket says 172.21.15.138:41970) 2024-04-26T20:56:33.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.142+0000 7f2063400640 1 -- 172.21.15.138:0/1948436177 learned_addr learned my addr 172.21.15.138:0/1948436177 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:33.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.142+0000 7f2063e00640 1 --2- 172.21.15.138:0/1948436177 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2064152990 0x7f2064153900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:33.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.142+0000 7f205aa00640 1 --2- 172.21.15.138:0/1948436177 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f20640b2240 0x7f2064152450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:33.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.142+0000 7f2063400640 1 -- 172.21.15.138:0/1948436177 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f20640b2240 msgr2=0x7f2064152450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:33.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.142+0000 7f2063400640 1 --2- 172.21.15.138:0/1948436177 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f20640b2240 0x7f2064152450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:33.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.142+0000 7f2063400640 1 -- 172.21.15.138:0/1948436177 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2064152990 msgr2=0x7f2064153900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:33.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.142+0000 7f2063400640 1 --2- 172.21.15.138:0/1948436177 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2064152990 0x7f2064153900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:33.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.142+0000 7f2063400640 1 -- 172.21.15.138:0/1948436177 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20640b29e0 con 0x7f2048003a30 2024-04-26T20:56:33.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.142+0000 7f2063400640 1 --2- 172.21.15.138:0/1948436177 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2048003a30 0x7f20640afdf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f205401ccd0 tx=0x7f2048005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:33.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.142+0000 7f205be00640 1 -- 172.21.15.138:0/1948436177 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2054001260 con 0x7f2048003a30 2024-04-26T20:56:33.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.142+0000 7f205be00640 1 -- 172.21.15.138:0/1948436177 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20540bb070 con 0x7f2048003a30 2024-04-26T20:56:33.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.142+0000 7f205be00640 1 -- 172.21.15.138:0/1948436177 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2054001800 con 0x7f2048003a30 2024-04-26T20:56:33.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.142+0000 7f206a400640 1 -- 172.21.15.138:0/1948436177 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20640b2cc0 con 0x7f2048003a30 2024-04-26T20:56:33.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.142+0000 7f206a400640 1 -- 172.21.15.138:0/1948436177 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20640ca5a0 con 0x7f2048003a30 2024-04-26T20:56:33.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.142+0000 7f206a400640 1 -- 172.21.15.138:0/1948436177 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2064069430 con 0x7f2048003a30 2024-04-26T20:56:33.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.142+0000 7f205be00640 1 -- 172.21.15.138:0/1948436177 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f20540b5070 con 0x7f2048003a30 2024-04-26T20:56:33.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.146+0000 7f205be00640 1 --2- 172.21.15.138:0/1948436177 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f2040068520 0x7f204006a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:33.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.146+0000 7f205be00640 1 -- 172.21.15.138:0/1948436177 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f2054120dc0 con 0x7f2048003a30 2024-04-26T20:56:33.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.146+0000 7f205aa00640 1 --2- 172.21.15.138:0/1948436177 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f2040068520 0x7f204006a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:33.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.146+0000 7f205aa00640 1 --2- 172.21.15.138:0/1948436177 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f2040068520 0x7f204006a9e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f204c000c10 tx=0x7f204c007100 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:33.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.150+0000 7f205be00640 1 -- 172.21.15.138:0/1948436177 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2054016f70 con 0x7f2048003a30 2024-04-26T20:56:33.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.310+0000 7f206a400640 1 -- 172.21.15.138:0/1948436177 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f20640ced70 con 0x7f2048003a30 2024-04-26T20:56:33.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.310+0000 7f205be00640 1 -- 172.21.15.138:0/1948436177 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) ==== 93+0+10 (secure 0 0 0) 0x7f20540f16f0 con 0x7f2048003a30 2024-04-26T20:56:33.313 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 1 2024-04-26T20:56:33.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.310+0000 7f206a400640 1 -- 172.21.15.138:0/1948436177 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f2040068520 msgr2=0x7f204006a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:33.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.310+0000 7f206a400640 1 --2- 172.21.15.138:0/1948436177 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f2040068520 0x7f204006a9e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f204c000c10 tx=0x7f204c007100 comp rx=0 tx=0).stop 2024-04-26T20:56:33.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.310+0000 7f206a400640 1 -- 172.21.15.138:0/1948436177 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2048003a30 msgr2=0x7f20640afdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:33.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.310+0000 7f206a400640 1 --2- 172.21.15.138:0/1948436177 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2048003a30 0x7f20640afdf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f205401ccd0 tx=0x7f2048005840 comp rx=0 tx=0).stop 2024-04-26T20:56:33.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.310+0000 7f206a400640 1 -- 172.21.15.138:0/1948436177 shutdown_connections 2024-04-26T20:56:33.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.310+0000 7f206a400640 1 --2- 172.21.15.138:0/1948436177 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f2040068520 0x7f204006a9e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:33.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.310+0000 7f206a400640 1 --2- 172.21.15.138:0/1948436177 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2064152990 0x7f2064153900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:33.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.310+0000 7f206a400640 1 --2- 172.21.15.138:0/1948436177 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f20640b2240 0x7f2064152450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:33.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.310+0000 7f206a400640 1 --2- 172.21.15.138:0/1948436177 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2048003a30 0x7f20640afdf0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:33.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.310+0000 7f206a400640 1 -- 172.21.15.138:0/1948436177 >> 172.21.15.138:0/1948436177 conn(0x7f20640d2e00 msgr2=0x7f2064158100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:33.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.310+0000 7f206a400640 1 -- 172.21.15.138:0/1948436177 shutdown_connections 2024-04-26T20:56:33.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.310+0000 7f206a400640 1 -- 172.21.15.138:0/1948436177 wait complete. 2024-04-26T20:56:33.333 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:56:33.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.462+0000 7f655ae00640 1 Processor -- start 2024-04-26T20:56:33.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.462+0000 7f655ae00640 1 -- start start 2024-04-26T20:56:33.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.466+0000 7f655ae00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f65540cba90 0x7f655406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:33.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.466+0000 7f655ae00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f655415bb60 0x7f655415bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:33.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.466+0000 7f655ae00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6554072130 con 0x7f6554159250 2024-04-26T20:56:33.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.466+0000 7f655ae00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f655415f4e0 con 0x7f65540cba90 2024-04-26T20:56:33.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.466+0000 7f655ae00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f655415cae0 con 0x7f655415bb60 2024-04-26T20:56:33.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.466+0000 7f6558e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f655415bb60 0x7f655415bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:33.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.466+0000 7f654b400640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f65540cba90 0x7f655406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:33.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.466+0000 7f6553e00640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f6554159250 0x7f65540cb380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.138:35564/0 (socket says 172.21.15.138:35564) 2024-04-26T20:56:33.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.466+0000 7f6553e00640 1 -- 172.21.15.138:0/2018816876 learned_addr learned my addr 172.21.15.138:0/2018816876 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:56:33.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.466+0000 7f6558e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f655415bb60 0x7f655415bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.138:51294/0 (socket says 172.21.15.138:51294) 2024-04-26T20:56:33.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.466+0000 7f654b400640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f65540cba90 0x7f655406ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.138:50226/0 (socket says 172.21.15.138:50226) 2024-04-26T20:56:33.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.466+0000 7f654b400640 1 -- 172.21.15.138:0/2018816876 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f655415bb60 msgr2=0x7f655415bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:33.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.466+0000 7f654b400640 1 --2- 172.21.15.138:0/2018816876 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f655415bb60 0x7f655415bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:33.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.466+0000 7f654b400640 1 -- 172.21.15.138:0/2018816876 >> v1:172.21.15.143:6789/0 conn(0x7f6554159250 legacy=0x7f65540cb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:33.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.466+0000 7f654b400640 1 -- 172.21.15.138:0/2018816876 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f655415c800 con 0x7f65540cba90 2024-04-26T20:56:33.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.470+0000 7f654b400640 1 --2- 172.21.15.138:0/2018816876 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f65540cba90 0x7f655406ee80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f653c0097c0 tx=0x7f653c01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba9ac1b7a1dff3ca server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:33.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.470+0000 7f6553400640 1 -- 172.21.15.138:0/2018816876 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f653c0b0070 con 0x7f65540cba90 2024-04-26T20:56:33.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.470+0000 7f6553400640 1 -- 172.21.15.138:0/2018816876 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f653c0ab600 con 0x7f65540cba90 2024-04-26T20:56:33.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.470+0000 7f6553400640 1 -- 172.21.15.138:0/2018816876 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f653c0ab9d0 con 0x7f65540cba90 2024-04-26T20:56:33.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.470+0000 7f655ae00640 1 -- 172.21.15.138:0/2018816876 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f65540cba90 msgr2=0x7f655406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:33.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.470+0000 7f655ae00640 1 --2- 172.21.15.138:0/2018816876 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f65540cba90 0x7f655406ee80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f653c0097c0 tx=0x7f653c01c4a0 comp rx=0 tx=0).stop 2024-04-26T20:56:33.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.470+0000 7f655ae00640 1 -- 172.21.15.138:0/2018816876 shutdown_connections 2024-04-26T20:56:33.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.470+0000 7f655ae00640 1 --2- 172.21.15.138:0/2018816876 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f655415bb60 0x7f655415bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:33.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.470+0000 7f655ae00640 1 --2- 172.21.15.138:0/2018816876 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f65540cba90 0x7f655406ee80 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:33.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.470+0000 7f655ae00640 1 -- 172.21.15.138:0/2018816876 >> 172.21.15.138:0/2018816876 conn(0x7f65540d0b20 msgr2=0x7f65540d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:33.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.470+0000 7f655ae00640 1 -- 172.21.15.138:0/2018816876 shutdown_connections 2024-04-26T20:56:33.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.470+0000 7f655ae00640 1 -- 172.21.15.138:0/2018816876 wait complete. 2024-04-26T20:56:33.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.470+0000 7f655ae00640 1 Processor -- start 2024-04-26T20:56:33.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.470+0000 7f655ae00640 1 -- start start 2024-04-26T20:56:33.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.474+0000 7f655ae00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f65540cba90 0x7f65540ce970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:33.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.474+0000 7f655ae00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6554159250 0x7f6554157d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:33.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.474+0000 7f655ae00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f655415bb60 0x7f65541555d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:33.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.474+0000 7f655ae00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f6554166e70 con 0x7f655415bb60 2024-04-26T20:56:33.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.474+0000 7f655ae00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f6554166cf0 con 0x7f6554159250 2024-04-26T20:56:33.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.474+0000 7f655ae00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f6554166ff0 con 0x7f65540cba90 2024-04-26T20:56:33.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.474+0000 7f6558e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f655415bb60 0x7f65541555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:33.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.474+0000 7f6558e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f655415bb60 0x7f65541555d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:41980/0 (socket says 172.21.15.138:41980) 2024-04-26T20:56:33.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.474+0000 7f6558e00640 1 -- 172.21.15.138:0/3869875747 learned_addr learned my addr 172.21.15.138:0/3869875747 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:33.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.474+0000 7f654b400640 1 --2- 172.21.15.138:0/3869875747 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6554159250 0x7f6554157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:33.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.474+0000 7f6553e00640 1 --2- 172.21.15.138:0/3869875747 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f65540cba90 0x7f65540ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:33.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.474+0000 7f6558e00640 1 -- 172.21.15.138:0/3869875747 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f65540cba90 msgr2=0x7f65540ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:33.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.474+0000 7f6558e00640 1 --2- 172.21.15.138:0/3869875747 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f65540cba90 0x7f65540ce970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:33.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.474+0000 7f6558e00640 1 -- 172.21.15.138:0/3869875747 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6554159250 msgr2=0x7f6554157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:33.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.474+0000 7f6558e00640 1 --2- 172.21.15.138:0/3869875747 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6554159250 0x7f6554157d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:33.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.474+0000 7f6558e00640 1 -- 172.21.15.138:0/3869875747 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65540cd5d0 con 0x7f655415bb60 2024-04-26T20:56:33.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.474+0000 7f654b400640 1 --2- 172.21.15.138:0/3869875747 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6554159250 0x7f6554157d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:56:33.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.474+0000 7f6553e00640 1 --2- 172.21.15.138:0/3869875747 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f65540cba90 0x7f65540ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:56:33.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.474+0000 7f6558e00640 1 --2- 172.21.15.138:0/3869875747 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f655415bb60 0x7f65541555d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f654c00e7f0 tx=0x7f654c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:33.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.474+0000 7f6550c00640 1 -- 172.21.15.138:0/3869875747 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f654c017070 con 0x7f655415bb60 2024-04-26T20:56:33.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.474+0000 7f6550c00640 1 -- 172.21.15.138:0/3869875747 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f654c00c940 con 0x7f655415bb60 2024-04-26T20:56:33.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.474+0000 7f655ae00640 1 -- 172.21.15.138:0/3869875747 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6554158480 con 0x7f655415bb60 2024-04-26T20:56:33.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.474+0000 7f6550c00640 1 -- 172.21.15.138:0/3869875747 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f654c00eea0 con 0x7f655415bb60 2024-04-26T20:56:33.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.474+0000 7f655ae00640 1 -- 172.21.15.138:0/3869875747 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65540cd870 con 0x7f655415bb60 2024-04-26T20:56:33.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.474+0000 7f655ae00640 1 -- 172.21.15.138:0/3869875747 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6554069510 con 0x7f655415bb60 2024-04-26T20:56:33.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.474+0000 7f6550c00640 1 -- 172.21.15.138:0/3869875747 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f654c01a070 con 0x7f655415bb60 2024-04-26T20:56:33.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.478+0000 7f6550c00640 1 --2- 172.21.15.138:0/3869875747 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f65300683b0 0x7f653006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:33.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.478+0000 7f6550c00640 1 -- 172.21.15.138:0/3869875747 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f654c0868d0 con 0x7f655415bb60 2024-04-26T20:56:33.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.478+0000 7f6553e00640 1 --2- 172.21.15.138:0/3869875747 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f65300683b0 0x7f653006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:33.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.478+0000 7f6553e00640 1 --2- 172.21.15.138:0/3869875747 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f65300683b0 0x7f653006a870 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f65540cfbe0 tx=0x7f6544009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:33.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.482+0000 7f6550c00640 1 -- 172.21.15.138:0/3869875747 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f654c0571e0 con 0x7f655415bb60 2024-04-26T20:56:33.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.670+0000 7f655ae00640 1 -- 172.21.15.138:0/3869875747 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f65541662c0 con 0x7f655415bb60 2024-04-26T20:56:33.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.670+0000 7f6550c00640 1 -- 172.21.15.138:0/3869875747 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1395 (secure 0 0 0) 0x7f654c056ae0 con 0x7f655415bb60 2024-04-26T20:56:33.673 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:56:33.673 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/1806638334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":1806638334},{"type":"v1","addr":"172.21.15.138:6834","nonce":1806638334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-26T20:56:33.673 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 2 2024-04-26T20:56:33.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.670+0000 7f655ae00640 1 -- 172.21.15.138:0/3869875747 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f65300683b0 msgr2=0x7f653006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:33.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.670+0000 7f655ae00640 1 --2- 172.21.15.138:0/3869875747 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f65300683b0 0x7f653006a870 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f65540cfbe0 tx=0x7f6544009040 comp rx=0 tx=0).stop 2024-04-26T20:56:33.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.670+0000 7f655ae00640 1 -- 172.21.15.138:0/3869875747 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f655415bb60 msgr2=0x7f65541555d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:33.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.670+0000 7f655ae00640 1 --2- 172.21.15.138:0/3869875747 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f655415bb60 0x7f65541555d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f654c00e7f0 tx=0x7f654c00ecb0 comp rx=0 tx=0).stop 2024-04-26T20:56:33.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.670+0000 7f655ae00640 1 -- 172.21.15.138:0/3869875747 shutdown_connections 2024-04-26T20:56:33.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.670+0000 7f655ae00640 1 --2- 172.21.15.138:0/3869875747 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f65300683b0 0x7f653006a870 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:33.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.670+0000 7f655ae00640 1 --2- 172.21.15.138:0/3869875747 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f655415bb60 0x7f65541555d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:33.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.670+0000 7f655ae00640 1 --2- 172.21.15.138:0/3869875747 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6554159250 0x7f6554157d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:33.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.670+0000 7f655ae00640 1 --2- 172.21.15.138:0/3869875747 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f65540cba90 0x7f65540ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:33.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.670+0000 7f655ae00640 1 -- 172.21.15.138:0/3869875747 >> 172.21.15.138:0/3869875747 conn(0x7f65540d0b20 msgr2=0x7f655415b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:33.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.670+0000 7f655ae00640 1 -- 172.21.15.138:0/3869875747 shutdown_connections 2024-04-26T20:56:33.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:33.670+0000 7f655ae00640 1 -- 172.21.15.138:0/3869875747 wait complete. 2024-04-26T20:56:35.695 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:56:35.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.838+0000 7fef5b200640 1 Processor -- start 2024-04-26T20:56:35.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.838+0000 7fef5b200640 1 -- start start 2024-04-26T20:56:35.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.838+0000 7fef5b200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fef5c0cc460 0x7fef5c0cb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:35.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.838+0000 7fef5b200640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fef5c0cd0a0 0x7fef5c0cb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:35.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.838+0000 7fef5b200640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef5c15d5c0 con 0x7fef5c15d1e0 2024-04-26T20:56:35.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.838+0000 7fef5b200640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fef5c0cc9d0 con 0x7fef5c0cd0a0 2024-04-26T20:56:35.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.838+0000 7fef5b200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fef5c0ccc20 con 0x7fef5c0cc460 2024-04-26T20:56:35.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.842+0000 7fef5a800640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fef5c0cd0a0 0x7fef5c0cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:35.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.842+0000 7fef59e00640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fef5c15d1e0 0x7fef5c071cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.138:59394/0 (socket says 172.21.15.138:59394) 2024-04-26T20:56:35.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.842+0000 7fef51400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fef5c0cc460 0x7fef5c0cb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:35.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.842+0000 7fef59e00640 1 -- 172.21.15.138:0/2218571375 learned_addr learned my addr 172.21.15.138:0/2218571375 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:56:35.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.842+0000 7fef5a800640 1 -- 172.21.15.138:0/2218571375 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fef5c0cc460 msgr2=0x7fef5c0cb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:35.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.842+0000 7fef5a800640 1 --2- 172.21.15.138:0/2218571375 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fef5c0cc460 0x7fef5c0cb0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:35.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.842+0000 7fef5a800640 1 -- 172.21.15.138:0/2218571375 >> v1:172.21.15.143:6789/0 conn(0x7fef5c15d1e0 legacy=0x7fef5c071cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:35.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.842+0000 7fef5a800640 1 -- 172.21.15.138:0/2218571375 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef5c0d1590 con 0x7fef5c0cd0a0 2024-04-26T20:56:35.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.842+0000 7fef51400640 1 --2- 172.21.15.138:0/2218571375 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fef5c0cc460 0x7fef5c0cb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:56:35.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.842+0000 7fef59400640 1 -- 172.21.15.138:0/2218571375 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2958492588 0 0) 0x7fef5c15d5c0 con 0x7fef5c15d1e0 2024-04-26T20:56:35.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.842+0000 7fef5a800640 1 --2- 172.21.15.138:0/2218571375 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fef5c0cd0a0 0x7fef5c0cb600 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fef54009d90 tx=0x7fef5401c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33fa2539075ba617 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:35.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.846+0000 7fef59400640 1 -- 172.21.15.138:0/2218571375 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef540b2070 con 0x7fef5c0cd0a0 2024-04-26T20:56:35.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.846+0000 7fef59400640 1 -- 172.21.15.138:0/2218571375 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef540a59c0 con 0x7fef5c0cd0a0 2024-04-26T20:56:35.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.846+0000 7fef59400640 1 -- 172.21.15.138:0/2218571375 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef540a5d90 con 0x7fef5c0cd0a0 2024-04-26T20:56:35.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.846+0000 7fef5b200640 1 -- 172.21.15.138:0/2218571375 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fef5c0cd0a0 msgr2=0x7fef5c0cb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:35.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.846+0000 7fef5b200640 1 --2- 172.21.15.138:0/2218571375 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fef5c0cd0a0 0x7fef5c0cb600 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fef54009d90 tx=0x7fef5401c940 comp rx=0 tx=0).stop 2024-04-26T20:56:35.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.846+0000 7fef5b200640 1 -- 172.21.15.138:0/2218571375 shutdown_connections 2024-04-26T20:56:35.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.846+0000 7fef5b200640 1 --2- 172.21.15.138:0/2218571375 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fef5c0cd0a0 0x7fef5c0cb600 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:35.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.846+0000 7fef5b200640 1 --2- 172.21.15.138:0/2218571375 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fef5c0cc460 0x7fef5c0cb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:35.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.846+0000 7fef5b200640 1 -- 172.21.15.138:0/2218571375 >> 172.21.15.138:0/2218571375 conn(0x7fef5c0d0a70 msgr2=0x7fef5c0d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:35.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.846+0000 7fef5b200640 1 -- 172.21.15.138:0/2218571375 shutdown_connections 2024-04-26T20:56:35.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.846+0000 7fef5b200640 1 -- 172.21.15.138:0/2218571375 wait complete. 2024-04-26T20:56:35.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.846+0000 7fef5b200640 1 Processor -- start 2024-04-26T20:56:35.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.846+0000 7fef5b200640 1 -- start start 2024-04-26T20:56:35.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.846+0000 7fef5b200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fef5c0cd0a0 0x7fef5c1606a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:35.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.846+0000 7fef5b200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fef5c15d1e0 0x7fef5c0c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:35.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.846+0000 7fef5b200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fef5c1602a0 0x7fef5c153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:35.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.846+0000 7fef5b200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fef5c073a70 con 0x7fef5c1602a0 2024-04-26T20:56:35.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.846+0000 7fef5b200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fef5c0738f0 con 0x7fef5c15d1e0 2024-04-26T20:56:35.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.846+0000 7fef5b200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fef5c169d20 con 0x7fef5c0cd0a0 2024-04-26T20:56:35.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.846+0000 7fef5a800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fef5c1602a0 0x7fef5c153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:35.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.846+0000 7fef5a800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fef5c1602a0 0x7fef5c153b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:53922/0 (socket says 172.21.15.138:53922) 2024-04-26T20:56:35.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.846+0000 7fef5a800640 1 -- 172.21.15.138:0/613048721 learned_addr learned my addr 172.21.15.138:0/613048721 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:35.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.846+0000 7fef59e00640 1 --2- 172.21.15.138:0/613048721 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fef5c0cd0a0 0x7fef5c1606a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:35.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.846+0000 7fef51400640 1 --2- 172.21.15.138:0/613048721 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fef5c15d1e0 0x7fef5c0c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:35.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.850+0000 7fef5a800640 1 -- 172.21.15.138:0/613048721 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fef5c0cd0a0 msgr2=0x7fef5c1606a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:35.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.850+0000 7fef5a800640 1 --2- 172.21.15.138:0/613048721 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fef5c0cd0a0 0x7fef5c1606a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:35.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.850+0000 7fef5a800640 1 -- 172.21.15.138:0/613048721 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fef5c15d1e0 msgr2=0x7fef5c0c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:35.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.850+0000 7fef5a800640 1 --2- 172.21.15.138:0/613048721 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fef5c15d1e0 0x7fef5c0c6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:35.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.850+0000 7fef5a800640 1 -- 172.21.15.138:0/613048721 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef5c0b6320 con 0x7fef5c1602a0 2024-04-26T20:56:35.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.850+0000 7fef5a800640 1 --2- 172.21.15.138:0/613048721 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fef5c1602a0 0x7fef5c153b10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fef5401aff0 tx=0x7fef540196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:35.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.850+0000 7fef52a00640 1 -- 172.21.15.138:0/613048721 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef540b2050 con 0x7fef5c1602a0 2024-04-26T20:56:35.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.850+0000 7fef52a00640 1 -- 172.21.15.138:0/613048721 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef540be070 con 0x7fef5c1602a0 2024-04-26T20:56:35.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.850+0000 7fef52a00640 1 -- 172.21.15.138:0/613048721 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef540ada70 con 0x7fef5c1602a0 2024-04-26T20:56:35.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.850+0000 7fef5b200640 1 -- 172.21.15.138:0/613048721 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef5c15f510 con 0x7fef5c1602a0 2024-04-26T20:56:35.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.850+0000 7fef5b200640 1 -- 172.21.15.138:0/613048721 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef5c15fad0 con 0x7fef5c1602a0 2024-04-26T20:56:35.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.850+0000 7fef5b200640 1 -- 172.21.15.138:0/613048721 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef5c15f320 con 0x7fef5c1602a0 2024-04-26T20:56:35.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.850+0000 7fef52a00640 1 -- 172.21.15.138:0/613048721 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fef540adc10 con 0x7fef5c1602a0 2024-04-26T20:56:35.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.850+0000 7fef52a00640 1 --2- 172.21.15.138:0/613048721 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fef38068380 0x7fef3806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:35.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.850+0000 7fef52a00640 1 -- 172.21.15.138:0/613048721 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fef541217d0 con 0x7fef5c1602a0 2024-04-26T20:56:35.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.850+0000 7fef59e00640 1 --2- 172.21.15.138:0/613048721 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fef38068380 0x7fef3806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:35.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.854+0000 7fef59e00640 1 --2- 172.21.15.138:0/613048721 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fef38068380 0x7fef3806a840 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fef4c000f70 tx=0x7fef4c007df0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:35.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:35.854+0000 7fef52a00640 1 -- 172.21.15.138:0/613048721 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fef54016560 con 0x7fef5c1602a0 2024-04-26T20:56:36.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.046+0000 7fef5b200640 1 -- 172.21.15.138:0/613048721 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fef5c069430 con 0x7fef5c1602a0 2024-04-26T20:56:36.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.046+0000 7fef52a00640 1 -- 172.21.15.138:0/613048721 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3876 (secure 0 0 0) 0x7fef540f1ba0 con 0x7fef5c1602a0 2024-04-26T20:56:36.050 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:56:36.050 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/3495262740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3495262740},{"type":"v1","addr":"172.21.15.143:6837","nonce":3495262740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4273,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/1806638334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":1806638334},{"type":"v1","addr":"172.21.15.138:6834","nonce":1806638334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/3333703637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":3333703637},{"type":"v1","addr":"172.21.15.138:6835","nonce":3333703637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4290,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3598364176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":3598364176},{"type":"v1","addr":"172.21.15.143:6836","nonce":3598364176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-26T20:56:36.051 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 3 2024-04-26T20:56:36.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.050+0000 7fef5b200640 1 -- 172.21.15.138:0/613048721 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fef38068380 msgr2=0x7fef3806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:36.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.050+0000 7fef5b200640 1 --2- 172.21.15.138:0/613048721 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fef38068380 0x7fef3806a840 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fef4c000f70 tx=0x7fef4c007df0 comp rx=0 tx=0).stop 2024-04-26T20:56:36.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.050+0000 7fef5b200640 1 -- 172.21.15.138:0/613048721 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fef5c1602a0 msgr2=0x7fef5c153b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:36.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.050+0000 7fef5b200640 1 --2- 172.21.15.138:0/613048721 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fef5c1602a0 0x7fef5c153b10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fef5401aff0 tx=0x7fef540196e0 comp rx=0 tx=0).stop 2024-04-26T20:56:36.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.050+0000 7fef5b200640 1 -- 172.21.15.138:0/613048721 shutdown_connections 2024-04-26T20:56:36.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.050+0000 7fef5b200640 1 --2- 172.21.15.138:0/613048721 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fef38068380 0x7fef3806a840 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:36.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.050+0000 7fef5b200640 1 --2- 172.21.15.138:0/613048721 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fef5c1602a0 0x7fef5c153b10 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:36.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.050+0000 7fef5b200640 1 --2- 172.21.15.138:0/613048721 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fef5c15d1e0 0x7fef5c0c6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:36.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.050+0000 7fef5b200640 1 --2- 172.21.15.138:0/613048721 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fef5c0cd0a0 0x7fef5c1606a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:36.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.050+0000 7fef5b200640 1 -- 172.21.15.138:0/613048721 >> 172.21.15.138:0/613048721 conn(0x7fef5c0d0a70 msgr2=0x7fef5c0b08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:36.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.050+0000 7fef5b200640 1 -- 172.21.15.138:0/613048721 shutdown_connections 2024-04-26T20:56:36.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.050+0000 7fef5b200640 1 -- 172.21.15.138:0/613048721 wait complete. 2024-04-26T20:56:36.071 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:56:36.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.202+0000 7fdf86800640 1 Processor -- start 2024-04-26T20:56:36.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.202+0000 7fdf86800640 1 -- start start 2024-04-26T20:56:36.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.202+0000 7fdf86800640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fdf8015ce20 0x7fdf80161340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:36.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.202+0000 7fdf86800640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf80073b70 con 0x7fdf8015e0c0 2024-04-26T20:56:36.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.202+0000 7fdf86800640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf80073e10 con 0x7fdf800cca00 2024-04-26T20:56:36.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.202+0000 7fdf86800640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fdf800740f0 con 0x7fdf8015ce20 2024-04-26T20:56:36.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.206+0000 7fdf7ea00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fdf8015e0c0 0x7fdf80071ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:54628/0 (socket says 172.21.15.138:54628) 2024-04-26T20:56:36.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.206+0000 7fdf7ea00640 1 -- 172.21.15.138:0/3730159321 learned_addr learned my addr 172.21.15.138:0/3730159321 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:56:36.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.206+0000 7fdf7f400640 1 --2- 172.21.15.138:0/3730159321 >> v2:172.21.15.143:3300/0 conn(0x7fdf8015ce20 0x7fdf80161340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:36.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.206+0000 7fdf7e000640 1 -- 172.21.15.138:0/3730159321 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 685881817 0 0) 0x7fdf80073b70 con 0x7fdf8015e0c0 2024-04-26T20:56:36.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.206+0000 7fdf7e000640 1 -- 172.21.15.138:0/3730159321 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf64003530 con 0x7fdf8015e0c0 2024-04-26T20:56:36.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.206+0000 7fdf7e000640 1 -- 172.21.15.138:0/3730159321 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 471649421 0 0) 0x7fdf80073e10 con 0x7fdf800cca00 2024-04-26T20:56:36.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.206+0000 7fdf7f400640 1 -- 172.21.15.138:0/3730159321 >> v1:172.21.15.143:6789/0 conn(0x7fdf800cca00 legacy=0x7fdf800cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:36.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.206+0000 7fdf7f400640 1 -- 172.21.15.138:0/3730159321 >> v1:172.21.15.138:6789/0 conn(0x7fdf8015e0c0 legacy=0x7fdf80071ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:36.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.206+0000 7fdf7f400640 1 -- 172.21.15.138:0/3730159321 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf80160b40 con 0x7fdf8015ce20 2024-04-26T20:56:36.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.206+0000 7fdf7f400640 1 --2- 172.21.15.138:0/3730159321 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdf8015ce20 0x7fdf80161340 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdf680097c0 tx=0x7fdf6801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49ed3710c1c0aeb2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:36.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.210+0000 7fdf7e000640 1 -- 172.21.15.138:0/3730159321 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf680b1070 con 0x7fdf8015ce20 2024-04-26T20:56:36.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.210+0000 7fdf7e000640 1 -- 172.21.15.138:0/3730159321 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf680ac410 con 0x7fdf8015ce20 2024-04-26T20:56:36.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.210+0000 7fdf7e000640 1 -- 172.21.15.138:0/3730159321 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf680ac7e0 con 0x7fdf8015ce20 2024-04-26T20:56:36.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.210+0000 7fdf86800640 1 -- 172.21.15.138:0/3730159321 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdf8015ce20 msgr2=0x7fdf80161340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:36.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.210+0000 7fdf86800640 1 --2- 172.21.15.138:0/3730159321 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdf8015ce20 0x7fdf80161340 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdf680097c0 tx=0x7fdf6801c4a0 comp rx=0 tx=0).stop 2024-04-26T20:56:36.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.210+0000 7fdf86800640 1 -- 172.21.15.138:0/3730159321 shutdown_connections 2024-04-26T20:56:36.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.210+0000 7fdf86800640 1 --2- 172.21.15.138:0/3730159321 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdf8015ce20 0x7fdf80161340 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:36.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.210+0000 7fdf86800640 1 -- 172.21.15.138:0/3730159321 >> 172.21.15.138:0/3730159321 conn(0x7fdf800d0b20 msgr2=0x7fdf800d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:36.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.210+0000 7fdf86800640 1 -- 172.21.15.138:0/3730159321 shutdown_connections 2024-04-26T20:56:36.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.210+0000 7fdf86800640 1 -- 172.21.15.138:0/3730159321 wait complete. 2024-04-26T20:56:36.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.210+0000 7fdf86800640 1 Processor -- start 2024-04-26T20:56:36.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.210+0000 7fdf86800640 1 -- start start 2024-04-26T20:56:36.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.210+0000 7fdf86800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdf800cca00 0x7fdf8014c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:36.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.210+0000 7fdf86800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdf8015ce20 0x7fdf80150da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:36.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.210+0000 7fdf86800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf8015e0c0 0x7fdf801512e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:36.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.210+0000 7fdf86800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fdf8006e800 con 0x7fdf8015e0c0 2024-04-26T20:56:36.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.210+0000 7fdf86800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fdf8006e680 con 0x7fdf800cca00 2024-04-26T20:56:36.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.210+0000 7fdf86800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fdf8016ae50 con 0x7fdf8015ce20 2024-04-26T20:56:36.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.210+0000 7fdf7fe00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf8015e0c0 0x7fdf801512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:36.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.210+0000 7fdf7fe00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf8015e0c0 0x7fdf801512e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:53936/0 (socket says 172.21.15.138:53936) 2024-04-26T20:56:36.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.210+0000 7fdf7fe00640 1 -- 172.21.15.138:0/1203858051 learned_addr learned my addr 172.21.15.138:0/1203858051 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:36.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.214+0000 7fdf7ea00640 1 --2- 172.21.15.138:0/1203858051 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdf8015ce20 0x7fdf80150da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:36.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.214+0000 7fdf7f400640 1 --2- 172.21.15.138:0/1203858051 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdf800cca00 0x7fdf8014c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:36.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.214+0000 7fdf7fe00640 1 -- 172.21.15.138:0/1203858051 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdf8015ce20 msgr2=0x7fdf80150da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:36.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.214+0000 7fdf7fe00640 1 --2- 172.21.15.138:0/1203858051 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdf8015ce20 0x7fdf80150da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:36.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.214+0000 7fdf7fe00640 1 -- 172.21.15.138:0/1203858051 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdf800cca00 msgr2=0x7fdf8014c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:36.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.214+0000 7fdf7fe00640 1 --2- 172.21.15.138:0/1203858051 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdf800cca00 0x7fdf8014c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:36.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.214+0000 7fdf7fe00640 1 -- 172.21.15.138:0/1203858051 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf800cac10 con 0x7fdf8015e0c0 2024-04-26T20:56:36.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.214+0000 7fdf7fe00640 1 --2- 172.21.15.138:0/1203858051 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf8015e0c0 0x7fdf801512e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdf7800c7b0 tx=0x7fdf7800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:36.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.214+0000 7fdf77400640 1 -- 172.21.15.138:0/1203858051 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf78003db0 con 0x7fdf8015e0c0 2024-04-26T20:56:36.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.214+0000 7fdf77400640 1 -- 172.21.15.138:0/1203858051 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf78005070 con 0x7fdf8015e0c0 2024-04-26T20:56:36.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.214+0000 7fdf86800640 1 -- 172.21.15.138:0/1203858051 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf800c9e50 con 0x7fdf8015e0c0 2024-04-26T20:56:36.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.214+0000 7fdf77400640 1 -- 172.21.15.138:0/1203858051 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf78005460 con 0x7fdf8015e0c0 2024-04-26T20:56:36.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.214+0000 7fdf86800640 1 -- 172.21.15.138:0/1203858051 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf800ca410 con 0x7fdf8015e0c0 2024-04-26T20:56:36.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.214+0000 7fdf86800640 1 -- 172.21.15.138:0/1203858051 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf80069510 con 0x7fdf8015e0c0 2024-04-26T20:56:36.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.214+0000 7fdf77400640 1 -- 172.21.15.138:0/1203858051 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdf78005600 con 0x7fdf8015e0c0 2024-04-26T20:56:36.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.214+0000 7fdf77400640 1 --2- 172.21.15.138:0/1203858051 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fdf5c068380 0x7fdf5c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:36.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.214+0000 7fdf77400640 1 -- 172.21.15.138:0/1203858051 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fdf780866f0 con 0x7fdf8015e0c0 2024-04-26T20:56:36.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.214+0000 7fdf7f400640 1 --2- 172.21.15.138:0/1203858051 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fdf5c068380 0x7fdf5c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:36.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.218+0000 7fdf7f400640 1 --2- 172.21.15.138:0/1203858051 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fdf5c068380 0x7fdf5c06a840 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdf680ae000 tx=0x7fdf68008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:36.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.218+0000 7fdf77400640 1 -- 172.21.15.138:0/1203858051 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fdf78056f60 con 0x7fdf8015e0c0 2024-04-26T20:56:36.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.378+0000 7fdf86800640 1 -- 172.21.15.138:0/1203858051 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdf80151b70 con 0x7fdf8015e0c0 2024-04-26T20:56:36.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.378+0000 7fdf77400640 1 -- 172.21.15.138:0/1203858051 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12944 (secure 0 0 0) 0x7fdf78056860 con 0x7fdf8015e0c0 2024-04-26T20:56:36.381 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:56:36.381 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":19,"fsid":"c22b4730-12cc-4558-8535-b965384398c0","created":"2024-04-26T20:56:14.182475+0000","modified":"2024-04-26T20:56:30.151540+0000","last_up_change":"2024-04-26T20:56:26.013243+0000","last_in_change":"2024-04-26T20:56:16.714055+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:56:27.265834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3f9a2e34-3199-466f-a6cf-57927318121e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6801","nonce":3534772245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6803","nonce":3534772245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6807","nonce":3534772245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6805","nonce":3534772245}]},"public_addr":"172.21.15.138:6801/3534772245","cluster_addr":"172.21.15.138:6803/3534772245","heartbeat_back_addr":"172.21.15.138:6807/3534772245","heartbeat_front_addr":"172.21.15.138:6805/3534772245","state":["exists","up"]},{"osd":1,"uuid":"e881fcf6-3248-4696-a2ef-95d206d77712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6817","nonce":1427635773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6819","nonce":1427635773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6823","nonce":1427635773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6821","nonce":1427635773}]},"public_addr":"172.21.15.138:6817/1427635773","cluster_addr":"172.21.15.138:6819/1427635773","heartbeat_back_addr":"172.21.15.138:6823/1427635773","heartbeat_front_addr":"172.21.15.138:6821/1427635773","state":["exists","up"]},{"osd":2,"uuid":"f7d1db33-7672-4699-ae47-9f1e0a8e4222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6809","nonce":4273721573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6811","nonce":4273721573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6815","nonce":4273721573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6813","nonce":4273721573}]},"public_addr":"172.21.15.138:6809/4273721573","cluster_addr":"172.21.15.138:6811/4273721573","heartbeat_back_addr":"172.21.15.138:6815/4273721573","heartbeat_front_addr":"172.21.15.138:6813/4273721573","state":["exists","up"]},{"osd":3,"uuid":"2f4e0a9a-b8f6-4468-844a-a4501cd85054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6825","nonce":3098242154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6827","nonce":3098242154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6831","nonce":3098242154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6829","nonce":3098242154}]},"public_addr":"172.21.15.138:6825/3098242154","cluster_addr":"172.21.15.138:6827/3098242154","heartbeat_back_addr":"172.21.15.138:6831/3098242154","heartbeat_front_addr":"172.21.15.138:6829/3098242154","state":["exists","up"]},{"osd":4,"uuid":"c85df99b-3624-410e-866b-86830af2cfe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6801","nonce":2942056312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6803","nonce":2942056312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6807","nonce":2942056312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6805","nonce":2942056312}]},"public_addr":"172.21.15.143:6801/2942056312","cluster_addr":"172.21.15.143:6803/2942056312","heartbeat_back_addr":"172.21.15.143:6807/2942056312","heartbeat_front_addr":"172.21.15.143:6805/2942056312","state":["exists","up"]},{"osd":5,"uuid":"9af1efb5-c416-4808-b5ef-de0679ab9705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6809","nonce":1910222887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6811","nonce":1910222887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6815","nonce":1910222887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6813","nonce":1910222887}]},"public_addr":"172.21.15.143:6809/1910222887","cluster_addr":"172.21.15.143:6811/1910222887","heartbeat_back_addr":"172.21.15.143:6815/1910222887","heartbeat_front_addr":"172.21.15.143:6813/1910222887","state":["exists","up"]},{"osd":6,"uuid":"d7138615-8838-45ff-9072-2fd0683362f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6817","nonce":1082239825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6819","nonce":1082239825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6823","nonce":1082239825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6821","nonce":1082239825}]},"public_addr":"172.21.15.143:6817/1082239825","cluster_addr":"172.21.15.143:6819/1082239825","heartbeat_back_addr":"172.21.15.143:6823/1082239825","heartbeat_front_addr":"172.21.15.143:6821/1082239825","state":["exists","up"]},{"osd":7,"uuid":"0c27172b-35c4-49ec-ba0b-0137b8ff0010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6825","nonce":3295508495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6827","nonce":3295508495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6831","nonce":3295508495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6829","nonce":3295508495}]},"public_addr":"172.21.15.143:6825/3295508495","cluster_addr":"172.21.15.143:6827/3295508495","heartbeat_back_addr":"172.21.15.143:6831/3295508495","heartbeat_front_addr":"172.21.15.143:6829/3295508495","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.326627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.396119+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.433915+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.414179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.216947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.329272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.503073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.436382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:56:36.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.378+0000 7fdf86800640 1 -- 172.21.15.138:0/1203858051 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fdf5c068380 msgr2=0x7fdf5c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:36.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.378+0000 7fdf86800640 1 --2- 172.21.15.138:0/1203858051 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fdf5c068380 0x7fdf5c06a840 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdf680ae000 tx=0x7fdf68008040 comp rx=0 tx=0).stop 2024-04-26T20:56:36.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.378+0000 7fdf86800640 1 -- 172.21.15.138:0/1203858051 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf8015e0c0 msgr2=0x7fdf801512e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:36.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.378+0000 7fdf86800640 1 --2- 172.21.15.138:0/1203858051 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf8015e0c0 0x7fdf801512e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdf7800c7b0 tx=0x7fdf7800cc70 comp rx=0 tx=0).stop 2024-04-26T20:56:36.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.378+0000 7fdf86800640 1 -- 172.21.15.138:0/1203858051 shutdown_connections 2024-04-26T20:56:36.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.378+0000 7fdf86800640 1 --2- 172.21.15.138:0/1203858051 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fdf5c068380 0x7fdf5c06a840 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:36.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.378+0000 7fdf86800640 1 --2- 172.21.15.138:0/1203858051 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf8015e0c0 0x7fdf801512e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:36.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.378+0000 7fdf86800640 1 --2- 172.21.15.138:0/1203858051 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdf8015ce20 0x7fdf80150da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:36.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.378+0000 7fdf86800640 1 --2- 172.21.15.138:0/1203858051 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdf800cca00 0x7fdf8014c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:36.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.378+0000 7fdf86800640 1 -- 172.21.15.138:0/1203858051 >> 172.21.15.138:0/1203858051 conn(0x7fdf800d0b20 msgr2=0x7fdf800b37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:36.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.378+0000 7fdf86800640 1 -- 172.21.15.138:0/1203858051 shutdown_connections 2024-04-26T20:56:36.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.378+0000 7fdf86800640 1 -- 172.21.15.138:0/1203858051 wait complete. 2024-04-26T20:56:36.401 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:56:27.265834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T20:56:36.401 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T20:56:36.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.538+0000 7f1a92c00640 1 Processor -- start 2024-04-26T20:56:36.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.538+0000 7f1a92c00640 1 -- start start 2024-04-26T20:56:36.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.538+0000 7f1a92c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1a8c15bdc0 0x7f1a8c15f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:36.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.538+0000 7f1a92c00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1a8c073d70 0x7f1a8c15fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:36.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.538+0000 7f1a92c00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a8c06dee0 con 0x7f1a8c06f880 2024-04-26T20:56:36.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.538+0000 7f1a92c00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f1a8c15c1a0 con 0x7f1a8c073d70 2024-04-26T20:56:36.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.538+0000 7f1a92c00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f1a8c06e180 con 0x7f1a8c15bdc0 2024-04-26T20:56:36.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.538+0000 7f1a90c00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f1a8c06f880 0x7f1a8c0cb6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:54642/0 (socket says 172.21.15.138:54642) 2024-04-26T20:56:36.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.538+0000 7f1a90c00640 1 -- 172.21.15.138:0/1620414059 learned_addr learned my addr 172.21.15.138:0/1620414059 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:56:36.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.538+0000 7f1a8b400640 1 --2- 172.21.15.138:0/1620414059 >> v2:172.21.15.143:3300/0 conn(0x7f1a8c073d70 0x7f1a8c15fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:36.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.538+0000 7f1a8be00640 1 --2- 172.21.15.138:0/1620414059 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1a8c15bdc0 0x7f1a8c15f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:36.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.538+0000 7f1a8aa00640 1 -- 172.21.15.138:0/1620414059 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2097490689 0 0) 0x7f1a8c06dee0 con 0x7f1a8c06f880 2024-04-26T20:56:36.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.538+0000 7f1a8aa00640 1 -- 172.21.15.138:0/1620414059 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a70003530 con 0x7f1a8c06f880 2024-04-26T20:56:36.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.538+0000 7f1a8b400640 1 -- 172.21.15.138:0/1620414059 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1a8c15bdc0 msgr2=0x7f1a8c15f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:36.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.538+0000 7f1a8b400640 1 --2- 172.21.15.138:0/1620414059 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1a8c15bdc0 0x7f1a8c15f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:36.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.538+0000 7f1a8b400640 1 -- 172.21.15.138:0/1620414059 >> v1:172.21.15.138:6789/0 conn(0x7f1a8c06f880 legacy=0x7f1a8c0cb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:36.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.538+0000 7f1a8aa00640 1 -- 172.21.15.138:0/1620414059 <== mon.0 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2872415131 0 0) 0x7f1a70003530 con 0x7f1a8c06f880 2024-04-26T20:56:36.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.538+0000 7f1a8b400640 1 -- 172.21.15.138:0/1620414059 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a8c06e460 con 0x7f1a8c073d70 2024-04-26T20:56:36.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.542+0000 7f1a8b400640 1 --2- 172.21.15.138:0/1620414059 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1a8c073d70 0x7f1a8c15fe70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1a740097c0 tx=0x7f1a7401c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5b100e898a40444 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:36.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.542+0000 7f1a8aa00640 1 -- 172.21.15.138:0/1620414059 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a740b0070 con 0x7f1a8c073d70 2024-04-26T20:56:36.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.542+0000 7f1a8aa00640 1 -- 172.21.15.138:0/1620414059 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a740ab400 con 0x7f1a8c073d70 2024-04-26T20:56:36.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.542+0000 7f1a8aa00640 1 -- 172.21.15.138:0/1620414059 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a84001a00 con 0x7f1a8c073d70 2024-04-26T20:56:36.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.542+0000 7f1a92c00640 1 -- 172.21.15.138:0/1620414059 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1a8c073d70 msgr2=0x7f1a8c15fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:36.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.542+0000 7f1a92c00640 1 --2- 172.21.15.138:0/1620414059 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1a8c073d70 0x7f1a8c15fe70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1a740097c0 tx=0x7f1a7401c330 comp rx=0 tx=0).stop 2024-04-26T20:56:36.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.542+0000 7f1a92c00640 1 -- 172.21.15.138:0/1620414059 shutdown_connections 2024-04-26T20:56:36.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.542+0000 7f1a92c00640 1 --2- 172.21.15.138:0/1620414059 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1a8c073d70 0x7f1a8c15fe70 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:36.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.542+0000 7f1a92c00640 1 --2- 172.21.15.138:0/1620414059 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1a8c15bdc0 0x7f1a8c15f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:36.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.542+0000 7f1a92c00640 1 -- 172.21.15.138:0/1620414059 >> 172.21.15.138:0/1620414059 conn(0x7f1a8c0d0bb0 msgr2=0x7f1a8c0d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:36.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.542+0000 7f1a92c00640 1 -- 172.21.15.138:0/1620414059 shutdown_connections 2024-04-26T20:56:36.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.542+0000 7f1a92c00640 1 -- 172.21.15.138:0/1620414059 wait complete. 2024-04-26T20:56:36.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.546+0000 7f1a92c00640 1 Processor -- start 2024-04-26T20:56:36.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.546+0000 7f1a92c00640 1 -- start start 2024-04-26T20:56:36.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.546+0000 7f1a92c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1a8c06f880 0x7f1a8c15b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:36.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.546+0000 7f1a92c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1a8c073d70 0x7f1a8c15a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:36.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.546+0000 7f1a92c00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a8c15bdc0 0x7f1a8c1f0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:36.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.546+0000 7f1a92c00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f1a8c06e8f0 con 0x7f1a8c15bdc0 2024-04-26T20:56:36.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.546+0000 7f1a92c00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f1a8c06e770 con 0x7f1a8c073d70 2024-04-26T20:56:36.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.546+0000 7f1a92c00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f1a8c06ea70 con 0x7f1a8c06f880 2024-04-26T20:56:36.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.546+0000 7f1a90c00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a8c15bdc0 0x7f1a8c1f0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:36.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.546+0000 7f1a90c00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a8c15bdc0 0x7f1a8c1f0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:53942/0 (socket says 172.21.15.138:53942) 2024-04-26T20:56:36.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.546+0000 7f1a90c00640 1 -- 172.21.15.138:0/1472661023 learned_addr learned my addr 172.21.15.138:0/1472661023 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:36.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.546+0000 7f1a8be00640 1 --2- 172.21.15.138:0/1472661023 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1a8c06f880 0x7f1a8c15b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:36.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.546+0000 7f1a8b400640 1 --2- 172.21.15.138:0/1472661023 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1a8c073d70 0x7f1a8c15a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:36.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.546+0000 7f1a90c00640 1 -- 172.21.15.138:0/1472661023 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1a8c06f880 msgr2=0x7f1a8c15b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:36.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.546+0000 7f1a90c00640 1 --2- 172.21.15.138:0/1472661023 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1a8c06f880 0x7f1a8c15b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:36.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.546+0000 7f1a90c00640 1 -- 172.21.15.138:0/1472661023 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1a8c073d70 msgr2=0x7f1a8c15a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:36.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.546+0000 7f1a90c00640 1 --2- 172.21.15.138:0/1472661023 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1a8c073d70 0x7f1a8c15a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:36.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.546+0000 7f1a90c00640 1 -- 172.21.15.138:0/1472661023 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a8c15aad0 con 0x7f1a8c15bdc0 2024-04-26T20:56:36.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.546+0000 7f1a8b400640 1 --2- 172.21.15.138:0/1472661023 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1a8c073d70 0x7f1a8c15a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:56:36.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.546+0000 7f1a8be00640 1 --2- 172.21.15.138:0/1472661023 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1a8c06f880 0x7f1a8c15b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:56:36.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.546+0000 7f1a90c00640 1 --2- 172.21.15.138:0/1472661023 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a8c15bdc0 0x7f1a8c1f0930 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1a840018a0 tx=0x7f1a8400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:36.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.546+0000 7f1a83e00640 1 -- 172.21.15.138:0/1472661023 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a84012400 con 0x7f1a8c15bdc0 2024-04-26T20:56:36.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.546+0000 7f1a83e00640 1 -- 172.21.15.138:0/1472661023 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a840125c0 con 0x7f1a8c15bdc0 2024-04-26T20:56:36.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.546+0000 7f1a92c00640 1 -- 172.21.15.138:0/1472661023 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a8c0b5250 con 0x7f1a8c15bdc0 2024-04-26T20:56:36.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.546+0000 7f1a83e00640 1 -- 172.21.15.138:0/1472661023 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a840129b0 con 0x7f1a8c15bdc0 2024-04-26T20:56:36.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.546+0000 7f1a92c00640 1 -- 172.21.15.138:0/1472661023 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a8c0b5810 con 0x7f1a8c15bdc0 2024-04-26T20:56:36.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.550+0000 7f1a92c00640 1 -- 172.21.15.138:0/1472661023 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a8c069430 con 0x7f1a8c15bdc0 2024-04-26T20:56:36.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.550+0000 7f1a83e00640 1 -- 172.21.15.138:0/1472661023 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1a84012b50 con 0x7f1a8c15bdc0 2024-04-26T20:56:36.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.550+0000 7f1a83e00640 1 --2- 172.21.15.138:0/1472661023 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1a68068380 0x7f1a6806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:36.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.550+0000 7f1a83e00640 1 -- 172.21.15.138:0/1472661023 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f1a84086ff0 con 0x7f1a8c15bdc0 2024-04-26T20:56:36.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.550+0000 7f1a8be00640 1 --2- 172.21.15.138:0/1472661023 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1a68068380 0x7f1a6806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:36.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.550+0000 7f1a8be00640 1 --2- 172.21.15.138:0/1472661023 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1a68068380 0x7f1a6806a840 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c009b10 tx=0x7f1a7c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:36.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.554+0000 7f1a83e00640 1 -- 172.21.15.138:0/1472661023 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1a840577e0 con 0x7f1a8c15bdc0 2024-04-26T20:56:36.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.710+0000 7f1a92c00640 1 -- 172.21.15.138:0/1472661023 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1a8c069c70 con 0x7f1a8c15bdc0 2024-04-26T20:56:36.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.710+0000 7f1a83e00640 1 -- 172.21.15.138:0/1472661023 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) ==== 93+0+10 (secure 0 0 0) 0x7f1a840570e0 con 0x7f1a8c15bdc0 2024-04-26T20:56:36.714 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 1 2024-04-26T20:56:36.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.714+0000 7f1a92c00640 1 -- 172.21.15.138:0/1472661023 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1a68068380 msgr2=0x7f1a6806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:36.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.714+0000 7f1a92c00640 1 --2- 172.21.15.138:0/1472661023 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1a68068380 0x7f1a6806a840 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c009b10 tx=0x7f1a7c008040 comp rx=0 tx=0).stop 2024-04-26T20:56:36.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.714+0000 7f1a92c00640 1 -- 172.21.15.138:0/1472661023 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a8c15bdc0 msgr2=0x7f1a8c1f0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:36.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.714+0000 7f1a92c00640 1 --2- 172.21.15.138:0/1472661023 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a8c15bdc0 0x7f1a8c1f0930 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1a840018a0 tx=0x7f1a8400a430 comp rx=0 tx=0).stop 2024-04-26T20:56:36.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.714+0000 7f1a92c00640 1 -- 172.21.15.138:0/1472661023 shutdown_connections 2024-04-26T20:56:36.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.714+0000 7f1a92c00640 1 --2- 172.21.15.138:0/1472661023 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1a68068380 0x7f1a6806a840 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:36.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.714+0000 7f1a92c00640 1 --2- 172.21.15.138:0/1472661023 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a8c15bdc0 0x7f1a8c1f0930 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:36.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.714+0000 7f1a92c00640 1 --2- 172.21.15.138:0/1472661023 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1a8c073d70 0x7f1a8c15a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:36.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.714+0000 7f1a92c00640 1 --2- 172.21.15.138:0/1472661023 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1a8c06f880 0x7f1a8c15b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:36.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.714+0000 7f1a92c00640 1 -- 172.21.15.138:0/1472661023 >> 172.21.15.138:0/1472661023 conn(0x7f1a8c0d0bb0 msgr2=0x7f1a8c0d0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:36.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.714+0000 7f1a92c00640 1 -- 172.21.15.138:0/1472661023 shutdown_connections 2024-04-26T20:56:36.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.714+0000 7f1a92c00640 1 -- 172.21.15.138:0/1472661023 wait complete. 2024-04-26T20:56:36.735 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-26T20:56:36.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.866+0000 7fc828e00640 1 Processor -- start 2024-04-26T20:56:36.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.866+0000 7fc828e00640 1 -- start start 2024-04-26T20:56:36.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.870+0000 7fc828e00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc8240cbe00 0x7fc82406de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:36.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.870+0000 7fc828e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc8240cc1e0 0x7fc824073b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:36.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.870+0000 7fc828e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc8240ce6f0 0x7fc8240ceb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:36.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.870+0000 7fc828e00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fc824073680 con 0x7fc8240ce6f0 2024-04-26T20:56:36.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.870+0000 7fc828e00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fc8240727f0 con 0x7fc8240cbe00 2024-04-26T20:56:36.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.870+0000 7fc828e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fc824072a70 con 0x7fc8240cc1e0 2024-04-26T20:56:36.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.870+0000 7fc822800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc8240ce6f0 0x7fc8240ceb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:36.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.870+0000 7fc822800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc8240ce6f0 0x7fc8240ceb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:53952/0 (socket says 172.21.15.138:53952) 2024-04-26T20:56:36.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.870+0000 7fc822800640 1 -- 172.21.15.138:0/3332107960 learned_addr learned my addr 172.21.15.138:0/3332107960 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:36.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.870+0000 7fc821e00640 1 --2- 172.21.15.138:0/3332107960 >> v2:172.21.15.143:3300/0 conn(0x7fc8240cbe00 0x7fc82406de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:36.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.870+0000 7fc819400640 1 --2- 172.21.15.138:0/3332107960 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc8240cc1e0 0x7fc824073b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:36.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.870+0000 7fc822800640 1 -- 172.21.15.138:0/3332107960 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc8240cc1e0 msgr2=0x7fc824073b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:36.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.870+0000 7fc822800640 1 --2- 172.21.15.138:0/3332107960 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc8240cc1e0 0x7fc824073b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:36.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.870+0000 7fc822800640 1 -- 172.21.15.138:0/3332107960 >> v2:172.21.15.143:3300/0 conn(0x7fc8240cbe00 msgr2=0x7fc82406de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:36.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.870+0000 7fc822800640 1 --2- 172.21.15.138:0/3332107960 >> v2:172.21.15.143:3300/0 conn(0x7fc8240cbe00 0x7fc82406de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:36.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.870+0000 7fc822800640 1 -- 172.21.15.138:0/3332107960 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc824072d50 con 0x7fc8240ce6f0 2024-04-26T20:56:36.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.870+0000 7fc821e00640 1 --2- 172.21.15.138:0/3332107960 >> v2:172.21.15.143:3300/0 conn(0x7fc8240cbe00 0x7fc82406de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:56:36.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.870+0000 7fc819400640 1 --2- 172.21.15.138:0/3332107960 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc8240cc1e0 0x7fc824073b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:56:36.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.874+0000 7fc822800640 1 --2- 172.21.15.138:0/3332107960 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8240ce6f0 0x7fc8240ceb80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc824074a70 tx=0x7fc81c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0e8d519485d6f1f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:36.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.874+0000 7fc821400640 1 -- 172.21.15.138:0/3332107960 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc81c0b0070 con 0x7fc8240ce6f0 2024-04-26T20:56:36.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.874+0000 7fc821400640 1 -- 172.21.15.138:0/3332107960 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc81c0ab600 con 0x7fc8240ce6f0 2024-04-26T20:56:36.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.874+0000 7fc821400640 1 -- 172.21.15.138:0/3332107960 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc81c0ab9d0 con 0x7fc8240ce6f0 2024-04-26T20:56:36.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.874+0000 7fc828e00640 1 -- 172.21.15.138:0/3332107960 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8240ce6f0 msgr2=0x7fc8240ceb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:36.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.874+0000 7fc828e00640 1 --2- 172.21.15.138:0/3332107960 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8240ce6f0 0x7fc8240ceb80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc824074a70 tx=0x7fc81c01c520 comp rx=0 tx=0).stop 2024-04-26T20:56:36.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.874+0000 7fc828e00640 1 -- 172.21.15.138:0/3332107960 shutdown_connections 2024-04-26T20:56:36.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.874+0000 7fc828e00640 1 --2- 172.21.15.138:0/3332107960 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8240ce6f0 0x7fc8240ceb80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:36.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.874+0000 7fc828e00640 1 --2- 172.21.15.138:0/3332107960 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc8240cc1e0 0x7fc824073b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:36.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.874+0000 7fc828e00640 1 --2- 172.21.15.138:0/3332107960 >> v2:172.21.15.143:3300/0 conn(0x7fc8240cbe00 0x7fc82406de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:36.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.874+0000 7fc828e00640 1 -- 172.21.15.138:0/3332107960 >> 172.21.15.138:0/3332107960 conn(0x7fc8240d0b20 msgr2=0x7fc8240d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:36.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.874+0000 7fc828e00640 1 -- 172.21.15.138:0/3332107960 shutdown_connections 2024-04-26T20:56:36.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.874+0000 7fc828e00640 1 -- 172.21.15.138:0/3332107960 wait complete. 2024-04-26T20:56:36.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.874+0000 7fc828e00640 1 Processor -- start 2024-04-26T20:56:36.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.874+0000 7fc828e00640 1 -- start start 2024-04-26T20:56:36.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.874+0000 7fc828e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc8240cbe00 0x7fc82414bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:36.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.874+0000 7fc828e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8240cc1e0 0x7fc8240b0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:36.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.874+0000 7fc828e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc8240ce6f0 0x7fc8240b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:36.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.874+0000 7fc828e00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc82406e530 con 0x7fc8240cc1e0 2024-04-26T20:56:36.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.874+0000 7fc828e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fc82406e3b0 con 0x7fc8240ce6f0 2024-04-26T20:56:36.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.874+0000 7fc828e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fc824074050 con 0x7fc8240cbe00 2024-04-26T20:56:36.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.874+0000 7fc819400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8240cc1e0 0x7fc8240b0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:36.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.874+0000 7fc819400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8240cc1e0 0x7fc8240b0a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:53964/0 (socket says 172.21.15.138:53964) 2024-04-26T20:56:36.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.874+0000 7fc819400640 1 -- 172.21.15.138:0/795331435 learned_addr learned my addr 172.21.15.138:0/795331435 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:36.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.878+0000 7fc821e00640 1 --2- 172.21.15.138:0/795331435 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc8240cbe00 0x7fc82414bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:36.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.878+0000 7fc819400640 1 -- 172.21.15.138:0/795331435 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc8240cbe00 msgr2=0x7fc82414bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:36.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.878+0000 7fc822800640 1 --2- 172.21.15.138:0/795331435 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc8240ce6f0 0x7fc8240b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:36.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.878+0000 7fc819400640 1 --2- 172.21.15.138:0/795331435 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc8240cbe00 0x7fc82414bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:36.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.878+0000 7fc819400640 1 -- 172.21.15.138:0/795331435 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc8240ce6f0 msgr2=0x7fc8240b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:36.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.878+0000 7fc819400640 1 --2- 172.21.15.138:0/795331435 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc8240ce6f0 0x7fc8240b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:36.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.878+0000 7fc819400640 1 -- 172.21.15.138:0/795331435 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8240b3a30 con 0x7fc8240cc1e0 2024-04-26T20:56:36.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.878+0000 7fc821e00640 1 --2- 172.21.15.138:0/795331435 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc8240cbe00 0x7fc82414bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:56:36.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.878+0000 7fc822800640 1 --2- 172.21.15.138:0/795331435 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc8240ce6f0 0x7fc8240b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:56:36.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.878+0000 7fc819400640 1 --2- 172.21.15.138:0/795331435 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8240cc1e0 0x7fc8240b0a90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc80c00c7c0 tx=0x7fc80c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:36.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.878+0000 7fc81aa00640 1 -- 172.21.15.138:0/795331435 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc80c007a30 con 0x7fc8240cc1e0 2024-04-26T20:56:36.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.878+0000 7fc81aa00640 1 -- 172.21.15.138:0/795331435 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc80c007bd0 con 0x7fc8240cc1e0 2024-04-26T20:56:36.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.878+0000 7fc828e00640 1 -- 172.21.15.138:0/795331435 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8240b3d10 con 0x7fc8240cc1e0 2024-04-26T20:56:36.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.878+0000 7fc81aa00640 1 -- 172.21.15.138:0/795331435 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc80c0113f0 con 0x7fc8240cc1e0 2024-04-26T20:56:36.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.878+0000 7fc828e00640 1 -- 172.21.15.138:0/795331435 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8240b42d0 con 0x7fc8240cc1e0 2024-04-26T20:56:36.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.878+0000 7fc828e00640 1 -- 172.21.15.138:0/795331435 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc824069510 con 0x7fc8240cc1e0 2024-04-26T20:56:36.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.878+0000 7fc81aa00640 1 -- 172.21.15.138:0/795331435 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc80c011590 con 0x7fc8240cc1e0 2024-04-26T20:56:36.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.878+0000 7fc81aa00640 1 --2- 172.21.15.138:0/795331435 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc8000683b0 0x7fc80006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:36.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.878+0000 7fc81aa00640 1 -- 172.21.15.138:0/795331435 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fc80c0868f0 con 0x7fc8240cc1e0 2024-04-26T20:56:36.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.882+0000 7fc821e00640 1 --2- 172.21.15.138:0/795331435 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc8000683b0 0x7fc80006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:36.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.882+0000 7fc821e00640 1 --2- 172.21.15.138:0/795331435 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc8000683b0 0x7fc80006a870 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc814008fc0 tx=0x7fc814008510 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:36.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:36.882+0000 7fc81aa00640 1 -- 172.21.15.138:0/795331435 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc80c015020 con 0x7fc8240cc1e0 2024-04-26T20:56:37.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.042+0000 7fc828e00640 1 -- 172.21.15.138:0/795331435 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fc82406de10 con 0x7fc8240cc1e0 2024-04-26T20:56:37.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.042+0000 7fc81aa00640 1 -- 172.21.15.138:0/795331435 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) ==== 84+0+65 (secure 0 0 0) 0x7fc80c057160 con 0x7fc8240cc1e0 2024-04-26T20:56:37.046 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:56:37.046 INFO:teuthology.orchestra.run.smithi138.stdout:[ 2024-04-26T20:56:37.046 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-26T20:56:37.046 INFO:teuthology.orchestra.run.smithi138.stdout: "poolnum": 1, 2024-04-26T20:56:37.046 INFO:teuthology.orchestra.run.smithi138.stdout: "poolname": ".mgr" 2024-04-26T20:56:37.046 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-26T20:56:37.046 INFO:teuthology.orchestra.run.smithi138.stdout:] 2024-04-26T20:56:37.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.046+0000 7fc828e00640 1 -- 172.21.15.138:0/795331435 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc8000683b0 msgr2=0x7fc80006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:37.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.046+0000 7fc828e00640 1 --2- 172.21.15.138:0/795331435 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc8000683b0 0x7fc80006a870 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc814008fc0 tx=0x7fc814008510 comp rx=0 tx=0).stop 2024-04-26T20:56:37.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.046+0000 7fc828e00640 1 -- 172.21.15.138:0/795331435 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8240cc1e0 msgr2=0x7fc8240b0a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:37.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.046+0000 7fc828e00640 1 --2- 172.21.15.138:0/795331435 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8240cc1e0 0x7fc8240b0a90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc80c00c7c0 tx=0x7fc80c00cc80 comp rx=0 tx=0).stop 2024-04-26T20:56:37.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.046+0000 7fc828e00640 1 -- 172.21.15.138:0/795331435 shutdown_connections 2024-04-26T20:56:37.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.046+0000 7fc828e00640 1 --2- 172.21.15.138:0/795331435 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc8000683b0 0x7fc80006a870 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:37.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.046+0000 7fc828e00640 1 --2- 172.21.15.138:0/795331435 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc8240ce6f0 0x7fc8240b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:37.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.046+0000 7fc828e00640 1 --2- 172.21.15.138:0/795331435 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8240cc1e0 0x7fc8240b0a90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:37.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.046+0000 7fc828e00640 1 --2- 172.21.15.138:0/795331435 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc8240cbe00 0x7fc82414bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:37.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.046+0000 7fc828e00640 1 -- 172.21.15.138:0/795331435 >> 172.21.15.138:0/795331435 conn(0x7fc8240d0b20 msgr2=0x7fc82406e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:37.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.046+0000 7fc828e00640 1 -- 172.21.15.138:0/795331435 shutdown_connections 2024-04-26T20:56:37.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.046+0000 7fc828e00640 1 -- 172.21.15.138:0/795331435 wait complete. 2024-04-26T20:56:37.067 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-26T20:56:37.067 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-26T20:56:37.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.206+0000 7fdf98400640 1 Processor -- start 2024-04-26T20:56:37.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.206+0000 7fdf98400640 1 -- start start 2024-04-26T20:56:37.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.206+0000 7fdf98400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdf9015f0f0 0x7fdf900b4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:37.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.206+0000 7fdf98400640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fdf900ae990 0x7fdf9006e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:37.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.206+0000 7fdf98400640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf900b4d70 con 0x7fdf9006ec20 2024-04-26T20:56:37.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.206+0000 7fdf98400640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fdf900b5050 con 0x7fdf900ae990 2024-04-26T20:56:37.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.206+0000 7fdf98400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fdf900b5330 con 0x7fdf9015f0f0 2024-04-26T20:56:37.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.206+0000 7fdf95a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdf9015f0f0 0x7fdf900b4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:37.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.206+0000 7fdf95000640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fdf900ae990 0x7fdf9006e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:37.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.206+0000 7fdf95a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdf9015f0f0 0x7fdf900b4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.138:55606/0 (socket says 172.21.15.138:55606) 2024-04-26T20:56:37.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.206+0000 7fdf95a00640 1 -- 172.21.15.138:0/374372314 learned_addr learned my addr 172.21.15.138:0/374372314 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:37.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.206+0000 7fdf96400640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fdf9006ec20 0x7fdf900b5e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.138:59410/0 (socket says 172.21.15.138:59410) 2024-04-26T20:56:37.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.206+0000 7fdf95a00640 1 -- 172.21.15.138:0/374372314 >> v2:172.21.15.143:3300/0 conn(0x7fdf900ae990 msgr2=0x7fdf9006e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:37.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.206+0000 7fdf95a00640 1 --2- 172.21.15.138:0/374372314 >> v2:172.21.15.143:3300/0 conn(0x7fdf900ae990 0x7fdf9006e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:37.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.206+0000 7fdf95a00640 1 -- 172.21.15.138:0/374372314 >> v1:172.21.15.143:6789/0 conn(0x7fdf9006ec20 legacy=0x7fdf900b5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:37.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.206+0000 7fdf95a00640 1 -- 172.21.15.138:0/374372314 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf900b5610 con 0x7fdf9015f0f0 2024-04-26T20:56:37.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.210+0000 7fdf95a00640 1 --2- 172.21.15.138:0/374372314 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdf9015f0f0 0x7fdf900b4400 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fdf840098a0 tx=0x7fdf8401ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ce4014da694c0d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:37.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.210+0000 7fdf8fe00640 1 -- 172.21.15.138:0/374372314 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf840b5070 con 0x7fdf9015f0f0 2024-04-26T20:56:37.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.210+0000 7fdf8fe00640 1 -- 172.21.15.138:0/374372314 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf840a8a30 con 0x7fdf9015f0f0 2024-04-26T20:56:37.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.210+0000 7fdf8fe00640 1 -- 172.21.15.138:0/374372314 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf840a8e00 con 0x7fdf9015f0f0 2024-04-26T20:56:37.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.210+0000 7fdf98400640 1 -- 172.21.15.138:0/374372314 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdf9015f0f0 msgr2=0x7fdf900b4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:37.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.210+0000 7fdf98400640 1 --2- 172.21.15.138:0/374372314 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdf9015f0f0 0x7fdf900b4400 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fdf840098a0 tx=0x7fdf8401ed30 comp rx=0 tx=0).stop 2024-04-26T20:56:37.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.210+0000 7fdf98400640 1 -- 172.21.15.138:0/374372314 shutdown_connections 2024-04-26T20:56:37.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.210+0000 7fdf98400640 1 --2- 172.21.15.138:0/374372314 >> v2:172.21.15.143:3300/0 conn(0x7fdf900ae990 0x7fdf9006e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:37.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.210+0000 7fdf98400640 1 --2- 172.21.15.138:0/374372314 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdf9015f0f0 0x7fdf900b4400 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:37.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.210+0000 7fdf98400640 1 -- 172.21.15.138:0/374372314 >> 172.21.15.138:0/374372314 conn(0x7fdf90072790 msgr2=0x7fdf90072ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:37.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.210+0000 7fdf98400640 1 -- 172.21.15.138:0/374372314 shutdown_connections 2024-04-26T20:56:37.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.210+0000 7fdf98400640 1 -- 172.21.15.138:0/374372314 wait complete. 2024-04-26T20:56:37.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.214+0000 7fdf98400640 1 Processor -- start 2024-04-26T20:56:37.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.214+0000 7fdf98400640 1 -- start start 2024-04-26T20:56:37.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.214+0000 7fdf98400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf9006ec20 0x7fdf901f7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:37.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.214+0000 7fdf98400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdf900ae990 0x7fdf90160cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:37.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.214+0000 7fdf98400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdf9015f0f0 0x7fdf9014a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:37.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.214+0000 7fdf98400640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fdf9015f650 con 0x7fdf9006ec20 2024-04-26T20:56:37.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.214+0000 7fdf98400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fdf9015f4d0 con 0x7fdf9015f0f0 2024-04-26T20:56:37.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.214+0000 7fdf98400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fdf900b4940 con 0x7fdf900ae990 2024-04-26T20:56:37.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.214+0000 7fdf95a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf9006ec20 0x7fdf901f7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:37.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.214+0000 7fdf95a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf9006ec20 0x7fdf901f7f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:53978/0 (socket says 172.21.15.138:53978) 2024-04-26T20:56:37.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.214+0000 7fdf95a00640 1 -- 172.21.15.138:0/301554489 learned_addr learned my addr 172.21.15.138:0/301554489 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:37.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.214+0000 7fdf96400640 1 --2- 172.21.15.138:0/301554489 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdf9015f0f0 0x7fdf9014a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:37.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.214+0000 7fdf95000640 1 --2- 172.21.15.138:0/301554489 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdf900ae990 0x7fdf90160cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:37.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.214+0000 7fdf95a00640 1 -- 172.21.15.138:0/301554489 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdf900ae990 msgr2=0x7fdf90160cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:37.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.214+0000 7fdf95a00640 1 --2- 172.21.15.138:0/301554489 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdf900ae990 0x7fdf90160cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:37.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.214+0000 7fdf95a00640 1 -- 172.21.15.138:0/301554489 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdf9015f0f0 msgr2=0x7fdf9014a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:37.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.214+0000 7fdf95a00640 1 --2- 172.21.15.138:0/301554489 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdf9015f0f0 0x7fdf9014a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:37.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.214+0000 7fdf95a00640 1 -- 172.21.15.138:0/301554489 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf90161700 con 0x7fdf9006ec20 2024-04-26T20:56:37.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.214+0000 7fdf95a00640 1 --2- 172.21.15.138:0/301554489 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf9006ec20 0x7fdf901f7f30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdf840b3040 tx=0x7fdf8401bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:37.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.214+0000 7fdf8d600640 1 -- 172.21.15.138:0/301554489 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf840b5070 con 0x7fdf9006ec20 2024-04-26T20:56:37.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.214+0000 7fdf8d600640 1 -- 172.21.15.138:0/301554489 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf840b0a50 con 0x7fdf9006ec20 2024-04-26T20:56:37.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.214+0000 7fdf98400640 1 -- 172.21.15.138:0/301554489 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf901619e0 con 0x7fdf9006ec20 2024-04-26T20:56:37.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.214+0000 7fdf8d600640 1 -- 172.21.15.138:0/301554489 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf840b0e40 con 0x7fdf9006ec20 2024-04-26T20:56:37.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.214+0000 7fdf98400640 1 -- 172.21.15.138:0/301554489 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf90161fa0 con 0x7fdf9006ec20 2024-04-26T20:56:37.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.218+0000 7fdf98400640 1 -- 172.21.15.138:0/301554489 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf90069510 con 0x7fdf9006ec20 2024-04-26T20:56:37.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.218+0000 7fdf8d600640 1 -- 172.21.15.138:0/301554489 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdf840c2060 con 0x7fdf9006ec20 2024-04-26T20:56:37.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.218+0000 7fdf8d600640 1 --2- 172.21.15.138:0/301554489 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fdf70068380 0x7fdf7006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:37.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.218+0000 7fdf8d600640 1 -- 172.21.15.138:0/301554489 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fdf841235e0 con 0x7fdf9006ec20 2024-04-26T20:56:37.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.218+0000 7fdf95000640 1 --2- 172.21.15.138:0/301554489 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fdf70068380 0x7fdf7006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:37.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.218+0000 7fdf95000640 1 --2- 172.21.15.138:0/301554489 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fdf70068380 0x7fdf7006a840 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdf9014deb0 tx=0x7fdf7c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:37.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.222+0000 7fdf8d600640 1 -- 172.21.15.138:0/301554489 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fdf84018890 con 0x7fdf9006ec20 2024-04-26T20:56:37.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:37.382+0000 7fdf98400640 1 -- 172.21.15.138:0/301554489 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fdf90068590 con 0x7fdf9006ec20 2024-04-26T20:56:37.615 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:56:37.618 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:56:38.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.182+0000 7fdf8d600640 1 -- 172.21.15.138:0/301554489 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) ==== 138+0+0 (secure 0 0 0) 0x7fdf840f3800 con 0x7fdf9006ec20 2024-04-26T20:56:38.187 INFO:teuthology.orchestra.run.smithi138.stderr:pool 'cephfs_metadata' created 2024-04-26T20:56:38.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.186+0000 7fdf98400640 1 -- 172.21.15.138:0/301554489 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fdf70068380 msgr2=0x7fdf7006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:38.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.186+0000 7fdf98400640 1 --2- 172.21.15.138:0/301554489 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fdf70068380 0x7fdf7006a840 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdf9014deb0 tx=0x7fdf7c009190 comp rx=0 tx=0).stop 2024-04-26T20:56:38.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.186+0000 7fdf98400640 1 -- 172.21.15.138:0/301554489 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf9006ec20 msgr2=0x7fdf901f7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:38.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.186+0000 7fdf98400640 1 --2- 172.21.15.138:0/301554489 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf9006ec20 0x7fdf901f7f30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdf840b3040 tx=0x7fdf8401bad0 comp rx=0 tx=0).stop 2024-04-26T20:56:38.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.186+0000 7fdf98400640 1 -- 172.21.15.138:0/301554489 shutdown_connections 2024-04-26T20:56:38.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.186+0000 7fdf98400640 1 --2- 172.21.15.138:0/301554489 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fdf70068380 0x7fdf7006a840 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:38.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.186+0000 7fdf98400640 1 --2- 172.21.15.138:0/301554489 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdf9015f0f0 0x7fdf9014a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:38.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.186+0000 7fdf98400640 1 --2- 172.21.15.138:0/301554489 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdf900ae990 0x7fdf90160cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:38.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.186+0000 7fdf98400640 1 --2- 172.21.15.138:0/301554489 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf9006ec20 0x7fdf901f7f30 secure :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdf840b3040 tx=0x7fdf8401bad0 comp rx=0 tx=0).stop 2024-04-26T20:56:38.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.186+0000 7fdf98400640 1 -- 172.21.15.138:0/301554489 >> 172.21.15.138:0/301554489 conn(0x7fdf90072790 msgr2=0x7fdf9006f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:38.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.190+0000 7fdf98400640 1 -- 172.21.15.138:0/301554489 shutdown_connections 2024-04-26T20:56:38.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.190+0000 7fdf98400640 1 -- 172.21.15.138:0/301554489 wait complete. 2024-04-26T20:56:38.217 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-04-26T20:56:38.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.358+0000 7f8faa400640 1 Processor -- start 2024-04-26T20:56:38.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.358+0000 7f8faa400640 1 -- start start 2024-04-26T20:56:38.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.358+0000 7f8faa400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f8fa415bdc0 0x7f8fa415f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:38.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.358+0000 7f8faa400640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8fa406f880 0x7f8fa40ce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:38.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.358+0000 7f8faa400640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fa406dee0 con 0x7f8fa4073d70 2024-04-26T20:56:38.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.358+0000 7f8faa400640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f8fa415c1a0 con 0x7f8fa415bdc0 2024-04-26T20:56:38.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.358+0000 7f8faa400640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f8fa406e180 con 0x7f8fa406f880 2024-04-26T20:56:38.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.358+0000 7f8fa3400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f8fa415bdc0 0x7f8fa415f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:38.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.358+0000 7f8fa3400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f8fa415bdc0 0x7f8fa415f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:53988/0 (socket says 172.21.15.138:53988) 2024-04-26T20:56:38.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.358+0000 7f8fa3400640 1 -- 172.21.15.138:0/3152679900 learned_addr learned my addr 172.21.15.138:0/3152679900 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:38.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.358+0000 7f8f9aa00640 1 --1- 172.21.15.138:0/3152679900 >> v1:172.21.15.138:6789/0 conn(0x7f8fa4073d70 0x7f8fa415fe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:54650/0 (socket says 172.21.15.138:54650) 2024-04-26T20:56:38.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.358+0000 7f8fa3e00640 1 --2- 172.21.15.138:0/3152679900 >> v2:172.21.15.143:3300/0 conn(0x7f8fa406f880 0x7f8fa40ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:38.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.358+0000 7f8fa3400640 1 -- 172.21.15.138:0/3152679900 >> v2:172.21.15.143:3300/0 conn(0x7f8fa406f880 msgr2=0x7f8fa40ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:38.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.358+0000 7f8fa3400640 1 --2- 172.21.15.138:0/3152679900 >> v2:172.21.15.143:3300/0 conn(0x7f8fa406f880 0x7f8fa40ce780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:38.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.358+0000 7f8fa3400640 1 -- 172.21.15.138:0/3152679900 >> v1:172.21.15.138:6789/0 conn(0x7f8fa4073d70 legacy=0x7f8fa415fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:38.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.358+0000 7f8fa3400640 1 -- 172.21.15.138:0/3152679900 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fa406e460 con 0x7f8fa415bdc0 2024-04-26T20:56:38.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.358+0000 7f8fa2a00640 1 -- 172.21.15.138:0/3152679900 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1602148806 0 0) 0x7f8fa406dee0 con 0x7f8fa4073d70 2024-04-26T20:56:38.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.362+0000 7f8fa3400640 1 --2- 172.21.15.138:0/3152679900 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8fa415bdc0 0x7f8fa415f930 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8fa40b3800 tx=0x7f8f9401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c57ba07b58deaf9c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:38.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.362+0000 7f8fa2a00640 1 -- 172.21.15.138:0/3152679900 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f940b0070 con 0x7f8fa415bdc0 2024-04-26T20:56:38.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.362+0000 7f8fa2a00640 1 -- 172.21.15.138:0/3152679900 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f940ab600 con 0x7f8fa415bdc0 2024-04-26T20:56:38.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.362+0000 7f8fa2a00640 1 -- 172.21.15.138:0/3152679900 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f940ab9d0 con 0x7f8fa415bdc0 2024-04-26T20:56:38.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.362+0000 7f8faa400640 1 -- 172.21.15.138:0/3152679900 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8fa415bdc0 msgr2=0x7f8fa415f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:38.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.362+0000 7f8faa400640 1 --2- 172.21.15.138:0/3152679900 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8fa415bdc0 0x7f8fa415f930 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8fa40b3800 tx=0x7f8f9401c400 comp rx=0 tx=0).stop 2024-04-26T20:56:38.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.362+0000 7f8faa400640 1 -- 172.21.15.138:0/3152679900 shutdown_connections 2024-04-26T20:56:38.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.362+0000 7f8faa400640 1 --2- 172.21.15.138:0/3152679900 >> v2:172.21.15.143:3300/0 conn(0x7f8fa406f880 0x7f8fa40ce780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:38.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.362+0000 7f8faa400640 1 --2- 172.21.15.138:0/3152679900 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8fa415bdc0 0x7f8fa415f930 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:38.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.362+0000 7f8faa400640 1 -- 172.21.15.138:0/3152679900 >> 172.21.15.138:0/3152679900 conn(0x7f8fa40d0bb0 msgr2=0x7f8fa40d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:38.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.362+0000 7f8faa400640 1 -- 172.21.15.138:0/3152679900 shutdown_connections 2024-04-26T20:56:38.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.362+0000 7f8faa400640 1 -- 172.21.15.138:0/3152679900 wait complete. 2024-04-26T20:56:38.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.362+0000 7f8faa400640 1 Processor -- start 2024-04-26T20:56:38.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.362+0000 7f8faa400640 1 -- start start 2024-04-26T20:56:38.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.366+0000 7f8faa400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8fa406f880 0x7f8fa40b3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:38.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.366+0000 7f8faa400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8fa4073d70 0x7f8fa4157f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:38.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.366+0000 7f8faa400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8fa415bdc0 0x7f8fa4158480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:38.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.366+0000 7f8faa400640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa406e770 con 0x7f8fa4073d70 2024-04-26T20:56:38.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.366+0000 7f8faa400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa4160790 con 0x7f8fa406f880 2024-04-26T20:56:38.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.366+0000 7f8faa400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f8fa406e8f0 con 0x7f8fa415bdc0 2024-04-26T20:56:38.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.366+0000 7f8f9aa00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8fa4073d70 0x7f8fa4157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:38.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.366+0000 7f8f9aa00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8fa4073d70 0x7f8fa4157f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:53996/0 (socket says 172.21.15.138:53996) 2024-04-26T20:56:38.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.366+0000 7f8f9aa00640 1 -- 172.21.15.138:0/2279021136 learned_addr learned my addr 172.21.15.138:0/2279021136 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:38.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.366+0000 7f8fa3e00640 1 --2- 172.21.15.138:0/2279021136 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8fa415bdc0 0x7f8fa4158480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:38.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.366+0000 7f8fa3400640 1 --2- 172.21.15.138:0/2279021136 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8fa406f880 0x7f8fa40b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:38.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.366+0000 7f8f9aa00640 1 -- 172.21.15.138:0/2279021136 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8fa415bdc0 msgr2=0x7f8fa4158480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:38.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.366+0000 7f8f9aa00640 1 --2- 172.21.15.138:0/2279021136 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8fa415bdc0 0x7f8fa4158480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:38.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.366+0000 7f8f9aa00640 1 -- 172.21.15.138:0/2279021136 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8fa406f880 msgr2=0x7f8fa40b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:38.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.366+0000 7f8f9aa00640 1 --2- 172.21.15.138:0/2279021136 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8fa406f880 0x7f8fa40b3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:38.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.366+0000 7f8f9aa00640 1 -- 172.21.15.138:0/2279021136 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fa40b4280 con 0x7f8fa4073d70 2024-04-26T20:56:38.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.366+0000 7f8f9aa00640 1 --2- 172.21.15.138:0/2279021136 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8fa4073d70 0x7f8fa4157f40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c00c4e0 tx=0x7f8f8c00c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:38.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.366+0000 7f8f9be00640 1 -- 172.21.15.138:0/2279021136 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c018070 con 0x7f8fa4073d70 2024-04-26T20:56:38.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.366+0000 7f8f9be00640 1 -- 172.21.15.138:0/2279021136 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f8c007500 con 0x7f8fa4073d70 2024-04-26T20:56:38.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.366+0000 7f8faa400640 1 -- 172.21.15.138:0/2279021136 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fa40b4560 con 0x7f8fa4073d70 2024-04-26T20:56:38.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.366+0000 7f8f9be00640 1 -- 172.21.15.138:0/2279021136 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c004a30 con 0x7f8fa4073d70 2024-04-26T20:56:38.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.366+0000 7f8faa400640 1 -- 172.21.15.138:0/2279021136 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fa40b4b20 con 0x7f8fa4073d70 2024-04-26T20:56:38.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.366+0000 7f8faa400640 1 -- 172.21.15.138:0/2279021136 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fa4069430 con 0x7f8fa4073d70 2024-04-26T20:56:38.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.370+0000 7f8f9be00640 1 -- 172.21.15.138:0/2279021136 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8f8c01b070 con 0x7f8fa4073d70 2024-04-26T20:56:38.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.370+0000 7f8f9be00640 1 --2- 172.21.15.138:0/2279021136 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f8f800683b0 0x7f8f8006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:38.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.370+0000 7f8f9be00640 1 -- 172.21.15.138:0/2279021136 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5227+0+0 (secure 0 0 0) 0x7f8f8c085d60 con 0x7f8fa4073d70 2024-04-26T20:56:38.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.370+0000 7f8fa3400640 1 --2- 172.21.15.138:0/2279021136 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f8f800683b0 0x7f8f8006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:38.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.370+0000 7f8fa3400640 1 --2- 172.21.15.138:0/2279021136 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f8f800683b0 0x7f8f8006a870 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8f940ad000 tx=0x7f8f940a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:38.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.374+0000 7f8f9be00640 1 -- 172.21.15.138:0/2279021136 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8f8c055fe0 con 0x7f8fa4073d70 2024-04-26T20:56:38.534 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:38.530+0000 7f8faa400640 1 -- 172.21.15.138:0/2279021136 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f8fa40d19c0 con 0x7f8fa4073d70 2024-04-26T20:56:39.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.186+0000 7f8f9be00640 1 -- 172.21.15.138:0/2279021136 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v21) ==== 171+0+0 (secure 0 0 0) 0x7f8f8c05a2e0 con 0x7f8fa4073d70 2024-04-26T20:56:39.190 INFO:teuthology.orchestra.run.smithi138.stderr:pool 'cephfs_data' created 2024-04-26T20:56:39.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.190+0000 7f8faa400640 1 -- 172.21.15.138:0/2279021136 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f8f800683b0 msgr2=0x7f8f8006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:39.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.190+0000 7f8faa400640 1 --2- 172.21.15.138:0/2279021136 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f8f800683b0 0x7f8f8006a870 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8f940ad000 tx=0x7f8f940a6000 comp rx=0 tx=0).stop 2024-04-26T20:56:39.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.190+0000 7f8faa400640 1 -- 172.21.15.138:0/2279021136 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8fa4073d70 msgr2=0x7f8fa4157f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:39.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.190+0000 7f8faa400640 1 --2- 172.21.15.138:0/2279021136 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8fa4073d70 0x7f8fa4157f40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c00c4e0 tx=0x7f8f8c00c9a0 comp rx=0 tx=0).stop 2024-04-26T20:56:39.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.190+0000 7f8faa400640 1 -- 172.21.15.138:0/2279021136 shutdown_connections 2024-04-26T20:56:39.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.190+0000 7f8faa400640 1 --2- 172.21.15.138:0/2279021136 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f8f800683b0 0x7f8f8006a870 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:39.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.190+0000 7f8faa400640 1 --2- 172.21.15.138:0/2279021136 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8fa415bdc0 0x7f8fa4158480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:39.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.190+0000 7f8faa400640 1 --2- 172.21.15.138:0/2279021136 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8fa4073d70 0x7f8fa4157f40 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:39.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.190+0000 7f8faa400640 1 --2- 172.21.15.138:0/2279021136 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8fa406f880 0x7f8fa40b3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:39.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.190+0000 7f8faa400640 1 -- 172.21.15.138:0/2279021136 >> 172.21.15.138:0/2279021136 conn(0x7f8fa40d0bb0 msgr2=0x7f8fa406ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:39.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.190+0000 7f8faa400640 1 -- 172.21.15.138:0/2279021136 shutdown_connections 2024-04-26T20:56:39.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.190+0000 7f8faa400640 1 -- 172.21.15.138:0/2279021136 wait complete. 2024-04-26T20:56:39.234 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-26T20:56:39.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.370+0000 7f8e23400640 1 Processor -- start 2024-04-26T20:56:39.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.370+0000 7f8e23400640 1 -- start start 2024-04-26T20:56:39.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.370+0000 7f8e23400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f8e1c15e180 0x7f8e1c0cb200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:39.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.370+0000 7f8e23400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8e1c0cb740 0x7f8e1c0b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:39.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.370+0000 7f8e23400640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e1c0cd210 con 0x7f8e1c15aa60 2024-04-26T20:56:39.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.370+0000 7f8e23400640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f8e1c15d6a0 con 0x7f8e1c15e180 2024-04-26T20:56:39.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.370+0000 7f8e23400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f8e1c15d980 con 0x7f8e1c0cb740 2024-04-26T20:56:39.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.370+0000 7f8e13e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f8e1c15e180 0x7f8e1c0cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:39.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.370+0000 7f8e13e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f8e1c15e180 0x7f8e1c0cb200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:54006/0 (socket says 172.21.15.138:54006) 2024-04-26T20:56:39.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.370+0000 7f8e13e00640 1 -- 172.21.15.138:0/141876794 learned_addr learned my addr 172.21.15.138:0/141876794 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:39.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.370+0000 7f8e13e00640 1 -- 172.21.15.138:0/141876794 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8e1c0cb740 msgr2=0x7f8e1c0b5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:39.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.370+0000 7f8e13e00640 1 --2- 172.21.15.138:0/141876794 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8e1c0cb740 0x7f8e1c0b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:39.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.370+0000 7f8e13e00640 1 -- 172.21.15.138:0/141876794 >> v1:172.21.15.143:6789/0 conn(0x7f8e1c15aa60 legacy=0x7f8e1c0cc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:39.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.370+0000 7f8e13e00640 1 -- 172.21.15.138:0/141876794 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e1c15dc60 con 0x7f8e1c15e180 2024-04-26T20:56:39.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.374+0000 7f8e13e00640 1 --2- 172.21.15.138:0/141876794 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8e1c15e180 0x7f8e1c0cb200 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8e04009870 tx=0x7f8e0401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96fe9d20f003b4f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:39.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.374+0000 7f8e1be00640 1 -- 172.21.15.138:0/141876794 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e040b0070 con 0x7f8e1c15e180 2024-04-26T20:56:39.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.374+0000 7f8e1be00640 1 -- 172.21.15.138:0/141876794 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e040ab600 con 0x7f8e1c15e180 2024-04-26T20:56:39.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.374+0000 7f8e1be00640 1 -- 172.21.15.138:0/141876794 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e040ab9d0 con 0x7f8e1c15e180 2024-04-26T20:56:39.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.374+0000 7f8e23400640 1 -- 172.21.15.138:0/141876794 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8e1c15e180 msgr2=0x7f8e1c0cb200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:39.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.374+0000 7f8e23400640 1 --2- 172.21.15.138:0/141876794 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8e1c15e180 0x7f8e1c0cb200 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8e04009870 tx=0x7f8e0401c520 comp rx=0 tx=0).stop 2024-04-26T20:56:39.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.374+0000 7f8e23400640 1 -- 172.21.15.138:0/141876794 shutdown_connections 2024-04-26T20:56:39.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.374+0000 7f8e23400640 1 --2- 172.21.15.138:0/141876794 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8e1c0cb740 0x7f8e1c0b5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:39.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.374+0000 7f8e23400640 1 --2- 172.21.15.138:0/141876794 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8e1c15e180 0x7f8e1c0cb200 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:39.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.374+0000 7f8e23400640 1 -- 172.21.15.138:0/141876794 >> 172.21.15.138:0/141876794 conn(0x7f8e1c0d0bb0 msgr2=0x7f8e1c0d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:39.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.374+0000 7f8e23400640 1 -- 172.21.15.138:0/141876794 shutdown_connections 2024-04-26T20:56:39.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.374+0000 7f8e23400640 1 -- 172.21.15.138:0/141876794 wait complete. 2024-04-26T20:56:39.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.378+0000 7f8e23400640 1 Processor -- start 2024-04-26T20:56:39.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.378+0000 7f8e23400640 1 -- start start 2024-04-26T20:56:39.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.378+0000 7f8e23400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8e1c0cb740 0x7f8e1c14e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:39.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.378+0000 7f8e23400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8e1c15aa60 0x7f8e1c155600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:39.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.378+0000 7f8e23400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8e1c15e180 0x7f8e1c0b1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:39.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.378+0000 7f8e23400640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f8e1c06dee0 con 0x7f8e1c0cb740 2024-04-26T20:56:39.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.378+0000 7f8e23400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f8e1c0cbbb0 con 0x7f8e1c15e180 2024-04-26T20:56:39.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.378+0000 7f8e23400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f8e1c06e060 con 0x7f8e1c15aa60 2024-04-26T20:56:39.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.378+0000 7f8e20a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8e1c0cb740 0x7f8e1c14e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:39.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.378+0000 7f8e20a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8e1c0cb740 0x7f8e1c14e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:54012/0 (socket says 172.21.15.138:54012) 2024-04-26T20:56:39.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.378+0000 7f8e20a00640 1 -- 172.21.15.138:0/4051792767 learned_addr learned my addr 172.21.15.138:0/4051792767 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:39.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.378+0000 7f8e13e00640 1 --2- 172.21.15.138:0/4051792767 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8e1c15aa60 0x7f8e1c155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:39.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.378+0000 7f8e21400640 1 --2- 172.21.15.138:0/4051792767 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8e1c15e180 0x7f8e1c0b1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:39.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.378+0000 7f8e20a00640 1 -- 172.21.15.138:0/4051792767 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8e1c15aa60 msgr2=0x7f8e1c155600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:39.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.378+0000 7f8e20a00640 1 --2- 172.21.15.138:0/4051792767 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8e1c15aa60 0x7f8e1c155600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:39.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.378+0000 7f8e20a00640 1 -- 172.21.15.138:0/4051792767 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8e1c15e180 msgr2=0x7f8e1c0b1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:39.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.378+0000 7f8e20a00640 1 --2- 172.21.15.138:0/4051792767 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8e1c15e180 0x7f8e1c0b1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:39.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.378+0000 7f8e20a00640 1 -- 172.21.15.138:0/4051792767 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e1c1fb8e0 con 0x7f8e1c0cb740 2024-04-26T20:56:39.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.378+0000 7f8e20a00640 1 --2- 172.21.15.138:0/4051792767 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8e1c0cb740 0x7f8e1c14e740 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c00c480 tx=0x7f8e0c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:39.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.378+0000 7f8e19600640 1 -- 172.21.15.138:0/4051792767 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c012830 con 0x7f8e1c0cb740 2024-04-26T20:56:39.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.378+0000 7f8e19600640 1 -- 172.21.15.138:0/4051792767 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e0c017070 con 0x7f8e1c0cb740 2024-04-26T20:56:39.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.378+0000 7f8e19600640 1 -- 172.21.15.138:0/4051792767 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c012c30 con 0x7f8e1c0cb740 2024-04-26T20:56:39.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.378+0000 7f8e23400640 1 -- 172.21.15.138:0/4051792767 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e1c1fbbc0 con 0x7f8e1c0cb740 2024-04-26T20:56:39.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.378+0000 7f8e23400640 1 -- 172.21.15.138:0/4051792767 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e1c1fc180 con 0x7f8e1c0cb740 2024-04-26T20:56:39.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.382+0000 7f8e23400640 1 -- 172.21.15.138:0/4051792767 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e1c069430 con 0x7f8e1c0cb740 2024-04-26T20:56:39.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.382+0000 7f8e19600640 1 -- 172.21.15.138:0/4051792767 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8e0c01c460 con 0x7f8e1c0cb740 2024-04-26T20:56:39.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.382+0000 7f8e19600640 1 --2- 172.21.15.138:0/4051792767 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f8df8068380 0x7f8df806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:39.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.382+0000 7f8e19600640 1 -- 172.21.15.138:0/4051792767 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5609+0+0 (secure 0 0 0) 0x7f8e0c0867d0 con 0x7f8e1c0cb740 2024-04-26T20:56:39.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.382+0000 7f8e13e00640 1 --2- 172.21.15.138:0/4051792767 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f8df8068380 0x7f8df806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:39.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.382+0000 7f8e13e00640 1 --2- 172.21.15.138:0/4051792767 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f8df8068380 0x7f8df806a840 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8e040ad000 tx=0x7f8e040a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:39.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.386+0000 7f8e19600640 1 -- 172.21.15.138:0/4051792767 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8e0c056de0 con 0x7f8e1c0cb740 2024-04-26T20:56:39.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:39.578+0000 7f8e23400640 1 -- 172.21.15.138:0/4051792767 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f8e1c06fbd0 con 0x7f8e1c0cb740 2024-04-26T20:56:40.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.218+0000 7f8e19600640 1 -- 172.21.15.138:0/4051792767 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f8e0c0566e0 con 0x7f8e1c0cb740 2024-04-26T20:56:40.223 INFO:teuthology.orchestra.run.smithi138.stderr:new fs with metadata pool 2 and data pool 3 2024-04-26T20:56:40.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.226+0000 7f8e23400640 1 -- 172.21.15.138:0/4051792767 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f8df8068380 msgr2=0x7f8df806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:40.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.226+0000 7f8e23400640 1 --2- 172.21.15.138:0/4051792767 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f8df8068380 0x7f8df806a840 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8e040ad000 tx=0x7f8e040a6000 comp rx=0 tx=0).stop 2024-04-26T20:56:40.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.226+0000 7f8e23400640 1 -- 172.21.15.138:0/4051792767 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8e1c0cb740 msgr2=0x7f8e1c14e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:40.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.226+0000 7f8e23400640 1 --2- 172.21.15.138:0/4051792767 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8e1c0cb740 0x7f8e1c14e740 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c00c480 tx=0x7f8e0c00c940 comp rx=0 tx=0).stop 2024-04-26T20:56:40.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.226+0000 7f8e23400640 1 -- 172.21.15.138:0/4051792767 shutdown_connections 2024-04-26T20:56:40.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.226+0000 7f8e23400640 1 --2- 172.21.15.138:0/4051792767 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f8df8068380 0x7f8df806a840 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:40.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.226+0000 7f8e23400640 1 --2- 172.21.15.138:0/4051792767 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8e1c15e180 0x7f8e1c0b1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:40.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.226+0000 7f8e23400640 1 --2- 172.21.15.138:0/4051792767 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8e1c15aa60 0x7f8e1c155600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:40.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.226+0000 7f8e23400640 1 --2- 172.21.15.138:0/4051792767 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8e1c0cb740 0x7f8e1c14e740 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c00c480 tx=0x7f8e0c00c940 comp rx=0 tx=0).stop 2024-04-26T20:56:40.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.226+0000 7f8e23400640 1 -- 172.21.15.138:0/4051792767 >> 172.21.15.138:0/4051792767 conn(0x7f8e1c0d0bb0 msgr2=0x7f8e1c153530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:40.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.226+0000 7f8e23400640 1 -- 172.21.15.138:0/4051792767 shutdown_connections 2024-04-26T20:56:40.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.230+0000 7f8e23400640 1 -- 172.21.15.138:0/4051792767 wait complete. 2024-04-26T20:56:40.266 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-04-26T20:56:40.267 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-04-26T20:56:40.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.406+0000 7fe501600640 1 Processor -- start 2024-04-26T20:56:40.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.406+0000 7fe501600640 1 -- start start 2024-04-26T20:56:40.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.406+0000 7fe501600640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe4fc0cc2e0 0x7fe4fc073e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:40.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.406+0000 7fe501600640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4fc06e1a0 con 0x7fe4fc15bc40 2024-04-26T20:56:40.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.406+0000 7fe501600640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4fc06e480 con 0x7fe4fc15c020 2024-04-26T20:56:40.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.406+0000 7fe501600640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fe4fc073380 con 0x7fe4fc0cc2e0 2024-04-26T20:56:40.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.406+0000 7fe4faa00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fe4fc15bc40 0x7fe4fc0cbbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:54664/0 (socket says 172.21.15.138:54664) 2024-04-26T20:56:40.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.406+0000 7fe4faa00640 1 -- 172.21.15.138:0/3888978723 learned_addr learned my addr 172.21.15.138:0/3888978723 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:56:40.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.406+0000 7fe4f3e00640 1 --2- 172.21.15.138:0/3888978723 >> v2:172.21.15.143:3300/0 conn(0x7fe4fc0cc2e0 0x7fe4fc073e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:40.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.406+0000 7fe4fa000640 1 -- 172.21.15.138:0/3888978723 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2497873434 0 0) 0x7fe4fc06e1a0 con 0x7fe4fc15bc40 2024-04-26T20:56:40.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.406+0000 7fe4fa000640 1 -- 172.21.15.138:0/3888978723 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4e0005740 con 0x7fe4fc15bc40 2024-04-26T20:56:40.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.406+0000 7fe4fa000640 1 -- 172.21.15.138:0/3888978723 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1022890581 0 0) 0x7fe4fc06e480 con 0x7fe4fc15c020 2024-04-26T20:56:40.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.406+0000 7fe4fa000640 1 -- 172.21.15.138:0/3888978723 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4fc06e1a0 con 0x7fe4fc15c020 2024-04-26T20:56:40.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.406+0000 7fe4fa000640 1 -- 172.21.15.138:0/3888978723 <== mon.0 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 95600488 0 0) 0x7fe4e0005740 con 0x7fe4fc15bc40 2024-04-26T20:56:40.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.406+0000 7fe4fa000640 1 -- 172.21.15.138:0/3888978723 >> v2:172.21.15.143:3300/0 conn(0x7fe4fc0cc2e0 msgr2=0x7fe4fc073e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:40.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.406+0000 7fe4fa000640 1 --2- 172.21.15.138:0/3888978723 >> v2:172.21.15.143:3300/0 conn(0x7fe4fc0cc2e0 0x7fe4fc073e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:40.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.406+0000 7fe4fa000640 1 -- 172.21.15.138:0/3888978723 >> v1:172.21.15.143:6789/0 conn(0x7fe4fc15c020 legacy=0x7fe4fc0ce720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:40.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.406+0000 7fe4fa000640 1 -- 172.21.15.138:0/3888978723 --> v1:172.21.15.138:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4fc073660 con 0x7fe4fc15bc40 2024-04-26T20:56:40.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.406+0000 7fe4fa000640 1 -- 172.21.15.138:0/3888978723 <== mon.0 v1:172.21.15.138:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2715389689 0 0) 0x7fe4ec001680 con 0x7fe4fc15bc40 2024-04-26T20:56:40.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.406+0000 7fe4fa000640 1 -- 172.21.15.138:0/3888978723 >> v1:172.21.15.138:6789/0 conn(0x7fe4fc15bc40 legacy=0x7fe4fc0cbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:40.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.406+0000 7fe4fa000640 1 --2- 172.21.15.138:0/3888978723 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe4e0005db0 0x7fe4e00061b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:40.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.406+0000 7fe4fa000640 1 --2- 172.21.15.138:0/3888978723 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4e0006a20 0x7fe4e0006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:40.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.406+0000 7fe4fa000640 1 --2- 172.21.15.138:0/3888978723 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4e00073e0 0x7fe4e000dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:40.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.406+0000 7fe4fa000640 1 -- 172.21.15.138:0/3888978723 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe4fc073380 con 0x7fe4e00073e0 2024-04-26T20:56:40.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.406+0000 7fe4fa000640 1 -- 172.21.15.138:0/3888978723 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e000e2b0 con 0x7fe4e0006a20 2024-04-26T20:56:40.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.406+0000 7fe4fa000640 1 -- 172.21.15.138:0/3888978723 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fe4e000e4b0 con 0x7fe4e0005db0 2024-04-26T20:56:40.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.406+0000 7fe4fb400640 1 --2- 172.21.15.138:0/3888978723 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4e00073e0 0x7fe4e000dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:40.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.406+0000 7fe4f3e00640 1 --2- 172.21.15.138:0/3888978723 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4e0006a20 0x7fe4e0006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:40.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.406+0000 7fe4faa00640 1 --2- 172.21.15.138:0/3888978723 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe4e0005db0 0x7fe4e00061b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:40.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.406+0000 7fe4fb400640 1 -- 172.21.15.138:0/3888978723 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe4e0005db0 msgr2=0x7fe4e00061b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:40.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.406+0000 7fe4fb400640 1 --2- 172.21.15.138:0/3888978723 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe4e0005db0 0x7fe4e00061b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:40.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.406+0000 7fe4fb400640 1 -- 172.21.15.138:0/3888978723 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4e0006a20 msgr2=0x7fe4e0006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:40.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.406+0000 7fe4fb400640 1 --2- 172.21.15.138:0/3888978723 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4e0006a20 0x7fe4e0006ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:40.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.406+0000 7fe4fb400640 1 -- 172.21.15.138:0/3888978723 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4e0005740 con 0x7fe4e00073e0 2024-04-26T20:56:40.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.410+0000 7fe4fb400640 1 -- 172.21.15.138:0/3888978723 reap_dead start 2024-04-26T20:56:40.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.410+0000 7fe4fb400640 1 --2- 172.21.15.138:0/3888978723 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4e00073e0 0x7fe4e000dbe0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe4f4001fd0 tx=0x7fe4f401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a82b86bc628a21ae server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:40.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.410+0000 7fe4fa000640 1 -- 172.21.15.138:0/3888978723 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f4001c20 con 0x7fe4e00073e0 2024-04-26T20:56:40.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.410+0000 7fe4fa000640 1 -- 172.21.15.138:0/3888978723 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4f4003b80 con 0x7fe4e00073e0 2024-04-26T20:56:40.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.410+0000 7fe4fa000640 1 -- 172.21.15.138:0/3888978723 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f40050d0 con 0x7fe4e00073e0 2024-04-26T20:56:40.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.410+0000 7fe501600640 1 -- 172.21.15.138:0/3888978723 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4e00073e0 msgr2=0x7fe4e000dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:40.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.410+0000 7fe501600640 1 --2- 172.21.15.138:0/3888978723 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4e00073e0 0x7fe4e000dbe0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe4f4001fd0 tx=0x7fe4f401c900 comp rx=0 tx=0).stop 2024-04-26T20:56:40.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.410+0000 7fe501600640 1 -- 172.21.15.138:0/3888978723 shutdown_connections 2024-04-26T20:56:40.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.410+0000 7fe501600640 1 --2- 172.21.15.138:0/3888978723 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4e00073e0 0x7fe4e000dbe0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:40.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.410+0000 7fe501600640 1 -- 172.21.15.138:0/3888978723 >> 172.21.15.138:0/3888978723 conn(0x7fe4fc0d0b50 msgr2=0x7fe4fc0d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:40.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.410+0000 7fe501600640 1 -- 172.21.15.138:0/3888978723 shutdown_connections 2024-04-26T20:56:40.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.410+0000 7fe501600640 1 -- 172.21.15.138:0/3888978723 wait complete. 2024-04-26T20:56:40.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.414+0000 7fe501600640 1 Processor -- start 2024-04-26T20:56:40.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.414+0000 7fe501600640 1 -- start start 2024-04-26T20:56:40.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.414+0000 7fe501600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4e00073e0 0x7fe4fc1e5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:40.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.414+0000 7fe501600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4fc1e7400 0x7fe4fc157040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:40.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.414+0000 7fe501600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe4fc0ca060 0x7fe4fc1e7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:40.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.414+0000 7fe501600640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe4fc06dfd0 con 0x7fe4e00073e0 2024-04-26T20:56:40.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.414+0000 7fe501600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fe4fc06de50 con 0x7fe4fc1e7400 2024-04-26T20:56:40.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.414+0000 7fe501600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fe4fc0cb1a0 con 0x7fe4fc0ca060 2024-04-26T20:56:40.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.414+0000 7fe4faa00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4e00073e0 0x7fe4fc1e5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:40.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.414+0000 7fe4faa00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4e00073e0 0x7fe4fc1e5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:54022/0 (socket says 172.21.15.138:54022) 2024-04-26T20:56:40.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.414+0000 7fe4faa00640 1 -- 172.21.15.138:0/3630074871 learned_addr learned my addr 172.21.15.138:0/3630074871 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:40.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.414+0000 7fe4f3e00640 1 --2- 172.21.15.138:0/3630074871 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4fc1e7400 0x7fe4fc157040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:40.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.414+0000 7fe4fb400640 1 --2- 172.21.15.138:0/3630074871 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe4fc0ca060 0x7fe4fc1e7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:40.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.414+0000 7fe4faa00640 1 -- 172.21.15.138:0/3630074871 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe4fc0ca060 msgr2=0x7fe4fc1e7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:40.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.414+0000 7fe4faa00640 1 --2- 172.21.15.138:0/3630074871 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe4fc0ca060 0x7fe4fc1e7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:40.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.414+0000 7fe4faa00640 1 -- 172.21.15.138:0/3630074871 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4fc1e7400 msgr2=0x7fe4fc157040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:40.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.414+0000 7fe4faa00640 1 --2- 172.21.15.138:0/3630074871 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4fc1e7400 0x7fe4fc157040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:40.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.414+0000 7fe4faa00640 1 -- 172.21.15.138:0/3630074871 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4fc157580 con 0x7fe4e00073e0 2024-04-26T20:56:40.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.414+0000 7fe4faa00640 1 --2- 172.21.15.138:0/3630074871 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4e00073e0 0x7fe4fc1e5cd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec000c10 tx=0x7fe4ec0128e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:40.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.414+0000 7fe4f2a00640 1 -- 172.21.15.138:0/3630074871 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec01c070 con 0x7fe4e00073e0 2024-04-26T20:56:40.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.414+0000 7fe4f2a00640 1 -- 172.21.15.138:0/3630074871 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4ec014770 con 0x7fe4e00073e0 2024-04-26T20:56:40.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.414+0000 7fe501600640 1 -- 172.21.15.138:0/3630074871 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4fc1e6360 con 0x7fe4e00073e0 2024-04-26T20:56:40.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.414+0000 7fe4f2a00640 1 -- 172.21.15.138:0/3630074871 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec014b60 con 0x7fe4e00073e0 2024-04-26T20:56:40.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.414+0000 7fe501600640 1 -- 172.21.15.138:0/3630074871 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4fc1e6920 con 0x7fe4e00073e0 2024-04-26T20:56:40.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.414+0000 7fe501600640 1 -- 172.21.15.138:0/3630074871 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4fc069510 con 0x7fe4e00073e0 2024-04-26T20:56:40.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.418+0000 7fe4f2a00640 1 -- 172.21.15.138:0/3630074871 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe4ec01f070 con 0x7fe4e00073e0 2024-04-26T20:56:40.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.418+0000 7fe4f2a00640 1 --2- 172.21.15.138:0/3630074871 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe4d8068380 0x7fe4d806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:40.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.418+0000 7fe4f2a00640 1 -- 172.21.15.138:0/3630074871 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe4ec089280 con 0x7fe4e00073e0 2024-04-26T20:56:40.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.418+0000 7fe4f3e00640 1 --2- 172.21.15.138:0/3630074871 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe4d8068380 0x7fe4d806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:40.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.418+0000 7fe4f3e00640 1 --2- 172.21.15.138:0/3630074871 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe4d8068380 0x7fe4d806a840 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc0b6360 tx=0x7fe4e4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:40.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.422+0000 7fe4f2a00640 1 -- 172.21.15.138:0/3630074871 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe4ec059150 con 0x7fe4e00073e0 2024-04-26T20:56:40.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:40.590+0000 7fe501600640 1 -- 172.21.15.138:0/3630074871 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7fe4fc073dc0 con 0x7fe4e00073e0 2024-04-26T20:56:41.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.222+0000 7fe4f2a00640 1 -- 172.21.15.138:0/3630074871 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v23) ==== 157+0+0 (secure 0 0 0) 0x7fe4ec05d450 con 0x7fe4e00073e0 2024-04-26T20:56:41.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.226+0000 7fe501600640 1 -- 172.21.15.138:0/3630074871 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe4d8068380 msgr2=0x7fe4d806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:41.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.226+0000 7fe501600640 1 --2- 172.21.15.138:0/3630074871 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe4d8068380 0x7fe4d806a840 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc0b6360 tx=0x7fe4e4009190 comp rx=0 tx=0).stop 2024-04-26T20:56:41.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.226+0000 7fe501600640 1 -- 172.21.15.138:0/3630074871 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4e00073e0 msgr2=0x7fe4fc1e5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:41.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.226+0000 7fe501600640 1 --2- 172.21.15.138:0/3630074871 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4e00073e0 0x7fe4fc1e5cd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec000c10 tx=0x7fe4ec0128e0 comp rx=0 tx=0).stop 2024-04-26T20:56:41.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.226+0000 7fe501600640 1 -- 172.21.15.138:0/3630074871 shutdown_connections 2024-04-26T20:56:41.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.226+0000 7fe501600640 1 --2- 172.21.15.138:0/3630074871 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe4d8068380 0x7fe4d806a840 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:41.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.226+0000 7fe501600640 1 --2- 172.21.15.138:0/3630074871 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe4fc0ca060 0x7fe4fc1e7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:41.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.226+0000 7fe501600640 1 --2- 172.21.15.138:0/3630074871 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4fc1e7400 0x7fe4fc157040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:41.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.226+0000 7fe501600640 1 --2- 172.21.15.138:0/3630074871 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4e00073e0 0x7fe4fc1e5cd0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:41.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.226+0000 7fe501600640 1 -- 172.21.15.138:0/3630074871 >> 172.21.15.138:0/3630074871 conn(0x7fe4fc0d0b50 msgr2=0x7fe4fc0ced10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:41.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.226+0000 7fe501600640 1 -- 172.21.15.138:0/3630074871 shutdown_connections 2024-04-26T20:56:41.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.226+0000 7fe501600640 1 -- 172.21.15.138:0/3630074871 wait complete. 2024-04-26T20:56:41.252 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-04-26T20:56:41.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.394+0000 7f412c200640 1 Processor -- start 2024-04-26T20:56:41.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.394+0000 7f412c200640 1 -- start start 2024-04-26T20:56:41.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.394+0000 7f412c200640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f41240d3880 0x7f41240d1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:41.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.394+0000 7f412c200640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41240d2250 con 0x7f412415f3b0 2024-04-26T20:56:41.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.394+0000 7f412c200640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41240cd530 con 0x7f41240cfcf0 2024-04-26T20:56:41.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.394+0000 7f412c200640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f41240cdb80 con 0x7f41240d3880 2024-04-26T20:56:41.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.394+0000 7f4129800640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f412415f3b0 0x7f41240cf5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:54676/0 (socket says 172.21.15.138:54676) 2024-04-26T20:56:41.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.394+0000 7f4129800640 1 -- 172.21.15.138:0/352068701 learned_addr learned my addr 172.21.15.138:0/352068701 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:56:41.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.394+0000 7f4123e00640 1 -- 172.21.15.138:0/352068701 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 187752622 0 0) 0x7f41240d2250 con 0x7f412415f3b0 2024-04-26T20:56:41.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.394+0000 7f4123e00640 1 -- 172.21.15.138:0/352068701 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f410c003530 con 0x7f412415f3b0 2024-04-26T20:56:41.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.394+0000 7f412a200640 1 --2- 172.21.15.138:0/352068701 >> v2:172.21.15.143:3300/0 conn(0x7f41240d3880 0x7f41240d1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:41.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.394+0000 7f4123e00640 1 -- 172.21.15.138:0/352068701 <== mon.0 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1216587116 0 0) 0x7f410c003530 con 0x7f412415f3b0 2024-04-26T20:56:41.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.394+0000 7f4123e00640 1 -- 172.21.15.138:0/352068701 >> v2:172.21.15.143:3300/0 conn(0x7f41240d3880 msgr2=0x7f41240d1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:41.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.394+0000 7f4123e00640 1 --2- 172.21.15.138:0/352068701 >> v2:172.21.15.143:3300/0 conn(0x7f41240d3880 0x7f41240d1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:41.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.394+0000 7f4123e00640 1 -- 172.21.15.138:0/352068701 >> v1:172.21.15.143:6789/0 conn(0x7f41240cfcf0 legacy=0x7f41240ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:41.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.394+0000 7f4123e00640 1 -- 172.21.15.138:0/352068701 --> v1:172.21.15.138:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41240cd810 con 0x7f412415f3b0 2024-04-26T20:56:41.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.394+0000 7f4123e00640 1 -- 172.21.15.138:0/352068701 <== mon.0 v1:172.21.15.138:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2715389689 0 0) 0x7f4118001680 con 0x7f412415f3b0 2024-04-26T20:56:41.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.394+0000 7f4123e00640 1 -- 172.21.15.138:0/352068701 >> v1:172.21.15.138:6789/0 conn(0x7f412415f3b0 legacy=0x7f41240cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:41.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.394+0000 7f4123e00640 1 --2- 172.21.15.138:0/352068701 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f410c003a30 0x7f410c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:41.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.394+0000 7f4123e00640 1 --2- 172.21.15.138:0/352068701 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f410c004810 0x7f410c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:41.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.394+0000 7f4123e00640 1 --2- 172.21.15.138:0/352068701 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f410c0051d0 0x7f410c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:41.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.394+0000 7f4123e00640 1 -- 172.21.15.138:0/352068701 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f41240cdb80 con 0x7f410c003a30 2024-04-26T20:56:41.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.394+0000 7f4123e00640 1 -- 172.21.15.138:0/352068701 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f410c00c100 con 0x7f410c004810 2024-04-26T20:56:41.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.394+0000 7f4123e00640 1 -- 172.21.15.138:0/352068701 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f410c00c300 con 0x7f410c0051d0 2024-04-26T20:56:41.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.398+0000 7f4129800640 1 --2- 172.21.15.138:0/352068701 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f410c003a30 0x7f410c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:41.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.398+0000 7f4128e00640 1 --2- 172.21.15.138:0/352068701 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f410c004810 0x7f410c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:41.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.398+0000 7f412a200640 1 --2- 172.21.15.138:0/352068701 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f410c0051d0 0x7f410c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:41.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.398+0000 7f4129800640 1 -- 172.21.15.138:0/352068701 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f410c0051d0 msgr2=0x7f410c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:41.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.398+0000 7f4129800640 1 --2- 172.21.15.138:0/352068701 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f410c0051d0 0x7f410c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:41.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.398+0000 7f4129800640 1 -- 172.21.15.138:0/352068701 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f410c004810 msgr2=0x7f410c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:41.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.398+0000 7f4129800640 1 --2- 172.21.15.138:0/352068701 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f410c004810 0x7f410c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:41.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.398+0000 7f4129800640 1 -- 172.21.15.138:0/352068701 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f410c003530 con 0x7f410c003a30 2024-04-26T20:56:41.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.398+0000 7f412a200640 1 -- 172.21.15.138:0/352068701 reap_dead start 2024-04-26T20:56:41.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.398+0000 7f4129800640 1 --2- 172.21.15.138:0/352068701 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f410c003a30 0x7f410c003e50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f411800c210 tx=0x7f411801cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2c18171d12fd791 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:41.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.398+0000 7f4123e00640 1 -- 172.21.15.138:0/352068701 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4118007d40 con 0x7f410c003a30 2024-04-26T20:56:41.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.398+0000 7f4123e00640 1 -- 172.21.15.138:0/352068701 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41180a9070 con 0x7f410c003a30 2024-04-26T20:56:41.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.398+0000 7f4123e00640 1 -- 172.21.15.138:0/352068701 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41180a5da0 con 0x7f410c003a30 2024-04-26T20:56:41.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.402+0000 7f412c200640 1 -- 172.21.15.138:0/352068701 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f410c003a30 msgr2=0x7f410c003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:41.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.402+0000 7f412c200640 1 --2- 172.21.15.138:0/352068701 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f410c003a30 0x7f410c003e50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f411800c210 tx=0x7f411801cc20 comp rx=0 tx=0).stop 2024-04-26T20:56:41.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.402+0000 7f412c200640 1 -- 172.21.15.138:0/352068701 shutdown_connections 2024-04-26T20:56:41.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.402+0000 7f412c200640 1 --2- 172.21.15.138:0/352068701 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f410c003a30 0x7f410c003e50 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:41.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.402+0000 7f412c200640 1 -- 172.21.15.138:0/352068701 >> 172.21.15.138:0/352068701 conn(0x7f41240d2d60 msgr2=0x7f41240d3170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:41.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.402+0000 7f412c200640 1 -- 172.21.15.138:0/352068701 shutdown_connections 2024-04-26T20:56:41.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.402+0000 7f412c200640 1 -- 172.21.15.138:0/352068701 wait complete. 2024-04-26T20:56:41.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.402+0000 7f412c200640 1 Processor -- start 2024-04-26T20:56:41.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.402+0000 7f412c200640 1 -- start start 2024-04-26T20:56:41.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.402+0000 7f412c200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f410c003a30 0x7f41240b74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:41.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.402+0000 7f412c200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f412415f9a0 0x7f412415fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:41.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.402+0000 7f412c200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4124150cd0 0x7f4124151130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:41.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.402+0000 7f412c200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f412406e940 con 0x7f412415f9a0 2024-04-26T20:56:41.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.402+0000 7f412c200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f412406e7c0 con 0x7f410c003a30 2024-04-26T20:56:41.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.402+0000 7f412c200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f412406dec0 con 0x7f4124150cd0 2024-04-26T20:56:41.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.402+0000 7f4128e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f412415f9a0 0x7f412415fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:41.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.402+0000 7f4128e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f412415f9a0 0x7f412415fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:54048/0 (socket says 172.21.15.138:54048) 2024-04-26T20:56:41.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.402+0000 7f4128e00640 1 -- 172.21.15.138:0/973763398 learned_addr learned my addr 172.21.15.138:0/973763398 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:41.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.402+0000 7f4129800640 1 --2- 172.21.15.138:0/973763398 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f410c003a30 0x7f41240b74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:41.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.402+0000 7f412a200640 1 --2- 172.21.15.138:0/973763398 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4124150cd0 0x7f4124151130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:41.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.402+0000 7f4128e00640 1 -- 172.21.15.138:0/973763398 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4124150cd0 msgr2=0x7f4124151130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:41.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.402+0000 7f4128e00640 1 --2- 172.21.15.138:0/973763398 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4124150cd0 0x7f4124151130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:41.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.402+0000 7f4128e00640 1 -- 172.21.15.138:0/973763398 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f410c003a30 msgr2=0x7f41240b74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:41.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.402+0000 7f4128e00640 1 --2- 172.21.15.138:0/973763398 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f410c003a30 0x7f41240b74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:41.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.402+0000 7f4128e00640 1 -- 172.21.15.138:0/973763398 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4124160660 con 0x7f412415f9a0 2024-04-26T20:56:41.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.402+0000 7f4128e00640 1 --2- 172.21.15.138:0/973763398 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f412415f9a0 0x7f412415fe20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f411000e4b0 tx=0x7f411000e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:41.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.406+0000 7f4121600640 1 -- 172.21.15.138:0/973763398 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41100052e0 con 0x7f412415f9a0 2024-04-26T20:56:41.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.406+0000 7f4121600640 1 -- 172.21.15.138:0/973763398 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4110018070 con 0x7f412415f9a0 2024-04-26T20:56:41.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.406+0000 7f4121600640 1 -- 172.21.15.138:0/973763398 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4110005480 con 0x7f412415f9a0 2024-04-26T20:56:41.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.406+0000 7f412c200640 1 -- 172.21.15.138:0/973763398 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4124160940 con 0x7f412415f9a0 2024-04-26T20:56:41.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.406+0000 7f412c200640 1 -- 172.21.15.138:0/973763398 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41240c6c10 con 0x7f412415f9a0 2024-04-26T20:56:41.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.406+0000 7f412c200640 1 -- 172.21.15.138:0/973763398 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4124069430 con 0x7f412415f9a0 2024-04-26T20:56:41.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.406+0000 7f4121600640 1 -- 172.21.15.138:0/973763398 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4110003840 con 0x7f412415f9a0 2024-04-26T20:56:41.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.406+0000 7f4121600640 1 --2- 172.21.15.138:0/973763398 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f41040683b0 0x7f410406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:41.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.406+0000 7f4121600640 1 -- 172.21.15.138:0/973763398 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6007+0+0 (secure 0 0 0) 0x7f4110086620 con 0x7f412415f9a0 2024-04-26T20:56:41.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.406+0000 7f4129800640 1 --2- 172.21.15.138:0/973763398 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f41040683b0 0x7f410406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:41.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.410+0000 7f4129800640 1 --2- 172.21.15.138:0/973763398 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f41040683b0 0x7f410406a870 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f41180ab000 tx=0x7f41180a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:41.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.410+0000 7f4121600640 1 -- 172.21.15.138:0/973763398 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4110056440 con 0x7f412415f9a0 2024-04-26T20:56:41.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:41.574+0000 7f412c200640 1 -- 172.21.15.138:0/973763398 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f412406eb50 con 0x7f412415f9a0 2024-04-26T20:56:43.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.226+0000 7f4121600640 1 -- 172.21.15.138:0/973763398 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v25) ==== 228+0+0 (secure 0 0 0) 0x7f4110084e20 con 0x7f412415f9a0 2024-04-26T20:56:43.230 INFO:teuthology.orchestra.run.smithi138.stderr:pool 'cephfs_data_ec' created 2024-04-26T20:56:43.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.230+0000 7f412c200640 1 -- 172.21.15.138:0/973763398 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f41040683b0 msgr2=0x7f410406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:43.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.230+0000 7f412c200640 1 --2- 172.21.15.138:0/973763398 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f41040683b0 0x7f410406a870 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f41180ab000 tx=0x7f41180a7070 comp rx=0 tx=0).stop 2024-04-26T20:56:43.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.230+0000 7f412c200640 1 -- 172.21.15.138:0/973763398 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f412415f9a0 msgr2=0x7f412415fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:43.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.230+0000 7f412c200640 1 --2- 172.21.15.138:0/973763398 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f412415f9a0 0x7f412415fe20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f411000e4b0 tx=0x7f411000e970 comp rx=0 tx=0).stop 2024-04-26T20:56:43.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.234+0000 7f412c200640 1 -- 172.21.15.138:0/973763398 shutdown_connections 2024-04-26T20:56:43.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.234+0000 7f412c200640 1 --2- 172.21.15.138:0/973763398 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f41040683b0 0x7f410406a870 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:43.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.234+0000 7f412c200640 1 --2- 172.21.15.138:0/973763398 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4124150cd0 0x7f4124151130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:43.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.234+0000 7f412c200640 1 --2- 172.21.15.138:0/973763398 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f412415f9a0 0x7f412415fe20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:43.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.234+0000 7f412c200640 1 --2- 172.21.15.138:0/973763398 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f410c003a30 0x7f41240b74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:43.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.234+0000 7f412c200640 1 -- 172.21.15.138:0/973763398 >> 172.21.15.138:0/973763398 conn(0x7f41240d2d60 msgr2=0x7f41240711d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:43.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.234+0000 7f412c200640 1 -- 172.21.15.138:0/973763398 shutdown_connections 2024-04-26T20:56:43.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.234+0000 7f412c200640 1 -- 172.21.15.138:0/973763398 wait complete. 2024-04-26T20:56:43.267 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-04-26T20:56:43.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.406+0000 7f323b400640 1 Processor -- start 2024-04-26T20:56:43.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.406+0000 7f323b400640 1 -- start start 2024-04-26T20:56:43.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.406+0000 7f323b400640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f32340ae990 0x7f323406e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:43.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.406+0000 7f323b400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f323406ec20 0x7f32340b5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:43.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.406+0000 7f323b400640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32340b4d70 con 0x7f323415f0f0 2024-04-26T20:56:43.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.406+0000 7f323b400640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f32340b4b10 con 0x7f323406ec20 2024-04-26T20:56:43.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.406+0000 7f323b400640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f32340b5050 con 0x7f32340ae990 2024-04-26T20:56:43.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.410+0000 7f3238a00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f323415f0f0 0x7f32340b4400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:54688/0 (socket says 172.21.15.138:54688) 2024-04-26T20:56:43.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.410+0000 7f3238a00640 1 -- 172.21.15.138:0/807571535 learned_addr learned my addr 172.21.15.138:0/807571535 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:56:43.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.410+0000 7f3239400640 1 --2- 172.21.15.138:0/807571535 >> v2:172.21.15.138:3300/0 conn(0x7f323406ec20 0x7f32340b5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:43.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.410+0000 7f322be00640 1 --2- 172.21.15.138:0/807571535 >> v2:172.21.15.143:3300/0 conn(0x7f32340ae990 0x7f323406e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:43.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.410+0000 7f3239400640 1 -- 172.21.15.138:0/807571535 >> v2:172.21.15.143:3300/0 conn(0x7f32340ae990 msgr2=0x7f323406e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:43.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.410+0000 7f3239400640 1 --2- 172.21.15.138:0/807571535 >> v2:172.21.15.143:3300/0 conn(0x7f32340ae990 0x7f323406e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:43.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.410+0000 7f3239400640 1 -- 172.21.15.138:0/807571535 >> v1:172.21.15.138:6789/0 conn(0x7f323415f0f0 legacy=0x7f32340b4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:43.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.410+0000 7f3239400640 1 -- 172.21.15.138:0/807571535 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32340b5330 con 0x7f323406ec20 2024-04-26T20:56:43.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.410+0000 7f322be00640 1 --2- 172.21.15.138:0/807571535 >> v2:172.21.15.143:3300/0 conn(0x7f32340ae990 0x7f323406e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:56:43.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.410+0000 7f3239400640 1 --2- 172.21.15.138:0/807571535 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f323406ec20 0x7f32340b5e10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3234068560 tx=0x7f322c01f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=506b2b751638c7e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:43.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.410+0000 7f3233e00640 1 -- 172.21.15.138:0/807571535 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f322c0b4070 con 0x7f323406ec20 2024-04-26T20:56:43.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.410+0000 7f3233e00640 1 -- 172.21.15.138:0/807571535 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f322c0af600 con 0x7f323406ec20 2024-04-26T20:56:43.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.410+0000 7f3233e00640 1 -- 172.21.15.138:0/807571535 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f322c0af9d0 con 0x7f323406ec20 2024-04-26T20:56:43.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.414+0000 7f323b400640 1 -- 172.21.15.138:0/807571535 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f323406ec20 msgr2=0x7f32340b5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:43.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.414+0000 7f323b400640 1 --2- 172.21.15.138:0/807571535 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f323406ec20 0x7f32340b5e10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3234068560 tx=0x7f322c01f110 comp rx=0 tx=0).stop 2024-04-26T20:56:43.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.414+0000 7f323b400640 1 -- 172.21.15.138:0/807571535 shutdown_connections 2024-04-26T20:56:43.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.414+0000 7f323b400640 1 --2- 172.21.15.138:0/807571535 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f323406ec20 0x7f32340b5e10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:43.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.414+0000 7f323b400640 1 --2- 172.21.15.138:0/807571535 >> v2:172.21.15.143:3300/0 conn(0x7f32340ae990 0x7f323406e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:43.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.414+0000 7f323b400640 1 -- 172.21.15.138:0/807571535 >> 172.21.15.138:0/807571535 conn(0x7f3234072790 msgr2=0x7f3234072ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:43.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.414+0000 7f323b400640 1 -- 172.21.15.138:0/807571535 shutdown_connections 2024-04-26T20:56:43.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.414+0000 7f323b400640 1 -- 172.21.15.138:0/807571535 wait complete. 2024-04-26T20:56:43.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.414+0000 7f323b400640 1 Processor -- start 2024-04-26T20:56:43.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.414+0000 7f323b400640 1 -- start start 2024-04-26T20:56:43.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.414+0000 7f323b400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f323406ec20 0x7f32341586e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:43.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.414+0000 7f323b400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f32340ae990 0x7f3234156600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:43.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.414+0000 7f323b400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f323415f0f0 0x7f32341619a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:43.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.414+0000 7f323b400640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f323415f4d0 con 0x7f323406ec20 2024-04-26T20:56:43.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.414+0000 7f323b400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f32340b58f0 con 0x7f323415f0f0 2024-04-26T20:56:43.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.414+0000 7f323b400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f323415f650 con 0x7f32340ae990 2024-04-26T20:56:43.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.414+0000 7f3238a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f323406ec20 0x7f32341586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:43.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.414+0000 7f3238a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f323406ec20 0x7f32341586e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:54074/0 (socket says 172.21.15.138:54074) 2024-04-26T20:56:43.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.414+0000 7f3238a00640 1 -- 172.21.15.138:0/1358061341 learned_addr learned my addr 172.21.15.138:0/1358061341 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:43.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.414+0000 7f3239400640 1 --2- 172.21.15.138:0/1358061341 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f323415f0f0 0x7f32341619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:43.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.414+0000 7f3238a00640 1 -- 172.21.15.138:0/1358061341 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f32340ae990 msgr2=0x7f3234156600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:43.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.414+0000 7f322be00640 1 --2- 172.21.15.138:0/1358061341 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f32340ae990 0x7f3234156600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:43.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.414+0000 7f3238a00640 1 --2- 172.21.15.138:0/1358061341 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f32340ae990 0x7f3234156600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:43.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.414+0000 7f3238a00640 1 -- 172.21.15.138:0/1358061341 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f323415f0f0 msgr2=0x7f32341619a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:43.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.414+0000 7f3238a00640 1 --2- 172.21.15.138:0/1358061341 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f323415f0f0 0x7f32341619a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:43.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.414+0000 7f3238a00640 1 -- 172.21.15.138:0/1358061341 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3234156d70 con 0x7f323406ec20 2024-04-26T20:56:43.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.414+0000 7f3239400640 1 --2- 172.21.15.138:0/1358061341 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f323415f0f0 0x7f32341619a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:56:43.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.414+0000 7f322be00640 1 --2- 172.21.15.138:0/1358061341 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f32340ae990 0x7f3234156600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:56:43.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.418+0000 7f3238a00640 1 --2- 172.21.15.138:0/1358061341 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f323406ec20 0x7f32341586e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f322400c450 tx=0x7f322400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:43.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.418+0000 7f3231600640 1 -- 172.21.15.138:0/1358061341 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3224017070 con 0x7f323406ec20 2024-04-26T20:56:43.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.418+0000 7f3231600640 1 -- 172.21.15.138:0/1358061341 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3224005cf0 con 0x7f323406ec20 2024-04-26T20:56:43.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.418+0000 7f3231600640 1 -- 172.21.15.138:0/1358061341 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3224007290 con 0x7f323406ec20 2024-04-26T20:56:43.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.418+0000 7f323b400640 1 -- 172.21.15.138:0/1358061341 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3234157050 con 0x7f323406ec20 2024-04-26T20:56:43.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.418+0000 7f323b400640 1 -- 172.21.15.138:0/1358061341 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3234157610 con 0x7f323406ec20 2024-04-26T20:56:43.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.418+0000 7f323b400640 1 -- 172.21.15.138:0/1358061341 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3234069510 con 0x7f323406ec20 2024-04-26T20:56:43.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.418+0000 7f3231600640 1 -- 172.21.15.138:0/1358061341 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f322401a070 con 0x7f323406ec20 2024-04-26T20:56:43.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.418+0000 7f3231600640 1 --2- 172.21.15.138:0/1358061341 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f3210068380 0x7f321006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:43.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.418+0000 7f3231600640 1 -- 172.21.15.138:0/1358061341 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6500+0+0 (secure 0 0 0) 0x7f3224085ff0 con 0x7f323406ec20 2024-04-26T20:56:43.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.418+0000 7f322be00640 1 --2- 172.21.15.138:0/1358061341 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f3210068380 0x7f321006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:43.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.422+0000 7f322be00640 1 --2- 172.21.15.138:0/1358061341 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f3210068380 0x7f321006a840 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f323406e980 tx=0x7f321c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:43.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.422+0000 7f3231600640 1 -- 172.21.15.138:0/1358061341 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3224056280 con 0x7f323406ec20 2024-04-26T20:56:43.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:43.578+0000 7f323b400640 1 -- 172.21.15.138:0/1358061341 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f3234155560 con 0x7f323406ec20 2024-04-26T20:56:43.765 INFO:tasks.ceph.mds.b.smithi143.stderr:2024-04-26T20:56:43.759+0000 7f4d01600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T20:56:44.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.230+0000 7f3231600640 1 -- 172.21.15.138:0/1358061341 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v26) ==== 169+0+0 (secure 0 0 0) 0x7f3224055b80 con 0x7f323406ec20 2024-04-26T20:56:44.232 INFO:teuthology.orchestra.run.smithi138.stderr:set pool 4 allow_ec_overwrites to true 2024-04-26T20:56:44.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.230+0000 7f323b400640 1 -- 172.21.15.138:0/1358061341 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f3210068380 msgr2=0x7f321006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:44.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.230+0000 7f323b400640 1 --2- 172.21.15.138:0/1358061341 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f3210068380 0x7f321006a840 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f323406e980 tx=0x7f321c008040 comp rx=0 tx=0).stop 2024-04-26T20:56:44.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.230+0000 7f323b400640 1 -- 172.21.15.138:0/1358061341 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f323406ec20 msgr2=0x7f32341586e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:44.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.230+0000 7f323b400640 1 --2- 172.21.15.138:0/1358061341 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f323406ec20 0x7f32341586e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f322400c450 tx=0x7f322400c910 comp rx=0 tx=0).stop 2024-04-26T20:56:44.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.234+0000 7f323b400640 1 -- 172.21.15.138:0/1358061341 shutdown_connections 2024-04-26T20:56:44.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.234+0000 7f323b400640 1 --2- 172.21.15.138:0/1358061341 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f3210068380 0x7f321006a840 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:44.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.234+0000 7f323b400640 1 --2- 172.21.15.138:0/1358061341 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f323415f0f0 0x7f32341619a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:44.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.234+0000 7f323b400640 1 --2- 172.21.15.138:0/1358061341 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f32340ae990 0x7f3234156600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:44.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.234+0000 7f323b400640 1 --2- 172.21.15.138:0/1358061341 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f323406ec20 0x7f32341586e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:44.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.234+0000 7f323b400640 1 -- 172.21.15.138:0/1358061341 >> 172.21.15.138:0/1358061341 conn(0x7f3234072790 msgr2=0x7f3234070bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:44.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.234+0000 7f323b400640 1 -- 172.21.15.138:0/1358061341 shutdown_connections 2024-04-26T20:56:44.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.234+0000 7f323b400640 1 -- 172.21.15.138:0/1358061341 wait complete. 2024-04-26T20:56:44.285 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-04-26T20:56:44.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.418+0000 7f831a400640 1 Processor -- start 2024-04-26T20:56:44.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.418+0000 7f831a400640 1 -- start start 2024-04-26T20:56:44.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.422+0000 7f831a400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f831415aa60 0x7f83140cc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:44.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.422+0000 7f831a400640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f83140cb910 0x7f83140b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:44.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.422+0000 7f831a400640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83140cd210 con 0x7f83140ccd20 2024-04-26T20:56:44.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.422+0000 7f831a400640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f831415d6a0 con 0x7f83140cb910 2024-04-26T20:56:44.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.422+0000 7f831a400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f831415d980 con 0x7f831415aa60 2024-04-26T20:56:44.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.422+0000 7f8313e00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f83140cb910 0x7f83140b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:44.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.422+0000 7f8313400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f831415aa60 0x7f83140cc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:44.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.422+0000 7f8313e00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f83140cb910 0x7f83140b5aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.138:52692/0 (socket says 172.21.15.138:52692) 2024-04-26T20:56:44.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.422+0000 7f8313e00640 1 -- 172.21.15.138:0/4197603990 learned_addr learned my addr 172.21.15.138:0/4197603990 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:44.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.422+0000 7f8313e00640 1 -- 172.21.15.138:0/4197603990 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f831415aa60 msgr2=0x7f83140cc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:44.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.422+0000 7f8313e00640 1 --2- 172.21.15.138:0/4197603990 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f831415aa60 0x7f83140cc7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:44.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.422+0000 7f8313e00640 1 -- 172.21.15.138:0/4197603990 >> v1:172.21.15.143:6789/0 conn(0x7f83140ccd20 legacy=0x7f83140cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:44.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.422+0000 7f8313e00640 1 -- 172.21.15.138:0/4197603990 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f831415dc60 con 0x7f83140cb910 2024-04-26T20:56:44.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.422+0000 7f8313e00640 1 --2- 172.21.15.138:0/4197603990 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f83140cb910 0x7f83140b5aa0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f830c009e50 tx=0x7f830c01ca30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51bd7240123b20f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:44.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.426+0000 7f8312a00640 1 -- 172.21.15.138:0/4197603990 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f830c0a5700 con 0x7f83140cb910 2024-04-26T20:56:44.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.426+0000 7f8312a00640 1 -- 172.21.15.138:0/4197603990 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f830c0a58a0 con 0x7f83140cb910 2024-04-26T20:56:44.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.426+0000 7f8312a00640 1 -- 172.21.15.138:0/4197603990 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f830c0a5c70 con 0x7f83140cb910 2024-04-26T20:56:44.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.426+0000 7f831a400640 1 -- 172.21.15.138:0/4197603990 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f83140cb910 msgr2=0x7f83140b5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:44.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.426+0000 7f831a400640 1 --2- 172.21.15.138:0/4197603990 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f83140cb910 0x7f83140b5aa0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f830c009e50 tx=0x7f830c01ca30 comp rx=0 tx=0).stop 2024-04-26T20:56:44.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.426+0000 7f831a400640 1 -- 172.21.15.138:0/4197603990 shutdown_connections 2024-04-26T20:56:44.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.426+0000 7f831a400640 1 --2- 172.21.15.138:0/4197603990 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f83140cb910 0x7f83140b5aa0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:44.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.426+0000 7f831a400640 1 --2- 172.21.15.138:0/4197603990 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f831415aa60 0x7f83140cc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:44.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.426+0000 7f831a400640 1 -- 172.21.15.138:0/4197603990 >> 172.21.15.138:0/4197603990 conn(0x7f83140d0bb0 msgr2=0x7f83140d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:44.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.426+0000 7f831a400640 1 -- 172.21.15.138:0/4197603990 shutdown_connections 2024-04-26T20:56:44.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.426+0000 7f831a400640 1 -- 172.21.15.138:0/4197603990 wait complete. 2024-04-26T20:56:44.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.426+0000 7f831a400640 1 Processor -- start 2024-04-26T20:56:44.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.426+0000 7f831a400640 1 -- start start 2024-04-26T20:56:44.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.426+0000 7f831a400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f83140cb910 0x7f831414ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:44.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.426+0000 7f831a400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f83140ccd20 0x7f83140ce780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:44.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.426+0000 7f831a400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f831415aa60 0x7f83141539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:44.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.426+0000 7f831a400640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f831406e0f0 con 0x7f831415aa60 2024-04-26T20:56:44.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.426+0000 7f831a400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f8314072240 con 0x7f83140ccd20 2024-04-26T20:56:44.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.426+0000 7f831a400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f831406e270 con 0x7f83140cb910 2024-04-26T20:56:44.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.426+0000 7f8313e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f831415aa60 0x7f83141539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:44.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.430+0000 7f8313400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f83140cb910 0x7f831414ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:44.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.430+0000 7f8313e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f831415aa60 0x7f83141539a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:55206/0 (socket says 172.21.15.138:55206) 2024-04-26T20:56:44.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.430+0000 7f8313e00640 1 -- 172.21.15.138:0/1097557920 learned_addr learned my addr 172.21.15.138:0/1097557920 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:44.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.430+0000 7f830aa00640 1 --2- 172.21.15.138:0/1097557920 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f83140ccd20 0x7f83140ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:44.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.430+0000 7f8313e00640 1 -- 172.21.15.138:0/1097557920 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f83140cb910 msgr2=0x7f831414ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:44.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.430+0000 7f8313e00640 1 --2- 172.21.15.138:0/1097557920 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f83140cb910 0x7f831414ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:44.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.430+0000 7f8313e00640 1 -- 172.21.15.138:0/1097557920 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f83140ccd20 msgr2=0x7f83140ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:44.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.430+0000 7f8313e00640 1 --2- 172.21.15.138:0/1097557920 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f83140ccd20 0x7f83140ce780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:44.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.430+0000 7f8313e00640 1 -- 172.21.15.138:0/1097557920 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83140cf0f0 con 0x7f831415aa60 2024-04-26T20:56:44.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.430+0000 7f8313400640 1 --2- 172.21.15.138:0/1097557920 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f83140cb910 0x7f831414ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:56:44.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.430+0000 7f8313e00640 1 --2- 172.21.15.138:0/1097557920 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f831415aa60 0x7f83141539a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f830c01a660 tx=0x7f830c0197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:44.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.430+0000 7f830be00640 1 -- 172.21.15.138:0/1097557920 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f830c009510 con 0x7f831415aa60 2024-04-26T20:56:44.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.430+0000 7f830be00640 1 -- 172.21.15.138:0/1097557920 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f830c0be070 con 0x7f831415aa60 2024-04-26T20:56:44.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.430+0000 7f831a400640 1 -- 172.21.15.138:0/1097557920 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83140cf3d0 con 0x7f831415aa60 2024-04-26T20:56:44.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.430+0000 7f830be00640 1 -- 172.21.15.138:0/1097557920 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f830c0b88b0 con 0x7f831415aa60 2024-04-26T20:56:44.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.430+0000 7f831a400640 1 -- 172.21.15.138:0/1097557920 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83140cf990 con 0x7f831415aa60 2024-04-26T20:56:44.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.430+0000 7f831a400640 1 -- 172.21.15.138:0/1097557920 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8314069430 con 0x7f831415aa60 2024-04-26T20:56:44.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.430+0000 7f830be00640 1 -- 172.21.15.138:0/1097557920 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f830c0b8a50 con 0x7f831415aa60 2024-04-26T20:56:44.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.434+0000 7f830be00640 1 --2- 172.21.15.138:0/1097557920 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f82f0068380 0x7f82f006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:44.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.434+0000 7f830be00640 1 -- 172.21.15.138:0/1097557920 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6500+0+0 (secure 0 0 0) 0x7f830c121d60 con 0x7f831415aa60 2024-04-26T20:56:44.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.434+0000 7f8313400640 1 --2- 172.21.15.138:0/1097557920 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f82f0068380 0x7f82f006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:44.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.434+0000 7f8313400640 1 --2- 172.21.15.138:0/1097557920 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f82f0068380 0x7f82f006a840 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8304009eb0 tx=0x7f8304009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:44.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.438+0000 7f830be00640 1 -- 172.21.15.138:0/1097557920 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f830c016620 con 0x7f831415aa60 2024-04-26T20:56:44.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:44.630+0000 7f831a400640 1 -- 172.21.15.138:0/1097557920 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f831406fbd0 con 0x7f831415aa60 2024-04-26T20:56:45.281 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.278+0000 7f830be00640 1 -- 172.21.15.138:0/1097557920 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) ==== 137+0+0 (secure 0 0 0) 0x7f830c0f1af0 con 0x7f831415aa60 2024-04-26T20:56:45.281 INFO:teuthology.orchestra.run.smithi138.stderr:added data pool 4 to fsmap 2024-04-26T20:56:45.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.278+0000 7f831a400640 1 -- 172.21.15.138:0/1097557920 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f82f0068380 msgr2=0x7f82f006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:45.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.278+0000 7f831a400640 1 --2- 172.21.15.138:0/1097557920 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f82f0068380 0x7f82f006a840 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8304009eb0 tx=0x7f8304009190 comp rx=0 tx=0).stop 2024-04-26T20:56:45.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.278+0000 7f831a400640 1 -- 172.21.15.138:0/1097557920 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f831415aa60 msgr2=0x7f83141539a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:45.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.278+0000 7f831a400640 1 --2- 172.21.15.138:0/1097557920 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f831415aa60 0x7f83141539a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f830c01a660 tx=0x7f830c0197d0 comp rx=0 tx=0).stop 2024-04-26T20:56:45.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.282+0000 7f831a400640 1 -- 172.21.15.138:0/1097557920 shutdown_connections 2024-04-26T20:56:45.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.282+0000 7f831a400640 1 --2- 172.21.15.138:0/1097557920 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f82f0068380 0x7f82f006a840 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:45.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.282+0000 7f831a400640 1 --2- 172.21.15.138:0/1097557920 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f831415aa60 0x7f83141539a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:45.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.282+0000 7f831a400640 1 --2- 172.21.15.138:0/1097557920 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f83140ccd20 0x7f83140ce780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:45.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.282+0000 7f831a400640 1 --2- 172.21.15.138:0/1097557920 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f83140cb910 0x7f831414ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:45.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.282+0000 7f831a400640 1 -- 172.21.15.138:0/1097557920 >> 172.21.15.138:0/1097557920 conn(0x7f83140d0bb0 msgr2=0x7f83140b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:45.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.282+0000 7f831a400640 1 -- 172.21.15.138:0/1097557920 shutdown_connections 2024-04-26T20:56:45.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.282+0000 7f831a400640 1 -- 172.21.15.138:0/1097557920 wait complete. 2024-04-26T20:56:45.303 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:56:45.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.438+0000 7ff686e00640 1 Processor -- start 2024-04-26T20:56:45.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.438+0000 7ff686e00640 1 -- start start 2024-04-26T20:56:45.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.438+0000 7ff686e00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff6800d1720 0x7ff6800b3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:45.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.438+0000 7ff686e00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6800ce540 con 0x7ff6800b2280 2024-04-26T20:56:45.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.438+0000 7ff686e00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6800ce820 con 0x7ff68015d0f0 2024-04-26T20:56:45.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.438+0000 7ff686e00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7ff6800d0e50 con 0x7ff6800d1720 2024-04-26T20:56:45.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.438+0000 7ff67f400640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7ff6800b2280 0x7ff6800b2b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:58366/0 (socket says 172.21.15.138:58366) 2024-04-26T20:56:45.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.438+0000 7ff67f400640 1 -- 172.21.15.138:0/2185837310 learned_addr learned my addr 172.21.15.138:0/2185837310 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:56:45.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.438+0000 7ff684e00640 1 --2- 172.21.15.138:0/2185837310 >> v2:172.21.15.143:3300/0 conn(0x7ff6800d1720 0x7ff6800b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:45.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.438+0000 7ff67ea00640 1 -- 172.21.15.138:0/2185837310 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3383551622 0 0) 0x7ff6800ce540 con 0x7ff6800b2280 2024-04-26T20:56:45.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.438+0000 7ff67ea00640 1 -- 172.21.15.138:0/2185837310 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff664003530 con 0x7ff6800b2280 2024-04-26T20:56:45.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.438+0000 7ff67ea00640 1 -- 172.21.15.138:0/2185837310 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3283658174 0 0) 0x7ff6800ce820 con 0x7ff68015d0f0 2024-04-26T20:56:45.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.438+0000 7ff67ea00640 1 -- 172.21.15.138:0/2185837310 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6800ce540 con 0x7ff68015d0f0 2024-04-26T20:56:45.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.438+0000 7ff67ea00640 1 -- 172.21.15.138:0/2185837310 <== mon.0 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 394315631 0 0) 0x7ff664003530 con 0x7ff6800b2280 2024-04-26T20:56:45.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.438+0000 7ff684e00640 1 -- 172.21.15.138:0/2185837310 >> v1:172.21.15.143:6789/0 conn(0x7ff68015d0f0 legacy=0x7ff6800d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:45.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.438+0000 7ff684e00640 1 -- 172.21.15.138:0/2185837310 >> v1:172.21.15.138:6789/0 conn(0x7ff6800b2280 legacy=0x7ff6800b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:45.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.438+0000 7ff684e00640 1 -- 172.21.15.138:0/2185837310 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6800ceb00 con 0x7ff6800d1720 2024-04-26T20:56:45.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.442+0000 7ff684e00640 1 --2- 172.21.15.138:0/2185837310 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6800d1720 0x7ff6800b3280 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff678009d90 tx=0x7ff67801c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fe9afc84e81d270 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:45.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.442+0000 7ff67ea00640 1 -- 172.21.15.138:0/2185837310 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff66c001680 con 0x7ff6800d1720 2024-04-26T20:56:45.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.442+0000 7ff67ea00640 1 -- 172.21.15.138:0/2185837310 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6780a64e0 con 0x7ff6800d1720 2024-04-26T20:56:45.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.442+0000 7ff67ea00640 1 -- 172.21.15.138:0/2185837310 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6780a68b0 con 0x7ff6800d1720 2024-04-26T20:56:45.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.442+0000 7ff686e00640 1 -- 172.21.15.138:0/2185837310 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6800d1720 msgr2=0x7ff6800b3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:45.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.442+0000 7ff686e00640 1 --2- 172.21.15.138:0/2185837310 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6800d1720 0x7ff6800b3280 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff678009d90 tx=0x7ff67801c890 comp rx=0 tx=0).stop 2024-04-26T20:56:45.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.442+0000 7ff686e00640 1 -- 172.21.15.138:0/2185837310 shutdown_connections 2024-04-26T20:56:45.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.442+0000 7ff686e00640 1 --2- 172.21.15.138:0/2185837310 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6800d1720 0x7ff6800b3280 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:45.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.442+0000 7ff686e00640 1 -- 172.21.15.138:0/2185837310 >> 172.21.15.138:0/2185837310 conn(0x7ff6800d2d80 msgr2=0x7ff6800d3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:45.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.442+0000 7ff686e00640 1 -- 172.21.15.138:0/2185837310 shutdown_connections 2024-04-26T20:56:45.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.442+0000 7ff686e00640 1 -- 172.21.15.138:0/2185837310 wait complete. 2024-04-26T20:56:45.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.446+0000 7ff686e00640 1 Processor -- start 2024-04-26T20:56:45.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.446+0000 7ff686e00640 1 -- start start 2024-04-26T20:56:45.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.446+0000 7ff686e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff6800b2280 0x7ff6800c6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:45.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.446+0000 7ff686e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6800d1720 0x7ff680155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:45.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.446+0000 7ff686e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff68015d0f0 0x7ff680143be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:45.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.446+0000 7ff686e00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff68016b050 con 0x7ff68015d0f0 2024-04-26T20:56:45.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.446+0000 7ff686e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ff68016aed0 con 0x7ff6800d1720 2024-04-26T20:56:45.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.446+0000 7ff686e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ff68016b1d0 con 0x7ff6800b2280 2024-04-26T20:56:45.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.446+0000 7ff684e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff68015d0f0 0x7ff680143be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:45.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.446+0000 7ff684e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff68015d0f0 0x7ff680143be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:55214/0 (socket says 172.21.15.138:55214) 2024-04-26T20:56:45.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.446+0000 7ff684e00640 1 -- 172.21.15.138:0/1190553970 learned_addr learned my addr 172.21.15.138:0/1190553970 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:45.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.446+0000 7ff67f400640 1 --2- 172.21.15.138:0/1190553970 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6800d1720 0x7ff680155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:45.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.446+0000 7ff67fe00640 1 --2- 172.21.15.138:0/1190553970 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff6800b2280 0x7ff6800c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:45.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.446+0000 7ff684e00640 1 -- 172.21.15.138:0/1190553970 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff6800b2280 msgr2=0x7ff6800c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:45.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.446+0000 7ff684e00640 1 --2- 172.21.15.138:0/1190553970 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff6800b2280 0x7ff6800c6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:45.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.446+0000 7ff684e00640 1 -- 172.21.15.138:0/1190553970 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6800d1720 msgr2=0x7ff680155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:45.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.446+0000 7ff684e00640 1 --2- 172.21.15.138:0/1190553970 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6800d1720 0x7ff680155520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:45.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.446+0000 7ff684e00640 1 -- 172.21.15.138:0/1190553970 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6800cc6e0 con 0x7ff68015d0f0 2024-04-26T20:56:45.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.446+0000 7ff67f400640 1 --2- 172.21.15.138:0/1190553970 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6800d1720 0x7ff680155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:56:45.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.446+0000 7ff684e00640 1 --2- 172.21.15.138:0/1190553970 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff68015d0f0 0x7ff680143be0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff6780b0040 tx=0x7ff678019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:45.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.446+0000 7ff677e00640 1 -- 172.21.15.138:0/1190553970 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6780be070 con 0x7ff68015d0f0 2024-04-26T20:56:45.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.446+0000 7ff677e00640 1 -- 172.21.15.138:0/1190553970 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6780b8840 con 0x7ff68015d0f0 2024-04-26T20:56:45.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.446+0000 7ff677e00640 1 -- 172.21.15.138:0/1190553970 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff678009450 con 0x7ff68015d0f0 2024-04-26T20:56:45.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.446+0000 7ff686e00640 1 -- 172.21.15.138:0/1190553970 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff680155a60 con 0x7ff68015d0f0 2024-04-26T20:56:45.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.446+0000 7ff686e00640 1 -- 172.21.15.138:0/1190553970 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6800ccc40 con 0x7ff68015d0f0 2024-04-26T20:56:45.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.446+0000 7ff686e00640 1 -- 172.21.15.138:0/1190553970 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff680069510 con 0x7ff68015d0f0 2024-04-26T20:56:45.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.450+0000 7ff677e00640 1 -- 172.21.15.138:0/1190553970 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff6780c1070 con 0x7ff68015d0f0 2024-04-26T20:56:45.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.450+0000 7ff677e00640 1 --2- 172.21.15.138:0/1190553970 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff6600683b0 0x7ff66006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:45.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.450+0000 7ff677e00640 1 -- 172.21.15.138:0/1190553970 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7ff678121fd0 con 0x7ff68015d0f0 2024-04-26T20:56:45.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.450+0000 7ff67fe00640 1 --2- 172.21.15.138:0/1190553970 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff6600683b0 0x7ff66006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:45.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.450+0000 7ff67fe00640 1 --2- 172.21.15.138:0/1190553970 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff6600683b0 0x7ff66006a870 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff6700011f0 tx=0x7ff670009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:45.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.454+0000 7ff677e00640 1 -- 172.21.15.138:0/1190553970 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff680155a60 con 0x7ff68015d0f0 2024-04-26T20:56:45.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.646+0000 7ff686e00640 1 -- 172.21.15.138:0/1190553970 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff680075150 con 0x7ff68015d0f0 2024-04-26T20:56:45.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.646+0000 7ff677e00640 1 -- 172.21.15.138:0/1190553970 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5189 (secure 0 0 0) 0x7ff6800cc6e0 con 0x7ff68015d0f0 2024-04-26T20:56:45.649 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:56:45.649 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/3495262740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3495262740},{"type":"v1","addr":"172.21.15.143:6837","nonce":3495262740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4273,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/1806638334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":1806638334},{"type":"v1","addr":"172.21.15.138:6834","nonce":1806638334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/3333703637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":3333703637},{"type":"v1","addr":"172.21.15.138:6835","nonce":3333703637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:56:39.581500+0000","modified":"2024-04-26T20:56:44.634160+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6836/3598364176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":3598364176},{"type":"v1","addr":"172.21.15.143:6836","nonce":3598364176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-04-26T20:56:45.649 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 7 2024-04-26T20:56:45.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.646+0000 7ff686e00640 1 -- 172.21.15.138:0/1190553970 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff6600683b0 msgr2=0x7ff66006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:45.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.646+0000 7ff686e00640 1 --2- 172.21.15.138:0/1190553970 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff6600683b0 0x7ff66006a870 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff6700011f0 tx=0x7ff670009040 comp rx=0 tx=0).stop 2024-04-26T20:56:45.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.646+0000 7ff686e00640 1 -- 172.21.15.138:0/1190553970 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff68015d0f0 msgr2=0x7ff680143be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:45.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.646+0000 7ff686e00640 1 --2- 172.21.15.138:0/1190553970 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff68015d0f0 0x7ff680143be0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff6780b0040 tx=0x7ff678019630 comp rx=0 tx=0).stop 2024-04-26T20:56:45.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.646+0000 7ff686e00640 1 -- 172.21.15.138:0/1190553970 shutdown_connections 2024-04-26T20:56:45.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.646+0000 7ff686e00640 1 --2- 172.21.15.138:0/1190553970 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff6600683b0 0x7ff66006a870 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:45.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.646+0000 7ff686e00640 1 --2- 172.21.15.138:0/1190553970 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff68015d0f0 0x7ff680143be0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:45.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.646+0000 7ff686e00640 1 --2- 172.21.15.138:0/1190553970 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6800d1720 0x7ff680155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:45.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.646+0000 7ff686e00640 1 --2- 172.21.15.138:0/1190553970 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff6800b2280 0x7ff6800c6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:45.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.646+0000 7ff686e00640 1 -- 172.21.15.138:0/1190553970 >> 172.21.15.138:0/1190553970 conn(0x7ff6800d2d80 msgr2=0x7ff6800d3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:45.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.646+0000 7ff686e00640 1 -- 172.21.15.138:0/1190553970 shutdown_connections 2024-04-26T20:56:45.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.646+0000 7ff686e00640 1 -- 172.21.15.138:0/1190553970 wait complete. 2024-04-26T20:56:45.670 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:56:45.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.802+0000 7f1007c00640 1 Processor -- start 2024-04-26T20:56:45.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.802+0000 7f1007c00640 1 -- start start 2024-04-26T20:56:45.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.806+0000 7f1007c00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f100015ce20 0x7f1000161340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:45.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.806+0000 7f1007c00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1000073b70 con 0x7f100015e0c0 2024-04-26T20:56:45.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.806+0000 7f1007c00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1000073e10 con 0x7f10000cca00 2024-04-26T20:56:45.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.806+0000 7f1007c00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f10000740f0 con 0x7f100015ce20 2024-04-26T20:56:45.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.806+0000 7f0fffe00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f100015e0c0 0x7f1000071ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:58372/0 (socket says 172.21.15.138:58372) 2024-04-26T20:56:45.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.806+0000 7f0fffe00640 1 -- 172.21.15.138:0/4265076932 learned_addr learned my addr 172.21.15.138:0/4265076932 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:56:45.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.806+0000 7f1005200640 1 --2- 172.21.15.138:0/4265076932 >> v2:172.21.15.143:3300/0 conn(0x7f100015ce20 0x7f1000161340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:45.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.806+0000 7f0fff400640 1 -- 172.21.15.138:0/4265076932 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 563169721 0 0) 0x7f1000073b70 con 0x7f100015e0c0 2024-04-26T20:56:45.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.806+0000 7f0fff400640 1 -- 172.21.15.138:0/4265076932 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0fe8003530 con 0x7f100015e0c0 2024-04-26T20:56:45.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.806+0000 7f0fff400640 1 -- 172.21.15.138:0/4265076932 <== mon.0 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2551214528 0 0) 0x7f0fe8003530 con 0x7f100015e0c0 2024-04-26T20:56:45.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.806+0000 7f0fff400640 1 -- 172.21.15.138:0/4265076932 >> v2:172.21.15.143:3300/0 conn(0x7f100015ce20 msgr2=0x7f1000161340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:45.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.806+0000 7f0fff400640 1 --2- 172.21.15.138:0/4265076932 >> v2:172.21.15.143:3300/0 conn(0x7f100015ce20 0x7f1000161340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:45.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.806+0000 7f0fff400640 1 -- 172.21.15.138:0/4265076932 >> v1:172.21.15.143:6789/0 conn(0x7f10000cca00 legacy=0x7f10000cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:45.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.806+0000 7f0fff400640 1 -- 172.21.15.138:0/4265076932 --> v1:172.21.15.138:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1000160b40 con 0x7f100015e0c0 2024-04-26T20:56:45.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.806+0000 7f0fff400640 1 -- 172.21.15.138:0/4265076932 <== mon.0 v1:172.21.15.138:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2715389689 0 0) 0x7f0fec0016a0 con 0x7f100015e0c0 2024-04-26T20:56:45.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.806+0000 7f0fff400640 1 -- 172.21.15.138:0/4265076932 >> v1:172.21.15.138:6789/0 conn(0x7f100015e0c0 legacy=0x7f1000071ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:45.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.806+0000 7f0fff400640 1 --2- 172.21.15.138:0/4265076932 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0fe80039c0 0x7f0fe8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:45.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.806+0000 7f0fff400640 1 --2- 172.21.15.138:0/4265076932 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0fe8004810 0x7f0fe8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:45.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.806+0000 7f0fff400640 1 --2- 172.21.15.138:0/4265076932 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0fe80051d0 0x7f0fe800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:45.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.806+0000 7f0fff400640 1 -- 172.21.15.138:0/4265076932 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f10000740f0 con 0x7f0fe80039c0 2024-04-26T20:56:45.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.806+0000 7f0fff400640 1 -- 172.21.15.138:0/4265076932 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe800c070 con 0x7f0fe80051d0 2024-04-26T20:56:45.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.806+0000 7f0fff400640 1 -- 172.21.15.138:0/4265076932 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f0fe800c270 con 0x7f0fe8004810 2024-04-26T20:56:45.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.806+0000 7f1005200640 1 --2- 172.21.15.138:0/4265076932 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0fe80039c0 0x7f0fe8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:45.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.806+0000 7f0fffe00640 1 --2- 172.21.15.138:0/4265076932 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0fe8004810 0x7f0fe8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:45.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.806+0000 7f1005c00640 1 --2- 172.21.15.138:0/4265076932 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0fe80051d0 0x7f0fe800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:45.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.806+0000 7f1005200640 1 -- 172.21.15.138:0/4265076932 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0fe8004810 msgr2=0x7f0fe8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:45.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.806+0000 7f1005200640 1 --2- 172.21.15.138:0/4265076932 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0fe8004810 0x7f0fe8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:45.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.806+0000 7f1005200640 1 -- 172.21.15.138:0/4265076932 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0fe80051d0 msgr2=0x7f0fe800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:45.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.806+0000 7f1005200640 1 --2- 172.21.15.138:0/4265076932 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0fe80051d0 0x7f0fe800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:45.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.806+0000 7f1005200640 1 -- 172.21.15.138:0/4265076932 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fe8003530 con 0x7f0fe80039c0 2024-04-26T20:56:45.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.806+0000 7f1005c00640 1 --2- 172.21.15.138:0/4265076932 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0fe80051d0 0x7f0fe800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:56:45.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.806+0000 7f1005c00640 1 -- 172.21.15.138:0/4265076932 reap_dead start 2024-04-26T20:56:45.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.810+0000 7f1005200640 1 --2- 172.21.15.138:0/4265076932 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0fe80039c0 0x7f0fe8003de0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0ff4009ae0 tx=0x7f0ff401ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a0a463568e65a63 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:45.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.810+0000 7f0fff400640 1 -- 172.21.15.138:0/4265076932 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff40b2070 con 0x7f0fe80039c0 2024-04-26T20:56:45.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.810+0000 7f0fff400640 1 -- 172.21.15.138:0/4265076932 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ff40a55f0 con 0x7f0fe80039c0 2024-04-26T20:56:45.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.810+0000 7f0fff400640 1 -- 172.21.15.138:0/4265076932 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff40096b0 con 0x7f0fe80039c0 2024-04-26T20:56:45.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.810+0000 7f1007c00640 1 -- 172.21.15.138:0/4265076932 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0fe80039c0 msgr2=0x7f0fe8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:45.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.810+0000 7f1007c00640 1 --2- 172.21.15.138:0/4265076932 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0fe80039c0 0x7f0fe8003de0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0ff4009ae0 tx=0x7f0ff401ca40 comp rx=0 tx=0).stop 2024-04-26T20:56:45.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.810+0000 7f1007c00640 1 -- 172.21.15.138:0/4265076932 shutdown_connections 2024-04-26T20:56:45.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.810+0000 7f1007c00640 1 --2- 172.21.15.138:0/4265076932 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0fe80039c0 0x7f0fe8003de0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:45.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.810+0000 7f1007c00640 1 -- 172.21.15.138:0/4265076932 >> 172.21.15.138:0/4265076932 conn(0x7f10000d0b20 msgr2=0x7f10000d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:45.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.810+0000 7f1007c00640 1 -- 172.21.15.138:0/4265076932 shutdown_connections 2024-04-26T20:56:45.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.810+0000 7f1007c00640 1 -- 172.21.15.138:0/4265076932 wait complete. 2024-04-26T20:56:45.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.814+0000 7f1007c00640 1 Processor -- start 2024-04-26T20:56:45.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.814+0000 7f1007c00640 1 -- start start 2024-04-26T20:56:45.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.814+0000 7f1007c00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0fe80039c0 0x7f100015b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:45.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.814+0000 7f1007c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10001f8f40 0x7f100015bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:45.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.814+0000 7f1007c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1000150330 0x7f10000af620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:45.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.814+0000 7f1007c00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f1000072060 con 0x7f0fe80039c0 2024-04-26T20:56:45.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.814+0000 7f1007c00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f1000071ee0 con 0x7f1000150330 2024-04-26T20:56:45.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.814+0000 7f1007c00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f10000721e0 con 0x7f10001f8f40 2024-04-26T20:56:45.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.814+0000 7f1005200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0fe80039c0 0x7f100015b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:45.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.814+0000 7f1005200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0fe80039c0 0x7f100015b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:55220/0 (socket says 172.21.15.138:55220) 2024-04-26T20:56:45.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.814+0000 7f1005200640 1 -- 172.21.15.138:0/265531753 learned_addr learned my addr 172.21.15.138:0/265531753 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:45.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.814+0000 7f0fffe00640 1 --2- 172.21.15.138:0/265531753 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10001f8f40 0x7f100015bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:45.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.814+0000 7f1005c00640 1 --2- 172.21.15.138:0/265531753 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1000150330 0x7f10000af620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:45.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.814+0000 7f1005200640 1 -- 172.21.15.138:0/265531753 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10001f8f40 msgr2=0x7f100015bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:45.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.814+0000 7f1005200640 1 --2- 172.21.15.138:0/265531753 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10001f8f40 0x7f100015bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:45.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.814+0000 7f1005200640 1 -- 172.21.15.138:0/265531753 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1000150330 msgr2=0x7f10000af620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:45.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.814+0000 7f1005200640 1 --2- 172.21.15.138:0/265531753 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1000150330 0x7f10000af620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:45.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.814+0000 7f1005200640 1 -- 172.21.15.138:0/265531753 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10001f81c0 con 0x7f0fe80039c0 2024-04-26T20:56:45.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.814+0000 7f1005200640 1 --2- 172.21.15.138:0/265531753 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0fe80039c0 0x7f100015b7a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0ff401c870 tx=0x7f0ff40197e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:45.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.814+0000 7f0ffcc00640 1 -- 172.21.15.138:0/265531753 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff40b2040 con 0x7f0fe80039c0 2024-04-26T20:56:45.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.814+0000 7f0ffcc00640 1 -- 172.21.15.138:0/265531753 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ff400f000 con 0x7f0fe80039c0 2024-04-26T20:56:45.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.814+0000 7f0ffcc00640 1 -- 172.21.15.138:0/265531753 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff40096b0 con 0x7f0fe80039c0 2024-04-26T20:56:45.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.814+0000 7f1007c00640 1 -- 172.21.15.138:0/265531753 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10001f8460 con 0x7f0fe80039c0 2024-04-26T20:56:45.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.814+0000 7f1007c00640 1 -- 172.21.15.138:0/265531753 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10001f8a20 con 0x7f0fe80039c0 2024-04-26T20:56:45.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.814+0000 7f1007c00640 1 -- 172.21.15.138:0/265531753 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1000069510 con 0x7f0fe80039c0 2024-04-26T20:56:45.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.818+0000 7f0ffcc00640 1 -- 172.21.15.138:0/265531753 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0ff40bf030 con 0x7f0fe80039c0 2024-04-26T20:56:45.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.818+0000 7f0ffcc00640 1 --2- 172.21.15.138:0/265531753 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0fe00683b0 0x7f0fe006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:45.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.818+0000 7f0ffcc00640 1 -- 172.21.15.138:0/265531753 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f0ff41205b0 con 0x7f0fe80039c0 2024-04-26T20:56:45.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.818+0000 7f0fffe00640 1 --2- 172.21.15.138:0/265531753 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0fe00683b0 0x7f0fe006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:45.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.818+0000 7f0fffe00640 1 --2- 172.21.15.138:0/265531753 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0fe00683b0 0x7f0fe006a870 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f10000b1e30 tx=0x7f0fec007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:45.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.822+0000 7f0ffcc00640 1 -- 172.21.15.138:0/265531753 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0ff40c6060 con 0x7f0fe80039c0 2024-04-26T20:56:45.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.978+0000 7f1007c00640 1 -- 172.21.15.138:0/265531753 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f10000008e0 con 0x7f0fe80039c0 2024-04-26T20:56:45.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.982+0000 7f0ffcc00640 1 -- 172.21.15.138:0/265531753 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18578 (secure 0 0 0) 0x7f0ff4016780 con 0x7f0fe80039c0 2024-04-26T20:56:45.984 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:56:45.984 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":27,"fsid":"c22b4730-12cc-4558-8535-b965384398c0","created":"2024-04-26T20:56:14.182475+0000","modified":"2024-04-26T20:56:44.633968+0000","last_up_change":"2024-04-26T20:56:26.013243+0000","last_in_change":"2024-04-26T20:56:16.714055+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:56:27.265834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:56:37.394398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:56:38.544369+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:56:42.240243+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3f9a2e34-3199-466f-a6cf-57927318121e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6801","nonce":3534772245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6803","nonce":3534772245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6807","nonce":3534772245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6805","nonce":3534772245}]},"public_addr":"172.21.15.138:6801/3534772245","cluster_addr":"172.21.15.138:6803/3534772245","heartbeat_back_addr":"172.21.15.138:6807/3534772245","heartbeat_front_addr":"172.21.15.138:6805/3534772245","state":["exists","up"]},{"osd":1,"uuid":"e881fcf6-3248-4696-a2ef-95d206d77712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6817","nonce":1427635773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6819","nonce":1427635773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6823","nonce":1427635773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6821","nonce":1427635773}]},"public_addr":"172.21.15.138:6817/1427635773","cluster_addr":"172.21.15.138:6819/1427635773","heartbeat_back_addr":"172.21.15.138:6823/1427635773","heartbeat_front_addr":"172.21.15.138:6821/1427635773","state":["exists","up"]},{"osd":2,"uuid":"f7d1db33-7672-4699-ae47-9f1e0a8e4222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6809","nonce":4273721573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6811","nonce":4273721573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6815","nonce":4273721573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6813","nonce":4273721573}]},"public_addr":"172.21.15.138:6809/4273721573","cluster_addr":"172.21.15.138:6811/4273721573","heartbeat_back_addr":"172.21.15.138:6815/4273721573","heartbeat_front_addr":"172.21.15.138:6813/4273721573","state":["exists","up"]},{"osd":3,"uuid":"2f4e0a9a-b8f6-4468-844a-a4501cd85054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6825","nonce":3098242154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6827","nonce":3098242154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6831","nonce":3098242154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6829","nonce":3098242154}]},"public_addr":"172.21.15.138:6825/3098242154","cluster_addr":"172.21.15.138:6827/3098242154","heartbeat_back_addr":"172.21.15.138:6831/3098242154","heartbeat_front_addr":"172.21.15.138:6829/3098242154","state":["exists","up"]},{"osd":4,"uuid":"c85df99b-3624-410e-866b-86830af2cfe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6801","nonce":2942056312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6803","nonce":2942056312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6807","nonce":2942056312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6805","nonce":2942056312}]},"public_addr":"172.21.15.143:6801/2942056312","cluster_addr":"172.21.15.143:6803/2942056312","heartbeat_back_addr":"172.21.15.143:6807/2942056312","heartbeat_front_addr":"172.21.15.143:6805/2942056312","state":["exists","up"]},{"osd":5,"uuid":"9af1efb5-c416-4808-b5ef-de0679ab9705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6809","nonce":1910222887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6811","nonce":1910222887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6815","nonce":1910222887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6813","nonce":1910222887}]},"public_addr":"172.21.15.143:6809/1910222887","cluster_addr":"172.21.15.143:6811/1910222887","heartbeat_back_addr":"172.21.15.143:6815/1910222887","heartbeat_front_addr":"172.21.15.143:6813/1910222887","state":["exists","up"]},{"osd":6,"uuid":"d7138615-8838-45ff-9072-2fd0683362f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6817","nonce":1082239825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6819","nonce":1082239825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6823","nonce":1082239825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6821","nonce":1082239825}]},"public_addr":"172.21.15.143:6817/1082239825","cluster_addr":"172.21.15.143:6819/1082239825","heartbeat_back_addr":"172.21.15.143:6823/1082239825","heartbeat_front_addr":"172.21.15.143:6821/1082239825","state":["exists","up"]},{"osd":7,"uuid":"0c27172b-35c4-49ec-ba0b-0137b8ff0010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6825","nonce":3295508495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6827","nonce":3295508495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6831","nonce":3295508495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6829","nonce":3295508495}]},"public_addr":"172.21.15.143:6825/3295508495","cluster_addr":"172.21.15.143:6827/3295508495","heartbeat_back_addr":"172.21.15.143:6831/3295508495","heartbeat_front_addr":"172.21.15.143:6829/3295508495","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.326627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.396119+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.433915+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.414179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.216947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.329272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.503073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.436382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:56:45.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.982+0000 7f1007c00640 1 -- 172.21.15.138:0/265531753 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0fe00683b0 msgr2=0x7f0fe006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:45.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.982+0000 7f1007c00640 1 --2- 172.21.15.138:0/265531753 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0fe00683b0 0x7f0fe006a870 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f10000b1e30 tx=0x7f0fec007040 comp rx=0 tx=0).stop 2024-04-26T20:56:45.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.982+0000 7f1007c00640 1 -- 172.21.15.138:0/265531753 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0fe80039c0 msgr2=0x7f100015b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:45.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.982+0000 7f1007c00640 1 --2- 172.21.15.138:0/265531753 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0fe80039c0 0x7f100015b7a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0ff401c870 tx=0x7f0ff40197e0 comp rx=0 tx=0).stop 2024-04-26T20:56:45.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.982+0000 7f1007c00640 1 -- 172.21.15.138:0/265531753 shutdown_connections 2024-04-26T20:56:45.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.982+0000 7f1007c00640 1 --2- 172.21.15.138:0/265531753 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0fe00683b0 0x7f0fe006a870 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:45.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.982+0000 7f1007c00640 1 --2- 172.21.15.138:0/265531753 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1000150330 0x7f10000af620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:45.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.982+0000 7f1007c00640 1 --2- 172.21.15.138:0/265531753 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10001f8f40 0x7f100015bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:45.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.982+0000 7f1007c00640 1 --2- 172.21.15.138:0/265531753 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0fe80039c0 0x7f100015b7a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:45.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.982+0000 7f1007c00640 1 -- 172.21.15.138:0/265531753 >> 172.21.15.138:0/265531753 conn(0x7f10000d0b20 msgr2=0x7f10000cd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:45.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.982+0000 7f1007c00640 1 -- 172.21.15.138:0/265531753 shutdown_connections 2024-04-26T20:56:45.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:45.982+0000 7f1007c00640 1 -- 172.21.15.138:0/265531753 wait complete. 2024-04-26T20:56:46.005 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:56:46.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.134+0000 7f64e8a00640 1 Processor -- start 2024-04-26T20:56:46.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.134+0000 7f64e8a00640 1 -- start start 2024-04-26T20:56:46.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.138+0000 7f64e8a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f64e40cbe00 0x7f64e406de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:46.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.138+0000 7f64e8a00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f64e40cc1e0 0x7f64e4073b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:46.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.138+0000 7f64e8a00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64e40727f0 con 0x7f64e40ce6f0 2024-04-26T20:56:46.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.138+0000 7f64e8a00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f64e4073680 con 0x7f64e40cc1e0 2024-04-26T20:56:46.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.138+0000 7f64e8a00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f64e4072a70 con 0x7f64e40cbe00 2024-04-26T20:56:46.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.138+0000 7f64e1400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f64e40cc1e0 0x7f64e4073b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:46.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.138+0000 7f64e1400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f64e40cc1e0 0x7f64e4073b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:55224/0 (socket says 172.21.15.138:55224) 2024-04-26T20:56:46.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.138+0000 7f64e1400640 1 -- 172.21.15.138:0/4251431479 learned_addr learned my addr 172.21.15.138:0/4251431479 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:46.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.138+0000 7f64e1e00640 1 --2- 172.21.15.138:0/4251431479 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f64e40cbe00 0x7f64e406de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:46.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.138+0000 7f64e1400640 1 -- 172.21.15.138:0/4251431479 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f64e40cbe00 msgr2=0x7f64e406de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:46.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.138+0000 7f64e1400640 1 --2- 172.21.15.138:0/4251431479 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f64e40cbe00 0x7f64e406de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:46.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.138+0000 7f64e1400640 1 -- 172.21.15.138:0/4251431479 >> v1:172.21.15.143:6789/0 conn(0x7f64e40ce6f0 legacy=0x7f64e40ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:46.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.138+0000 7f64e1400640 1 -- 172.21.15.138:0/4251431479 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64e4072d50 con 0x7f64e40cc1e0 2024-04-26T20:56:46.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.138+0000 7f64e1e00640 1 --2- 172.21.15.138:0/4251431479 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f64e40cbe00 0x7f64e406de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:56:46.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.142+0000 7f64e1400640 1 --2- 172.21.15.138:0/4251431479 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64e40cc1e0 0x7f64e4073b10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f64d0009870 tx=0x7f64d001c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82dc34a382993389 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:46.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.142+0000 7f64e0a00640 1 -- 172.21.15.138:0/4251431479 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64d00b0070 con 0x7f64e40cc1e0 2024-04-26T20:56:46.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.142+0000 7f64e0a00640 1 -- 172.21.15.138:0/4251431479 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64d00ab600 con 0x7f64e40cc1e0 2024-04-26T20:56:46.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.142+0000 7f64e0a00640 1 -- 172.21.15.138:0/4251431479 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64d00ab9d0 con 0x7f64e40cc1e0 2024-04-26T20:56:46.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.142+0000 7f64e8a00640 1 -- 172.21.15.138:0/4251431479 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64e40cc1e0 msgr2=0x7f64e4073b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:46.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.142+0000 7f64e8a00640 1 --2- 172.21.15.138:0/4251431479 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64e40cc1e0 0x7f64e4073b10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f64d0009870 tx=0x7f64d001c340 comp rx=0 tx=0).stop 2024-04-26T20:56:46.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.142+0000 7f64e8a00640 1 -- 172.21.15.138:0/4251431479 shutdown_connections 2024-04-26T20:56:46.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.142+0000 7f64e8a00640 1 --2- 172.21.15.138:0/4251431479 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64e40cc1e0 0x7f64e4073b10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:46.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.142+0000 7f64e8a00640 1 --2- 172.21.15.138:0/4251431479 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f64e40cbe00 0x7f64e406de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:46.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.142+0000 7f64e8a00640 1 -- 172.21.15.138:0/4251431479 >> 172.21.15.138:0/4251431479 conn(0x7f64e40d0b20 msgr2=0x7f64e40d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:46.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.142+0000 7f64e8a00640 1 -- 172.21.15.138:0/4251431479 shutdown_connections 2024-04-26T20:56:46.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.142+0000 7f64e8a00640 1 -- 172.21.15.138:0/4251431479 wait complete. 2024-04-26T20:56:46.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.142+0000 7f64e8a00640 1 Processor -- start 2024-04-26T20:56:46.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.142+0000 7f64e8a00640 1 -- start start 2024-04-26T20:56:46.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.146+0000 7f64e8a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64e40cbe00 0x7f64e415b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:46.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.146+0000 7f64e8a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f64e40cc1e0 0x7f64e4152aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:46.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.146+0000 7f64e8a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f64e40ce6f0 0x7f64e4151950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:46.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.146+0000 7f64e8a00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f64e40741d0 con 0x7f64e40cbe00 2024-04-26T20:56:46.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.146+0000 7f64e8a00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f64e4074050 con 0x7f64e40cc1e0 2024-04-26T20:56:46.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.146+0000 7f64e8a00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f64e40d0780 con 0x7f64e40ce6f0 2024-04-26T20:56:46.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.146+0000 7f64e1e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64e40cbe00 0x7f64e415b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:46.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.146+0000 7f64e1e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64e40cbe00 0x7f64e415b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:55226/0 (socket says 172.21.15.138:55226) 2024-04-26T20:56:46.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.146+0000 7f64e1e00640 1 -- 172.21.15.138:0/982431585 learned_addr learned my addr 172.21.15.138:0/982431585 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:46.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.146+0000 7f64e1e00640 1 -- 172.21.15.138:0/982431585 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f64e40ce6f0 msgr2=0x7f64e4151950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:46.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.146+0000 7f64e1e00640 1 --2- 172.21.15.138:0/982431585 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f64e40ce6f0 0x7f64e4151950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:46.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.146+0000 7f64e1e00640 1 -- 172.21.15.138:0/982431585 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f64e40cc1e0 msgr2=0x7f64e4152aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:46.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.146+0000 7f64e1e00640 1 --2- 172.21.15.138:0/982431585 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f64e40cc1e0 0x7f64e4152aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:46.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.146+0000 7f64e1e00640 1 -- 172.21.15.138:0/982431585 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64e40cb090 con 0x7f64e40cbe00 2024-04-26T20:56:46.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.146+0000 7f64e1e00640 1 --2- 172.21.15.138:0/982431585 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64e40cbe00 0x7f64e415b020 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f64d400cf60 tx=0x7f64d400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:46.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.146+0000 7f64da000640 1 -- 172.21.15.138:0/982431585 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64d401a070 con 0x7f64e40cbe00 2024-04-26T20:56:46.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.146+0000 7f64da000640 1 -- 172.21.15.138:0/982431585 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64d400d840 con 0x7f64e40cbe00 2024-04-26T20:56:46.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.146+0000 7f64da000640 1 -- 172.21.15.138:0/982431585 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64d400dc10 con 0x7f64e40cbe00 2024-04-26T20:56:46.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.146+0000 7f64e8a00640 1 -- 172.21.15.138:0/982431585 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64e40cb370 con 0x7f64e40cbe00 2024-04-26T20:56:46.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.146+0000 7f64e8a00640 1 -- 172.21.15.138:0/982431585 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64e40cb930 con 0x7f64e40cbe00 2024-04-26T20:56:46.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.146+0000 7f64e8a00640 1 -- 172.21.15.138:0/982431585 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64e4069510 con 0x7f64e40cbe00 2024-04-26T20:56:46.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.146+0000 7f64da000640 1 -- 172.21.15.138:0/982431585 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f64d401d070 con 0x7f64e40cbe00 2024-04-26T20:56:46.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.150+0000 7f64da000640 1 --2- 172.21.15.138:0/982431585 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f64c4068380 0x7f64c406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:46.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.150+0000 7f64da000640 1 -- 172.21.15.138:0/982431585 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f64d4087590 con 0x7f64e40cbe00 2024-04-26T20:56:46.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.150+0000 7f64e1400640 1 --2- 172.21.15.138:0/982431585 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f64c4068380 0x7f64c406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:46.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.150+0000 7f64e1400640 1 --2- 172.21.15.138:0/982431585 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f64c4068380 0x7f64c406a840 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f64d00ad000 tx=0x7f64d0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:46.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.154+0000 7f64da000640 1 -- 172.21.15.138:0/982431585 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f64d4057120 con 0x7f64e40cbe00 2024-04-26T20:56:46.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.310+0000 7f64e8a00640 1 -- 172.21.15.138:0/982431585 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f64e406ed40 con 0x7f64e40cbe00 2024-04-26T20:56:46.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.314+0000 7f64da000640 1 -- 172.21.15.138:0/982431585 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18578 (secure 0 0 0) 0x7f64d405b420 con 0x7f64e40cbe00 2024-04-26T20:56:46.316 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:56:46.316 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":27,"fsid":"c22b4730-12cc-4558-8535-b965384398c0","created":"2024-04-26T20:56:14.182475+0000","modified":"2024-04-26T20:56:44.633968+0000","last_up_change":"2024-04-26T20:56:26.013243+0000","last_in_change":"2024-04-26T20:56:16.714055+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:56:27.265834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:56:37.394398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:56:38.544369+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:56:42.240243+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3f9a2e34-3199-466f-a6cf-57927318121e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6801","nonce":3534772245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6803","nonce":3534772245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6807","nonce":3534772245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6805","nonce":3534772245}]},"public_addr":"172.21.15.138:6801/3534772245","cluster_addr":"172.21.15.138:6803/3534772245","heartbeat_back_addr":"172.21.15.138:6807/3534772245","heartbeat_front_addr":"172.21.15.138:6805/3534772245","state":["exists","up"]},{"osd":1,"uuid":"e881fcf6-3248-4696-a2ef-95d206d77712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6817","nonce":1427635773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6819","nonce":1427635773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6823","nonce":1427635773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6821","nonce":1427635773}]},"public_addr":"172.21.15.138:6817/1427635773","cluster_addr":"172.21.15.138:6819/1427635773","heartbeat_back_addr":"172.21.15.138:6823/1427635773","heartbeat_front_addr":"172.21.15.138:6821/1427635773","state":["exists","up"]},{"osd":2,"uuid":"f7d1db33-7672-4699-ae47-9f1e0a8e4222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6809","nonce":4273721573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6811","nonce":4273721573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6815","nonce":4273721573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6813","nonce":4273721573}]},"public_addr":"172.21.15.138:6809/4273721573","cluster_addr":"172.21.15.138:6811/4273721573","heartbeat_back_addr":"172.21.15.138:6815/4273721573","heartbeat_front_addr":"172.21.15.138:6813/4273721573","state":["exists","up"]},{"osd":3,"uuid":"2f4e0a9a-b8f6-4468-844a-a4501cd85054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6825","nonce":3098242154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6827","nonce":3098242154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6831","nonce":3098242154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6829","nonce":3098242154}]},"public_addr":"172.21.15.138:6825/3098242154","cluster_addr":"172.21.15.138:6827/3098242154","heartbeat_back_addr":"172.21.15.138:6831/3098242154","heartbeat_front_addr":"172.21.15.138:6829/3098242154","state":["exists","up"]},{"osd":4,"uuid":"c85df99b-3624-410e-866b-86830af2cfe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6801","nonce":2942056312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6803","nonce":2942056312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6807","nonce":2942056312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6805","nonce":2942056312}]},"public_addr":"172.21.15.143:6801/2942056312","cluster_addr":"172.21.15.143:6803/2942056312","heartbeat_back_addr":"172.21.15.143:6807/2942056312","heartbeat_front_addr":"172.21.15.143:6805/2942056312","state":["exists","up"]},{"osd":5,"uuid":"9af1efb5-c416-4808-b5ef-de0679ab9705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6809","nonce":1910222887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6811","nonce":1910222887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6815","nonce":1910222887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6813","nonce":1910222887}]},"public_addr":"172.21.15.143:6809/1910222887","cluster_addr":"172.21.15.143:6811/1910222887","heartbeat_back_addr":"172.21.15.143:6815/1910222887","heartbeat_front_addr":"172.21.15.143:6813/1910222887","state":["exists","up"]},{"osd":6,"uuid":"d7138615-8838-45ff-9072-2fd0683362f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6817","nonce":1082239825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6819","nonce":1082239825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6823","nonce":1082239825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6821","nonce":1082239825}]},"public_addr":"172.21.15.143:6817/1082239825","cluster_addr":"172.21.15.143:6819/1082239825","heartbeat_back_addr":"172.21.15.143:6823/1082239825","heartbeat_front_addr":"172.21.15.143:6821/1082239825","state":["exists","up"]},{"osd":7,"uuid":"0c27172b-35c4-49ec-ba0b-0137b8ff0010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6825","nonce":3295508495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6827","nonce":3295508495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6831","nonce":3295508495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6829","nonce":3295508495}]},"public_addr":"172.21.15.143:6825/3295508495","cluster_addr":"172.21.15.143:6827/3295508495","heartbeat_back_addr":"172.21.15.143:6831/3295508495","heartbeat_front_addr":"172.21.15.143:6829/3295508495","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.326627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.396119+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.433915+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.414179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.216947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.329272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.503073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.436382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:56:46.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.314+0000 7f64e8a00640 1 -- 172.21.15.138:0/982431585 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f64c4068380 msgr2=0x7f64c406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:46.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.314+0000 7f64e8a00640 1 --2- 172.21.15.138:0/982431585 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f64c4068380 0x7f64c406a840 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f64d00ad000 tx=0x7f64d0008040 comp rx=0 tx=0).stop 2024-04-26T20:56:46.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.314+0000 7f64e8a00640 1 -- 172.21.15.138:0/982431585 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64e40cbe00 msgr2=0x7f64e415b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:46.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.314+0000 7f64e8a00640 1 --2- 172.21.15.138:0/982431585 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64e40cbe00 0x7f64e415b020 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f64d400cf60 tx=0x7f64d400cf90 comp rx=0 tx=0).stop 2024-04-26T20:56:46.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.314+0000 7f64e8a00640 1 -- 172.21.15.138:0/982431585 shutdown_connections 2024-04-26T20:56:46.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.314+0000 7f64e8a00640 1 --2- 172.21.15.138:0/982431585 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f64c4068380 0x7f64c406a840 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:46.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.314+0000 7f64e8a00640 1 --2- 172.21.15.138:0/982431585 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f64e40ce6f0 0x7f64e4151950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:46.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.314+0000 7f64e8a00640 1 --2- 172.21.15.138:0/982431585 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f64e40cc1e0 0x7f64e4152aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:46.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.314+0000 7f64e8a00640 1 --2- 172.21.15.138:0/982431585 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64e40cbe00 0x7f64e415b020 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:46.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.314+0000 7f64e8a00640 1 -- 172.21.15.138:0/982431585 >> 172.21.15.138:0/982431585 conn(0x7f64e40d0b20 msgr2=0x7f64e40c5450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:46.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.314+0000 7f64e8a00640 1 -- 172.21.15.138:0/982431585 shutdown_connections 2024-04-26T20:56:46.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.314+0000 7f64e8a00640 1 -- 172.21.15.138:0/982431585 wait complete. 2024-04-26T20:56:46.351 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:56:46.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.482+0000 7f4ce0c00640 1 Processor -- start 2024-04-26T20:56:46.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.482+0000 7f4ce0c00640 1 -- start start 2024-04-26T20:56:46.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.486+0000 7f4ce0c00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4cdc0cbe00 0x7f4cdc06de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:46.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.486+0000 7f4ce0c00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4cdc0cc1e0 0x7f4cdc073b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:46.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.486+0000 7f4ce0c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4cdc0ce6f0 0x7f4cdc0ceb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:46.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.486+0000 7f4ce0c00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f4cdc073680 con 0x7f4cdc0cc1e0 2024-04-26T20:56:46.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.486+0000 7f4ce0c00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f4cdc0727f0 con 0x7f4cdc0cbe00 2024-04-26T20:56:46.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.486+0000 7f4ce0c00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f4cdc072a70 con 0x7f4cdc0ce6f0 2024-04-26T20:56:46.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.486+0000 7f4cd1400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4cdc0cc1e0 0x7f4cdc073b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:46.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.486+0000 7f4cd1400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4cdc0cc1e0 0x7f4cdc073b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:55242/0 (socket says 172.21.15.138:55242) 2024-04-26T20:56:46.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.486+0000 7f4cd1400640 1 -- 172.21.15.138:0/1994411559 learned_addr learned my addr 172.21.15.138:0/1994411559 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:46.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.486+0000 7f4cda800640 1 --2- 172.21.15.138:0/1994411559 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4cdc0ce6f0 0x7f4cdc0ceb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:46.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.486+0000 7f4cd9e00640 1 --2- 172.21.15.138:0/1994411559 >> v2:172.21.15.143:3300/0 conn(0x7f4cdc0cbe00 0x7f4cdc06de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:46.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.486+0000 7f4cd1400640 1 -- 172.21.15.138:0/1994411559 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4cdc0ce6f0 msgr2=0x7f4cdc0ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:46.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.486+0000 7f4cd1400640 1 --2- 172.21.15.138:0/1994411559 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4cdc0ce6f0 0x7f4cdc0ceb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:46.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.486+0000 7f4cd1400640 1 -- 172.21.15.138:0/1994411559 >> v2:172.21.15.143:3300/0 conn(0x7f4cdc0cbe00 msgr2=0x7f4cdc06de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:46.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.486+0000 7f4cd1400640 1 --2- 172.21.15.138:0/1994411559 >> v2:172.21.15.143:3300/0 conn(0x7f4cdc0cbe00 0x7f4cdc06de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:46.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.486+0000 7f4cd1400640 1 -- 172.21.15.138:0/1994411559 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cdc072d50 con 0x7f4cdc0cc1e0 2024-04-26T20:56:46.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.486+0000 7f4cda800640 1 --2- 172.21.15.138:0/1994411559 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4cdc0ce6f0 0x7f4cdc0ceb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:56:46.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.486+0000 7f4cd9e00640 1 --2- 172.21.15.138:0/1994411559 >> v2:172.21.15.143:3300/0 conn(0x7f4cdc0cbe00 0x7f4cdc06de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:56:46.491 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.490+0000 7f4cd1400640 1 --2- 172.21.15.138:0/1994411559 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4cdc0cc1e0 0x7f4cdc073b10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc074a70 tx=0x7f4cc401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa97e026879d3ace server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:46.491 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.490+0000 7f4cd9400640 1 -- 172.21.15.138:0/1994411559 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc40b1070 con 0x7f4cdc0cc1e0 2024-04-26T20:56:46.491 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.490+0000 7f4cd9400640 1 -- 172.21.15.138:0/1994411559 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cc40ac630 con 0x7f4cdc0cc1e0 2024-04-26T20:56:46.492 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.490+0000 7f4cd9400640 1 -- 172.21.15.138:0/1994411559 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc40a8050 con 0x7f4cdc0cc1e0 2024-04-26T20:56:46.492 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.490+0000 7f4ce0c00640 1 -- 172.21.15.138:0/1994411559 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4cdc0cc1e0 msgr2=0x7f4cdc073b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:46.492 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.490+0000 7f4ce0c00640 1 --2- 172.21.15.138:0/1994411559 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4cdc0cc1e0 0x7f4cdc073b10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc074a70 tx=0x7f4cc401c520 comp rx=0 tx=0).stop 2024-04-26T20:56:46.492 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.490+0000 7f4ce0c00640 1 -- 172.21.15.138:0/1994411559 shutdown_connections 2024-04-26T20:56:46.492 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.490+0000 7f4ce0c00640 1 --2- 172.21.15.138:0/1994411559 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4cdc0ce6f0 0x7f4cdc0ceb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:46.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.490+0000 7f4ce0c00640 1 --2- 172.21.15.138:0/1994411559 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4cdc0cc1e0 0x7f4cdc073b10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:46.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.490+0000 7f4ce0c00640 1 --2- 172.21.15.138:0/1994411559 >> v2:172.21.15.143:3300/0 conn(0x7f4cdc0cbe00 0x7f4cdc06de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:46.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.490+0000 7f4ce0c00640 1 -- 172.21.15.138:0/1994411559 >> 172.21.15.138:0/1994411559 conn(0x7f4cdc0d0b20 msgr2=0x7f4cdc0d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:46.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.490+0000 7f4ce0c00640 1 -- 172.21.15.138:0/1994411559 shutdown_connections 2024-04-26T20:56:46.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.490+0000 7f4ce0c00640 1 -- 172.21.15.138:0/1994411559 wait complete. 2024-04-26T20:56:46.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.490+0000 7f4ce0c00640 1 Processor -- start 2024-04-26T20:56:46.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.490+0000 7f4ce0c00640 1 -- start start 2024-04-26T20:56:46.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.490+0000 7f4ce0c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4cdc0cbe00 0x7f4cdc156500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:46.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.490+0000 7f4ce0c00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4cdc0cc1e0 0x7f4cdc153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:46.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.490+0000 7f4ce0c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4cdc0ce6f0 0x7f4cdc0ca3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:46.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.490+0000 7f4ce0c00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f4cdc06e530 con 0x7f4cdc0cc1e0 2024-04-26T20:56:46.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.490+0000 7f4ce0c00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f4cdc06e3b0 con 0x7f4cdc0ce6f0 2024-04-26T20:56:46.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.490+0000 7f4ce0c00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f4cdc074050 con 0x7f4cdc0cbe00 2024-04-26T20:56:46.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.494+0000 7f4cd1400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4cdc0cc1e0 0x7f4cdc153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:46.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.494+0000 7f4cd1400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4cdc0cc1e0 0x7f4cdc153960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:55254/0 (socket says 172.21.15.138:55254) 2024-04-26T20:56:46.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.494+0000 7f4cd1400640 1 -- 172.21.15.138:0/2397628722 learned_addr learned my addr 172.21.15.138:0/2397628722 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:46.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.494+0000 7f4cd9e00640 1 --2- 172.21.15.138:0/2397628722 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4cdc0cbe00 0x7f4cdc156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:46.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.494+0000 7f4cda800640 1 --2- 172.21.15.138:0/2397628722 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4cdc0ce6f0 0x7f4cdc0ca3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:46.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.494+0000 7f4cd1400640 1 -- 172.21.15.138:0/2397628722 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4cdc0cbe00 msgr2=0x7f4cdc156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:46.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.494+0000 7f4cd1400640 1 --2- 172.21.15.138:0/2397628722 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4cdc0cbe00 0x7f4cdc156500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:46.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.494+0000 7f4cd1400640 1 -- 172.21.15.138:0/2397628722 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4cdc0ce6f0 msgr2=0x7f4cdc0ca3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:46.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.494+0000 7f4cd1400640 1 --2- 172.21.15.138:0/2397628722 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4cdc0ce6f0 0x7f4cdc0ca3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:46.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.494+0000 7f4cd1400640 1 -- 172.21.15.138:0/2397628722 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cdc153ea0 con 0x7f4cdc0cc1e0 2024-04-26T20:56:46.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.494+0000 7f4cd1400640 1 --2- 172.21.15.138:0/2397628722 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4cdc0cc1e0 0x7f4cdc153960 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4cc401abd0 tx=0x7f4cc40192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:46.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.494+0000 7f4cd2a00640 1 -- 172.21.15.138:0/2397628722 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc40bc070 con 0x7f4cdc0cc1e0 2024-04-26T20:56:46.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.494+0000 7f4cd2a00640 1 -- 172.21.15.138:0/2397628722 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cc40ab800 con 0x7f4cdc0cc1e0 2024-04-26T20:56:46.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.494+0000 7f4cd2a00640 1 -- 172.21.15.138:0/2397628722 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc40b1070 con 0x7f4cdc0cc1e0 2024-04-26T20:56:46.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.494+0000 7f4ce0c00640 1 -- 172.21.15.138:0/2397628722 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cdc0c8f10 con 0x7f4cdc0cc1e0 2024-04-26T20:56:46.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.494+0000 7f4ce0c00640 1 -- 172.21.15.138:0/2397628722 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cdc0c94d0 con 0x7f4cdc0cc1e0 2024-04-26T20:56:46.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.494+0000 7f4ce0c00640 1 -- 172.21.15.138:0/2397628722 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cdc069510 con 0x7f4cdc0cc1e0 2024-04-26T20:56:46.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.494+0000 7f4cd2a00640 1 -- 172.21.15.138:0/2397628722 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4cc40ac4f0 con 0x7f4cdc0cc1e0 2024-04-26T20:56:46.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.498+0000 7f4cd2a00640 1 --2- 172.21.15.138:0/2397628722 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4cb80683b0 0x7f4cb806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:46.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.498+0000 7f4cd2a00640 1 -- 172.21.15.138:0/2397628722 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f4cc4120830 con 0x7f4cdc0cc1e0 2024-04-26T20:56:46.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.498+0000 7f4cd9e00640 1 --2- 172.21.15.138:0/2397628722 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4cb80683b0 0x7f4cb806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:46.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.498+0000 7f4cd9e00640 1 --2- 172.21.15.138:0/2397628722 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4cb80683b0 0x7f4cb806a870 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc00f500 tx=0x7f4ccc007700 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:46.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.502+0000 7f4cd2a00640 1 -- 172.21.15.138:0/2397628722 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4cdc153ea0 con 0x7f4cdc0cc1e0 2024-04-26T20:56:46.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.690+0000 7f4ce0c00640 1 -- 172.21.15.138:0/2397628722 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4cdc0cf330 con 0x7f4cdc0cc1e0 2024-04-26T20:56:46.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.690+0000 7f4cd2a00640 1 -- 172.21.15.138:0/2397628722 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5189 (secure 0 0 0) 0x7f4cc4016110 con 0x7f4cdc0cc1e0 2024-04-26T20:56:46.694 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:56:46.694 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/3495262740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3495262740},{"type":"v1","addr":"172.21.15.143:6837","nonce":3495262740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4273,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/1806638334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":1806638334},{"type":"v1","addr":"172.21.15.138:6834","nonce":1806638334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/3333703637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":3333703637},{"type":"v1","addr":"172.21.15.138:6835","nonce":3333703637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:56:39.581500+0000","modified":"2024-04-26T20:56:44.634160+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6836/3598364176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":3598364176},{"type":"v1","addr":"172.21.15.143:6836","nonce":3598364176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-04-26T20:56:46.694 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 7 2024-04-26T20:56:46.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.690+0000 7f4ce0c00640 1 -- 172.21.15.138:0/2397628722 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4cb80683b0 msgr2=0x7f4cb806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:46.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.690+0000 7f4ce0c00640 1 --2- 172.21.15.138:0/2397628722 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4cb80683b0 0x7f4cb806a870 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc00f500 tx=0x7f4ccc007700 comp rx=0 tx=0).stop 2024-04-26T20:56:46.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.690+0000 7f4ce0c00640 1 -- 172.21.15.138:0/2397628722 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4cdc0cc1e0 msgr2=0x7f4cdc153960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:46.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.690+0000 7f4ce0c00640 1 --2- 172.21.15.138:0/2397628722 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4cdc0cc1e0 0x7f4cdc153960 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4cc401abd0 tx=0x7f4cc40192c0 comp rx=0 tx=0).stop 2024-04-26T20:56:46.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.694+0000 7f4ce0c00640 1 -- 172.21.15.138:0/2397628722 shutdown_connections 2024-04-26T20:56:46.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.694+0000 7f4ce0c00640 1 --2- 172.21.15.138:0/2397628722 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4cb80683b0 0x7f4cb806a870 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:46.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.694+0000 7f4ce0c00640 1 --2- 172.21.15.138:0/2397628722 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4cdc0ce6f0 0x7f4cdc0ca3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:46.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.694+0000 7f4ce0c00640 1 --2- 172.21.15.138:0/2397628722 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4cdc0cc1e0 0x7f4cdc153960 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:46.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.694+0000 7f4ce0c00640 1 --2- 172.21.15.138:0/2397628722 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4cdc0cbe00 0x7f4cdc156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:46.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.694+0000 7f4ce0c00640 1 -- 172.21.15.138:0/2397628722 >> 172.21.15.138:0/2397628722 conn(0x7f4cdc0d0b20 msgr2=0x7f4cdc154cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:46.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.694+0000 7f4ce0c00640 1 -- 172.21.15.138:0/2397628722 shutdown_connections 2024-04-26T20:56:46.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.694+0000 7f4ce0c00640 1 -- 172.21.15.138:0/2397628722 wait complete. 2024-04-26T20:56:46.715 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:56:46.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.846+0000 7f23ea200640 1 Processor -- start 2024-04-26T20:56:46.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.846+0000 7f23ea200640 1 -- start start 2024-04-26T20:56:46.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.850+0000 7f23ea200640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f23e415ce20 0x7f23e4161340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:46.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.850+0000 7f23ea200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f23e40cca00 0x7f23e40cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:46.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.850+0000 7f23ea200640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23e40cd360 con 0x7f23e415e0c0 2024-04-26T20:56:46.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.850+0000 7f23ea200640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f23e4073b70 con 0x7f23e415ce20 2024-04-26T20:56:46.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.850+0000 7f23ea200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f23e4073e10 con 0x7f23e40cca00 2024-04-26T20:56:46.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.850+0000 7f23e3400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f23e415ce20 0x7f23e4161340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:46.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.850+0000 7f23e3400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f23e415ce20 0x7f23e4161340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:55256/0 (socket says 172.21.15.138:55256) 2024-04-26T20:56:46.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.850+0000 7f23e3400640 1 -- 172.21.15.138:0/3906246708 learned_addr learned my addr 172.21.15.138:0/3906246708 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:46.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.850+0000 7f23e3e00640 1 --2- 172.21.15.138:0/3906246708 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f23e40cca00 0x7f23e40cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:46.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.850+0000 7f23e3400640 1 -- 172.21.15.138:0/3906246708 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f23e40cca00 msgr2=0x7f23e40cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:46.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.850+0000 7f23e3400640 1 --2- 172.21.15.138:0/3906246708 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f23e40cca00 0x7f23e40cce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:46.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.850+0000 7f23e3400640 1 -- 172.21.15.138:0/3906246708 >> v1:172.21.15.143:6789/0 conn(0x7f23e415e0c0 legacy=0x7f23e4071ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:46.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.850+0000 7f23e3400640 1 -- 172.21.15.138:0/3906246708 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23e40740f0 con 0x7f23e415ce20 2024-04-26T20:56:46.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.850+0000 7f23e3e00640 1 --2- 172.21.15.138:0/3906246708 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f23e40cca00 0x7f23e40cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:56:46.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.850+0000 7f23e3400640 1 --2- 172.21.15.138:0/3906246708 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23e415ce20 0x7f23e4161340 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f23d4009870 tx=0x7f23d401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=241b40d2620cdb09 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:46.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.850+0000 7f23e2000640 1 -- 172.21.15.138:0/3906246708 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d40a7070 con 0x7f23e415ce20 2024-04-26T20:56:46.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.854+0000 7f23e2000640 1 -- 172.21.15.138:0/3906246708 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23d40b0070 con 0x7f23e415ce20 2024-04-26T20:56:46.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.854+0000 7f23e2000640 1 -- 172.21.15.138:0/3906246708 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d40ab890 con 0x7f23e415ce20 2024-04-26T20:56:46.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.854+0000 7f23ea200640 1 -- 172.21.15.138:0/3906246708 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23e415ce20 msgr2=0x7f23e4161340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:46.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.854+0000 7f23ea200640 1 --2- 172.21.15.138:0/3906246708 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23e415ce20 0x7f23e4161340 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f23d4009870 tx=0x7f23d401c560 comp rx=0 tx=0).stop 2024-04-26T20:56:46.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.854+0000 7f23ea200640 1 -- 172.21.15.138:0/3906246708 shutdown_connections 2024-04-26T20:56:46.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.854+0000 7f23ea200640 1 --2- 172.21.15.138:0/3906246708 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f23e40cca00 0x7f23e40cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:46.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.854+0000 7f23ea200640 1 --2- 172.21.15.138:0/3906246708 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23e415ce20 0x7f23e4161340 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:46.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.854+0000 7f23ea200640 1 -- 172.21.15.138:0/3906246708 >> 172.21.15.138:0/3906246708 conn(0x7f23e40d0b20 msgr2=0x7f23e40d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:46.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.854+0000 7f23ea200640 1 -- 172.21.15.138:0/3906246708 shutdown_connections 2024-04-26T20:56:46.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.854+0000 7f23ea200640 1 -- 172.21.15.138:0/3906246708 wait complete. 2024-04-26T20:56:46.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.854+0000 7f23ea200640 1 Processor -- start 2024-04-26T20:56:46.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.854+0000 7f23ea200640 1 -- start start 2024-04-26T20:56:46.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.854+0000 7f23ea200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f23e40cca00 0x7f23e415be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:46.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.854+0000 7f23ea200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23e415ce20 0x7f23e40b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:46.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.854+0000 7f23ea200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23e415e0c0 0x7f23e40afa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:46.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.854+0000 7f23ea200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f23e415d380 con 0x7f23e415e0c0 2024-04-26T20:56:46.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.854+0000 7f23ea200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f23e415d200 con 0x7f23e415ce20 2024-04-26T20:56:46.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.854+0000 7f23ea200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f23e406e680 con 0x7f23e40cca00 2024-04-26T20:56:46.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.854+0000 7f23e3e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23e415e0c0 0x7f23e40afa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:46.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.854+0000 7f23e3e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23e415e0c0 0x7f23e40afa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:55264/0 (socket says 172.21.15.138:55264) 2024-04-26T20:56:46.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.854+0000 7f23e3e00640 1 -- 172.21.15.138:0/653616739 learned_addr learned my addr 172.21.15.138:0/653616739 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:46.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.854+0000 7f23e3400640 1 --2- 172.21.15.138:0/653616739 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f23e40cca00 0x7f23e415be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:46.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.854+0000 7f23e2a00640 1 --2- 172.21.15.138:0/653616739 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23e415ce20 0x7f23e40b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:46.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.858+0000 7f23e3e00640 1 -- 172.21.15.138:0/653616739 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f23e40cca00 msgr2=0x7f23e415be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:46.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.858+0000 7f23e3e00640 1 --2- 172.21.15.138:0/653616739 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f23e40cca00 0x7f23e415be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:46.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.858+0000 7f23e3e00640 1 -- 172.21.15.138:0/653616739 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23e415ce20 msgr2=0x7f23e40b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:46.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.858+0000 7f23e3e00640 1 --2- 172.21.15.138:0/653616739 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23e415ce20 0x7f23e40b5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:46.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.858+0000 7f23e3e00640 1 -- 172.21.15.138:0/653616739 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23e40c65f0 con 0x7f23e415e0c0 2024-04-26T20:56:46.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.858+0000 7f23e3400640 1 --2- 172.21.15.138:0/653616739 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f23e40cca00 0x7f23e415be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:56:46.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.858+0000 7f23e3e00640 1 --2- 172.21.15.138:0/653616739 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23e415e0c0 0x7f23e40afa40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f23dc009fa0 tx=0x7f23dc00d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:46.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.858+0000 7f23db400640 1 -- 172.21.15.138:0/653616739 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23dc01a070 con 0x7f23e415e0c0 2024-04-26T20:56:46.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.858+0000 7f23db400640 1 -- 172.21.15.138:0/653616739 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23dc003bc0 con 0x7f23e415e0c0 2024-04-26T20:56:46.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.858+0000 7f23db400640 1 -- 172.21.15.138:0/653616739 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23dc004030 con 0x7f23e415e0c0 2024-04-26T20:56:46.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.858+0000 7f23ea200640 1 -- 172.21.15.138:0/653616739 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23e40c68d0 con 0x7f23e415e0c0 2024-04-26T20:56:46.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.858+0000 7f23ea200640 1 -- 172.21.15.138:0/653616739 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23e40c6e90 con 0x7f23e415e0c0 2024-04-26T20:56:46.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.858+0000 7f23ea200640 1 -- 172.21.15.138:0/653616739 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23e4069510 con 0x7f23e415e0c0 2024-04-26T20:56:46.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.858+0000 7f23db400640 1 -- 172.21.15.138:0/653616739 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f23dc01d070 con 0x7f23e415e0c0 2024-04-26T20:56:46.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.858+0000 7f23db400640 1 --2- 172.21.15.138:0/653616739 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f23c4068380 0x7f23c406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:46.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.858+0000 7f23db400640 1 -- 172.21.15.138:0/653616739 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f23dc0870b0 con 0x7f23e415e0c0 2024-04-26T20:56:46.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.862+0000 7f23e3400640 1 --2- 172.21.15.138:0/653616739 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f23c4068380 0x7f23c406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:46.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.862+0000 7f23e3400640 1 --2- 172.21.15.138:0/653616739 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f23c4068380 0x7f23c406a840 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f23d40af000 tx=0x7f23d40a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:46.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:46.866+0000 7f23db400640 1 -- 172.21.15.138:0/653616739 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f23dc010070 con 0x7f23e415e0c0 2024-04-26T20:56:47.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.022+0000 7f23ea200640 1 -- 172.21.15.138:0/653616739 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f23e4167c10 con 0x7f23e415e0c0 2024-04-26T20:56:47.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.022+0000 7f23db400640 1 -- 172.21.15.138:0/653616739 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18578 (secure 0 0 0) 0x7f23dc056bb0 con 0x7f23e415e0c0 2024-04-26T20:56:47.027 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:56:47.028 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":27,"fsid":"c22b4730-12cc-4558-8535-b965384398c0","created":"2024-04-26T20:56:14.182475+0000","modified":"2024-04-26T20:56:44.633968+0000","last_up_change":"2024-04-26T20:56:26.013243+0000","last_in_change":"2024-04-26T20:56:16.714055+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:56:27.265834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:56:37.394398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:56:38.544369+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:56:42.240243+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3f9a2e34-3199-466f-a6cf-57927318121e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6801","nonce":3534772245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6803","nonce":3534772245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6807","nonce":3534772245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6805","nonce":3534772245}]},"public_addr":"172.21.15.138:6801/3534772245","cluster_addr":"172.21.15.138:6803/3534772245","heartbeat_back_addr":"172.21.15.138:6807/3534772245","heartbeat_front_addr":"172.21.15.138:6805/3534772245","state":["exists","up"]},{"osd":1,"uuid":"e881fcf6-3248-4696-a2ef-95d206d77712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6817","nonce":1427635773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6819","nonce":1427635773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6823","nonce":1427635773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6821","nonce":1427635773}]},"public_addr":"172.21.15.138:6817/1427635773","cluster_addr":"172.21.15.138:6819/1427635773","heartbeat_back_addr":"172.21.15.138:6823/1427635773","heartbeat_front_addr":"172.21.15.138:6821/1427635773","state":["exists","up"]},{"osd":2,"uuid":"f7d1db33-7672-4699-ae47-9f1e0a8e4222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6809","nonce":4273721573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6811","nonce":4273721573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6815","nonce":4273721573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6813","nonce":4273721573}]},"public_addr":"172.21.15.138:6809/4273721573","cluster_addr":"172.21.15.138:6811/4273721573","heartbeat_back_addr":"172.21.15.138:6815/4273721573","heartbeat_front_addr":"172.21.15.138:6813/4273721573","state":["exists","up"]},{"osd":3,"uuid":"2f4e0a9a-b8f6-4468-844a-a4501cd85054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6825","nonce":3098242154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6827","nonce":3098242154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6831","nonce":3098242154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6829","nonce":3098242154}]},"public_addr":"172.21.15.138:6825/3098242154","cluster_addr":"172.21.15.138:6827/3098242154","heartbeat_back_addr":"172.21.15.138:6831/3098242154","heartbeat_front_addr":"172.21.15.138:6829/3098242154","state":["exists","up"]},{"osd":4,"uuid":"c85df99b-3624-410e-866b-86830af2cfe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6801","nonce":2942056312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6803","nonce":2942056312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6807","nonce":2942056312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6805","nonce":2942056312}]},"public_addr":"172.21.15.143:6801/2942056312","cluster_addr":"172.21.15.143:6803/2942056312","heartbeat_back_addr":"172.21.15.143:6807/2942056312","heartbeat_front_addr":"172.21.15.143:6805/2942056312","state":["exists","up"]},{"osd":5,"uuid":"9af1efb5-c416-4808-b5ef-de0679ab9705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6809","nonce":1910222887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6811","nonce":1910222887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6815","nonce":1910222887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6813","nonce":1910222887}]},"public_addr":"172.21.15.143:6809/1910222887","cluster_addr":"172.21.15.143:6811/1910222887","heartbeat_back_addr":"172.21.15.143:6815/1910222887","heartbeat_front_addr":"172.21.15.143:6813/1910222887","state":["exists","up"]},{"osd":6,"uuid":"d7138615-8838-45ff-9072-2fd0683362f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6817","nonce":1082239825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6819","nonce":1082239825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6823","nonce":1082239825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6821","nonce":1082239825}]},"public_addr":"172.21.15.143:6817/1082239825","cluster_addr":"172.21.15.143:6819/1082239825","heartbeat_back_addr":"172.21.15.143:6823/1082239825","heartbeat_front_addr":"172.21.15.143:6821/1082239825","state":["exists","up"]},{"osd":7,"uuid":"0c27172b-35c4-49ec-ba0b-0137b8ff0010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6825","nonce":3295508495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6827","nonce":3295508495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6831","nonce":3295508495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6829","nonce":3295508495}]},"public_addr":"172.21.15.143:6825/3295508495","cluster_addr":"172.21.15.143:6827/3295508495","heartbeat_back_addr":"172.21.15.143:6831/3295508495","heartbeat_front_addr":"172.21.15.143:6829/3295508495","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.326627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.396119+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.433915+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.414179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.216947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.329272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.503073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.436382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:56:47.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.026+0000 7f23ea200640 1 -- 172.21.15.138:0/653616739 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f23c4068380 msgr2=0x7f23c406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:47.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.026+0000 7f23ea200640 1 --2- 172.21.15.138:0/653616739 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f23c4068380 0x7f23c406a840 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f23d40af000 tx=0x7f23d40a7000 comp rx=0 tx=0).stop 2024-04-26T20:56:47.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.026+0000 7f23ea200640 1 -- 172.21.15.138:0/653616739 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23e415e0c0 msgr2=0x7f23e40afa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:47.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.026+0000 7f23ea200640 1 --2- 172.21.15.138:0/653616739 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23e415e0c0 0x7f23e40afa40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f23dc009fa0 tx=0x7f23dc00d560 comp rx=0 tx=0).stop 2024-04-26T20:56:47.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.026+0000 7f23ea200640 1 -- 172.21.15.138:0/653616739 shutdown_connections 2024-04-26T20:56:47.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.026+0000 7f23ea200640 1 --2- 172.21.15.138:0/653616739 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f23c4068380 0x7f23c406a840 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:47.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.026+0000 7f23ea200640 1 --2- 172.21.15.138:0/653616739 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23e415e0c0 0x7f23e40afa40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:47.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.026+0000 7f23ea200640 1 --2- 172.21.15.138:0/653616739 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23e415ce20 0x7f23e40b5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:47.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.026+0000 7f23ea200640 1 --2- 172.21.15.138:0/653616739 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f23e40cca00 0x7f23e415be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:47.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.026+0000 7f23ea200640 1 -- 172.21.15.138:0/653616739 >> 172.21.15.138:0/653616739 conn(0x7f23e40d0b20 msgr2=0x7f23e40cddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:47.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.026+0000 7f23ea200640 1 -- 172.21.15.138:0/653616739 shutdown_connections 2024-04-26T20:56:47.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.026+0000 7f23ea200640 1 -- 172.21.15.138:0/653616739 wait complete. 2024-04-26T20:56:47.451 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T20:56:39.581500+0000', 'modified': '2024-04-26T20:56:44.634160+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4290}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4290': {'gid': 4290, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.143:6836/3598364176', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6834', 'nonce': 3598364176}, {'type': 'v1', 'addr': '172.21.15.143:6836', 'nonce': 3598364176}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4290, 'qdb_cluster': [4290]} 2024-04-26T20:56:47.451 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T20:56:47.451 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-26T20:56:47.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.586+0000 7fec06400640 1 Processor -- start 2024-04-26T20:56:47.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.586+0000 7fec06400640 1 -- start start 2024-04-26T20:56:47.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.586+0000 7fec06400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fec0015cd20 0x7fec00162ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:47.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.586+0000 7fec06400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec000d1260 0x7fec0006c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:47.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.586+0000 7fec06400640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec0015d100 con 0x7fec000d16e0 2024-04-26T20:56:47.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.586+0000 7fec06400640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fec0006ef80 con 0x7fec0015cd20 2024-04-26T20:56:47.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.586+0000 7fec06400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fec0006f1d0 con 0x7fec000d1260 2024-04-26T20:56:47.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.586+0000 7febff400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fec0015cd20 0x7fec00162ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:47.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.586+0000 7febff400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fec0015cd20 0x7fec00162ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:55278/0 (socket says 172.21.15.138:55278) 2024-04-26T20:56:47.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.586+0000 7febff400640 1 -- 172.21.15.138:0/1920651008 learned_addr learned my addr 172.21.15.138:0/1920651008 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:47.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.586+0000 7febff400640 1 -- 172.21.15.138:0/1920651008 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec000d1260 msgr2=0x7fec0006c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:47.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.586+0000 7febff400640 1 --2- 172.21.15.138:0/1920651008 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec000d1260 0x7fec0006c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:47.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.586+0000 7febff400640 1 -- 172.21.15.138:0/1920651008 >> v1:172.21.15.143:6789/0 conn(0x7fec000d16e0 legacy=0x7fec000b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:47.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.586+0000 7febff400640 1 -- 172.21.15.138:0/1920651008 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec0006f4b0 con 0x7fec0015cd20 2024-04-26T20:56:47.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.590+0000 7febff400640 1 --2- 172.21.15.138:0/1920651008 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec0015cd20 0x7fec00162ce0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7febf0009870 tx=0x7febf001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8472b7bafd6d6a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:47.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.590+0000 7febfea00640 1 -- 172.21.15.138:0/1920651008 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf00ab5f0 con 0x7fec0015cd20 2024-04-26T20:56:47.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.590+0000 7febfea00640 1 -- 172.21.15.138:0/1920651008 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febf00b0070 con 0x7fec0015cd20 2024-04-26T20:56:47.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.590+0000 7febfea00640 1 -- 172.21.15.138:0/1920651008 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf00ab9b0 con 0x7fec0015cd20 2024-04-26T20:56:47.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.590+0000 7fec06400640 1 -- 172.21.15.138:0/1920651008 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec0015cd20 msgr2=0x7fec00162ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:47.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.590+0000 7fec06400640 1 --2- 172.21.15.138:0/1920651008 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec0015cd20 0x7fec00162ce0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7febf0009870 tx=0x7febf001c520 comp rx=0 tx=0).stop 2024-04-26T20:56:47.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.590+0000 7fec06400640 1 -- 172.21.15.138:0/1920651008 shutdown_connections 2024-04-26T20:56:47.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.590+0000 7fec06400640 1 --2- 172.21.15.138:0/1920651008 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec000d1260 0x7fec0006c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:47.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.590+0000 7fec06400640 1 --2- 172.21.15.138:0/1920651008 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec0015cd20 0x7fec00162ce0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:47.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.590+0000 7fec06400640 1 -- 172.21.15.138:0/1920651008 >> 172.21.15.138:0/1920651008 conn(0x7fec000d1c30 msgr2=0x7fec000d2040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:47.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.590+0000 7fec06400640 1 -- 172.21.15.138:0/1920651008 shutdown_connections 2024-04-26T20:56:47.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.590+0000 7fec06400640 1 -- 172.21.15.138:0/1920651008 wait complete. 2024-04-26T20:56:47.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.594+0000 7fec06400640 1 Processor -- start 2024-04-26T20:56:47.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.594+0000 7fec06400640 1 -- start start 2024-04-26T20:56:47.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.594+0000 7fec06400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec000d1260 0x7fec00157670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:47.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.594+0000 7fec06400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec000d16e0 0x7fec00149450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:47.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.594+0000 7fec06400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec0015cd20 0x7fec00158160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:47.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.594+0000 7fec06400640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fec000b1580 con 0x7fec0015cd20 2024-04-26T20:56:47.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.594+0000 7fec06400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fec000b1400 con 0x7fec000d1260 2024-04-26T20:56:47.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.594+0000 7fec06400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fec000cdaa0 con 0x7fec000d16e0 2024-04-26T20:56:47.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.594+0000 7febffe00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec0015cd20 0x7fec00158160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:47.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.594+0000 7febffe00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec0015cd20 0x7fec00158160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:55288/0 (socket says 172.21.15.138:55288) 2024-04-26T20:56:47.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.594+0000 7febffe00640 1 -- 172.21.15.138:0/76955395 learned_addr learned my addr 172.21.15.138:0/76955395 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:47.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.594+0000 7febff400640 1 --2- 172.21.15.138:0/76955395 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec000d1260 0x7fec00157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:47.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.594+0000 7febf6a00640 1 --2- 172.21.15.138:0/76955395 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec000d16e0 0x7fec00149450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:47.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.594+0000 7febffe00640 1 -- 172.21.15.138:0/76955395 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec000d16e0 msgr2=0x7fec00149450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:47.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.594+0000 7febffe00640 1 --2- 172.21.15.138:0/76955395 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec000d16e0 0x7fec00149450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:47.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.594+0000 7febffe00640 1 -- 172.21.15.138:0/76955395 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec000d1260 msgr2=0x7fec00157670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:47.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.594+0000 7febffe00640 1 --2- 172.21.15.138:0/76955395 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec000d1260 0x7fec00157670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:47.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.594+0000 7febffe00640 1 -- 172.21.15.138:0/76955395 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec0015be50 con 0x7fec0015cd20 2024-04-26T20:56:47.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.594+0000 7febffe00640 1 --2- 172.21.15.138:0/76955395 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec0015cd20 0x7fec00158160 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7febf800c7b0 tx=0x7febf800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:47.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.594+0000 7febf7e00640 1 -- 172.21.15.138:0/76955395 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf8017070 con 0x7fec0015cd20 2024-04-26T20:56:47.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.594+0000 7febf7e00640 1 -- 172.21.15.138:0/76955395 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febf8003db0 con 0x7fec0015cd20 2024-04-26T20:56:47.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.594+0000 7fec06400640 1 -- 172.21.15.138:0/76955395 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec0015c130 con 0x7fec0015cd20 2024-04-26T20:56:47.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.594+0000 7febf7e00640 1 -- 172.21.15.138:0/76955395 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf800ce60 con 0x7fec0015cd20 2024-04-26T20:56:47.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.594+0000 7fec06400640 1 -- 172.21.15.138:0/76955395 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec0015c6f0 con 0x7fec0015cd20 2024-04-26T20:56:47.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.598+0000 7febf7e00640 1 -- 172.21.15.138:0/76955395 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7febf801a070 con 0x7fec0015cd20 2024-04-26T20:56:47.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.598+0000 7febf7e00640 1 --2- 172.21.15.138:0/76955395 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7febdc068380 0x7febdc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:47.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.598+0000 7febf7e00640 1 -- 172.21.15.138:0/76955395 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7febf80862e0 con 0x7fec0015cd20 2024-04-26T20:56:47.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.598+0000 7fec09822000 1 Processor -- start 2024-04-26T20:56:47.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.598+0000 7febff400640 1 --2- 172.21.15.138:0/76955395 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7febdc068380 0x7febdc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:47.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.598+0000 7fec09822000 1 -- start start 2024-04-26T20:56:47.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.598+0000 7febff400640 1 --2- 172.21.15.138:0/76955395 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7febdc068380 0x7febdc06a840 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7febf00af000 tx=0x7febf00a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:47.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.598+0000 7fec09822000 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x555d586a4700 0x555d586a4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:47.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.598+0000 7fec09822000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555d586a5020 0x555d5865b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:47.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.598+0000 7fec09822000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555d5865b740 0x555d5865bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:47.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.598+0000 7fec09822000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x555d58513140 con 0x555d586a5020 2024-04-26T20:56:47.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.598+0000 7fec09822000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x555d584a8e00 con 0x555d5865b740 2024-04-26T20:56:47.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.598+0000 7fec09822000 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x555d58461a00 con 0x555d586a4700 2024-04-26T20:56:47.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.598+0000 7febf6a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555d586a5020 0x555d5865b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:47.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.598+0000 7febf6a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555d586a5020 0x555d5865b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:55298/0 (socket says 172.21.15.138:55298) 2024-04-26T20:56:47.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.598+0000 7febf6a00640 1 -- 172.21.15.138:0/3763427399 learned_addr learned my addr 172.21.15.138:0/3763427399 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:47.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.598+0000 7febffe00640 1 --2- 172.21.15.138:0/3763427399 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555d5865b740 0x555d5865bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:47.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.598+0000 7febf6a00640 1 -- 172.21.15.138:0/3763427399 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x555d586a4700 msgr2=0x555d586a4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:47.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.598+0000 7febf6a00640 1 --2- 172.21.15.138:0/3763427399 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x555d586a4700 0x555d586a4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:47.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.598+0000 7febf6a00640 1 -- 172.21.15.138:0/3763427399 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555d5865b740 msgr2=0x555d5865bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:47.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.598+0000 7febf6a00640 1 --2- 172.21.15.138:0/3763427399 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555d5865b740 0x555d5865bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:47.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.598+0000 7febf6a00640 1 -- 172.21.15.138:0/3763427399 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d584660e0 con 0x555d586a5020 2024-04-26T20:56:47.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.598+0000 7febffe00640 1 --2- 172.21.15.138:0/3763427399 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555d5865b740 0x555d5865bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:56:47.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.598+0000 7febf6a00640 1 --2- 172.21.15.138:0/3763427399 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555d586a5020 0x555d5865b200 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7febe800b7d0 tx=0x7febe800bc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85bb4c0a000f6d9c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:47.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.598+0000 7febefe00640 1 -- 172.21.15.138:0/3763427399 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe800d950 con 0x555d586a5020 2024-04-26T20:56:47.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.598+0000 7febefe00640 1 -- 172.21.15.138:0/3763427399 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febe8018070 con 0x555d586a5020 2024-04-26T20:56:47.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.598+0000 7febefe00640 1 -- 172.21.15.138:0/3763427399 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe800dd50 con 0x555d586a5020 2024-04-26T20:56:47.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.602+0000 7fec09822000 1 -- 172.21.15.138:0/3763427399 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555d586a5020 msgr2=0x555d5865b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:47.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.602+0000 7fec09822000 1 --2- 172.21.15.138:0/3763427399 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555d586a5020 0x555d5865b200 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7febe800b7d0 tx=0x7febe800bc90 comp rx=0 tx=0).stop 2024-04-26T20:56:47.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.602+0000 7fec09822000 1 -- 172.21.15.138:0/3763427399 shutdown_connections 2024-04-26T20:56:47.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.602+0000 7fec09822000 1 --2- 172.21.15.138:0/3763427399 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555d5865b740 0x555d5865bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:47.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.602+0000 7fec09822000 1 --2- 172.21.15.138:0/3763427399 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555d586a5020 0x555d5865b200 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:47.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.602+0000 7fec09822000 1 --2- 172.21.15.138:0/3763427399 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x555d586a4700 0x555d586a4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:47.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.602+0000 7fec09822000 1 -- 172.21.15.138:0/3763427399 >> 172.21.15.138:0/3763427399 conn(0x555d586576f0 msgr2=0x555d58659ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:47.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.602+0000 7fec09822000 1 -- 172.21.15.138:0/3763427399 shutdown_connections 2024-04-26T20:56:47.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.602+0000 7fec09822000 1 -- 172.21.15.138:0/3763427399 wait complete. 2024-04-26T20:56:47.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.602+0000 7fec09822000 1 -- start start 2024-04-26T20:56:47.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.602+0000 7fec09822000 1 Processor -- start 2024-04-26T20:56:47.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.602+0000 7fec09822000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555d5865b740 0x555d586660a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:47.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.602+0000 7fec09822000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555d586a4700 0x555d586665e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:47.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.602+0000 7fec09822000 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x555d586a5020 0x555d58666b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:47.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.602+0000 7fec09822000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x555d584b6200 con 0x555d5865b740 2024-04-26T20:56:47.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.602+0000 7fec09822000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x555d5844ce80 con 0x555d586a4700 2024-04-26T20:56:47.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.602+0000 7fec09822000 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x555d584a3ae0 con 0x555d586a5020 2024-04-26T20:56:47.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.602+0000 7fec09822000 10 client.0 _ll_register_callbacks cb 0x555d584b5da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:56:47.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.602+0000 7febff400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555d5865b740 0x555d586660a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:47.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.602+0000 7febff400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555d5865b740 0x555d586660a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:55312/0 (socket says 172.21.15.138:55312) 2024-04-26T20:56:47.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.602+0000 7febff400640 1 -- 172.21.15.138:0/765770297 learned_addr learned my addr 172.21.15.138:0/765770297 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:47.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.602+0000 7febf6a00640 1 --2- 172.21.15.138:0/765770297 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555d586a4700 0x555d586665e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:47.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.602+0000 7febffe00640 1 --2- 172.21.15.138:0/765770297 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x555d586a5020 0x555d58666b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:47.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.602+0000 7febff400640 1 -- 172.21.15.138:0/765770297 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x555d586a5020 msgr2=0x555d58666b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:47.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.602+0000 7febff400640 1 --2- 172.21.15.138:0/765770297 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x555d586a5020 0x555d58666b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:47.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.602+0000 7febff400640 1 -- 172.21.15.138:0/765770297 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555d586a4700 msgr2=0x555d586665e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:47.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.602+0000 7febff400640 1 --2- 172.21.15.138:0/765770297 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555d586a4700 0x555d586665e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:47.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.602+0000 7febff400640 1 -- 172.21.15.138:0/765770297 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d584484e0 con 0x555d5865b740 2024-04-26T20:56:47.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.602+0000 7febff400640 1 --2- 172.21.15.138:0/765770297 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555d5865b740 0x555d586660a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7febf00ad040 tx=0x7febf00192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1312d6302741e46 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:47.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.602+0000 7febecc00640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-04-26T20:56:47.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.602+0000 7febecc00640 1 -- 172.21.15.138:0/765770297 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf00abc40 con 0x555d5865b740 2024-04-26T20:56:47.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.602+0000 7febecc00640 1 -- 172.21.15.138:0/765770297 <== mon.0 v2:172.21.15.138:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7febf00abde0 con 0x555d5865b740 2024-04-26T20:56:47.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.602+0000 7fec09822000 1 -- 172.21.15.138:0/765770297 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febe8018070 con 0x555d5865b740 2024-04-26T20:56:47.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.602+0000 7febecc00640 1 -- 172.21.15.138:0/765770297 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7febf00ca480 con 0x555d5865b740 2024-04-26T20:56:47.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.602+0000 7fec09822000 10 client.4413 fetch_fsmap learned FSMap version 7 2024-04-26T20:56:47.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.602+0000 7fec09822000 1 -- 172.21.15.138:0/765770297 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x555d5842ee80 con 0x555d5865b740 2024-04-26T20:56:47.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.602+0000 7febecc00640 1 -- 172.21.15.138:0/765770297 <== mon.0 v2:172.21.15.138:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febe8018070 con 0x555d5865b740 2024-04-26T20:56:47.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.606+0000 7febecc00640 1 -- 172.21.15.138:0/765770297 <== mon.0 v2:172.21.15.138:3300/0 5 ==== fsmap(e 7) ==== 3502+0+0 (secure 0 0 0) 0x7febf00ca620 con 0x555d5865b740 2024-04-26T20:56:47.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.606+0000 7fec09822000 10 client.4413 fetch_fsmap finished waiting for FSMap version 7 2024-04-26T20:56:47.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.606+0000 7fec09822000 10 client.4413 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T20:56:47.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.606+0000 7fec09822000 20 client.4413 populate_metadata read hostname 'smithi138' 2024-04-26T20:56:47.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.606+0000 7fec09822000 1 --2- 172.21.15.138:0/765770297 >> [v2:172.21.15.143:6834/3598364176,v1:172.21.15.143:6836/3598364176] conn(0x555d58667530 0x555d586b67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:47.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.606+0000 7fec09822000 4 client.4413 mds_command: new command op to 4290 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:56:47.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.606+0000 7fec09822000 1 -- 172.21.15.138:0/765770297 --> [v2:172.21.15.143:6834/3598364176,v1:172.21.15.143:6836/3598364176] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555d58441bc0 con 0x555d58667530 2024-04-26T20:56:47.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.606+0000 7febf6a00640 1 --2- 172.21.15.138:0/765770297 >> [v2:172.21.15.143:6834/3598364176,v1:172.21.15.143:6836/3598364176] conn(0x555d58667530 0x555d586b67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:47.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.606+0000 7febf6a00640 1 --2- 172.21.15.138:0/765770297 >> [v2:172.21.15.143:6834/3598364176,v1:172.21.15.143:6836/3598364176] conn(0x555d58667530 0x555d586b67b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=458f68d6fe1ba119 server_cookie=118effebc04c11e2 in_seq=0 out_seq=0 2024-04-26T20:56:47.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.606+0000 7febecc00640 10 client.4413 ms_handle_connect on v2:172.21.15.143:6834/3598364176 2024-04-26T20:56:47.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.606+0000 7febecc00640 1 -- 172.21.15.138:0/765770297 <== mds.0 v2:172.21.15.143:6834/3598364176 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x555d58441bc0 con 0x555d58667530 2024-04-26T20:56:47.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.606+0000 7febecc00640 10 client.4413 handle_command_reply: tid=0 2024-04-26T20:56:47.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.606+0000 7fec09822000 1 client.4413 shutdown 2024-04-26T20:56:47.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.606+0000 7fec09822000 1 -- 172.21.15.138:0/765770297 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555d5865b740 msgr2=0x555d586660a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:47.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.606+0000 7fec09822000 1 --2- 172.21.15.138:0/765770297 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555d5865b740 0x555d586660a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7febf00ad040 tx=0x7febf00192c0 comp rx=0 tx=0).stop 2024-04-26T20:56:47.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.606+0000 7fec09822000 1 -- 172.21.15.138:0/765770297 shutdown_connections 2024-04-26T20:56:47.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.606+0000 7fec09822000 1 --2- 172.21.15.138:0/765770297 >> [v2:172.21.15.143:6834/3598364176,v1:172.21.15.143:6836/3598364176] conn(0x555d58667530 0x555d586b67b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:47.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.606+0000 7fec09822000 1 --2- 172.21.15.138:0/765770297 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x555d586a5020 0x555d58666b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:47.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.606+0000 7fec09822000 1 --2- 172.21.15.138:0/765770297 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555d586a4700 0x555d586665e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:47.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.606+0000 7febecc00640 0 client.4413 ms_handle_reset on v2:172.21.15.143:6834/3598364176 2024-04-26T20:56:47.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.606+0000 7fec09822000 1 --2- 172.21.15.138:0/765770297 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555d5865b740 0x555d586660a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:47.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.606+0000 7fec09822000 1 -- 172.21.15.138:0/765770297 >> 172.21.15.138:0/765770297 conn(0x555d586576f0 msgr2=0x555d5865a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:47.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.606+0000 7fec09822000 1 -- 172.21.15.138:0/765770297 shutdown_connections 2024-04-26T20:56:47.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.606+0000 7fec09822000 1 -- 172.21.15.138:0/765770297 wait complete. 2024-04-26T20:56:47.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.606+0000 7fec09822000 20 client.4413 trim_cache size 0 max 16384 2024-04-26T20:56:47.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.626+0000 7fec09822000 1 Processor -- start 2024-04-26T20:56:47.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.626+0000 7fec09822000 1 -- start start 2024-04-26T20:56:47.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.626+0000 7fec09822000 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x555d5865b740 0x555d58659ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:47.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.626+0000 7fec09822000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555d586a4700 0x555d5865a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:47.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.626+0000 7fec09822000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555d586a5020 0x555d5865a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:47.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.626+0000 7fec09822000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fec00205360 con 0x555d586a4700 2024-04-26T20:56:47.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.626+0000 7fec09822000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fec00204720 con 0x555d586a5020 2024-04-26T20:56:47.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.626+0000 7fec09822000 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fec00204d40 con 0x555d5865b740 2024-04-26T20:56:47.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.626+0000 7febf6a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555d586a4700 0x555d5865a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:47.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.626+0000 7febf6a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555d586a4700 0x555d5865a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:55328/0 (socket says 172.21.15.138:55328) 2024-04-26T20:56:47.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.626+0000 7febf6a00640 1 -- 172.21.15.138:0/2607141098 learned_addr learned my addr 172.21.15.138:0/2607141098 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:47.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.626+0000 7febff400640 1 --2- 172.21.15.138:0/2607141098 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x555d5865b740 0x555d58659ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:47.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.626+0000 7febffe00640 1 --2- 172.21.15.138:0/2607141098 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555d586a5020 0x555d5865a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:47.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.626+0000 7febf6a00640 1 -- 172.21.15.138:0/2607141098 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x555d5865b740 msgr2=0x555d58659ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:47.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.626+0000 7febf6a00640 1 --2- 172.21.15.138:0/2607141098 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x555d5865b740 0x555d58659ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:47.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.626+0000 7febf6a00640 1 -- 172.21.15.138:0/2607141098 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555d586a5020 msgr2=0x555d5865a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:47.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.626+0000 7febf6a00640 1 --2- 172.21.15.138:0/2607141098 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555d586a5020 0x555d5865a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:47.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.626+0000 7febf6a00640 1 -- 172.21.15.138:0/2607141098 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d58461c50 con 0x555d586a4700 2024-04-26T20:56:47.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.626+0000 7febf6a00640 1 --2- 172.21.15.138:0/2607141098 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555d586a4700 0x555d5865a020 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7febe800b720 tx=0x7febe8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae4f7aba8ec9a966 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:47.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.626+0000 7febef400640 1 -- 172.21.15.138:0/2607141098 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe802e070 con 0x555d586a4700 2024-04-26T20:56:47.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.626+0000 7febef400640 1 -- 172.21.15.138:0/2607141098 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febe8018040 con 0x555d586a4700 2024-04-26T20:56:47.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.626+0000 7febef400640 1 -- 172.21.15.138:0/2607141098 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe80285f0 con 0x555d586a4700 2024-04-26T20:56:47.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.626+0000 7fec09822000 1 -- 172.21.15.138:0/2607141098 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555d586a4700 msgr2=0x555d5865a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:47.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.626+0000 7fec09822000 1 --2- 172.21.15.138:0/2607141098 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555d586a4700 0x555d5865a020 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7febe800b720 tx=0x7febe8012000 comp rx=0 tx=0).stop 2024-04-26T20:56:47.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.626+0000 7fec09822000 1 -- 172.21.15.138:0/2607141098 shutdown_connections 2024-04-26T20:56:47.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.626+0000 7fec09822000 1 --2- 172.21.15.138:0/2607141098 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555d586a5020 0x555d5865a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:47.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.626+0000 7fec09822000 1 --2- 172.21.15.138:0/2607141098 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555d586a4700 0x555d5865a020 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:47.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.626+0000 7fec09822000 1 --2- 172.21.15.138:0/2607141098 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x555d5865b740 0x555d58659ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:47.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.626+0000 7fec09822000 1 -- 172.21.15.138:0/2607141098 >> 172.21.15.138:0/2607141098 conn(0x555d586576f0 msgr2=0x555d58666930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:47.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.626+0000 7fec09822000 1 -- 172.21.15.138:0/2607141098 shutdown_connections 2024-04-26T20:56:47.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.626+0000 7fec09822000 1 -- 172.21.15.138:0/2607141098 wait complete. 2024-04-26T20:56:47.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.626+0000 7fec09822000 1 -- start start 2024-04-26T20:56:47.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.626+0000 7fec09822000 1 Processor -- start 2024-04-26T20:56:47.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.630+0000 7fec09822000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555d5865b740 0x555d586b8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:47.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.630+0000 7fec09822000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555d586a4700 0x555d586b9470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:47.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.630+0000 7fec09822000 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x555d586a5020 0x555d586d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:47.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.630+0000 7fec09822000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x555d584a8110 con 0x555d586a4700 2024-04-26T20:56:47.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.630+0000 7fec09822000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x555d5843e7b0 con 0x555d5865b740 2024-04-26T20:56:47.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.630+0000 7fec09822000 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x555d584ad430 con 0x555d586a5020 2024-04-26T20:56:47.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.630+0000 7fec09822000 10 client.0 _ll_register_callbacks cb 0x7febf00096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:56:47.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.630+0000 7febf6a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555d586a4700 0x555d586b9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:47.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.630+0000 7febf6a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555d586a4700 0x555d586b9470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:55332/0 (socket says 172.21.15.138:55332) 2024-04-26T20:56:47.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.630+0000 7febf6a00640 1 -- 172.21.15.138:0/2256026398 learned_addr learned my addr 172.21.15.138:0/2256026398 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:47.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.630+0000 7febff400640 1 --2- 172.21.15.138:0/2256026398 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555d5865b740 0x555d586b8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:47.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.630+0000 7febffe00640 1 --2- 172.21.15.138:0/2256026398 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x555d586a5020 0x555d586d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:47.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.630+0000 7febf6a00640 1 -- 172.21.15.138:0/2256026398 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x555d586a5020 msgr2=0x555d586d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:47.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.630+0000 7febf6a00640 1 --2- 172.21.15.138:0/2256026398 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x555d586a5020 0x555d586d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:47.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.630+0000 7febf6a00640 1 -- 172.21.15.138:0/2256026398 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555d5865b740 msgr2=0x555d586b8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:47.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.630+0000 7febf6a00640 1 --2- 172.21.15.138:0/2256026398 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555d5865b740 0x555d586b8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:47.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.630+0000 7febf6a00640 1 -- 172.21.15.138:0/2256026398 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d5852b160 con 0x555d586a4700 2024-04-26T20:56:47.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.630+0000 7febf6a00640 1 --2- 172.21.15.138:0/2256026398 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555d586a4700 0x555d586b9470 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7febe800b7d0 tx=0x7febe80046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fea49c55d7b2f0b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:47.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.630+0000 7febecc00640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-04-26T20:56:47.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.630+0000 7febecc00640 1 -- 172.21.15.138:0/2256026398 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe8038060 con 0x555d586a4700 2024-04-26T20:56:47.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.630+0000 7febecc00640 1 -- 172.21.15.138:0/2256026398 <== mon.0 v2:172.21.15.138:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7febe80285c0 con 0x555d586a4700 2024-04-26T20:56:47.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.630+0000 7fec09822000 1 -- 172.21.15.138:0/2256026398 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febe8018040 con 0x555d586a4700 2024-04-26T20:56:47.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.630+0000 7febecc00640 1 -- 172.21.15.138:0/2256026398 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7febe802e070 con 0x555d586a4700 2024-04-26T20:56:47.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.630+0000 7fec09822000 10 client.4419 fetch_fsmap learned FSMap version 7 2024-04-26T20:56:47.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.630+0000 7fec09822000 1 -- 172.21.15.138:0/2256026398 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x555d581620c0 con 0x555d586a4700 2024-04-26T20:56:47.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.630+0000 7febecc00640 1 -- 172.21.15.138:0/2256026398 <== mon.0 v2:172.21.15.138:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febe8018040 con 0x555d586a4700 2024-04-26T20:56:47.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.630+0000 7febecc00640 1 -- 172.21.15.138:0/2256026398 <== mon.0 v2:172.21.15.138:3300/0 5 ==== fsmap(e 7) ==== 3502+0+0 (secure 0 0 0) 0x7febe80287c0 con 0x555d586a4700 2024-04-26T20:56:47.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.630+0000 7fec09822000 10 client.4419 fetch_fsmap finished waiting for FSMap version 7 2024-04-26T20:56:47.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.630+0000 7fec09822000 10 client.4419 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T20:56:47.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.630+0000 7fec09822000 20 client.4419 populate_metadata read hostname 'smithi138' 2024-04-26T20:56:47.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.630+0000 7fec09822000 1 --2- 172.21.15.138:0/2256026398 >> [v2:172.21.15.143:6834/3598364176,v1:172.21.15.143:6836/3598364176] conn(0x555d586d0d00 0x555d5871b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:47.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.630+0000 7fec09822000 4 client.4419 mds_command: new command op to 4290 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T20:56:47.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.630+0000 7fec09822000 1 -- 172.21.15.138:0/2256026398 --> [v2:172.21.15.143:6834/3598364176,v1:172.21.15.143:6836/3598364176] -- command(tid 0: {"prefix": "status"}) -- 0x555d584b6a10 con 0x555d586d0d00 2024-04-26T20:56:47.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.630+0000 7febff400640 1 --2- 172.21.15.138:0/2256026398 >> [v2:172.21.15.143:6834/3598364176,v1:172.21.15.143:6836/3598364176] conn(0x555d586d0d00 0x555d5871b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:47.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.630+0000 7febecc00640 10 client.4419 ms_handle_connect on v2:172.21.15.143:6834/3598364176 2024-04-26T20:56:47.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.630+0000 7febff400640 1 --2- 172.21.15.138:0/2256026398 >> [v2:172.21.15.143:6834/3598364176,v1:172.21.15.143:6836/3598364176] conn(0x555d586d0d00 0x555d5871b7b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba9270bd5e085bd8 server_cookie=e57dc78ab37b4b12 in_seq=0 out_seq=0 2024-04-26T20:56:47.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.630+0000 7febecc00640 1 -- 172.21.15.138:0/2256026398 <== mds.0 v2:172.21.15.143:6834/3598364176 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x555d584b6a10 con 0x555d586d0d00 2024-04-26T20:56:47.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.630+0000 7febecc00640 10 client.4419 handle_command_reply: tid=0 2024-04-26T20:56:47.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.630+0000 7fec09822000 1 client.4419 shutdown 2024-04-26T20:56:47.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.630+0000 7fec09822000 1 -- 172.21.15.138:0/2256026398 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555d586a4700 msgr2=0x555d586b9470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:47.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.630+0000 7fec09822000 1 --2- 172.21.15.138:0/2256026398 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555d586a4700 0x555d586b9470 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7febe800b7d0 tx=0x7febe80046d0 comp rx=0 tx=0).stop 2024-04-26T20:56:47.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.634+0000 7fec09822000 1 -- 172.21.15.138:0/2256026398 shutdown_connections 2024-04-26T20:56:47.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.634+0000 7fec09822000 1 --2- 172.21.15.138:0/2256026398 >> [v2:172.21.15.143:6834/3598364176,v1:172.21.15.143:6836/3598364176] conn(0x555d586d0d00 0x555d5871b7b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:47.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.634+0000 7fec09822000 1 --2- 172.21.15.138:0/2256026398 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x555d586a5020 0x555d586d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:47.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.634+0000 7fec09822000 1 --2- 172.21.15.138:0/2256026398 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555d586a4700 0x555d586b9470 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:47.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.634+0000 7febecc00640 0 client.4419 ms_handle_reset on v2:172.21.15.143:6834/3598364176 2024-04-26T20:56:47.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.634+0000 7fec09822000 1 --2- 172.21.15.138:0/2256026398 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555d5865b740 0x555d586b8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:47.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.634+0000 7fec09822000 1 -- 172.21.15.138:0/2256026398 >> 172.21.15.138:0/2256026398 conn(0x555d586576f0 msgr2=0x555d586b1460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:47.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.634+0000 7fec09822000 1 -- 172.21.15.138:0/2256026398 shutdown_connections 2024-04-26T20:56:47.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.634+0000 7fec09822000 1 -- 172.21.15.138:0/2256026398 wait complete. 2024-04-26T20:56:47.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.634+0000 7fec09822000 20 client.4419 trim_cache size 0 max 16384 2024-04-26T20:56:47.639 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-26T20:56:47.639 INFO:teuthology.orchestra.run.smithi138.stdout: "cluster_fsid": "c22b4730-12cc-4558-8535-b965384398c0", 2024-04-26T20:56:47.639 INFO:teuthology.orchestra.run.smithi138.stdout: "whoami": 0, 2024-04-26T20:56:47.639 INFO:teuthology.orchestra.run.smithi138.stdout: "id": 4290, 2024-04-26T20:56:47.640 INFO:teuthology.orchestra.run.smithi138.stdout: "want_state": "up:active", 2024-04-26T20:56:47.640 INFO:teuthology.orchestra.run.smithi138.stdout: "state": "up:active", 2024-04-26T20:56:47.640 INFO:teuthology.orchestra.run.smithi138.stdout: "fs_name": "cephfs", 2024-04-26T20:56:47.640 INFO:teuthology.orchestra.run.smithi138.stdout: "rank_uptime": 7.4154136660000001, 2024-04-26T20:56:47.640 INFO:teuthology.orchestra.run.smithi138.stdout: "mdsmap_epoch": 7, 2024-04-26T20:56:47.640 INFO:teuthology.orchestra.run.smithi138.stdout: "osdmap_epoch": 27, 2024-04-26T20:56:47.640 INFO:teuthology.orchestra.run.smithi138.stdout: "osdmap_epoch_barrier": 27, 2024-04-26T20:56:47.640 INFO:teuthology.orchestra.run.smithi138.stdout: "uptime": 14.875569135999999 2024-04-26T20:56:47.640 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-26T20:56:47.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.634+0000 7fec06400640 1 -- 172.21.15.138:0/76955395 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7febdc068380 msgr2=0x7febdc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:47.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.634+0000 7fec06400640 1 --2- 172.21.15.138:0/76955395 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7febdc068380 0x7febdc06a840 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7febf00af000 tx=0x7febf00a7000 comp rx=0 tx=0).stop 2024-04-26T20:56:47.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.634+0000 7fec06400640 1 -- 172.21.15.138:0/76955395 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec0015cd20 msgr2=0x7fec00158160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:47.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.634+0000 7fec06400640 1 --2- 172.21.15.138:0/76955395 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec0015cd20 0x7fec00158160 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7febf800c7b0 tx=0x7febf800cc70 comp rx=0 tx=0).stop 2024-04-26T20:56:47.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.634+0000 7fec06400640 1 -- 172.21.15.138:0/76955395 shutdown_connections 2024-04-26T20:56:47.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.634+0000 7fec06400640 1 --2- 172.21.15.138:0/76955395 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7febdc068380 0x7febdc06a840 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:47.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.634+0000 7fec06400640 1 --2- 172.21.15.138:0/76955395 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec0015cd20 0x7fec00158160 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:47.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.634+0000 7fec06400640 1 --2- 172.21.15.138:0/76955395 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec000d16e0 0x7fec00149450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:47.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.634+0000 7fec06400640 1 --2- 172.21.15.138:0/76955395 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec000d1260 0x7fec00157670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:47.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.634+0000 7fec06400640 1 -- 172.21.15.138:0/76955395 >> 172.21.15.138:0/76955395 conn(0x7fec000d1c30 msgr2=0x7fec000b1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:47.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.634+0000 7fec06400640 1 -- 172.21.15.138:0/76955395 shutdown_connections 2024-04-26T20:56:47.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.634+0000 7fec06400640 1 -- 172.21.15.138:0/76955395 wait complete. 2024-04-26T20:56:47.654 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T20:56:47.654 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-26T20:56:47.655 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T20:56:47.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.786+0000 7f1326c00640 1 Processor -- start 2024-04-26T20:56:47.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.786+0000 7f1326c00640 1 -- start start 2024-04-26T20:56:47.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.786+0000 7f1326c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f13200d37d0 0x7f1320070860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:47.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.786+0000 7f1326c00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13200cd2c0 con 0x7f13200cda50 2024-04-26T20:56:47.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.786+0000 7f1326c00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f132015f690 con 0x7f132015f2b0 2024-04-26T20:56:47.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.786+0000 7f1326c00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f13200d1870 con 0x7f13200d37d0 2024-04-26T20:56:47.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.786+0000 7f1326200640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f13200cda50 0x7f13200cdee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:58382/0 (socket says 172.21.15.138:58382) 2024-04-26T20:56:47.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.786+0000 7f1326200640 1 -- 172.21.15.138:0/2541122729 learned_addr learned my addr 172.21.15.138:0/2541122729 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:56:47.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.786+0000 7f1324e00640 1 --2- 172.21.15.138:0/2541122729 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f13200d37d0 0x7f1320070860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:47.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.786+0000 7f131fe00640 1 -- 172.21.15.138:0/2541122729 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3610318627 0 0) 0x7f13200cd2c0 con 0x7f13200cda50 2024-04-26T20:56:47.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.790+0000 7f131fe00640 1 -- 172.21.15.138:0/2541122729 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1308003530 con 0x7f13200cda50 2024-04-26T20:56:47.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.790+0000 7f131fe00640 1 -- 172.21.15.138:0/2541122729 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2021429329 0 0) 0x7f132015f690 con 0x7f132015f2b0 2024-04-26T20:56:47.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.790+0000 7f131fe00640 1 -- 172.21.15.138:0/2541122729 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13200cd2c0 con 0x7f132015f2b0 2024-04-26T20:56:47.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.790+0000 7f1324e00640 1 -- 172.21.15.138:0/2541122729 >> v1:172.21.15.143:6789/0 conn(0x7f132015f2b0 legacy=0x7f1320070150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:47.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.790+0000 7f1324e00640 1 -- 172.21.15.138:0/2541122729 >> v1:172.21.15.138:6789/0 conn(0x7f13200cda50 legacy=0x7f13200cdee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:47.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.790+0000 7f1324e00640 1 -- 172.21.15.138:0/2541122729 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13200d1ac0 con 0x7f13200d37d0 2024-04-26T20:56:47.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.790+0000 7f1324e00640 1 --2- 172.21.15.138:0/2541122729 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f13200d37d0 0x7f1320070860 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f130c0097f0 tx=0x7f130c01c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f486691976a63ad4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:47.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.790+0000 7f131fe00640 1 -- 172.21.15.138:0/2541122729 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f130c0b2070 con 0x7f13200d37d0 2024-04-26T20:56:47.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.790+0000 7f131fe00640 1 -- 172.21.15.138:0/2541122729 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f130c0a9070 con 0x7f13200d37d0 2024-04-26T20:56:47.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.790+0000 7f131fe00640 1 -- 172.21.15.138:0/2541122729 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f130c0ad860 con 0x7f13200d37d0 2024-04-26T20:56:47.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.794+0000 7f1326c00640 1 -- 172.21.15.138:0/2541122729 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f13200d37d0 msgr2=0x7f1320070860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:47.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.794+0000 7f1326c00640 1 --2- 172.21.15.138:0/2541122729 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f13200d37d0 0x7f1320070860 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f130c0097f0 tx=0x7f130c01c4e0 comp rx=0 tx=0).stop 2024-04-26T20:56:47.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.794+0000 7f1326c00640 1 -- 172.21.15.138:0/2541122729 shutdown_connections 2024-04-26T20:56:47.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.794+0000 7f1326c00640 1 --2- 172.21.15.138:0/2541122729 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f13200d37d0 0x7f1320070860 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:47.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.794+0000 7f1326c00640 1 -- 172.21.15.138:0/2541122729 >> 172.21.15.138:0/2541122729 conn(0x7f13200d2bd0 msgr2=0x7f13200d2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:47.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.794+0000 7f1326c00640 1 -- 172.21.15.138:0/2541122729 shutdown_connections 2024-04-26T20:56:47.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.794+0000 7f1326c00640 1 -- 172.21.15.138:0/2541122729 wait complete. 2024-04-26T20:56:47.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.794+0000 7f1326c00640 1 Processor -- start 2024-04-26T20:56:47.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.794+0000 7f1326c00640 1 -- start start 2024-04-26T20:56:47.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.794+0000 7f1326c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f13200cda50 0x7f13200c7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:47.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.794+0000 7f1326c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13200d37d0 0x7f1320156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:47.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.794+0000 7f1326c00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f132015f2b0 0x7f1320149bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:47.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.794+0000 7f1326c00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f1320070f20 con 0x7f132015f2b0 2024-04-26T20:56:47.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.794+0000 7f1326c00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f1320070da0 con 0x7f13200d37d0 2024-04-26T20:56:47.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.794+0000 7f1326c00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f132016cdf0 con 0x7f13200cda50 2024-04-26T20:56:47.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.794+0000 7f1326200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f132015f2b0 0x7f1320149bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:47.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.794+0000 7f1326200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f132015f2b0 0x7f1320149bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:55334/0 (socket says 172.21.15.138:55334) 2024-04-26T20:56:47.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.794+0000 7f1326200640 1 -- 172.21.15.138:0/3971846551 learned_addr learned my addr 172.21.15.138:0/3971846551 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:47.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.794+0000 7f1324e00640 1 --2- 172.21.15.138:0/3971846551 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13200d37d0 0x7f1320156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:47.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.794+0000 7f1325800640 1 --2- 172.21.15.138:0/3971846551 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f13200cda50 0x7f13200c7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:47.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.794+0000 7f1326200640 1 -- 172.21.15.138:0/3971846551 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f13200cda50 msgr2=0x7f13200c7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:47.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.794+0000 7f1326200640 1 --2- 172.21.15.138:0/3971846551 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f13200cda50 0x7f13200c7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:47.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.794+0000 7f1326200640 1 -- 172.21.15.138:0/3971846551 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13200d37d0 msgr2=0x7f1320156180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:47.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.794+0000 7f1326200640 1 --2- 172.21.15.138:0/3971846551 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13200d37d0 0x7f1320156180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:47.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.794+0000 7f1326200640 1 -- 172.21.15.138:0/3971846551 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13200c66d0 con 0x7f132015f2b0 2024-04-26T20:56:47.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.794+0000 7f1325800640 1 --2- 172.21.15.138:0/3971846551 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f13200cda50 0x7f13200c7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:56:47.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.798+0000 7f1326200640 1 --2- 172.21.15.138:0/3971846551 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f132015f2b0 0x7f1320149bb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f131800cb20 tx=0x7f131800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:47.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.798+0000 7f131d600640 1 -- 172.21.15.138:0/3971846551 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1318017070 con 0x7f132015f2b0 2024-04-26T20:56:47.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.798+0000 7f131d600640 1 -- 172.21.15.138:0/3971846551 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f131800aca0 con 0x7f132015f2b0 2024-04-26T20:56:47.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.798+0000 7f131d600640 1 -- 172.21.15.138:0/3971846551 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1318012600 con 0x7f132015f2b0 2024-04-26T20:56:47.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.798+0000 7f1326c00640 1 -- 172.21.15.138:0/3971846551 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13200c6970 con 0x7f132015f2b0 2024-04-26T20:56:47.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.798+0000 7f1326c00640 1 -- 172.21.15.138:0/3971846551 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13200c89c0 con 0x7f132015f2b0 2024-04-26T20:56:47.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.798+0000 7f1326c00640 1 -- 172.21.15.138:0/3971846551 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1320069430 con 0x7f132015f2b0 2024-04-26T20:56:47.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.798+0000 7f131d600640 1 -- 172.21.15.138:0/3971846551 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f131801a070 con 0x7f132015f2b0 2024-04-26T20:56:47.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.798+0000 7f131d600640 1 --2- 172.21.15.138:0/3971846551 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1300068380 0x7f130006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:47.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.798+0000 7f131d600640 1 -- 172.21.15.138:0/3971846551 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f1318086900 con 0x7f132015f2b0 2024-04-26T20:56:47.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.798+0000 7f1325800640 1 --2- 172.21.15.138:0/3971846551 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1300068380 0x7f130006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:47.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.802+0000 7f1325800640 1 --2- 172.21.15.138:0/3971846551 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1300068380 0x7f130006a840 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f13200c98e0 tx=0x7f1314009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:47.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.802+0000 7f131d600640 1 -- 172.21.15.138:0/3971846551 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1318056520 con 0x7f132015f2b0 2024-04-26T20:56:47.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.994+0000 7f1326c00640 1 -- 172.21.15.138:0/3971846551 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f13200afb70 con 0x7f132015f2b0 2024-04-26T20:56:47.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.994+0000 7f131d600640 1 -- 172.21.15.138:0/3971846551 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+88 (secure 0 0 0) 0x7f131805a820 con 0x7f132015f2b0 2024-04-26T20:56:47.999 INFO:teuthology.orchestra.run.smithi138.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-26T20:56:48.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.998+0000 7f1326c00640 1 -- 172.21.15.138:0/3971846551 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1300068380 msgr2=0x7f130006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:48.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.998+0000 7f1326c00640 1 --2- 172.21.15.138:0/3971846551 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1300068380 0x7f130006a840 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f13200c98e0 tx=0x7f1314009040 comp rx=0 tx=0).stop 2024-04-26T20:56:48.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.998+0000 7f1326c00640 1 -- 172.21.15.138:0/3971846551 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f132015f2b0 msgr2=0x7f1320149bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:48.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.998+0000 7f1326c00640 1 --2- 172.21.15.138:0/3971846551 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f132015f2b0 0x7f1320149bb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f131800cb20 tx=0x7f131800a060 comp rx=0 tx=0).stop 2024-04-26T20:56:48.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.998+0000 7f1326c00640 1 -- 172.21.15.138:0/3971846551 shutdown_connections 2024-04-26T20:56:48.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.998+0000 7f1326c00640 1 --2- 172.21.15.138:0/3971846551 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1300068380 0x7f130006a840 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:48.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.998+0000 7f1326c00640 1 --2- 172.21.15.138:0/3971846551 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f132015f2b0 0x7f1320149bb0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:48.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.998+0000 7f1326c00640 1 --2- 172.21.15.138:0/3971846551 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13200d37d0 0x7f1320156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:48.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.998+0000 7f1326c00640 1 --2- 172.21.15.138:0/3971846551 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f13200cda50 0x7f13200c7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:48.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.998+0000 7f1326c00640 1 -- 172.21.15.138:0/3971846551 >> 172.21.15.138:0/3971846551 conn(0x7f13200d2bd0 msgr2=0x7f132006d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:48.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.998+0000 7f1326c00640 1 -- 172.21.15.138:0/3971846551 shutdown_connections 2024-04-26T20:56:48.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:47.998+0000 7f1326c00640 1 -- 172.21.15.138:0/3971846551 wait complete. 2024-04-26T20:56:48.020 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-26T20:56:48.020 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T20:56:48.020 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi138.front.sepia.ceph.com 2024-04-26T20:56:48.020 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-04-26T20:56:48.020 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-26T20:56:48.021 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-26T20:56:48.021 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T20:56:48.021 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T20:56:48.021 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-04-26T20:56:48.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:56:48.021 DEBUG:teuthology.orchestra.run.smithi138:> ip addr 2024-04-26T20:56:48.030 INFO:teuthology.orchestra.run.smithi138.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T20:56:48.030 INFO:teuthology.orchestra.run.smithi138.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T20:56:48.030 INFO:teuthology.orchestra.run.smithi138.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T20:56:48.030 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:56:48.030 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 ::1/128 scope host 2024-04-26T20:56:48.030 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:56:48.030 INFO:teuthology.orchestra.run.smithi138.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T20:56:48.030 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:d9:36:7a brd ff:ff:ff:ff:ff:ff 2024-04-26T20:56:48.030 INFO:teuthology.orchestra.run.smithi138.stdout: altname enp7s0f0 2024-04-26T20:56:48.030 INFO:teuthology.orchestra.run.smithi138.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T20:56:48.030 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:d9:36:7b brd ff:ff:ff:ff:ff:ff 2024-04-26T20:56:48.030 INFO:teuthology.orchestra.run.smithi138.stdout: altname enp7s0f1 2024-04-26T20:56:48.030 INFO:teuthology.orchestra.run.smithi138.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T20:56:48.030 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:88:6f:70 brd ff:ff:ff:ff:ff:ff 2024-04-26T20:56:48.031 INFO:teuthology.orchestra.run.smithi138.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T20:56:48.031 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:88:6f:71 brd ff:ff:ff:ff:ff:ff 2024-04-26T20:56:48.031 INFO:teuthology.orchestra.run.smithi138.stdout: inet 172.21.15.138/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-26T20:56:48.031 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft 42417sec preferred_lft 42417sec 2024-04-26T20:56:48.031 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 fe80::ec4:7aff:fe88:6f71/64 scope link 2024-04-26T20:56:48.031 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:56:48.031 INFO:teuthology.orchestra.run.smithi138.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-26T20:56:48.031 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 02:42:f3:4e:97:bb brd ff:ff:ff:ff:ff:ff 2024-04-26T20:56:48.031 INFO:teuthology.orchestra.run.smithi138.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-26T20:56:48.031 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:56:48.032 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-26T20:56:48.033 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T20:56:48.033 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2024-04-26T20:56:48.033 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link add name ceph-brx type bridge 2024-04-26T20:56:48.033 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip addr flush dev ceph-brx 2024-04-26T20:56:48.033 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link set ceph-brx up 2024-04-26T20:56:48.033 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-26T20:56:48.033 DEBUG:teuthology.orchestra.run.smithi138:> ') 2024-04-26T20:56:48.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:56:48.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:56:48.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:56:48.189 DEBUG:teuthology.orchestra.run.smithi138:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T20:56:48.254 INFO:teuthology.orchestra.run.smithi138.stdout:1 2024-04-26T20:56:48.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:56:48.256 DEBUG:teuthology.orchestra.run.smithi138:> route 2024-04-26T20:56:48.332 INFO:teuthology.orchestra.run.smithi138.stdout:Kernel IP routing table 2024-04-26T20:56:48.332 INFO:teuthology.orchestra.run.smithi138.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T20:56:48.332 INFO:teuthology.orchestra.run.smithi138.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-26T20:56:48.332 INFO:teuthology.orchestra.run.smithi138.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T20:56:48.332 INFO:teuthology.orchestra.run.smithi138.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-26T20:56:48.332 INFO:teuthology.orchestra.run.smithi138.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-26T20:56:48.332 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T20:56:48.332 INFO:teuthology.orchestra.run.smithi138.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T20:56:48.332 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T20:56:48.332 INFO:teuthology.orchestra.run.smithi138.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T20:56:48.332 INFO:teuthology.orchestra.run.smithi138.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T20:56:48.333 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T20:56:48.333 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2024-04-26T20:56:48.333 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T20:56:48.333 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T20:56:48.333 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T20:56:48.333 DEBUG:teuthology.orchestra.run.smithi138:> ') 2024-04-26T20:56:48.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:56:48.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:56:48.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:56:48.467 DEBUG:teuthology.orchestra.run.smithi138:> ip netns list 2024-04-26T20:56:48.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:56:48.476 DEBUG:teuthology.orchestra.run.smithi138:> ip netns list-id 2024-04-26T20:56:48.527 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T20:56:48.527 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2024-04-26T20:56:48.527 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T20:56:48.527 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-04-26T20:56:48.527 DEBUG:teuthology.orchestra.run.smithi138:> ') 2024-04-26T20:56:48.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:56:48.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:56:48.653 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-04-26T20:56:48.653 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T20:56:48.653 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2024-04-26T20:56:48.653 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-04-26T20:56:48.653 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-26T20:56:48.653 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-04-26T20:56:48.653 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-04-26T20:56:48.653 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-04-26T20:56:48.653 DEBUG:teuthology.orchestra.run.smithi138:> ') 2024-04-26T20:56:48.700 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:56:48.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:56:48.817 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T20:56:48.817 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2024-04-26T20:56:48.817 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link set brx.0 up 2024-04-26T20:56:48.817 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link set dev brx.0 master ceph-brx 2024-04-26T20:56:48.817 DEBUG:teuthology.orchestra.run.smithi138:> ') 2024-04-26T20:56:48.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:56:48.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:56:48.901 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-04-26T20:56:48.901 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T20:56:48.901 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-04-26T20:56:48.910 INFO:teuthology.orchestra.run.smithi138.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-04-26T20:56:48.910 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T20:56:48.910 DEBUG:teuthology.orchestra.run.smithi138:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-04-26T20:56:48.962 DEBUG:teuthology.orchestra.run.smithi138:> sudo modprobe fuse 2024-04-26T20:56:49.022 DEBUG:teuthology.orchestra.run.smithi138:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T20:56:49.072 INFO:teuthology.orchestra.run.smithi138.stdout:/sys 2024-04-26T20:56:49.072 INFO:teuthology.orchestra.run.smithi138.stdout:/proc 2024-04-26T20:56:49.072 INFO:teuthology.orchestra.run.smithi138.stdout:/dev 2024-04-26T20:56:49.072 INFO:teuthology.orchestra.run.smithi138.stdout:/dev/pts 2024-04-26T20:56:49.072 INFO:teuthology.orchestra.run.smithi138.stdout:/run 2024-04-26T20:56:49.072 INFO:teuthology.orchestra.run.smithi138.stdout:/ 2024-04-26T20:56:49.073 INFO:teuthology.orchestra.run.smithi138.stdout:/sys/kernel/security 2024-04-26T20:56:49.073 INFO:teuthology.orchestra.run.smithi138.stdout:/dev/shm 2024-04-26T20:56:49.073 INFO:teuthology.orchestra.run.smithi138.stdout:/run/lock 2024-04-26T20:56:49.073 INFO:teuthology.orchestra.run.smithi138.stdout:/sys/fs/cgroup 2024-04-26T20:56:49.073 INFO:teuthology.orchestra.run.smithi138.stdout:/sys/fs/pstore 2024-04-26T20:56:49.073 INFO:teuthology.orchestra.run.smithi138.stdout:/sys/fs/bpf 2024-04-26T20:56:49.073 INFO:teuthology.orchestra.run.smithi138.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T20:56:49.073 INFO:teuthology.orchestra.run.smithi138.stdout:/dev/hugepages 2024-04-26T20:56:49.073 INFO:teuthology.orchestra.run.smithi138.stdout:/dev/mqueue 2024-04-26T20:56:49.073 INFO:teuthology.orchestra.run.smithi138.stdout:/sys/kernel/debug 2024-04-26T20:56:49.073 INFO:teuthology.orchestra.run.smithi138.stdout:/sys/kernel/tracing 2024-04-26T20:56:49.073 INFO:teuthology.orchestra.run.smithi138.stdout:/proc/fs/nfsd 2024-04-26T20:56:49.073 INFO:teuthology.orchestra.run.smithi138.stdout:/sys/fs/fuse/connections 2024-04-26T20:56:49.074 INFO:teuthology.orchestra.run.smithi138.stdout:/sys/kernel/config 2024-04-26T20:56:49.074 INFO:teuthology.orchestra.run.smithi138.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T20:56:49.074 INFO:teuthology.orchestra.run.smithi138.stdout:/run/rpc_pipefs 2024-04-26T20:56:49.074 INFO:teuthology.orchestra.run.smithi138.stdout:/run/user/1000 2024-04-26T20:56:49.074 INFO:teuthology.orchestra.run.smithi138.stdout:/var/lib/ceph 2024-04-26T20:56:49.074 INFO:teuthology.orchestra.run.smithi138.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T20:56:49.074 INFO:teuthology.orchestra.run.smithi138.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T20:56:49.074 INFO:teuthology.orchestra.run.smithi138.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T20:56:49.074 INFO:teuthology.orchestra.run.smithi138.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T20:56:49.074 INFO:teuthology.orchestra.run.smithi138.stdout:/run/netns 2024-04-26T20:56:49.074 INFO:teuthology.orchestra.run.smithi138.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T20:56:49.074 INFO:teuthology.orchestra.run.smithi138.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T20:56:49.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:56:49.075 DEBUG:teuthology.orchestra.run.smithi138:> ls /sys/fs/fuse/connections 2024-04-26T20:56:49.131 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-26T20:56:49.131 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-04-26T20:56:49.182 DEBUG:teuthology.orchestra.run.smithi138:> sudo modprobe fuse 2024-04-26T20:56:49.202 DEBUG:teuthology.orchestra.run.smithi138:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T20:56:49.256 INFO:teuthology.orchestra.run.smithi138.stdout:/sys 2024-04-26T20:56:49.256 INFO:teuthology.orchestra.run.smithi138.stdout:/proc 2024-04-26T20:56:49.256 INFO:teuthology.orchestra.run.smithi138.stdout:/dev 2024-04-26T20:56:49.256 INFO:teuthology.orchestra.run.smithi138.stdout:/dev/pts 2024-04-26T20:56:49.256 INFO:teuthology.orchestra.run.smithi138.stdout:/run 2024-04-26T20:56:49.257 INFO:teuthology.orchestra.run.smithi138.stdout:/ 2024-04-26T20:56:49.257 INFO:teuthology.orchestra.run.smithi138.stdout:/sys/kernel/security 2024-04-26T20:56:49.257 INFO:teuthology.orchestra.run.smithi138.stdout:/dev/shm 2024-04-26T20:56:49.257 INFO:teuthology.orchestra.run.smithi138.stdout:/run/lock 2024-04-26T20:56:49.257 INFO:teuthology.orchestra.run.smithi138.stdout:/sys/fs/cgroup 2024-04-26T20:56:49.257 INFO:teuthology.orchestra.run.smithi138.stdout:/sys/fs/pstore 2024-04-26T20:56:49.257 INFO:teuthology.orchestra.run.smithi138.stdout:/sys/fs/bpf 2024-04-26T20:56:49.257 INFO:teuthology.orchestra.run.smithi138.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T20:56:49.257 INFO:teuthology.orchestra.run.smithi138.stdout:/dev/hugepages 2024-04-26T20:56:49.257 INFO:teuthology.orchestra.run.smithi138.stdout:/dev/mqueue 2024-04-26T20:56:49.257 INFO:teuthology.orchestra.run.smithi138.stdout:/sys/kernel/debug 2024-04-26T20:56:49.257 INFO:teuthology.orchestra.run.smithi138.stdout:/sys/kernel/tracing 2024-04-26T20:56:49.257 INFO:teuthology.orchestra.run.smithi138.stdout:/proc/fs/nfsd 2024-04-26T20:56:49.257 INFO:teuthology.orchestra.run.smithi138.stdout:/sys/fs/fuse/connections 2024-04-26T20:56:49.257 INFO:teuthology.orchestra.run.smithi138.stdout:/sys/kernel/config 2024-04-26T20:56:49.257 INFO:teuthology.orchestra.run.smithi138.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T20:56:49.258 INFO:teuthology.orchestra.run.smithi138.stdout:/run/rpc_pipefs 2024-04-26T20:56:49.258 INFO:teuthology.orchestra.run.smithi138.stdout:/run/user/1000 2024-04-26T20:56:49.258 INFO:teuthology.orchestra.run.smithi138.stdout:/var/lib/ceph 2024-04-26T20:56:49.258 INFO:teuthology.orchestra.run.smithi138.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T20:56:49.258 INFO:teuthology.orchestra.run.smithi138.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T20:56:49.258 INFO:teuthology.orchestra.run.smithi138.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T20:56:49.258 INFO:teuthology.orchestra.run.smithi138.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T20:56:49.258 INFO:teuthology.orchestra.run.smithi138.stdout:/run/netns 2024-04-26T20:56:49.258 INFO:teuthology.orchestra.run.smithi138.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T20:56:49.258 INFO:teuthology.orchestra.run.smithi138.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T20:56:49.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:56:49.259 DEBUG:teuthology.orchestra.run.smithi138:> ls /sys/fs/fuse/connections 2024-04-26T20:56:49.279 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi138.stderr:2024-04-26T20:56:49.274+0000 7f70112c8580 -1 init, newargv = 0x56538d114df0 newargc=15 2024-04-26T20:56:49.279 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi138.stderr:ceph-fuse[33876]: starting ceph client 2024-04-26T20:56:49.290 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi138.stderr:ceph-fuse[33876]: starting fuse 2024-04-26T20:56:50.389 DEBUG:teuthology.orchestra.run.smithi138:> sudo modprobe fuse 2024-04-26T20:56:50.413 DEBUG:teuthology.orchestra.run.smithi138:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T20:56:50.465 INFO:teuthology.orchestra.run.smithi138.stdout:/sys 2024-04-26T20:56:50.465 INFO:teuthology.orchestra.run.smithi138.stdout:/proc 2024-04-26T20:56:50.465 INFO:teuthology.orchestra.run.smithi138.stdout:/dev 2024-04-26T20:56:50.465 INFO:teuthology.orchestra.run.smithi138.stdout:/dev/pts 2024-04-26T20:56:50.465 INFO:teuthology.orchestra.run.smithi138.stdout:/run 2024-04-26T20:56:50.466 INFO:teuthology.orchestra.run.smithi138.stdout:/ 2024-04-26T20:56:50.466 INFO:teuthology.orchestra.run.smithi138.stdout:/sys/kernel/security 2024-04-26T20:56:50.466 INFO:teuthology.orchestra.run.smithi138.stdout:/dev/shm 2024-04-26T20:56:50.466 INFO:teuthology.orchestra.run.smithi138.stdout:/run/lock 2024-04-26T20:56:50.466 INFO:teuthology.orchestra.run.smithi138.stdout:/sys/fs/cgroup 2024-04-26T20:56:50.466 INFO:teuthology.orchestra.run.smithi138.stdout:/sys/fs/pstore 2024-04-26T20:56:50.466 INFO:teuthology.orchestra.run.smithi138.stdout:/sys/fs/bpf 2024-04-26T20:56:50.466 INFO:teuthology.orchestra.run.smithi138.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T20:56:50.466 INFO:teuthology.orchestra.run.smithi138.stdout:/dev/hugepages 2024-04-26T20:56:50.466 INFO:teuthology.orchestra.run.smithi138.stdout:/dev/mqueue 2024-04-26T20:56:50.466 INFO:teuthology.orchestra.run.smithi138.stdout:/sys/kernel/debug 2024-04-26T20:56:50.466 INFO:teuthology.orchestra.run.smithi138.stdout:/sys/kernel/tracing 2024-04-26T20:56:50.466 INFO:teuthology.orchestra.run.smithi138.stdout:/proc/fs/nfsd 2024-04-26T20:56:50.466 INFO:teuthology.orchestra.run.smithi138.stdout:/sys/fs/fuse/connections 2024-04-26T20:56:50.467 INFO:teuthology.orchestra.run.smithi138.stdout:/sys/kernel/config 2024-04-26T20:56:50.467 INFO:teuthology.orchestra.run.smithi138.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T20:56:50.467 INFO:teuthology.orchestra.run.smithi138.stdout:/run/rpc_pipefs 2024-04-26T20:56:50.467 INFO:teuthology.orchestra.run.smithi138.stdout:/run/user/1000 2024-04-26T20:56:50.467 INFO:teuthology.orchestra.run.smithi138.stdout:/var/lib/ceph 2024-04-26T20:56:50.467 INFO:teuthology.orchestra.run.smithi138.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T20:56:50.467 INFO:teuthology.orchestra.run.smithi138.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T20:56:50.467 INFO:teuthology.orchestra.run.smithi138.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T20:56:50.467 INFO:teuthology.orchestra.run.smithi138.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T20:56:50.467 INFO:teuthology.orchestra.run.smithi138.stdout:/run/netns 2024-04-26T20:56:50.467 INFO:teuthology.orchestra.run.smithi138.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T20:56:50.467 INFO:teuthology.orchestra.run.smithi138.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T20:56:50.470 INFO:teuthology.orchestra.run.smithi138.stdout:/home/ubuntu/cephtest/mnt.admin 2024-04-26T20:56:50.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:56:50.471 DEBUG:teuthology.orchestra.run.smithi138:> ls /sys/fs/fuse/connections 2024-04-26T20:56:50.523 INFO:teuthology.orchestra.run.smithi138.stdout:44 2024-04-26T20:56:50.524 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-04-26T20:56:50.524 DEBUG:teuthology.orchestra.run.smithi138:> sudo stdin-killer -- python3 -c ' 2024-04-26T20:56:50.524 DEBUG:teuthology.orchestra.run.smithi138:> import glob 2024-04-26T20:56:50.524 DEBUG:teuthology.orchestra.run.smithi138:> import re 2024-04-26T20:56:50.524 DEBUG:teuthology.orchestra.run.smithi138:> import os 2024-04-26T20:56:50.524 DEBUG:teuthology.orchestra.run.smithi138:> import subprocess 2024-04-26T20:56:50.524 DEBUG:teuthology.orchestra.run.smithi138:> 2024-04-26T20:56:50.524 DEBUG:teuthology.orchestra.run.smithi138:> def _find_admin_socket(client_name): 2024-04-26T20:56:50.524 DEBUG:teuthology.orchestra.run.smithi138:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-04-26T20:56:50.524 DEBUG:teuthology.orchestra.run.smithi138:> files = glob.glob(asok_path) 2024-04-26T20:56:50.524 DEBUG:teuthology.orchestra.run.smithi138:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-04-26T20:56:50.524 DEBUG:teuthology.orchestra.run.smithi138:> 2024-04-26T20:56:50.524 DEBUG:teuthology.orchestra.run.smithi138:> # Given a non-glob path, it better be there 2024-04-26T20:56:50.525 DEBUG:teuthology.orchestra.run.smithi138:> if "*" not in asok_path: 2024-04-26T20:56:50.525 DEBUG:teuthology.orchestra.run.smithi138:> assert(len(files) == 1) 2024-04-26T20:56:50.525 DEBUG:teuthology.orchestra.run.smithi138:> return files[0] 2024-04-26T20:56:50.525 DEBUG:teuthology.orchestra.run.smithi138:> 2024-04-26T20:56:50.525 DEBUG:teuthology.orchestra.run.smithi138:> for f in files: 2024-04-26T20:56:50.525 DEBUG:teuthology.orchestra.run.smithi138:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-26T20:56:50.525 DEBUG:teuthology.orchestra.run.smithi138:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-26T20:56:50.525 DEBUG:teuthology.orchestra.run.smithi138:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-26T20:56:50.525 DEBUG:teuthology.orchestra.run.smithi138:> contents = proc_f.read() 2024-04-26T20:56:50.525 DEBUG:teuthology.orchestra.run.smithi138:> if mountpoint in contents: 2024-04-26T20:56:50.525 DEBUG:teuthology.orchestra.run.smithi138:> return f 2024-04-26T20:56:50.525 DEBUG:teuthology.orchestra.run.smithi138:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-26T20:56:50.525 DEBUG:teuthology.orchestra.run.smithi138:> 2024-04-26T20:56:50.525 DEBUG:teuthology.orchestra.run.smithi138:> print(_find_admin_socket("client.admin")) 2024-04-26T20:56:50.525 DEBUG:teuthology.orchestra.run.smithi138:> ' 2024-04-26T20:56:50.660 INFO:teuthology.orchestra.run.smithi138.stdout:/var/run/ceph/ceph-client.admin.33876.asok 2024-04-26T20:56:50.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:56:50.674 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.33876.asok 2024-04-26T20:56:50.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:56:50.674 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.33876.asok status 2024-04-26T20:56:50.846 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-26T20:56:50.847 INFO:teuthology.orchestra.run.smithi138.stdout: "metadata": { 2024-04-26T20:56:50.847 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph_sha1": "bc612ffb9c1d5bc27536bc917a705262a36d4387", 2024-04-26T20:56:50.847 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph_version": "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)", 2024-04-26T20:56:50.847 INFO:teuthology.orchestra.run.smithi138.stdout: "entity_id": "admin", 2024-04-26T20:56:50.847 INFO:teuthology.orchestra.run.smithi138.stdout: "hostname": "smithi138", 2024-04-26T20:56:50.847 INFO:teuthology.orchestra.run.smithi138.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-04-26T20:56:50.847 INFO:teuthology.orchestra.run.smithi138.stdout: "pid": "33876", 2024-04-26T20:56:50.847 INFO:teuthology.orchestra.run.smithi138.stdout: "root": "/" 2024-04-26T20:56:50.847 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-26T20:56:50.847 INFO:teuthology.orchestra.run.smithi138.stdout: "dentry_count": 0, 2024-04-26T20:56:50.847 INFO:teuthology.orchestra.run.smithi138.stdout: "dentry_pinned_count": 0, 2024-04-26T20:56:50.847 INFO:teuthology.orchestra.run.smithi138.stdout: "id": 4431, 2024-04-26T20:56:50.847 INFO:teuthology.orchestra.run.smithi138.stdout: "inst": { 2024-04-26T20:56:50.847 INFO:teuthology.orchestra.run.smithi138.stdout: "name": { 2024-04-26T20:56:50.848 INFO:teuthology.orchestra.run.smithi138.stdout: "type": "client", 2024-04-26T20:56:50.848 INFO:teuthology.orchestra.run.smithi138.stdout: "num": 4431 2024-04-26T20:56:50.848 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-26T20:56:50.848 INFO:teuthology.orchestra.run.smithi138.stdout: "addr": { 2024-04-26T20:56:50.848 INFO:teuthology.orchestra.run.smithi138.stdout: "type": "v1", 2024-04-26T20:56:50.848 INFO:teuthology.orchestra.run.smithi138.stdout: "addr": "192.168.0.1:0", 2024-04-26T20:56:50.848 INFO:teuthology.orchestra.run.smithi138.stdout: "nonce": 1633223309 2024-04-26T20:56:50.848 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-26T20:56:50.848 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-26T20:56:50.848 INFO:teuthology.orchestra.run.smithi138.stdout: "addr": { 2024-04-26T20:56:50.848 INFO:teuthology.orchestra.run.smithi138.stdout: "type": "v1", 2024-04-26T20:56:50.848 INFO:teuthology.orchestra.run.smithi138.stdout: "addr": "192.168.0.1:0", 2024-04-26T20:56:50.848 INFO:teuthology.orchestra.run.smithi138.stdout: "nonce": 1633223309 2024-04-26T20:56:50.848 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-26T20:56:50.848 INFO:teuthology.orchestra.run.smithi138.stdout: "inst_str": "client.4431 192.168.0.1:0/1633223309", 2024-04-26T20:56:50.848 INFO:teuthology.orchestra.run.smithi138.stdout: "addr_str": "192.168.0.1:0/1633223309", 2024-04-26T20:56:50.849 INFO:teuthology.orchestra.run.smithi138.stdout: "inode_count": 1, 2024-04-26T20:56:50.849 INFO:teuthology.orchestra.run.smithi138.stdout: "mds_epoch": 7, 2024-04-26T20:56:50.849 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_epoch": 27, 2024-04-26T20:56:50.849 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_epoch_barrier": 0, 2024-04-26T20:56:50.849 INFO:teuthology.orchestra.run.smithi138.stdout: "blocklisted": false, 2024-04-26T20:56:50.849 INFO:teuthology.orchestra.run.smithi138.stdout: "fs_name": "cephfs" 2024-04-26T20:56:50.849 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-26T20:56:50.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:56:50.861 DEBUG:teuthology.orchestra.run.smithi138:> stat --file-system '--printf=%T 2024-04-26T20:56:50.861 DEBUG:teuthology.orchestra.run.smithi138:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-04-26T20:56:50.871 INFO:teuthology.orchestra.run.smithi138.stdout:fuseblk 2024-04-26T20:56:50.871 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-04-26T20:56:50.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:56:50.871 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-04-26T20:56:50.935 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-04-26T20:56:51.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T20:56:51.056 INFO:teuthology.orchestra.run.smithi138.stdout:# file: . 2024-04-26T20:56:51.056 INFO:teuthology.orchestra.run.smithi138.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-04-26T20:56:51.056 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:56:51.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:56:51.064 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-26T20:56:51.064 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T20:56:51.073 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:56:51.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.245+0000 7f42aae00640 1 Processor -- start 2024-04-26T20:56:51.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.245+0000 7f42aae00640 1 -- start start 2024-04-26T20:56:51.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.245+0000 7f42aae00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42a40cee00 0x7f42a40cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:51.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.245+0000 7f42aae00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42a40ccb60 con 0x7f42a415f2b0 2024-04-26T20:56:51.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.245+0000 7f42aae00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42a40cce40 con 0x7f42a40ae8c0 2024-04-26T20:56:51.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.245+0000 7f42aae00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f42a415f690 con 0x7f42a40cee00 2024-04-26T20:56:51.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.249+0000 7f42a3e00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f42a415f2b0 0x7f42a41637d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:58390/0 (socket says 172.21.15.138:58390) 2024-04-26T20:56:51.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.249+0000 7f42a3e00640 1 -- 172.21.15.138:0/2509414570 learned_addr learned my addr 172.21.15.138:0/2509414570 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:56:51.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.249+0000 7f42a8e00640 1 --2- 172.21.15.138:0/2509414570 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42a40cee00 0x7f42a40cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:51.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.249+0000 7f42a3400640 1 -- 172.21.15.138:0/2509414570 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 577873412 0 0) 0x7f42a40ccb60 con 0x7f42a415f2b0 2024-04-26T20:56:51.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.249+0000 7f42a3400640 1 -- 172.21.15.138:0/2509414570 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4288003530 con 0x7f42a415f2b0 2024-04-26T20:56:51.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.249+0000 7f42a3400640 1 -- 172.21.15.138:0/2509414570 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 673300079 0 0) 0x7f42a40cce40 con 0x7f42a40ae8c0 2024-04-26T20:56:51.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.249+0000 7f42a3400640 1 -- 172.21.15.138:0/2509414570 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42a40ccb60 con 0x7f42a40ae8c0 2024-04-26T20:56:51.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.249+0000 7f42a3400640 1 -- 172.21.15.138:0/2509414570 <== mon.0 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1710947862 0 0) 0x7f4288003530 con 0x7f42a415f2b0 2024-04-26T20:56:51.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.249+0000 7f42a3400640 1 -- 172.21.15.138:0/2509414570 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42a40cee00 msgr2=0x7f42a40cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:51.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.249+0000 7f42a3400640 1 --2- 172.21.15.138:0/2509414570 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42a40cee00 0x7f42a40cbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:51.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.249+0000 7f42a3400640 1 -- 172.21.15.138:0/2509414570 >> v1:172.21.15.143:6789/0 conn(0x7f42a40ae8c0 legacy=0x7f42a40ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:51.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.249+0000 7f42a3400640 1 -- 172.21.15.138:0/2509414570 --> v1:172.21.15.138:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42a40cb2a0 con 0x7f42a415f2b0 2024-04-26T20:56:51.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.249+0000 7f42a3400640 1 -- 172.21.15.138:0/2509414570 <== mon.0 v1:172.21.15.138:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2715389689 0 0) 0x7f4294001a00 con 0x7f42a415f2b0 2024-04-26T20:56:51.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.249+0000 7f42a3400640 1 -- 172.21.15.138:0/2509414570 >> v1:172.21.15.138:6789/0 conn(0x7f42a415f2b0 legacy=0x7f42a41637d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:51.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.249+0000 7f42a3400640 1 --2- 172.21.15.138:0/2509414570 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4288003b80 0x7f4288003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:51.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.249+0000 7f42a3400640 1 --2- 172.21.15.138:0/2509414570 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4288004810 0x7f4288004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:51.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.249+0000 7f42a3400640 1 --2- 172.21.15.138:0/2509414570 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42a40cee00 0x7f42880051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:51.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.249+0000 7f42a3400640 1 -- 172.21.15.138:0/2509414570 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f42a415f690 con 0x7f4288003b80 2024-04-26T20:56:51.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.249+0000 7f42a3400640 1 -- 172.21.15.138:0/2509414570 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f428800bb10 con 0x7f4288004810 2024-04-26T20:56:51.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.249+0000 7f42a3400640 1 -- 172.21.15.138:0/2509414570 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f428800bd10 con 0x7f42a40cee00 2024-04-26T20:56:51.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.249+0000 7f42a3e00640 1 --2- 172.21.15.138:0/2509414570 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4288003b80 0x7f4288003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:51.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.249+0000 7f429b400640 1 --2- 172.21.15.138:0/2509414570 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4288004810 0x7f4288004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:51.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.249+0000 7f42a8e00640 1 --2- 172.21.15.138:0/2509414570 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42a40cee00 0x7f42880051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:51.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.249+0000 7f42a3e00640 1 -- 172.21.15.138:0/2509414570 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42a40cee00 msgr2=0x7f42880051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:51.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.249+0000 7f42a3e00640 1 --2- 172.21.15.138:0/2509414570 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42a40cee00 0x7f42880051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:51.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.249+0000 7f42a3e00640 1 -- 172.21.15.138:0/2509414570 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4288004810 msgr2=0x7f4288004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:51.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.249+0000 7f42a3e00640 1 --2- 172.21.15.138:0/2509414570 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4288004810 0x7f4288004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:51.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.249+0000 7f42a3e00640 1 -- 172.21.15.138:0/2509414570 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4288003530 con 0x7f4288003b80 2024-04-26T20:56:51.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.249+0000 7f42a8e00640 1 --2- 172.21.15.138:0/2509414570 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42a40cee00 0x7f42880051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:56:51.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.253+0000 7f42a3e00640 1 --2- 172.21.15.138:0/2509414570 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4288003b80 0x7f4288003f80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f429400a820 tx=0x7f429401d320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7db9c770e8c442df server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:51.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.253+0000 7f42a3400640 1 -- 172.21.15.138:0/2509414570 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429400a450 con 0x7f4288003b80 2024-04-26T20:56:51.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.253+0000 7f42a3400640 1 -- 172.21.15.138:0/2509414570 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42940072d0 con 0x7f4288003b80 2024-04-26T20:56:51.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.253+0000 7f42a3400640 1 -- 172.21.15.138:0/2509414570 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42940076c0 con 0x7f4288003b80 2024-04-26T20:56:51.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.253+0000 7f42aae00640 1 -- 172.21.15.138:0/2509414570 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4288003b80 msgr2=0x7f4288003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:51.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.253+0000 7f42aae00640 1 --2- 172.21.15.138:0/2509414570 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4288003b80 0x7f4288003f80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f429400a820 tx=0x7f429401d320 comp rx=0 tx=0).stop 2024-04-26T20:56:51.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.253+0000 7f42a8e00640 1 -- 172.21.15.138:0/2509414570 reap_dead start 2024-04-26T20:56:51.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.253+0000 7f42aae00640 1 -- 172.21.15.138:0/2509414570 shutdown_connections 2024-04-26T20:56:51.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.253+0000 7f42aae00640 1 -- 172.21.15.138:0/2509414570 >> 172.21.15.138:0/2509414570 conn(0x7f42a40d0b20 msgr2=0x7f42a40d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:51.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.253+0000 7f42aae00640 1 -- 172.21.15.138:0/2509414570 shutdown_connections 2024-04-26T20:56:51.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.253+0000 7f42aae00640 1 -- 172.21.15.138:0/2509414570 wait complete. 2024-04-26T20:56:51.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.253+0000 7f42aae00640 1 Processor -- start 2024-04-26T20:56:51.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.253+0000 7f42aae00640 1 -- start start 2024-04-26T20:56:51.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.257+0000 7f42aae00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4288003b80 0x7f42a4150aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:51.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.257+0000 7f42aae00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42a415e040 0x7f42a415e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:51.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.257+0000 7f42aae00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42a40c6c40 0x7f42a40c70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:51.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.257+0000 7f42aae00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f42a416b160 con 0x7f42a40c6c40 2024-04-26T20:56:51.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.257+0000 7f42aae00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f42a40cc560 con 0x7f42a415e040 2024-04-26T20:56:51.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.257+0000 7f42aae00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f42a416b2e0 con 0x7f4288003b80 2024-04-26T20:56:51.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.257+0000 7f42a8e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42a40c6c40 0x7f42a40c70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:51.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.257+0000 7f42a3e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4288003b80 0x7f42a4150aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:51.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.257+0000 7f42a3e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4288003b80 0x7f42a4150aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.138:48858/0 (socket says 172.21.15.138:48858) 2024-04-26T20:56:51.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.257+0000 7f42a8e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42a40c6c40 0x7f42a40c70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:55346/0 (socket says 172.21.15.138:55346) 2024-04-26T20:56:51.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.257+0000 7f42a3e00640 1 -- 172.21.15.138:0/3268481317 learned_addr learned my addr 172.21.15.138:0/3268481317 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:51.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.257+0000 7f429b400640 1 --2- 172.21.15.138:0/3268481317 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42a415e040 0x7f42a415e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:51.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.257+0000 7f42a8e00640 1 -- 172.21.15.138:0/3268481317 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4288003b80 msgr2=0x7f42a4150aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:51.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.257+0000 7f42a8e00640 1 --2- 172.21.15.138:0/3268481317 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4288003b80 0x7f42a4150aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:51.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.257+0000 7f42a8e00640 1 -- 172.21.15.138:0/3268481317 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42a415e040 msgr2=0x7f42a415e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:51.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.257+0000 7f42a8e00640 1 --2- 172.21.15.138:0/3268481317 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42a415e040 0x7f42a415e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:51.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.257+0000 7f42a8e00640 1 -- 172.21.15.138:0/3268481317 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42a40c9eb0 con 0x7f42a40c6c40 2024-04-26T20:56:51.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.257+0000 7f42a8e00640 1 --2- 172.21.15.138:0/3268481317 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42a40c6c40 0x7f42a40c70c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f42a40b0450 tx=0x7f429c011860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:51.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.257+0000 7f42a0c00640 1 -- 172.21.15.138:0/3268481317 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429c01d070 con 0x7f42a40c6c40 2024-04-26T20:56:51.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.257+0000 7f42a0c00640 1 -- 172.21.15.138:0/3268481317 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f429c004250 con 0x7f42a40c6c40 2024-04-26T20:56:51.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.257+0000 7f42a0c00640 1 -- 172.21.15.138:0/3268481317 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429c015670 con 0x7f42a40c6c40 2024-04-26T20:56:51.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.257+0000 7f42aae00640 1 -- 172.21.15.138:0/3268481317 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42a40ca190 con 0x7f42a40c6c40 2024-04-26T20:56:51.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.257+0000 7f42aae00640 1 -- 172.21.15.138:0/3268481317 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42a40ca750 con 0x7f42a40c6c40 2024-04-26T20:56:51.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.257+0000 7f42aae00640 1 -- 172.21.15.138:0/3268481317 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42a4069510 con 0x7f42a40c6c40 2024-04-26T20:56:51.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.257+0000 7f42a0c00640 1 -- 172.21.15.138:0/3268481317 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f429c020070 con 0x7f42a40c6c40 2024-04-26T20:56:51.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.261+0000 7f42a0c00640 1 --2- 172.21.15.138:0/3268481317 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4280068380 0x7f428006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:51.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.261+0000 7f42a0c00640 1 -- 172.21.15.138:0/3268481317 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f429c086640 con 0x7f42a40c6c40 2024-04-26T20:56:51.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.261+0000 7f42a3e00640 1 --2- 172.21.15.138:0/3268481317 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4280068380 0x7f428006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:51.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.261+0000 7f42a3e00640 1 --2- 172.21.15.138:0/3268481317 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4280068380 0x7f428006a840 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f429401d360 tx=0x7f4294001dc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:51.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.265+0000 7f42a0c00640 1 -- 172.21.15.138:0/3268481317 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f429c027080 con 0x7f42a40c6c40 2024-04-26T20:56:51.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.425+0000 7f42aae00640 1 -- 172.21.15.138:0/3268481317 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f42a40c4650 con 0x7f42a40c6c40 2024-04-26T20:56:51.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.425+0000 7f42a0c00640 1 -- 172.21.15.138:0/3268481317 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18578 (secure 0 0 0) 0x7f429c056250 con 0x7f42a40c6c40 2024-04-26T20:56:51.429 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:56:51.429 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":27,"fsid":"c22b4730-12cc-4558-8535-b965384398c0","created":"2024-04-26T20:56:14.182475+0000","modified":"2024-04-26T20:56:44.633968+0000","last_up_change":"2024-04-26T20:56:26.013243+0000","last_in_change":"2024-04-26T20:56:16.714055+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:56:27.265834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:56:37.394398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:56:38.544369+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:56:42.240243+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3f9a2e34-3199-466f-a6cf-57927318121e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6801","nonce":3534772245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6803","nonce":3534772245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6807","nonce":3534772245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6805","nonce":3534772245}]},"public_addr":"172.21.15.138:6801/3534772245","cluster_addr":"172.21.15.138:6803/3534772245","heartbeat_back_addr":"172.21.15.138:6807/3534772245","heartbeat_front_addr":"172.21.15.138:6805/3534772245","state":["exists","up"]},{"osd":1,"uuid":"e881fcf6-3248-4696-a2ef-95d206d77712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6817","nonce":1427635773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6819","nonce":1427635773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6823","nonce":1427635773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6821","nonce":1427635773}]},"public_addr":"172.21.15.138:6817/1427635773","cluster_addr":"172.21.15.138:6819/1427635773","heartbeat_back_addr":"172.21.15.138:6823/1427635773","heartbeat_front_addr":"172.21.15.138:6821/1427635773","state":["exists","up"]},{"osd":2,"uuid":"f7d1db33-7672-4699-ae47-9f1e0a8e4222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6809","nonce":4273721573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6811","nonce":4273721573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6815","nonce":4273721573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6813","nonce":4273721573}]},"public_addr":"172.21.15.138:6809/4273721573","cluster_addr":"172.21.15.138:6811/4273721573","heartbeat_back_addr":"172.21.15.138:6815/4273721573","heartbeat_front_addr":"172.21.15.138:6813/4273721573","state":["exists","up"]},{"osd":3,"uuid":"2f4e0a9a-b8f6-4468-844a-a4501cd85054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6825","nonce":3098242154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6827","nonce":3098242154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6831","nonce":3098242154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6829","nonce":3098242154}]},"public_addr":"172.21.15.138:6825/3098242154","cluster_addr":"172.21.15.138:6827/3098242154","heartbeat_back_addr":"172.21.15.138:6831/3098242154","heartbeat_front_addr":"172.21.15.138:6829/3098242154","state":["exists","up"]},{"osd":4,"uuid":"c85df99b-3624-410e-866b-86830af2cfe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6801","nonce":2942056312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6803","nonce":2942056312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6807","nonce":2942056312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6805","nonce":2942056312}]},"public_addr":"172.21.15.143:6801/2942056312","cluster_addr":"172.21.15.143:6803/2942056312","heartbeat_back_addr":"172.21.15.143:6807/2942056312","heartbeat_front_addr":"172.21.15.143:6805/2942056312","state":["exists","up"]},{"osd":5,"uuid":"9af1efb5-c416-4808-b5ef-de0679ab9705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6809","nonce":1910222887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6811","nonce":1910222887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6815","nonce":1910222887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6813","nonce":1910222887}]},"public_addr":"172.21.15.143:6809/1910222887","cluster_addr":"172.21.15.143:6811/1910222887","heartbeat_back_addr":"172.21.15.143:6815/1910222887","heartbeat_front_addr":"172.21.15.143:6813/1910222887","state":["exists","up"]},{"osd":6,"uuid":"d7138615-8838-45ff-9072-2fd0683362f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6817","nonce":1082239825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6819","nonce":1082239825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6823","nonce":1082239825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6821","nonce":1082239825}]},"public_addr":"172.21.15.143:6817/1082239825","cluster_addr":"172.21.15.143:6819/1082239825","heartbeat_back_addr":"172.21.15.143:6823/1082239825","heartbeat_front_addr":"172.21.15.143:6821/1082239825","state":["exists","up"]},{"osd":7,"uuid":"0c27172b-35c4-49ec-ba0b-0137b8ff0010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6825","nonce":3295508495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6827","nonce":3295508495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6831","nonce":3295508495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6829","nonce":3295508495}]},"public_addr":"172.21.15.143:6825/3295508495","cluster_addr":"172.21.15.143:6827/3295508495","heartbeat_back_addr":"172.21.15.143:6831/3295508495","heartbeat_front_addr":"172.21.15.143:6829/3295508495","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.326627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.396119+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.433915+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.414179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.216947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.329272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.503073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.436382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:56:51.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.425+0000 7f42aae00640 1 -- 172.21.15.138:0/3268481317 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4280068380 msgr2=0x7f428006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:51.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.425+0000 7f42aae00640 1 --2- 172.21.15.138:0/3268481317 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4280068380 0x7f428006a840 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f429401d360 tx=0x7f4294001dc0 comp rx=0 tx=0).stop 2024-04-26T20:56:51.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.425+0000 7f42aae00640 1 -- 172.21.15.138:0/3268481317 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42a40c6c40 msgr2=0x7f42a40c70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:51.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.425+0000 7f42aae00640 1 --2- 172.21.15.138:0/3268481317 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42a40c6c40 0x7f42a40c70c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f42a40b0450 tx=0x7f429c011860 comp rx=0 tx=0).stop 2024-04-26T20:56:51.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.425+0000 7f42aae00640 1 -- 172.21.15.138:0/3268481317 shutdown_connections 2024-04-26T20:56:51.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.425+0000 7f42aae00640 1 --2- 172.21.15.138:0/3268481317 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4280068380 0x7f428006a840 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:51.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.425+0000 7f42aae00640 1 --2- 172.21.15.138:0/3268481317 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42a40c6c40 0x7f42a40c70c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:51.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.425+0000 7f42aae00640 1 --2- 172.21.15.138:0/3268481317 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42a415e040 0x7f42a415e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:51.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.425+0000 7f42aae00640 1 --2- 172.21.15.138:0/3268481317 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4288003b80 0x7f42a4150aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:51.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.425+0000 7f42aae00640 1 -- 172.21.15.138:0/3268481317 >> 172.21.15.138:0/3268481317 conn(0x7f42a40d0b20 msgr2=0x7f42a40af9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:51.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.425+0000 7f42aae00640 1 -- 172.21.15.138:0/3268481317 shutdown_connections 2024-04-26T20:56:51.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.425+0000 7f42aae00640 1 -- 172.21.15.138:0/3268481317 wait complete. 2024-04-26T20:56:51.451 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:56:27.265834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T20:56:37.394398+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T20:56:38.544369+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T20:56:42.240243+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T20:56:51.451 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T20:56:51.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.585+0000 7f2d3fe00640 1 Processor -- start 2024-04-26T20:56:51.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.585+0000 7f2d3fe00640 1 -- start start 2024-04-26T20:56:51.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.589+0000 7f2d3fe00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f2d40155ed0 0x7f2d40072c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:51.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.589+0000 7f2d3fe00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2d401562b0 0x7f2d40162d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:51.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.589+0000 7f2d3fe00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d400707a0 con 0x7f2d4006fe50 2024-04-26T20:56:51.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.589+0000 7f2d3fe00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f2d400731c0 con 0x7f2d401562b0 2024-04-26T20:56:51.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.589+0000 7f2d3fe00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f2d4006f550 con 0x7f2d40155ed0 2024-04-26T20:56:51.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.589+0000 7f2d3f400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2d401562b0 0x7f2d40162d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:51.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.589+0000 7f2d3f400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2d401562b0 0x7f2d40162d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:55358/0 (socket says 172.21.15.138:55358) 2024-04-26T20:56:51.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.589+0000 7f2d3f400640 1 -- 172.21.15.138:0/2104408052 learned_addr learned my addr 172.21.15.138:0/2104408052 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:51.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.589+0000 7f2d3ea00640 1 --2- 172.21.15.138:0/2104408052 >> v2:172.21.15.143:3300/0 conn(0x7f2d40155ed0 0x7f2d40072c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:51.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.589+0000 7f2d3f400640 1 -- 172.21.15.138:0/2104408052 >> v2:172.21.15.143:3300/0 conn(0x7f2d40155ed0 msgr2=0x7f2d40072c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:51.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.589+0000 7f2d3f400640 1 --2- 172.21.15.138:0/2104408052 >> v2:172.21.15.143:3300/0 conn(0x7f2d40155ed0 0x7f2d40072c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:51.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.589+0000 7f2d3f400640 1 -- 172.21.15.138:0/2104408052 >> v1:172.21.15.143:6789/0 conn(0x7f2d4006fe50 legacy=0x7f2d4006ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:51.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.589+0000 7f2d3f400640 1 -- 172.21.15.138:0/2104408052 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d40071ec0 con 0x7f2d401562b0 2024-04-26T20:56:51.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.589+0000 7f2d3f400640 1 --2- 172.21.15.138:0/2104408052 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2d401562b0 0x7f2d40162d10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2d40074570 tx=0x7f2d3801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f899c7b88dd1f09 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:51.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.593+0000 7f2d3d600640 1 -- 172.21.15.138:0/2104408052 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d380b0070 con 0x7f2d401562b0 2024-04-26T20:56:51.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.593+0000 7f2d3d600640 1 -- 172.21.15.138:0/2104408052 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d380ab600 con 0x7f2d401562b0 2024-04-26T20:56:51.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.593+0000 7f2d3d600640 1 -- 172.21.15.138:0/2104408052 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d380ab9d0 con 0x7f2d401562b0 2024-04-26T20:56:51.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.593+0000 7f2d3fe00640 1 -- 172.21.15.138:0/2104408052 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2d401562b0 msgr2=0x7f2d40162d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:51.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.593+0000 7f2d3fe00640 1 --2- 172.21.15.138:0/2104408052 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2d401562b0 0x7f2d40162d10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2d40074570 tx=0x7f2d3801c400 comp rx=0 tx=0).stop 2024-04-26T20:56:51.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.593+0000 7f2d3fe00640 1 -- 172.21.15.138:0/2104408052 shutdown_connections 2024-04-26T20:56:51.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.593+0000 7f2d3fe00640 1 --2- 172.21.15.138:0/2104408052 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2d401562b0 0x7f2d40162d10 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:51.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.593+0000 7f2d3fe00640 1 --2- 172.21.15.138:0/2104408052 >> v2:172.21.15.143:3300/0 conn(0x7f2d40155ed0 0x7f2d40072c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:51.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.593+0000 7f2d3fe00640 1 -- 172.21.15.138:0/2104408052 >> 172.21.15.138:0/2104408052 conn(0x7f2d400b25c0 msgr2=0x7f2d400b29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:51.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.593+0000 7f2d3fe00640 1 -- 172.21.15.138:0/2104408052 shutdown_connections 2024-04-26T20:56:51.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.593+0000 7f2d3fe00640 1 -- 172.21.15.138:0/2104408052 wait complete. 2024-04-26T20:56:51.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.593+0000 7f2d3fe00640 1 Processor -- start 2024-04-26T20:56:51.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.593+0000 7f2d3fe00640 1 -- start start 2024-04-26T20:56:51.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.593+0000 7f2d3fe00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d4006fe50 0x7f2d40152180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:51.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.593+0000 7f2d3fe00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2d40155ed0 0x7f2d4015f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:51.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.593+0000 7f2d3fe00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2d401562b0 0x7f2d4015fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:51.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.593+0000 7f2d3fe00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f2d400b4e00 con 0x7f2d401562b0 2024-04-26T20:56:51.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.593+0000 7f2d3fe00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f2d400b4c80 con 0x7f2d4006fe50 2024-04-26T20:56:51.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.593+0000 7f2d3fe00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f2d400b4f80 con 0x7f2d40155ed0 2024-04-26T20:56:51.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.593+0000 7f2d3f400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2d401562b0 0x7f2d4015fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:51.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.593+0000 7f2d3f400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2d401562b0 0x7f2d4015fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:55362/0 (socket says 172.21.15.138:55362) 2024-04-26T20:56:51.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.593+0000 7f2d3f400640 1 -- 172.21.15.138:0/1776403640 learned_addr learned my addr 172.21.15.138:0/1776403640 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:51.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.593+0000 7f2d3ea00640 1 --2- 172.21.15.138:0/1776403640 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d4006fe50 0x7f2d40152180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:51.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.597+0000 7f2d3e000640 1 --2- 172.21.15.138:0/1776403640 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2d40155ed0 0x7f2d4015f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:51.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.597+0000 7f2d3f400640 1 -- 172.21.15.138:0/1776403640 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2d40155ed0 msgr2=0x7f2d4015f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:51.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.597+0000 7f2d3f400640 1 --2- 172.21.15.138:0/1776403640 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2d40155ed0 0x7f2d4015f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:51.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.597+0000 7f2d3f400640 1 -- 172.21.15.138:0/1776403640 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d4006fe50 msgr2=0x7f2d40152180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:51.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.597+0000 7f2d3f400640 1 --2- 172.21.15.138:0/1776403640 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d4006fe50 0x7f2d40152180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:51.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.597+0000 7f2d3f400640 1 -- 172.21.15.138:0/1776403640 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d40156c20 con 0x7f2d401562b0 2024-04-26T20:56:51.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.597+0000 7f2d3f400640 1 --2- 172.21.15.138:0/1776403640 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2d401562b0 0x7f2d4015fc60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2d38019010 tx=0x7f2d380191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:51.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.597+0000 7f2d37400640 1 -- 172.21.15.138:0/1776403640 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d380b0040 con 0x7f2d401562b0 2024-04-26T20:56:51.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.597+0000 7f2d37400640 1 -- 172.21.15.138:0/1776403640 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d380b4420 con 0x7f2d401562b0 2024-04-26T20:56:51.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.597+0000 7f2d3fe00640 1 -- 172.21.15.138:0/1776403640 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d40156f00 con 0x7f2d401562b0 2024-04-26T20:56:51.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.597+0000 7f2d37400640 1 -- 172.21.15.138:0/1776403640 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d380b47d0 con 0x7f2d401562b0 2024-04-26T20:56:51.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.597+0000 7f2d3fe00640 1 -- 172.21.15.138:0/1776403640 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d401574c0 con 0x7f2d401562b0 2024-04-26T20:56:51.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.597+0000 7f2d3fe00640 1 -- 172.21.15.138:0/1776403640 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d40069430 con 0x7f2d401562b0 2024-04-26T20:56:51.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.597+0000 7f2d37400640 1 -- 172.21.15.138:0/1776403640 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2d380b4970 con 0x7f2d401562b0 2024-04-26T20:56:51.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.597+0000 7f2d37400640 1 --2- 172.21.15.138:0/1776403640 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f2d200683b0 0x7f2d2006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:51.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.601+0000 7f2d37400640 1 -- 172.21.15.138:0/1776403640 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f2d38120820 con 0x7f2d401562b0 2024-04-26T20:56:51.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.601+0000 7f2d3ea00640 1 --2- 172.21.15.138:0/1776403640 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f2d200683b0 0x7f2d2006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:51.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.601+0000 7f2d3ea00640 1 --2- 172.21.15.138:0/1776403640 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f2d200683b0 0x7f2d2006a870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2d400b2f00 tx=0x7f2d300098d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:51.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.601+0000 7f2d37400640 1 -- 172.21.15.138:0/1776403640 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2d38016110 con 0x7f2d401562b0 2024-04-26T20:56:51.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.757+0000 7f2d3fe00640 1 -- 172.21.15.138:0/1776403640 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2d4015f1c0 con 0x7f2d401562b0 2024-04-26T20:56:51.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.757+0000 7f2d37400640 1 -- 172.21.15.138:0/1776403640 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f2d380f0440 con 0x7f2d401562b0 2024-04-26T20:56:51.762 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 1 2024-04-26T20:56:51.764 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.761+0000 7f2d3fe00640 1 -- 172.21.15.138:0/1776403640 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f2d200683b0 msgr2=0x7f2d2006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:51.764 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.761+0000 7f2d3fe00640 1 --2- 172.21.15.138:0/1776403640 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f2d200683b0 0x7f2d2006a870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2d400b2f00 tx=0x7f2d300098d0 comp rx=0 tx=0).stop 2024-04-26T20:56:51.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.761+0000 7f2d3fe00640 1 -- 172.21.15.138:0/1776403640 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2d401562b0 msgr2=0x7f2d4015fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:51.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.761+0000 7f2d3fe00640 1 --2- 172.21.15.138:0/1776403640 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2d401562b0 0x7f2d4015fc60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2d38019010 tx=0x7f2d380191a0 comp rx=0 tx=0).stop 2024-04-26T20:56:51.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.761+0000 7f2d3fe00640 1 -- 172.21.15.138:0/1776403640 shutdown_connections 2024-04-26T20:56:51.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.761+0000 7f2d3fe00640 1 --2- 172.21.15.138:0/1776403640 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f2d200683b0 0x7f2d2006a870 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:51.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.761+0000 7f2d3fe00640 1 --2- 172.21.15.138:0/1776403640 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2d401562b0 0x7f2d4015fc60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:51.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.761+0000 7f2d3fe00640 1 --2- 172.21.15.138:0/1776403640 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2d40155ed0 0x7f2d4015f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:51.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.761+0000 7f2d3fe00640 1 --2- 172.21.15.138:0/1776403640 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d4006fe50 0x7f2d40152180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:51.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.761+0000 7f2d3fe00640 1 -- 172.21.15.138:0/1776403640 >> 172.21.15.138:0/1776403640 conn(0x7f2d400b25c0 msgr2=0x7f2d4006e720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:51.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.761+0000 7f2d3fe00640 1 -- 172.21.15.138:0/1776403640 shutdown_connections 2024-04-26T20:56:51.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.761+0000 7f2d3fe00640 1 -- 172.21.15.138:0/1776403640 wait complete. 2024-04-26T20:56:51.784 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T20:56:51.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.917+0000 7f6c23000640 1 Processor -- start 2024-04-26T20:56:51.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.917+0000 7f6c23000640 1 -- start start 2024-04-26T20:56:51.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.917+0000 7f6c23000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f6c1c15efe0 0x7f6c1c06c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:51.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.917+0000 7f6c23000640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6c1c0cd6d0 0x7f6c1c0c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:51.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.917+0000 7f6c23000640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c1c0cbab0 con 0x7f6c1c0cf240 2024-04-26T20:56:51.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.917+0000 7f6c23000640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f6c1c163940 con 0x7f6c1c15efe0 2024-04-26T20:56:51.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.917+0000 7f6c23000640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f6c1c0cbd30 con 0x7f6c1c0cd6d0 2024-04-26T20:56:51.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.921+0000 7f6c1be00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f6c1c15efe0 0x7f6c1c06c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:51.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.921+0000 7f6c1be00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f6c1c15efe0 0x7f6c1c06c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:55378/0 (socket says 172.21.15.138:55378) 2024-04-26T20:56:51.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.921+0000 7f6c1be00640 1 -- 172.21.15.138:0/2653104590 learned_addr learned my addr 172.21.15.138:0/2653104590 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:51.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.921+0000 7f6c1be00640 1 -- 172.21.15.138:0/2653104590 >> v2:172.21.15.143:3300/0 conn(0x7f6c1c0cd6d0 msgr2=0x7f6c1c0c7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:51.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.921+0000 7f6c1b400640 1 --2- 172.21.15.138:0/2653104590 >> v2:172.21.15.143:3300/0 conn(0x7f6c1c0cd6d0 0x7f6c1c0c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:51.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.921+0000 7f6c1be00640 1 --2- 172.21.15.138:0/2653104590 >> v2:172.21.15.143:3300/0 conn(0x7f6c1c0cd6d0 0x7f6c1c0c7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:51.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.921+0000 7f6c1be00640 1 -- 172.21.15.138:0/2653104590 >> v1:172.21.15.143:6789/0 conn(0x7f6c1c0cf240 legacy=0x7f6c1c0cc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:51.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.921+0000 7f6c1be00640 1 -- 172.21.15.138:0/2653104590 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c1c0cc010 con 0x7f6c1c15efe0 2024-04-26T20:56:51.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.921+0000 7f6c1b400640 1 --2- 172.21.15.138:0/2653104590 >> v2:172.21.15.143:3300/0 conn(0x7f6c1c0cd6d0 0x7f6c1c0c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:56:51.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.921+0000 7f6c1be00640 1 --2- 172.21.15.138:0/2653104590 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c1c15efe0 0x7f6c1c06c300 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c0d1150 tx=0x7f6c0c01c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a219564c527e896e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:51.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.921+0000 7f6c1aa00640 1 -- 172.21.15.138:0/2653104590 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c0a55a0 con 0x7f6c1c15efe0 2024-04-26T20:56:51.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.921+0000 7f6c1aa00640 1 -- 172.21.15.138:0/2653104590 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c0c0a5740 con 0x7f6c1c15efe0 2024-04-26T20:56:51.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.921+0000 7f6c1aa00640 1 -- 172.21.15.138:0/2653104590 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c0a5b10 con 0x7f6c1c15efe0 2024-04-26T20:56:51.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.925+0000 7f6c23000640 1 -- 172.21.15.138:0/2653104590 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c1c15efe0 msgr2=0x7f6c1c06c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:51.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.925+0000 7f6c23000640 1 --2- 172.21.15.138:0/2653104590 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c1c15efe0 0x7f6c1c06c300 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c0d1150 tx=0x7f6c0c01c7d0 comp rx=0 tx=0).stop 2024-04-26T20:56:51.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.925+0000 7f6c23000640 1 -- 172.21.15.138:0/2653104590 shutdown_connections 2024-04-26T20:56:51.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.925+0000 7f6c23000640 1 --2- 172.21.15.138:0/2653104590 >> v2:172.21.15.143:3300/0 conn(0x7f6c1c0cd6d0 0x7f6c1c0c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:51.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.925+0000 7f6c23000640 1 --2- 172.21.15.138:0/2653104590 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c1c15efe0 0x7f6c1c06c300 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:51.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.925+0000 7f6c23000640 1 -- 172.21.15.138:0/2653104590 >> 172.21.15.138:0/2653104590 conn(0x7f6c1c0cdee0 msgr2=0x7f6c1c0ce2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:51.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.925+0000 7f6c23000640 1 -- 172.21.15.138:0/2653104590 shutdown_connections 2024-04-26T20:56:51.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.925+0000 7f6c23000640 1 -- 172.21.15.138:0/2653104590 wait complete. 2024-04-26T20:56:51.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.925+0000 7f6c23000640 1 Processor -- start 2024-04-26T20:56:51.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.925+0000 7f6c23000640 1 -- start start 2024-04-26T20:56:51.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.925+0000 7f6c23000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c1c0cd6d0 0x7f6c1c145da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:51.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.925+0000 7f6c23000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c1c0cf240 0x7f6c1c0aeea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:51.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.925+0000 7f6c23000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6c1c15efe0 0x7f6c1c155640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:51.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.925+0000 7f6c23000640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1c0cd330 con 0x7f6c1c0cd6d0 2024-04-26T20:56:51.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.925+0000 7f6c23000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1c15f3c0 con 0x7f6c1c0cf240 2024-04-26T20:56:51.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.925+0000 7f6c23000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f6c1c156650 con 0x7f6c1c15efe0 2024-04-26T20:56:51.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.925+0000 7f6c1be00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c1c0cd6d0 0x7f6c1c145da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:51.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.925+0000 7f6c1be00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c1c0cd6d0 0x7f6c1c145da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:55386/0 (socket says 172.21.15.138:55386) 2024-04-26T20:56:51.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.925+0000 7f6c1be00640 1 -- 172.21.15.138:0/450953741 learned_addr learned my addr 172.21.15.138:0/450953741 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:51.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.925+0000 7f6c1be00640 1 -- 172.21.15.138:0/450953741 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6c1c15efe0 msgr2=0x7f6c1c155640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:51.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.925+0000 7f6c1be00640 1 --2- 172.21.15.138:0/450953741 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6c1c15efe0 0x7f6c1c155640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:51.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.925+0000 7f6c1be00640 1 -- 172.21.15.138:0/450953741 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c1c0cf240 msgr2=0x7f6c1c0aeea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:51.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.925+0000 7f6c1be00640 1 --2- 172.21.15.138:0/450953741 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c1c0cf240 0x7f6c1c0aeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:51.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.925+0000 7f6c1be00640 1 -- 172.21.15.138:0/450953741 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c1c156090 con 0x7f6c1c0cd6d0 2024-04-26T20:56:51.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.925+0000 7f6c1be00640 1 --2- 172.21.15.138:0/450953741 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c1c0cd6d0 0x7f6c1c145da0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c0af040 tx=0x7f6c0c019570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:51.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.929+0000 7f6c13e00640 1 -- 172.21.15.138:0/450953741 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c0bc020 con 0x7f6c1c0cd6d0 2024-04-26T20:56:51.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.929+0000 7f6c13e00640 1 -- 172.21.15.138:0/450953741 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c0c0b8670 con 0x7f6c1c0cd6d0 2024-04-26T20:56:51.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.929+0000 7f6c13e00640 1 -- 172.21.15.138:0/450953741 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c0b8a60 con 0x7f6c1c0cd6d0 2024-04-26T20:56:51.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.929+0000 7f6c23000640 1 -- 172.21.15.138:0/450953741 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c1c156370 con 0x7f6c1c0cd6d0 2024-04-26T20:56:51.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.929+0000 7f6c23000640 1 -- 172.21.15.138:0/450953741 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c1c1462e0 con 0x7f6c1c0cd6d0 2024-04-26T20:56:51.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.929+0000 7f6c23000640 1 -- 172.21.15.138:0/450953741 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c1c069430 con 0x7f6c1c0cd6d0 2024-04-26T20:56:51.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.929+0000 7f6c13e00640 1 -- 172.21.15.138:0/450953741 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6c0c0bf020 con 0x7f6c1c0cd6d0 2024-04-26T20:56:51.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.929+0000 7f6c13e00640 1 --2- 172.21.15.138:0/450953741 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6bfc068380 0x7f6bfc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:51.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.929+0000 7f6c13e00640 1 -- 172.21.15.138:0/450953741 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f6c0c121b70 con 0x7f6c1c0cd6d0 2024-04-26T20:56:51.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.929+0000 7f6c1b400640 1 --2- 172.21.15.138:0/450953741 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6bfc068380 0x7f6bfc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:51.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.933+0000 7f6c1b400640 1 --2- 172.21.15.138:0/450953741 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6bfc068380 0x7f6bfc06a840 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c0c6aa0 tx=0x7f6c08008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:51.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:51.933+0000 7f6c13e00640 1 -- 172.21.15.138:0/450953741 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6c0c0c6030 con 0x7f6c1c0cd6d0 2024-04-26T20:56:52.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.089+0000 7f6c23000640 1 -- 172.21.15.138:0/450953741 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f6c1c068690 con 0x7f6c1c0cd6d0 2024-04-26T20:56:52.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.089+0000 7f6c13e00640 1 -- 172.21.15.138:0/450953741 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f6c1c0cbab0 con 0x7f6c1c0cd6d0 2024-04-26T20:56:52.095 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 32 2024-04-26T20:56:52.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.093+0000 7f6c23000640 1 -- 172.21.15.138:0/450953741 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6bfc068380 msgr2=0x7f6bfc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:52.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.093+0000 7f6c23000640 1 --2- 172.21.15.138:0/450953741 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6bfc068380 0x7f6bfc06a840 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c0c6aa0 tx=0x7f6c08008040 comp rx=0 tx=0).stop 2024-04-26T20:56:52.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.093+0000 7f6c23000640 1 -- 172.21.15.138:0/450953741 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c1c0cd6d0 msgr2=0x7f6c1c145da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:52.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.093+0000 7f6c23000640 1 --2- 172.21.15.138:0/450953741 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c1c0cd6d0 0x7f6c1c145da0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c0af040 tx=0x7f6c0c019570 comp rx=0 tx=0).stop 2024-04-26T20:56:52.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.093+0000 7f6c23000640 1 -- 172.21.15.138:0/450953741 shutdown_connections 2024-04-26T20:56:52.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.093+0000 7f6c23000640 1 --2- 172.21.15.138:0/450953741 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6bfc068380 0x7f6bfc06a840 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:52.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.093+0000 7f6c23000640 1 --2- 172.21.15.138:0/450953741 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6c1c15efe0 0x7f6c1c155640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:52.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.093+0000 7f6c23000640 1 --2- 172.21.15.138:0/450953741 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c1c0cf240 0x7f6c1c0aeea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:52.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.093+0000 7f6c23000640 1 --2- 172.21.15.138:0/450953741 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c1c0cd6d0 0x7f6c1c145da0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:52.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.093+0000 7f6c23000640 1 -- 172.21.15.138:0/450953741 >> 172.21.15.138:0/450953741 conn(0x7f6c1c0cdee0 msgr2=0x7f6c1c0b1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:52.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.093+0000 7f6c23000640 1 -- 172.21.15.138:0/450953741 shutdown_connections 2024-04-26T20:56:52.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.093+0000 7f6c23000640 1 -- 172.21.15.138:0/450953741 wait complete. 2024-04-26T20:56:52.115 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T20:56:52.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.249+0000 7ff44be00640 1 Processor -- start 2024-04-26T20:56:52.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.249+0000 7ff44be00640 1 -- start start 2024-04-26T20:56:52.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.249+0000 7ff44be00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff44406c300 0x7ff44406c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:52.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.249+0000 7ff44be00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff44406f140 con 0x7ff44415f280 2024-04-26T20:56:52.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.249+0000 7ff44be00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff44406f420 con 0x7ff4440d2790 2024-04-26T20:56:52.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.249+0000 7ff44be00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7ff4440701d0 con 0x7ff44406c300 2024-04-26T20:56:52.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.253+0000 7ff449400640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7ff44415f280 0x7ff4440ae8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:58404/0 (socket says 172.21.15.138:58404) 2024-04-26T20:56:52.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.253+0000 7ff449400640 1 -- 172.21.15.138:0/2792246384 learned_addr learned my addr 172.21.15.138:0/2792246384 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:56:52.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.253+0000 7ff449e00640 1 --2- 172.21.15.138:0/2792246384 >> v2:172.21.15.143:3300/0 conn(0x7ff44406c300 0x7ff44406c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:52.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.253+0000 7ff443e00640 1 -- 172.21.15.138:0/2792246384 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1708239068 0 0) 0x7ff44406f140 con 0x7ff44415f280 2024-04-26T20:56:52.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.253+0000 7ff443e00640 1 -- 172.21.15.138:0/2792246384 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff42c003530 con 0x7ff44415f280 2024-04-26T20:56:52.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.253+0000 7ff443e00640 1 -- 172.21.15.138:0/2792246384 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 318313478 0 0) 0x7ff44406f420 con 0x7ff4440d2790 2024-04-26T20:56:52.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.253+0000 7ff443e00640 1 -- 172.21.15.138:0/2792246384 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff44406f140 con 0x7ff4440d2790 2024-04-26T20:56:52.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.253+0000 7ff443e00640 1 -- 172.21.15.138:0/2792246384 <== mon.0 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1483930361 0 0) 0x7ff42c003530 con 0x7ff44415f280 2024-04-26T20:56:52.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.253+0000 7ff443e00640 1 -- 172.21.15.138:0/2792246384 >> v2:172.21.15.143:3300/0 conn(0x7ff44406c300 msgr2=0x7ff44406c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:52.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.253+0000 7ff443e00640 1 --2- 172.21.15.138:0/2792246384 >> v2:172.21.15.143:3300/0 conn(0x7ff44406c300 0x7ff44406c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:52.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.253+0000 7ff443e00640 1 -- 172.21.15.138:0/2792246384 >> v1:172.21.15.143:6789/0 conn(0x7ff4440d2790 legacy=0x7ff44406f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:52.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.253+0000 7ff443e00640 1 -- 172.21.15.138:0/2792246384 --> v1:172.21.15.138:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4440aefc0 con 0x7ff44415f280 2024-04-26T20:56:52.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.253+0000 7ff443e00640 1 -- 172.21.15.138:0/2792246384 <== mon.0 v1:172.21.15.138:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2715389689 0 0) 0x7ff438001680 con 0x7ff44415f280 2024-04-26T20:56:52.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.253+0000 7ff443e00640 1 -- 172.21.15.138:0/2792246384 >> v1:172.21.15.138:6789/0 conn(0x7ff44415f280 legacy=0x7ff4440ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:52.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.253+0000 7ff443e00640 1 --2- 172.21.15.138:0/2792246384 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff42c003bc0 0x7ff42c003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:52.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.253+0000 7ff443e00640 1 --2- 172.21.15.138:0/2792246384 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff42c004810 0x7ff42c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:52.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.253+0000 7ff443e00640 1 --2- 172.21.15.138:0/2792246384 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff42c0051d0 0x7ff42c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:52.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.253+0000 7ff443e00640 1 -- 172.21.15.138:0/2792246384 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff4440701d0 con 0x7ff42c0051d0 2024-04-26T20:56:52.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.253+0000 7ff443e00640 1 -- 172.21.15.138:0/2792246384 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ff42c00c0d0 con 0x7ff42c004810 2024-04-26T20:56:52.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.253+0000 7ff443e00640 1 -- 172.21.15.138:0/2792246384 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ff42c00c2d0 con 0x7ff42c003bc0 2024-04-26T20:56:52.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.253+0000 7ff449e00640 1 --2- 172.21.15.138:0/2792246384 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff42c0051d0 0x7ff42c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:52.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.253+0000 7ff449400640 1 --2- 172.21.15.138:0/2792246384 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff42c003bc0 0x7ff42c003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:52.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.253+0000 7ff448a00640 1 --2- 172.21.15.138:0/2792246384 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff42c004810 0x7ff42c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:52.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.253+0000 7ff449e00640 1 -- 172.21.15.138:0/2792246384 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff42c003bc0 msgr2=0x7ff42c003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:52.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.253+0000 7ff449e00640 1 --2- 172.21.15.138:0/2792246384 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff42c003bc0 0x7ff42c003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:52.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.253+0000 7ff449e00640 1 -- 172.21.15.138:0/2792246384 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff42c004810 msgr2=0x7ff42c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:52.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.253+0000 7ff449e00640 1 --2- 172.21.15.138:0/2792246384 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff42c004810 0x7ff42c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:52.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.253+0000 7ff449e00640 1 -- 172.21.15.138:0/2792246384 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff42c003530 con 0x7ff42c0051d0 2024-04-26T20:56:52.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.257+0000 7ff449e00640 1 -- 172.21.15.138:0/2792246384 reap_dead start 2024-04-26T20:56:52.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.257+0000 7ff449e00640 1 --2- 172.21.15.138:0/2792246384 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff42c0051d0 0x7ff42c00b9d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff43c009fc0 tx=0x7ff43c01ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20159463512c31d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:52.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.257+0000 7ff443e00640 1 -- 172.21.15.138:0/2792246384 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff43c009c10 con 0x7ff42c0051d0 2024-04-26T20:56:52.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.257+0000 7ff443e00640 1 -- 172.21.15.138:0/2792246384 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff43c0a5d10 con 0x7ff42c0051d0 2024-04-26T20:56:52.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.257+0000 7ff443e00640 1 -- 172.21.15.138:0/2792246384 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff43c003be0 con 0x7ff42c0051d0 2024-04-26T20:56:52.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.257+0000 7ff44be00640 1 -- 172.21.15.138:0/2792246384 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff42c0051d0 msgr2=0x7ff42c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:52.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.257+0000 7ff44be00640 1 --2- 172.21.15.138:0/2792246384 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff42c0051d0 0x7ff42c00b9d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff43c009fc0 tx=0x7ff43c01ccc0 comp rx=0 tx=0).stop 2024-04-26T20:56:52.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.257+0000 7ff44be00640 1 -- 172.21.15.138:0/2792246384 shutdown_connections 2024-04-26T20:56:52.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.257+0000 7ff44be00640 1 --2- 172.21.15.138:0/2792246384 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff42c0051d0 0x7ff42c00b9d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:52.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.257+0000 7ff44be00640 1 -- 172.21.15.138:0/2792246384 >> 172.21.15.138:0/2792246384 conn(0x7ff4440d1c70 msgr2=0x7ff4440d2080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:52.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.257+0000 7ff44be00640 1 -- 172.21.15.138:0/2792246384 shutdown_connections 2024-04-26T20:56:52.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.257+0000 7ff44be00640 1 -- 172.21.15.138:0/2792246384 wait complete. 2024-04-26T20:56:52.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.257+0000 7ff44be00640 1 Processor -- start 2024-04-26T20:56:52.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.261+0000 7ff44be00640 1 -- start start 2024-04-26T20:56:52.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.261+0000 7ff44be00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff42c0051d0 0x7ff444155a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:52.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.261+0000 7ff44be00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4440ce050 0x7ff4440d0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:52.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.261+0000 7ff44be00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff4440ce4d0 0x7ff4440d0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:52.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.261+0000 7ff44be00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff44406cb20 con 0x7ff4440ce050 2024-04-26T20:56:52.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.261+0000 7ff44be00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ff44406c9a0 con 0x7ff42c0051d0 2024-04-26T20:56:52.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.261+0000 7ff44be00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ff4440cea10 con 0x7ff4440ce4d0 2024-04-26T20:56:52.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.261+0000 7ff449400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff42c0051d0 0x7ff444155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:52.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.261+0000 7ff449e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff4440ce4d0 0x7ff4440d0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:52.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.261+0000 7ff449400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff42c0051d0 0x7ff444155a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.138:52918/0 (socket says 172.21.15.138:52918) 2024-04-26T20:56:52.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.261+0000 7ff449400640 1 -- 172.21.15.138:0/3452756826 learned_addr learned my addr 172.21.15.138:0/3452756826 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:52.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.261+0000 7ff449e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff4440ce4d0 0x7ff4440d0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.138:48888/0 (socket says 172.21.15.138:48888) 2024-04-26T20:56:52.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.261+0000 7ff448a00640 1 --2- 172.21.15.138:0/3452756826 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4440ce050 0x7ff4440d0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:52.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.261+0000 7ff448a00640 1 -- 172.21.15.138:0/3452756826 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff4440ce4d0 msgr2=0x7ff4440d0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:52.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.261+0000 7ff448a00640 1 --2- 172.21.15.138:0/3452756826 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff4440ce4d0 0x7ff4440d0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:52.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.261+0000 7ff448a00640 1 -- 172.21.15.138:0/3452756826 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff42c0051d0 msgr2=0x7ff444155a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:52.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.261+0000 7ff448a00640 1 --2- 172.21.15.138:0/3452756826 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff42c0051d0 0x7ff444155a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:52.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.261+0000 7ff448a00640 1 -- 172.21.15.138:0/3452756826 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4440cecf0 con 0x7ff4440ce050 2024-04-26T20:56:52.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.261+0000 7ff448a00640 1 --2- 172.21.15.138:0/3452756826 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4440ce050 0x7ff4440d0530 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff430007fd0 tx=0x7ff43000fb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:52.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.261+0000 7ff441600640 1 -- 172.21.15.138:0/3452756826 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff43001a070 con 0x7ff4440ce050 2024-04-26T20:56:52.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.261+0000 7ff441600640 1 -- 172.21.15.138:0/3452756826 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff430005110 con 0x7ff4440ce050 2024-04-26T20:56:52.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.261+0000 7ff441600640 1 -- 172.21.15.138:0/3452756826 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4300067e0 con 0x7ff4440ce050 2024-04-26T20:56:52.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.261+0000 7ff44be00640 1 -- 172.21.15.138:0/3452756826 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4440cefd0 con 0x7ff4440ce050 2024-04-26T20:56:52.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.261+0000 7ff44be00640 1 -- 172.21.15.138:0/3452756826 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4440cf590 con 0x7ff4440ce050 2024-04-26T20:56:52.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.265+0000 7ff44be00640 1 -- 172.21.15.138:0/3452756826 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4440cf790 con 0x7ff4440ce050 2024-04-26T20:56:52.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.265+0000 7ff441600640 1 -- 172.21.15.138:0/3452756826 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff430006980 con 0x7ff4440ce050 2024-04-26T20:56:52.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.265+0000 7ff441600640 1 --2- 172.21.15.138:0/3452756826 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff424068380 0x7ff42406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:52.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.265+0000 7ff441600640 1 -- 172.21.15.138:0/3452756826 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7ff4300861d0 con 0x7ff4440ce050 2024-04-26T20:56:52.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.265+0000 7ff449400640 1 --2- 172.21.15.138:0/3452756826 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff424068380 0x7ff42406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:52.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.265+0000 7ff449400640 1 --2- 172.21.15.138:0/3452756826 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff424068380 0x7ff42406a840 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff44415d310 tx=0x7ff438000ee0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:52.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.269+0000 7ff441600640 1 -- 172.21.15.138:0/3452756826 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff4440cf790 con 0x7ff4440ce050 2024-04-26T20:56:52.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.425+0000 7ff44be00640 1 -- 172.21.15.138:0/3452756826 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff4440b68c0 con 0x7ff4440ce050 2024-04-26T20:56:52.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.425+0000 7ff441600640 1 -- 172.21.15.138:0/3452756826 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7ff430055e00 con 0x7ff4440ce050 2024-04-26T20:56:52.431 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 64 2024-04-26T20:56:52.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.429+0000 7ff44be00640 1 -- 172.21.15.138:0/3452756826 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff424068380 msgr2=0x7ff42406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:52.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.429+0000 7ff44be00640 1 --2- 172.21.15.138:0/3452756826 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff424068380 0x7ff42406a840 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff44415d310 tx=0x7ff438000ee0 comp rx=0 tx=0).stop 2024-04-26T20:56:52.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.429+0000 7ff44be00640 1 -- 172.21.15.138:0/3452756826 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4440ce050 msgr2=0x7ff4440d0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:52.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.429+0000 7ff44be00640 1 --2- 172.21.15.138:0/3452756826 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4440ce050 0x7ff4440d0530 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff430007fd0 tx=0x7ff43000fb40 comp rx=0 tx=0).stop 2024-04-26T20:56:52.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.429+0000 7ff44be00640 1 -- 172.21.15.138:0/3452756826 shutdown_connections 2024-04-26T20:56:52.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.429+0000 7ff44be00640 1 --2- 172.21.15.138:0/3452756826 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff424068380 0x7ff42406a840 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:52.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.429+0000 7ff44be00640 1 --2- 172.21.15.138:0/3452756826 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff4440ce4d0 0x7ff4440d0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:52.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.429+0000 7ff44be00640 1 --2- 172.21.15.138:0/3452756826 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4440ce050 0x7ff4440d0530 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:52.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.429+0000 7ff44be00640 1 --2- 172.21.15.138:0/3452756826 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff42c0051d0 0x7ff444155a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:52.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.429+0000 7ff44be00640 1 -- 172.21.15.138:0/3452756826 >> 172.21.15.138:0/3452756826 conn(0x7ff4440d1c70 msgr2=0x7ff4440ae8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:52.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.429+0000 7ff44be00640 1 -- 172.21.15.138:0/3452756826 shutdown_connections 2024-04-26T20:56:52.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.429+0000 7ff44be00640 1 -- 172.21.15.138:0/3452756826 wait complete. 2024-04-26T20:56:52.453 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T20:56:52.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.585+0000 7ff2bc400640 1 Processor -- start 2024-04-26T20:56:52.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.585+0000 7ff2bc400640 1 -- start start 2024-04-26T20:56:52.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.589+0000 7ff2bc400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff2b415f2f0 0x7ff2b406dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:52.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.589+0000 7ff2bc400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff2b40d2300 0x7ff2b40ce120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:52.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.589+0000 7ff2bc400640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2b40cd380 con 0x7ff2b406e120 2024-04-26T20:56:52.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.589+0000 7ff2bc400640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7ff2b406eb60 con 0x7ff2b415f2f0 2024-04-26T20:56:52.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.589+0000 7ff2bc400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ff2b406e560 con 0x7ff2b40d2300 2024-04-26T20:56:52.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.589+0000 7ff2b9a00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff2b415f2f0 0x7ff2b406dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:52.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.589+0000 7ff2b9000640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7ff2b406e120 0x7ff2b40d1bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:58410/0 (socket says 172.21.15.138:58410) 2024-04-26T20:56:52.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.589+0000 7ff2b9000640 1 -- 172.21.15.138:0/2578207233 learned_addr learned my addr 172.21.15.138:0/2578207233 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:56:52.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.589+0000 7ff2b9a00640 1 -- 172.21.15.138:0/2578207233 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff2b40d2300 msgr2=0x7ff2b40ce120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:52.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.589+0000 7ff2ba400640 1 --2- 172.21.15.138:0/2578207233 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff2b40d2300 0x7ff2b40ce120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:52.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.589+0000 7ff2b9a00640 1 --2- 172.21.15.138:0/2578207233 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff2b40d2300 0x7ff2b40ce120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:52.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.589+0000 7ff2b9a00640 1 -- 172.21.15.138:0/2578207233 >> v1:172.21.15.138:6789/0 conn(0x7ff2b406e120 legacy=0x7ff2b40d1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:52.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.589+0000 7ff2b3e00640 1 -- 172.21.15.138:0/2578207233 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 489091304 0 0) 0x7ff2b40cd380 con 0x7ff2b406e120 2024-04-26T20:56:52.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.589+0000 7ff2b9a00640 1 -- 172.21.15.138:0/2578207233 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2b40d28e0 con 0x7ff2b415f2f0 2024-04-26T20:56:52.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.589+0000 7ff2ba400640 1 --2- 172.21.15.138:0/2578207233 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff2b40d2300 0x7ff2b40ce120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:56:52.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.593+0000 7ff2b9a00640 1 --2- 172.21.15.138:0/2578207233 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2b415f2f0 0x7ff2b406dbe0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff2a80097a0 tx=0x7ff2a801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=718868dd1f192395 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:52.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.593+0000 7ff2b3e00640 1 -- 172.21.15.138:0/2578207233 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a80b2070 con 0x7ff2b415f2f0 2024-04-26T20:56:52.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.593+0000 7ff2b3e00640 1 -- 172.21.15.138:0/2578207233 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2a80a9070 con 0x7ff2b415f2f0 2024-04-26T20:56:52.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.593+0000 7ff2b3e00640 1 -- 172.21.15.138:0/2578207233 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a80ad880 con 0x7ff2b415f2f0 2024-04-26T20:56:52.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.593+0000 7ff2bc400640 1 -- 172.21.15.138:0/2578207233 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2b415f2f0 msgr2=0x7ff2b406dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:52.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.593+0000 7ff2bc400640 1 --2- 172.21.15.138:0/2578207233 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2b415f2f0 0x7ff2b406dbe0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff2a80097a0 tx=0x7ff2a801c450 comp rx=0 tx=0).stop 2024-04-26T20:56:52.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.593+0000 7ff2bc400640 1 -- 172.21.15.138:0/2578207233 shutdown_connections 2024-04-26T20:56:52.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.593+0000 7ff2bc400640 1 --2- 172.21.15.138:0/2578207233 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff2b40d2300 0x7ff2b40ce120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:52.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.593+0000 7ff2bc400640 1 --2- 172.21.15.138:0/2578207233 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2b415f2f0 0x7ff2b406dbe0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:52.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.593+0000 7ff2bc400640 1 -- 172.21.15.138:0/2578207233 >> 172.21.15.138:0/2578207233 conn(0x7ff2b40d2d30 msgr2=0x7ff2b40d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:52.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.593+0000 7ff2bc400640 1 -- 172.21.15.138:0/2578207233 shutdown_connections 2024-04-26T20:56:52.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.593+0000 7ff2bc400640 1 -- 172.21.15.138:0/2578207233 wait complete. 2024-04-26T20:56:52.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.593+0000 7ff2bc400640 1 Processor -- start 2024-04-26T20:56:52.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.593+0000 7ff2bc400640 1 -- start start 2024-04-26T20:56:52.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.593+0000 7ff2bc400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2b406e120 0x7ff2b414bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:52.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.593+0000 7ff2bc400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff2b40d2300 0x7ff2b40c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:52.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.597+0000 7ff2bc400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff2b415f2f0 0x7ff2b40c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:52.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.597+0000 7ff2bc400640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b415f6d0 con 0x7ff2b406e120 2024-04-26T20:56:52.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.597+0000 7ff2bc400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b40b5b80 con 0x7ff2b40d2300 2024-04-26T20:56:52.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.597+0000 7ff2bc400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ff2b415f850 con 0x7ff2b415f2f0 2024-04-26T20:56:52.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.597+0000 7ff2b9a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2b406e120 0x7ff2b414bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:52.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.597+0000 7ff2b9a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2b406e120 0x7ff2b414bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:55410/0 (socket says 172.21.15.138:55410) 2024-04-26T20:56:52.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.597+0000 7ff2b9a00640 1 -- 172.21.15.138:0/3671583160 learned_addr learned my addr 172.21.15.138:0/3671583160 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:52.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.597+0000 7ff2b9000640 1 --2- 172.21.15.138:0/3671583160 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff2b40d2300 0x7ff2b40c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:52.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.597+0000 7ff2ba400640 1 --2- 172.21.15.138:0/3671583160 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff2b415f2f0 0x7ff2b40c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:52.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.597+0000 7ff2b9a00640 1 -- 172.21.15.138:0/3671583160 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff2b415f2f0 msgr2=0x7ff2b40c8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:52.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.597+0000 7ff2b9a00640 1 --2- 172.21.15.138:0/3671583160 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff2b415f2f0 0x7ff2b40c8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:52.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.597+0000 7ff2b9a00640 1 -- 172.21.15.138:0/3671583160 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff2b40d2300 msgr2=0x7ff2b40c89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:52.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.597+0000 7ff2b9a00640 1 --2- 172.21.15.138:0/3671583160 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff2b40d2300 0x7ff2b40c89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:52.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.597+0000 7ff2b9a00640 1 -- 172.21.15.138:0/3671583160 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2b414c240 con 0x7ff2b406e120 2024-04-26T20:56:52.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.597+0000 7ff2ba400640 1 --2- 172.21.15.138:0/3671583160 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff2b415f2f0 0x7ff2b40c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:56:52.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.597+0000 7ff2b9a00640 1 --2- 172.21.15.138:0/3671583160 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2b406e120 0x7ff2b414bd00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff2a801a080 tx=0x7ff2a801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:52.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.597+0000 7ff2b1600640 1 -- 172.21.15.138:0/3671583160 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a80b2050 con 0x7ff2b406e120 2024-04-26T20:56:52.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.597+0000 7ff2b1600640 1 -- 172.21.15.138:0/3671583160 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2a80b3040 con 0x7ff2b406e120 2024-04-26T20:56:52.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.597+0000 7ff2b1600640 1 -- 172.21.15.138:0/3671583160 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a80b9690 con 0x7ff2b406e120 2024-04-26T20:56:52.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.597+0000 7ff2bc400640 1 -- 172.21.15.138:0/3671583160 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2b41fbb50 con 0x7ff2b406e120 2024-04-26T20:56:52.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.597+0000 7ff2bc400640 1 -- 172.21.15.138:0/3671583160 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2b41f7b40 con 0x7ff2b406e120 2024-04-26T20:56:52.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.597+0000 7ff2bc400640 1 -- 172.21.15.138:0/3671583160 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2b4069430 con 0x7ff2b406e120 2024-04-26T20:56:52.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.597+0000 7ff2b1600640 1 -- 172.21.15.138:0/3671583160 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff2a80c0030 con 0x7ff2b406e120 2024-04-26T20:56:52.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.601+0000 7ff2b1600640 1 --2- 172.21.15.138:0/3671583160 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff294068380 0x7ff29406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:52.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.601+0000 7ff2b1600640 1 -- 172.21.15.138:0/3671583160 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7ff2a8120c00 con 0x7ff2b406e120 2024-04-26T20:56:52.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.601+0000 7ff2b9000640 1 --2- 172.21.15.138:0/3671583160 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff294068380 0x7ff29406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:52.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.601+0000 7ff2b9000640 1 --2- 172.21.15.138:0/3671583160 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff294068380 0x7ff29406a840 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff2b41586e0 tx=0x7ff2a0007c10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:52.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.601+0000 7ff2b1600640 1 -- 172.21.15.138:0/3671583160 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff2a80c7060 con 0x7ff2b406e120 2024-04-26T20:56:52.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.765+0000 7ff2bc400640 1 -- 172.21.15.138:0/3671583160 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7ff2b4158430 con 0x7ff2b406e120 2024-04-26T20:56:52.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.765+0000 7ff2b1600640 1 -- 172.21.15.138:0/3671583160 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7ff2a8016070 con 0x7ff2b406e120 2024-04-26T20:56:52.769 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 32 2024-04-26T20:56:52.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.769+0000 7ff2bc400640 1 -- 172.21.15.138:0/3671583160 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff294068380 msgr2=0x7ff29406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:52.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.769+0000 7ff2bc400640 1 --2- 172.21.15.138:0/3671583160 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff294068380 0x7ff29406a840 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff2b41586e0 tx=0x7ff2a0007c10 comp rx=0 tx=0).stop 2024-04-26T20:56:52.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.769+0000 7ff2bc400640 1 -- 172.21.15.138:0/3671583160 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2b406e120 msgr2=0x7ff2b414bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:52.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.769+0000 7ff2bc400640 1 --2- 172.21.15.138:0/3671583160 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2b406e120 0x7ff2b414bd00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff2a801a080 tx=0x7ff2a801ac90 comp rx=0 tx=0).stop 2024-04-26T20:56:52.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.769+0000 7ff2bc400640 1 -- 172.21.15.138:0/3671583160 shutdown_connections 2024-04-26T20:56:52.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.769+0000 7ff2bc400640 1 --2- 172.21.15.138:0/3671583160 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff294068380 0x7ff29406a840 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:52.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.769+0000 7ff2bc400640 1 --2- 172.21.15.138:0/3671583160 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff2b415f2f0 0x7ff2b40c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:52.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.769+0000 7ff2bc400640 1 --2- 172.21.15.138:0/3671583160 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff2b40d2300 0x7ff2b40c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:52.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.769+0000 7ff2bc400640 1 --2- 172.21.15.138:0/3671583160 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2b406e120 0x7ff2b414bd00 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:52.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.769+0000 7ff2bc400640 1 -- 172.21.15.138:0/3671583160 >> 172.21.15.138:0/3671583160 conn(0x7ff2b40d2d30 msgr2=0x7ff2b4071160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:52.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.769+0000 7ff2bc400640 1 -- 172.21.15.138:0/3671583160 shutdown_connections 2024-04-26T20:56:52.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.769+0000 7ff2bc400640 1 -- 172.21.15.138:0/3671583160 wait complete. 2024-04-26T20:56:52.792 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T20:56:52.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.925+0000 7fdd62000640 1 Processor -- start 2024-04-26T20:56:52.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.925+0000 7fdd62000640 1 -- start start 2024-04-26T20:56:52.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.925+0000 7fdd62000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fdd5c0cc1e0 0x7fdd5c0ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:52.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.925+0000 7fdd62000640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd5c0727f0 con 0x7fdd5c0cbe00 2024-04-26T20:56:52.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.925+0000 7fdd62000640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd5c072a70 con 0x7fdd5c15cf80 2024-04-26T20:56:52.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.925+0000 7fdd62000640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fdd5c074220 con 0x7fdd5c0cc1e0 2024-04-26T20:56:52.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.925+0000 7fdd5be00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fdd5c0cc1e0 0x7fdd5c0ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:52.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.925+0000 7fdd5be00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fdd5c0cc1e0 0x7fdd5c0ce6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:55426/0 (socket says 172.21.15.138:55426) 2024-04-26T20:56:52.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.925+0000 7fdd5b400640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fdd5c0cbe00 0x7fdd5c06de70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:58424/0 (socket says 172.21.15.138:58424) 2024-04-26T20:56:52.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.925+0000 7fdd5be00640 1 -- 172.21.15.138:0/3756089507 learned_addr learned my addr 172.21.15.138:0/3756089507 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:52.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.925+0000 7fdd5be00640 1 -- 172.21.15.138:0/3756089507 >> v1:172.21.15.143:6789/0 conn(0x7fdd5c15cf80 legacy=0x7fdd5c073b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:52.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.925+0000 7fdd5a000640 1 -- 172.21.15.138:0/3756089507 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1799640469 0 0) 0x7fdd4c001120 con 0x7fdd5c0cbe00 2024-04-26T20:56:52.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.925+0000 7fdd5be00640 1 -- 172.21.15.138:0/3756089507 >> v1:172.21.15.138:6789/0 conn(0x7fdd5c0cbe00 legacy=0x7fdd5c06de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:52.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.925+0000 7fdd5be00640 1 -- 172.21.15.138:0/3756089507 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd5c072d50 con 0x7fdd5c0cc1e0 2024-04-26T20:56:52.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.929+0000 7fdd5be00640 1 --2- 172.21.15.138:0/3756089507 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdd5c0cc1e0 0x7fdd5c0ce6f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdd5400d150 tx=0x7fdd5401ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d33cde4bb55c8f23 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:52.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.929+0000 7fdd5a000640 1 -- 172.21.15.138:0/3756089507 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd5400b2d0 con 0x7fdd5c0cc1e0 2024-04-26T20:56:52.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.929+0000 7fdd5a000640 1 -- 172.21.15.138:0/3756089507 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd5400b470 con 0x7fdd5c0cc1e0 2024-04-26T20:56:52.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.929+0000 7fdd5a000640 1 -- 172.21.15.138:0/3756089507 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd540a79e0 con 0x7fdd5c0cc1e0 2024-04-26T20:56:52.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.929+0000 7fdd62000640 1 -- 172.21.15.138:0/3756089507 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdd5c0cc1e0 msgr2=0x7fdd5c0ce6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:52.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.929+0000 7fdd62000640 1 --2- 172.21.15.138:0/3756089507 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdd5c0cc1e0 0x7fdd5c0ce6f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdd5400d150 tx=0x7fdd5401ebf0 comp rx=0 tx=0).stop 2024-04-26T20:56:52.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.929+0000 7fdd62000640 1 -- 172.21.15.138:0/3756089507 shutdown_connections 2024-04-26T20:56:52.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.929+0000 7fdd62000640 1 --2- 172.21.15.138:0/3756089507 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdd5c0cc1e0 0x7fdd5c0ce6f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:52.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.929+0000 7fdd62000640 1 -- 172.21.15.138:0/3756089507 >> 172.21.15.138:0/3756089507 conn(0x7fdd5c0d0b20 msgr2=0x7fdd5c0d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:52.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.929+0000 7fdd62000640 1 -- 172.21.15.138:0/3756089507 shutdown_connections 2024-04-26T20:56:52.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.929+0000 7fdd62000640 1 -- 172.21.15.138:0/3756089507 wait complete. 2024-04-26T20:56:52.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.929+0000 7fdd62000640 1 Processor -- start 2024-04-26T20:56:52.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.929+0000 7fdd62000640 1 -- start start 2024-04-26T20:56:52.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.933+0000 7fdd62000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdd5c0cbe00 0x7fdd5c15b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:52.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.933+0000 7fdd62000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdd5c0cc1e0 0x7fdd5c0c7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:52.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.933+0000 7fdd62000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdd5c15cf80 0x7fdd5c15a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:52.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.933+0000 7fdd62000640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fdd5c0d0780 con 0x7fdd5c0cbe00 2024-04-26T20:56:52.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.933+0000 7fdd62000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fdd5c073680 con 0x7fdd5c0cc1e0 2024-04-26T20:56:52.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.933+0000 7fdd62000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fdd5c0d0900 con 0x7fdd5c15cf80 2024-04-26T20:56:52.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.933+0000 7fdd5b400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdd5c0cbe00 0x7fdd5c15b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:52.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.933+0000 7fdd5b400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdd5c0cbe00 0x7fdd5c15b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:55436/0 (socket says 172.21.15.138:55436) 2024-04-26T20:56:52.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.933+0000 7fdd5b400640 1 -- 172.21.15.138:0/1709480052 learned_addr learned my addr 172.21.15.138:0/1709480052 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:52.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.933+0000 7fdd5b400640 1 -- 172.21.15.138:0/1709480052 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdd5c15cf80 msgr2=0x7fdd5c15a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:52.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.933+0000 7fdd5b400640 1 --2- 172.21.15.138:0/1709480052 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdd5c15cf80 0x7fdd5c15a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:52.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.933+0000 7fdd5b400640 1 -- 172.21.15.138:0/1709480052 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdd5c0cc1e0 msgr2=0x7fdd5c0c7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:52.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.933+0000 7fdd5b400640 1 --2- 172.21.15.138:0/1709480052 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdd5c0cc1e0 0x7fdd5c0c7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:52.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.933+0000 7fdd5b400640 1 -- 172.21.15.138:0/1709480052 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd5c0ca490 con 0x7fdd5c0cbe00 2024-04-26T20:56:52.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.933+0000 7fdd5b400640 1 --2- 172.21.15.138:0/1709480052 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdd5c0cbe00 0x7fdd5c15b590 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c00c780 tx=0x7fdd4c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:52.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.933+0000 7fdd53400640 1 -- 172.21.15.138:0/1709480052 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c018070 con 0x7fdd5c0cbe00 2024-04-26T20:56:52.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.933+0000 7fdd53400640 1 -- 172.21.15.138:0/1709480052 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd4c0072f0 con 0x7fdd5c0cbe00 2024-04-26T20:56:52.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.933+0000 7fdd53400640 1 -- 172.21.15.138:0/1709480052 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c0047f0 con 0x7fdd5c0cbe00 2024-04-26T20:56:52.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.933+0000 7fdd62000640 1 -- 172.21.15.138:0/1709480052 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd5c0ca770 con 0x7fdd5c0cbe00 2024-04-26T20:56:52.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.933+0000 7fdd62000640 1 -- 172.21.15.138:0/1709480052 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd5c0cad30 con 0x7fdd5c0cbe00 2024-04-26T20:56:52.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.933+0000 7fdd62000640 1 -- 172.21.15.138:0/1709480052 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd5c069510 con 0x7fdd5c0cbe00 2024-04-26T20:56:52.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.933+0000 7fdd53400640 1 -- 172.21.15.138:0/1709480052 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdd4c004990 con 0x7fdd5c0cbe00 2024-04-26T20:56:52.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.937+0000 7fdd53400640 1 --2- 172.21.15.138:0/1709480052 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fdd3c068380 0x7fdd3c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:52.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.937+0000 7fdd53400640 1 -- 172.21.15.138:0/1709480052 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fdd4c086210 con 0x7fdd5c0cbe00 2024-04-26T20:56:52.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.937+0000 7fdd5aa00640 1 --2- 172.21.15.138:0/1709480052 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fdd3c068380 0x7fdd3c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:52.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.937+0000 7fdd5aa00640 1 --2- 172.21.15.138:0/1709480052 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fdd3c068380 0x7fdd3c06a840 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c0b6900 tx=0x7fdd48006bd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:52.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:52.941+0000 7fdd53400640 1 -- 172.21.15.138:0/1709480052 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fdd5c0727f0 con 0x7fdd5c0cbe00 2024-04-26T20:56:53.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.105+0000 7fdd62000640 1 -- 172.21.15.138:0/1709480052 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fdd5c0caf00 con 0x7fdd5c0cbe00 2024-04-26T20:56:53.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.105+0000 7fdd53400640 1 -- 172.21.15.138:0/1709480052 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7fdd4c056490 con 0x7fdd5c0cbe00 2024-04-26T20:56:53.111 INFO:teuthology.orchestra.run.smithi138.stderr:listed 0 entries 2024-04-26T20:56:53.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.109+0000 7fdd62000640 1 -- 172.21.15.138:0/1709480052 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fdd3c068380 msgr2=0x7fdd3c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:53.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.109+0000 7fdd62000640 1 --2- 172.21.15.138:0/1709480052 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fdd3c068380 0x7fdd3c06a840 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c0b6900 tx=0x7fdd48006bd0 comp rx=0 tx=0).stop 2024-04-26T20:56:53.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.109+0000 7fdd62000640 1 -- 172.21.15.138:0/1709480052 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdd5c0cbe00 msgr2=0x7fdd5c15b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:53.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.109+0000 7fdd62000640 1 --2- 172.21.15.138:0/1709480052 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdd5c0cbe00 0x7fdd5c15b590 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c00c780 tx=0x7fdd4c00cc40 comp rx=0 tx=0).stop 2024-04-26T20:56:53.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.109+0000 7fdd62000640 1 -- 172.21.15.138:0/1709480052 shutdown_connections 2024-04-26T20:56:53.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.109+0000 7fdd62000640 1 --2- 172.21.15.138:0/1709480052 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fdd3c068380 0x7fdd3c06a840 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:53.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.109+0000 7fdd62000640 1 --2- 172.21.15.138:0/1709480052 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdd5c15cf80 0x7fdd5c15a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:53.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.109+0000 7fdd62000640 1 --2- 172.21.15.138:0/1709480052 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdd5c0cc1e0 0x7fdd5c0c7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:53.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.109+0000 7fdd62000640 1 --2- 172.21.15.138:0/1709480052 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdd5c0cbe00 0x7fdd5c15b590 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:53.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.109+0000 7fdd62000640 1 -- 172.21.15.138:0/1709480052 >> 172.21.15.138:0/1709480052 conn(0x7fdd5c0d0b20 msgr2=0x7fdd5c157f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:53.114 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.109+0000 7fdd62000640 1 -- 172.21.15.138:0/1709480052 shutdown_connections 2024-04-26T20:56:53.114 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.109+0000 7fdd62000640 1 -- 172.21.15.138:0/1709480052 wait complete. 2024-04-26T20:56:53.131 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-26T20:56:53.132 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T20:56:53.140 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:56:53.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.313+0000 7f1ae8400640 1 Processor -- start 2024-04-26T20:56:53.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.313+0000 7f1ae8400640 1 -- start start 2024-04-26T20:56:53.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.317+0000 7f1ae8400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1ae015ce20 0x7f1ae0161340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:53.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.317+0000 7f1ae8400640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1ae015e0c0 0x7f1ae0071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:53.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.317+0000 7f1ae8400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f1ae00cca00 0x7f1ae00cce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:53.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.317+0000 7f1ae8400640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f1ae00cd390 con 0x7f1ae00cca00 2024-04-26T20:56:53.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.317+0000 7f1ae8400640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f1ae0073b70 con 0x7f1ae015e0c0 2024-04-26T20:56:53.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.317+0000 7f1ae8400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f1ae0073e10 con 0x7f1ae015ce20 2024-04-26T20:56:53.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.317+0000 7f1ae6400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f1ae00cca00 0x7f1ae00cce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:53.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.317+0000 7f1ae6400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f1ae00cca00 0x7f1ae00cce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:55440/0 (socket says 172.21.15.138:55440) 2024-04-26T20:56:53.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.317+0000 7f1ae6400640 1 -- 172.21.15.138:0/2440839965 learned_addr learned my addr 172.21.15.138:0/2440839965 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:53.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.317+0000 7f1ae5000640 1 --2- 172.21.15.138:0/2440839965 >> v2:172.21.15.143:3300/0 conn(0x7f1ae015e0c0 0x7f1ae0071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:53.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.317+0000 7f1ae6400640 1 -- 172.21.15.138:0/2440839965 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1ae015ce20 msgr2=0x7f1ae0161340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:53.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.317+0000 7f1ae5a00640 1 --2- 172.21.15.138:0/2440839965 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1ae015ce20 0x7f1ae0161340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:53.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.317+0000 7f1ae6400640 1 --2- 172.21.15.138:0/2440839965 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1ae015ce20 0x7f1ae0161340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:53.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.317+0000 7f1ae6400640 1 -- 172.21.15.138:0/2440839965 >> v2:172.21.15.143:3300/0 conn(0x7f1ae015e0c0 msgr2=0x7f1ae0071ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:53.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.317+0000 7f1ae6400640 1 --2- 172.21.15.138:0/2440839965 >> v2:172.21.15.143:3300/0 conn(0x7f1ae015e0c0 0x7f1ae0071ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:53.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.317+0000 7f1ae6400640 1 -- 172.21.15.138:0/2440839965 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ae00740f0 con 0x7f1ae00cca00 2024-04-26T20:56:53.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.317+0000 7f1ae5000640 1 --2- 172.21.15.138:0/2440839965 >> v2:172.21.15.143:3300/0 conn(0x7f1ae015e0c0 0x7f1ae0071ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:56:53.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.317+0000 7f1ae5a00640 1 --2- 172.21.15.138:0/2440839965 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1ae015ce20 0x7f1ae0161340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:56:53.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.321+0000 7f1ae6400640 1 --2- 172.21.15.138:0/2440839965 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ae00cca00 0x7f1ae00cce50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1ae0074a70 tx=0x7f1ad801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=821f422c9be83761 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:53.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.321+0000 7f1adfe00640 1 -- 172.21.15.138:0/2440839965 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad80b1070 con 0x7f1ae00cca00 2024-04-26T20:56:53.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.321+0000 7f1adfe00640 1 -- 172.21.15.138:0/2440839965 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ad80ac620 con 0x7f1ae00cca00 2024-04-26T20:56:53.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.321+0000 7f1adfe00640 1 -- 172.21.15.138:0/2440839965 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad80ac9f0 con 0x7f1ae00cca00 2024-04-26T20:56:53.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.321+0000 7f1ae8400640 1 -- 172.21.15.138:0/2440839965 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ae00cca00 msgr2=0x7f1ae00cce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:53.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.321+0000 7f1ae8400640 1 --2- 172.21.15.138:0/2440839965 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ae00cca00 0x7f1ae00cce50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1ae0074a70 tx=0x7f1ad801c4f0 comp rx=0 tx=0).stop 2024-04-26T20:56:53.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.321+0000 7f1ae8400640 1 -- 172.21.15.138:0/2440839965 shutdown_connections 2024-04-26T20:56:53.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.321+0000 7f1ae8400640 1 --2- 172.21.15.138:0/2440839965 >> v2:172.21.15.143:3300/0 conn(0x7f1ae015e0c0 0x7f1ae0071ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:53.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.321+0000 7f1ae8400640 1 --2- 172.21.15.138:0/2440839965 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ae00cca00 0x7f1ae00cce50 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:53.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.321+0000 7f1ae8400640 1 --2- 172.21.15.138:0/2440839965 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1ae015ce20 0x7f1ae0161340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:53.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.321+0000 7f1ae8400640 1 -- 172.21.15.138:0/2440839965 >> 172.21.15.138:0/2440839965 conn(0x7f1ae00d0b20 msgr2=0x7f1ae00d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:53.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.321+0000 7f1ae8400640 1 -- 172.21.15.138:0/2440839965 shutdown_connections 2024-04-26T20:56:53.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.321+0000 7f1ae8400640 1 -- 172.21.15.138:0/2440839965 wait complete. 2024-04-26T20:56:53.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.321+0000 7f1ae8400640 1 Processor -- start 2024-04-26T20:56:53.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.321+0000 7f1ae8400640 1 -- start start 2024-04-26T20:56:53.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.325+0000 7f1ae8400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1ae00cca00 0x7f1ae01556d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:53.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.325+0000 7f1ae8400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ae015ce20 0x7f1ae014bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:53.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.325+0000 7f1ae8400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1ae015e0c0 0x7f1ae006f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:53.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.325+0000 7f1ae8400640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f1ae00725a0 con 0x7f1ae015ce20 2024-04-26T20:56:53.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.325+0000 7f1ae8400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f1ae0072420 con 0x7f1ae00cca00 2024-04-26T20:56:53.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.325+0000 7f1ae8400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f1ae015d200 con 0x7f1ae015e0c0 2024-04-26T20:56:53.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.325+0000 7f1ae5000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ae015ce20 0x7f1ae014bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:53.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.325+0000 7f1ae5000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ae015ce20 0x7f1ae014bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:55452/0 (socket says 172.21.15.138:55452) 2024-04-26T20:56:53.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.325+0000 7f1ae5000640 1 -- 172.21.15.138:0/1961774977 learned_addr learned my addr 172.21.15.138:0/1961774977 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:53.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.325+0000 7f1ae6400640 1 --2- 172.21.15.138:0/1961774977 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1ae015e0c0 0x7f1ae006f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:53.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.325+0000 7f1ae5a00640 1 --2- 172.21.15.138:0/1961774977 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1ae00cca00 0x7f1ae01556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:53.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.325+0000 7f1ae5000640 1 -- 172.21.15.138:0/1961774977 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1ae015e0c0 msgr2=0x7f1ae006f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:53.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.325+0000 7f1ae5000640 1 --2- 172.21.15.138:0/1961774977 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1ae015e0c0 0x7f1ae006f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:53.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.325+0000 7f1ae5000640 1 -- 172.21.15.138:0/1961774977 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1ae00cca00 msgr2=0x7f1ae01556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:53.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.325+0000 7f1ae5000640 1 --2- 172.21.15.138:0/1961774977 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1ae00cca00 0x7f1ae01556d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:53.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.325+0000 7f1ae5000640 1 -- 172.21.15.138:0/1961774977 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ae014c270 con 0x7f1ae015ce20 2024-04-26T20:56:53.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.325+0000 7f1ae5000640 1 --2- 172.21.15.138:0/1961774977 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ae015ce20 0x7f1ae014bad0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1acc00c7f0 tx=0x7f1acc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:53.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.325+0000 7f1add600640 1 -- 172.21.15.138:0/1961774977 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1acc015070 con 0x7f1ae015ce20 2024-04-26T20:56:53.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.325+0000 7f1add600640 1 -- 172.21.15.138:0/1961774977 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1acc007820 con 0x7f1ae015ce20 2024-04-26T20:56:53.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.325+0000 7f1ae8400640 1 -- 172.21.15.138:0/1961774977 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ae014c550 con 0x7f1ae015ce20 2024-04-26T20:56:53.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.325+0000 7f1add600640 1 -- 172.21.15.138:0/1961774977 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1acc007c10 con 0x7f1ae015ce20 2024-04-26T20:56:53.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.325+0000 7f1ae8400640 1 -- 172.21.15.138:0/1961774977 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ae014cb10 con 0x7f1ae015ce20 2024-04-26T20:56:53.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.325+0000 7f1ae8400640 1 -- 172.21.15.138:0/1961774977 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ae0069510 con 0x7f1ae015ce20 2024-04-26T20:56:53.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.325+0000 7f1add600640 1 -- 172.21.15.138:0/1961774977 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1acc018070 con 0x7f1ae015ce20 2024-04-26T20:56:53.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.329+0000 7f1add600640 1 --2- 172.21.15.138:0/1961774977 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1ac0068380 0x7f1ac006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:53.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.329+0000 7f1add600640 1 -- 172.21.15.138:0/1961774977 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f1acc086c30 con 0x7f1ae015ce20 2024-04-26T20:56:53.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.329+0000 7f1ae5a00640 1 --2- 172.21.15.138:0/1961774977 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1ac0068380 0x7f1ac006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:53.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.329+0000 7f1ae5a00640 1 --2- 172.21.15.138:0/1961774977 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1ac0068380 0x7f1ac006a840 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1ad40075b0 tx=0x7f1ad4007540 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:53.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.333+0000 7f1add600640 1 -- 172.21.15.138:0/1961774977 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1acc056ea0 con 0x7f1ae015ce20 2024-04-26T20:56:53.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.489+0000 7f1ae8400640 1 -- 172.21.15.138:0/1961774977 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1ae00b1500 con 0x7f1ae015ce20 2024-04-26T20:56:53.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.489+0000 7f1add600640 1 -- 172.21.15.138:0/1961774977 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18578 (secure 0 0 0) 0x7f1acc0567a0 con 0x7f1ae015ce20 2024-04-26T20:56:53.495 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:56:53.495 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":27,"fsid":"c22b4730-12cc-4558-8535-b965384398c0","created":"2024-04-26T20:56:14.182475+0000","modified":"2024-04-26T20:56:44.633968+0000","last_up_change":"2024-04-26T20:56:26.013243+0000","last_in_change":"2024-04-26T20:56:16.714055+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:56:27.265834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:56:37.394398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:56:38.544369+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:56:42.240243+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3f9a2e34-3199-466f-a6cf-57927318121e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6801","nonce":3534772245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6803","nonce":3534772245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6807","nonce":3534772245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6805","nonce":3534772245}]},"public_addr":"172.21.15.138:6801/3534772245","cluster_addr":"172.21.15.138:6803/3534772245","heartbeat_back_addr":"172.21.15.138:6807/3534772245","heartbeat_front_addr":"172.21.15.138:6805/3534772245","state":["exists","up"]},{"osd":1,"uuid":"e881fcf6-3248-4696-a2ef-95d206d77712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6817","nonce":1427635773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6819","nonce":1427635773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6823","nonce":1427635773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6821","nonce":1427635773}]},"public_addr":"172.21.15.138:6817/1427635773","cluster_addr":"172.21.15.138:6819/1427635773","heartbeat_back_addr":"172.21.15.138:6823/1427635773","heartbeat_front_addr":"172.21.15.138:6821/1427635773","state":["exists","up"]},{"osd":2,"uuid":"f7d1db33-7672-4699-ae47-9f1e0a8e4222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6809","nonce":4273721573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6811","nonce":4273721573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6815","nonce":4273721573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6813","nonce":4273721573}]},"public_addr":"172.21.15.138:6809/4273721573","cluster_addr":"172.21.15.138:6811/4273721573","heartbeat_back_addr":"172.21.15.138:6815/4273721573","heartbeat_front_addr":"172.21.15.138:6813/4273721573","state":["exists","up"]},{"osd":3,"uuid":"2f4e0a9a-b8f6-4468-844a-a4501cd85054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6825","nonce":3098242154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6827","nonce":3098242154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6831","nonce":3098242154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6829","nonce":3098242154}]},"public_addr":"172.21.15.138:6825/3098242154","cluster_addr":"172.21.15.138:6827/3098242154","heartbeat_back_addr":"172.21.15.138:6831/3098242154","heartbeat_front_addr":"172.21.15.138:6829/3098242154","state":["exists","up"]},{"osd":4,"uuid":"c85df99b-3624-410e-866b-86830af2cfe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6801","nonce":2942056312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6803","nonce":2942056312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6807","nonce":2942056312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6805","nonce":2942056312}]},"public_addr":"172.21.15.143:6801/2942056312","cluster_addr":"172.21.15.143:6803/2942056312","heartbeat_back_addr":"172.21.15.143:6807/2942056312","heartbeat_front_addr":"172.21.15.143:6805/2942056312","state":["exists","up"]},{"osd":5,"uuid":"9af1efb5-c416-4808-b5ef-de0679ab9705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6809","nonce":1910222887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6811","nonce":1910222887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6815","nonce":1910222887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6813","nonce":1910222887}]},"public_addr":"172.21.15.143:6809/1910222887","cluster_addr":"172.21.15.143:6811/1910222887","heartbeat_back_addr":"172.21.15.143:6815/1910222887","heartbeat_front_addr":"172.21.15.143:6813/1910222887","state":["exists","up"]},{"osd":6,"uuid":"d7138615-8838-45ff-9072-2fd0683362f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6817","nonce":1082239825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6819","nonce":1082239825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6823","nonce":1082239825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6821","nonce":1082239825}]},"public_addr":"172.21.15.143:6817/1082239825","cluster_addr":"172.21.15.143:6819/1082239825","heartbeat_back_addr":"172.21.15.143:6823/1082239825","heartbeat_front_addr":"172.21.15.143:6821/1082239825","state":["exists","up"]},{"osd":7,"uuid":"0c27172b-35c4-49ec-ba0b-0137b8ff0010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6825","nonce":3295508495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6827","nonce":3295508495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6831","nonce":3295508495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6829","nonce":3295508495}]},"public_addr":"172.21.15.143:6825/3295508495","cluster_addr":"172.21.15.143:6827/3295508495","heartbeat_back_addr":"172.21.15.143:6831/3295508495","heartbeat_front_addr":"172.21.15.143:6829/3295508495","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.326627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.396119+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.433915+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.414179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.216947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.329272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.503073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.436382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:56:53.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.493+0000 7f1ae8400640 1 -- 172.21.15.138:0/1961774977 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1ac0068380 msgr2=0x7f1ac006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:53.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.493+0000 7f1ae8400640 1 --2- 172.21.15.138:0/1961774977 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1ac0068380 0x7f1ac006a840 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1ad40075b0 tx=0x7f1ad4007540 comp rx=0 tx=0).stop 2024-04-26T20:56:53.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.493+0000 7f1ae8400640 1 -- 172.21.15.138:0/1961774977 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ae015ce20 msgr2=0x7f1ae014bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:53.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.493+0000 7f1ae8400640 1 --2- 172.21.15.138:0/1961774977 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ae015ce20 0x7f1ae014bad0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1acc00c7f0 tx=0x7f1acc00ccb0 comp rx=0 tx=0).stop 2024-04-26T20:56:53.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.493+0000 7f1ae8400640 1 -- 172.21.15.138:0/1961774977 shutdown_connections 2024-04-26T20:56:53.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.493+0000 7f1ae8400640 1 --2- 172.21.15.138:0/1961774977 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1ac0068380 0x7f1ac006a840 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:53.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.493+0000 7f1ae8400640 1 --2- 172.21.15.138:0/1961774977 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1ae015e0c0 0x7f1ae006f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:53.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.493+0000 7f1ae8400640 1 --2- 172.21.15.138:0/1961774977 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ae015ce20 0x7f1ae014bad0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:53.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.493+0000 7f1ae8400640 1 --2- 172.21.15.138:0/1961774977 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1ae00cca00 0x7f1ae01556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:53.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.493+0000 7f1ae8400640 1 -- 172.21.15.138:0/1961774977 >> 172.21.15.138:0/1961774977 conn(0x7f1ae00d0b20 msgr2=0x7f1ae00b0660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:53.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.493+0000 7f1ae8400640 1 -- 172.21.15.138:0/1961774977 shutdown_connections 2024-04-26T20:56:53.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.493+0000 7f1ae8400640 1 -- 172.21.15.138:0/1961774977 wait complete. 2024-04-26T20:56:53.516 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:56:27.265834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T20:56:37.394398+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T20:56:38.544369+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T20:56:42.240243+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T20:56:53.517 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T20:56:53.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.649+0000 7f2eae600640 1 Processor -- start 2024-04-26T20:56:53.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.649+0000 7f2eae600640 1 -- start start 2024-04-26T20:56:53.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.653+0000 7f2eae600640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f2ea8073d70 0x7f2ea8160040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:53.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.653+0000 7f2eae600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2ea806f880 0x7f2ea80ce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:53.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.653+0000 7f2eae600640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ea806dee0 con 0x7f2ea815bdc0 2024-04-26T20:56:53.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.653+0000 7f2eae600640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f2ea815c1a0 con 0x7f2ea8073d70 2024-04-26T20:56:53.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.653+0000 7f2eae600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f2ea806e180 con 0x7f2ea806f880 2024-04-26T20:56:53.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.653+0000 7f2ea7400640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f2ea815bdc0 0x7f2ea815f930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:43594/0 (socket says 172.21.15.138:43594) 2024-04-26T20:56:53.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.653+0000 7f2ea7400640 1 -- 172.21.15.138:0/2158904590 learned_addr learned my addr 172.21.15.138:0/2158904590 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:56:53.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.653+0000 7f2ea6a00640 1 --2- 172.21.15.138:0/2158904590 >> v2:172.21.15.143:3300/0 conn(0x7f2ea8073d70 0x7f2ea8160040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:53.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.653+0000 7f2ea7e00640 1 --2- 172.21.15.138:0/2158904590 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2ea806f880 0x7f2ea80ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:53.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.653+0000 7f2ea6000640 1 -- 172.21.15.138:0/2158904590 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1099601127 0 0) 0x7f2ea806dee0 con 0x7f2ea815bdc0 2024-04-26T20:56:53.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.653+0000 7f2ea6000640 1 -- 172.21.15.138:0/2158904590 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e8c005740 con 0x7f2ea815bdc0 2024-04-26T20:56:53.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.653+0000 7f2ea6000640 1 -- 172.21.15.138:0/2158904590 <== mon.0 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4145319098 0 0) 0x7f2e8c005740 con 0x7f2ea815bdc0 2024-04-26T20:56:53.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.653+0000 7f2ea6000640 1 -- 172.21.15.138:0/2158904590 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2ea806f880 msgr2=0x7f2ea80ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:53.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.653+0000 7f2ea6000640 1 --2- 172.21.15.138:0/2158904590 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2ea806f880 0x7f2ea80ce780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:53.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.653+0000 7f2ea6000640 1 -- 172.21.15.138:0/2158904590 >> v2:172.21.15.143:3300/0 conn(0x7f2ea8073d70 msgr2=0x7f2ea8160040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:53.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.653+0000 7f2ea6000640 1 --2- 172.21.15.138:0/2158904590 >> v2:172.21.15.143:3300/0 conn(0x7f2ea8073d70 0x7f2ea8160040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:53.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.653+0000 7f2ea6000640 1 -- 172.21.15.138:0/2158904590 --> v1:172.21.15.138:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ea806e460 con 0x7f2ea815bdc0 2024-04-26T20:56:53.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.653+0000 7f2ea6000640 1 -- 172.21.15.138:0/2158904590 <== mon.0 v1:172.21.15.138:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2715389689 0 0) 0x7f2e98001a20 con 0x7f2ea815bdc0 2024-04-26T20:56:53.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.653+0000 7f2ea6a00640 1 --2- 172.21.15.138:0/2158904590 >> v2:172.21.15.143:3300/0 conn(0x7f2ea8073d70 0x7f2ea8160040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:56:53.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.653+0000 7f2ea6000640 1 -- 172.21.15.138:0/2158904590 >> v1:172.21.15.138:6789/0 conn(0x7f2ea815bdc0 legacy=0x7f2ea815f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:53.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.653+0000 7f2ea6000640 1 --2- 172.21.15.138:0/2158904590 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2ea806f880 0x7f2e8c005c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:53.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.653+0000 7f2ea6000640 1 --2- 172.21.15.138:0/2158904590 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2e8c0061c0 0x7f2e8c006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:53.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.653+0000 7f2ea6000640 1 --2- 172.21.15.138:0/2158904590 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2e8c006f60 0x7f2e8c0073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:53.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.653+0000 7f2ea6000640 1 -- 172.21.15.138:0/2158904590 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea815c1a0 con 0x7f2e8c006f60 2024-04-26T20:56:53.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.653+0000 7f2ea6000640 1 -- 172.21.15.138:0/2158904590 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea806e180 con 0x7f2e8c0061c0 2024-04-26T20:56:53.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.653+0000 7f2ea6000640 1 -- 172.21.15.138:0/2158904590 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f2e8c00dc90 con 0x7f2ea806f880 2024-04-26T20:56:53.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.653+0000 7f2ea7e00640 1 --2- 172.21.15.138:0/2158904590 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2e8c006f60 0x7f2e8c0073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:53.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.653+0000 7f2ea7400640 1 --2- 172.21.15.138:0/2158904590 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2ea806f880 0x7f2e8c005c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:53.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.653+0000 7f2ea6a00640 1 --2- 172.21.15.138:0/2158904590 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2e8c0061c0 0x7f2e8c006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:53.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.653+0000 7f2ea7e00640 1 -- 172.21.15.138:0/2158904590 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2ea806f880 msgr2=0x7f2e8c005c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:53.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.653+0000 7f2ea7e00640 1 --2- 172.21.15.138:0/2158904590 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2ea806f880 0x7f2e8c005c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:53.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.653+0000 7f2ea7e00640 1 -- 172.21.15.138:0/2158904590 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2e8c0061c0 msgr2=0x7f2e8c006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:53.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.653+0000 7f2ea7e00640 1 --2- 172.21.15.138:0/2158904590 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2e8c0061c0 0x7f2e8c006a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:53.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.653+0000 7f2ea7e00640 1 -- 172.21.15.138:0/2158904590 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e8c005740 con 0x7f2e8c006f60 2024-04-26T20:56:53.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.657+0000 7f2ea7e00640 1 --2- 172.21.15.138:0/2158904590 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2e8c006f60 0x7f2e8c0073e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0009ae0 tx=0x7f2ea001ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=471ea81ebee583dd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:53.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.657+0000 7f2ea6000640 1 -- 172.21.15.138:0/2158904590 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea00b2070 con 0x7f2e8c006f60 2024-04-26T20:56:53.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.657+0000 7f2ea6000640 1 -- 172.21.15.138:0/2158904590 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ea00a5660 con 0x7f2e8c006f60 2024-04-26T20:56:53.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.657+0000 7f2ea6000640 1 -- 172.21.15.138:0/2158904590 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea00096b0 con 0x7f2e8c006f60 2024-04-26T20:56:53.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.657+0000 7f2eae600640 1 -- 172.21.15.138:0/2158904590 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2e8c006f60 msgr2=0x7f2e8c0073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:53.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.657+0000 7f2eae600640 1 --2- 172.21.15.138:0/2158904590 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2e8c006f60 0x7f2e8c0073e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0009ae0 tx=0x7f2ea001ca70 comp rx=0 tx=0).stop 2024-04-26T20:56:53.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.657+0000 7f2ea7e00640 1 -- 172.21.15.138:0/2158904590 reap_dead start 2024-04-26T20:56:53.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.657+0000 7f2eae600640 1 -- 172.21.15.138:0/2158904590 shutdown_connections 2024-04-26T20:56:53.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.657+0000 7f2eae600640 1 -- 172.21.15.138:0/2158904590 >> 172.21.15.138:0/2158904590 conn(0x7f2ea80d0bb0 msgr2=0x7f2ea80d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:53.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.657+0000 7f2eae600640 1 -- 172.21.15.138:0/2158904590 shutdown_connections 2024-04-26T20:56:53.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.657+0000 7f2eae600640 1 -- 172.21.15.138:0/2158904590 wait complete. 2024-04-26T20:56:53.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.657+0000 7f2eae600640 1 Processor -- start 2024-04-26T20:56:53.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.661+0000 7f2eae600640 1 -- start start 2024-04-26T20:56:53.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.661+0000 7f2eae600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2e8c006f60 0x7f2ea81f10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:53.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.661+0000 7f2eae600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ea80c3f60 0x7f2ea80b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:53.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.661+0000 7f2eae600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2ea80c5500 0x7f2ea80c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:53.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.661+0000 7f2eae600640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea8160580 con 0x7f2ea80c3f60 2024-04-26T20:56:53.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.661+0000 7f2eae600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea8073570 con 0x7f2ea80c5500 2024-04-26T20:56:53.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.661+0000 7f2eae600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f2ea8160700 con 0x7f2e8c006f60 2024-04-26T20:56:53.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.661+0000 7f2ea6a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ea80c3f60 0x7f2ea80b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:53.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.661+0000 7f2ea6a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ea80c3f60 0x7f2ea80b1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:56628/0 (socket says 172.21.15.138:56628) 2024-04-26T20:56:53.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.661+0000 7f2ea6a00640 1 -- 172.21.15.138:0/1678589567 learned_addr learned my addr 172.21.15.138:0/1678589567 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:53.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.661+0000 7f2ea7400640 1 --2- 172.21.15.138:0/1678589567 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2e8c006f60 0x7f2ea81f10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:53.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.661+0000 7f2ea7e00640 1 --2- 172.21.15.138:0/1678589567 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2ea80c5500 0x7f2ea80c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:53.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.661+0000 7f2ea6a00640 1 -- 172.21.15.138:0/1678589567 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2e8c006f60 msgr2=0x7f2ea81f10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:53.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.661+0000 7f2ea6a00640 1 --2- 172.21.15.138:0/1678589567 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2e8c006f60 0x7f2ea81f10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:53.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.661+0000 7f2ea6a00640 1 -- 172.21.15.138:0/1678589567 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2ea80c5500 msgr2=0x7f2ea80c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:53.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.661+0000 7f2ea6a00640 1 --2- 172.21.15.138:0/1678589567 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2ea80c5500 0x7f2ea80c5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:53.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.661+0000 7f2ea6a00640 1 -- 172.21.15.138:0/1678589567 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ea81f1620 con 0x7f2ea80c3f60 2024-04-26T20:56:53.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.661+0000 7f2ea6a00640 1 --2- 172.21.15.138:0/1678589567 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ea80c3f60 0x7f2ea80b1f30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2e94011ca0 tx=0x7f2e9400f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:53.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.661+0000 7f2e9f400640 1 -- 172.21.15.138:0/1678589567 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e94011cd0 con 0x7f2ea80c3f60 2024-04-26T20:56:53.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.661+0000 7f2e9f400640 1 -- 172.21.15.138:0/1678589567 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e94011e70 con 0x7f2ea80c3f60 2024-04-26T20:56:53.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.661+0000 7f2eae600640 1 -- 172.21.15.138:0/1678589567 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ea80c4460 con 0x7f2ea80c3f60 2024-04-26T20:56:53.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.661+0000 7f2e9f400640 1 -- 172.21.15.138:0/1678589567 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e94004250 con 0x7f2ea80c3f60 2024-04-26T20:56:53.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.661+0000 7f2eae600640 1 -- 172.21.15.138:0/1678589567 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ea80c4a20 con 0x7f2ea80c3f60 2024-04-26T20:56:53.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.661+0000 7f2eae600640 1 -- 172.21.15.138:0/1678589567 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ea8069430 con 0x7f2ea80c3f60 2024-04-26T20:56:53.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.665+0000 7f2e9f400640 1 -- 172.21.15.138:0/1678589567 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2e94012040 con 0x7f2ea80c3f60 2024-04-26T20:56:53.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.665+0000 7f2e9f400640 1 --2- 172.21.15.138:0/1678589567 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f2e88068380 0x7f2e8806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:53.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.665+0000 7f2e9f400640 1 -- 172.21.15.138:0/1678589567 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f2e94087220 con 0x7f2ea80c3f60 2024-04-26T20:56:53.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.665+0000 7f2ea7400640 1 --2- 172.21.15.138:0/1678589567 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f2e88068380 0x7f2e8806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:53.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.665+0000 7f2ea7400640 1 --2- 172.21.15.138:0/1678589567 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f2e88068380 0x7f2e8806a840 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2ea815f820 tx=0x7f2e9800a060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:53.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.669+0000 7f2e9f400640 1 -- 172.21.15.138:0/1678589567 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2e94019070 con 0x7f2ea80c3f60 2024-04-26T20:56:53.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.825+0000 7f2eae600640 1 -- 172.21.15.138:0/1678589567 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2ea80d04c0 con 0x7f2ea80c3f60 2024-04-26T20:56:53.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.825+0000 7f2e9f400640 1 -- 172.21.15.138:0/1678589567 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f2e94056db0 con 0x7f2ea80c3f60 2024-04-26T20:56:53.830 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 1 2024-04-26T20:56:53.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.829+0000 7f2eae600640 1 -- 172.21.15.138:0/1678589567 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f2e88068380 msgr2=0x7f2e8806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:53.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.829+0000 7f2eae600640 1 --2- 172.21.15.138:0/1678589567 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f2e88068380 0x7f2e8806a840 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2ea815f820 tx=0x7f2e9800a060 comp rx=0 tx=0).stop 2024-04-26T20:56:53.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.829+0000 7f2eae600640 1 -- 172.21.15.138:0/1678589567 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ea80c3f60 msgr2=0x7f2ea80b1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:53.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.829+0000 7f2eae600640 1 --2- 172.21.15.138:0/1678589567 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ea80c3f60 0x7f2ea80b1f30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2e94011ca0 tx=0x7f2e9400f610 comp rx=0 tx=0).stop 2024-04-26T20:56:53.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.829+0000 7f2eae600640 1 -- 172.21.15.138:0/1678589567 shutdown_connections 2024-04-26T20:56:53.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.829+0000 7f2eae600640 1 --2- 172.21.15.138:0/1678589567 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f2e88068380 0x7f2e8806a840 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:53.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.829+0000 7f2eae600640 1 --2- 172.21.15.138:0/1678589567 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2ea80c5500 0x7f2ea80c5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:53.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.829+0000 7f2eae600640 1 --2- 172.21.15.138:0/1678589567 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ea80c3f60 0x7f2ea80b1f30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:53.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.829+0000 7f2eae600640 1 --2- 172.21.15.138:0/1678589567 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2e8c006f60 0x7f2ea81f10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:53.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.829+0000 7f2eae600640 1 -- 172.21.15.138:0/1678589567 >> 172.21.15.138:0/1678589567 conn(0x7f2ea80d0bb0 msgr2=0x7f2ea80cb1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:53.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.829+0000 7f2eae600640 1 -- 172.21.15.138:0/1678589567 shutdown_connections 2024-04-26T20:56:53.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.829+0000 7f2eae600640 1 -- 172.21.15.138:0/1678589567 wait complete. 2024-04-26T20:56:53.852 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T20:56:53.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.985+0000 7fb82ac00640 1 Processor -- start 2024-04-26T20:56:53.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.985+0000 7fb82ac00640 1 -- start start 2024-04-26T20:56:53.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.985+0000 7fb82ac00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb8240cd6d0 0x7fb82406c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:53.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.985+0000 7fb82ac00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8240cbab0 con 0x7fb8240cf950 2024-04-26T20:56:53.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.985+0000 7fb82ac00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb824163940 con 0x7fb82415efe0 2024-04-26T20:56:53.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.985+0000 7fb82ac00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fb8240cbd30 con 0x7fb8240cd6d0 2024-04-26T20:56:53.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.985+0000 7fb81b400640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fb8240cf950 0x7fb8240cc810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:43602/0 (socket says 172.21.15.138:43602) 2024-04-26T20:56:53.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.985+0000 7fb81b400640 1 -- 172.21.15.138:0/2612797507 learned_addr learned my addr 172.21.15.138:0/2612797507 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:56:53.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.989+0000 7fb828c00640 1 --2- 172.21.15.138:0/2612797507 >> v2:172.21.15.143:3300/0 conn(0x7fb8240cd6d0 0x7fb82406c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:53.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.989+0000 7fb823400640 1 -- 172.21.15.138:0/2612797507 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1027668194 0 0) 0x7fb80c001120 con 0x7fb8240cf950 2024-04-26T20:56:53.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.989+0000 7fb823400640 1 -- 172.21.15.138:0/2612797507 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb808003530 con 0x7fb8240cf950 2024-04-26T20:56:53.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.989+0000 7fb823400640 1 -- 172.21.15.138:0/2612797507 <== mon.0 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3694312478 0 0) 0x7fb808003530 con 0x7fb8240cf950 2024-04-26T20:56:53.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.989+0000 7fb828c00640 1 -- 172.21.15.138:0/2612797507 >> v1:172.21.15.143:6789/0 conn(0x7fb82415efe0 legacy=0x7fb8240cf240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:53.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.989+0000 7fb828c00640 1 -- 172.21.15.138:0/2612797507 >> v1:172.21.15.138:6789/0 conn(0x7fb8240cf950 legacy=0x7fb8240cc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:53.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.989+0000 7fb828c00640 1 -- 172.21.15.138:0/2612797507 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8240cc010 con 0x7fb8240cd6d0 2024-04-26T20:56:53.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.989+0000 7fb828c00640 1 --2- 172.21.15.138:0/2612797507 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb8240cd6d0 0x7fb82406c300 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb81c0097c0 tx=0x7fb81c01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6cd2c95d51fac566 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:53.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.989+0000 7fb823400640 1 -- 172.21.15.138:0/2612797507 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb81c0b2070 con 0x7fb8240cd6d0 2024-04-26T20:56:53.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.989+0000 7fb823400640 1 -- 172.21.15.138:0/2612797507 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb81c0a9070 con 0x7fb8240cd6d0 2024-04-26T20:56:53.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.989+0000 7fb823400640 1 -- 172.21.15.138:0/2612797507 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb80c001850 con 0x7fb8240cd6d0 2024-04-26T20:56:53.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.993+0000 7fb82ac00640 1 -- 172.21.15.138:0/2612797507 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb8240cd6d0 msgr2=0x7fb82406c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:53.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.993+0000 7fb82ac00640 1 --2- 172.21.15.138:0/2612797507 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb8240cd6d0 0x7fb82406c300 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb81c0097c0 tx=0x7fb81c01c3c0 comp rx=0 tx=0).stop 2024-04-26T20:56:53.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.993+0000 7fb82ac00640 1 -- 172.21.15.138:0/2612797507 shutdown_connections 2024-04-26T20:56:53.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.993+0000 7fb82ac00640 1 --2- 172.21.15.138:0/2612797507 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb8240cd6d0 0x7fb82406c300 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:53.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.993+0000 7fb82ac00640 1 -- 172.21.15.138:0/2612797507 >> 172.21.15.138:0/2612797507 conn(0x7fb8240cdee0 msgr2=0x7fb8240ce2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:53.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.993+0000 7fb82ac00640 1 -- 172.21.15.138:0/2612797507 shutdown_connections 2024-04-26T20:56:53.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.993+0000 7fb82ac00640 1 -- 172.21.15.138:0/2612797507 wait complete. 2024-04-26T20:56:53.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.993+0000 7fb82ac00640 1 Processor -- start 2024-04-26T20:56:53.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.993+0000 7fb82ac00640 1 -- start start 2024-04-26T20:56:54.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.993+0000 7fb82ac00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb8240cd6d0 0x7fb824160940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:54.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.993+0000 7fb82ac00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb8240cf950 0x7fb824158330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:54.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.993+0000 7fb82ac00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb82415efe0 0x7fb824155e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:54.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.993+0000 7fb82ac00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fb8240cd330 con 0x7fb82415efe0 2024-04-26T20:56:54.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.993+0000 7fb82ac00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fb82415f3c0 con 0x7fb8240cd6d0 2024-04-26T20:56:54.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.993+0000 7fb82ac00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb8241591c0 con 0x7fb8240cf950 2024-04-26T20:56:54.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.993+0000 7fb828c00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb82415efe0 0x7fb824155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:54.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.993+0000 7fb828c00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb82415efe0 0x7fb824155e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:56636/0 (socket says 172.21.15.138:56636) 2024-04-26T20:56:54.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.993+0000 7fb828c00640 1 -- 172.21.15.138:0/3997225694 learned_addr learned my addr 172.21.15.138:0/3997225694 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:54.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.993+0000 7fb81b400640 1 --2- 172.21.15.138:0/3997225694 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb8240cf950 0x7fb824158330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:54.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.993+0000 7fb823e00640 1 --2- 172.21.15.138:0/3997225694 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb8240cd6d0 0x7fb824160940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:54.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.993+0000 7fb828c00640 1 -- 172.21.15.138:0/3997225694 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb8240cf950 msgr2=0x7fb824158330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:54.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.993+0000 7fb828c00640 1 --2- 172.21.15.138:0/3997225694 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb8240cf950 0x7fb824158330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:54.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.993+0000 7fb828c00640 1 -- 172.21.15.138:0/3997225694 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb8240cd6d0 msgr2=0x7fb824160940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:54.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.993+0000 7fb828c00640 1 --2- 172.21.15.138:0/3997225694 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb8240cd6d0 0x7fb824160940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:54.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.993+0000 7fb828c00640 1 -- 172.21.15.138:0/3997225694 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb824160f20 con 0x7fb82415efe0 2024-04-26T20:56:54.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.993+0000 7fb823e00640 1 --2- 172.21.15.138:0/3997225694 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb8240cd6d0 0x7fb824160940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:56:54.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.997+0000 7fb828c00640 1 --2- 172.21.15.138:0/3997225694 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb82415efe0 0x7fb824155e20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb81c019ff0 tx=0x7fb81c019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:54.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.997+0000 7fb820c00640 1 -- 172.21.15.138:0/3997225694 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb81c0b2040 con 0x7fb82415efe0 2024-04-26T20:56:54.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.997+0000 7fb820c00640 1 -- 172.21.15.138:0/3997225694 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb81c0bb070 con 0x7fb82415efe0 2024-04-26T20:56:54.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.997+0000 7fb82ac00640 1 -- 172.21.15.138:0/3997225694 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb824161200 con 0x7fb82415efe0 2024-04-26T20:56:54.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.997+0000 7fb820c00640 1 -- 172.21.15.138:0/3997225694 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb81c003aa0 con 0x7fb82415efe0 2024-04-26T20:56:54.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.997+0000 7fb82ac00640 1 -- 172.21.15.138:0/3997225694 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8241617c0 con 0x7fb82415efe0 2024-04-26T20:56:54.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.997+0000 7fb82ac00640 1 -- 172.21.15.138:0/3997225694 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb824069430 con 0x7fb82415efe0 2024-04-26T20:56:54.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.997+0000 7fb820c00640 1 -- 172.21.15.138:0/3997225694 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb81c0ab070 con 0x7fb82415efe0 2024-04-26T20:56:54.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.997+0000 7fb820c00640 1 --2- 172.21.15.138:0/3997225694 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb8000683b0 0x7fb80006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:54.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.997+0000 7fb820c00640 1 -- 172.21.15.138:0/3997225694 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fb81c120650 con 0x7fb82415efe0 2024-04-26T20:56:54.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:53.997+0000 7fb823e00640 1 --2- 172.21.15.138:0/3997225694 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb8000683b0 0x7fb80006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:54.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.001+0000 7fb823e00640 1 --2- 172.21.15.138:0/3997225694 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb8000683b0 0x7fb80006a870 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb8140012f0 tx=0x7fb814009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:54.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.001+0000 7fb820c00640 1 -- 172.21.15.138:0/3997225694 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb81c015fb0 con 0x7fb82415efe0 2024-04-26T20:56:54.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.157+0000 7fb82ac00640 1 -- 172.21.15.138:0/3997225694 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb8240710c0 con 0x7fb82415efe0 2024-04-26T20:56:54.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.157+0000 7fb820c00640 1 -- 172.21.15.138:0/3997225694 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7fb81c0f0830 con 0x7fb82415efe0 2024-04-26T20:56:54.163 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 32 2024-04-26T20:56:54.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.161+0000 7fb82ac00640 1 -- 172.21.15.138:0/3997225694 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb8000683b0 msgr2=0x7fb80006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:54.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.161+0000 7fb82ac00640 1 --2- 172.21.15.138:0/3997225694 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb8000683b0 0x7fb80006a870 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb8140012f0 tx=0x7fb814009040 comp rx=0 tx=0).stop 2024-04-26T20:56:54.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.161+0000 7fb82ac00640 1 -- 172.21.15.138:0/3997225694 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb82415efe0 msgr2=0x7fb824155e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:54.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.161+0000 7fb82ac00640 1 --2- 172.21.15.138:0/3997225694 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb82415efe0 0x7fb824155e20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb81c019ff0 tx=0x7fb81c019160 comp rx=0 tx=0).stop 2024-04-26T20:56:54.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.161+0000 7fb82ac00640 1 -- 172.21.15.138:0/3997225694 shutdown_connections 2024-04-26T20:56:54.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.161+0000 7fb82ac00640 1 --2- 172.21.15.138:0/3997225694 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb8000683b0 0x7fb80006a870 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:54.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.161+0000 7fb82ac00640 1 --2- 172.21.15.138:0/3997225694 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb82415efe0 0x7fb824155e20 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:54.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.161+0000 7fb82ac00640 1 --2- 172.21.15.138:0/3997225694 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb8240cf950 0x7fb824158330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:54.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.161+0000 7fb82ac00640 1 --2- 172.21.15.138:0/3997225694 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb8240cd6d0 0x7fb824160940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:54.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.161+0000 7fb82ac00640 1 -- 172.21.15.138:0/3997225694 >> 172.21.15.138:0/3997225694 conn(0x7fb8240cdee0 msgr2=0x7fb8240cf150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:54.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.161+0000 7fb82ac00640 1 -- 172.21.15.138:0/3997225694 shutdown_connections 2024-04-26T20:56:54.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.161+0000 7fb82ac00640 1 -- 172.21.15.138:0/3997225694 wait complete. 2024-04-26T20:56:54.184 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T20:56:54.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.321+0000 7fad6e400640 1 Processor -- start 2024-04-26T20:56:54.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.321+0000 7fad6e400640 1 -- start start 2024-04-26T20:56:54.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.321+0000 7fad6e400640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fad6815f600 0x7fad6806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:54.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.321+0000 7fad6e400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad6806e4a0 0x7fad680cdd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:54.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.321+0000 7fad6e400640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad680d1e50 con 0x7fad6815f220 2024-04-26T20:56:54.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.321+0000 7fad6e400640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fad6806dbf0 con 0x7fad6815f600 2024-04-26T20:56:54.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.321+0000 7fad6e400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fad680cd8a0 con 0x7fad6806e4a0 2024-04-26T20:56:54.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.321+0000 7fad6d000640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fad6815f220 0x7fad6806dd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:43608/0 (socket says 172.21.15.138:43608) 2024-04-26T20:56:54.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.321+0000 7fad6d000640 1 -- 172.21.15.138:0/1416585712 learned_addr learned my addr 172.21.15.138:0/1416585712 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:56:54.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.321+0000 7fad6da00640 1 --2- 172.21.15.138:0/1416585712 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad6806e4a0 0x7fad680cdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:54.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.321+0000 7fad67e00640 1 --2- 172.21.15.138:0/1416585712 >> v2:172.21.15.143:3300/0 conn(0x7fad6815f600 0x7fad6806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:54.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.321+0000 7fad67400640 1 -- 172.21.15.138:0/1416585712 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 527938174 0 0) 0x7fad680d1e50 con 0x7fad6815f220 2024-04-26T20:56:54.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.321+0000 7fad67400640 1 -- 172.21.15.138:0/1416585712 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad50003530 con 0x7fad6815f220 2024-04-26T20:56:54.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.321+0000 7fad67400640 1 -- 172.21.15.138:0/1416585712 <== mon.0 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 706018792 0 0) 0x7fad50003530 con 0x7fad6815f220 2024-04-26T20:56:54.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.321+0000 7fad67400640 1 -- 172.21.15.138:0/1416585712 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad6806e4a0 msgr2=0x7fad680cdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:54.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.321+0000 7fad67400640 1 --2- 172.21.15.138:0/1416585712 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad6806e4a0 0x7fad680cdd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:54.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.321+0000 7fad67400640 1 -- 172.21.15.138:0/1416585712 >> v2:172.21.15.143:3300/0 conn(0x7fad6815f600 msgr2=0x7fad6806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:54.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.321+0000 7fad67400640 1 --2- 172.21.15.138:0/1416585712 >> v2:172.21.15.143:3300/0 conn(0x7fad6815f600 0x7fad6806d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:54.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.321+0000 7fad67400640 1 -- 172.21.15.138:0/1416585712 --> v1:172.21.15.138:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad680d2130 con 0x7fad6815f220 2024-04-26T20:56:54.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.321+0000 7fad67400640 1 -- 172.21.15.138:0/1416585712 <== mon.0 v1:172.21.15.138:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2715389689 0 0) 0x7fad5c001680 con 0x7fad6815f220 2024-04-26T20:56:54.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.321+0000 7fad67400640 1 -- 172.21.15.138:0/1416585712 >> v1:172.21.15.138:6789/0 conn(0x7fad6815f220 legacy=0x7fad6806dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:54.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.321+0000 7fad67400640 1 --2- 172.21.15.138:0/1416585712 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad500039c0 0x7fad50003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:54.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.321+0000 7fad67400640 1 --2- 172.21.15.138:0/1416585712 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad6806e4a0 0x7fad50004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:54.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.321+0000 7fad67400640 1 --2- 172.21.15.138:0/1416585712 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad50004d50 0x7fad500051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:54.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.321+0000 7fad67400640 1 -- 172.21.15.138:0/1416585712 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fad6806dbf0 con 0x7fad500039c0 2024-04-26T20:56:54.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.321+0000 7fad67400640 1 -- 172.21.15.138:0/1416585712 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fad680cd8a0 con 0x7fad50004d50 2024-04-26T20:56:54.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.321+0000 7fad67400640 1 -- 172.21.15.138:0/1416585712 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fad5000b9d0 con 0x7fad6806e4a0 2024-04-26T20:56:54.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.321+0000 7fad6da00640 1 --2- 172.21.15.138:0/1416585712 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad50004d50 0x7fad500051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:54.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.321+0000 7fad6d000640 1 --2- 172.21.15.138:0/1416585712 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad500039c0 0x7fad50003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:54.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.321+0000 7fad67e00640 1 --2- 172.21.15.138:0/1416585712 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad6806e4a0 0x7fad50004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:54.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.325+0000 7fad6da00640 1 -- 172.21.15.138:0/1416585712 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad6806e4a0 msgr2=0x7fad50004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:54.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.325+0000 7fad6da00640 1 --2- 172.21.15.138:0/1416585712 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad6806e4a0 0x7fad50004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:54.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.325+0000 7fad6da00640 1 -- 172.21.15.138:0/1416585712 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad500039c0 msgr2=0x7fad50003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:54.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.325+0000 7fad6da00640 1 --2- 172.21.15.138:0/1416585712 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad500039c0 0x7fad50003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:54.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.325+0000 7fad6da00640 1 -- 172.21.15.138:0/1416585712 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad50003530 con 0x7fad50004d50 2024-04-26T20:56:54.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.325+0000 7fad6d000640 1 --2- 172.21.15.138:0/1416585712 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad500039c0 0x7fad50003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:56:54.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.325+0000 7fad6da00640 1 --2- 172.21.15.138:0/1416585712 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad50004d50 0x7fad500051d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fad680cd340 tx=0x7fad6001cbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92c88dab0e79d689 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:54.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.325+0000 7fad67400640 1 -- 172.21.15.138:0/1416585712 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad600b2070 con 0x7fad50004d50 2024-04-26T20:56:54.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.325+0000 7fad67400640 1 -- 172.21.15.138:0/1416585712 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad600a5ae0 con 0x7fad50004d50 2024-04-26T20:56:54.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.325+0000 7fad67400640 1 -- 172.21.15.138:0/1416585712 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad60009c10 con 0x7fad50004d50 2024-04-26T20:56:54.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.329+0000 7fad6e400640 1 -- 172.21.15.138:0/1416585712 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad50004d50 msgr2=0x7fad500051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:54.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.329+0000 7fad6e400640 1 --2- 172.21.15.138:0/1416585712 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad50004d50 0x7fad500051d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fad680cd340 tx=0x7fad6001cbe0 comp rx=0 tx=0).stop 2024-04-26T20:56:54.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.329+0000 7fad6da00640 1 -- 172.21.15.138:0/1416585712 reap_dead start 2024-04-26T20:56:54.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.329+0000 7fad6e400640 1 -- 172.21.15.138:0/1416585712 shutdown_connections 2024-04-26T20:56:54.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.329+0000 7fad6e400640 1 -- 172.21.15.138:0/1416585712 >> 172.21.15.138:0/1416585712 conn(0x7fad680d2d40 msgr2=0x7fad680d3150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:54.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.329+0000 7fad6e400640 1 -- 172.21.15.138:0/1416585712 shutdown_connections 2024-04-26T20:56:54.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.329+0000 7fad6e400640 1 -- 172.21.15.138:0/1416585712 wait complete. 2024-04-26T20:56:54.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.329+0000 7fad6e400640 1 Processor -- start 2024-04-26T20:56:54.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.329+0000 7fad6e400640 1 -- start start 2024-04-26T20:56:54.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.329+0000 7fad6e400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad50004d50 0x7fad681532c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:54.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.329+0000 7fad6e400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad6815c7e0 0x7fad6815cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:54.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.329+0000 7fad6e400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad680c9e80 0x7fad680ca300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:54.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.329+0000 7fad6e400640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fad680ce6a0 con 0x7fad50004d50 2024-04-26T20:56:54.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.329+0000 7fad6e400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fad680ce520 con 0x7fad680c9e80 2024-04-26T20:56:54.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.329+0000 7fad6e400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fad680ce820 con 0x7fad6815c7e0 2024-04-26T20:56:54.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.329+0000 7fad6d000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad50004d50 0x7fad681532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:54.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.329+0000 7fad6d000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad50004d50 0x7fad681532c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:56644/0 (socket says 172.21.15.138:56644) 2024-04-26T20:56:54.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.329+0000 7fad6d000640 1 -- 172.21.15.138:0/3911490933 learned_addr learned my addr 172.21.15.138:0/3911490933 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:54.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.329+0000 7fad6d000640 1 -- 172.21.15.138:0/3911490933 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad6815c7e0 msgr2=0x7fad6815cc40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T20:56:54.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.329+0000 7fad6d000640 1 --2- 172.21.15.138:0/3911490933 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad6815c7e0 0x7fad6815cc40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:54.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.329+0000 7fad6d000640 1 -- 172.21.15.138:0/3911490933 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad680c9e80 msgr2=0x7fad680ca300 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T20:56:54.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.329+0000 7fad6d000640 1 --2- 172.21.15.138:0/3911490933 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad680c9e80 0x7fad680ca300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:54.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.329+0000 7fad6d000640 1 -- 172.21.15.138:0/3911490933 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad680cabd0 con 0x7fad50004d50 2024-04-26T20:56:54.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.329+0000 7fad6d000640 1 --2- 172.21.15.138:0/3911490933 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad50004d50 0x7fad681532c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fad5c0017f0 tx=0x7fad5c007810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:54.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.329+0000 7fad64c00640 1 -- 172.21.15.138:0/3911490933 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad5c01a070 con 0x7fad50004d50 2024-04-26T20:56:54.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.329+0000 7fad64c00640 1 -- 172.21.15.138:0/3911490933 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad5c00fa40 con 0x7fad50004d50 2024-04-26T20:56:54.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.329+0000 7fad6e400640 1 -- 172.21.15.138:0/3911490933 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad680caeb0 con 0x7fad50004d50 2024-04-26T20:56:54.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.329+0000 7fad64c00640 1 -- 172.21.15.138:0/3911490933 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad5c00fe10 con 0x7fad50004d50 2024-04-26T20:56:54.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.329+0000 7fad6e400640 1 -- 172.21.15.138:0/3911490933 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad680cb470 con 0x7fad50004d50 2024-04-26T20:56:54.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.333+0000 7fad6e400640 1 -- 172.21.15.138:0/3911490933 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad68069430 con 0x7fad50004d50 2024-04-26T20:56:54.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.333+0000 7fad64c00640 1 -- 172.21.15.138:0/3911490933 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fad5c01d070 con 0x7fad50004d50 2024-04-26T20:56:54.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.333+0000 7fad64c00640 1 --2- 172.21.15.138:0/3911490933 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fad48068380 0x7fad4806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:54.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.333+0000 7fad64c00640 1 -- 172.21.15.138:0/3911490933 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fad5c086b00 con 0x7fad50004d50 2024-04-26T20:56:54.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.333+0000 7fad67e00640 1 --2- 172.21.15.138:0/3911490933 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fad48068380 0x7fad4806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:54.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.333+0000 7fad67e00640 1 --2- 172.21.15.138:0/3911490933 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fad48068380 0x7fad4806a840 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fad681fb990 tx=0x7fad54008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:54.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.337+0000 7fad64c00640 1 -- 172.21.15.138:0/3911490933 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fad5c056c50 con 0x7fad50004d50 2024-04-26T20:56:54.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.493+0000 7fad6e400640 1 -- 172.21.15.138:0/3911490933 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fad6815e490 con 0x7fad50004d50 2024-04-26T20:56:54.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.493+0000 7fad64c00640 1 -- 172.21.15.138:0/3911490933 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7fad5c086e20 con 0x7fad50004d50 2024-04-26T20:56:54.498 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 64 2024-04-26T20:56:54.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.497+0000 7fad6e400640 1 -- 172.21.15.138:0/3911490933 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fad48068380 msgr2=0x7fad4806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:54.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.497+0000 7fad6e400640 1 --2- 172.21.15.138:0/3911490933 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fad48068380 0x7fad4806a840 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fad681fb990 tx=0x7fad54008040 comp rx=0 tx=0).stop 2024-04-26T20:56:54.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.497+0000 7fad6e400640 1 -- 172.21.15.138:0/3911490933 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad50004d50 msgr2=0x7fad681532c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:54.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.497+0000 7fad6e400640 1 --2- 172.21.15.138:0/3911490933 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad50004d50 0x7fad681532c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fad5c0017f0 tx=0x7fad5c007810 comp rx=0 tx=0).stop 2024-04-26T20:56:54.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.497+0000 7fad6e400640 1 -- 172.21.15.138:0/3911490933 shutdown_connections 2024-04-26T20:56:54.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.497+0000 7fad6e400640 1 --2- 172.21.15.138:0/3911490933 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fad48068380 0x7fad4806a840 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:54.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.497+0000 7fad6e400640 1 --2- 172.21.15.138:0/3911490933 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad680c9e80 0x7fad680ca300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:54.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.497+0000 7fad6e400640 1 --2- 172.21.15.138:0/3911490933 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad6815c7e0 0x7fad6815cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:54.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.497+0000 7fad6e400640 1 --2- 172.21.15.138:0/3911490933 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad50004d50 0x7fad681532c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:54.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.497+0000 7fad6e400640 1 -- 172.21.15.138:0/3911490933 >> 172.21.15.138:0/3911490933 conn(0x7fad680d2d40 msgr2=0x7fad6815dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:54.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.497+0000 7fad6e400640 1 -- 172.21.15.138:0/3911490933 shutdown_connections 2024-04-26T20:56:54.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.497+0000 7fad6e400640 1 -- 172.21.15.138:0/3911490933 wait complete. 2024-04-26T20:56:54.519 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T20:56:54.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.653+0000 7f6705200640 1 Processor -- start 2024-04-26T20:56:54.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.653+0000 7f6705200640 1 -- start start 2024-04-26T20:56:54.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.653+0000 7f6705200640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f670006f880 0x7f6700166cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:54.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.653+0000 7f6705200640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6700160750 con 0x7f6700073d70 2024-04-26T20:56:54.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.653+0000 7f6705200640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f670006dee0 con 0x7f670015bdc0 2024-04-26T20:56:54.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.653+0000 7f6705200640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f670015c1a0 con 0x7f670006f880 2024-04-26T20:56:54.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.653+0000 7f66fe800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f670006f880 0x7f6700166cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:54.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.653+0000 7f66fd400640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f6700073d70 0x7f6700160040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:43622/0 (socket says 172.21.15.138:43622) 2024-04-26T20:56:54.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.653+0000 7f66fd400640 1 -- 172.21.15.138:0/1802368352 learned_addr learned my addr 172.21.15.138:0/1802368352 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:56:54.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.657+0000 7f66fe800640 1 -- 172.21.15.138:0/1802368352 >> v1:172.21.15.143:6789/0 conn(0x7f670015bdc0 legacy=0x7f670015f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:54.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.657+0000 7f66fe800640 1 -- 172.21.15.138:0/1802368352 >> v1:172.21.15.138:6789/0 conn(0x7f6700073d70 legacy=0x7f6700160040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:54.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.657+0000 7f66fe800640 1 -- 172.21.15.138:0/1802368352 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f670006e180 con 0x7f670006f880 2024-04-26T20:56:54.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.657+0000 7f66fca00640 1 -- 172.21.15.138:0/1802368352 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 445400192 0 0) 0x7f6700160750 con 0x7f6700073d70 2024-04-26T20:56:54.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.657+0000 7f66fe800640 1 --2- 172.21.15.138:0/1802368352 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f670006f880 0x7f6700166cc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f66f800bfa0 tx=0x7f66f801ea50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=354f3407f085dc4b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:54.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.657+0000 7f66fca00640 1 -- 172.21.15.138:0/1802368352 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f800b2d0 con 0x7f670006f880 2024-04-26T20:56:54.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.657+0000 7f66fca00640 1 -- 172.21.15.138:0/1802368352 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66f80a7710 con 0x7f670006f880 2024-04-26T20:56:54.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.657+0000 7f66fca00640 1 -- 172.21.15.138:0/1802368352 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f80a7ae0 con 0x7f670006f880 2024-04-26T20:56:54.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.657+0000 7f6705200640 1 -- 172.21.15.138:0/1802368352 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f670006f880 msgr2=0x7f6700166cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:54.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.657+0000 7f6705200640 1 --2- 172.21.15.138:0/1802368352 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f670006f880 0x7f6700166cc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f66f800bfa0 tx=0x7f66f801ea50 comp rx=0 tx=0).stop 2024-04-26T20:56:54.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.657+0000 7f6705200640 1 -- 172.21.15.138:0/1802368352 shutdown_connections 2024-04-26T20:56:54.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.657+0000 7f6705200640 1 --2- 172.21.15.138:0/1802368352 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f670006f880 0x7f6700166cc0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:54.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.657+0000 7f6705200640 1 -- 172.21.15.138:0/1802368352 >> 172.21.15.138:0/1802368352 conn(0x7f67000d0bb0 msgr2=0x7f67000d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:54.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.657+0000 7f6705200640 1 -- 172.21.15.138:0/1802368352 shutdown_connections 2024-04-26T20:56:54.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.657+0000 7f6705200640 1 -- 172.21.15.138:0/1802368352 wait complete. 2024-04-26T20:56:54.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.661+0000 7f6705200640 1 Processor -- start 2024-04-26T20:56:54.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.661+0000 7f6705200640 1 -- start start 2024-04-26T20:56:54.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.661+0000 7f6705200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f670006f880 0x7f670015c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:54.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.661+0000 7f6705200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6700073d70 0x7f67000b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:54.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.661+0000 7f6705200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f670015bdc0 0x7f670015da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:54.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.661+0000 7f6705200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f670006f100 con 0x7f670006f880 2024-04-26T20:56:54.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.661+0000 7f6705200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f670006ef80 con 0x7f670015bdc0 2024-04-26T20:56:54.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.661+0000 7f6705200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f670006f280 con 0x7f6700073d70 2024-04-26T20:56:54.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.661+0000 7f66fde00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f670006f880 0x7f670015c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:54.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.661+0000 7f66fde00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f670006f880 0x7f670015c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:56658/0 (socket says 172.21.15.138:56658) 2024-04-26T20:56:54.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.661+0000 7f66fde00640 1 -- 172.21.15.138:0/33141082 learned_addr learned my addr 172.21.15.138:0/33141082 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:54.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.661+0000 7f66fd400640 1 --2- 172.21.15.138:0/33141082 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6700073d70 0x7f67000b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:54.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.661+0000 7f66fe800640 1 --2- 172.21.15.138:0/33141082 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f670015bdc0 0x7f670015da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:54.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.661+0000 7f66fde00640 1 -- 172.21.15.138:0/33141082 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6700073d70 msgr2=0x7f67000b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:54.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.661+0000 7f66fde00640 1 --2- 172.21.15.138:0/33141082 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6700073d70 0x7f67000b6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:54.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.661+0000 7f66fde00640 1 -- 172.21.15.138:0/33141082 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f670015bdc0 msgr2=0x7f670015da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:54.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.661+0000 7f66fde00640 1 --2- 172.21.15.138:0/33141082 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f670015bdc0 0x7f670015da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:54.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.661+0000 7f66fde00640 1 -- 172.21.15.138:0/33141082 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67000b6770 con 0x7f670006f880 2024-04-26T20:56:54.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.661+0000 7f66fde00640 1 --2- 172.21.15.138:0/33141082 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f670006f880 0x7f670015c3b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f66e800c3c0 tx=0x7f66e800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:54.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.661+0000 7f66f6000640 1 -- 172.21.15.138:0/33141082 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e8017070 con 0x7f670006f880 2024-04-26T20:56:54.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.661+0000 7f66f6000640 1 -- 172.21.15.138:0/33141082 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66e80052d0 con 0x7f670006f880 2024-04-26T20:56:54.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.661+0000 7f6705200640 1 -- 172.21.15.138:0/33141082 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f670015c9f0 con 0x7f670006f880 2024-04-26T20:56:54.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.661+0000 7f66f6000640 1 -- 172.21.15.138:0/33141082 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e8003840 con 0x7f670006f880 2024-04-26T20:56:54.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.661+0000 7f6705200640 1 -- 172.21.15.138:0/33141082 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f670015d230 con 0x7f670006f880 2024-04-26T20:56:54.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.665+0000 7f6705200640 1 -- 172.21.15.138:0/33141082 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6700069430 con 0x7f670006f880 2024-04-26T20:56:54.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.665+0000 7f66f6000640 1 -- 172.21.15.138:0/33141082 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f66e801a070 con 0x7f670006f880 2024-04-26T20:56:54.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.665+0000 7f66f6000640 1 --2- 172.21.15.138:0/33141082 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f66dc068380 0x7f66dc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:54.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.665+0000 7f66f6000640 1 -- 172.21.15.138:0/33141082 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f66e8085f60 con 0x7f670006f880 2024-04-26T20:56:54.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.665+0000 7f66fd400640 1 --2- 172.21.15.138:0/33141082 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f66dc068380 0x7f66dc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:54.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.665+0000 7f66fd400640 1 --2- 172.21.15.138:0/33141082 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f66dc068380 0x7f66dc06a840 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f66f0007fd0 tx=0x7f66f0007ba0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:54.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.669+0000 7f66f6000640 1 -- 172.21.15.138:0/33141082 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f670015c9f0 con 0x7f670006f880 2024-04-26T20:56:54.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.825+0000 7f6705200640 1 -- 172.21.15.138:0/33141082 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f67000cc190 con 0x7f670006f880 2024-04-26T20:56:54.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.829+0000 7f66f6000640 1 -- 172.21.15.138:0/33141082 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f66e8005480 con 0x7f670006f880 2024-04-26T20:56:54.832 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 32 2024-04-26T20:56:54.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.829+0000 7f6705200640 1 -- 172.21.15.138:0/33141082 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f66dc068380 msgr2=0x7f66dc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:54.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.829+0000 7f6705200640 1 --2- 172.21.15.138:0/33141082 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f66dc068380 0x7f66dc06a840 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f66f0007fd0 tx=0x7f66f0007ba0 comp rx=0 tx=0).stop 2024-04-26T20:56:54.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.829+0000 7f6705200640 1 -- 172.21.15.138:0/33141082 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f670006f880 msgr2=0x7f670015c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:54.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.829+0000 7f6705200640 1 --2- 172.21.15.138:0/33141082 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f670006f880 0x7f670015c3b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f66e800c3c0 tx=0x7f66e800c880 comp rx=0 tx=0).stop 2024-04-26T20:56:54.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.829+0000 7f6705200640 1 -- 172.21.15.138:0/33141082 shutdown_connections 2024-04-26T20:56:54.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.829+0000 7f6705200640 1 --2- 172.21.15.138:0/33141082 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f66dc068380 0x7f66dc06a840 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:54.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.829+0000 7f6705200640 1 --2- 172.21.15.138:0/33141082 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f670015bdc0 0x7f670015da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:54.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.829+0000 7f6705200640 1 --2- 172.21.15.138:0/33141082 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6700073d70 0x7f67000b6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:54.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.829+0000 7f6705200640 1 --2- 172.21.15.138:0/33141082 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f670006f880 0x7f670015c3b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:54.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.829+0000 7f6705200640 1 -- 172.21.15.138:0/33141082 >> 172.21.15.138:0/33141082 conn(0x7f67000d0bb0 msgr2=0x7f6700165ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:54.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.829+0000 7f6705200640 1 -- 172.21.15.138:0/33141082 shutdown_connections 2024-04-26T20:56:54.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.829+0000 7f6705200640 1 -- 172.21.15.138:0/33141082 wait complete. 2024-04-26T20:56:54.854 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T20:56:54.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.985+0000 7f52d2e00640 1 Processor -- start 2024-04-26T20:56:54.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.985+0000 7f52d2e00640 1 -- start start 2024-04-26T20:56:54.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.985+0000 7f52d2e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f52cc0cbe00 0x7f52cc06de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:54.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.985+0000 7f52d2e00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f52cc15cf80 0x7f52cc0ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:54.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.985+0000 7f52d2e00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52cc0727f0 con 0x7f52cc0cc1e0 2024-04-26T20:56:54.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.985+0000 7f52d2e00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f52cc074220 con 0x7f52cc0cbe00 2024-04-26T20:56:54.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.985+0000 7f52d2e00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f52cc073680 con 0x7f52cc15cf80 2024-04-26T20:56:54.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.985+0000 7f52c3e00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f52cc0cc1e0 0x7f52cc073b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:43630/0 (socket says 172.21.15.138:43630) 2024-04-26T20:56:54.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.985+0000 7f52c3e00640 1 -- 172.21.15.138:0/839735383 learned_addr learned my addr 172.21.15.138:0/839735383 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:56:54.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.985+0000 7f52d0e00640 1 --2- 172.21.15.138:0/839735383 >> v2:172.21.15.143:3300/0 conn(0x7f52cc15cf80 0x7f52cc0ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:54.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.985+0000 7f52cbe00640 1 --2- 172.21.15.138:0/839735383 >> v2:172.21.15.138:3300/0 conn(0x7f52cc0cbe00 0x7f52cc06de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:54.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.989+0000 7f52cb400640 1 -- 172.21.15.138:0/839735383 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3388583888 0 0) 0x7f52b4001120 con 0x7f52cc0cc1e0 2024-04-26T20:56:54.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.989+0000 7f52cb400640 1 -- 172.21.15.138:0/839735383 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52b0003530 con 0x7f52cc0cc1e0 2024-04-26T20:56:54.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.989+0000 7f52cbe00640 1 -- 172.21.15.138:0/839735383 >> v2:172.21.15.143:3300/0 conn(0x7f52cc15cf80 msgr2=0x7f52cc0ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:54.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.989+0000 7f52cbe00640 1 --2- 172.21.15.138:0/839735383 >> v2:172.21.15.143:3300/0 conn(0x7f52cc15cf80 0x7f52cc0ce6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:54.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.989+0000 7f52cbe00640 1 -- 172.21.15.138:0/839735383 >> v1:172.21.15.138:6789/0 conn(0x7f52cc0cc1e0 legacy=0x7f52cc073b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:54.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.989+0000 7f52cbe00640 1 -- 172.21.15.138:0/839735383 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52cc072a70 con 0x7f52cc0cbe00 2024-04-26T20:56:54.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.989+0000 7f52d0e00640 1 --2- 172.21.15.138:0/839735383 >> v2:172.21.15.143:3300/0 conn(0x7f52cc15cf80 0x7f52cc0ce6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:56:54.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.989+0000 7f52cbe00640 1 --2- 172.21.15.138:0/839735383 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52cc0cbe00 0x7f52cc06de70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f52cc0762d0 tx=0x7f52bc01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ad8e11ebde65a57 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:54.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.989+0000 7f52cb400640 1 -- 172.21.15.138:0/839735383 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52bc0b0070 con 0x7f52cc0cbe00 2024-04-26T20:56:54.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.989+0000 7f52cb400640 1 -- 172.21.15.138:0/839735383 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52bc0ab600 con 0x7f52cc0cbe00 2024-04-26T20:56:54.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.989+0000 7f52cb400640 1 -- 172.21.15.138:0/839735383 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52bc0ab9d0 con 0x7f52cc0cbe00 2024-04-26T20:56:54.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.989+0000 7f52d2e00640 1 -- 172.21.15.138:0/839735383 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52cc0cbe00 msgr2=0x7f52cc06de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:54.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.989+0000 7f52d2e00640 1 --2- 172.21.15.138:0/839735383 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52cc0cbe00 0x7f52cc06de70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f52cc0762d0 tx=0x7f52bc01c480 comp rx=0 tx=0).stop 2024-04-26T20:56:54.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.993+0000 7f52d2e00640 1 -- 172.21.15.138:0/839735383 shutdown_connections 2024-04-26T20:56:54.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.993+0000 7f52d2e00640 1 --2- 172.21.15.138:0/839735383 >> v2:172.21.15.143:3300/0 conn(0x7f52cc15cf80 0x7f52cc0ce6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:54.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.993+0000 7f52d2e00640 1 --2- 172.21.15.138:0/839735383 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52cc0cbe00 0x7f52cc06de70 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:54.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.993+0000 7f52d2e00640 1 -- 172.21.15.138:0/839735383 >> 172.21.15.138:0/839735383 conn(0x7f52cc0d0b20 msgr2=0x7f52cc0d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:54.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.993+0000 7f52d2e00640 1 -- 172.21.15.138:0/839735383 shutdown_connections 2024-04-26T20:56:54.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.993+0000 7f52d2e00640 1 -- 172.21.15.138:0/839735383 wait complete. 2024-04-26T20:56:54.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.993+0000 7f52d2e00640 1 Processor -- start 2024-04-26T20:56:54.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.993+0000 7f52d2e00640 1 -- start start 2024-04-26T20:56:54.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.993+0000 7f52d2e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f52cc0cbe00 0x7f52cc0c9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:54.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.993+0000 7f52d2e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52cc0cc1e0 0x7f52cc1524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:54.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.993+0000 7f52d2e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52cc15cf80 0x7f52cc0c7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:54.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.993+0000 7f52d2e00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f52cc06e3b0 con 0x7f52cc15cf80 2024-04-26T20:56:55.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.993+0000 7f52d2e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f52cc0cf040 con 0x7f52cc0cc1e0 2024-04-26T20:56:55.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.993+0000 7f52d2e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f52cc06e530 con 0x7f52cc0cbe00 2024-04-26T20:56:55.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.993+0000 7f52d0e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52cc15cf80 0x7f52cc0c7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:55.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.993+0000 7f52d0e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52cc15cf80 0x7f52cc0c7bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:56676/0 (socket says 172.21.15.138:56676) 2024-04-26T20:56:55.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.993+0000 7f52d0e00640 1 -- 172.21.15.138:0/2258745028 learned_addr learned my addr 172.21.15.138:0/2258745028 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:55.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.993+0000 7f52cbe00640 1 --2- 172.21.15.138:0/2258745028 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f52cc0cbe00 0x7f52cc0c9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:55.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.993+0000 7f52c3e00640 1 --2- 172.21.15.138:0/2258745028 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52cc0cc1e0 0x7f52cc1524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:55.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.993+0000 7f52d0e00640 1 -- 172.21.15.138:0/2258745028 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f52cc0cbe00 msgr2=0x7f52cc0c9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:55.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.993+0000 7f52d0e00640 1 --2- 172.21.15.138:0/2258745028 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f52cc0cbe00 0x7f52cc0c9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:55.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.993+0000 7f52d0e00640 1 -- 172.21.15.138:0/2258745028 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52cc0cc1e0 msgr2=0x7f52cc1524a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:55.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.993+0000 7f52d0e00640 1 --2- 172.21.15.138:0/2258745028 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52cc0cc1e0 0x7f52cc1524a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:55.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.993+0000 7f52d0e00640 1 -- 172.21.15.138:0/2258745028 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52cc0c8560 con 0x7f52cc15cf80 2024-04-26T20:56:55.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.993+0000 7f52c3e00640 1 --2- 172.21.15.138:0/2258745028 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52cc0cc1e0 0x7f52cc1524a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:56:55.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.993+0000 7f52d0e00640 1 --2- 172.21.15.138:0/2258745028 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52cc15cf80 0x7f52cc0c7bf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f52c400efc0 tx=0x7f52c400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:55.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.993+0000 7f52c8c00640 1 -- 172.21.15.138:0/2258745028 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c4018020 con 0x7f52cc15cf80 2024-04-26T20:56:55.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.997+0000 7f52c8c00640 1 -- 172.21.15.138:0/2258745028 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52c4014480 con 0x7f52cc15cf80 2024-04-26T20:56:55.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.997+0000 7f52d2e00640 1 -- 172.21.15.138:0/2258745028 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52cc0c8840 con 0x7f52cc15cf80 2024-04-26T20:56:55.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.997+0000 7f52c8c00640 1 -- 172.21.15.138:0/2258745028 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c4014870 con 0x7f52cc15cf80 2024-04-26T20:56:55.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.997+0000 7f52d2e00640 1 -- 172.21.15.138:0/2258745028 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52cc0c8e00 con 0x7f52cc15cf80 2024-04-26T20:56:55.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.997+0000 7f52d2e00640 1 -- 172.21.15.138:0/2258745028 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52cc069510 con 0x7f52cc15cf80 2024-04-26T20:56:55.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.997+0000 7f52c8c00640 1 -- 172.21.15.138:0/2258745028 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f52c401b020 con 0x7f52cc15cf80 2024-04-26T20:56:55.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.997+0000 7f52c8c00640 1 --2- 172.21.15.138:0/2258745028 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f52a8068380 0x7f52a806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:55.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.997+0000 7f52c8c00640 1 -- 172.21.15.138:0/2258745028 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f52c4087ac0 con 0x7f52cc15cf80 2024-04-26T20:56:55.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.997+0000 7f52cbe00640 1 --2- 172.21.15.138:0/2258745028 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f52a8068380 0x7f52a806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:55.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:54.997+0000 7f52cbe00640 1 --2- 172.21.15.138:0/2258745028 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f52a8068380 0x7f52a806a840 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f52bc0ad000 tx=0x7f52bc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:55.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.001+0000 7f52c8c00640 1 -- 172.21.15.138:0/2258745028 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f52c4022020 con 0x7f52cc15cf80 2024-04-26T20:56:55.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.173+0000 7f52d2e00640 1 -- 172.21.15.138:0/2258745028 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f52cc0c70b0 con 0x7f52cc15cf80 2024-04-26T20:56:55.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.177+0000 7f52c8c00640 1 -- 172.21.15.138:0/2258745028 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f52c4010040 con 0x7f52cc15cf80 2024-04-26T20:56:55.180 INFO:teuthology.orchestra.run.smithi138.stderr:listed 0 entries 2024-04-26T20:56:55.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.177+0000 7f52d2e00640 1 -- 172.21.15.138:0/2258745028 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f52a8068380 msgr2=0x7f52a806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:55.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.177+0000 7f52d2e00640 1 --2- 172.21.15.138:0/2258745028 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f52a8068380 0x7f52a806a840 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f52bc0ad000 tx=0x7f52bc008040 comp rx=0 tx=0).stop 2024-04-26T20:56:55.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.177+0000 7f52d2e00640 1 -- 172.21.15.138:0/2258745028 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52cc15cf80 msgr2=0x7f52cc0c7bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:55.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.177+0000 7f52d2e00640 1 --2- 172.21.15.138:0/2258745028 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52cc15cf80 0x7f52cc0c7bf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f52c400efc0 tx=0x7f52c400c490 comp rx=0 tx=0).stop 2024-04-26T20:56:55.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.177+0000 7f52d2e00640 1 -- 172.21.15.138:0/2258745028 shutdown_connections 2024-04-26T20:56:55.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.177+0000 7f52d2e00640 1 --2- 172.21.15.138:0/2258745028 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f52a8068380 0x7f52a806a840 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:55.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.177+0000 7f52d2e00640 1 --2- 172.21.15.138:0/2258745028 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52cc15cf80 0x7f52cc0c7bf0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:55.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.177+0000 7f52d2e00640 1 --2- 172.21.15.138:0/2258745028 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52cc0cc1e0 0x7f52cc1524a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:55.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.177+0000 7f52d2e00640 1 --2- 172.21.15.138:0/2258745028 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f52cc0cbe00 0x7f52cc0c9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:55.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.177+0000 7f52d2e00640 1 -- 172.21.15.138:0/2258745028 >> 172.21.15.138:0/2258745028 conn(0x7f52cc0d0b20 msgr2=0x7f52cc153770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:55.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.177+0000 7f52d2e00640 1 -- 172.21.15.138:0/2258745028 shutdown_connections 2024-04-26T20:56:55.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.177+0000 7f52d2e00640 1 -- 172.21.15.138:0/2258745028 wait complete. 2024-04-26T20:56:55.200 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi138.front.sepia.ceph.com... 2024-04-26T20:56:55.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:56:55.201 DEBUG:teuthology.orchestra.run.smithi138:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-04-26T20:56:55.390 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi138.stderr:ceph-fuse[33876]: fuse finished with error 0 and tester_r 0 2024-04-26T20:56:55.394 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T20:56:55.466 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi138.front.sepia.ceph.com 2024-04-26T20:56:55.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:56:55.466 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-04-26T20:56:55.483 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:56:55.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.661+0000 7f96c2e00640 1 Processor -- start 2024-04-26T20:56:55.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.661+0000 7f96c2e00640 1 -- start start 2024-04-26T20:56:55.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.661+0000 7f96c2e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f96bc0cbe00 0x7f96bc06de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:55.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.661+0000 7f96c2e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f96bc15cf80 0x7f96bc0ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:55.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.661+0000 7f96c2e00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96bc0727f0 con 0x7f96bc0cc1e0 2024-04-26T20:56:55.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.661+0000 7f96c2e00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f96bc074220 con 0x7f96bc0cbe00 2024-04-26T20:56:55.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.661+0000 7f96c2e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f96bc073680 con 0x7f96bc15cf80 2024-04-26T20:56:55.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.661+0000 7f96bbe00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f96bc0cbe00 0x7f96bc06de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:55.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.661+0000 7f96bbe00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f96bc0cbe00 0x7f96bc06de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:56680/0 (socket says 172.21.15.138:56680) 2024-04-26T20:56:55.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.661+0000 7f96bbe00640 1 -- 172.21.15.138:0/4285756630 learned_addr learned my addr 172.21.15.138:0/4285756630 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:55.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.665+0000 7f96c0e00640 1 --2- 172.21.15.138:0/4285756630 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f96bc15cf80 0x7f96bc0ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:55.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.665+0000 7f96bbe00640 1 -- 172.21.15.138:0/4285756630 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f96bc15cf80 msgr2=0x7f96bc0ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:55.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.665+0000 7f96bbe00640 1 --2- 172.21.15.138:0/4285756630 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f96bc15cf80 0x7f96bc0ce6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:55.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.665+0000 7f96bbe00640 1 -- 172.21.15.138:0/4285756630 >> v1:172.21.15.138:6789/0 conn(0x7f96bc0cc1e0 legacy=0x7f96bc073b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:55.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.665+0000 7f96bbe00640 1 -- 172.21.15.138:0/4285756630 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96bc072a70 con 0x7f96bc0cbe00 2024-04-26T20:56:55.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.665+0000 7f96baa00640 1 -- 172.21.15.138:0/4285756630 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2973886343 0 0) 0x7f96a4001120 con 0x7f96bc0cc1e0 2024-04-26T20:56:55.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.665+0000 7f96bbe00640 1 --2- 172.21.15.138:0/4285756630 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96bc0cbe00 0x7f96bc06de70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f96ac009870 tx=0x7f96ac01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ae3995b5d45dcd6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:55.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.665+0000 7f96baa00640 1 -- 172.21.15.138:0/4285756630 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96ac0ab650 con 0x7f96bc0cbe00 2024-04-26T20:56:55.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.665+0000 7f96baa00640 1 -- 172.21.15.138:0/4285756630 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96ac0b0070 con 0x7f96bc0cbe00 2024-04-26T20:56:55.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.665+0000 7f96baa00640 1 -- 172.21.15.138:0/4285756630 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96ac0aba10 con 0x7f96bc0cbe00 2024-04-26T20:56:55.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.669+0000 7f96c2e00640 1 -- 172.21.15.138:0/4285756630 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96bc0cbe00 msgr2=0x7f96bc06de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:55.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.669+0000 7f96c2e00640 1 --2- 172.21.15.138:0/4285756630 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96bc0cbe00 0x7f96bc06de70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f96ac009870 tx=0x7f96ac01c560 comp rx=0 tx=0).stop 2024-04-26T20:56:55.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.669+0000 7f96c2e00640 1 -- 172.21.15.138:0/4285756630 shutdown_connections 2024-04-26T20:56:55.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.669+0000 7f96c2e00640 1 --2- 172.21.15.138:0/4285756630 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f96bc15cf80 0x7f96bc0ce6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:55.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.669+0000 7f96c2e00640 1 --2- 172.21.15.138:0/4285756630 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96bc0cbe00 0x7f96bc06de70 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:55.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.669+0000 7f96c2e00640 1 -- 172.21.15.138:0/4285756630 >> 172.21.15.138:0/4285756630 conn(0x7f96bc0d0b20 msgr2=0x7f96bc0d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:55.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.669+0000 7f96c2e00640 1 -- 172.21.15.138:0/4285756630 shutdown_connections 2024-04-26T20:56:55.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.669+0000 7f96c2e00640 1 -- 172.21.15.138:0/4285756630 wait complete. 2024-04-26T20:56:55.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.669+0000 7f96c2e00640 1 Processor -- start 2024-04-26T20:56:55.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.669+0000 7f96c2e00640 1 -- start start 2024-04-26T20:56:55.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.669+0000 7f96c2e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f96bc0cbe00 0x7f96bc0cb360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:55.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.669+0000 7f96c2e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96bc0cc1e0 0x7f96bc14fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:55.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.669+0000 7f96c2e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f96bc15cf80 0x7f96bc06e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:55.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.669+0000 7f96c2e00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f96bc06e3b0 con 0x7f96bc0cc1e0 2024-04-26T20:56:55.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.669+0000 7f96c2e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f96bc0cf040 con 0x7f96bc15cf80 2024-04-26T20:56:55.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.669+0000 7f96c2e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f96bc06e530 con 0x7f96bc0cbe00 2024-04-26T20:56:55.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.669+0000 7f96bb400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96bc0cc1e0 0x7f96bc14fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:55.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.669+0000 7f96bb400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96bc0cc1e0 0x7f96bc14fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:56688/0 (socket says 172.21.15.138:56688) 2024-04-26T20:56:55.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.669+0000 7f96bb400640 1 -- 172.21.15.138:0/463442500 learned_addr learned my addr 172.21.15.138:0/463442500 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:55.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.669+0000 7f96bbe00640 1 --2- 172.21.15.138:0/463442500 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f96bc0cbe00 0x7f96bc0cb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:55.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.669+0000 7f96c0e00640 1 --2- 172.21.15.138:0/463442500 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f96bc15cf80 0x7f96bc06e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:55.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.669+0000 7f96bb400640 1 -- 172.21.15.138:0/463442500 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f96bc0cbe00 msgr2=0x7f96bc0cb360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:55.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.669+0000 7f96bb400640 1 --2- 172.21.15.138:0/463442500 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f96bc0cbe00 0x7f96bc0cb360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:55.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.669+0000 7f96bb400640 1 -- 172.21.15.138:0/463442500 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f96bc15cf80 msgr2=0x7f96bc06e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:55.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.669+0000 7f96bb400640 1 --2- 172.21.15.138:0/463442500 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f96bc15cf80 0x7f96bc06e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:55.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.669+0000 7f96bb400640 1 -- 172.21.15.138:0/463442500 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96bc0cb8a0 con 0x7f96bc0cc1e0 2024-04-26T20:56:55.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.669+0000 7f96bb400640 1 --2- 172.21.15.138:0/463442500 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96bc0cc1e0 0x7f96bc14fbd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f96a400c750 tx=0x7f96a400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:55.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.669+0000 7f96b3e00640 1 -- 172.21.15.138:0/463442500 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a4017070 con 0x7f96bc0cc1e0 2024-04-26T20:56:55.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.669+0000 7f96b3e00640 1 -- 172.21.15.138:0/463442500 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96a4005290 con 0x7f96bc0cc1e0 2024-04-26T20:56:55.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.673+0000 7f96c2e00640 1 -- 172.21.15.138:0/463442500 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96bc151470 con 0x7f96bc0cc1e0 2024-04-26T20:56:55.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.673+0000 7f96b3e00640 1 -- 172.21.15.138:0/463442500 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a400a640 con 0x7f96bc0cc1e0 2024-04-26T20:56:55.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.673+0000 7f96c2e00640 1 -- 172.21.15.138:0/463442500 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96bc151a30 con 0x7f96bc0cc1e0 2024-04-26T20:56:55.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.673+0000 7f96c2e00640 1 -- 172.21.15.138:0/463442500 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96bc069510 con 0x7f96bc0cc1e0 2024-04-26T20:56:55.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.673+0000 7f96b3e00640 1 -- 172.21.15.138:0/463442500 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f96a401a070 con 0x7f96bc0cc1e0 2024-04-26T20:56:55.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.673+0000 7f96b3e00640 1 --2- 172.21.15.138:0/463442500 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9698068380 0x7f969806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:55.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.673+0000 7f96b3e00640 1 -- 172.21.15.138:0/463442500 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f96a4086140 con 0x7f96bc0cc1e0 2024-04-26T20:56:55.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.673+0000 7f96bbe00640 1 --2- 172.21.15.138:0/463442500 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9698068380 0x7f969806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:55.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.677+0000 7f96bbe00640 1 --2- 172.21.15.138:0/463442500 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9698068380 0x7f969806a840 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f96ac0af000 tx=0x7f96ac0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:55.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.677+0000 7f96b3e00640 1 -- 172.21.15.138:0/463442500 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f96bc0727f0 con 0x7f96bc0cc1e0 2024-04-26T20:56:55.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.837+0000 7f96c2e00640 1 -- 172.21.15.138:0/463442500 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f96bc0b3a80 con 0x7f96bc0cc1e0 2024-04-26T20:56:55.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.837+0000 7f96b3e00640 1 -- 172.21.15.138:0/463442500 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18578 (secure 0 0 0) 0x7f96a4056320 con 0x7f96bc0cc1e0 2024-04-26T20:56:55.843 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:56:55.843 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":27,"fsid":"c22b4730-12cc-4558-8535-b965384398c0","created":"2024-04-26T20:56:14.182475+0000","modified":"2024-04-26T20:56:44.633968+0000","last_up_change":"2024-04-26T20:56:26.013243+0000","last_in_change":"2024-04-26T20:56:16.714055+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:56:27.265834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:56:37.394398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:56:38.544369+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:56:42.240243+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3f9a2e34-3199-466f-a6cf-57927318121e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6801","nonce":3534772245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6803","nonce":3534772245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6807","nonce":3534772245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6805","nonce":3534772245}]},"public_addr":"172.21.15.138:6801/3534772245","cluster_addr":"172.21.15.138:6803/3534772245","heartbeat_back_addr":"172.21.15.138:6807/3534772245","heartbeat_front_addr":"172.21.15.138:6805/3534772245","state":["exists","up"]},{"osd":1,"uuid":"e881fcf6-3248-4696-a2ef-95d206d77712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6817","nonce":1427635773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6819","nonce":1427635773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6823","nonce":1427635773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6821","nonce":1427635773}]},"public_addr":"172.21.15.138:6817/1427635773","cluster_addr":"172.21.15.138:6819/1427635773","heartbeat_back_addr":"172.21.15.138:6823/1427635773","heartbeat_front_addr":"172.21.15.138:6821/1427635773","state":["exists","up"]},{"osd":2,"uuid":"f7d1db33-7672-4699-ae47-9f1e0a8e4222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6809","nonce":4273721573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6811","nonce":4273721573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6815","nonce":4273721573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6813","nonce":4273721573}]},"public_addr":"172.21.15.138:6809/4273721573","cluster_addr":"172.21.15.138:6811/4273721573","heartbeat_back_addr":"172.21.15.138:6815/4273721573","heartbeat_front_addr":"172.21.15.138:6813/4273721573","state":["exists","up"]},{"osd":3,"uuid":"2f4e0a9a-b8f6-4468-844a-a4501cd85054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6825","nonce":3098242154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6827","nonce":3098242154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6831","nonce":3098242154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6829","nonce":3098242154}]},"public_addr":"172.21.15.138:6825/3098242154","cluster_addr":"172.21.15.138:6827/3098242154","heartbeat_back_addr":"172.21.15.138:6831/3098242154","heartbeat_front_addr":"172.21.15.138:6829/3098242154","state":["exists","up"]},{"osd":4,"uuid":"c85df99b-3624-410e-866b-86830af2cfe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6801","nonce":2942056312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6803","nonce":2942056312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6807","nonce":2942056312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6805","nonce":2942056312}]},"public_addr":"172.21.15.143:6801/2942056312","cluster_addr":"172.21.15.143:6803/2942056312","heartbeat_back_addr":"172.21.15.143:6807/2942056312","heartbeat_front_addr":"172.21.15.143:6805/2942056312","state":["exists","up"]},{"osd":5,"uuid":"9af1efb5-c416-4808-b5ef-de0679ab9705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6809","nonce":1910222887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6811","nonce":1910222887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6815","nonce":1910222887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6813","nonce":1910222887}]},"public_addr":"172.21.15.143:6809/1910222887","cluster_addr":"172.21.15.143:6811/1910222887","heartbeat_back_addr":"172.21.15.143:6815/1910222887","heartbeat_front_addr":"172.21.15.143:6813/1910222887","state":["exists","up"]},{"osd":6,"uuid":"d7138615-8838-45ff-9072-2fd0683362f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6817","nonce":1082239825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6819","nonce":1082239825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6823","nonce":1082239825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6821","nonce":1082239825}]},"public_addr":"172.21.15.143:6817/1082239825","cluster_addr":"172.21.15.143:6819/1082239825","heartbeat_back_addr":"172.21.15.143:6823/1082239825","heartbeat_front_addr":"172.21.15.143:6821/1082239825","state":["exists","up"]},{"osd":7,"uuid":"0c27172b-35c4-49ec-ba0b-0137b8ff0010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6825","nonce":3295508495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6827","nonce":3295508495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6831","nonce":3295508495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6829","nonce":3295508495}]},"public_addr":"172.21.15.143:6825/3295508495","cluster_addr":"172.21.15.143:6827/3295508495","heartbeat_back_addr":"172.21.15.143:6831/3295508495","heartbeat_front_addr":"172.21.15.143:6829/3295508495","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.326627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.396119+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.433915+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.414179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.216947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.329272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.503073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.436382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:56:55.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.841+0000 7f96c2e00640 1 -- 172.21.15.138:0/463442500 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9698068380 msgr2=0x7f969806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:55.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.841+0000 7f96c2e00640 1 --2- 172.21.15.138:0/463442500 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9698068380 0x7f969806a840 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f96ac0af000 tx=0x7f96ac0a7000 comp rx=0 tx=0).stop 2024-04-26T20:56:55.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.841+0000 7f96c2e00640 1 -- 172.21.15.138:0/463442500 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96bc0cc1e0 msgr2=0x7f96bc14fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:55.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.841+0000 7f96c2e00640 1 --2- 172.21.15.138:0/463442500 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96bc0cc1e0 0x7f96bc14fbd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f96a400c750 tx=0x7f96a400cc10 comp rx=0 tx=0).stop 2024-04-26T20:56:55.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.841+0000 7f96c2e00640 1 -- 172.21.15.138:0/463442500 shutdown_connections 2024-04-26T20:56:55.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.841+0000 7f96c2e00640 1 --2- 172.21.15.138:0/463442500 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9698068380 0x7f969806a840 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:55.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.841+0000 7f96c2e00640 1 --2- 172.21.15.138:0/463442500 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f96bc15cf80 0x7f96bc06e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:55.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.841+0000 7f96c2e00640 1 --2- 172.21.15.138:0/463442500 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96bc0cc1e0 0x7f96bc14fbd0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:55.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.841+0000 7f96c2e00640 1 --2- 172.21.15.138:0/463442500 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f96bc0cbe00 0x7f96bc0cb360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:55.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.841+0000 7f96c2e00640 1 -- 172.21.15.138:0/463442500 >> 172.21.15.138:0/463442500 conn(0x7f96bc0d0b20 msgr2=0x7f96bc0cf250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:55.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.841+0000 7f96c2e00640 1 -- 172.21.15.138:0/463442500 shutdown_connections 2024-04-26T20:56:55.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.841+0000 7f96c2e00640 1 -- 172.21.15.138:0/463442500 wait complete. 2024-04-26T20:56:55.864 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:56:55.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.993+0000 7f4a88200640 1 Processor -- start 2024-04-26T20:56:55.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.993+0000 7f4a88200640 1 -- start start 2024-04-26T20:56:56.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.997+0000 7f4a88200640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4a800cc1e0 0x7f4a800ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:56.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.997+0000 7f4a88200640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a800727f0 con 0x7f4a800cbe00 2024-04-26T20:56:56.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.997+0000 7f4a88200640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a80072a70 con 0x7f4a8015cf80 2024-04-26T20:56:56.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.997+0000 7f4a88200640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f4a80074220 con 0x7f4a800cc1e0 2024-04-26T20:56:56.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.997+0000 7f4a86200640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4a800cc1e0 0x7f4a800ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:56.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.997+0000 7f4a85800640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f4a800cbe00 0x7f4a8006de70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:43654/0 (socket says 172.21.15.138:43654) 2024-04-26T20:56:56.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.997+0000 7f4a85800640 1 -- 172.21.15.138:0/3705216598 learned_addr learned my addr 172.21.15.138:0/3705216598 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:56:56.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.997+0000 7f4a86200640 1 -- 172.21.15.138:0/3705216598 >> v1:172.21.15.143:6789/0 conn(0x7f4a8015cf80 legacy=0x7f4a80073b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:56.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.997+0000 7f4a86200640 1 -- 172.21.15.138:0/3705216598 >> v1:172.21.15.138:6789/0 conn(0x7f4a800cbe00 legacy=0x7f4a8006de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:56.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.997+0000 7f4a86200640 1 -- 172.21.15.138:0/3705216598 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a80072d50 con 0x7f4a800cc1e0 2024-04-26T20:56:56.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:55.997+0000 7f4a7fe00640 1 -- 172.21.15.138:0/3705216598 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1310803933 0 0) 0x7f4a74001120 con 0x7f4a800cbe00 2024-04-26T20:56:56.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.001+0000 7f4a86200640 1 --2- 172.21.15.138:0/3705216598 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4a800cc1e0 0x7f4a800ce6f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4a78009d90 tx=0x7f4a7801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d30bb7e3807ffb3b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:56.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.001+0000 7f4a7fe00640 1 -- 172.21.15.138:0/3705216598 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a780b2070 con 0x7f4a800cc1e0 2024-04-26T20:56:56.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.001+0000 7f4a7fe00640 1 -- 172.21.15.138:0/3705216598 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a780a57f0 con 0x7f4a800cc1e0 2024-04-26T20:56:56.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.001+0000 7f4a7fe00640 1 -- 172.21.15.138:0/3705216598 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a780a5bc0 con 0x7f4a800cc1e0 2024-04-26T20:56:56.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.001+0000 7f4a88200640 1 -- 172.21.15.138:0/3705216598 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4a800cc1e0 msgr2=0x7f4a800ce6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:56.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.001+0000 7f4a88200640 1 --2- 172.21.15.138:0/3705216598 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4a800cc1e0 0x7f4a800ce6f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4a78009d90 tx=0x7f4a7801c930 comp rx=0 tx=0).stop 2024-04-26T20:56:56.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.001+0000 7f4a88200640 1 -- 172.21.15.138:0/3705216598 shutdown_connections 2024-04-26T20:56:56.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.001+0000 7f4a88200640 1 --2- 172.21.15.138:0/3705216598 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4a800cc1e0 0x7f4a800ce6f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:56.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.001+0000 7f4a88200640 1 -- 172.21.15.138:0/3705216598 >> 172.21.15.138:0/3705216598 conn(0x7f4a800d0b20 msgr2=0x7f4a800d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:56.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.001+0000 7f4a88200640 1 -- 172.21.15.138:0/3705216598 shutdown_connections 2024-04-26T20:56:56.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.001+0000 7f4a88200640 1 -- 172.21.15.138:0/3705216598 wait complete. 2024-04-26T20:56:56.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.001+0000 7f4a88200640 1 Processor -- start 2024-04-26T20:56:56.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.001+0000 7f4a88200640 1 -- start start 2024-04-26T20:56:56.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.005+0000 7f4a88200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4a800cbe00 0x7f4a800ca300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:56.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.005+0000 7f4a88200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4a800cc1e0 0x7f4a800c7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:56.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.005+0000 7f4a88200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a8015cf80 0x7f4a800c6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:56.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.005+0000 7f4a88200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f4a800d0780 con 0x7f4a800cc1e0 2024-04-26T20:56:56.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.005+0000 7f4a88200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f4a80073680 con 0x7f4a8015cf80 2024-04-26T20:56:56.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.005+0000 7f4a88200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f4a800d0900 con 0x7f4a800cbe00 2024-04-26T20:56:56.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.005+0000 7f4a84e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4a800cc1e0 0x7f4a800c7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:56.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.005+0000 7f4a84e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4a800cc1e0 0x7f4a800c7bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:56708/0 (socket says 172.21.15.138:56708) 2024-04-26T20:56:56.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.005+0000 7f4a84e00640 1 -- 172.21.15.138:0/3152714298 learned_addr learned my addr 172.21.15.138:0/3152714298 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:56.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.005+0000 7f4a85800640 1 --2- 172.21.15.138:0/3152714298 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4a800cbe00 0x7f4a800ca300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:56.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.005+0000 7f4a86200640 1 --2- 172.21.15.138:0/3152714298 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a8015cf80 0x7f4a800c6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:56.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.005+0000 7f4a84e00640 1 -- 172.21.15.138:0/3152714298 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4a800cbe00 msgr2=0x7f4a800ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:56.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.005+0000 7f4a84e00640 1 --2- 172.21.15.138:0/3152714298 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4a800cbe00 0x7f4a800ca300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:56.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.005+0000 7f4a84e00640 1 -- 172.21.15.138:0/3152714298 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a8015cf80 msgr2=0x7f4a800c6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:56.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.005+0000 7f4a84e00640 1 --2- 172.21.15.138:0/3152714298 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a8015cf80 0x7f4a800c6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:56.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.005+0000 7f4a84e00640 1 -- 172.21.15.138:0/3152714298 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a800c8440 con 0x7f4a800cc1e0 2024-04-26T20:56:56.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.005+0000 7f4a85800640 1 --2- 172.21.15.138:0/3152714298 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4a800cbe00 0x7f4a800ca300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:56:56.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.005+0000 7f4a84e00640 1 --2- 172.21.15.138:0/3152714298 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4a800cc1e0 0x7f4a800c7bf0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c00c450 tx=0x7f4a6c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:56.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.005+0000 7f4a7d600640 1 -- 172.21.15.138:0/3152714298 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c012830 con 0x7f4a800cc1e0 2024-04-26T20:56:56.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.005+0000 7f4a7d600640 1 -- 172.21.15.138:0/3152714298 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a6c017070 con 0x7f4a800cc1e0 2024-04-26T20:56:56.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.005+0000 7f4a7d600640 1 -- 172.21.15.138:0/3152714298 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c012c30 con 0x7f4a800cc1e0 2024-04-26T20:56:56.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.005+0000 7f4a88200640 1 -- 172.21.15.138:0/3152714298 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a800c8720 con 0x7f4a800cc1e0 2024-04-26T20:56:56.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.005+0000 7f4a88200640 1 -- 172.21.15.138:0/3152714298 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a800c8ce0 con 0x7f4a800cc1e0 2024-04-26T20:56:56.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.005+0000 7f4a88200640 1 -- 172.21.15.138:0/3152714298 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a80069510 con 0x7f4a800cc1e0 2024-04-26T20:56:56.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.005+0000 7f4a7d600640 1 -- 172.21.15.138:0/3152714298 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4a6c01c460 con 0x7f4a800cc1e0 2024-04-26T20:56:56.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.009+0000 7f4a7d600640 1 --2- 172.21.15.138:0/3152714298 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4a60068380 0x7f4a6006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:56.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.009+0000 7f4a7d600640 1 -- 172.21.15.138:0/3152714298 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f4a6c086a60 con 0x7f4a800cc1e0 2024-04-26T20:56:56.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.009+0000 7f4a85800640 1 --2- 172.21.15.138:0/3152714298 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4a60068380 0x7f4a6006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:56.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.009+0000 7f4a85800640 1 --2- 172.21.15.138:0/3152714298 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4a60068380 0x7f4a6006a840 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4a74000f70 tx=0x7f4a74007cd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:56.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.013+0000 7f4a7d600640 1 -- 172.21.15.138:0/3152714298 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4a6c056cd0 con 0x7f4a800cc1e0 2024-04-26T20:56:56.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.165+0000 7f4a88200640 1 -- 172.21.15.138:0/3152714298 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4a80158960 con 0x7f4a800cc1e0 2024-04-26T20:56:56.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.169+0000 7f4a7d600640 1 -- 172.21.15.138:0/3152714298 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18578 (secure 0 0 0) 0x7f4a6c0565d0 con 0x7f4a800cc1e0 2024-04-26T20:56:56.172 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:56:56.173 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":27,"fsid":"c22b4730-12cc-4558-8535-b965384398c0","created":"2024-04-26T20:56:14.182475+0000","modified":"2024-04-26T20:56:44.633968+0000","last_up_change":"2024-04-26T20:56:26.013243+0000","last_in_change":"2024-04-26T20:56:16.714055+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:56:27.265834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:56:37.394398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:56:38.544369+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:56:42.240243+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3f9a2e34-3199-466f-a6cf-57927318121e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6801","nonce":3534772245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6803","nonce":3534772245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6807","nonce":3534772245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6805","nonce":3534772245}]},"public_addr":"172.21.15.138:6801/3534772245","cluster_addr":"172.21.15.138:6803/3534772245","heartbeat_back_addr":"172.21.15.138:6807/3534772245","heartbeat_front_addr":"172.21.15.138:6805/3534772245","state":["exists","up"]},{"osd":1,"uuid":"e881fcf6-3248-4696-a2ef-95d206d77712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6817","nonce":1427635773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6819","nonce":1427635773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6823","nonce":1427635773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6821","nonce":1427635773}]},"public_addr":"172.21.15.138:6817/1427635773","cluster_addr":"172.21.15.138:6819/1427635773","heartbeat_back_addr":"172.21.15.138:6823/1427635773","heartbeat_front_addr":"172.21.15.138:6821/1427635773","state":["exists","up"]},{"osd":2,"uuid":"f7d1db33-7672-4699-ae47-9f1e0a8e4222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6809","nonce":4273721573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6811","nonce":4273721573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6815","nonce":4273721573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6813","nonce":4273721573}]},"public_addr":"172.21.15.138:6809/4273721573","cluster_addr":"172.21.15.138:6811/4273721573","heartbeat_back_addr":"172.21.15.138:6815/4273721573","heartbeat_front_addr":"172.21.15.138:6813/4273721573","state":["exists","up"]},{"osd":3,"uuid":"2f4e0a9a-b8f6-4468-844a-a4501cd85054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6825","nonce":3098242154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6827","nonce":3098242154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6831","nonce":3098242154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6829","nonce":3098242154}]},"public_addr":"172.21.15.138:6825/3098242154","cluster_addr":"172.21.15.138:6827/3098242154","heartbeat_back_addr":"172.21.15.138:6831/3098242154","heartbeat_front_addr":"172.21.15.138:6829/3098242154","state":["exists","up"]},{"osd":4,"uuid":"c85df99b-3624-410e-866b-86830af2cfe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6801","nonce":2942056312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6803","nonce":2942056312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6807","nonce":2942056312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6805","nonce":2942056312}]},"public_addr":"172.21.15.143:6801/2942056312","cluster_addr":"172.21.15.143:6803/2942056312","heartbeat_back_addr":"172.21.15.143:6807/2942056312","heartbeat_front_addr":"172.21.15.143:6805/2942056312","state":["exists","up"]},{"osd":5,"uuid":"9af1efb5-c416-4808-b5ef-de0679ab9705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6809","nonce":1910222887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6811","nonce":1910222887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6815","nonce":1910222887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6813","nonce":1910222887}]},"public_addr":"172.21.15.143:6809/1910222887","cluster_addr":"172.21.15.143:6811/1910222887","heartbeat_back_addr":"172.21.15.143:6815/1910222887","heartbeat_front_addr":"172.21.15.143:6813/1910222887","state":["exists","up"]},{"osd":6,"uuid":"d7138615-8838-45ff-9072-2fd0683362f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6817","nonce":1082239825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6819","nonce":1082239825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6823","nonce":1082239825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6821","nonce":1082239825}]},"public_addr":"172.21.15.143:6817/1082239825","cluster_addr":"172.21.15.143:6819/1082239825","heartbeat_back_addr":"172.21.15.143:6823/1082239825","heartbeat_front_addr":"172.21.15.143:6821/1082239825","state":["exists","up"]},{"osd":7,"uuid":"0c27172b-35c4-49ec-ba0b-0137b8ff0010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6825","nonce":3295508495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6827","nonce":3295508495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6831","nonce":3295508495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6829","nonce":3295508495}]},"public_addr":"172.21.15.143:6825/3295508495","cluster_addr":"172.21.15.143:6827/3295508495","heartbeat_back_addr":"172.21.15.143:6831/3295508495","heartbeat_front_addr":"172.21.15.143:6829/3295508495","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.326627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.396119+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.433915+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.414179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.216947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.329272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.503073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.436382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:56:56.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.169+0000 7f4a88200640 1 -- 172.21.15.138:0/3152714298 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4a60068380 msgr2=0x7f4a6006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:56.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.169+0000 7f4a88200640 1 --2- 172.21.15.138:0/3152714298 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4a60068380 0x7f4a6006a840 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4a74000f70 tx=0x7f4a74007cd0 comp rx=0 tx=0).stop 2024-04-26T20:56:56.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.169+0000 7f4a88200640 1 -- 172.21.15.138:0/3152714298 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4a800cc1e0 msgr2=0x7f4a800c7bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:56.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.169+0000 7f4a88200640 1 --2- 172.21.15.138:0/3152714298 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4a800cc1e0 0x7f4a800c7bf0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c00c450 tx=0x7f4a6c00c910 comp rx=0 tx=0).stop 2024-04-26T20:56:56.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.169+0000 7f4a88200640 1 -- 172.21.15.138:0/3152714298 shutdown_connections 2024-04-26T20:56:56.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.169+0000 7f4a88200640 1 --2- 172.21.15.138:0/3152714298 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4a60068380 0x7f4a6006a840 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:56.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.169+0000 7f4a88200640 1 --2- 172.21.15.138:0/3152714298 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a8015cf80 0x7f4a800c6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:56.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.169+0000 7f4a88200640 1 --2- 172.21.15.138:0/3152714298 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4a800cc1e0 0x7f4a800c7bf0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:56.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.169+0000 7f4a88200640 1 --2- 172.21.15.138:0/3152714298 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4a800cbe00 0x7f4a800ca300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:56.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.169+0000 7f4a88200640 1 -- 172.21.15.138:0/3152714298 >> 172.21.15.138:0/3152714298 conn(0x7f4a800d0b20 msgr2=0x7f4a800afab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:56.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.169+0000 7f4a88200640 1 -- 172.21.15.138:0/3152714298 shutdown_connections 2024-04-26T20:56:56.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.169+0000 7f4a88200640 1 -- 172.21.15.138:0/3152714298 wait complete. 2024-04-26T20:56:56.195 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-26T20:56:56.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.333+0000 7fc6e9e00640 1 Processor -- start 2024-04-26T20:56:56.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.333+0000 7fc6e9e00640 1 -- start start 2024-04-26T20:56:56.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.337+0000 7fc6e9e00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc6e4073ad0 0x7fc6e4073eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:56.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.337+0000 7fc6e9e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc6e40d0490 0x7fc6e40d0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:56.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.337+0000 7fc6e9e00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6e40743f0 con 0x7fc6e4162ca0 2024-04-26T20:56:56.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.337+0000 7fc6e9e00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fc6e40cf3f0 con 0x7fc6e4073ad0 2024-04-26T20:56:56.341 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.337+0000 7fc6e9e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fc6e40cf6d0 con 0x7fc6e40d0490 2024-04-26T20:56:56.341 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.337+0000 7fc6e3400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc6e40d0490 0x7fc6e40d0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:56.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.337+0000 7fc6e2a00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc6e4073ad0 0x7fc6e4073eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:56.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.337+0000 7fc6da000640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fc6e4162ca0 0x7fc6e40ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.138:36002/0 (socket says 172.21.15.138:36002) 2024-04-26T20:56:56.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.337+0000 7fc6e3400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc6e40d0490 0x7fc6e40d0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.138:47564/0 (socket says 172.21.15.138:47564) 2024-04-26T20:56:56.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.337+0000 7fc6e2a00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc6e4073ad0 0x7fc6e4073eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.138:36574/0 (socket says 172.21.15.138:36574) 2024-04-26T20:56:56.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.337+0000 7fc6da000640 1 -- 172.21.15.138:0/3715624789 learned_addr learned my addr 172.21.15.138:0/3715624789 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:56:56.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.337+0000 7fc6e2a00640 1 -- 172.21.15.138:0/3715624789 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc6e40d0490 msgr2=0x7fc6e40d0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:56.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.337+0000 7fc6e2a00640 1 --2- 172.21.15.138:0/3715624789 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc6e40d0490 0x7fc6e40d0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:56.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.337+0000 7fc6e2a00640 1 -- 172.21.15.138:0/3715624789 >> v1:172.21.15.143:6789/0 conn(0x7fc6e4162ca0 legacy=0x7fc6e40ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:56.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.337+0000 7fc6e2a00640 1 -- 172.21.15.138:0/3715624789 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6e40cf9b0 con 0x7fc6e4073ad0 2024-04-26T20:56:56.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.337+0000 7fc6e3400640 1 --2- 172.21.15.138:0/3715624789 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc6e40d0490 0x7fc6e40d0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:56:56.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.341+0000 7fc6e2a00640 1 --2- 172.21.15.138:0/3715624789 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc6e4073ad0 0x7fc6e4073eb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4009d90 tx=0x7fc6d401c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d3e03b14fd29e1c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:56.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.341+0000 7fc6e2000640 1 -- 172.21.15.138:0/3715624789 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d40b2070 con 0x7fc6e4073ad0 2024-04-26T20:56:56.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.341+0000 7fc6e2000640 1 -- 172.21.15.138:0/3715624789 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6d40a5920 con 0x7fc6e4073ad0 2024-04-26T20:56:56.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.341+0000 7fc6e2000640 1 -- 172.21.15.138:0/3715624789 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d40a5cf0 con 0x7fc6e4073ad0 2024-04-26T20:56:56.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.341+0000 7fc6e9e00640 1 -- 172.21.15.138:0/3715624789 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc6e4073ad0 msgr2=0x7fc6e4073eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:56.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.341+0000 7fc6e9e00640 1 --2- 172.21.15.138:0/3715624789 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc6e4073ad0 0x7fc6e4073eb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4009d90 tx=0x7fc6d401c970 comp rx=0 tx=0).stop 2024-04-26T20:56:56.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.341+0000 7fc6e9e00640 1 -- 172.21.15.138:0/3715624789 shutdown_connections 2024-04-26T20:56:56.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.341+0000 7fc6e9e00640 1 --2- 172.21.15.138:0/3715624789 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc6e40d0490 0x7fc6e40d0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:56.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.341+0000 7fc6e9e00640 1 --2- 172.21.15.138:0/3715624789 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc6e4073ad0 0x7fc6e4073eb0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:56.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.341+0000 7fc6e9e00640 1 -- 172.21.15.138:0/3715624789 >> 172.21.15.138:0/3715624789 conn(0x7fc6e40d0fd0 msgr2=0x7fc6e40d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:56.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.341+0000 7fc6e9e00640 1 -- 172.21.15.138:0/3715624789 shutdown_connections 2024-04-26T20:56:56.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.341+0000 7fc6e9e00640 1 -- 172.21.15.138:0/3715624789 wait complete. 2024-04-26T20:56:56.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.341+0000 7fc6e9e00640 1 Processor -- start 2024-04-26T20:56:56.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.341+0000 7fc6e9e00640 1 -- start start 2024-04-26T20:56:56.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.345+0000 7fc6e9e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc6e4073ad0 0x7fc6e4158070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:56.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.345+0000 7fc6e9e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc6e40d0490 0x7fc6e40a0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:56.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.345+0000 7fc6e9e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc6e4162ca0 0x7fc6e409df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:56.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.345+0000 7fc6e9e00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc6e416c1c0 con 0x7fc6e40d0490 2024-04-26T20:56:56.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.345+0000 7fc6e9e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fc6e416c040 con 0x7fc6e4073ad0 2024-04-26T20:56:56.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.345+0000 7fc6e9e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fc6e416c340 con 0x7fc6e4162ca0 2024-04-26T20:56:56.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.345+0000 7fc6da000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc6e40d0490 0x7fc6e40a0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:56.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.345+0000 7fc6da000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc6e40d0490 0x7fc6e40a0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:56716/0 (socket says 172.21.15.138:56716) 2024-04-26T20:56:56.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.345+0000 7fc6da000640 1 -- 172.21.15.138:0/3251542622 learned_addr learned my addr 172.21.15.138:0/3251542622 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:56.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.345+0000 7fc6e2a00640 1 --2- 172.21.15.138:0/3251542622 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc6e4073ad0 0x7fc6e4158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:56.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.345+0000 7fc6e3400640 1 --2- 172.21.15.138:0/3251542622 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc6e4162ca0 0x7fc6e409df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:56.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.345+0000 7fc6da000640 1 -- 172.21.15.138:0/3251542622 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc6e4162ca0 msgr2=0x7fc6e409df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:56.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.345+0000 7fc6da000640 1 --2- 172.21.15.138:0/3251542622 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc6e4162ca0 0x7fc6e409df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:56.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.345+0000 7fc6da000640 1 -- 172.21.15.138:0/3251542622 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc6e4073ad0 msgr2=0x7fc6e4158070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:56.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.345+0000 7fc6da000640 1 --2- 172.21.15.138:0/3251542622 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc6e4073ad0 0x7fc6e4158070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:56.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.345+0000 7fc6da000640 1 -- 172.21.15.138:0/3251542622 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6e40c5330 con 0x7fc6e40d0490 2024-04-26T20:56:56.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.345+0000 7fc6da000640 1 --2- 172.21.15.138:0/3251542622 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc6e40d0490 0x7fc6e40a0f00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc00c370 tx=0x7fc6cc00c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:56.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.345+0000 7fc6dbe00640 1 -- 172.21.15.138:0/3251542622 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc017070 con 0x7fc6e40d0490 2024-04-26T20:56:56.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.345+0000 7fc6dbe00640 1 -- 172.21.15.138:0/3251542622 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6cc005cf0 con 0x7fc6e40d0490 2024-04-26T20:56:56.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.345+0000 7fc6e9e00640 1 -- 172.21.15.138:0/3251542622 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6e40a1750 con 0x7fc6e40d0490 2024-04-26T20:56:56.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.345+0000 7fc6dbe00640 1 -- 172.21.15.138:0/3251542622 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc0072f0 con 0x7fc6e40d0490 2024-04-26T20:56:56.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.345+0000 7fc6e9e00640 1 -- 172.21.15.138:0/3251542622 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6e40a1d10 con 0x7fc6e40d0490 2024-04-26T20:56:56.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.345+0000 7fc6e9e00640 1 -- 172.21.15.138:0/3251542622 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6e4069430 con 0x7fc6e40d0490 2024-04-26T20:56:56.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.349+0000 7fc6dbe00640 1 -- 172.21.15.138:0/3251542622 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc6cc01a070 con 0x7fc6e40d0490 2024-04-26T20:56:56.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.349+0000 7fc6dbe00640 1 --2- 172.21.15.138:0/3251542622 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc6c0068380 0x7fc6c006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:56.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.349+0000 7fc6dbe00640 1 -- 172.21.15.138:0/3251542622 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fc6cc085ef0 con 0x7fc6e40d0490 2024-04-26T20:56:56.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.349+0000 7fc6e2a00640 1 --2- 172.21.15.138:0/3251542622 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc6c0068380 0x7fc6c006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:56.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.349+0000 7fc6e2a00640 1 --2- 172.21.15.138:0/3251542622 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc6c0068380 0x7fc6c006a840 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc6d40af000 tx=0x7fc6d40a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:56.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.353+0000 7fc6dbe00640 1 -- 172.21.15.138:0/3251542622 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc6cc055b10 con 0x7fc6e40d0490 2024-04-26T20:56:56.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:56.541+0000 7fc6e9e00640 1 -- 172.21.15.138:0/3251542622 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fc6e40d1d30 con 0x7fc6e40d0490 2024-04-26T20:56:57.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.313+0000 7fc6dbe00640 1 -- 172.21.15.138:0/3251542622 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) ==== 118+0+0 (secure 0 0 0) 0x7fc6cc059e10 con 0x7fc6e40d0490 2024-04-26T20:56:57.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.317+0000 7fc6e9e00640 1 -- 172.21.15.138:0/3251542622 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc6c0068380 msgr2=0x7fc6c006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:57.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.317+0000 7fc6e9e00640 1 --2- 172.21.15.138:0/3251542622 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc6c0068380 0x7fc6c006a840 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc6d40af000 tx=0x7fc6d40a7070 comp rx=0 tx=0).stop 2024-04-26T20:56:57.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.317+0000 7fc6e9e00640 1 -- 172.21.15.138:0/3251542622 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc6e40d0490 msgr2=0x7fc6e40a0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:57.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.317+0000 7fc6e9e00640 1 --2- 172.21.15.138:0/3251542622 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc6e40d0490 0x7fc6e40a0f00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc00c370 tx=0x7fc6cc00c770 comp rx=0 tx=0).stop 2024-04-26T20:56:57.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.317+0000 7fc6e9e00640 1 -- 172.21.15.138:0/3251542622 shutdown_connections 2024-04-26T20:56:57.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.317+0000 7fc6e9e00640 1 --2- 172.21.15.138:0/3251542622 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc6c0068380 0x7fc6c006a840 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:57.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.317+0000 7fc6e9e00640 1 --2- 172.21.15.138:0/3251542622 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc6e4162ca0 0x7fc6e409df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:57.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.317+0000 7fc6e9e00640 1 --2- 172.21.15.138:0/3251542622 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc6e40d0490 0x7fc6e40a0f00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:57.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.317+0000 7fc6e9e00640 1 --2- 172.21.15.138:0/3251542622 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc6e4073ad0 0x7fc6e4158070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:57.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.317+0000 7fc6e9e00640 1 -- 172.21.15.138:0/3251542622 >> 172.21.15.138:0/3251542622 conn(0x7fc6e40d0fd0 msgr2=0x7fc6e40cd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:57.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.317+0000 7fc6e9e00640 1 -- 172.21.15.138:0/3251542622 shutdown_connections 2024-04-26T20:56:57.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.317+0000 7fc6e9e00640 1 -- 172.21.15.138:0/3251542622 wait complete. 2024-04-26T20:56:57.342 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-04-26T20:56:57.343 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-26T20:56:57.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.481+0000 7fb0e6e00640 1 Processor -- start 2024-04-26T20:56:57.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.481+0000 7fb0e6e00640 1 -- start start 2024-04-26T20:56:57.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.481+0000 7fb0e6e00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb0e015f3b0 0x7fb0e00d1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:57.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.481+0000 7fb0e6e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb0e00cfcf0 0x7fb0e00ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:57.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.481+0000 7fb0e6e00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0e00d2250 con 0x7fb0e00d3880 2024-04-26T20:56:57.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.481+0000 7fb0e6e00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fb0e00cdb80 con 0x7fb0e00cfcf0 2024-04-26T20:56:57.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.481+0000 7fb0e6e00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fb0e00cd530 con 0x7fb0e015f3b0 2024-04-26T20:56:57.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.481+0000 7fb0e4e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb0e00cfcf0 0x7fb0e00ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:57.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.481+0000 7fb0e4e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb0e00cfcf0 0x7fb0e00ce010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:56732/0 (socket says 172.21.15.138:56732) 2024-04-26T20:56:57.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.481+0000 7fb0e4e00640 1 -- 172.21.15.138:0/2261366677 learned_addr learned my addr 172.21.15.138:0/2261366677 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:57.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.481+0000 7fb0dfe00640 1 --2- 172.21.15.138:0/2261366677 >> v2:172.21.15.143:3300/0 conn(0x7fb0e015f3b0 0x7fb0e00d1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:57.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.481+0000 7fb0e4e00640 1 -- 172.21.15.138:0/2261366677 >> v2:172.21.15.143:3300/0 conn(0x7fb0e015f3b0 msgr2=0x7fb0e00d1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:57.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.481+0000 7fb0e4e00640 1 --2- 172.21.15.138:0/2261366677 >> v2:172.21.15.143:3300/0 conn(0x7fb0e015f3b0 0x7fb0e00d1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:57.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.481+0000 7fb0e4e00640 1 -- 172.21.15.138:0/2261366677 >> v1:172.21.15.143:6789/0 conn(0x7fb0e00d3880 legacy=0x7fb0e00cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:57.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.481+0000 7fb0e4e00640 1 -- 172.21.15.138:0/2261366677 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0e00cd810 con 0x7fb0e00cfcf0 2024-04-26T20:56:57.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.485+0000 7fb0e4e00640 1 --2- 172.21.15.138:0/2261366677 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0e00cfcf0 0x7fb0e00ce010 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb0e006ff20 tx=0x7fb0d801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15f6b29396b37e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:57.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.485+0000 7fb0df400640 1 -- 172.21.15.138:0/2261366677 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d80a9400 con 0x7fb0e00cfcf0 2024-04-26T20:56:57.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.485+0000 7fb0df400640 1 -- 172.21.15.138:0/2261366677 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0d80a95a0 con 0x7fb0e00cfcf0 2024-04-26T20:56:57.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.485+0000 7fb0df400640 1 -- 172.21.15.138:0/2261366677 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d80a9970 con 0x7fb0e00cfcf0 2024-04-26T20:56:57.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.485+0000 7fb0e6e00640 1 -- 172.21.15.138:0/2261366677 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0e00cfcf0 msgr2=0x7fb0e00ce010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:57.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.485+0000 7fb0e6e00640 1 --2- 172.21.15.138:0/2261366677 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0e00cfcf0 0x7fb0e00ce010 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb0e006ff20 tx=0x7fb0d801c520 comp rx=0 tx=0).stop 2024-04-26T20:56:57.491 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.485+0000 7fb0e6e00640 1 -- 172.21.15.138:0/2261366677 shutdown_connections 2024-04-26T20:56:57.491 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.485+0000 7fb0e6e00640 1 --2- 172.21.15.138:0/2261366677 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0e00cfcf0 0x7fb0e00ce010 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:57.491 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.485+0000 7fb0e6e00640 1 --2- 172.21.15.138:0/2261366677 >> v2:172.21.15.143:3300/0 conn(0x7fb0e015f3b0 0x7fb0e00d1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:57.491 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.485+0000 7fb0e6e00640 1 -- 172.21.15.138:0/2261366677 >> 172.21.15.138:0/2261366677 conn(0x7fb0e00d2d60 msgr2=0x7fb0e00d3170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:57.491 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.485+0000 7fb0e6e00640 1 -- 172.21.15.138:0/2261366677 shutdown_connections 2024-04-26T20:56:57.491 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.485+0000 7fb0e6e00640 1 -- 172.21.15.138:0/2261366677 wait complete. 2024-04-26T20:56:57.492 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.489+0000 7fb0e6e00640 1 Processor -- start 2024-04-26T20:56:57.492 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.489+0000 7fb0e6e00640 1 -- start start 2024-04-26T20:56:57.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.489+0000 7fb0e6e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0e00cfcf0 0x7fb0e0159860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:57.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.489+0000 7fb0e6e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0e00d3880 0x7fb0e00cba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:57.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.489+0000 7fb0e6e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0e015f3b0 0x7fb0e01566a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:57.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.489+0000 7fb0e6e00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fb0e00cf0f0 con 0x7fb0e00cfcf0 2024-04-26T20:56:57.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.489+0000 7fb0e6e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fb0e00cef70 con 0x7fb0e015f3b0 2024-04-26T20:56:57.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.489+0000 7fb0e6e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb0e016bf70 con 0x7fb0e00d3880 2024-04-26T20:56:57.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.489+0000 7fb0dfe00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0e00cfcf0 0x7fb0e0159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:57.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.489+0000 7fb0dfe00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0e00cfcf0 0x7fb0e0159860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:56736/0 (socket says 172.21.15.138:56736) 2024-04-26T20:56:57.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.489+0000 7fb0dfe00640 1 -- 172.21.15.138:0/2714501135 learned_addr learned my addr 172.21.15.138:0/2714501135 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:57.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.489+0000 7fb0d7400640 1 --2- 172.21.15.138:0/2714501135 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0e00d3880 0x7fb0e00cba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:57.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.489+0000 7fb0e4e00640 1 --2- 172.21.15.138:0/2714501135 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0e015f3b0 0x7fb0e01566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:57.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.489+0000 7fb0dfe00640 1 -- 172.21.15.138:0/2714501135 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0e00d3880 msgr2=0x7fb0e00cba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:57.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.489+0000 7fb0dfe00640 1 --2- 172.21.15.138:0/2714501135 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0e00d3880 0x7fb0e00cba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:57.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.489+0000 7fb0dfe00640 1 -- 172.21.15.138:0/2714501135 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0e015f3b0 msgr2=0x7fb0e01566a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:57.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.489+0000 7fb0dfe00640 1 --2- 172.21.15.138:0/2714501135 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0e015f3b0 0x7fb0e01566a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:57.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.489+0000 7fb0dfe00640 1 -- 172.21.15.138:0/2714501135 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0e0159da0 con 0x7fb0e00cfcf0 2024-04-26T20:56:57.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.489+0000 7fb0e4e00640 1 --2- 172.21.15.138:0/2714501135 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0e015f3b0 0x7fb0e01566a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:56:57.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.489+0000 7fb0dfe00640 1 --2- 172.21.15.138:0/2714501135 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0e00cfcf0 0x7fb0e0159860 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb0d000efc0 tx=0x7fb0d000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:57.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.489+0000 7fb0dcc00640 1 -- 172.21.15.138:0/2714501135 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d0018020 con 0x7fb0e00cfcf0 2024-04-26T20:56:57.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.489+0000 7fb0dcc00640 1 -- 172.21.15.138:0/2714501135 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0d0014480 con 0x7fb0e00cfcf0 2024-04-26T20:56:57.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.489+0000 7fb0dcc00640 1 -- 172.21.15.138:0/2714501135 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d0014850 con 0x7fb0e00cfcf0 2024-04-26T20:56:57.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.489+0000 7fb0e6e00640 1 -- 172.21.15.138:0/2714501135 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0e015a040 con 0x7fb0e00cfcf0 2024-04-26T20:56:57.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.489+0000 7fb0e6e00640 1 -- 172.21.15.138:0/2714501135 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0e015a8e0 con 0x7fb0e00cfcf0 2024-04-26T20:56:57.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.489+0000 7fb0e6e00640 1 -- 172.21.15.138:0/2714501135 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0e015a430 con 0x7fb0e00cfcf0 2024-04-26T20:56:57.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.493+0000 7fb0dcc00640 1 -- 172.21.15.138:0/2714501135 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb0d001b020 con 0x7fb0e00cfcf0 2024-04-26T20:56:57.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.493+0000 7fb0dcc00640 1 --2- 172.21.15.138:0/2714501135 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb0bc068380 0x7fb0bc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:57.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.493+0000 7fb0dcc00640 1 -- 172.21.15.138:0/2714501135 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fb0d0087b20 con 0x7fb0e00cfcf0 2024-04-26T20:56:57.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.493+0000 7fb0d7400640 1 --2- 172.21.15.138:0/2714501135 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb0bc068380 0x7fb0bc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:57.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.493+0000 7fb0d7400640 1 --2- 172.21.15.138:0/2714501135 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb0bc068380 0x7fb0bc06a840 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb0e0158bb0 tx=0x7fb0c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:57.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.497+0000 7fb0dcc00640 1 -- 172.21.15.138:0/2714501135 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb0d0022030 con 0x7fb0e00cfcf0 2024-04-26T20:56:57.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:57.685+0000 7fb0e6e00640 1 -- 172.21.15.138:0/2714501135 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fb0e0069430 con 0x7fb0e00cfcf0 2024-04-26T20:56:58.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.321+0000 7fb0dcc00640 1 -- 172.21.15.138:0/2714501135 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) ==== 122+0+0 (secure 0 0 0) 0x7fb0d0010040 con 0x7fb0e00cfcf0 2024-04-26T20:56:58.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.321+0000 7fb0e6e00640 1 -- 172.21.15.138:0/2714501135 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb0bc068380 msgr2=0x7fb0bc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:58.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.321+0000 7fb0e6e00640 1 --2- 172.21.15.138:0/2714501135 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb0bc068380 0x7fb0bc06a840 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb0e0158bb0 tx=0x7fb0c8009040 comp rx=0 tx=0).stop 2024-04-26T20:56:58.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.321+0000 7fb0e6e00640 1 -- 172.21.15.138:0/2714501135 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0e00cfcf0 msgr2=0x7fb0e0159860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:58.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.321+0000 7fb0e6e00640 1 --2- 172.21.15.138:0/2714501135 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0e00cfcf0 0x7fb0e0159860 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb0d000efc0 tx=0x7fb0d000c490 comp rx=0 tx=0).stop 2024-04-26T20:56:58.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.321+0000 7fb0e6e00640 1 -- 172.21.15.138:0/2714501135 shutdown_connections 2024-04-26T20:56:58.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.321+0000 7fb0e6e00640 1 --2- 172.21.15.138:0/2714501135 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb0bc068380 0x7fb0bc06a840 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:58.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.321+0000 7fb0e6e00640 1 --2- 172.21.15.138:0/2714501135 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0e015f3b0 0x7fb0e01566a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:58.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.321+0000 7fb0e6e00640 1 --2- 172.21.15.138:0/2714501135 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0e00d3880 0x7fb0e00cba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:58.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.321+0000 7fb0e6e00640 1 --2- 172.21.15.138:0/2714501135 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0e00cfcf0 0x7fb0e0159860 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:58.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.321+0000 7fb0e6e00640 1 -- 172.21.15.138:0/2714501135 >> 172.21.15.138:0/2714501135 conn(0x7fb0e00d2d60 msgr2=0x7fb0e0071320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:58.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.321+0000 7fb0e6e00640 1 -- 172.21.15.138:0/2714501135 shutdown_connections 2024-04-26T20:56:58.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.321+0000 7fb0e6e00640 1 -- 172.21.15.138:0/2714501135 wait complete. 2024-04-26T20:56:58.347 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-26T20:56:58.347 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:56:58.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.481+0000 7fe939200640 1 Processor -- start 2024-04-26T20:56:58.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.481+0000 7fe939200640 1 -- start start 2024-04-26T20:56:58.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.481+0000 7fe939200640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe9340cfd10 0x7fe9340cdd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:58.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.481+0000 7fe939200640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe93415f510 0x7fe9340ce2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:58.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.481+0000 7fe939200640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9340d2180 con 0x7fe93415f130 2024-04-26T20:56:58.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.481+0000 7fe939200640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fe9340cd570 con 0x7fe9340cfd10 2024-04-26T20:56:58.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.481+0000 7fe939200640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fe9340cd850 con 0x7fe93415f510 2024-04-26T20:56:58.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.481+0000 7fe929400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe9340cfd10 0x7fe9340cdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:58.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.481+0000 7fe931e00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fe93415f130 0x7fe9340cf600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:43664/0 (socket says 172.21.15.138:43664) 2024-04-26T20:56:58.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.481+0000 7fe929400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe9340cfd10 0x7fe9340cdd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:56748/0 (socket says 172.21.15.138:56748) 2024-04-26T20:56:58.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.481+0000 7fe931e00640 1 -- 172.21.15.138:0/3540843183 learned_addr learned my addr 172.21.15.138:0/3540843183 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:56:58.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.481+0000 7fe932800640 1 --2- 172.21.15.138:0/3540843183 >> v2:172.21.15.143:3300/0 conn(0x7fe93415f510 0x7fe9340ce2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:58.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.481+0000 7fe929400640 1 -- 172.21.15.138:0/3540843183 >> v2:172.21.15.143:3300/0 conn(0x7fe93415f510 msgr2=0x7fe9340ce2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:58.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.481+0000 7fe929400640 1 --2- 172.21.15.138:0/3540843183 >> v2:172.21.15.143:3300/0 conn(0x7fe93415f510 0x7fe9340ce2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:58.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.481+0000 7fe929400640 1 -- 172.21.15.138:0/3540843183 >> v1:172.21.15.138:6789/0 conn(0x7fe93415f130 legacy=0x7fe9340cf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:58.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.481+0000 7fe929400640 1 -- 172.21.15.138:0/3540843183 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe93406e730 con 0x7fe9340cfd10 2024-04-26T20:56:58.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.481+0000 7fe931400640 1 -- 172.21.15.138:0/3540843183 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 691442366 0 0) 0x7fe9340d2180 con 0x7fe93415f130 2024-04-26T20:56:58.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.485+0000 7fe929400640 1 --2- 172.21.15.138:0/3540843183 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9340cfd10 0x7fe9340cdd70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe9340690f0 tx=0x7fe91c01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8934975692a75ac9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:58.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.485+0000 7fe931400640 1 -- 172.21.15.138:0/3540843183 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91c0b5070 con 0x7fe9340cfd10 2024-04-26T20:56:58.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.485+0000 7fe931400640 1 -- 172.21.15.138:0/3540843183 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe91c0a8970 con 0x7fe9340cfd10 2024-04-26T20:56:58.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.485+0000 7fe931400640 1 -- 172.21.15.138:0/3540843183 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91c0a8d40 con 0x7fe9340cfd10 2024-04-26T20:56:58.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.485+0000 7fe939200640 1 -- 172.21.15.138:0/3540843183 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9340cfd10 msgr2=0x7fe9340cdd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:58.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.485+0000 7fe939200640 1 --2- 172.21.15.138:0/3540843183 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9340cfd10 0x7fe9340cdd70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe9340690f0 tx=0x7fe91c01ec70 comp rx=0 tx=0).stop 2024-04-26T20:56:58.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.485+0000 7fe939200640 1 -- 172.21.15.138:0/3540843183 shutdown_connections 2024-04-26T20:56:58.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.485+0000 7fe939200640 1 --2- 172.21.15.138:0/3540843183 >> v2:172.21.15.143:3300/0 conn(0x7fe93415f510 0x7fe9340ce2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:58.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.485+0000 7fe939200640 1 --2- 172.21.15.138:0/3540843183 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9340cfd10 0x7fe9340cdd70 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:58.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.485+0000 7fe939200640 1 -- 172.21.15.138:0/3540843183 >> 172.21.15.138:0/3540843183 conn(0x7fe9340d2d80 msgr2=0x7fe9340d3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:58.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.485+0000 7fe939200640 1 -- 172.21.15.138:0/3540843183 shutdown_connections 2024-04-26T20:56:58.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.485+0000 7fe939200640 1 -- 172.21.15.138:0/3540843183 wait complete. 2024-04-26T20:56:58.491 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.485+0000 7fe939200640 1 Processor -- start 2024-04-26T20:56:58.491 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.489+0000 7fe939200640 1 -- start start 2024-04-26T20:56:58.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.489+0000 7fe939200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9340cfd10 0x7fe934153050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:58.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.489+0000 7fe939200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe93415f130 0x7fe9341f4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:58.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.489+0000 7fe939200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe93415f510 0x7fe9340c88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:58.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.489+0000 7fe939200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe9340d0670 con 0x7fe93415f510 2024-04-26T20:56:58.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.489+0000 7fe939200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fe9340d04f0 con 0x7fe9340cfd10 2024-04-26T20:56:58.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.489+0000 7fe939200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fe9340d3870 con 0x7fe93415f130 2024-04-26T20:56:58.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.489+0000 7fe932800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe93415f510 0x7fe9340c88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:58.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.489+0000 7fe932800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe93415f510 0x7fe9340c88f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:56752/0 (socket says 172.21.15.138:56752) 2024-04-26T20:56:58.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.489+0000 7fe932800640 1 -- 172.21.15.138:0/2384524431 learned_addr learned my addr 172.21.15.138:0/2384524431 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:58.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.489+0000 7fe931e00640 1 --2- 172.21.15.138:0/2384524431 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9340cfd10 0x7fe934153050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:58.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.489+0000 7fe929400640 1 --2- 172.21.15.138:0/2384524431 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe93415f130 0x7fe9341f4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:58.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.489+0000 7fe932800640 1 -- 172.21.15.138:0/2384524431 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe93415f130 msgr2=0x7fe9341f4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:58.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.489+0000 7fe932800640 1 --2- 172.21.15.138:0/2384524431 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe93415f130 0x7fe9341f4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:58.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.489+0000 7fe932800640 1 -- 172.21.15.138:0/2384524431 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9340cfd10 msgr2=0x7fe934153050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:58.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.489+0000 7fe932800640 1 --2- 172.21.15.138:0/2384524431 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9340cfd10 0x7fe934153050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:58.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.489+0000 7fe932800640 1 -- 172.21.15.138:0/2384524431 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe934162be0 con 0x7fe93415f510 2024-04-26T20:56:58.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.489+0000 7fe929400640 1 --2- 172.21.15.138:0/2384524431 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe93415f130 0x7fe9341f4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:56:58.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.489+0000 7fe931e00640 1 --2- 172.21.15.138:0/2384524431 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9340cfd10 0x7fe934153050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:56:58.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.489+0000 7fe932800640 1 --2- 172.21.15.138:0/2384524431 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe93415f510 0x7fe9340c88f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe92c009fd0 tx=0x7fe92c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:58.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.489+0000 7fe92aa00640 1 -- 172.21.15.138:0/2384524431 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe92c014420 con 0x7fe93415f510 2024-04-26T20:56:58.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.489+0000 7fe92aa00640 1 -- 172.21.15.138:0/2384524431 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe92c019070 con 0x7fe93415f510 2024-04-26T20:56:58.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.489+0000 7fe92aa00640 1 -- 172.21.15.138:0/2384524431 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe92c014800 con 0x7fe93415f510 2024-04-26T20:56:58.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.489+0000 7fe939200640 1 -- 172.21.15.138:0/2384524431 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9340c7b30 con 0x7fe93415f510 2024-04-26T20:56:58.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.489+0000 7fe939200640 1 -- 172.21.15.138:0/2384524431 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9340c80f0 con 0x7fe93415f510 2024-04-26T20:56:58.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.489+0000 7fe939200640 1 -- 172.21.15.138:0/2384524431 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe934069510 con 0x7fe93415f510 2024-04-26T20:56:58.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.493+0000 7fe92aa00640 1 -- 172.21.15.138:0/2384524431 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe92c0149a0 con 0x7fe93415f510 2024-04-26T20:56:58.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.493+0000 7fe92aa00640 1 --2- 172.21.15.138:0/2384524431 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe910068380 0x7fe91006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:58.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.493+0000 7fe92aa00640 1 -- 172.21.15.138:0/2384524431 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fe92c0875a0 con 0x7fe93415f510 2024-04-26T20:56:58.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.493+0000 7fe931e00640 1 --2- 172.21.15.138:0/2384524431 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe910068380 0x7fe91006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:58.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.493+0000 7fe931e00640 1 --2- 172.21.15.138:0/2384524431 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe910068380 0x7fe91006a840 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe924000f70 tx=0x7fe924009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:58.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.497+0000 7fe92aa00640 1 -- 172.21.15.138:0/2384524431 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe92c057810 con 0x7fe93415f510 2024-04-26T20:56:58.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.681+0000 7fe939200640 1 -- 172.21.15.138:0/2384524431 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe934153590 con 0x7fe93415f510 2024-04-26T20:56:58.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.685+0000 7fe92aa00640 1 -- 172.21.15.138:0/2384524431 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5189 (secure 0 0 0) 0x7fe92c057110 con 0x7fe93415f510 2024-04-26T20:56:58.688 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:56:58.688 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/3495262740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3495262740},{"type":"v1","addr":"172.21.15.143:6837","nonce":3495262740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4273,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/1806638334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":1806638334},{"type":"v1","addr":"172.21.15.138:6834","nonce":1806638334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/3333703637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":3333703637},{"type":"v1","addr":"172.21.15.138:6835","nonce":3333703637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:56:39.581500+0000","modified":"2024-04-26T20:56:57.692718+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6836/3598364176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":3598364176},{"type":"v1","addr":"172.21.15.143:6836","nonce":3598364176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-04-26T20:56:58.688 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 9 2024-04-26T20:56:58.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.685+0000 7fe939200640 1 -- 172.21.15.138:0/2384524431 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe910068380 msgr2=0x7fe91006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:58.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.685+0000 7fe939200640 1 --2- 172.21.15.138:0/2384524431 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe910068380 0x7fe91006a840 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe924000f70 tx=0x7fe924009040 comp rx=0 tx=0).stop 2024-04-26T20:56:58.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.685+0000 7fe939200640 1 -- 172.21.15.138:0/2384524431 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe93415f510 msgr2=0x7fe9340c88f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:58.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.685+0000 7fe939200640 1 --2- 172.21.15.138:0/2384524431 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe93415f510 0x7fe9340c88f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe92c009fd0 tx=0x7fe92c00e4b0 comp rx=0 tx=0).stop 2024-04-26T20:56:58.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.685+0000 7fe939200640 1 -- 172.21.15.138:0/2384524431 shutdown_connections 2024-04-26T20:56:58.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.685+0000 7fe939200640 1 --2- 172.21.15.138:0/2384524431 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe910068380 0x7fe91006a840 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:58.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.685+0000 7fe939200640 1 --2- 172.21.15.138:0/2384524431 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe93415f510 0x7fe9340c88f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:58.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.685+0000 7fe939200640 1 --2- 172.21.15.138:0/2384524431 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe93415f130 0x7fe9341f4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:58.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.685+0000 7fe939200640 1 --2- 172.21.15.138:0/2384524431 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9340cfd10 0x7fe934153050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:58.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.685+0000 7fe939200640 1 -- 172.21.15.138:0/2384524431 >> 172.21.15.138:0/2384524431 conn(0x7fe9340d2d80 msgr2=0x7fe9340cbe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:58.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.685+0000 7fe939200640 1 -- 172.21.15.138:0/2384524431 shutdown_connections 2024-04-26T20:56:58.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.685+0000 7fe939200640 1 -- 172.21.15.138:0/2384524431 wait complete. 2024-04-26T20:56:58.709 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:56:58.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.841+0000 7efd93200640 1 Processor -- start 2024-04-26T20:56:58.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.841+0000 7efd93200640 1 -- start start 2024-04-26T20:56:58.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.841+0000 7efd93200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd9415ef00 0x7efd9406c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:58.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.841+0000 7efd93200640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7efd940b5fa0 0x7efd9406c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:58.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.841+0000 7efd93200640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd940b6430 con 0x7efd940ce760 2024-04-26T20:56:58.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.841+0000 7efd93200640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7efd940b24b0 con 0x7efd940b5fa0 2024-04-26T20:56:58.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.841+0000 7efd93200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7efd940b70b0 con 0x7efd9415ef00 2024-04-26T20:56:58.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.841+0000 7efd91400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7efd940b5fa0 0x7efd9406c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:58.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.841+0000 7efd91400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7efd940b5fa0 0x7efd9406c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:56768/0 (socket says 172.21.15.138:56768) 2024-04-26T20:56:58.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.841+0000 7efd91400640 1 -- 172.21.15.138:0/1072383524 learned_addr learned my addr 172.21.15.138:0/1072383524 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:58.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.841+0000 7efd92800640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7efd940ce760 0x7efd940b0050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:43668/0 (socket says 172.21.15.138:43668) 2024-04-26T20:56:58.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.841+0000 7efd91e00640 1 --2- 172.21.15.138:0/1072383524 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd9415ef00 0x7efd9406c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:58.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.841+0000 7efd91400640 1 -- 172.21.15.138:0/1072383524 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd9415ef00 msgr2=0x7efd9406c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:58.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.841+0000 7efd91400640 1 --2- 172.21.15.138:0/1072383524 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd9415ef00 0x7efd9406c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:58.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.841+0000 7efd91400640 1 -- 172.21.15.138:0/1072383524 >> v1:172.21.15.138:6789/0 conn(0x7efd940ce760 legacy=0x7efd940b0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:58.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.841+0000 7efd91400640 1 -- 172.21.15.138:0/1072383524 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd940b6710 con 0x7efd940b5fa0 2024-04-26T20:56:58.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.845+0000 7efd91400640 1 --2- 172.21.15.138:0/1072383524 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd940b5fa0 0x7efd9406c840 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7efd800098a0 tx=0x7efd8001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e684165739a0b8bc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:58.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.845+0000 7efd90a00640 1 -- 172.21.15.138:0/1072383524 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd800aa650 con 0x7efd940b5fa0 2024-04-26T20:56:58.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.845+0000 7efd90a00640 1 -- 172.21.15.138:0/1072383524 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd800af070 con 0x7efd940b5fa0 2024-04-26T20:56:58.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.845+0000 7efd90a00640 1 -- 172.21.15.138:0/1072383524 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd800aaa10 con 0x7efd940b5fa0 2024-04-26T20:56:58.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.845+0000 7efd93200640 1 -- 172.21.15.138:0/1072383524 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd940b5fa0 msgr2=0x7efd9406c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:58.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.845+0000 7efd93200640 1 --2- 172.21.15.138:0/1072383524 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd940b5fa0 0x7efd9406c840 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7efd800098a0 tx=0x7efd8001c4f0 comp rx=0 tx=0).stop 2024-04-26T20:56:58.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.845+0000 7efd93200640 1 -- 172.21.15.138:0/1072383524 shutdown_connections 2024-04-26T20:56:58.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.845+0000 7efd93200640 1 --2- 172.21.15.138:0/1072383524 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd940b5fa0 0x7efd9406c840 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:58.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.845+0000 7efd93200640 1 --2- 172.21.15.138:0/1072383524 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd9415ef00 0x7efd9406c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:58.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.845+0000 7efd93200640 1 -- 172.21.15.138:0/1072383524 >> 172.21.15.138:0/1072383524 conn(0x7efd940d12d0 msgr2=0x7efd940d16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:58.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.845+0000 7efd93200640 1 -- 172.21.15.138:0/1072383524 shutdown_connections 2024-04-26T20:56:58.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.845+0000 7efd93200640 1 -- 172.21.15.138:0/1072383524 wait complete. 2024-04-26T20:56:58.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.845+0000 7efd93200640 1 Processor -- start 2024-04-26T20:56:58.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.845+0000 7efd93200640 1 -- start start 2024-04-26T20:56:58.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.849+0000 7efd93200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd940ce760 0x7efd941543a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:58.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.849+0000 7efd93200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd9415ef00 0x7efd9409a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:58.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.849+0000 7efd93200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd94070100 0x7efd9409aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:58.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.849+0000 7efd93200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7efd940b08e0 con 0x7efd94070100 2024-04-26T20:56:58.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.849+0000 7efd93200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7efd940b0760 con 0x7efd9415ef00 2024-04-26T20:56:58.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.849+0000 7efd93200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7efd940b0a60 con 0x7efd940ce760 2024-04-26T20:56:58.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.849+0000 7efd92800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd94070100 0x7efd9409aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:58.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.849+0000 7efd92800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd94070100 0x7efd9409aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:56778/0 (socket says 172.21.15.138:56778) 2024-04-26T20:56:58.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.849+0000 7efd92800640 1 -- 172.21.15.138:0/1888557031 learned_addr learned my addr 172.21.15.138:0/1888557031 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:58.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.849+0000 7efd91e00640 1 --2- 172.21.15.138:0/1888557031 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd940ce760 0x7efd941543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:58.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.849+0000 7efd91400640 1 --2- 172.21.15.138:0/1888557031 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd9415ef00 0x7efd9409a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:58.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.849+0000 7efd92800640 1 -- 172.21.15.138:0/1888557031 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd940ce760 msgr2=0x7efd941543a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:58.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.849+0000 7efd92800640 1 --2- 172.21.15.138:0/1888557031 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd940ce760 0x7efd941543a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:58.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.849+0000 7efd92800640 1 -- 172.21.15.138:0/1888557031 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd9415ef00 msgr2=0x7efd9409a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:58.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.849+0000 7efd92800640 1 --2- 172.21.15.138:0/1888557031 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd9415ef00 0x7efd9409a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:58.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.849+0000 7efd92800640 1 -- 172.21.15.138:0/1888557031 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd9406f450 con 0x7efd94070100 2024-04-26T20:56:58.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.849+0000 7efd92800640 1 --2- 172.21.15.138:0/1888557031 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd94070100 0x7efd9409aac0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7efd8c00c7d0 tx=0x7efd8c00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:58.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.849+0000 7efd8a000640 1 -- 172.21.15.138:0/1888557031 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd8c017070 con 0x7efd94070100 2024-04-26T20:56:58.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.849+0000 7efd8a000640 1 -- 172.21.15.138:0/1888557031 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd8c00a640 con 0x7efd94070100 2024-04-26T20:56:58.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.849+0000 7efd8a000640 1 -- 172.21.15.138:0/1888557031 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd8c00a9f0 con 0x7efd94070100 2024-04-26T20:56:58.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.849+0000 7efd93200640 1 -- 172.21.15.138:0/1888557031 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd941548e0 con 0x7efd94070100 2024-04-26T20:56:58.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.849+0000 7efd93200640 1 -- 172.21.15.138:0/1888557031 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd9406e840 con 0x7efd94070100 2024-04-26T20:56:58.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.849+0000 7efd93200640 1 -- 172.21.15.138:0/1888557031 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd94069b40 con 0x7efd94070100 2024-04-26T20:56:58.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.849+0000 7efd8a000640 1 -- 172.21.15.138:0/1888557031 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efd8c01a070 con 0x7efd94070100 2024-04-26T20:56:58.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.853+0000 7efd8a000640 1 --2- 172.21.15.138:0/1888557031 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7efd74068380 0x7efd7406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:58.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.853+0000 7efd8a000640 1 -- 172.21.15.138:0/1888557031 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7efd8c0862e0 con 0x7efd94070100 2024-04-26T20:56:58.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.853+0000 7efd91e00640 1 --2- 172.21.15.138:0/1888557031 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7efd74068380 0x7efd7406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:58.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.853+0000 7efd91e00640 1 --2- 172.21.15.138:0/1888557031 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7efd74068380 0x7efd7406a840 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7efd840079c0 tx=0x7efd84008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:58.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:58.857+0000 7efd8a000640 1 -- 172.21.15.138:0/1888557031 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7efd8c055f00 con 0x7efd94070100 2024-04-26T20:56:59.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.013+0000 7efd93200640 1 -- 172.21.15.138:0/1888557031 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efd940761c0 con 0x7efd94070100 2024-04-26T20:56:59.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.017+0000 7efd8a000640 1 -- 172.21.15.138:0/1888557031 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18578 (secure 0 0 0) 0x7efd8c07de20 con 0x7efd94070100 2024-04-26T20:56:59.020 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:56:59.020 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":27,"fsid":"c22b4730-12cc-4558-8535-b965384398c0","created":"2024-04-26T20:56:14.182475+0000","modified":"2024-04-26T20:56:44.633968+0000","last_up_change":"2024-04-26T20:56:26.013243+0000","last_in_change":"2024-04-26T20:56:16.714055+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:56:27.265834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:56:37.394398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:56:38.544369+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:56:42.240243+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3f9a2e34-3199-466f-a6cf-57927318121e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6801","nonce":3534772245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6803","nonce":3534772245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6807","nonce":3534772245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6805","nonce":3534772245}]},"public_addr":"172.21.15.138:6801/3534772245","cluster_addr":"172.21.15.138:6803/3534772245","heartbeat_back_addr":"172.21.15.138:6807/3534772245","heartbeat_front_addr":"172.21.15.138:6805/3534772245","state":["exists","up"]},{"osd":1,"uuid":"e881fcf6-3248-4696-a2ef-95d206d77712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6817","nonce":1427635773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6819","nonce":1427635773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6823","nonce":1427635773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6821","nonce":1427635773}]},"public_addr":"172.21.15.138:6817/1427635773","cluster_addr":"172.21.15.138:6819/1427635773","heartbeat_back_addr":"172.21.15.138:6823/1427635773","heartbeat_front_addr":"172.21.15.138:6821/1427635773","state":["exists","up"]},{"osd":2,"uuid":"f7d1db33-7672-4699-ae47-9f1e0a8e4222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6809","nonce":4273721573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6811","nonce":4273721573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6815","nonce":4273721573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6813","nonce":4273721573}]},"public_addr":"172.21.15.138:6809/4273721573","cluster_addr":"172.21.15.138:6811/4273721573","heartbeat_back_addr":"172.21.15.138:6815/4273721573","heartbeat_front_addr":"172.21.15.138:6813/4273721573","state":["exists","up"]},{"osd":3,"uuid":"2f4e0a9a-b8f6-4468-844a-a4501cd85054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6825","nonce":3098242154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6827","nonce":3098242154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6831","nonce":3098242154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6829","nonce":3098242154}]},"public_addr":"172.21.15.138:6825/3098242154","cluster_addr":"172.21.15.138:6827/3098242154","heartbeat_back_addr":"172.21.15.138:6831/3098242154","heartbeat_front_addr":"172.21.15.138:6829/3098242154","state":["exists","up"]},{"osd":4,"uuid":"c85df99b-3624-410e-866b-86830af2cfe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6801","nonce":2942056312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6803","nonce":2942056312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6807","nonce":2942056312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6805","nonce":2942056312}]},"public_addr":"172.21.15.143:6801/2942056312","cluster_addr":"172.21.15.143:6803/2942056312","heartbeat_back_addr":"172.21.15.143:6807/2942056312","heartbeat_front_addr":"172.21.15.143:6805/2942056312","state":["exists","up"]},{"osd":5,"uuid":"9af1efb5-c416-4808-b5ef-de0679ab9705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6809","nonce":1910222887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6811","nonce":1910222887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6815","nonce":1910222887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6813","nonce":1910222887}]},"public_addr":"172.21.15.143:6809/1910222887","cluster_addr":"172.21.15.143:6811/1910222887","heartbeat_back_addr":"172.21.15.143:6815/1910222887","heartbeat_front_addr":"172.21.15.143:6813/1910222887","state":["exists","up"]},{"osd":6,"uuid":"d7138615-8838-45ff-9072-2fd0683362f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6817","nonce":1082239825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6819","nonce":1082239825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6823","nonce":1082239825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6821","nonce":1082239825}]},"public_addr":"172.21.15.143:6817/1082239825","cluster_addr":"172.21.15.143:6819/1082239825","heartbeat_back_addr":"172.21.15.143:6823/1082239825","heartbeat_front_addr":"172.21.15.143:6821/1082239825","state":["exists","up"]},{"osd":7,"uuid":"0c27172b-35c4-49ec-ba0b-0137b8ff0010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6825","nonce":3295508495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6827","nonce":3295508495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6831","nonce":3295508495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6829","nonce":3295508495}]},"public_addr":"172.21.15.143:6825/3295508495","cluster_addr":"172.21.15.143:6827/3295508495","heartbeat_back_addr":"172.21.15.143:6831/3295508495","heartbeat_front_addr":"172.21.15.143:6829/3295508495","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.326627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.396119+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.433915+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.414179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.216947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.329272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.503073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.436382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:56:59.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.017+0000 7efd93200640 1 -- 172.21.15.138:0/1888557031 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7efd74068380 msgr2=0x7efd7406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:59.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.017+0000 7efd93200640 1 --2- 172.21.15.138:0/1888557031 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7efd74068380 0x7efd7406a840 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7efd840079c0 tx=0x7efd84008040 comp rx=0 tx=0).stop 2024-04-26T20:56:59.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.017+0000 7efd93200640 1 -- 172.21.15.138:0/1888557031 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd94070100 msgr2=0x7efd9409aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:59.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.017+0000 7efd93200640 1 --2- 172.21.15.138:0/1888557031 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd94070100 0x7efd9409aac0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7efd8c00c7d0 tx=0x7efd8c00cc90 comp rx=0 tx=0).stop 2024-04-26T20:56:59.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.017+0000 7efd93200640 1 -- 172.21.15.138:0/1888557031 shutdown_connections 2024-04-26T20:56:59.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.017+0000 7efd93200640 1 --2- 172.21.15.138:0/1888557031 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7efd74068380 0x7efd7406a840 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:59.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.017+0000 7efd93200640 1 --2- 172.21.15.138:0/1888557031 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd94070100 0x7efd9409aac0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:59.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.017+0000 7efd93200640 1 --2- 172.21.15.138:0/1888557031 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd9415ef00 0x7efd9409a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:59.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.017+0000 7efd93200640 1 --2- 172.21.15.138:0/1888557031 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd940ce760 0x7efd941543a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:59.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.017+0000 7efd93200640 1 -- 172.21.15.138:0/1888557031 >> 172.21.15.138:0/1888557031 conn(0x7efd940d12d0 msgr2=0x7efd940b3140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:59.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.017+0000 7efd93200640 1 -- 172.21.15.138:0/1888557031 shutdown_connections 2024-04-26T20:56:59.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.017+0000 7efd93200640 1 -- 172.21.15.138:0/1888557031 wait complete. 2024-04-26T20:56:59.041 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-26T20:56:59.041 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T20:56:59.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.173+0000 7fd25be00640 1 Processor -- start 2024-04-26T20:56:59.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.173+0000 7fd25be00640 1 -- start start 2024-04-26T20:56:59.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.173+0000 7fd25be00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd25415ce20 0x7fd254161340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:59.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.173+0000 7fd25be00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd25415e0c0 0x7fd254071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:59.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.173+0000 7fd25be00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd2540cca00 0x7fd2540cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:59.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.173+0000 7fd25be00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fd2540cd360 con 0x7fd25415ce20 2024-04-26T20:56:59.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.173+0000 7fd25be00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fd254073b70 con 0x7fd25415e0c0 2024-04-26T20:56:59.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.173+0000 7fd25be00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fd254073e10 con 0x7fd2540cca00 2024-04-26T20:56:59.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.173+0000 7fd259400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd25415ce20 0x7fd254161340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:59.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.173+0000 7fd259400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd25415ce20 0x7fd254161340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:56780/0 (socket says 172.21.15.138:56780) 2024-04-26T20:56:59.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.173+0000 7fd259400640 1 -- 172.21.15.138:0/1317226695 learned_addr learned my addr 172.21.15.138:0/1317226695 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:59.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.173+0000 7fd258a00640 1 --2- 172.21.15.138:0/1317226695 >> v2:172.21.15.143:3300/0 conn(0x7fd25415e0c0 0x7fd254071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:59.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.173+0000 7fd259e00640 1 --2- 172.21.15.138:0/1317226695 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd2540cca00 0x7fd2540cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:59.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.173+0000 7fd259400640 1 -- 172.21.15.138:0/1317226695 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd2540cca00 msgr2=0x7fd2540cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:59.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.173+0000 7fd259400640 1 --2- 172.21.15.138:0/1317226695 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd2540cca00 0x7fd2540cce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:59.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.173+0000 7fd259400640 1 -- 172.21.15.138:0/1317226695 >> v2:172.21.15.143:3300/0 conn(0x7fd25415e0c0 msgr2=0x7fd254071ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:56:59.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.173+0000 7fd259400640 1 --2- 172.21.15.138:0/1317226695 >> v2:172.21.15.143:3300/0 conn(0x7fd25415e0c0 0x7fd254071ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:59.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.173+0000 7fd259400640 1 -- 172.21.15.138:0/1317226695 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2540740f0 con 0x7fd25415ce20 2024-04-26T20:56:59.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.173+0000 7fd258a00640 1 --2- 172.21.15.138:0/1317226695 >> v2:172.21.15.143:3300/0 conn(0x7fd25415e0c0 0x7fd254071ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:56:59.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.177+0000 7fd259400640 1 --2- 172.21.15.138:0/1317226695 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd25415ce20 0x7fd254161340 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd25406fb00 tx=0x7fd24801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19148750c12debcb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:59.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.177+0000 7fd253e00640 1 -- 172.21.15.138:0/1317226695 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2480aa430 con 0x7fd25415ce20 2024-04-26T20:56:59.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.177+0000 7fd253e00640 1 -- 172.21.15.138:0/1317226695 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2480af070 con 0x7fd25415ce20 2024-04-26T20:56:59.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.177+0000 7fd253e00640 1 -- 172.21.15.138:0/1317226695 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2480aa7f0 con 0x7fd25415ce20 2024-04-26T20:56:59.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.177+0000 7fd25be00640 1 -- 172.21.15.138:0/1317226695 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd25415ce20 msgr2=0x7fd254161340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:59.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.177+0000 7fd25be00640 1 --2- 172.21.15.138:0/1317226695 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd25415ce20 0x7fd254161340 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd25406fb00 tx=0x7fd24801c4f0 comp rx=0 tx=0).stop 2024-04-26T20:56:59.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.177+0000 7fd25be00640 1 -- 172.21.15.138:0/1317226695 shutdown_connections 2024-04-26T20:56:59.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.177+0000 7fd25be00640 1 --2- 172.21.15.138:0/1317226695 >> v2:172.21.15.143:3300/0 conn(0x7fd25415e0c0 0x7fd254071ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:59.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.177+0000 7fd25be00640 1 --2- 172.21.15.138:0/1317226695 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd2540cca00 0x7fd2540cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:59.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.177+0000 7fd25be00640 1 --2- 172.21.15.138:0/1317226695 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd25415ce20 0x7fd254161340 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:59.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.177+0000 7fd25be00640 1 -- 172.21.15.138:0/1317226695 >> 172.21.15.138:0/1317226695 conn(0x7fd2540d0b20 msgr2=0x7fd2540d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:59.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.177+0000 7fd25be00640 1 -- 172.21.15.138:0/1317226695 shutdown_connections 2024-04-26T20:56:59.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.177+0000 7fd25be00640 1 -- 172.21.15.138:0/1317226695 wait complete. 2024-04-26T20:56:59.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.181+0000 7fd25be00640 1 Processor -- start 2024-04-26T20:56:59.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.181+0000 7fd25be00640 1 -- start start 2024-04-26T20:56:59.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.181+0000 7fd25be00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd2540cca00 0x7fd25406ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:59.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.181+0000 7fd25be00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd25415ce20 0x7fd254152c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:59.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.181+0000 7fd25be00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd25415e0c0 0x7fd2540ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:59.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.181+0000 7fd25be00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd2540725a0 con 0x7fd2540cca00 2024-04-26T20:56:59.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.181+0000 7fd25be00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fd254072420 con 0x7fd25415e0c0 2024-04-26T20:56:59.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.181+0000 7fd25be00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fd25415d200 con 0x7fd25415ce20 2024-04-26T20:56:59.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.181+0000 7fd259400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd2540cca00 0x7fd25406ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:59.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.181+0000 7fd259400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd2540cca00 0x7fd25406ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:56796/0 (socket says 172.21.15.138:56796) 2024-04-26T20:56:59.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.181+0000 7fd259400640 1 -- 172.21.15.138:0/1028485474 learned_addr learned my addr 172.21.15.138:0/1028485474 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:59.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.181+0000 7fd258a00640 1 --2- 172.21.15.138:0/1028485474 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd25415ce20 0x7fd254152c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:59.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.181+0000 7fd259e00640 1 --2- 172.21.15.138:0/1028485474 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd25415e0c0 0x7fd2540ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:59.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.181+0000 7fd259400640 1 -- 172.21.15.138:0/1028485474 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd25415ce20 msgr2=0x7fd254152c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:59.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.181+0000 7fd259400640 1 --2- 172.21.15.138:0/1028485474 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd25415ce20 0x7fd254152c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:59.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.181+0000 7fd259400640 1 -- 172.21.15.138:0/1028485474 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd25415e0c0 msgr2=0x7fd2540ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:59.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.181+0000 7fd259400640 1 --2- 172.21.15.138:0/1028485474 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd25415e0c0 0x7fd2540ce6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:59.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.181+0000 7fd259400640 1 -- 172.21.15.138:0/1028485474 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd254166170 con 0x7fd2540cca00 2024-04-26T20:56:59.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.181+0000 7fd259e00640 1 --2- 172.21.15.138:0/1028485474 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd25415e0c0 0x7fd2540ce6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:56:59.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.181+0000 7fd259400640 1 --2- 172.21.15.138:0/1028485474 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd2540cca00 0x7fd25406ebc0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd2480ac040 tx=0x7fd24801ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:59.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.181+0000 7fd251600640 1 -- 172.21.15.138:0/1028485474 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2480bd5f0 con 0x7fd2540cca00 2024-04-26T20:56:59.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.181+0000 7fd251600640 1 -- 172.21.15.138:0/1028485474 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2480bd790 con 0x7fd2540cca00 2024-04-26T20:56:59.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.181+0000 7fd25be00640 1 -- 172.21.15.138:0/1028485474 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd254153600 con 0x7fd2540cca00 2024-04-26T20:56:59.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.181+0000 7fd251600640 1 -- 172.21.15.138:0/1028485474 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2480bdb60 con 0x7fd2540cca00 2024-04-26T20:56:59.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.181+0000 7fd25be00640 1 -- 172.21.15.138:0/1028485474 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd254166710 con 0x7fd2540cca00 2024-04-26T20:56:59.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.181+0000 7fd25be00640 1 -- 172.21.15.138:0/1028485474 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd254069510 con 0x7fd2540cca00 2024-04-26T20:56:59.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.185+0000 7fd251600640 1 -- 172.21.15.138:0/1028485474 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd2480b33f0 con 0x7fd2540cca00 2024-04-26T20:56:59.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.185+0000 7fd251600640 1 --2- 172.21.15.138:0/1028485474 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd2340683b0 0x7fd23406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:59.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.185+0000 7fd251600640 1 -- 172.21.15.138:0/1028485474 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fd2481217c0 con 0x7fd2540cca00 2024-04-26T20:56:59.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.185+0000 7fd258a00640 1 --2- 172.21.15.138:0/1028485474 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd2340683b0 0x7fd23406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:59.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.185+0000 7fd258a00640 1 --2- 172.21.15.138:0/1028485474 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd2340683b0 0x7fd23406a870 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd2541fb800 tx=0x7fd240008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:59.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.189+0000 7fd251600640 1 -- 172.21.15.138:0/1028485474 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd2480c3060 con 0x7fd2540cca00 2024-04-26T20:56:59.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.345+0000 7fd25be00640 1 -- 172.21.15.138:0/1028485474 --> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd2540cc060 con 0x7fd2340683b0 2024-04-26T20:56:59.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.389+0000 7fd251600640 1 -- 172.21.15.138:0/1028485474 <== mgr.4100 v2:172.21.15.143:6832/4275464198 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332558 (secure 0 0 0) 0x7fd2540cc060 con 0x7fd2340683b0 2024-04-26T20:56:59.394 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:56:59.398 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-04-26T20:56:59.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.393+0000 7fd25be00640 1 -- 172.21.15.138:0/1028485474 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd2340683b0 msgr2=0x7fd23406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:59.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.393+0000 7fd25be00640 1 --2- 172.21.15.138:0/1028485474 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd2340683b0 0x7fd23406a870 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd2541fb800 tx=0x7fd240008040 comp rx=0 tx=0).stop 2024-04-26T20:56:59.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.393+0000 7fd25be00640 1 -- 172.21.15.138:0/1028485474 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd2540cca00 msgr2=0x7fd25406ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:59.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.393+0000 7fd25be00640 1 --2- 172.21.15.138:0/1028485474 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd2540cca00 0x7fd25406ebc0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd2480ac040 tx=0x7fd24801ad30 comp rx=0 tx=0).stop 2024-04-26T20:56:59.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.393+0000 7fd25be00640 1 -- 172.21.15.138:0/1028485474 shutdown_connections 2024-04-26T20:56:59.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.393+0000 7fd25be00640 1 --2- 172.21.15.138:0/1028485474 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd2340683b0 0x7fd23406a870 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:59.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.393+0000 7fd25be00640 1 --2- 172.21.15.138:0/1028485474 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd25415e0c0 0x7fd2540ce6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:59.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.393+0000 7fd25be00640 1 --2- 172.21.15.138:0/1028485474 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd25415ce20 0x7fd254152c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:59.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.393+0000 7fd25be00640 1 --2- 172.21.15.138:0/1028485474 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd2540cca00 0x7fd25406ebc0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:59.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.393+0000 7fd25be00640 1 -- 172.21.15.138:0/1028485474 >> 172.21.15.138:0/1028485474 conn(0x7fd2540d0b20 msgr2=0x7fd2540c6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:59.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.393+0000 7fd25be00640 1 -- 172.21.15.138:0/1028485474 shutdown_connections 2024-04-26T20:56:59.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.393+0000 7fd25be00640 1 -- 172.21.15.138:0/1028485474 wait complete. 2024-04-26T20:56:59.416 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-04-26T20:56:59.244096+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219600,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755120,"statfs":{"total":773094113280,"available":772869242880,"internally_reserved":0,"allocated":3514368,"data_stored":2074395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003491"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789875+0000","last_change":"2024-04-26T20:56:39.229878+0000","last_active":"2024-04-26T20:56:45.789875+0000","last_peered":"2024-04-26T20:56:45.789875+0000","last_clean":"2024-04-26T20:56:45.789875+0000","last_became_active":"2024-04-26T20:56:39.229574+0000","last_became_peered":"2024-04-26T20:56:39.229574+0000","last_unstale":"2024-04-26T20:56:45.789875+0000","last_undegraded":"2024-04-26T20:56:45.789875+0000","last_fullsized":"2024-04-26T20:56:45.789875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:24:19.832688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789650+0000","last_change":"2024-04-26T20:56:40.249312+0000","last_active":"2024-04-26T20:56:45.789650+0000","last_peered":"2024-04-26T20:56:45.789650+0000","last_clean":"2024-04-26T20:56:45.789650+0000","last_became_active":"2024-04-26T20:56:40.249079+0000","last_became_peered":"2024-04-26T20:56:40.249079+0000","last_unstale":"2024-04-26T20:56:45.789650+0000","last_undegraded":"2024-04-26T20:56:45.789650+0000","last_fullsized":"2024-04-26T20:56:45.789650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:11:49.558212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.280455+0000","last_change":"2024-04-26T20:56:44.274985+0000","last_active":"2024-04-26T20:56:45.280455+0000","last_peered":"2024-04-26T20:56:45.280455+0000","last_clean":"2024-04-26T20:56:45.280455+0000","last_became_active":"2024-04-26T20:56:44.274510+0000","last_became_peered":"2024-04-26T20:56:44.274510+0000","last_unstale":"2024-04-26T20:56:45.280455+0000","last_undegraded":"2024-04-26T20:56:45.280455+0000","last_fullsized":"2024-04-26T20:56:45.280455+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:59.157222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789762+0000","last_change":"2024-04-26T20:56:39.213876+0000","last_active":"2024-04-26T20:56:45.789762+0000","last_peered":"2024-04-26T20:56:45.789762+0000","last_clean":"2024-04-26T20:56:45.789762+0000","last_became_active":"2024-04-26T20:56:39.213454+0000","last_became_peered":"2024-04-26T20:56:39.213454+0000","last_unstale":"2024-04-26T20:56:45.789762+0000","last_undegraded":"2024-04-26T20:56:45.789762+0000","last_fullsized":"2024-04-26T20:56:45.789762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:40:48.839377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789322+0000","last_change":"2024-04-26T20:56:40.247462+0000","last_active":"2024-04-26T20:56:45.789322+0000","last_peered":"2024-04-26T20:56:45.789322+0000","last_clean":"2024-04-26T20:56:45.789322+0000","last_became_active":"2024-04-26T20:56:40.246735+0000","last_became_peered":"2024-04-26T20:56:40.246735+0000","last_unstale":"2024-04-26T20:56:45.789322+0000","last_undegraded":"2024-04-26T20:56:45.789322+0000","last_fullsized":"2024-04-26T20:56:45.789322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:29.705970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.279752+0000","last_change":"2024-04-26T20:56:44.275068+0000","last_active":"2024-04-26T20:56:45.279752+0000","last_peered":"2024-04-26T20:56:45.279752+0000","last_clean":"2024-04-26T20:56:45.279752+0000","last_became_active":"2024-04-26T20:56:44.273517+0000","last_became_peered":"2024-04-26T20:56:44.273517+0000","last_unstale":"2024-04-26T20:56:45.279752+0000","last_undegraded":"2024-04-26T20:56:45.279752+0000","last_fullsized":"2024-04-26T20:56:45.279752+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:41:08.276592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278739+0000","last_change":"2024-04-26T20:56:39.213779+0000","last_active":"2024-04-26T20:56:45.278739+0000","last_peered":"2024-04-26T20:56:45.278739+0000","last_clean":"2024-04-26T20:56:45.278739+0000","last_became_active":"2024-04-26T20:56:39.213433+0000","last_became_peered":"2024-04-26T20:56:39.213433+0000","last_unstale":"2024-04-26T20:56:45.278739+0000","last_undegraded":"2024-04-26T20:56:45.278739+0000","last_fullsized":"2024-04-26T20:56:45.278739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:33.595789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.465212+0000","last_change":"2024-04-26T20:56:40.240847+0000","last_active":"2024-04-26T20:56:45.465212+0000","last_peered":"2024-04-26T20:56:45.465212+0000","last_clean":"2024-04-26T20:56:45.465212+0000","last_became_active":"2024-04-26T20:56:40.240513+0000","last_became_peered":"2024-04-26T20:56:40.240513+0000","last_unstale":"2024-04-26T20:56:45.465212+0000","last_undegraded":"2024-04-26T20:56:45.465212+0000","last_fullsized":"2024-04-26T20:56:45.465212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:31.742963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.280055+0000","last_change":"2024-04-26T20:56:44.268256+0000","last_active":"2024-04-26T20:56:45.280055+0000","last_peered":"2024-04-26T20:56:45.280055+0000","last_clean":"2024-04-26T20:56:45.280055+0000","last_became_active":"2024-04-26T20:56:44.267885+0000","last_became_peered":"2024-04-26T20:56:44.267885+0000","last_unstale":"2024-04-26T20:56:45.280055+0000","last_undegraded":"2024-04-26T20:56:45.280055+0000","last_fullsized":"2024-04-26T20:56:45.280055+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:24:14.331856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278928+0000","last_change":"2024-04-26T20:56:39.210434+0000","last_active":"2024-04-26T20:56:45.278928+0000","last_peered":"2024-04-26T20:56:45.278928+0000","last_clean":"2024-04-26T20:56:45.278928+0000","last_became_active":"2024-04-26T20:56:39.210149+0000","last_became_peered":"2024-04-26T20:56:39.210149+0000","last_unstale":"2024-04-26T20:56:45.278928+0000","last_undegraded":"2024-04-26T20:56:45.278928+0000","last_fullsized":"2024-04-26T20:56:45.278928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:57.508629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786985+0000","last_change":"2024-04-26T20:56:40.232523+0000","last_active":"2024-04-26T20:56:45.786985+0000","last_peered":"2024-04-26T20:56:45.786985+0000","last_clean":"2024-04-26T20:56:45.786985+0000","last_became_active":"2024-04-26T20:56:40.230256+0000","last_became_peered":"2024-04-26T20:56:40.230256+0000","last_unstale":"2024-04-26T20:56:45.786985+0000","last_undegraded":"2024-04-26T20:56:45.786985+0000","last_fullsized":"2024-04-26T20:56:45.786985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:16:36.927553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.279880+0000","last_change":"2024-04-26T20:56:44.274965+0000","last_active":"2024-04-26T20:56:45.279880+0000","last_peered":"2024-04-26T20:56:45.279880+0000","last_clean":"2024-04-26T20:56:45.279880+0000","last_became_active":"2024-04-26T20:56:44.274623+0000","last_became_peered":"2024-04-26T20:56:44.274623+0000","last_unstale":"2024-04-26T20:56:45.279880+0000","last_undegraded":"2024-04-26T20:56:45.279880+0000","last_fullsized":"2024-04-26T20:56:45.279880+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:20:44.467468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786581+0000","last_change":"2024-04-26T20:56:40.245428+0000","last_active":"2024-04-26T20:56:45.786581+0000","last_peered":"2024-04-26T20:56:45.786581+0000","last_clean":"2024-04-26T20:56:45.786581+0000","last_became_active":"2024-04-26T20:56:40.245183+0000","last_became_peered":"2024-04-26T20:56:40.245183+0000","last_unstale":"2024-04-26T20:56:45.786581+0000","last_undegraded":"2024-04-26T20:56:45.786581+0000","last_fullsized":"2024-04-26T20:56:45.786581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:39:41.674507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786761+0000","last_change":"2024-04-26T20:56:39.230950+0000","last_active":"2024-04-26T20:56:45.786761+0000","last_peered":"2024-04-26T20:56:45.786761+0000","last_clean":"2024-04-26T20:56:45.786761+0000","last_became_active":"2024-04-26T20:56:39.229924+0000","last_became_peered":"2024-04-26T20:56:39.229924+0000","last_unstale":"2024-04-26T20:56:45.786761+0000","last_undegraded":"2024-04-26T20:56:45.786761+0000","last_fullsized":"2024-04-26T20:56:45.786761+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:57.508629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786803+0000","last_change":"2024-04-26T20:56:44.266930+0000","last_active":"2024-04-26T20:56:45.786803+0000","last_peered":"2024-04-26T20:56:45.786803+0000","last_clean":"2024-04-26T20:56:45.786803+0000","last_became_active":"2024-04-26T20:56:44.266307+0000","last_became_peered":"2024-04-26T20:56:44.266307+0000","last_unstale":"2024-04-26T20:56:45.786803+0000","last_undegraded":"2024-04-26T20:56:45.786803+0000","last_fullsized":"2024-04-26T20:56:45.786803+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:49:09.870181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.281399+0000","last_change":"2024-04-26T20:56:40.243411+0000","last_active":"2024-04-26T20:56:45.281399+0000","last_peered":"2024-04-26T20:56:45.281399+0000","last_clean":"2024-04-26T20:56:45.281399+0000","last_became_active":"2024-04-26T20:56:40.242875+0000","last_became_peered":"2024-04-26T20:56:40.242875+0000","last_unstale":"2024-04-26T20:56:45.281399+0000","last_undegraded":"2024-04-26T20:56:45.281399+0000","last_fullsized":"2024-04-26T20:56:45.281399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:10:58.729505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788799+0000","last_change":"2024-04-26T20:56:39.224859+0000","last_active":"2024-04-26T20:56:45.788799+0000","last_peered":"2024-04-26T20:56:45.788799+0000","last_clean":"2024-04-26T20:56:45.788799+0000","last_became_active":"2024-04-26T20:56:39.223684+0000","last_became_peered":"2024-04-26T20:56:39.223684+0000","last_unstale":"2024-04-26T20:56:45.788799+0000","last_undegraded":"2024-04-26T20:56:45.788799+0000","last_fullsized":"2024-04-26T20:56:45.788799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:41:13.015392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278377+0000","last_change":"2024-04-26T20:56:44.269716+0000","last_active":"2024-04-26T20:56:45.278377+0000","last_peered":"2024-04-26T20:56:45.278377+0000","last_clean":"2024-04-26T20:56:45.278377+0000","last_became_active":"2024-04-26T20:56:44.269363+0000","last_became_peered":"2024-04-26T20:56:44.269363+0000","last_unstale":"2024-04-26T20:56:45.278377+0000","last_undegraded":"2024-04-26T20:56:45.278377+0000","last_fullsized":"2024-04-26T20:56:45.278377+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:39:45.714289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789241+0000","last_change":"2024-04-26T20:56:40.233387+0000","last_active":"2024-04-26T20:56:45.789241+0000","last_peered":"2024-04-26T20:56:45.789241+0000","last_clean":"2024-04-26T20:56:45.789241+0000","last_became_active":"2024-04-26T20:56:40.233078+0000","last_became_peered":"2024-04-26T20:56:40.233078+0000","last_unstale":"2024-04-26T20:56:45.789241+0000","last_undegraded":"2024-04-26T20:56:45.789241+0000","last_fullsized":"2024-04-26T20:56:45.789241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:10:26.700437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788991+0000","last_change":"2024-04-26T20:56:39.211859+0000","last_active":"2024-04-26T20:56:45.788991+0000","last_peered":"2024-04-26T20:56:45.788991+0000","last_clean":"2024-04-26T20:56:45.788991+0000","last_became_active":"2024-04-26T20:56:39.211629+0000","last_became_peered":"2024-04-26T20:56:39.211629+0000","last_unstale":"2024-04-26T20:56:45.788991+0000","last_undegraded":"2024-04-26T20:56:45.788991+0000","last_fullsized":"2024-04-26T20:56:45.788991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:27.088665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.281180+0000","last_change":"2024-04-26T20:56:44.276902+0000","last_active":"2024-04-26T20:56:45.281180+0000","last_peered":"2024-04-26T20:56:45.281180+0000","last_clean":"2024-04-26T20:56:45.281180+0000","last_became_active":"2024-04-26T20:56:44.276509+0000","last_became_peered":"2024-04-26T20:56:44.276509+0000","last_unstale":"2024-04-26T20:56:45.281180+0000","last_undegraded":"2024-04-26T20:56:45.281180+0000","last_fullsized":"2024-04-26T20:56:45.281180+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:07:31.106137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786397+0000","last_change":"2024-04-26T20:56:40.229542+0000","last_active":"2024-04-26T20:56:45.786397+0000","last_peered":"2024-04-26T20:56:45.786397+0000","last_clean":"2024-04-26T20:56:45.786397+0000","last_became_active":"2024-04-26T20:56:40.227907+0000","last_became_peered":"2024-04-26T20:56:40.227907+0000","last_unstale":"2024-04-26T20:56:45.786397+0000","last_undegraded":"2024-04-26T20:56:45.786397+0000","last_fullsized":"2024-04-26T20:56:45.786397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:32:50.377638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.277959+0000","last_change":"2024-04-26T20:56:39.226639+0000","last_active":"2024-04-26T20:56:45.277959+0000","last_peered":"2024-04-26T20:56:45.277959+0000","last_clean":"2024-04-26T20:56:45.277959+0000","last_became_active":"2024-04-26T20:56:39.226040+0000","last_became_peered":"2024-04-26T20:56:39.226040+0000","last_unstale":"2024-04-26T20:56:45.277959+0000","last_undegraded":"2024-04-26T20:56:45.277959+0000","last_fullsized":"2024-04-26T20:56:45.277959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:11:12.183144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.280450+0000","last_change":"2024-04-26T20:56:44.264659+0000","last_active":"2024-04-26T20:56:45.280450+0000","last_peered":"2024-04-26T20:56:45.280450+0000","last_clean":"2024-04-26T20:56:45.280450+0000","last_became_active":"2024-04-26T20:56:44.264283+0000","last_became_peered":"2024-04-26T20:56:44.264283+0000","last_unstale":"2024-04-26T20:56:45.280450+0000","last_undegraded":"2024-04-26T20:56:45.280450+0000","last_fullsized":"2024-04-26T20:56:45.280450+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:50:30.081888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789823+0000","last_change":"2024-04-26T20:56:40.254246+0000","last_active":"2024-04-26T20:56:45.789823+0000","last_peered":"2024-04-26T20:56:45.789823+0000","last_clean":"2024-04-26T20:56:45.789823+0000","last_became_active":"2024-04-26T20:56:40.253998+0000","last_became_peered":"2024-04-26T20:56:40.253998+0000","last_unstale":"2024-04-26T20:56:45.789823+0000","last_undegraded":"2024-04-26T20:56:45.789823+0000","last_fullsized":"2024-04-26T20:56:45.789823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:15.179866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.787122+0000","last_change":"2024-04-26T20:56:39.228884+0000","last_active":"2024-04-26T20:56:45.787122+0000","last_peered":"2024-04-26T20:56:45.787122+0000","last_clean":"2024-04-26T20:56:45.787122+0000","last_became_active":"2024-04-26T20:56:39.228629+0000","last_became_peered":"2024-04-26T20:56:39.228629+0000","last_unstale":"2024-04-26T20:56:45.787122+0000","last_undegraded":"2024-04-26T20:56:45.787122+0000","last_fullsized":"2024-04-26T20:56:45.787122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:41:03.229071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.279855+0000","last_change":"2024-04-26T20:56:44.260583+0000","last_active":"2024-04-26T20:56:45.279855+0000","last_peered":"2024-04-26T20:56:45.279855+0000","last_clean":"2024-04-26T20:56:45.279855+0000","last_became_active":"2024-04-26T20:56:44.260203+0000","last_became_peered":"2024-04-26T20:56:44.260203+0000","last_unstale":"2024-04-26T20:56:45.279855+0000","last_undegraded":"2024-04-26T20:56:45.279855+0000","last_fullsized":"2024-04-26T20:56:45.279855+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:11:53.597994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789753+0000","last_change":"2024-04-26T20:56:40.248051+0000","last_active":"2024-04-26T20:56:45.789753+0000","last_peered":"2024-04-26T20:56:45.789753+0000","last_clean":"2024-04-26T20:56:45.789753+0000","last_became_active":"2024-04-26T20:56:40.247752+0000","last_became_peered":"2024-04-26T20:56:40.247752+0000","last_unstale":"2024-04-26T20:56:45.789753+0000","last_undegraded":"2024-04-26T20:56:45.789753+0000","last_fullsized":"2024-04-26T20:56:45.789753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:12:39.534861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.790043+0000","last_change":"2024-04-26T20:56:39.215006+0000","last_active":"2024-04-26T20:56:45.790043+0000","last_peered":"2024-04-26T20:56:45.790043+0000","last_clean":"2024-04-26T20:56:45.790043+0000","last_became_active":"2024-04-26T20:56:39.214568+0000","last_became_peered":"2024-04-26T20:56:39.214568+0000","last_unstale":"2024-04-26T20:56:45.790043+0000","last_undegraded":"2024-04-26T20:56:45.790043+0000","last_fullsized":"2024-04-26T20:56:45.790043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:48:30.348419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788054+0000","last_change":"2024-04-26T20:56:44.266191+0000","last_active":"2024-04-26T20:56:45.788054+0000","last_peered":"2024-04-26T20:56:45.788054+0000","last_clean":"2024-04-26T20:56:45.788054+0000","last_became_active":"2024-04-26T20:56:44.265828+0000","last_became_peered":"2024-04-26T20:56:44.265828+0000","last_unstale":"2024-04-26T20:56:45.788054+0000","last_undegraded":"2024-04-26T20:56:45.788054+0000","last_fullsized":"2024-04-26T20:56:45.788054+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:07.880235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.790688+0000","last_change":"2024-04-26T20:56:40.235429+0000","last_active":"2024-04-26T20:56:45.790688+0000","last_peered":"2024-04-26T20:56:45.790688+0000","last_clean":"2024-04-26T20:56:45.790688+0000","last_became_active":"2024-04-26T20:56:40.234817+0000","last_became_peered":"2024-04-26T20:56:40.234817+0000","last_unstale":"2024-04-26T20:56:45.790688+0000","last_undegraded":"2024-04-26T20:56:45.790688+0000","last_fullsized":"2024-04-26T20:56:45.790688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:41:03.691519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.787238+0000","last_change":"2024-04-26T20:56:39.224333+0000","last_active":"2024-04-26T20:56:45.787238+0000","last_peered":"2024-04-26T20:56:45.787238+0000","last_clean":"2024-04-26T20:56:45.787238+0000","last_became_active":"2024-04-26T20:56:39.220936+0000","last_became_peered":"2024-04-26T20:56:39.220936+0000","last_unstale":"2024-04-26T20:56:45.787238+0000","last_undegraded":"2024-04-26T20:56:45.787238+0000","last_fullsized":"2024-04-26T20:56:45.787238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:57:35.827912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788284+0000","last_change":"2024-04-26T20:56:44.257752+0000","last_active":"2024-04-26T20:56:45.788284+0000","last_peered":"2024-04-26T20:56:45.788284+0000","last_clean":"2024-04-26T20:56:45.788284+0000","last_became_active":"2024-04-26T20:56:44.257338+0000","last_became_peered":"2024-04-26T20:56:44.257338+0000","last_unstale":"2024-04-26T20:56:45.788284+0000","last_undegraded":"2024-04-26T20:56:45.788284+0000","last_fullsized":"2024-04-26T20:56:45.788284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:20:44.467468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.280289+0000","last_change":"2024-04-26T20:56:40.245228+0000","last_active":"2024-04-26T20:56:45.280289+0000","last_peered":"2024-04-26T20:56:45.280289+0000","last_clean":"2024-04-26T20:56:45.280289+0000","last_became_active":"2024-04-26T20:56:40.244846+0000","last_became_peered":"2024-04-26T20:56:40.244846+0000","last_unstale":"2024-04-26T20:56:45.280289+0000","last_undegraded":"2024-04-26T20:56:45.280289+0000","last_fullsized":"2024-04-26T20:56:45.280289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:41:13.644088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788644+0000","last_change":"2024-04-26T20:56:39.220939+0000","last_active":"2024-04-26T20:56:45.788644+0000","last_peered":"2024-04-26T20:56:45.788644+0000","last_clean":"2024-04-26T20:56:45.788644+0000","last_became_active":"2024-04-26T20:56:39.220267+0000","last_became_peered":"2024-04-26T20:56:39.220267+0000","last_unstale":"2024-04-26T20:56:45.788644+0000","last_undegraded":"2024-04-26T20:56:45.788644+0000","last_fullsized":"2024-04-26T20:56:45.788644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:14:14.002707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788475+0000","last_change":"2024-04-26T20:56:44.257761+0000","last_active":"2024-04-26T20:56:45.788475+0000","last_peered":"2024-04-26T20:56:45.788475+0000","last_clean":"2024-04-26T20:56:45.788475+0000","last_became_active":"2024-04-26T20:56:44.257291+0000","last_became_peered":"2024-04-26T20:56:44.257291+0000","last_unstale":"2024-04-26T20:56:45.788475+0000","last_undegraded":"2024-04-26T20:56:45.788475+0000","last_fullsized":"2024-04-26T20:56:45.788475+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:24:14.331856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278555+0000","last_change":"2024-04-26T20:56:40.224373+0000","last_active":"2024-04-26T20:56:45.278555+0000","last_peered":"2024-04-26T20:56:45.278555+0000","last_clean":"2024-04-26T20:56:45.278555+0000","last_became_active":"2024-04-26T20:56:40.224141+0000","last_became_peered":"2024-04-26T20:56:40.224141+0000","last_unstale":"2024-04-26T20:56:45.278555+0000","last_undegraded":"2024-04-26T20:56:45.278555+0000","last_fullsized":"2024-04-26T20:56:45.278555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:50:26.042106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786967+0000","last_change":"2024-04-26T20:56:39.225627+0000","last_active":"2024-04-26T20:56:45.786967+0000","last_peered":"2024-04-26T20:56:45.786967+0000","last_clean":"2024-04-26T20:56:45.786967+0000","last_became_active":"2024-04-26T20:56:39.224819+0000","last_became_peered":"2024-04-26T20:56:39.224819+0000","last_unstale":"2024-04-26T20:56:45.786967+0000","last_undegraded":"2024-04-26T20:56:45.786967+0000","last_fullsized":"2024-04-26T20:56:45.786967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:54.109701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.790603+0000","last_change":"2024-04-26T20:56:44.268007+0000","last_active":"2024-04-26T20:56:45.790603+0000","last_peered":"2024-04-26T20:56:45.790603+0000","last_clean":"2024-04-26T20:56:45.790603+0000","last_became_active":"2024-04-26T20:56:44.267593+0000","last_became_peered":"2024-04-26T20:56:44.267593+0000","last_unstale":"2024-04-26T20:56:45.790603+0000","last_undegraded":"2024-04-26T20:56:45.790603+0000","last_fullsized":"2024-04-26T20:56:45.790603+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:43:21.248440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788110+0000","last_change":"2024-04-26T20:56:40.232686+0000","last_active":"2024-04-26T20:56:45.788110+0000","last_peered":"2024-04-26T20:56:45.788110+0000","last_clean":"2024-04-26T20:56:45.788110+0000","last_became_active":"2024-04-26T20:56:40.232406+0000","last_became_peered":"2024-04-26T20:56:40.232406+0000","last_unstale":"2024-04-26T20:56:45.788110+0000","last_undegraded":"2024-04-26T20:56:45.788110+0000","last_fullsized":"2024-04-26T20:56:45.788110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:44:46.926225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.280640+0000","last_change":"2024-04-26T20:56:39.224479+0000","last_active":"2024-04-26T20:56:45.280640+0000","last_peered":"2024-04-26T20:56:45.280640+0000","last_clean":"2024-04-26T20:56:45.280640+0000","last_became_active":"2024-04-26T20:56:39.224106+0000","last_became_peered":"2024-04-26T20:56:39.224106+0000","last_unstale":"2024-04-26T20:56:45.280640+0000","last_undegraded":"2024-04-26T20:56:45.280640+0000","last_fullsized":"2024-04-26T20:56:45.280640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:31:59.475595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.790288+0000","last_change":"2024-04-26T20:56:44.264512+0000","last_active":"2024-04-26T20:56:45.790288+0000","last_peered":"2024-04-26T20:56:45.790288+0000","last_clean":"2024-04-26T20:56:45.790288+0000","last_became_active":"2024-04-26T20:56:44.264211+0000","last_became_peered":"2024-04-26T20:56:44.264211+0000","last_unstale":"2024-04-26T20:56:45.790288+0000","last_undegraded":"2024-04-26T20:56:45.790288+0000","last_fullsized":"2024-04-26T20:56:45.790288+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:33.745752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788142+0000","last_change":"2024-04-26T20:56:40.248343+0000","last_active":"2024-04-26T20:56:45.788142+0000","last_peered":"2024-04-26T20:56:45.788142+0000","last_clean":"2024-04-26T20:56:45.788142+0000","last_became_active":"2024-04-26T20:56:40.248044+0000","last_became_peered":"2024-04-26T20:56:40.248044+0000","last_unstale":"2024-04-26T20:56:45.788142+0000","last_undegraded":"2024-04-26T20:56:45.788142+0000","last_fullsized":"2024-04-26T20:56:45.788142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:14:12.321345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786512+0000","last_change":"2024-04-26T20:56:39.224746+0000","last_active":"2024-04-26T20:56:45.786512+0000","last_peered":"2024-04-26T20:56:45.786512+0000","last_clean":"2024-04-26T20:56:45.786512+0000","last_became_active":"2024-04-26T20:56:39.224396+0000","last_became_peered":"2024-04-26T20:56:39.224396+0000","last_unstale":"2024-04-26T20:56:45.786512+0000","last_undegraded":"2024-04-26T20:56:45.786512+0000","last_fullsized":"2024-04-26T20:56:45.786512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:33.595789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789520+0000","last_change":"2024-04-26T20:56:44.263211+0000","last_active":"2024-04-26T20:56:45.789520+0000","last_peered":"2024-04-26T20:56:45.789520+0000","last_clean":"2024-04-26T20:56:45.789520+0000","last_became_active":"2024-04-26T20:56:44.262730+0000","last_became_peered":"2024-04-26T20:56:44.262730+0000","last_unstale":"2024-04-26T20:56:45.789520+0000","last_undegraded":"2024-04-26T20:56:45.789520+0000","last_fullsized":"2024-04-26T20:56:45.789520+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:00.508968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789184+0000","last_change":"2024-04-26T20:56:40.231800+0000","last_active":"2024-04-26T20:56:45.789184+0000","last_peered":"2024-04-26T20:56:45.789184+0000","last_clean":"2024-04-26T20:56:45.789184+0000","last_became_active":"2024-04-26T20:56:40.231372+0000","last_became_peered":"2024-04-26T20:56:40.231372+0000","last_unstale":"2024-04-26T20:56:45.789184+0000","last_undegraded":"2024-04-26T20:56:45.789184+0000","last_fullsized":"2024-04-26T20:56:45.789184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:25:09.320511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786818+0000","last_change":"2024-04-26T20:56:39.219637+0000","last_active":"2024-04-26T20:56:45.786818+0000","last_peered":"2024-04-26T20:56:45.786818+0000","last_clean":"2024-04-26T20:56:45.786818+0000","last_became_active":"2024-04-26T20:56:39.219390+0000","last_became_peered":"2024-04-26T20:56:39.219390+0000","last_unstale":"2024-04-26T20:56:45.786818+0000","last_undegraded":"2024-04-26T20:56:45.786818+0000","last_fullsized":"2024-04-26T20:56:45.786818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:41:12.636349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":178,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.464868+0000","last_change":"2024-04-26T20:56:29.347462+0000","last_active":"2024-04-26T20:56:45.464868+0000","last_peered":"2024-04-26T20:56:45.464868+0000","last_clean":"2024-04-26T20:56:45.464868+0000","last_became_active":"2024-04-26T20:56:29.346224+0000","last_became_peered":"2024-04-26T20:56:29.346224+0000","last_unstale":"2024-04-26T20:56:45.464868+0000","last_undegraded":"2024-04-26T20:56:45.464868+0000","last_fullsized":"2024-04-26T20:56:45.464868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:28.079105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:28.079105+0000","last_clean_scrub_stamp":"2024-04-26T20:56:28.079105+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:13.693525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.787244+0000","last_change":"2024-04-26T20:56:44.256761+0000","last_active":"2024-04-26T20:56:45.787244+0000","last_peered":"2024-04-26T20:56:45.787244+0000","last_clean":"2024-04-26T20:56:45.787244+0000","last_became_active":"2024-04-26T20:56:44.256253+0000","last_became_peered":"2024-04-26T20:56:44.256253+0000","last_unstale":"2024-04-26T20:56:45.787244+0000","last_undegraded":"2024-04-26T20:56:45.787244+0000","last_fullsized":"2024-04-26T20:56:45.787244+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:34.373869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.787072+0000","last_change":"2024-04-26T20:56:40.245995+0000","last_active":"2024-04-26T20:56:45.787072+0000","last_peered":"2024-04-26T20:56:45.787072+0000","last_clean":"2024-04-26T20:56:45.787072+0000","last_became_active":"2024-04-26T20:56:40.245694+0000","last_became_peered":"2024-04-26T20:56:40.245694+0000","last_unstale":"2024-04-26T20:56:45.787072+0000","last_undegraded":"2024-04-26T20:56:45.787072+0000","last_fullsized":"2024-04-26T20:56:45.787072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:52.333752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.790781+0000","last_change":"2024-04-26T20:56:39.224388+0000","last_active":"2024-04-26T20:56:45.790781+0000","last_peered":"2024-04-26T20:56:45.790781+0000","last_clean":"2024-04-26T20:56:45.790781+0000","last_became_active":"2024-04-26T20:56:39.224125+0000","last_became_peered":"2024-04-26T20:56:39.224125+0000","last_unstale":"2024-04-26T20:56:45.790781+0000","last_undegraded":"2024-04-26T20:56:45.790781+0000","last_fullsized":"2024-04-26T20:56:45.790781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:40:48.839377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.279794+0000","last_change":"2024-04-26T20:56:44.266270+0000","last_active":"2024-04-26T20:56:45.279794+0000","last_peered":"2024-04-26T20:56:45.279794+0000","last_clean":"2024-04-26T20:56:45.279794+0000","last_became_active":"2024-04-26T20:56:44.265879+0000","last_became_peered":"2024-04-26T20:56:44.265879+0000","last_unstale":"2024-04-26T20:56:45.279794+0000","last_undegraded":"2024-04-26T20:56:45.279794+0000","last_fullsized":"2024-04-26T20:56:45.279794+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:28:42.894461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278895+0000","last_change":"2024-04-26T20:56:40.232540+0000","last_active":"2024-04-26T20:56:45.278895+0000","last_peered":"2024-04-26T20:56:45.278895+0000","last_clean":"2024-04-26T20:56:45.278895+0000","last_became_active":"2024-04-26T20:56:40.231008+0000","last_became_peered":"2024-04-26T20:56:40.231008+0000","last_unstale":"2024-04-26T20:56:45.278895+0000","last_undegraded":"2024-04-26T20:56:45.278895+0000","last_fullsized":"2024-04-26T20:56:45.278895+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:20:40.427686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789243+0000","last_change":"2024-04-26T20:56:39.222383+0000","last_active":"2024-04-26T20:56:45.789243+0000","last_peered":"2024-04-26T20:56:45.789243+0000","last_clean":"2024-04-26T20:56:45.789243+0000","last_became_active":"2024-04-26T20:56:39.222014+0000","last_became_peered":"2024-04-26T20:56:39.222014+0000","last_unstale":"2024-04-26T20:56:45.789243+0000","last_undegraded":"2024-04-26T20:56:45.789243+0000","last_fullsized":"2024-04-26T20:56:45.789243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:03:29.476982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788357+0000","last_change":"2024-04-26T20:56:44.264780+0000","last_active":"2024-04-26T20:56:45.788357+0000","last_peered":"2024-04-26T20:56:45.788357+0000","last_clean":"2024-04-26T20:56:45.788357+0000","last_became_active":"2024-04-26T20:56:44.260516+0000","last_became_peered":"2024-04-26T20:56:44.260516+0000","last_unstale":"2024-04-26T20:56:45.788357+0000","last_undegraded":"2024-04-26T20:56:45.788357+0000","last_fullsized":"2024-04-26T20:56:45.788357+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:56.373533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278843+0000","last_change":"2024-04-26T20:56:40.245302+0000","last_active":"2024-04-26T20:56:45.278843+0000","last_peered":"2024-04-26T20:56:45.278843+0000","last_clean":"2024-04-26T20:56:45.278843+0000","last_became_active":"2024-04-26T20:56:40.245020+0000","last_became_peered":"2024-04-26T20:56:40.245020+0000","last_unstale":"2024-04-26T20:56:45.278843+0000","last_undegraded":"2024-04-26T20:56:45.278843+0000","last_fullsized":"2024-04-26T20:56:45.278843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:32:50.377638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789962+0000","last_change":"2024-04-26T20:56:39.212876+0000","last_active":"2024-04-26T20:56:45.789962+0000","last_peered":"2024-04-26T20:56:45.789962+0000","last_clean":"2024-04-26T20:56:45.789962+0000","last_became_active":"2024-04-26T20:56:39.210505+0000","last_became_peered":"2024-04-26T20:56:39.210505+0000","last_unstale":"2024-04-26T20:56:45.789962+0000","last_undegraded":"2024-04-26T20:56:45.789962+0000","last_fullsized":"2024-04-26T20:56:45.789962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:29:37.126090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786321+0000","last_change":"2024-04-26T20:56:44.269758+0000","last_active":"2024-04-26T20:56:45.786321+0000","last_peered":"2024-04-26T20:56:45.786321+0000","last_clean":"2024-04-26T20:56:45.786321+0000","last_became_active":"2024-04-26T20:56:44.267320+0000","last_became_peered":"2024-04-26T20:56:44.267320+0000","last_unstale":"2024-04-26T20:56:45.786321+0000","last_undegraded":"2024-04-26T20:56:45.786321+0000","last_fullsized":"2024-04-26T20:56:45.786321+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:28.426749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.280509+0000","last_change":"2024-04-26T20:56:40.224152+0000","last_active":"2024-04-26T20:56:45.280509+0000","last_peered":"2024-04-26T20:56:45.280509+0000","last_clean":"2024-04-26T20:56:45.280509+0000","last_became_active":"2024-04-26T20:56:40.223000+0000","last_became_peered":"2024-04-26T20:56:40.223000+0000","last_unstale":"2024-04-26T20:56:45.280509+0000","last_undegraded":"2024-04-26T20:56:45.280509+0000","last_fullsized":"2024-04-26T20:56:45.280509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:46.709617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278951+0000","last_change":"2024-04-26T20:56:39.210612+0000","last_active":"2024-04-26T20:56:45.278951+0000","last_peered":"2024-04-26T20:56:45.278951+0000","last_clean":"2024-04-26T20:56:45.278951+0000","last_became_active":"2024-04-26T20:56:39.210308+0000","last_became_peered":"2024-04-26T20:56:39.210308+0000","last_unstale":"2024-04-26T20:56:45.278951+0000","last_undegraded":"2024-04-26T20:56:45.278951+0000","last_fullsized":"2024-04-26T20:56:45.278951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:10:57.721766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.465006+0000","last_change":"2024-04-26T20:56:44.255699+0000","last_active":"2024-04-26T20:56:45.465006+0000","last_peered":"2024-04-26T20:56:45.465006+0000","last_clean":"2024-04-26T20:56:45.465006+0000","last_became_active":"2024-04-26T20:56:44.255377+0000","last_became_peered":"2024-04-26T20:56:44.255377+0000","last_unstale":"2024-04-26T20:56:45.465006+0000","last_undegraded":"2024-04-26T20:56:45.465006+0000","last_fullsized":"2024-04-26T20:56:45.465006+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:35.050613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786401+0000","last_change":"2024-04-26T20:56:40.223324+0000","last_active":"2024-04-26T20:56:45.786401+0000","last_peered":"2024-04-26T20:56:45.786401+0000","last_clean":"2024-04-26T20:56:45.786401+0000","last_became_active":"2024-04-26T20:56:40.223003+0000","last_became_peered":"2024-04-26T20:56:40.223003+0000","last_unstale":"2024-04-26T20:56:45.786401+0000","last_undegraded":"2024-04-26T20:56:45.786401+0000","last_fullsized":"2024-04-26T20:56:45.786401+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:14:26.269699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789347+0000","last_change":"2024-04-26T20:56:39.217490+0000","last_active":"2024-04-26T20:56:45.789347+0000","last_peered":"2024-04-26T20:56:45.789347+0000","last_clean":"2024-04-26T20:56:45.789347+0000","last_became_active":"2024-04-26T20:56:39.217064+0000","last_became_peered":"2024-04-26T20:56:39.217064+0000","last_unstale":"2024-04-26T20:56:45.789347+0000","last_undegraded":"2024-04-26T20:56:45.789347+0000","last_fullsized":"2024-04-26T20:56:45.789347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:58:35.548325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789701+0000","last_change":"2024-04-26T20:56:44.262792+0000","last_active":"2024-04-26T20:56:45.789701+0000","last_peered":"2024-04-26T20:56:45.789701+0000","last_clean":"2024-04-26T20:56:45.789701+0000","last_became_active":"2024-04-26T20:56:44.260202+0000","last_became_peered":"2024-04-26T20:56:44.260202+0000","last_unstale":"2024-04-26T20:56:45.789701+0000","last_undegraded":"2024-04-26T20:56:45.789701+0000","last_fullsized":"2024-04-26T20:56:45.789701+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:54:15.702050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.464817+0000","last_change":"2024-04-26T20:56:40.259427+0000","last_active":"2024-04-26T20:56:45.464817+0000","last_peered":"2024-04-26T20:56:45.464817+0000","last_clean":"2024-04-26T20:56:45.464817+0000","last_became_active":"2024-04-26T20:56:40.258928+0000","last_became_peered":"2024-04-26T20:56:40.258928+0000","last_unstale":"2024-04-26T20:56:45.464817+0000","last_undegraded":"2024-04-26T20:56:45.464817+0000","last_fullsized":"2024-04-26T20:56:45.464817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:10:58.729505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278176+0000","last_change":"2024-04-26T20:56:39.223722+0000","last_active":"2024-04-26T20:56:45.278176+0000","last_peered":"2024-04-26T20:56:45.278176+0000","last_clean":"2024-04-26T20:56:45.278176+0000","last_became_active":"2024-04-26T20:56:39.223385+0000","last_became_peered":"2024-04-26T20:56:39.223385+0000","last_unstale":"2024-04-26T20:56:45.278176+0000","last_undegraded":"2024-04-26T20:56:45.278176+0000","last_fullsized":"2024-04-26T20:56:45.278176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:41:13.015392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789491+0000","last_change":"2024-04-26T20:56:44.259808+0000","last_active":"2024-04-26T20:56:45.789491+0000","last_peered":"2024-04-26T20:56:45.789491+0000","last_clean":"2024-04-26T20:56:45.789491+0000","last_became_active":"2024-04-26T20:56:44.259170+0000","last_became_peered":"2024-04-26T20:56:44.259170+0000","last_unstale":"2024-04-26T20:56:45.789491+0000","last_undegraded":"2024-04-26T20:56:45.789491+0000","last_fullsized":"2024-04-26T20:56:45.789491+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:18:11.962630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786651+0000","last_change":"2024-04-26T20:56:40.233004+0000","last_active":"2024-04-26T20:56:45.786651+0000","last_peered":"2024-04-26T20:56:45.786651+0000","last_clean":"2024-04-26T20:56:45.786651+0000","last_became_active":"2024-04-26T20:56:40.232735+0000","last_became_peered":"2024-04-26T20:56:40.232735+0000","last_unstale":"2024-04-26T20:56:45.786651+0000","last_undegraded":"2024-04-26T20:56:45.786651+0000","last_fullsized":"2024-04-26T20:56:45.786651+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:32:02.092294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786874+0000","last_change":"2024-04-26T20:56:39.224061+0000","last_active":"2024-04-26T20:56:45.786874+0000","last_peered":"2024-04-26T20:56:45.786874+0000","last_clean":"2024-04-26T20:56:45.786874+0000","last_became_active":"2024-04-26T20:56:39.223790+0000","last_became_peered":"2024-04-26T20:56:39.223790+0000","last_unstale":"2024-04-26T20:56:45.786874+0000","last_undegraded":"2024-04-26T20:56:45.786874+0000","last_fullsized":"2024-04-26T20:56:45.786874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:14:11.313606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.790509+0000","last_change":"2024-04-26T20:56:44.269183+0000","last_active":"2024-04-26T20:56:45.790509+0000","last_peered":"2024-04-26T20:56:45.790509+0000","last_clean":"2024-04-26T20:56:45.790509+0000","last_became_active":"2024-04-26T20:56:44.266986+0000","last_became_peered":"2024-04-26T20:56:44.266986+0000","last_unstale":"2024-04-26T20:56:45.790509+0000","last_undegraded":"2024-04-26T20:56:45.790509+0000","last_fullsized":"2024-04-26T20:56:45.790509+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:50:30.081888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788704+0000","last_change":"2024-04-26T20:56:40.245751+0000","last_active":"2024-04-26T20:56:45.788704+0000","last_peered":"2024-04-26T20:56:45.788704+0000","last_clean":"2024-04-26T20:56:45.788704+0000","last_became_active":"2024-04-26T20:56:40.245369+0000","last_became_peered":"2024-04-26T20:56:40.245369+0000","last_unstale":"2024-04-26T20:56:45.788704+0000","last_undegraded":"2024-04-26T20:56:45.788704+0000","last_fullsized":"2024-04-26T20:56:45.788704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:59.357459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.281500+0000","last_change":"2024-04-26T20:56:39.225785+0000","last_active":"2024-04-26T20:56:45.281500+0000","last_peered":"2024-04-26T20:56:45.281500+0000","last_clean":"2024-04-26T20:56:45.281500+0000","last_became_active":"2024-04-26T20:56:39.225542+0000","last_became_peered":"2024-04-26T20:56:39.225542+0000","last_unstale":"2024-04-26T20:56:45.281500+0000","last_undegraded":"2024-04-26T20:56:45.281500+0000","last_fullsized":"2024-04-26T20:56:45.281500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:03:29.476982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.787074+0000","last_change":"2024-04-26T20:56:44.253303+0000","last_active":"2024-04-26T20:56:45.787074+0000","last_peered":"2024-04-26T20:56:45.787074+0000","last_clean":"2024-04-26T20:56:45.787074+0000","last_became_active":"2024-04-26T20:56:44.252962+0000","last_became_peered":"2024-04-26T20:56:44.252962+0000","last_unstale":"2024-04-26T20:56:45.787074+0000","last_undegraded":"2024-04-26T20:56:45.787074+0000","last_fullsized":"2024-04-26T20:56:45.787074+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:51:16.305273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278531+0000","last_change":"2024-04-26T20:56:40.242121+0000","last_active":"2024-04-26T20:56:45.278531+0000","last_peered":"2024-04-26T20:56:45.278531+0000","last_clean":"2024-04-26T20:56:45.278531+0000","last_became_active":"2024-04-26T20:56:40.241861+0000","last_became_peered":"2024-04-26T20:56:40.241861+0000","last_unstale":"2024-04-26T20:56:45.278531+0000","last_undegraded":"2024-04-26T20:56:45.278531+0000","last_fullsized":"2024-04-26T20:56:45.278531+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:11:49.558212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'10","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:55.394552+0000","last_change":"2024-04-26T20:56:39.215684+0000","last_active":"2024-04-26T20:56:55.394552+0000","last_peered":"2024-04-26T20:56:55.394552+0000","last_clean":"2024-04-26T20:56:55.394552+0000","last_became_active":"2024-04-26T20:56:39.215414+0000","last_became_peered":"2024-04-26T20:56:39.215414+0000","last_unstale":"2024-04-26T20:56:55.394552+0000","last_undegraded":"2024-04-26T20:56:55.394552+0000","last_fullsized":"2024-04-26T20:56:55.394552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:19:34.743821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789857+0000","last_change":"2024-04-26T20:56:44.268455+0000","last_active":"2024-04-26T20:56:45.789857+0000","last_peered":"2024-04-26T20:56:45.789857+0000","last_clean":"2024-04-26T20:56:45.789857+0000","last_became_active":"2024-04-26T20:56:44.267050+0000","last_became_peered":"2024-04-26T20:56:44.267050+0000","last_unstale":"2024-04-26T20:56:45.789857+0000","last_undegraded":"2024-04-26T20:56:45.789857+0000","last_fullsized":"2024-04-26T20:56:45.789857+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:53:37.753988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786653+0000","last_change":"2024-04-26T20:56:40.234863+0000","last_active":"2024-04-26T20:56:45.786653+0000","last_peered":"2024-04-26T20:56:45.786653+0000","last_clean":"2024-04-26T20:56:45.786653+0000","last_became_active":"2024-04-26T20:56:40.233643+0000","last_became_peered":"2024-04-26T20:56:40.233643+0000","last_unstale":"2024-04-26T20:56:45.786653+0000","last_undegraded":"2024-04-26T20:56:45.786653+0000","last_fullsized":"2024-04-26T20:56:45.786653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:33:12.507172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.281206+0000","last_change":"2024-04-26T20:56:39.226868+0000","last_active":"2024-04-26T20:56:45.281206+0000","last_peered":"2024-04-26T20:56:45.281206+0000","last_clean":"2024-04-26T20:56:45.281206+0000","last_became_active":"2024-04-26T20:56:39.224374+0000","last_became_peered":"2024-04-26T20:56:39.224374+0000","last_unstale":"2024-04-26T20:56:45.281206+0000","last_undegraded":"2024-04-26T20:56:45.281206+0000","last_fullsized":"2024-04-26T20:56:45.281206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:14:14.002707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.280149+0000","last_change":"2024-04-26T20:56:44.267204+0000","last_active":"2024-04-26T20:56:45.280149+0000","last_peered":"2024-04-26T20:56:45.280149+0000","last_clean":"2024-04-26T20:56:45.280149+0000","last_became_active":"2024-04-26T20:56:44.265067+0000","last_became_peered":"2024-04-26T20:56:44.265067+0000","last_unstale":"2024-04-26T20:56:45.280149+0000","last_undegraded":"2024-04-26T20:56:45.280149+0000","last_fullsized":"2024-04-26T20:56:45.280149+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:33.745752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789404+0000","last_change":"2024-04-26T20:56:40.250180+0000","last_active":"2024-04-26T20:56:45.789404+0000","last_peered":"2024-04-26T20:56:45.789404+0000","last_clean":"2024-04-26T20:56:45.789404+0000","last_became_active":"2024-04-26T20:56:40.241673+0000","last_became_peered":"2024-04-26T20:56:40.241673+0000","last_unstale":"2024-04-26T20:56:45.789404+0000","last_undegraded":"2024-04-26T20:56:45.789404+0000","last_fullsized":"2024-04-26T20:56:45.789404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:43:17.208658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278532+0000","last_change":"2024-04-26T20:56:39.212686+0000","last_active":"2024-04-26T20:56:45.278532+0000","last_peered":"2024-04-26T20:56:45.278532+0000","last_clean":"2024-04-26T20:56:45.278532+0000","last_became_active":"2024-04-26T20:56:39.211596+0000","last_became_peered":"2024-04-26T20:56:39.211596+0000","last_unstale":"2024-04-26T20:56:45.278532+0000","last_undegraded":"2024-04-26T20:56:45.278532+0000","last_fullsized":"2024-04-26T20:56:45.278532+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:40:48.839377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.280382+0000","last_change":"2024-04-26T20:56:44.271569+0000","last_active":"2024-04-26T20:56:45.280382+0000","last_peered":"2024-04-26T20:56:45.280382+0000","last_clean":"2024-04-26T20:56:45.280382+0000","last_became_active":"2024-04-26T20:56:44.271199+0000","last_became_peered":"2024-04-26T20:56:44.271199+0000","last_unstale":"2024-04-26T20:56:45.280382+0000","last_undegraded":"2024-04-26T20:56:45.280382+0000","last_fullsized":"2024-04-26T20:56:45.280382+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:03.397241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.280443+0000","last_change":"2024-04-26T20:56:40.218097+0000","last_active":"2024-04-26T20:56:45.280443+0000","last_peered":"2024-04-26T20:56:45.280443+0000","last_clean":"2024-04-26T20:56:45.280443+0000","last_became_active":"2024-04-26T20:56:40.217279+0000","last_became_peered":"2024-04-26T20:56:40.217279+0000","last_unstale":"2024-04-26T20:56:45.280443+0000","last_undegraded":"2024-04-26T20:56:45.280443+0000","last_fullsized":"2024-04-26T20:56:45.280443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:31.742963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.465604+0000","last_change":"2024-04-26T20:56:39.206681+0000","last_active":"2024-04-26T20:56:45.465604+0000","last_peered":"2024-04-26T20:56:45.465604+0000","last_clean":"2024-04-26T20:56:45.465604+0000","last_became_active":"2024-04-26T20:56:39.206387+0000","last_became_peered":"2024-04-26T20:56:39.206387+0000","last_unstale":"2024-04-26T20:56:45.465604+0000","last_undegraded":"2024-04-26T20:56:45.465604+0000","last_fullsized":"2024-04-26T20:56:45.465604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:41:13.015392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788775+0000","last_change":"2024-04-26T20:56:44.272225+0000","last_active":"2024-04-26T20:56:45.788775+0000","last_peered":"2024-04-26T20:56:45.788775+0000","last_clean":"2024-04-26T20:56:45.788775+0000","last_became_active":"2024-04-26T20:56:44.268540+0000","last_became_peered":"2024-04-26T20:56:44.268540+0000","last_unstale":"2024-04-26T20:56:45.788775+0000","last_undegraded":"2024-04-26T20:56:45.788775+0000","last_fullsized":"2024-04-26T20:56:45.788775+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:20:27.945065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789725+0000","last_change":"2024-04-26T20:56:44.270140+0000","last_active":"2024-04-26T20:56:45.789725+0000","last_peered":"2024-04-26T20:56:45.789725+0000","last_clean":"2024-04-26T20:56:45.789725+0000","last_became_active":"2024-04-26T20:56:44.269804+0000","last_became_peered":"2024-04-26T20:56:44.269804+0000","last_unstale":"2024-04-26T20:56:45.789725+0000","last_undegraded":"2024-04-26T20:56:45.789725+0000","last_fullsized":"2024-04-26T20:56:45.789725+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:56:25.438566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788888+0000","last_change":"2024-04-26T20:56:40.242067+0000","last_active":"2024-04-26T20:56:45.788888+0000","last_peered":"2024-04-26T20:56:45.788888+0000","last_clean":"2024-04-26T20:56:45.788888+0000","last_became_active":"2024-04-26T20:56:40.241730+0000","last_became_peered":"2024-04-26T20:56:40.241730+0000","last_unstale":"2024-04-26T20:56:45.788888+0000","last_undegraded":"2024-04-26T20:56:45.788888+0000","last_fullsized":"2024-04-26T20:56:45.788888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:30:32.775766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786403+0000","last_change":"2024-04-26T20:56:39.224756+0000","last_active":"2024-04-26T20:56:45.786403+0000","last_peered":"2024-04-26T20:56:45.786403+0000","last_clean":"2024-04-26T20:56:45.786403+0000","last_became_active":"2024-04-26T20:56:39.224355+0000","last_became_peered":"2024-04-26T20:56:39.224355+0000","last_unstale":"2024-04-26T20:56:45.786403+0000","last_undegraded":"2024-04-26T20:56:45.786403+0000","last_fullsized":"2024-04-26T20:56:45.786403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:10:57.721766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.787013+0000","last_change":"2024-04-26T20:56:44.259652+0000","last_active":"2024-04-26T20:56:45.787013+0000","last_peered":"2024-04-26T20:56:45.787013+0000","last_clean":"2024-04-26T20:56:45.787013+0000","last_became_active":"2024-04-26T20:56:44.259253+0000","last_became_peered":"2024-04-26T20:56:44.259253+0000","last_unstale":"2024-04-26T20:56:45.787013+0000","last_undegraded":"2024-04-26T20:56:45.787013+0000","last_fullsized":"2024-04-26T20:56:45.787013+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:34:23.113242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788223+0000","last_change":"2024-04-26T20:56:40.252069+0000","last_active":"2024-04-26T20:56:45.788223+0000","last_peered":"2024-04-26T20:56:45.788223+0000","last_clean":"2024-04-26T20:56:45.788223+0000","last_became_active":"2024-04-26T20:56:40.251800+0000","last_became_peered":"2024-04-26T20:56:40.251800+0000","last_unstale":"2024-04-26T20:56:45.788223+0000","last_undegraded":"2024-04-26T20:56:45.788223+0000","last_fullsized":"2024-04-26T20:56:45.788223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:50:26.042106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789011+0000","last_change":"2024-04-26T20:56:39.222979+0000","last_active":"2024-04-26T20:56:45.789011+0000","last_peered":"2024-04-26T20:56:45.789011+0000","last_clean":"2024-04-26T20:56:45.789011+0000","last_became_active":"2024-04-26T20:56:39.222514+0000","last_became_peered":"2024-04-26T20:56:39.222514+0000","last_unstale":"2024-04-26T20:56:45.789011+0000","last_undegraded":"2024-04-26T20:56:45.789011+0000","last_fullsized":"2024-04-26T20:56:45.789011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:03:29.476982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786759+0000","last_change":"2024-04-26T20:56:39.229726+0000","last_active":"2024-04-26T20:56:45.786759+0000","last_peered":"2024-04-26T20:56:45.786759+0000","last_clean":"2024-04-26T20:56:45.786759+0000","last_became_active":"2024-04-26T20:56:39.228823+0000","last_became_peered":"2024-04-26T20:56:39.228823+0000","last_unstale":"2024-04-26T20:56:45.786759+0000","last_undegraded":"2024-04-26T20:56:45.786759+0000","last_fullsized":"2024-04-26T20:56:45.786759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:45.701878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788829+0000","last_change":"2024-04-26T20:56:40.237552+0000","last_active":"2024-04-26T20:56:45.788829+0000","last_peered":"2024-04-26T20:56:45.788829+0000","last_clean":"2024-04-26T20:56:45.788829+0000","last_became_active":"2024-04-26T20:56:40.234148+0000","last_became_peered":"2024-04-26T20:56:40.234148+0000","last_unstale":"2024-04-26T20:56:45.788829+0000","last_undegraded":"2024-04-26T20:56:45.788829+0000","last_fullsized":"2024-04-26T20:56:45.788829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:05:09.050038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789111+0000","last_change":"2024-04-26T20:56:44.268137+0000","last_active":"2024-04-26T20:56:45.789111+0000","last_peered":"2024-04-26T20:56:45.789111+0000","last_clean":"2024-04-26T20:56:45.789111+0000","last_became_active":"2024-04-26T20:56:44.267618+0000","last_became_peered":"2024-04-26T20:56:44.267618+0000","last_unstale":"2024-04-26T20:56:45.789111+0000","last_undegraded":"2024-04-26T20:56:45.789111+0000","last_fullsized":"2024-04-26T20:56:45.789111+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:47:30.881003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788498+0000","last_change":"2024-04-26T20:56:39.219724+0000","last_active":"2024-04-26T20:56:45.788498+0000","last_peered":"2024-04-26T20:56:45.788498+0000","last_clean":"2024-04-26T20:56:45.788498+0000","last_became_active":"2024-04-26T20:56:39.219485+0000","last_became_peered":"2024-04-26T20:56:39.219485+0000","last_unstale":"2024-04-26T20:56:45.788498+0000","last_undegraded":"2024-04-26T20:56:45.788498+0000","last_fullsized":"2024-04-26T20:56:45.788498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:11:12.183144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.465256+0000","last_change":"2024-04-26T20:56:40.242585+0000","last_active":"2024-04-26T20:56:45.465256+0000","last_peered":"2024-04-26T20:56:45.465256+0000","last_clean":"2024-04-26T20:56:45.465256+0000","last_became_active":"2024-04-26T20:56:40.242312+0000","last_became_peered":"2024-04-26T20:56:40.242312+0000","last_unstale":"2024-04-26T20:56:45.465256+0000","last_undegraded":"2024-04-26T20:56:45.465256+0000","last_fullsized":"2024-04-26T20:56:45.465256+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:58.516368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.281033+0000","last_change":"2024-04-26T20:56:44.278669+0000","last_active":"2024-04-26T20:56:45.281033+0000","last_peered":"2024-04-26T20:56:45.281033+0000","last_clean":"2024-04-26T20:56:45.281033+0000","last_became_active":"2024-04-26T20:56:44.278144+0000","last_became_peered":"2024-04-26T20:56:44.278144+0000","last_unstale":"2024-04-26T20:56:45.281033+0000","last_undegraded":"2024-04-26T20:56:45.281033+0000","last_fullsized":"2024-04-26T20:56:45.281033+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:35.050613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.279742+0000","last_change":"2024-04-26T20:56:40.239350+0000","last_active":"2024-04-26T20:56:45.279742+0000","last_peered":"2024-04-26T20:56:45.279742+0000","last_clean":"2024-04-26T20:56:45.279742+0000","last_became_active":"2024-04-26T20:56:40.238857+0000","last_became_peered":"2024-04-26T20:56:40.238857+0000","last_unstale":"2024-04-26T20:56:45.279742+0000","last_undegraded":"2024-04-26T20:56:45.279742+0000","last_fullsized":"2024-04-26T20:56:45.279742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:34.603528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.280519+0000","last_change":"2024-04-26T20:56:40.250462+0000","last_active":"2024-04-26T20:56:45.280519+0000","last_peered":"2024-04-26T20:56:45.280519+0000","last_clean":"2024-04-26T20:56:45.280519+0000","last_became_active":"2024-04-26T20:56:40.250111+0000","last_became_peered":"2024-04-26T20:56:40.250111+0000","last_unstale":"2024-04-26T20:56:45.280519+0000","last_undegraded":"2024-04-26T20:56:45.280519+0000","last_fullsized":"2024-04-26T20:56:45.280519+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:34.603528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786771+0000","last_change":"2024-04-26T20:56:40.243150+0000","last_active":"2024-04-26T20:56:45.786771+0000","last_peered":"2024-04-26T20:56:45.786771+0000","last_clean":"2024-04-26T20:56:45.786771+0000","last_became_active":"2024-04-26T20:56:40.242878+0000","last_became_peered":"2024-04-26T20:56:40.242878+0000","last_unstale":"2024-04-26T20:56:45.786771+0000","last_undegraded":"2024-04-26T20:56:45.786771+0000","last_fullsized":"2024-04-26T20:56:45.786771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:38.504120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788406+0000","last_change":"2024-04-26T20:56:40.246148+0000","last_active":"2024-04-26T20:56:45.788406+0000","last_peered":"2024-04-26T20:56:45.788406+0000","last_clean":"2024-04-26T20:56:45.788406+0000","last_became_active":"2024-04-26T20:56:40.241050+0000","last_became_peered":"2024-04-26T20:56:40.241050+0000","last_unstale":"2024-04-26T20:56:45.788406+0000","last_undegraded":"2024-04-26T20:56:45.788406+0000","last_fullsized":"2024-04-26T20:56:45.788406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:41:04.236810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.790634+0000","last_change":"2024-04-26T20:56:40.240515+0000","last_active":"2024-04-26T20:56:45.790634+0000","last_peered":"2024-04-26T20:56:45.790634+0000","last_clean":"2024-04-26T20:56:45.790634+0000","last_became_active":"2024-04-26T20:56:40.240214+0000","last_became_peered":"2024-04-26T20:56:40.240214+0000","last_unstale":"2024-04-26T20:56:45.790634+0000","last_undegraded":"2024-04-26T20:56:45.790634+0000","last_fullsized":"2024-04-26T20:56:45.790634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:07:27.066355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.790023+0000","last_change":"2024-04-26T20:56:40.237603+0000","last_active":"2024-04-26T20:56:45.790023+0000","last_peered":"2024-04-26T20:56:45.790023+0000","last_clean":"2024-04-26T20:56:45.790023+0000","last_became_active":"2024-04-26T20:56:40.237312+0000","last_became_peered":"2024-04-26T20:56:40.237312+0000","last_unstale":"2024-04-26T20:56:45.790023+0000","last_undegraded":"2024-04-26T20:56:45.790023+0000","last_fullsized":"2024-04-26T20:56:45.790023+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:31.010832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.280394+0000","last_change":"2024-04-26T20:56:40.224409+0000","last_active":"2024-04-26T20:56:45.280394+0000","last_peered":"2024-04-26T20:56:45.280394+0000","last_clean":"2024-04-26T20:56:45.280394+0000","last_became_active":"2024-04-26T20:56:40.223783+0000","last_became_peered":"2024-04-26T20:56:40.223783+0000","last_unstale":"2024-04-26T20:56:45.280394+0000","last_undegraded":"2024-04-26T20:56:45.280394+0000","last_fullsized":"2024-04-26T20:56:45.280394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:57:36.835651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789132+0000","last_change":"2024-04-26T20:56:40.247698+0000","last_active":"2024-04-26T20:56:45.789132+0000","last_peered":"2024-04-26T20:56:45.789132+0000","last_clean":"2024-04-26T20:56:45.789132+0000","last_became_active":"2024-04-26T20:56:40.247096+0000","last_became_peered":"2024-04-26T20:56:40.247096+0000","last_unstale":"2024-04-26T20:56:45.789132+0000","last_undegraded":"2024-04-26T20:56:45.789132+0000","last_fullsized":"2024-04-26T20:56:45.789132+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:20:40.427686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786399+0000","last_change":"2024-04-26T20:56:40.258240+0000","last_active":"2024-04-26T20:56:45.786399+0000","last_peered":"2024-04-26T20:56:45.786399+0000","last_clean":"2024-04-26T20:56:45.786399+0000","last_became_active":"2024-04-26T20:56:40.257922+0000","last_became_peered":"2024-04-26T20:56:40.257922+0000","last_unstale":"2024-04-26T20:56:45.786399+0000","last_undegraded":"2024-04-26T20:56:45.786399+0000","last_fullsized":"2024-04-26T20:56:45.786399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:43:17.208658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788602+0000","last_change":"2024-04-26T20:56:40.234841+0000","last_active":"2024-04-26T20:56:45.788602+0000","last_peered":"2024-04-26T20:56:45.788602+0000","last_clean":"2024-04-26T20:56:45.788602+0000","last_became_active":"2024-04-26T20:56:40.234455+0000","last_became_peered":"2024-04-26T20:56:40.234455+0000","last_unstale":"2024-04-26T20:56:45.788602+0000","last_undegraded":"2024-04-26T20:56:45.788602+0000","last_fullsized":"2024-04-26T20:56:45.788602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:03:10.550412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.465190+0000","last_change":"2024-04-26T20:56:40.236302+0000","last_active":"2024-04-26T20:56:45.465190+0000","last_peered":"2024-04-26T20:56:45.465190+0000","last_clean":"2024-04-26T20:56:45.465190+0000","last_became_active":"2024-04-26T20:56:40.236036+0000","last_became_peered":"2024-04-26T20:56:40.236036+0000","last_unstale":"2024-04-26T20:56:45.465190+0000","last_undegraded":"2024-04-26T20:56:45.465190+0000","last_fullsized":"2024-04-26T20:56:45.465190+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:41:13.644088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789474+0000","last_change":"2024-04-26T20:56:40.234738+0000","last_active":"2024-04-26T20:56:45.789474+0000","last_peered":"2024-04-26T20:56:45.789474+0000","last_clean":"2024-04-26T20:56:45.789474+0000","last_became_active":"2024-04-26T20:56:40.231985+0000","last_became_peered":"2024-04-26T20:56:40.231985+0000","last_unstale":"2024-04-26T20:56:45.789474+0000","last_undegraded":"2024-04-26T20:56:45.789474+0000","last_fullsized":"2024-04-26T20:56:45.789474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:57:53.450954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278740+0000","last_change":"2024-04-26T20:56:40.249286+0000","last_active":"2024-04-26T20:56:45.278740+0000","last_peered":"2024-04-26T20:56:45.278740+0000","last_clean":"2024-04-26T20:56:45.278740+0000","last_became_active":"2024-04-26T20:56:40.249012+0000","last_became_peered":"2024-04-26T20:56:40.249012+0000","last_unstale":"2024-04-26T20:56:45.278740+0000","last_undegraded":"2024-04-26T20:56:45.278740+0000","last_fullsized":"2024-04-26T20:56:45.278740+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:43:17.208658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.787152+0000","last_change":"2024-04-26T20:56:40.228646+0000","last_active":"2024-04-26T20:56:45.787152+0000","last_peered":"2024-04-26T20:56:45.787152+0000","last_clean":"2024-04-26T20:56:45.787152+0000","last_became_active":"2024-04-26T20:56:40.228368+0000","last_became_peered":"2024-04-26T20:56:40.228368+0000","last_unstale":"2024-04-26T20:56:45.787152+0000","last_undegraded":"2024-04-26T20:56:45.787152+0000","last_fullsized":"2024-04-26T20:56:45.787152+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:18:07.922849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.281190+0000","last_change":"2024-04-26T20:56:40.225730+0000","last_active":"2024-04-26T20:56:45.281190+0000","last_peered":"2024-04-26T20:56:45.281190+0000","last_clean":"2024-04-26T20:56:45.281190+0000","last_became_active":"2024-04-26T20:56:40.225431+0000","last_became_peered":"2024-04-26T20:56:40.225431+0000","last_unstale":"2024-04-26T20:56:45.281190+0000","last_undegraded":"2024-04-26T20:56:45.281190+0000","last_fullsized":"2024-04-26T20:56:45.281190+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:58.516368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.787104+0000","last_change":"2024-04-26T20:56:40.232831+0000","last_active":"2024-04-26T20:56:45.787104+0000","last_peered":"2024-04-26T20:56:45.787104+0000","last_clean":"2024-04-26T20:56:45.787104+0000","last_became_active":"2024-04-26T20:56:40.229977+0000","last_became_peered":"2024-04-26T20:56:40.229977+0000","last_unstale":"2024-04-26T20:56:45.787104+0000","last_undegraded":"2024-04-26T20:56:45.787104+0000","last_fullsized":"2024-04-26T20:56:45.787104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:56.469187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786286+0000","last_change":"2024-04-26T20:56:40.222579+0000","last_active":"2024-04-26T20:56:45.786286+0000","last_peered":"2024-04-26T20:56:45.786286+0000","last_clean":"2024-04-26T20:56:45.786286+0000","last_became_active":"2024-04-26T20:56:40.222116+0000","last_became_peered":"2024-04-26T20:56:40.222116+0000","last_unstale":"2024-04-26T20:56:45.786286+0000","last_undegraded":"2024-04-26T20:56:45.786286+0000","last_fullsized":"2024-04-26T20:56:45.786286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:50:26.042106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788401+0000","last_change":"2024-04-26T20:56:40.245721+0000","last_active":"2024-04-26T20:56:45.788401+0000","last_peered":"2024-04-26T20:56:45.788401+0000","last_clean":"2024-04-26T20:56:45.788401+0000","last_became_active":"2024-04-26T20:56:40.240783+0000","last_became_peered":"2024-04-26T20:56:40.240783+0000","last_unstale":"2024-04-26T20:56:45.788401+0000","last_undegraded":"2024-04-26T20:56:45.788401+0000","last_fullsized":"2024-04-26T20:56:45.788401+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:07:27.066355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788602+0000","last_change":"2024-04-26T20:56:40.239382+0000","last_active":"2024-04-26T20:56:45.788602+0000","last_peered":"2024-04-26T20:56:45.788602+0000","last_clean":"2024-04-26T20:56:45.788602+0000","last_became_active":"2024-04-26T20:56:40.239118+0000","last_became_peered":"2024-04-26T20:56:40.239118+0000","last_unstale":"2024-04-26T20:56:45.788602+0000","last_undegraded":"2024-04-26T20:56:45.788602+0000","last_fullsized":"2024-04-26T20:56:45.788602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:46.709617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788816+0000","last_change":"2024-04-26T20:56:40.236079+0000","last_active":"2024-04-26T20:56:45.788816+0000","last_peered":"2024-04-26T20:56:45.788816+0000","last_clean":"2024-04-26T20:56:45.788816+0000","last_became_active":"2024-04-26T20:56:40.235815+0000","last_became_peered":"2024-04-26T20:56:40.235815+0000","last_unstale":"2024-04-26T20:56:45.788816+0000","last_undegraded":"2024-04-26T20:56:45.788816+0000","last_fullsized":"2024-04-26T20:56:45.788816+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:55.117440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278710+0000","last_change":"2024-04-26T20:56:40.249327+0000","last_active":"2024-04-26T20:56:45.278710+0000","last_peered":"2024-04-26T20:56:45.278710+0000","last_clean":"2024-04-26T20:56:45.278710+0000","last_became_active":"2024-04-26T20:56:40.249079+0000","last_became_peered":"2024-04-26T20:56:40.249079+0000","last_unstale":"2024-04-26T20:56:45.278710+0000","last_undegraded":"2024-04-26T20:56:45.278710+0000","last_fullsized":"2024-04-26T20:56:45.278710+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:41:04.236810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278396+0000","last_change":"2024-04-26T20:56:40.233773+0000","last_active":"2024-04-26T20:56:45.278396+0000","last_peered":"2024-04-26T20:56:45.278396+0000","last_clean":"2024-04-26T20:56:45.278396+0000","last_became_active":"2024-04-26T20:56:40.233225+0000","last_became_peered":"2024-04-26T20:56:40.233225+0000","last_unstale":"2024-04-26T20:56:45.278396+0000","last_undegraded":"2024-04-26T20:56:45.278396+0000","last_fullsized":"2024-04-26T20:56:45.278396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:28:38.854680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278624+0000","last_change":"2024-04-26T20:56:40.227906+0000","last_active":"2024-04-26T20:56:45.278624+0000","last_peered":"2024-04-26T20:56:45.278624+0000","last_clean":"2024-04-26T20:56:45.278624+0000","last_became_active":"2024-04-26T20:56:40.227613+0000","last_became_peered":"2024-04-26T20:56:40.227613+0000","last_unstale":"2024-04-26T20:56:45.278624+0000","last_undegraded":"2024-04-26T20:56:45.278624+0000","last_fullsized":"2024-04-26T20:56:45.278624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:14:26.269699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.465600+0000","last_change":"2024-04-26T20:56:40.236919+0000","last_active":"2024-04-26T20:56:45.465600+0000","last_peered":"2024-04-26T20:56:45.465600+0000","last_clean":"2024-04-26T20:56:45.465600+0000","last_became_active":"2024-04-26T20:56:40.236544+0000","last_became_peered":"2024-04-26T20:56:40.236544+0000","last_unstale":"2024-04-26T20:56:45.465600+0000","last_undegraded":"2024-04-26T20:56:45.465600+0000","last_fullsized":"2024-04-26T20:56:45.465600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:57:36.835651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.787998+0000","last_change":"2024-04-26T20:56:40.251770+0000","last_active":"2024-04-26T20:56:45.787998+0000","last_peered":"2024-04-26T20:56:45.787998+0000","last_clean":"2024-04-26T20:56:45.787998+0000","last_became_active":"2024-04-26T20:56:40.251426+0000","last_became_peered":"2024-04-26T20:56:40.251426+0000","last_unstale":"2024-04-26T20:56:45.787998+0000","last_undegraded":"2024-04-26T20:56:45.787998+0000","last_fullsized":"2024-04-26T20:56:45.787998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:41:03.691519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278135+0000","last_change":"2024-04-26T20:56:40.227391+0000","last_active":"2024-04-26T20:56:45.278135+0000","last_peered":"2024-04-26T20:56:45.278135+0000","last_clean":"2024-04-26T20:56:45.278135+0000","last_became_active":"2024-04-26T20:56:40.226681+0000","last_became_peered":"2024-04-26T20:56:40.226681+0000","last_unstale":"2024-04-26T20:56:45.278135+0000","last_undegraded":"2024-04-26T20:56:45.278135+0000","last_fullsized":"2024-04-26T20:56:45.278135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:44:46.926225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.279941+0000","last_change":"2024-04-26T20:56:40.225067+0000","last_active":"2024-04-26T20:56:45.279941+0000","last_peered":"2024-04-26T20:56:45.279941+0000","last_clean":"2024-04-26T20:56:45.279941+0000","last_became_active":"2024-04-26T20:56:40.224764+0000","last_became_peered":"2024-04-26T20:56:40.224764+0000","last_unstale":"2024-04-26T20:56:45.279941+0000","last_undegraded":"2024-04-26T20:56:45.279941+0000","last_fullsized":"2024-04-26T20:56:45.279941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:10:58.729505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278406+0000","last_change":"2024-04-26T20:56:40.253423+0000","last_active":"2024-04-26T20:56:45.278406+0000","last_peered":"2024-04-26T20:56:45.278406+0000","last_clean":"2024-04-26T20:56:45.278406+0000","last_became_active":"2024-04-26T20:56:40.253195+0000","last_became_peered":"2024-04-26T20:56:40.253195+0000","last_unstale":"2024-04-26T20:56:45.278406+0000","last_undegraded":"2024-04-26T20:56:45.278406+0000","last_fullsized":"2024-04-26T20:56:45.278406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:24:10.292075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.280200+0000","last_change":"2024-04-26T20:56:40.225398+0000","last_active":"2024-04-26T20:56:45.280200+0000","last_peered":"2024-04-26T20:56:45.280200+0000","last_clean":"2024-04-26T20:56:45.280200+0000","last_became_active":"2024-04-26T20:56:40.225061+0000","last_became_peered":"2024-04-26T20:56:40.225061+0000","last_unstale":"2024-04-26T20:56:45.280200+0000","last_undegraded":"2024-04-26T20:56:45.280200+0000","last_fullsized":"2024-04-26T20:56:45.280200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:58.516368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789064+0000","last_change":"2024-04-26T20:56:40.248772+0000","last_active":"2024-04-26T20:56:45.789064+0000","last_peered":"2024-04-26T20:56:45.789064+0000","last_clean":"2024-04-26T20:56:45.789064+0000","last_became_active":"2024-04-26T20:56:40.240740+0000","last_became_peered":"2024-04-26T20:56:40.240740+0000","last_unstale":"2024-04-26T20:56:45.789064+0000","last_undegraded":"2024-04-26T20:56:45.789064+0000","last_fullsized":"2024-04-26T20:56:45.789064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:28:38.854680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789550+0000","last_change":"2024-04-26T20:56:40.251885+0000","last_active":"2024-04-26T20:56:45.789550+0000","last_peered":"2024-04-26T20:56:45.789550+0000","last_clean":"2024-04-26T20:56:45.789550+0000","last_became_active":"2024-04-26T20:56:40.251578+0000","last_became_peered":"2024-04-26T20:56:40.251578+0000","last_unstale":"2024-04-26T20:56:45.789550+0000","last_undegraded":"2024-04-26T20:56:45.789550+0000","last_fullsized":"2024-04-26T20:56:45.789550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:24:10.292075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278816+0000","last_change":"2024-04-26T20:56:40.235504+0000","last_active":"2024-04-26T20:56:45.278816+0000","last_peered":"2024-04-26T20:56:45.278816+0000","last_clean":"2024-04-26T20:56:45.278816+0000","last_became_active":"2024-04-26T20:56:40.234572+0000","last_became_peered":"2024-04-26T20:56:40.234572+0000","last_unstale":"2024-04-26T20:56:45.278816+0000","last_undegraded":"2024-04-26T20:56:45.278816+0000","last_fullsized":"2024-04-26T20:56:45.278816+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:29.705970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":110689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":110565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509449,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":884736,"data_stored":701025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":111147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":114266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":880640,"data_stored":701003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":110621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":115079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T20:56:59.421 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T20:56:59.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.597+0000 7fa19ae00640 1 Processor -- start 2024-04-26T20:56:59.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.597+0000 7fa19ae00640 1 -- start start 2024-04-26T20:56:59.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.597+0000 7fa19ae00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa1940d0e80 0x7fa19406c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:59.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.597+0000 7fa19ae00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1940d1310 con 0x7fa19406c840 2024-04-26T20:56:59.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.597+0000 7fa19ae00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1940cfde0 con 0x7fa1941468c0 2024-04-26T20:56:59.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.597+0000 7fa19ae00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fa19406ccb0 con 0x7fa1940d0e80 2024-04-26T20:56:59.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.597+0000 7fa198e00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fa19406c840 0x7fa19406f030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:43682/0 (socket says 172.21.15.138:43682) 2024-04-26T20:56:59.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.597+0000 7fa198e00640 1 -- 172.21.15.138:0/2133076711 learned_addr learned my addr 172.21.15.138:0/2133076711 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:56:59.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.597+0000 7fa193400640 1 --2- 172.21.15.138:0/2133076711 >> v2:172.21.15.143:3300/0 conn(0x7fa1940d0e80 0x7fa19406c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:59.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.597+0000 7fa192a00640 1 -- 172.21.15.138:0/2133076711 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 312650571 0 0) 0x7fa18c001120 con 0x7fa19406c840 2024-04-26T20:56:59.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.597+0000 7fa192a00640 1 -- 172.21.15.138:0/2133076711 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa178003530 con 0x7fa19406c840 2024-04-26T20:56:59.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.597+0000 7fa192a00640 1 -- 172.21.15.138:0/2133076711 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3655109826 0 0) 0x7fa1940cfde0 con 0x7fa1941468c0 2024-04-26T20:56:59.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.597+0000 7fa192a00640 1 -- 172.21.15.138:0/2133076711 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa18c001120 con 0x7fa1941468c0 2024-04-26T20:56:59.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.597+0000 7fa193400640 1 -- 172.21.15.138:0/2133076711 >> v1:172.21.15.143:6789/0 conn(0x7fa1941468c0 legacy=0x7fa1940cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:59.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.597+0000 7fa193400640 1 -- 172.21.15.138:0/2133076711 >> v1:172.21.15.138:6789/0 conn(0x7fa19406c840 legacy=0x7fa19406f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:59.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.597+0000 7fa193400640 1 -- 172.21.15.138:0/2133076711 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1940d00c0 con 0x7fa1940d0e80 2024-04-26T20:56:59.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.601+0000 7fa193400640 1 --2- 172.21.15.138:0/2133076711 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1940d0e80 0x7fa19406c300 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa1800097c0 tx=0x7fa18001c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee90a5aa7a99e9a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:59.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.601+0000 7fa192a00640 1 -- 172.21.15.138:0/2133076711 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1800a7070 con 0x7fa1940d0e80 2024-04-26T20:56:59.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.601+0000 7fa192a00640 1 -- 172.21.15.138:0/2133076711 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1800b0070 con 0x7fa1940d0e80 2024-04-26T20:56:59.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.601+0000 7fa192a00640 1 -- 172.21.15.138:0/2133076711 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1800ab890 con 0x7fa1940d0e80 2024-04-26T20:56:59.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.601+0000 7fa19ae00640 1 -- 172.21.15.138:0/2133076711 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1940d0e80 msgr2=0x7fa19406c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:59.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.601+0000 7fa19ae00640 1 --2- 172.21.15.138:0/2133076711 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1940d0e80 0x7fa19406c300 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa1800097c0 tx=0x7fa18001c470 comp rx=0 tx=0).stop 2024-04-26T20:56:59.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.601+0000 7fa19ae00640 1 -- 172.21.15.138:0/2133076711 shutdown_connections 2024-04-26T20:56:59.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.601+0000 7fa19ae00640 1 --2- 172.21.15.138:0/2133076711 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1940d0e80 0x7fa19406c300 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:59.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.601+0000 7fa19ae00640 1 -- 172.21.15.138:0/2133076711 >> 172.21.15.138:0/2133076711 conn(0x7fa1940d1c60 msgr2=0x7fa1940d2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:59.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.601+0000 7fa19ae00640 1 -- 172.21.15.138:0/2133076711 shutdown_connections 2024-04-26T20:56:59.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.601+0000 7fa19ae00640 1 -- 172.21.15.138:0/2133076711 wait complete. 2024-04-26T20:56:59.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.605+0000 7fa19ae00640 1 Processor -- start 2024-04-26T20:56:59.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.605+0000 7fa19ae00640 1 -- start start 2024-04-26T20:56:59.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.605+0000 7fa19ae00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa19406c840 0x7fa19415ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:59.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.605+0000 7fa19ae00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa1940d0e80 0x7fa1941537d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:59.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.605+0000 7fa19ae00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1941468c0 0x7fa19415a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:59.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.605+0000 7fa19ae00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fa1940cc400 con 0x7fa19406c840 2024-04-26T20:56:59.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.605+0000 7fa19ae00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fa1940ccf30 con 0x7fa1941468c0 2024-04-26T20:56:59.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.605+0000 7fa19ae00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fa1940cc580 con 0x7fa1940d0e80 2024-04-26T20:56:59.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.605+0000 7fa193e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa19406c840 0x7fa19415ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:59.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.605+0000 7fa193e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa19406c840 0x7fa19415ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:56808/0 (socket says 172.21.15.138:56808) 2024-04-26T20:56:59.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.605+0000 7fa193e00640 1 -- 172.21.15.138:0/2609323235 learned_addr learned my addr 172.21.15.138:0/2609323235 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:59.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.605+0000 7fa193400640 1 --2- 172.21.15.138:0/2609323235 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa1940d0e80 0x7fa1941537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:59.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.605+0000 7fa198e00640 1 --2- 172.21.15.138:0/2609323235 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1941468c0 0x7fa19415a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:59.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.605+0000 7fa193e00640 1 -- 172.21.15.138:0/2609323235 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa1940d0e80 msgr2=0x7fa1941537d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:59.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.605+0000 7fa193e00640 1 --2- 172.21.15.138:0/2609323235 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa1940d0e80 0x7fa1941537d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:59.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.605+0000 7fa193e00640 1 -- 172.21.15.138:0/2609323235 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1941468c0 msgr2=0x7fa19415a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:59.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.605+0000 7fa193e00640 1 --2- 172.21.15.138:0/2609323235 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1941468c0 0x7fa19415a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:59.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.605+0000 7fa193e00640 1 -- 172.21.15.138:0/2609323235 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa194153d10 con 0x7fa19406c840 2024-04-26T20:56:59.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.605+0000 7fa193e00640 1 --2- 172.21.15.138:0/2609323235 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa19406c840 0x7fa19415ca30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa18400c7d0 tx=0x7fa18400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:59.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.605+0000 7fa18be00640 1 -- 172.21.15.138:0/2609323235 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa184003b80 con 0x7fa19406c840 2024-04-26T20:56:59.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.605+0000 7fa18be00640 1 -- 172.21.15.138:0/2609323235 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa184003d40 con 0x7fa19406c840 2024-04-26T20:56:59.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.605+0000 7fa19ae00640 1 -- 172.21.15.138:0/2609323235 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa19415b990 con 0x7fa19406c840 2024-04-26T20:56:59.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.605+0000 7fa18be00640 1 -- 172.21.15.138:0/2609323235 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa18400aa90 con 0x7fa19406c840 2024-04-26T20:56:59.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.605+0000 7fa19ae00640 1 -- 172.21.15.138:0/2609323235 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa19415bf50 con 0x7fa19406c840 2024-04-26T20:56:59.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.609+0000 7fa19ae00640 1 -- 172.21.15.138:0/2609323235 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa194069510 con 0x7fa19406c840 2024-04-26T20:56:59.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.609+0000 7fa18be00640 1 -- 172.21.15.138:0/2609323235 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa18400ac30 con 0x7fa19406c840 2024-04-26T20:56:59.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.609+0000 7fa18be00640 1 --2- 172.21.15.138:0/2609323235 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fa174068380 0x7fa17406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:59.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.609+0000 7fa18be00640 1 -- 172.21.15.138:0/2609323235 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fa184086b00 con 0x7fa19406c840 2024-04-26T20:56:59.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.609+0000 7fa193400640 1 --2- 172.21.15.138:0/2609323235 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fa174068380 0x7fa17406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:59.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.609+0000 7fa193400640 1 --2- 172.21.15.138:0/2609323235 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fa174068380 0x7fa17406a840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa1800af000 tx=0x7fa1800a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:59.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.613+0000 7fa18be00640 1 -- 172.21.15.138:0/2609323235 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa1840566a0 con 0x7fa19406c840 2024-04-26T20:56:59.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.765+0000 7fa19ae00640 1 -- 172.21.15.138:0/2609323235 --> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa1940d2a90 con 0x7fa174068380 2024-04-26T20:56:59.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.777+0000 7fa18be00640 1 -- 172.21.15.138:0/2609323235 <== mgr.4100 v2:172.21.15.143:6832/4275464198 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332558 (secure 0 0 0) 0x7fa1940d2a90 con 0x7fa174068380 2024-04-26T20:56:59.784 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:56:59.786 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-04-26T20:56:59.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.781+0000 7fa19ae00640 1 -- 172.21.15.138:0/2609323235 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fa174068380 msgr2=0x7fa17406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:59.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.781+0000 7fa19ae00640 1 --2- 172.21.15.138:0/2609323235 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fa174068380 0x7fa17406a840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa1800af000 tx=0x7fa1800a7000 comp rx=0 tx=0).stop 2024-04-26T20:56:59.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.781+0000 7fa19ae00640 1 -- 172.21.15.138:0/2609323235 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa19406c840 msgr2=0x7fa19415ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:59.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.781+0000 7fa19ae00640 1 --2- 172.21.15.138:0/2609323235 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa19406c840 0x7fa19415ca30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa18400c7d0 tx=0x7fa18400cc90 comp rx=0 tx=0).stop 2024-04-26T20:56:59.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.781+0000 7fa19ae00640 1 -- 172.21.15.138:0/2609323235 shutdown_connections 2024-04-26T20:56:59.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.781+0000 7fa19ae00640 1 --2- 172.21.15.138:0/2609323235 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fa174068380 0x7fa17406a840 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:59.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.781+0000 7fa19ae00640 1 --2- 172.21.15.138:0/2609323235 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1941468c0 0x7fa19415a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:59.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.781+0000 7fa19ae00640 1 --2- 172.21.15.138:0/2609323235 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa1940d0e80 0x7fa1941537d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:59.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.781+0000 7fa19ae00640 1 --2- 172.21.15.138:0/2609323235 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa19406c840 0x7fa19415ca30 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:59.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.781+0000 7fa19ae00640 1 -- 172.21.15.138:0/2609323235 >> 172.21.15.138:0/2609323235 conn(0x7fa1940d1c60 msgr2=0x7fa194142c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:59.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.781+0000 7fa19ae00640 1 -- 172.21.15.138:0/2609323235 shutdown_connections 2024-04-26T20:56:59.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.781+0000 7fa19ae00640 1 -- 172.21.15.138:0/2609323235 wait complete. 2024-04-26T20:56:59.803 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-04-26T20:56:59.244096+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219600,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755120,"statfs":{"total":773094113280,"available":772869242880,"internally_reserved":0,"allocated":3514368,"data_stored":2074395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003491"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789875+0000","last_change":"2024-04-26T20:56:39.229878+0000","last_active":"2024-04-26T20:56:45.789875+0000","last_peered":"2024-04-26T20:56:45.789875+0000","last_clean":"2024-04-26T20:56:45.789875+0000","last_became_active":"2024-04-26T20:56:39.229574+0000","last_became_peered":"2024-04-26T20:56:39.229574+0000","last_unstale":"2024-04-26T20:56:45.789875+0000","last_undegraded":"2024-04-26T20:56:45.789875+0000","last_fullsized":"2024-04-26T20:56:45.789875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:24:19.832688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789650+0000","last_change":"2024-04-26T20:56:40.249312+0000","last_active":"2024-04-26T20:56:45.789650+0000","last_peered":"2024-04-26T20:56:45.789650+0000","last_clean":"2024-04-26T20:56:45.789650+0000","last_became_active":"2024-04-26T20:56:40.249079+0000","last_became_peered":"2024-04-26T20:56:40.249079+0000","last_unstale":"2024-04-26T20:56:45.789650+0000","last_undegraded":"2024-04-26T20:56:45.789650+0000","last_fullsized":"2024-04-26T20:56:45.789650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:11:49.558212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.280455+0000","last_change":"2024-04-26T20:56:44.274985+0000","last_active":"2024-04-26T20:56:45.280455+0000","last_peered":"2024-04-26T20:56:45.280455+0000","last_clean":"2024-04-26T20:56:45.280455+0000","last_became_active":"2024-04-26T20:56:44.274510+0000","last_became_peered":"2024-04-26T20:56:44.274510+0000","last_unstale":"2024-04-26T20:56:45.280455+0000","last_undegraded":"2024-04-26T20:56:45.280455+0000","last_fullsized":"2024-04-26T20:56:45.280455+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:59.157222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789762+0000","last_change":"2024-04-26T20:56:39.213876+0000","last_active":"2024-04-26T20:56:45.789762+0000","last_peered":"2024-04-26T20:56:45.789762+0000","last_clean":"2024-04-26T20:56:45.789762+0000","last_became_active":"2024-04-26T20:56:39.213454+0000","last_became_peered":"2024-04-26T20:56:39.213454+0000","last_unstale":"2024-04-26T20:56:45.789762+0000","last_undegraded":"2024-04-26T20:56:45.789762+0000","last_fullsized":"2024-04-26T20:56:45.789762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:40:48.839377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789322+0000","last_change":"2024-04-26T20:56:40.247462+0000","last_active":"2024-04-26T20:56:45.789322+0000","last_peered":"2024-04-26T20:56:45.789322+0000","last_clean":"2024-04-26T20:56:45.789322+0000","last_became_active":"2024-04-26T20:56:40.246735+0000","last_became_peered":"2024-04-26T20:56:40.246735+0000","last_unstale":"2024-04-26T20:56:45.789322+0000","last_undegraded":"2024-04-26T20:56:45.789322+0000","last_fullsized":"2024-04-26T20:56:45.789322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:29.705970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.279752+0000","last_change":"2024-04-26T20:56:44.275068+0000","last_active":"2024-04-26T20:56:45.279752+0000","last_peered":"2024-04-26T20:56:45.279752+0000","last_clean":"2024-04-26T20:56:45.279752+0000","last_became_active":"2024-04-26T20:56:44.273517+0000","last_became_peered":"2024-04-26T20:56:44.273517+0000","last_unstale":"2024-04-26T20:56:45.279752+0000","last_undegraded":"2024-04-26T20:56:45.279752+0000","last_fullsized":"2024-04-26T20:56:45.279752+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:41:08.276592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278739+0000","last_change":"2024-04-26T20:56:39.213779+0000","last_active":"2024-04-26T20:56:45.278739+0000","last_peered":"2024-04-26T20:56:45.278739+0000","last_clean":"2024-04-26T20:56:45.278739+0000","last_became_active":"2024-04-26T20:56:39.213433+0000","last_became_peered":"2024-04-26T20:56:39.213433+0000","last_unstale":"2024-04-26T20:56:45.278739+0000","last_undegraded":"2024-04-26T20:56:45.278739+0000","last_fullsized":"2024-04-26T20:56:45.278739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:33.595789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.465212+0000","last_change":"2024-04-26T20:56:40.240847+0000","last_active":"2024-04-26T20:56:45.465212+0000","last_peered":"2024-04-26T20:56:45.465212+0000","last_clean":"2024-04-26T20:56:45.465212+0000","last_became_active":"2024-04-26T20:56:40.240513+0000","last_became_peered":"2024-04-26T20:56:40.240513+0000","last_unstale":"2024-04-26T20:56:45.465212+0000","last_undegraded":"2024-04-26T20:56:45.465212+0000","last_fullsized":"2024-04-26T20:56:45.465212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:31.742963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.280055+0000","last_change":"2024-04-26T20:56:44.268256+0000","last_active":"2024-04-26T20:56:45.280055+0000","last_peered":"2024-04-26T20:56:45.280055+0000","last_clean":"2024-04-26T20:56:45.280055+0000","last_became_active":"2024-04-26T20:56:44.267885+0000","last_became_peered":"2024-04-26T20:56:44.267885+0000","last_unstale":"2024-04-26T20:56:45.280055+0000","last_undegraded":"2024-04-26T20:56:45.280055+0000","last_fullsized":"2024-04-26T20:56:45.280055+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:24:14.331856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278928+0000","last_change":"2024-04-26T20:56:39.210434+0000","last_active":"2024-04-26T20:56:45.278928+0000","last_peered":"2024-04-26T20:56:45.278928+0000","last_clean":"2024-04-26T20:56:45.278928+0000","last_became_active":"2024-04-26T20:56:39.210149+0000","last_became_peered":"2024-04-26T20:56:39.210149+0000","last_unstale":"2024-04-26T20:56:45.278928+0000","last_undegraded":"2024-04-26T20:56:45.278928+0000","last_fullsized":"2024-04-26T20:56:45.278928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:57.508629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786985+0000","last_change":"2024-04-26T20:56:40.232523+0000","last_active":"2024-04-26T20:56:45.786985+0000","last_peered":"2024-04-26T20:56:45.786985+0000","last_clean":"2024-04-26T20:56:45.786985+0000","last_became_active":"2024-04-26T20:56:40.230256+0000","last_became_peered":"2024-04-26T20:56:40.230256+0000","last_unstale":"2024-04-26T20:56:45.786985+0000","last_undegraded":"2024-04-26T20:56:45.786985+0000","last_fullsized":"2024-04-26T20:56:45.786985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:16:36.927553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.279880+0000","last_change":"2024-04-26T20:56:44.274965+0000","last_active":"2024-04-26T20:56:45.279880+0000","last_peered":"2024-04-26T20:56:45.279880+0000","last_clean":"2024-04-26T20:56:45.279880+0000","last_became_active":"2024-04-26T20:56:44.274623+0000","last_became_peered":"2024-04-26T20:56:44.274623+0000","last_unstale":"2024-04-26T20:56:45.279880+0000","last_undegraded":"2024-04-26T20:56:45.279880+0000","last_fullsized":"2024-04-26T20:56:45.279880+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:20:44.467468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786581+0000","last_change":"2024-04-26T20:56:40.245428+0000","last_active":"2024-04-26T20:56:45.786581+0000","last_peered":"2024-04-26T20:56:45.786581+0000","last_clean":"2024-04-26T20:56:45.786581+0000","last_became_active":"2024-04-26T20:56:40.245183+0000","last_became_peered":"2024-04-26T20:56:40.245183+0000","last_unstale":"2024-04-26T20:56:45.786581+0000","last_undegraded":"2024-04-26T20:56:45.786581+0000","last_fullsized":"2024-04-26T20:56:45.786581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:39:41.674507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786761+0000","last_change":"2024-04-26T20:56:39.230950+0000","last_active":"2024-04-26T20:56:45.786761+0000","last_peered":"2024-04-26T20:56:45.786761+0000","last_clean":"2024-04-26T20:56:45.786761+0000","last_became_active":"2024-04-26T20:56:39.229924+0000","last_became_peered":"2024-04-26T20:56:39.229924+0000","last_unstale":"2024-04-26T20:56:45.786761+0000","last_undegraded":"2024-04-26T20:56:45.786761+0000","last_fullsized":"2024-04-26T20:56:45.786761+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:57.508629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786803+0000","last_change":"2024-04-26T20:56:44.266930+0000","last_active":"2024-04-26T20:56:45.786803+0000","last_peered":"2024-04-26T20:56:45.786803+0000","last_clean":"2024-04-26T20:56:45.786803+0000","last_became_active":"2024-04-26T20:56:44.266307+0000","last_became_peered":"2024-04-26T20:56:44.266307+0000","last_unstale":"2024-04-26T20:56:45.786803+0000","last_undegraded":"2024-04-26T20:56:45.786803+0000","last_fullsized":"2024-04-26T20:56:45.786803+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:49:09.870181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.281399+0000","last_change":"2024-04-26T20:56:40.243411+0000","last_active":"2024-04-26T20:56:45.281399+0000","last_peered":"2024-04-26T20:56:45.281399+0000","last_clean":"2024-04-26T20:56:45.281399+0000","last_became_active":"2024-04-26T20:56:40.242875+0000","last_became_peered":"2024-04-26T20:56:40.242875+0000","last_unstale":"2024-04-26T20:56:45.281399+0000","last_undegraded":"2024-04-26T20:56:45.281399+0000","last_fullsized":"2024-04-26T20:56:45.281399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:10:58.729505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788799+0000","last_change":"2024-04-26T20:56:39.224859+0000","last_active":"2024-04-26T20:56:45.788799+0000","last_peered":"2024-04-26T20:56:45.788799+0000","last_clean":"2024-04-26T20:56:45.788799+0000","last_became_active":"2024-04-26T20:56:39.223684+0000","last_became_peered":"2024-04-26T20:56:39.223684+0000","last_unstale":"2024-04-26T20:56:45.788799+0000","last_undegraded":"2024-04-26T20:56:45.788799+0000","last_fullsized":"2024-04-26T20:56:45.788799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:41:13.015392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278377+0000","last_change":"2024-04-26T20:56:44.269716+0000","last_active":"2024-04-26T20:56:45.278377+0000","last_peered":"2024-04-26T20:56:45.278377+0000","last_clean":"2024-04-26T20:56:45.278377+0000","last_became_active":"2024-04-26T20:56:44.269363+0000","last_became_peered":"2024-04-26T20:56:44.269363+0000","last_unstale":"2024-04-26T20:56:45.278377+0000","last_undegraded":"2024-04-26T20:56:45.278377+0000","last_fullsized":"2024-04-26T20:56:45.278377+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:39:45.714289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789241+0000","last_change":"2024-04-26T20:56:40.233387+0000","last_active":"2024-04-26T20:56:45.789241+0000","last_peered":"2024-04-26T20:56:45.789241+0000","last_clean":"2024-04-26T20:56:45.789241+0000","last_became_active":"2024-04-26T20:56:40.233078+0000","last_became_peered":"2024-04-26T20:56:40.233078+0000","last_unstale":"2024-04-26T20:56:45.789241+0000","last_undegraded":"2024-04-26T20:56:45.789241+0000","last_fullsized":"2024-04-26T20:56:45.789241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:10:26.700437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788991+0000","last_change":"2024-04-26T20:56:39.211859+0000","last_active":"2024-04-26T20:56:45.788991+0000","last_peered":"2024-04-26T20:56:45.788991+0000","last_clean":"2024-04-26T20:56:45.788991+0000","last_became_active":"2024-04-26T20:56:39.211629+0000","last_became_peered":"2024-04-26T20:56:39.211629+0000","last_unstale":"2024-04-26T20:56:45.788991+0000","last_undegraded":"2024-04-26T20:56:45.788991+0000","last_fullsized":"2024-04-26T20:56:45.788991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:27.088665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.281180+0000","last_change":"2024-04-26T20:56:44.276902+0000","last_active":"2024-04-26T20:56:45.281180+0000","last_peered":"2024-04-26T20:56:45.281180+0000","last_clean":"2024-04-26T20:56:45.281180+0000","last_became_active":"2024-04-26T20:56:44.276509+0000","last_became_peered":"2024-04-26T20:56:44.276509+0000","last_unstale":"2024-04-26T20:56:45.281180+0000","last_undegraded":"2024-04-26T20:56:45.281180+0000","last_fullsized":"2024-04-26T20:56:45.281180+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:07:31.106137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786397+0000","last_change":"2024-04-26T20:56:40.229542+0000","last_active":"2024-04-26T20:56:45.786397+0000","last_peered":"2024-04-26T20:56:45.786397+0000","last_clean":"2024-04-26T20:56:45.786397+0000","last_became_active":"2024-04-26T20:56:40.227907+0000","last_became_peered":"2024-04-26T20:56:40.227907+0000","last_unstale":"2024-04-26T20:56:45.786397+0000","last_undegraded":"2024-04-26T20:56:45.786397+0000","last_fullsized":"2024-04-26T20:56:45.786397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:32:50.377638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.277959+0000","last_change":"2024-04-26T20:56:39.226639+0000","last_active":"2024-04-26T20:56:45.277959+0000","last_peered":"2024-04-26T20:56:45.277959+0000","last_clean":"2024-04-26T20:56:45.277959+0000","last_became_active":"2024-04-26T20:56:39.226040+0000","last_became_peered":"2024-04-26T20:56:39.226040+0000","last_unstale":"2024-04-26T20:56:45.277959+0000","last_undegraded":"2024-04-26T20:56:45.277959+0000","last_fullsized":"2024-04-26T20:56:45.277959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:11:12.183144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.280450+0000","last_change":"2024-04-26T20:56:44.264659+0000","last_active":"2024-04-26T20:56:45.280450+0000","last_peered":"2024-04-26T20:56:45.280450+0000","last_clean":"2024-04-26T20:56:45.280450+0000","last_became_active":"2024-04-26T20:56:44.264283+0000","last_became_peered":"2024-04-26T20:56:44.264283+0000","last_unstale":"2024-04-26T20:56:45.280450+0000","last_undegraded":"2024-04-26T20:56:45.280450+0000","last_fullsized":"2024-04-26T20:56:45.280450+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:50:30.081888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789823+0000","last_change":"2024-04-26T20:56:40.254246+0000","last_active":"2024-04-26T20:56:45.789823+0000","last_peered":"2024-04-26T20:56:45.789823+0000","last_clean":"2024-04-26T20:56:45.789823+0000","last_became_active":"2024-04-26T20:56:40.253998+0000","last_became_peered":"2024-04-26T20:56:40.253998+0000","last_unstale":"2024-04-26T20:56:45.789823+0000","last_undegraded":"2024-04-26T20:56:45.789823+0000","last_fullsized":"2024-04-26T20:56:45.789823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:15.179866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.787122+0000","last_change":"2024-04-26T20:56:39.228884+0000","last_active":"2024-04-26T20:56:45.787122+0000","last_peered":"2024-04-26T20:56:45.787122+0000","last_clean":"2024-04-26T20:56:45.787122+0000","last_became_active":"2024-04-26T20:56:39.228629+0000","last_became_peered":"2024-04-26T20:56:39.228629+0000","last_unstale":"2024-04-26T20:56:45.787122+0000","last_undegraded":"2024-04-26T20:56:45.787122+0000","last_fullsized":"2024-04-26T20:56:45.787122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:41:03.229071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.279855+0000","last_change":"2024-04-26T20:56:44.260583+0000","last_active":"2024-04-26T20:56:45.279855+0000","last_peered":"2024-04-26T20:56:45.279855+0000","last_clean":"2024-04-26T20:56:45.279855+0000","last_became_active":"2024-04-26T20:56:44.260203+0000","last_became_peered":"2024-04-26T20:56:44.260203+0000","last_unstale":"2024-04-26T20:56:45.279855+0000","last_undegraded":"2024-04-26T20:56:45.279855+0000","last_fullsized":"2024-04-26T20:56:45.279855+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:11:53.597994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789753+0000","last_change":"2024-04-26T20:56:40.248051+0000","last_active":"2024-04-26T20:56:45.789753+0000","last_peered":"2024-04-26T20:56:45.789753+0000","last_clean":"2024-04-26T20:56:45.789753+0000","last_became_active":"2024-04-26T20:56:40.247752+0000","last_became_peered":"2024-04-26T20:56:40.247752+0000","last_unstale":"2024-04-26T20:56:45.789753+0000","last_undegraded":"2024-04-26T20:56:45.789753+0000","last_fullsized":"2024-04-26T20:56:45.789753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:12:39.534861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.790043+0000","last_change":"2024-04-26T20:56:39.215006+0000","last_active":"2024-04-26T20:56:45.790043+0000","last_peered":"2024-04-26T20:56:45.790043+0000","last_clean":"2024-04-26T20:56:45.790043+0000","last_became_active":"2024-04-26T20:56:39.214568+0000","last_became_peered":"2024-04-26T20:56:39.214568+0000","last_unstale":"2024-04-26T20:56:45.790043+0000","last_undegraded":"2024-04-26T20:56:45.790043+0000","last_fullsized":"2024-04-26T20:56:45.790043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:48:30.348419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788054+0000","last_change":"2024-04-26T20:56:44.266191+0000","last_active":"2024-04-26T20:56:45.788054+0000","last_peered":"2024-04-26T20:56:45.788054+0000","last_clean":"2024-04-26T20:56:45.788054+0000","last_became_active":"2024-04-26T20:56:44.265828+0000","last_became_peered":"2024-04-26T20:56:44.265828+0000","last_unstale":"2024-04-26T20:56:45.788054+0000","last_undegraded":"2024-04-26T20:56:45.788054+0000","last_fullsized":"2024-04-26T20:56:45.788054+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:07.880235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.790688+0000","last_change":"2024-04-26T20:56:40.235429+0000","last_active":"2024-04-26T20:56:45.790688+0000","last_peered":"2024-04-26T20:56:45.790688+0000","last_clean":"2024-04-26T20:56:45.790688+0000","last_became_active":"2024-04-26T20:56:40.234817+0000","last_became_peered":"2024-04-26T20:56:40.234817+0000","last_unstale":"2024-04-26T20:56:45.790688+0000","last_undegraded":"2024-04-26T20:56:45.790688+0000","last_fullsized":"2024-04-26T20:56:45.790688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:41:03.691519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.787238+0000","last_change":"2024-04-26T20:56:39.224333+0000","last_active":"2024-04-26T20:56:45.787238+0000","last_peered":"2024-04-26T20:56:45.787238+0000","last_clean":"2024-04-26T20:56:45.787238+0000","last_became_active":"2024-04-26T20:56:39.220936+0000","last_became_peered":"2024-04-26T20:56:39.220936+0000","last_unstale":"2024-04-26T20:56:45.787238+0000","last_undegraded":"2024-04-26T20:56:45.787238+0000","last_fullsized":"2024-04-26T20:56:45.787238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:57:35.827912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788284+0000","last_change":"2024-04-26T20:56:44.257752+0000","last_active":"2024-04-26T20:56:45.788284+0000","last_peered":"2024-04-26T20:56:45.788284+0000","last_clean":"2024-04-26T20:56:45.788284+0000","last_became_active":"2024-04-26T20:56:44.257338+0000","last_became_peered":"2024-04-26T20:56:44.257338+0000","last_unstale":"2024-04-26T20:56:45.788284+0000","last_undegraded":"2024-04-26T20:56:45.788284+0000","last_fullsized":"2024-04-26T20:56:45.788284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:20:44.467468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.280289+0000","last_change":"2024-04-26T20:56:40.245228+0000","last_active":"2024-04-26T20:56:45.280289+0000","last_peered":"2024-04-26T20:56:45.280289+0000","last_clean":"2024-04-26T20:56:45.280289+0000","last_became_active":"2024-04-26T20:56:40.244846+0000","last_became_peered":"2024-04-26T20:56:40.244846+0000","last_unstale":"2024-04-26T20:56:45.280289+0000","last_undegraded":"2024-04-26T20:56:45.280289+0000","last_fullsized":"2024-04-26T20:56:45.280289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:41:13.644088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788644+0000","last_change":"2024-04-26T20:56:39.220939+0000","last_active":"2024-04-26T20:56:45.788644+0000","last_peered":"2024-04-26T20:56:45.788644+0000","last_clean":"2024-04-26T20:56:45.788644+0000","last_became_active":"2024-04-26T20:56:39.220267+0000","last_became_peered":"2024-04-26T20:56:39.220267+0000","last_unstale":"2024-04-26T20:56:45.788644+0000","last_undegraded":"2024-04-26T20:56:45.788644+0000","last_fullsized":"2024-04-26T20:56:45.788644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:14:14.002707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788475+0000","last_change":"2024-04-26T20:56:44.257761+0000","last_active":"2024-04-26T20:56:45.788475+0000","last_peered":"2024-04-26T20:56:45.788475+0000","last_clean":"2024-04-26T20:56:45.788475+0000","last_became_active":"2024-04-26T20:56:44.257291+0000","last_became_peered":"2024-04-26T20:56:44.257291+0000","last_unstale":"2024-04-26T20:56:45.788475+0000","last_undegraded":"2024-04-26T20:56:45.788475+0000","last_fullsized":"2024-04-26T20:56:45.788475+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:24:14.331856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278555+0000","last_change":"2024-04-26T20:56:40.224373+0000","last_active":"2024-04-26T20:56:45.278555+0000","last_peered":"2024-04-26T20:56:45.278555+0000","last_clean":"2024-04-26T20:56:45.278555+0000","last_became_active":"2024-04-26T20:56:40.224141+0000","last_became_peered":"2024-04-26T20:56:40.224141+0000","last_unstale":"2024-04-26T20:56:45.278555+0000","last_undegraded":"2024-04-26T20:56:45.278555+0000","last_fullsized":"2024-04-26T20:56:45.278555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:50:26.042106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786967+0000","last_change":"2024-04-26T20:56:39.225627+0000","last_active":"2024-04-26T20:56:45.786967+0000","last_peered":"2024-04-26T20:56:45.786967+0000","last_clean":"2024-04-26T20:56:45.786967+0000","last_became_active":"2024-04-26T20:56:39.224819+0000","last_became_peered":"2024-04-26T20:56:39.224819+0000","last_unstale":"2024-04-26T20:56:45.786967+0000","last_undegraded":"2024-04-26T20:56:45.786967+0000","last_fullsized":"2024-04-26T20:56:45.786967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:54.109701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.790603+0000","last_change":"2024-04-26T20:56:44.268007+0000","last_active":"2024-04-26T20:56:45.790603+0000","last_peered":"2024-04-26T20:56:45.790603+0000","last_clean":"2024-04-26T20:56:45.790603+0000","last_became_active":"2024-04-26T20:56:44.267593+0000","last_became_peered":"2024-04-26T20:56:44.267593+0000","last_unstale":"2024-04-26T20:56:45.790603+0000","last_undegraded":"2024-04-26T20:56:45.790603+0000","last_fullsized":"2024-04-26T20:56:45.790603+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:43:21.248440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788110+0000","last_change":"2024-04-26T20:56:40.232686+0000","last_active":"2024-04-26T20:56:45.788110+0000","last_peered":"2024-04-26T20:56:45.788110+0000","last_clean":"2024-04-26T20:56:45.788110+0000","last_became_active":"2024-04-26T20:56:40.232406+0000","last_became_peered":"2024-04-26T20:56:40.232406+0000","last_unstale":"2024-04-26T20:56:45.788110+0000","last_undegraded":"2024-04-26T20:56:45.788110+0000","last_fullsized":"2024-04-26T20:56:45.788110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:44:46.926225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.280640+0000","last_change":"2024-04-26T20:56:39.224479+0000","last_active":"2024-04-26T20:56:45.280640+0000","last_peered":"2024-04-26T20:56:45.280640+0000","last_clean":"2024-04-26T20:56:45.280640+0000","last_became_active":"2024-04-26T20:56:39.224106+0000","last_became_peered":"2024-04-26T20:56:39.224106+0000","last_unstale":"2024-04-26T20:56:45.280640+0000","last_undegraded":"2024-04-26T20:56:45.280640+0000","last_fullsized":"2024-04-26T20:56:45.280640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:31:59.475595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.790288+0000","last_change":"2024-04-26T20:56:44.264512+0000","last_active":"2024-04-26T20:56:45.790288+0000","last_peered":"2024-04-26T20:56:45.790288+0000","last_clean":"2024-04-26T20:56:45.790288+0000","last_became_active":"2024-04-26T20:56:44.264211+0000","last_became_peered":"2024-04-26T20:56:44.264211+0000","last_unstale":"2024-04-26T20:56:45.790288+0000","last_undegraded":"2024-04-26T20:56:45.790288+0000","last_fullsized":"2024-04-26T20:56:45.790288+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:33.745752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788142+0000","last_change":"2024-04-26T20:56:40.248343+0000","last_active":"2024-04-26T20:56:45.788142+0000","last_peered":"2024-04-26T20:56:45.788142+0000","last_clean":"2024-04-26T20:56:45.788142+0000","last_became_active":"2024-04-26T20:56:40.248044+0000","last_became_peered":"2024-04-26T20:56:40.248044+0000","last_unstale":"2024-04-26T20:56:45.788142+0000","last_undegraded":"2024-04-26T20:56:45.788142+0000","last_fullsized":"2024-04-26T20:56:45.788142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:14:12.321345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786512+0000","last_change":"2024-04-26T20:56:39.224746+0000","last_active":"2024-04-26T20:56:45.786512+0000","last_peered":"2024-04-26T20:56:45.786512+0000","last_clean":"2024-04-26T20:56:45.786512+0000","last_became_active":"2024-04-26T20:56:39.224396+0000","last_became_peered":"2024-04-26T20:56:39.224396+0000","last_unstale":"2024-04-26T20:56:45.786512+0000","last_undegraded":"2024-04-26T20:56:45.786512+0000","last_fullsized":"2024-04-26T20:56:45.786512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:33.595789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789520+0000","last_change":"2024-04-26T20:56:44.263211+0000","last_active":"2024-04-26T20:56:45.789520+0000","last_peered":"2024-04-26T20:56:45.789520+0000","last_clean":"2024-04-26T20:56:45.789520+0000","last_became_active":"2024-04-26T20:56:44.262730+0000","last_became_peered":"2024-04-26T20:56:44.262730+0000","last_unstale":"2024-04-26T20:56:45.789520+0000","last_undegraded":"2024-04-26T20:56:45.789520+0000","last_fullsized":"2024-04-26T20:56:45.789520+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:00.508968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789184+0000","last_change":"2024-04-26T20:56:40.231800+0000","last_active":"2024-04-26T20:56:45.789184+0000","last_peered":"2024-04-26T20:56:45.789184+0000","last_clean":"2024-04-26T20:56:45.789184+0000","last_became_active":"2024-04-26T20:56:40.231372+0000","last_became_peered":"2024-04-26T20:56:40.231372+0000","last_unstale":"2024-04-26T20:56:45.789184+0000","last_undegraded":"2024-04-26T20:56:45.789184+0000","last_fullsized":"2024-04-26T20:56:45.789184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:25:09.320511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786818+0000","last_change":"2024-04-26T20:56:39.219637+0000","last_active":"2024-04-26T20:56:45.786818+0000","last_peered":"2024-04-26T20:56:45.786818+0000","last_clean":"2024-04-26T20:56:45.786818+0000","last_became_active":"2024-04-26T20:56:39.219390+0000","last_became_peered":"2024-04-26T20:56:39.219390+0000","last_unstale":"2024-04-26T20:56:45.786818+0000","last_undegraded":"2024-04-26T20:56:45.786818+0000","last_fullsized":"2024-04-26T20:56:45.786818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:41:12.636349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":178,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.464868+0000","last_change":"2024-04-26T20:56:29.347462+0000","last_active":"2024-04-26T20:56:45.464868+0000","last_peered":"2024-04-26T20:56:45.464868+0000","last_clean":"2024-04-26T20:56:45.464868+0000","last_became_active":"2024-04-26T20:56:29.346224+0000","last_became_peered":"2024-04-26T20:56:29.346224+0000","last_unstale":"2024-04-26T20:56:45.464868+0000","last_undegraded":"2024-04-26T20:56:45.464868+0000","last_fullsized":"2024-04-26T20:56:45.464868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:28.079105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:28.079105+0000","last_clean_scrub_stamp":"2024-04-26T20:56:28.079105+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:13.693525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.787244+0000","last_change":"2024-04-26T20:56:44.256761+0000","last_active":"2024-04-26T20:56:45.787244+0000","last_peered":"2024-04-26T20:56:45.787244+0000","last_clean":"2024-04-26T20:56:45.787244+0000","last_became_active":"2024-04-26T20:56:44.256253+0000","last_became_peered":"2024-04-26T20:56:44.256253+0000","last_unstale":"2024-04-26T20:56:45.787244+0000","last_undegraded":"2024-04-26T20:56:45.787244+0000","last_fullsized":"2024-04-26T20:56:45.787244+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:34.373869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.787072+0000","last_change":"2024-04-26T20:56:40.245995+0000","last_active":"2024-04-26T20:56:45.787072+0000","last_peered":"2024-04-26T20:56:45.787072+0000","last_clean":"2024-04-26T20:56:45.787072+0000","last_became_active":"2024-04-26T20:56:40.245694+0000","last_became_peered":"2024-04-26T20:56:40.245694+0000","last_unstale":"2024-04-26T20:56:45.787072+0000","last_undegraded":"2024-04-26T20:56:45.787072+0000","last_fullsized":"2024-04-26T20:56:45.787072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:52.333752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.790781+0000","last_change":"2024-04-26T20:56:39.224388+0000","last_active":"2024-04-26T20:56:45.790781+0000","last_peered":"2024-04-26T20:56:45.790781+0000","last_clean":"2024-04-26T20:56:45.790781+0000","last_became_active":"2024-04-26T20:56:39.224125+0000","last_became_peered":"2024-04-26T20:56:39.224125+0000","last_unstale":"2024-04-26T20:56:45.790781+0000","last_undegraded":"2024-04-26T20:56:45.790781+0000","last_fullsized":"2024-04-26T20:56:45.790781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:40:48.839377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.279794+0000","last_change":"2024-04-26T20:56:44.266270+0000","last_active":"2024-04-26T20:56:45.279794+0000","last_peered":"2024-04-26T20:56:45.279794+0000","last_clean":"2024-04-26T20:56:45.279794+0000","last_became_active":"2024-04-26T20:56:44.265879+0000","last_became_peered":"2024-04-26T20:56:44.265879+0000","last_unstale":"2024-04-26T20:56:45.279794+0000","last_undegraded":"2024-04-26T20:56:45.279794+0000","last_fullsized":"2024-04-26T20:56:45.279794+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:28:42.894461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278895+0000","last_change":"2024-04-26T20:56:40.232540+0000","last_active":"2024-04-26T20:56:45.278895+0000","last_peered":"2024-04-26T20:56:45.278895+0000","last_clean":"2024-04-26T20:56:45.278895+0000","last_became_active":"2024-04-26T20:56:40.231008+0000","last_became_peered":"2024-04-26T20:56:40.231008+0000","last_unstale":"2024-04-26T20:56:45.278895+0000","last_undegraded":"2024-04-26T20:56:45.278895+0000","last_fullsized":"2024-04-26T20:56:45.278895+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:20:40.427686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789243+0000","last_change":"2024-04-26T20:56:39.222383+0000","last_active":"2024-04-26T20:56:45.789243+0000","last_peered":"2024-04-26T20:56:45.789243+0000","last_clean":"2024-04-26T20:56:45.789243+0000","last_became_active":"2024-04-26T20:56:39.222014+0000","last_became_peered":"2024-04-26T20:56:39.222014+0000","last_unstale":"2024-04-26T20:56:45.789243+0000","last_undegraded":"2024-04-26T20:56:45.789243+0000","last_fullsized":"2024-04-26T20:56:45.789243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:03:29.476982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788357+0000","last_change":"2024-04-26T20:56:44.264780+0000","last_active":"2024-04-26T20:56:45.788357+0000","last_peered":"2024-04-26T20:56:45.788357+0000","last_clean":"2024-04-26T20:56:45.788357+0000","last_became_active":"2024-04-26T20:56:44.260516+0000","last_became_peered":"2024-04-26T20:56:44.260516+0000","last_unstale":"2024-04-26T20:56:45.788357+0000","last_undegraded":"2024-04-26T20:56:45.788357+0000","last_fullsized":"2024-04-26T20:56:45.788357+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:56.373533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278843+0000","last_change":"2024-04-26T20:56:40.245302+0000","last_active":"2024-04-26T20:56:45.278843+0000","last_peered":"2024-04-26T20:56:45.278843+0000","last_clean":"2024-04-26T20:56:45.278843+0000","last_became_active":"2024-04-26T20:56:40.245020+0000","last_became_peered":"2024-04-26T20:56:40.245020+0000","last_unstale":"2024-04-26T20:56:45.278843+0000","last_undegraded":"2024-04-26T20:56:45.278843+0000","last_fullsized":"2024-04-26T20:56:45.278843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:32:50.377638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789962+0000","last_change":"2024-04-26T20:56:39.212876+0000","last_active":"2024-04-26T20:56:45.789962+0000","last_peered":"2024-04-26T20:56:45.789962+0000","last_clean":"2024-04-26T20:56:45.789962+0000","last_became_active":"2024-04-26T20:56:39.210505+0000","last_became_peered":"2024-04-26T20:56:39.210505+0000","last_unstale":"2024-04-26T20:56:45.789962+0000","last_undegraded":"2024-04-26T20:56:45.789962+0000","last_fullsized":"2024-04-26T20:56:45.789962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:29:37.126090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786321+0000","last_change":"2024-04-26T20:56:44.269758+0000","last_active":"2024-04-26T20:56:45.786321+0000","last_peered":"2024-04-26T20:56:45.786321+0000","last_clean":"2024-04-26T20:56:45.786321+0000","last_became_active":"2024-04-26T20:56:44.267320+0000","last_became_peered":"2024-04-26T20:56:44.267320+0000","last_unstale":"2024-04-26T20:56:45.786321+0000","last_undegraded":"2024-04-26T20:56:45.786321+0000","last_fullsized":"2024-04-26T20:56:45.786321+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:28.426749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.280509+0000","last_change":"2024-04-26T20:56:40.224152+0000","last_active":"2024-04-26T20:56:45.280509+0000","last_peered":"2024-04-26T20:56:45.280509+0000","last_clean":"2024-04-26T20:56:45.280509+0000","last_became_active":"2024-04-26T20:56:40.223000+0000","last_became_peered":"2024-04-26T20:56:40.223000+0000","last_unstale":"2024-04-26T20:56:45.280509+0000","last_undegraded":"2024-04-26T20:56:45.280509+0000","last_fullsized":"2024-04-26T20:56:45.280509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:46.709617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278951+0000","last_change":"2024-04-26T20:56:39.210612+0000","last_active":"2024-04-26T20:56:45.278951+0000","last_peered":"2024-04-26T20:56:45.278951+0000","last_clean":"2024-04-26T20:56:45.278951+0000","last_became_active":"2024-04-26T20:56:39.210308+0000","last_became_peered":"2024-04-26T20:56:39.210308+0000","last_unstale":"2024-04-26T20:56:45.278951+0000","last_undegraded":"2024-04-26T20:56:45.278951+0000","last_fullsized":"2024-04-26T20:56:45.278951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:10:57.721766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.465006+0000","last_change":"2024-04-26T20:56:44.255699+0000","last_active":"2024-04-26T20:56:45.465006+0000","last_peered":"2024-04-26T20:56:45.465006+0000","last_clean":"2024-04-26T20:56:45.465006+0000","last_became_active":"2024-04-26T20:56:44.255377+0000","last_became_peered":"2024-04-26T20:56:44.255377+0000","last_unstale":"2024-04-26T20:56:45.465006+0000","last_undegraded":"2024-04-26T20:56:45.465006+0000","last_fullsized":"2024-04-26T20:56:45.465006+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:35.050613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786401+0000","last_change":"2024-04-26T20:56:40.223324+0000","last_active":"2024-04-26T20:56:45.786401+0000","last_peered":"2024-04-26T20:56:45.786401+0000","last_clean":"2024-04-26T20:56:45.786401+0000","last_became_active":"2024-04-26T20:56:40.223003+0000","last_became_peered":"2024-04-26T20:56:40.223003+0000","last_unstale":"2024-04-26T20:56:45.786401+0000","last_undegraded":"2024-04-26T20:56:45.786401+0000","last_fullsized":"2024-04-26T20:56:45.786401+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:14:26.269699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789347+0000","last_change":"2024-04-26T20:56:39.217490+0000","last_active":"2024-04-26T20:56:45.789347+0000","last_peered":"2024-04-26T20:56:45.789347+0000","last_clean":"2024-04-26T20:56:45.789347+0000","last_became_active":"2024-04-26T20:56:39.217064+0000","last_became_peered":"2024-04-26T20:56:39.217064+0000","last_unstale":"2024-04-26T20:56:45.789347+0000","last_undegraded":"2024-04-26T20:56:45.789347+0000","last_fullsized":"2024-04-26T20:56:45.789347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:58:35.548325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789701+0000","last_change":"2024-04-26T20:56:44.262792+0000","last_active":"2024-04-26T20:56:45.789701+0000","last_peered":"2024-04-26T20:56:45.789701+0000","last_clean":"2024-04-26T20:56:45.789701+0000","last_became_active":"2024-04-26T20:56:44.260202+0000","last_became_peered":"2024-04-26T20:56:44.260202+0000","last_unstale":"2024-04-26T20:56:45.789701+0000","last_undegraded":"2024-04-26T20:56:45.789701+0000","last_fullsized":"2024-04-26T20:56:45.789701+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:54:15.702050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.464817+0000","last_change":"2024-04-26T20:56:40.259427+0000","last_active":"2024-04-26T20:56:45.464817+0000","last_peered":"2024-04-26T20:56:45.464817+0000","last_clean":"2024-04-26T20:56:45.464817+0000","last_became_active":"2024-04-26T20:56:40.258928+0000","last_became_peered":"2024-04-26T20:56:40.258928+0000","last_unstale":"2024-04-26T20:56:45.464817+0000","last_undegraded":"2024-04-26T20:56:45.464817+0000","last_fullsized":"2024-04-26T20:56:45.464817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:10:58.729505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278176+0000","last_change":"2024-04-26T20:56:39.223722+0000","last_active":"2024-04-26T20:56:45.278176+0000","last_peered":"2024-04-26T20:56:45.278176+0000","last_clean":"2024-04-26T20:56:45.278176+0000","last_became_active":"2024-04-26T20:56:39.223385+0000","last_became_peered":"2024-04-26T20:56:39.223385+0000","last_unstale":"2024-04-26T20:56:45.278176+0000","last_undegraded":"2024-04-26T20:56:45.278176+0000","last_fullsized":"2024-04-26T20:56:45.278176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:41:13.015392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789491+0000","last_change":"2024-04-26T20:56:44.259808+0000","last_active":"2024-04-26T20:56:45.789491+0000","last_peered":"2024-04-26T20:56:45.789491+0000","last_clean":"2024-04-26T20:56:45.789491+0000","last_became_active":"2024-04-26T20:56:44.259170+0000","last_became_peered":"2024-04-26T20:56:44.259170+0000","last_unstale":"2024-04-26T20:56:45.789491+0000","last_undegraded":"2024-04-26T20:56:45.789491+0000","last_fullsized":"2024-04-26T20:56:45.789491+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:18:11.962630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786651+0000","last_change":"2024-04-26T20:56:40.233004+0000","last_active":"2024-04-26T20:56:45.786651+0000","last_peered":"2024-04-26T20:56:45.786651+0000","last_clean":"2024-04-26T20:56:45.786651+0000","last_became_active":"2024-04-26T20:56:40.232735+0000","last_became_peered":"2024-04-26T20:56:40.232735+0000","last_unstale":"2024-04-26T20:56:45.786651+0000","last_undegraded":"2024-04-26T20:56:45.786651+0000","last_fullsized":"2024-04-26T20:56:45.786651+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:32:02.092294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786874+0000","last_change":"2024-04-26T20:56:39.224061+0000","last_active":"2024-04-26T20:56:45.786874+0000","last_peered":"2024-04-26T20:56:45.786874+0000","last_clean":"2024-04-26T20:56:45.786874+0000","last_became_active":"2024-04-26T20:56:39.223790+0000","last_became_peered":"2024-04-26T20:56:39.223790+0000","last_unstale":"2024-04-26T20:56:45.786874+0000","last_undegraded":"2024-04-26T20:56:45.786874+0000","last_fullsized":"2024-04-26T20:56:45.786874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:14:11.313606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.790509+0000","last_change":"2024-04-26T20:56:44.269183+0000","last_active":"2024-04-26T20:56:45.790509+0000","last_peered":"2024-04-26T20:56:45.790509+0000","last_clean":"2024-04-26T20:56:45.790509+0000","last_became_active":"2024-04-26T20:56:44.266986+0000","last_became_peered":"2024-04-26T20:56:44.266986+0000","last_unstale":"2024-04-26T20:56:45.790509+0000","last_undegraded":"2024-04-26T20:56:45.790509+0000","last_fullsized":"2024-04-26T20:56:45.790509+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:50:30.081888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788704+0000","last_change":"2024-04-26T20:56:40.245751+0000","last_active":"2024-04-26T20:56:45.788704+0000","last_peered":"2024-04-26T20:56:45.788704+0000","last_clean":"2024-04-26T20:56:45.788704+0000","last_became_active":"2024-04-26T20:56:40.245369+0000","last_became_peered":"2024-04-26T20:56:40.245369+0000","last_unstale":"2024-04-26T20:56:45.788704+0000","last_undegraded":"2024-04-26T20:56:45.788704+0000","last_fullsized":"2024-04-26T20:56:45.788704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:59.357459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.281500+0000","last_change":"2024-04-26T20:56:39.225785+0000","last_active":"2024-04-26T20:56:45.281500+0000","last_peered":"2024-04-26T20:56:45.281500+0000","last_clean":"2024-04-26T20:56:45.281500+0000","last_became_active":"2024-04-26T20:56:39.225542+0000","last_became_peered":"2024-04-26T20:56:39.225542+0000","last_unstale":"2024-04-26T20:56:45.281500+0000","last_undegraded":"2024-04-26T20:56:45.281500+0000","last_fullsized":"2024-04-26T20:56:45.281500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:03:29.476982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.787074+0000","last_change":"2024-04-26T20:56:44.253303+0000","last_active":"2024-04-26T20:56:45.787074+0000","last_peered":"2024-04-26T20:56:45.787074+0000","last_clean":"2024-04-26T20:56:45.787074+0000","last_became_active":"2024-04-26T20:56:44.252962+0000","last_became_peered":"2024-04-26T20:56:44.252962+0000","last_unstale":"2024-04-26T20:56:45.787074+0000","last_undegraded":"2024-04-26T20:56:45.787074+0000","last_fullsized":"2024-04-26T20:56:45.787074+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:51:16.305273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278531+0000","last_change":"2024-04-26T20:56:40.242121+0000","last_active":"2024-04-26T20:56:45.278531+0000","last_peered":"2024-04-26T20:56:45.278531+0000","last_clean":"2024-04-26T20:56:45.278531+0000","last_became_active":"2024-04-26T20:56:40.241861+0000","last_became_peered":"2024-04-26T20:56:40.241861+0000","last_unstale":"2024-04-26T20:56:45.278531+0000","last_undegraded":"2024-04-26T20:56:45.278531+0000","last_fullsized":"2024-04-26T20:56:45.278531+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:11:49.558212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'10","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:55.394552+0000","last_change":"2024-04-26T20:56:39.215684+0000","last_active":"2024-04-26T20:56:55.394552+0000","last_peered":"2024-04-26T20:56:55.394552+0000","last_clean":"2024-04-26T20:56:55.394552+0000","last_became_active":"2024-04-26T20:56:39.215414+0000","last_became_peered":"2024-04-26T20:56:39.215414+0000","last_unstale":"2024-04-26T20:56:55.394552+0000","last_undegraded":"2024-04-26T20:56:55.394552+0000","last_fullsized":"2024-04-26T20:56:55.394552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:19:34.743821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789857+0000","last_change":"2024-04-26T20:56:44.268455+0000","last_active":"2024-04-26T20:56:45.789857+0000","last_peered":"2024-04-26T20:56:45.789857+0000","last_clean":"2024-04-26T20:56:45.789857+0000","last_became_active":"2024-04-26T20:56:44.267050+0000","last_became_peered":"2024-04-26T20:56:44.267050+0000","last_unstale":"2024-04-26T20:56:45.789857+0000","last_undegraded":"2024-04-26T20:56:45.789857+0000","last_fullsized":"2024-04-26T20:56:45.789857+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:53:37.753988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786653+0000","last_change":"2024-04-26T20:56:40.234863+0000","last_active":"2024-04-26T20:56:45.786653+0000","last_peered":"2024-04-26T20:56:45.786653+0000","last_clean":"2024-04-26T20:56:45.786653+0000","last_became_active":"2024-04-26T20:56:40.233643+0000","last_became_peered":"2024-04-26T20:56:40.233643+0000","last_unstale":"2024-04-26T20:56:45.786653+0000","last_undegraded":"2024-04-26T20:56:45.786653+0000","last_fullsized":"2024-04-26T20:56:45.786653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:33:12.507172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.281206+0000","last_change":"2024-04-26T20:56:39.226868+0000","last_active":"2024-04-26T20:56:45.281206+0000","last_peered":"2024-04-26T20:56:45.281206+0000","last_clean":"2024-04-26T20:56:45.281206+0000","last_became_active":"2024-04-26T20:56:39.224374+0000","last_became_peered":"2024-04-26T20:56:39.224374+0000","last_unstale":"2024-04-26T20:56:45.281206+0000","last_undegraded":"2024-04-26T20:56:45.281206+0000","last_fullsized":"2024-04-26T20:56:45.281206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:14:14.002707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.280149+0000","last_change":"2024-04-26T20:56:44.267204+0000","last_active":"2024-04-26T20:56:45.280149+0000","last_peered":"2024-04-26T20:56:45.280149+0000","last_clean":"2024-04-26T20:56:45.280149+0000","last_became_active":"2024-04-26T20:56:44.265067+0000","last_became_peered":"2024-04-26T20:56:44.265067+0000","last_unstale":"2024-04-26T20:56:45.280149+0000","last_undegraded":"2024-04-26T20:56:45.280149+0000","last_fullsized":"2024-04-26T20:56:45.280149+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:33.745752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789404+0000","last_change":"2024-04-26T20:56:40.250180+0000","last_active":"2024-04-26T20:56:45.789404+0000","last_peered":"2024-04-26T20:56:45.789404+0000","last_clean":"2024-04-26T20:56:45.789404+0000","last_became_active":"2024-04-26T20:56:40.241673+0000","last_became_peered":"2024-04-26T20:56:40.241673+0000","last_unstale":"2024-04-26T20:56:45.789404+0000","last_undegraded":"2024-04-26T20:56:45.789404+0000","last_fullsized":"2024-04-26T20:56:45.789404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:43:17.208658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278532+0000","last_change":"2024-04-26T20:56:39.212686+0000","last_active":"2024-04-26T20:56:45.278532+0000","last_peered":"2024-04-26T20:56:45.278532+0000","last_clean":"2024-04-26T20:56:45.278532+0000","last_became_active":"2024-04-26T20:56:39.211596+0000","last_became_peered":"2024-04-26T20:56:39.211596+0000","last_unstale":"2024-04-26T20:56:45.278532+0000","last_undegraded":"2024-04-26T20:56:45.278532+0000","last_fullsized":"2024-04-26T20:56:45.278532+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:40:48.839377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.280382+0000","last_change":"2024-04-26T20:56:44.271569+0000","last_active":"2024-04-26T20:56:45.280382+0000","last_peered":"2024-04-26T20:56:45.280382+0000","last_clean":"2024-04-26T20:56:45.280382+0000","last_became_active":"2024-04-26T20:56:44.271199+0000","last_became_peered":"2024-04-26T20:56:44.271199+0000","last_unstale":"2024-04-26T20:56:45.280382+0000","last_undegraded":"2024-04-26T20:56:45.280382+0000","last_fullsized":"2024-04-26T20:56:45.280382+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:03.397241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.280443+0000","last_change":"2024-04-26T20:56:40.218097+0000","last_active":"2024-04-26T20:56:45.280443+0000","last_peered":"2024-04-26T20:56:45.280443+0000","last_clean":"2024-04-26T20:56:45.280443+0000","last_became_active":"2024-04-26T20:56:40.217279+0000","last_became_peered":"2024-04-26T20:56:40.217279+0000","last_unstale":"2024-04-26T20:56:45.280443+0000","last_undegraded":"2024-04-26T20:56:45.280443+0000","last_fullsized":"2024-04-26T20:56:45.280443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:31.742963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.465604+0000","last_change":"2024-04-26T20:56:39.206681+0000","last_active":"2024-04-26T20:56:45.465604+0000","last_peered":"2024-04-26T20:56:45.465604+0000","last_clean":"2024-04-26T20:56:45.465604+0000","last_became_active":"2024-04-26T20:56:39.206387+0000","last_became_peered":"2024-04-26T20:56:39.206387+0000","last_unstale":"2024-04-26T20:56:45.465604+0000","last_undegraded":"2024-04-26T20:56:45.465604+0000","last_fullsized":"2024-04-26T20:56:45.465604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:41:13.015392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788775+0000","last_change":"2024-04-26T20:56:44.272225+0000","last_active":"2024-04-26T20:56:45.788775+0000","last_peered":"2024-04-26T20:56:45.788775+0000","last_clean":"2024-04-26T20:56:45.788775+0000","last_became_active":"2024-04-26T20:56:44.268540+0000","last_became_peered":"2024-04-26T20:56:44.268540+0000","last_unstale":"2024-04-26T20:56:45.788775+0000","last_undegraded":"2024-04-26T20:56:45.788775+0000","last_fullsized":"2024-04-26T20:56:45.788775+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:20:27.945065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789725+0000","last_change":"2024-04-26T20:56:44.270140+0000","last_active":"2024-04-26T20:56:45.789725+0000","last_peered":"2024-04-26T20:56:45.789725+0000","last_clean":"2024-04-26T20:56:45.789725+0000","last_became_active":"2024-04-26T20:56:44.269804+0000","last_became_peered":"2024-04-26T20:56:44.269804+0000","last_unstale":"2024-04-26T20:56:45.789725+0000","last_undegraded":"2024-04-26T20:56:45.789725+0000","last_fullsized":"2024-04-26T20:56:45.789725+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:56:25.438566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788888+0000","last_change":"2024-04-26T20:56:40.242067+0000","last_active":"2024-04-26T20:56:45.788888+0000","last_peered":"2024-04-26T20:56:45.788888+0000","last_clean":"2024-04-26T20:56:45.788888+0000","last_became_active":"2024-04-26T20:56:40.241730+0000","last_became_peered":"2024-04-26T20:56:40.241730+0000","last_unstale":"2024-04-26T20:56:45.788888+0000","last_undegraded":"2024-04-26T20:56:45.788888+0000","last_fullsized":"2024-04-26T20:56:45.788888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:30:32.775766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786403+0000","last_change":"2024-04-26T20:56:39.224756+0000","last_active":"2024-04-26T20:56:45.786403+0000","last_peered":"2024-04-26T20:56:45.786403+0000","last_clean":"2024-04-26T20:56:45.786403+0000","last_became_active":"2024-04-26T20:56:39.224355+0000","last_became_peered":"2024-04-26T20:56:39.224355+0000","last_unstale":"2024-04-26T20:56:45.786403+0000","last_undegraded":"2024-04-26T20:56:45.786403+0000","last_fullsized":"2024-04-26T20:56:45.786403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:10:57.721766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.787013+0000","last_change":"2024-04-26T20:56:44.259652+0000","last_active":"2024-04-26T20:56:45.787013+0000","last_peered":"2024-04-26T20:56:45.787013+0000","last_clean":"2024-04-26T20:56:45.787013+0000","last_became_active":"2024-04-26T20:56:44.259253+0000","last_became_peered":"2024-04-26T20:56:44.259253+0000","last_unstale":"2024-04-26T20:56:45.787013+0000","last_undegraded":"2024-04-26T20:56:45.787013+0000","last_fullsized":"2024-04-26T20:56:45.787013+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:34:23.113242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788223+0000","last_change":"2024-04-26T20:56:40.252069+0000","last_active":"2024-04-26T20:56:45.788223+0000","last_peered":"2024-04-26T20:56:45.788223+0000","last_clean":"2024-04-26T20:56:45.788223+0000","last_became_active":"2024-04-26T20:56:40.251800+0000","last_became_peered":"2024-04-26T20:56:40.251800+0000","last_unstale":"2024-04-26T20:56:45.788223+0000","last_undegraded":"2024-04-26T20:56:45.788223+0000","last_fullsized":"2024-04-26T20:56:45.788223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:50:26.042106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789011+0000","last_change":"2024-04-26T20:56:39.222979+0000","last_active":"2024-04-26T20:56:45.789011+0000","last_peered":"2024-04-26T20:56:45.789011+0000","last_clean":"2024-04-26T20:56:45.789011+0000","last_became_active":"2024-04-26T20:56:39.222514+0000","last_became_peered":"2024-04-26T20:56:39.222514+0000","last_unstale":"2024-04-26T20:56:45.789011+0000","last_undegraded":"2024-04-26T20:56:45.789011+0000","last_fullsized":"2024-04-26T20:56:45.789011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:03:29.476982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786759+0000","last_change":"2024-04-26T20:56:39.229726+0000","last_active":"2024-04-26T20:56:45.786759+0000","last_peered":"2024-04-26T20:56:45.786759+0000","last_clean":"2024-04-26T20:56:45.786759+0000","last_became_active":"2024-04-26T20:56:39.228823+0000","last_became_peered":"2024-04-26T20:56:39.228823+0000","last_unstale":"2024-04-26T20:56:45.786759+0000","last_undegraded":"2024-04-26T20:56:45.786759+0000","last_fullsized":"2024-04-26T20:56:45.786759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:45.701878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788829+0000","last_change":"2024-04-26T20:56:40.237552+0000","last_active":"2024-04-26T20:56:45.788829+0000","last_peered":"2024-04-26T20:56:45.788829+0000","last_clean":"2024-04-26T20:56:45.788829+0000","last_became_active":"2024-04-26T20:56:40.234148+0000","last_became_peered":"2024-04-26T20:56:40.234148+0000","last_unstale":"2024-04-26T20:56:45.788829+0000","last_undegraded":"2024-04-26T20:56:45.788829+0000","last_fullsized":"2024-04-26T20:56:45.788829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:05:09.050038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789111+0000","last_change":"2024-04-26T20:56:44.268137+0000","last_active":"2024-04-26T20:56:45.789111+0000","last_peered":"2024-04-26T20:56:45.789111+0000","last_clean":"2024-04-26T20:56:45.789111+0000","last_became_active":"2024-04-26T20:56:44.267618+0000","last_became_peered":"2024-04-26T20:56:44.267618+0000","last_unstale":"2024-04-26T20:56:45.789111+0000","last_undegraded":"2024-04-26T20:56:45.789111+0000","last_fullsized":"2024-04-26T20:56:45.789111+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:47:30.881003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788498+0000","last_change":"2024-04-26T20:56:39.219724+0000","last_active":"2024-04-26T20:56:45.788498+0000","last_peered":"2024-04-26T20:56:45.788498+0000","last_clean":"2024-04-26T20:56:45.788498+0000","last_became_active":"2024-04-26T20:56:39.219485+0000","last_became_peered":"2024-04-26T20:56:39.219485+0000","last_unstale":"2024-04-26T20:56:45.788498+0000","last_undegraded":"2024-04-26T20:56:45.788498+0000","last_fullsized":"2024-04-26T20:56:45.788498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:11:12.183144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.465256+0000","last_change":"2024-04-26T20:56:40.242585+0000","last_active":"2024-04-26T20:56:45.465256+0000","last_peered":"2024-04-26T20:56:45.465256+0000","last_clean":"2024-04-26T20:56:45.465256+0000","last_became_active":"2024-04-26T20:56:40.242312+0000","last_became_peered":"2024-04-26T20:56:40.242312+0000","last_unstale":"2024-04-26T20:56:45.465256+0000","last_undegraded":"2024-04-26T20:56:45.465256+0000","last_fullsized":"2024-04-26T20:56:45.465256+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:58.516368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.281033+0000","last_change":"2024-04-26T20:56:44.278669+0000","last_active":"2024-04-26T20:56:45.281033+0000","last_peered":"2024-04-26T20:56:45.281033+0000","last_clean":"2024-04-26T20:56:45.281033+0000","last_became_active":"2024-04-26T20:56:44.278144+0000","last_became_peered":"2024-04-26T20:56:44.278144+0000","last_unstale":"2024-04-26T20:56:45.281033+0000","last_undegraded":"2024-04-26T20:56:45.281033+0000","last_fullsized":"2024-04-26T20:56:45.281033+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:35.050613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.279742+0000","last_change":"2024-04-26T20:56:40.239350+0000","last_active":"2024-04-26T20:56:45.279742+0000","last_peered":"2024-04-26T20:56:45.279742+0000","last_clean":"2024-04-26T20:56:45.279742+0000","last_became_active":"2024-04-26T20:56:40.238857+0000","last_became_peered":"2024-04-26T20:56:40.238857+0000","last_unstale":"2024-04-26T20:56:45.279742+0000","last_undegraded":"2024-04-26T20:56:45.279742+0000","last_fullsized":"2024-04-26T20:56:45.279742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:34.603528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.280519+0000","last_change":"2024-04-26T20:56:40.250462+0000","last_active":"2024-04-26T20:56:45.280519+0000","last_peered":"2024-04-26T20:56:45.280519+0000","last_clean":"2024-04-26T20:56:45.280519+0000","last_became_active":"2024-04-26T20:56:40.250111+0000","last_became_peered":"2024-04-26T20:56:40.250111+0000","last_unstale":"2024-04-26T20:56:45.280519+0000","last_undegraded":"2024-04-26T20:56:45.280519+0000","last_fullsized":"2024-04-26T20:56:45.280519+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:34.603528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786771+0000","last_change":"2024-04-26T20:56:40.243150+0000","last_active":"2024-04-26T20:56:45.786771+0000","last_peered":"2024-04-26T20:56:45.786771+0000","last_clean":"2024-04-26T20:56:45.786771+0000","last_became_active":"2024-04-26T20:56:40.242878+0000","last_became_peered":"2024-04-26T20:56:40.242878+0000","last_unstale":"2024-04-26T20:56:45.786771+0000","last_undegraded":"2024-04-26T20:56:45.786771+0000","last_fullsized":"2024-04-26T20:56:45.786771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:38.504120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788406+0000","last_change":"2024-04-26T20:56:40.246148+0000","last_active":"2024-04-26T20:56:45.788406+0000","last_peered":"2024-04-26T20:56:45.788406+0000","last_clean":"2024-04-26T20:56:45.788406+0000","last_became_active":"2024-04-26T20:56:40.241050+0000","last_became_peered":"2024-04-26T20:56:40.241050+0000","last_unstale":"2024-04-26T20:56:45.788406+0000","last_undegraded":"2024-04-26T20:56:45.788406+0000","last_fullsized":"2024-04-26T20:56:45.788406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:41:04.236810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.790634+0000","last_change":"2024-04-26T20:56:40.240515+0000","last_active":"2024-04-26T20:56:45.790634+0000","last_peered":"2024-04-26T20:56:45.790634+0000","last_clean":"2024-04-26T20:56:45.790634+0000","last_became_active":"2024-04-26T20:56:40.240214+0000","last_became_peered":"2024-04-26T20:56:40.240214+0000","last_unstale":"2024-04-26T20:56:45.790634+0000","last_undegraded":"2024-04-26T20:56:45.790634+0000","last_fullsized":"2024-04-26T20:56:45.790634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:07:27.066355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.790023+0000","last_change":"2024-04-26T20:56:40.237603+0000","last_active":"2024-04-26T20:56:45.790023+0000","last_peered":"2024-04-26T20:56:45.790023+0000","last_clean":"2024-04-26T20:56:45.790023+0000","last_became_active":"2024-04-26T20:56:40.237312+0000","last_became_peered":"2024-04-26T20:56:40.237312+0000","last_unstale":"2024-04-26T20:56:45.790023+0000","last_undegraded":"2024-04-26T20:56:45.790023+0000","last_fullsized":"2024-04-26T20:56:45.790023+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:31.010832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.280394+0000","last_change":"2024-04-26T20:56:40.224409+0000","last_active":"2024-04-26T20:56:45.280394+0000","last_peered":"2024-04-26T20:56:45.280394+0000","last_clean":"2024-04-26T20:56:45.280394+0000","last_became_active":"2024-04-26T20:56:40.223783+0000","last_became_peered":"2024-04-26T20:56:40.223783+0000","last_unstale":"2024-04-26T20:56:45.280394+0000","last_undegraded":"2024-04-26T20:56:45.280394+0000","last_fullsized":"2024-04-26T20:56:45.280394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:57:36.835651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789132+0000","last_change":"2024-04-26T20:56:40.247698+0000","last_active":"2024-04-26T20:56:45.789132+0000","last_peered":"2024-04-26T20:56:45.789132+0000","last_clean":"2024-04-26T20:56:45.789132+0000","last_became_active":"2024-04-26T20:56:40.247096+0000","last_became_peered":"2024-04-26T20:56:40.247096+0000","last_unstale":"2024-04-26T20:56:45.789132+0000","last_undegraded":"2024-04-26T20:56:45.789132+0000","last_fullsized":"2024-04-26T20:56:45.789132+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:20:40.427686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786399+0000","last_change":"2024-04-26T20:56:40.258240+0000","last_active":"2024-04-26T20:56:45.786399+0000","last_peered":"2024-04-26T20:56:45.786399+0000","last_clean":"2024-04-26T20:56:45.786399+0000","last_became_active":"2024-04-26T20:56:40.257922+0000","last_became_peered":"2024-04-26T20:56:40.257922+0000","last_unstale":"2024-04-26T20:56:45.786399+0000","last_undegraded":"2024-04-26T20:56:45.786399+0000","last_fullsized":"2024-04-26T20:56:45.786399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:43:17.208658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788602+0000","last_change":"2024-04-26T20:56:40.234841+0000","last_active":"2024-04-26T20:56:45.788602+0000","last_peered":"2024-04-26T20:56:45.788602+0000","last_clean":"2024-04-26T20:56:45.788602+0000","last_became_active":"2024-04-26T20:56:40.234455+0000","last_became_peered":"2024-04-26T20:56:40.234455+0000","last_unstale":"2024-04-26T20:56:45.788602+0000","last_undegraded":"2024-04-26T20:56:45.788602+0000","last_fullsized":"2024-04-26T20:56:45.788602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:03:10.550412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.465190+0000","last_change":"2024-04-26T20:56:40.236302+0000","last_active":"2024-04-26T20:56:45.465190+0000","last_peered":"2024-04-26T20:56:45.465190+0000","last_clean":"2024-04-26T20:56:45.465190+0000","last_became_active":"2024-04-26T20:56:40.236036+0000","last_became_peered":"2024-04-26T20:56:40.236036+0000","last_unstale":"2024-04-26T20:56:45.465190+0000","last_undegraded":"2024-04-26T20:56:45.465190+0000","last_fullsized":"2024-04-26T20:56:45.465190+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:41:13.644088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789474+0000","last_change":"2024-04-26T20:56:40.234738+0000","last_active":"2024-04-26T20:56:45.789474+0000","last_peered":"2024-04-26T20:56:45.789474+0000","last_clean":"2024-04-26T20:56:45.789474+0000","last_became_active":"2024-04-26T20:56:40.231985+0000","last_became_peered":"2024-04-26T20:56:40.231985+0000","last_unstale":"2024-04-26T20:56:45.789474+0000","last_undegraded":"2024-04-26T20:56:45.789474+0000","last_fullsized":"2024-04-26T20:56:45.789474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:57:53.450954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278740+0000","last_change":"2024-04-26T20:56:40.249286+0000","last_active":"2024-04-26T20:56:45.278740+0000","last_peered":"2024-04-26T20:56:45.278740+0000","last_clean":"2024-04-26T20:56:45.278740+0000","last_became_active":"2024-04-26T20:56:40.249012+0000","last_became_peered":"2024-04-26T20:56:40.249012+0000","last_unstale":"2024-04-26T20:56:45.278740+0000","last_undegraded":"2024-04-26T20:56:45.278740+0000","last_fullsized":"2024-04-26T20:56:45.278740+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:43:17.208658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.787152+0000","last_change":"2024-04-26T20:56:40.228646+0000","last_active":"2024-04-26T20:56:45.787152+0000","last_peered":"2024-04-26T20:56:45.787152+0000","last_clean":"2024-04-26T20:56:45.787152+0000","last_became_active":"2024-04-26T20:56:40.228368+0000","last_became_peered":"2024-04-26T20:56:40.228368+0000","last_unstale":"2024-04-26T20:56:45.787152+0000","last_undegraded":"2024-04-26T20:56:45.787152+0000","last_fullsized":"2024-04-26T20:56:45.787152+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:18:07.922849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.281190+0000","last_change":"2024-04-26T20:56:40.225730+0000","last_active":"2024-04-26T20:56:45.281190+0000","last_peered":"2024-04-26T20:56:45.281190+0000","last_clean":"2024-04-26T20:56:45.281190+0000","last_became_active":"2024-04-26T20:56:40.225431+0000","last_became_peered":"2024-04-26T20:56:40.225431+0000","last_unstale":"2024-04-26T20:56:45.281190+0000","last_undegraded":"2024-04-26T20:56:45.281190+0000","last_fullsized":"2024-04-26T20:56:45.281190+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:58.516368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.787104+0000","last_change":"2024-04-26T20:56:40.232831+0000","last_active":"2024-04-26T20:56:45.787104+0000","last_peered":"2024-04-26T20:56:45.787104+0000","last_clean":"2024-04-26T20:56:45.787104+0000","last_became_active":"2024-04-26T20:56:40.229977+0000","last_became_peered":"2024-04-26T20:56:40.229977+0000","last_unstale":"2024-04-26T20:56:45.787104+0000","last_undegraded":"2024-04-26T20:56:45.787104+0000","last_fullsized":"2024-04-26T20:56:45.787104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:56.469187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786286+0000","last_change":"2024-04-26T20:56:40.222579+0000","last_active":"2024-04-26T20:56:45.786286+0000","last_peered":"2024-04-26T20:56:45.786286+0000","last_clean":"2024-04-26T20:56:45.786286+0000","last_became_active":"2024-04-26T20:56:40.222116+0000","last_became_peered":"2024-04-26T20:56:40.222116+0000","last_unstale":"2024-04-26T20:56:45.786286+0000","last_undegraded":"2024-04-26T20:56:45.786286+0000","last_fullsized":"2024-04-26T20:56:45.786286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:50:26.042106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788401+0000","last_change":"2024-04-26T20:56:40.245721+0000","last_active":"2024-04-26T20:56:45.788401+0000","last_peered":"2024-04-26T20:56:45.788401+0000","last_clean":"2024-04-26T20:56:45.788401+0000","last_became_active":"2024-04-26T20:56:40.240783+0000","last_became_peered":"2024-04-26T20:56:40.240783+0000","last_unstale":"2024-04-26T20:56:45.788401+0000","last_undegraded":"2024-04-26T20:56:45.788401+0000","last_fullsized":"2024-04-26T20:56:45.788401+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:07:27.066355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788602+0000","last_change":"2024-04-26T20:56:40.239382+0000","last_active":"2024-04-26T20:56:45.788602+0000","last_peered":"2024-04-26T20:56:45.788602+0000","last_clean":"2024-04-26T20:56:45.788602+0000","last_became_active":"2024-04-26T20:56:40.239118+0000","last_became_peered":"2024-04-26T20:56:40.239118+0000","last_unstale":"2024-04-26T20:56:45.788602+0000","last_undegraded":"2024-04-26T20:56:45.788602+0000","last_fullsized":"2024-04-26T20:56:45.788602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:46.709617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788816+0000","last_change":"2024-04-26T20:56:40.236079+0000","last_active":"2024-04-26T20:56:45.788816+0000","last_peered":"2024-04-26T20:56:45.788816+0000","last_clean":"2024-04-26T20:56:45.788816+0000","last_became_active":"2024-04-26T20:56:40.235815+0000","last_became_peered":"2024-04-26T20:56:40.235815+0000","last_unstale":"2024-04-26T20:56:45.788816+0000","last_undegraded":"2024-04-26T20:56:45.788816+0000","last_fullsized":"2024-04-26T20:56:45.788816+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:55.117440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278710+0000","last_change":"2024-04-26T20:56:40.249327+0000","last_active":"2024-04-26T20:56:45.278710+0000","last_peered":"2024-04-26T20:56:45.278710+0000","last_clean":"2024-04-26T20:56:45.278710+0000","last_became_active":"2024-04-26T20:56:40.249079+0000","last_became_peered":"2024-04-26T20:56:40.249079+0000","last_unstale":"2024-04-26T20:56:45.278710+0000","last_undegraded":"2024-04-26T20:56:45.278710+0000","last_fullsized":"2024-04-26T20:56:45.278710+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:41:04.236810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278396+0000","last_change":"2024-04-26T20:56:40.233773+0000","last_active":"2024-04-26T20:56:45.278396+0000","last_peered":"2024-04-26T20:56:45.278396+0000","last_clean":"2024-04-26T20:56:45.278396+0000","last_became_active":"2024-04-26T20:56:40.233225+0000","last_became_peered":"2024-04-26T20:56:40.233225+0000","last_unstale":"2024-04-26T20:56:45.278396+0000","last_undegraded":"2024-04-26T20:56:45.278396+0000","last_fullsized":"2024-04-26T20:56:45.278396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:28:38.854680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278624+0000","last_change":"2024-04-26T20:56:40.227906+0000","last_active":"2024-04-26T20:56:45.278624+0000","last_peered":"2024-04-26T20:56:45.278624+0000","last_clean":"2024-04-26T20:56:45.278624+0000","last_became_active":"2024-04-26T20:56:40.227613+0000","last_became_peered":"2024-04-26T20:56:40.227613+0000","last_unstale":"2024-04-26T20:56:45.278624+0000","last_undegraded":"2024-04-26T20:56:45.278624+0000","last_fullsized":"2024-04-26T20:56:45.278624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:14:26.269699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.465600+0000","last_change":"2024-04-26T20:56:40.236919+0000","last_active":"2024-04-26T20:56:45.465600+0000","last_peered":"2024-04-26T20:56:45.465600+0000","last_clean":"2024-04-26T20:56:45.465600+0000","last_became_active":"2024-04-26T20:56:40.236544+0000","last_became_peered":"2024-04-26T20:56:40.236544+0000","last_unstale":"2024-04-26T20:56:45.465600+0000","last_undegraded":"2024-04-26T20:56:45.465600+0000","last_fullsized":"2024-04-26T20:56:45.465600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:57:36.835651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.787998+0000","last_change":"2024-04-26T20:56:40.251770+0000","last_active":"2024-04-26T20:56:45.787998+0000","last_peered":"2024-04-26T20:56:45.787998+0000","last_clean":"2024-04-26T20:56:45.787998+0000","last_became_active":"2024-04-26T20:56:40.251426+0000","last_became_peered":"2024-04-26T20:56:40.251426+0000","last_unstale":"2024-04-26T20:56:45.787998+0000","last_undegraded":"2024-04-26T20:56:45.787998+0000","last_fullsized":"2024-04-26T20:56:45.787998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:41:03.691519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278135+0000","last_change":"2024-04-26T20:56:40.227391+0000","last_active":"2024-04-26T20:56:45.278135+0000","last_peered":"2024-04-26T20:56:45.278135+0000","last_clean":"2024-04-26T20:56:45.278135+0000","last_became_active":"2024-04-26T20:56:40.226681+0000","last_became_peered":"2024-04-26T20:56:40.226681+0000","last_unstale":"2024-04-26T20:56:45.278135+0000","last_undegraded":"2024-04-26T20:56:45.278135+0000","last_fullsized":"2024-04-26T20:56:45.278135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:44:46.926225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.279941+0000","last_change":"2024-04-26T20:56:40.225067+0000","last_active":"2024-04-26T20:56:45.279941+0000","last_peered":"2024-04-26T20:56:45.279941+0000","last_clean":"2024-04-26T20:56:45.279941+0000","last_became_active":"2024-04-26T20:56:40.224764+0000","last_became_peered":"2024-04-26T20:56:40.224764+0000","last_unstale":"2024-04-26T20:56:45.279941+0000","last_undegraded":"2024-04-26T20:56:45.279941+0000","last_fullsized":"2024-04-26T20:56:45.279941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:10:58.729505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278406+0000","last_change":"2024-04-26T20:56:40.253423+0000","last_active":"2024-04-26T20:56:45.278406+0000","last_peered":"2024-04-26T20:56:45.278406+0000","last_clean":"2024-04-26T20:56:45.278406+0000","last_became_active":"2024-04-26T20:56:40.253195+0000","last_became_peered":"2024-04-26T20:56:40.253195+0000","last_unstale":"2024-04-26T20:56:45.278406+0000","last_undegraded":"2024-04-26T20:56:45.278406+0000","last_fullsized":"2024-04-26T20:56:45.278406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:24:10.292075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.280200+0000","last_change":"2024-04-26T20:56:40.225398+0000","last_active":"2024-04-26T20:56:45.280200+0000","last_peered":"2024-04-26T20:56:45.280200+0000","last_clean":"2024-04-26T20:56:45.280200+0000","last_became_active":"2024-04-26T20:56:40.225061+0000","last_became_peered":"2024-04-26T20:56:40.225061+0000","last_unstale":"2024-04-26T20:56:45.280200+0000","last_undegraded":"2024-04-26T20:56:45.280200+0000","last_fullsized":"2024-04-26T20:56:45.280200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:58.516368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789064+0000","last_change":"2024-04-26T20:56:40.248772+0000","last_active":"2024-04-26T20:56:45.789064+0000","last_peered":"2024-04-26T20:56:45.789064+0000","last_clean":"2024-04-26T20:56:45.789064+0000","last_became_active":"2024-04-26T20:56:40.240740+0000","last_became_peered":"2024-04-26T20:56:40.240740+0000","last_unstale":"2024-04-26T20:56:45.789064+0000","last_undegraded":"2024-04-26T20:56:45.789064+0000","last_fullsized":"2024-04-26T20:56:45.789064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:28:38.854680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789550+0000","last_change":"2024-04-26T20:56:40.251885+0000","last_active":"2024-04-26T20:56:45.789550+0000","last_peered":"2024-04-26T20:56:45.789550+0000","last_clean":"2024-04-26T20:56:45.789550+0000","last_became_active":"2024-04-26T20:56:40.251578+0000","last_became_peered":"2024-04-26T20:56:40.251578+0000","last_unstale":"2024-04-26T20:56:45.789550+0000","last_undegraded":"2024-04-26T20:56:45.789550+0000","last_fullsized":"2024-04-26T20:56:45.789550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:24:10.292075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278816+0000","last_change":"2024-04-26T20:56:40.235504+0000","last_active":"2024-04-26T20:56:45.278816+0000","last_peered":"2024-04-26T20:56:45.278816+0000","last_clean":"2024-04-26T20:56:45.278816+0000","last_became_active":"2024-04-26T20:56:40.234572+0000","last_became_peered":"2024-04-26T20:56:40.234572+0000","last_unstale":"2024-04-26T20:56:45.278816+0000","last_undegraded":"2024-04-26T20:56:45.278816+0000","last_fullsized":"2024-04-26T20:56:45.278816+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:29.705970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":110689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":110565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509449,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":884736,"data_stored":701025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":111147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":114266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":880640,"data_stored":701003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":110621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":115079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T20:56:59.808 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-26T20:56:59.808 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-26T20:56:59.808 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-26T20:56:59.808 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-26T20:56:59.809 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-26T20:56:59.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.977+0000 7f49e3e00640 1 Processor -- start 2024-04-26T20:56:59.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.977+0000 7f49e3e00640 1 -- start start 2024-04-26T20:56:59.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.977+0000 7f49e3e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f49dc0cbe00 0x7f49dc06de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:59.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.977+0000 7f49e3e00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49dc0727f0 con 0x7f49dc0cc1e0 2024-04-26T20:56:59.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.977+0000 7f49e3e00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49dc072a70 con 0x7f49dc15cf80 2024-04-26T20:56:59.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.977+0000 7f49e3e00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f49dc074220 con 0x7f49dc0cbe00 2024-04-26T20:56:59.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.977+0000 7f49e1400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f49dc0cbe00 0x7f49dc06de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:59.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.977+0000 7f49e1400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f49dc0cbe00 0x7f49dc06de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:56814/0 (socket says 172.21.15.138:56814) 2024-04-26T20:56:59.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.977+0000 7f49e0a00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f49dc0cc1e0 0x7f49dc073b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:43692/0 (socket says 172.21.15.138:43692) 2024-04-26T20:56:59.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.977+0000 7f49e1400640 1 -- 172.21.15.138:0/369064939 learned_addr learned my addr 172.21.15.138:0/369064939 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:59.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.981+0000 7f49e1400640 1 -- 172.21.15.138:0/369064939 >> v1:172.21.15.143:6789/0 conn(0x7f49dc15cf80 legacy=0x7f49dc0ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:59.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.981+0000 7f49e1400640 1 -- 172.21.15.138:0/369064939 >> v1:172.21.15.138:6789/0 conn(0x7f49dc0cc1e0 legacy=0x7f49dc073b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:59.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.981+0000 7f49e1400640 1 -- 172.21.15.138:0/369064939 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49dc072d50 con 0x7f49dc0cbe00 2024-04-26T20:56:59.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.981+0000 7f49dbe00640 1 -- 172.21.15.138:0/369064939 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 38056983 0 0) 0x7f49c8001120 con 0x7f49dc0cc1e0 2024-04-26T20:56:59.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.981+0000 7f49e1400640 1 --2- 172.21.15.138:0/369064939 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49dc0cbe00 0x7f49dc06de70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f49d0009870 tx=0x7f49d001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87c84116b933aad3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:59.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.981+0000 7f49dbe00640 1 -- 172.21.15.138:0/369064939 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d00a7070 con 0x7f49dc0cbe00 2024-04-26T20:56:59.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.981+0000 7f49dbe00640 1 -- 172.21.15.138:0/369064939 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49d00b0070 con 0x7f49dc0cbe00 2024-04-26T20:56:59.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.981+0000 7f49dbe00640 1 -- 172.21.15.138:0/369064939 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d00ab890 con 0x7f49dc0cbe00 2024-04-26T20:56:59.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.985+0000 7f49e3e00640 1 -- 172.21.15.138:0/369064939 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49dc0cbe00 msgr2=0x7f49dc06de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:59.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.985+0000 7f49e3e00640 1 --2- 172.21.15.138:0/369064939 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49dc0cbe00 0x7f49dc06de70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f49d0009870 tx=0x7f49d001c560 comp rx=0 tx=0).stop 2024-04-26T20:56:59.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.985+0000 7f49e3e00640 1 -- 172.21.15.138:0/369064939 shutdown_connections 2024-04-26T20:56:59.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.985+0000 7f49e3e00640 1 --2- 172.21.15.138:0/369064939 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49dc0cbe00 0x7f49dc06de70 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:59.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.985+0000 7f49e3e00640 1 -- 172.21.15.138:0/369064939 >> 172.21.15.138:0/369064939 conn(0x7f49dc0d0b20 msgr2=0x7f49dc0d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:59.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.985+0000 7f49e3e00640 1 -- 172.21.15.138:0/369064939 shutdown_connections 2024-04-26T20:56:59.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.985+0000 7f49e3e00640 1 -- 172.21.15.138:0/369064939 wait complete. 2024-04-26T20:56:59.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.985+0000 7f49e3e00640 1 Processor -- start 2024-04-26T20:56:59.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.985+0000 7f49e3e00640 1 -- start start 2024-04-26T20:56:59.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.985+0000 7f49e3e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f49dc0cbe00 0x7f49dc0b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:59.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.985+0000 7f49e3e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49dc0cc1e0 0x7f49dc151820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:59.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.985+0000 7f49e3e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f49dc15cf80 0x7f49dc0ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:59.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.985+0000 7f49e3e00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f49dc0d0780 con 0x7f49dc0cc1e0 2024-04-26T20:56:59.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.985+0000 7f49e3e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f49dc073680 con 0x7f49dc15cf80 2024-04-26T20:56:59.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.985+0000 7f49e3e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f49dc0d0900 con 0x7f49dc0cbe00 2024-04-26T20:56:59.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.985+0000 7f49e0a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49dc0cc1e0 0x7f49dc151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:59.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.985+0000 7f49e0a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49dc0cc1e0 0x7f49dc151820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:56824/0 (socket says 172.21.15.138:56824) 2024-04-26T20:56:59.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.985+0000 7f49e0a00640 1 -- 172.21.15.138:0/1358873196 learned_addr learned my addr 172.21.15.138:0/1358873196 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:56:59.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.985+0000 7f49e1400640 1 --2- 172.21.15.138:0/1358873196 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f49dc0cbe00 0x7f49dc0b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:59.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.985+0000 7f49e1e00640 1 --2- 172.21.15.138:0/1358873196 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f49dc15cf80 0x7f49dc0ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:59.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.985+0000 7f49e0a00640 1 -- 172.21.15.138:0/1358873196 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f49dc0cbe00 msgr2=0x7f49dc0b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:59.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.985+0000 7f49e0a00640 1 --2- 172.21.15.138:0/1358873196 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f49dc0cbe00 0x7f49dc0b0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:59.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.985+0000 7f49e0a00640 1 -- 172.21.15.138:0/1358873196 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f49dc15cf80 msgr2=0x7f49dc0ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:59.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.985+0000 7f49e0a00640 1 --2- 172.21.15.138:0/1358873196 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f49dc15cf80 0x7f49dc0ae8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:59.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.985+0000 7f49e0a00640 1 -- 172.21.15.138:0/1358873196 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49dc0b1510 con 0x7f49dc0cc1e0 2024-04-26T20:56:59.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.985+0000 7f49e1e00640 1 --2- 172.21.15.138:0/1358873196 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f49dc15cf80 0x7f49dc0ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:56:59.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.985+0000 7f49e0a00640 1 --2- 172.21.15.138:0/1358873196 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49dc0cc1e0 0x7f49dc151820 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f49c800c7b0 tx=0x7f49c800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:59.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.985+0000 7f49d9600640 1 -- 172.21.15.138:0/1358873196 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c8018070 con 0x7f49dc0cc1e0 2024-04-26T20:56:59.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.985+0000 7f49d9600640 1 -- 172.21.15.138:0/1358873196 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49c80072d0 con 0x7f49dc0cc1e0 2024-04-26T20:56:59.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.985+0000 7f49d9600640 1 -- 172.21.15.138:0/1358873196 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c80047f0 con 0x7f49dc0cc1e0 2024-04-26T20:56:59.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.985+0000 7f49e3e00640 1 -- 172.21.15.138:0/1358873196 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49dc0af640 con 0x7f49dc0cc1e0 2024-04-26T20:56:59.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.989+0000 7f49e3e00640 1 -- 172.21.15.138:0/1358873196 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49dc0b1170 con 0x7f49dc0cc1e0 2024-04-26T20:56:59.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.989+0000 7f49e3e00640 1 -- 172.21.15.138:0/1358873196 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49dc069510 con 0x7f49dc0cc1e0 2024-04-26T20:56:59.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.989+0000 7f49d9600640 1 -- 172.21.15.138:0/1358873196 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f49c801b070 con 0x7f49dc0cc1e0 2024-04-26T20:56:59.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.989+0000 7f49d9600640 1 --2- 172.21.15.138:0/1358873196 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f49bc068380 0x7f49bc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:59.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.989+0000 7f49d9600640 1 -- 172.21.15.138:0/1358873196 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f49c8086080 con 0x7f49dc0cc1e0 2024-04-26T20:56:59.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.989+0000 7f49e1400640 1 --2- 172.21.15.138:0/1358873196 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f49bc068380 0x7f49bc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:59.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.989+0000 7f49e1400640 1 --2- 172.21.15.138:0/1358873196 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f49bc068380 0x7f49bc06a840 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f49d00af000 tx=0x7f49d00a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:59.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:56:59.993+0000 7f49d9600640 1 -- 172.21.15.138:0/1358873196 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f49dc0727f0 con 0x7f49dc0cc1e0 2024-04-26T20:57:00.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.189+0000 7f49e3e00640 1 -- 172.21.15.138:0/1358873196 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f49dc0ce8b0 con 0x7f49dc0cc1e0 2024-04-26T20:57:00.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.193+0000 7f49d9600640 1 -- 172.21.15.138:0/1358873196 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+168092 (secure 0 0 0) 0x7f49c80562f0 con 0x7f49dc0cc1e0 2024-04-26T20:57:00.199 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:57:00.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.197+0000 7f49e3e00640 1 -- 172.21.15.138:0/1358873196 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f49bc068380 msgr2=0x7f49bc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:00.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.197+0000 7f49e3e00640 1 --2- 172.21.15.138:0/1358873196 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f49bc068380 0x7f49bc06a840 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f49d00af000 tx=0x7f49d00a7000 comp rx=0 tx=0).stop 2024-04-26T20:57:00.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.197+0000 7f49e3e00640 1 -- 172.21.15.138:0/1358873196 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49dc0cc1e0 msgr2=0x7f49dc151820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:00.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.197+0000 7f49e3e00640 1 --2- 172.21.15.138:0/1358873196 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49dc0cc1e0 0x7f49dc151820 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f49c800c7b0 tx=0x7f49c800cc70 comp rx=0 tx=0).stop 2024-04-26T20:57:00.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.197+0000 7f49e3e00640 1 -- 172.21.15.138:0/1358873196 shutdown_connections 2024-04-26T20:57:00.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.197+0000 7f49e3e00640 1 --2- 172.21.15.138:0/1358873196 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f49bc068380 0x7f49bc06a840 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:00.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.197+0000 7f49e3e00640 1 --2- 172.21.15.138:0/1358873196 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f49dc15cf80 0x7f49dc0ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:00.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.197+0000 7f49e3e00640 1 --2- 172.21.15.138:0/1358873196 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49dc0cc1e0 0x7f49dc151820 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:00.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.197+0000 7f49e3e00640 1 --2- 172.21.15.138:0/1358873196 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f49dc0cbe00 0x7f49dc0b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:00.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.197+0000 7f49e3e00640 1 -- 172.21.15.138:0/1358873196 >> 172.21.15.138:0/1358873196 conn(0x7f49dc0d0b20 msgr2=0x7f49dc15bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:00.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.197+0000 7f49e3e00640 1 -- 172.21.15.138:0/1358873196 shutdown_connections 2024-04-26T20:57:00.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.197+0000 7f49e3e00640 1 -- 172.21.15.138:0/1358873196 wait complete. 2024-04-26T20:57:00.220 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":4275464198},{"type":"v1","addr":"172.21.15.143:6833","nonce":4275464198}]},"active_addr":"172.21.15.143:6833/4275464198","active_change":"2024-04-26T20:56:19.224465+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.143:0","nonce":2522165113}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.143:0","nonce":1203472001}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.143:0","nonce":3069112976}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.143:0","nonce":3628294079}]}]} 2024-04-26T20:57:00.224 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-26T20:57:00.224 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-26T20:57:00.224 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:57:00.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.361+0000 7fae01400640 1 Processor -- start 2024-04-26T20:57:00.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.361+0000 7fae01400640 1 -- start start 2024-04-26T20:57:00.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.365+0000 7fae01400640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fadfc15ce20 0x7fadfc161340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:00.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.365+0000 7fae01400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fadfc0cca00 0x7fadfc0cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:00.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.365+0000 7fae01400640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadfc0cd360 con 0x7fadfc15e0c0 2024-04-26T20:57:00.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.365+0000 7fae01400640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fadfc073b70 con 0x7fadfc15ce20 2024-04-26T20:57:00.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.365+0000 7fae01400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fadfc073e10 con 0x7fadfc0cca00 2024-04-26T20:57:00.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.365+0000 7fadfa800640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fadfc15ce20 0x7fadfc161340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:00.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.365+0000 7fadfb200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fadfc0cca00 0x7fadfc0cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:00.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.365+0000 7fadfa800640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fadfc15ce20 0x7fadfc161340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.138:36700/0 (socket says 172.21.15.138:36700) 2024-04-26T20:57:00.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.365+0000 7fadfa800640 1 -- 172.21.15.138:0/2427766439 learned_addr learned my addr 172.21.15.138:0/2427766439 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:00.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.365+0000 7fadfb200640 1 -- 172.21.15.138:0/2427766439 >> v2:172.21.15.143:3300/0 conn(0x7fadfc15ce20 msgr2=0x7fadfc161340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:00.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.365+0000 7fadfb200640 1 --2- 172.21.15.138:0/2427766439 >> v2:172.21.15.143:3300/0 conn(0x7fadfc15ce20 0x7fadfc161340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:00.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.365+0000 7fadfb200640 1 -- 172.21.15.138:0/2427766439 >> v1:172.21.15.143:6789/0 conn(0x7fadfc15e0c0 legacy=0x7fadfc071ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:00.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.365+0000 7fadfb200640 1 -- 172.21.15.138:0/2427766439 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadfc0740f0 con 0x7fadfc0cca00 2024-04-26T20:57:00.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.365+0000 7fadfa800640 1 --2- 172.21.15.138:0/2427766439 >> v2:172.21.15.143:3300/0 conn(0x7fadfc15ce20 0x7fadfc161340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:57:00.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.369+0000 7fadfb200640 1 --2- 172.21.15.138:0/2427766439 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fadfc0cca00 0x7fadfc0cce20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fadf4009d90 tx=0x7fadf401c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c8aa54d32acdd05 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:00.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.369+0000 7fadf9400640 1 -- 172.21.15.138:0/2427766439 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf40b2070 con 0x7fadfc0cca00 2024-04-26T20:57:00.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.369+0000 7fadf9400640 1 -- 172.21.15.138:0/2427766439 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadf40a5940 con 0x7fadfc0cca00 2024-04-26T20:57:00.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.369+0000 7fadf9400640 1 -- 172.21.15.138:0/2427766439 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf40a5d10 con 0x7fadfc0cca00 2024-04-26T20:57:00.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.369+0000 7fae01400640 1 -- 172.21.15.138:0/2427766439 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fadfc0cca00 msgr2=0x7fadfc0cce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:00.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.369+0000 7fae01400640 1 --2- 172.21.15.138:0/2427766439 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fadfc0cca00 0x7fadfc0cce20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fadf4009d90 tx=0x7fadf401c970 comp rx=0 tx=0).stop 2024-04-26T20:57:00.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.369+0000 7fae01400640 1 -- 172.21.15.138:0/2427766439 shutdown_connections 2024-04-26T20:57:00.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.369+0000 7fae01400640 1 --2- 172.21.15.138:0/2427766439 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fadfc0cca00 0x7fadfc0cce20 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:00.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.369+0000 7fae01400640 1 --2- 172.21.15.138:0/2427766439 >> v2:172.21.15.143:3300/0 conn(0x7fadfc15ce20 0x7fadfc161340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:00.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.369+0000 7fae01400640 1 -- 172.21.15.138:0/2427766439 >> 172.21.15.138:0/2427766439 conn(0x7fadfc0d0b20 msgr2=0x7fadfc0d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:00.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.369+0000 7fae01400640 1 -- 172.21.15.138:0/2427766439 shutdown_connections 2024-04-26T20:57:00.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.369+0000 7fae01400640 1 -- 172.21.15.138:0/2427766439 wait complete. 2024-04-26T20:57:00.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.369+0000 7fae01400640 1 Processor -- start 2024-04-26T20:57:00.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.369+0000 7fae01400640 1 -- start start 2024-04-26T20:57:00.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.373+0000 7fae01400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fadfc0cca00 0x7fadfc0b37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:00.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.373+0000 7fae01400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fadfc15ce20 0x7fadfc1560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:00.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.373+0000 7fae01400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fadfc15e0c0 0x7fadfc150150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:00.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.373+0000 7fae01400640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fadfc15d380 con 0x7fadfc15e0c0 2024-04-26T20:57:00.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.373+0000 7fae01400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fadfc15d200 con 0x7fadfc0cca00 2024-04-26T20:57:00.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.373+0000 7fae01400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fadfc06e680 con 0x7fadfc15ce20 2024-04-26T20:57:00.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.373+0000 7fadfb200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fadfc15e0c0 0x7fadfc150150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:00.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.373+0000 7fadf9e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fadfc15ce20 0x7fadfc1560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:00.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.373+0000 7fadfa800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fadfc0cca00 0x7fadfc0b37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:00.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.373+0000 7fadfb200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fadfc15e0c0 0x7fadfc150150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:56838/0 (socket says 172.21.15.138:56838) 2024-04-26T20:57:00.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.373+0000 7fadf9e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fadfc15ce20 0x7fadfc1560e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.138:47686/0 (socket says 172.21.15.138:47686) 2024-04-26T20:57:00.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.373+0000 7fadfa800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fadfc0cca00 0x7fadfc0b37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.138:36710/0 (socket says 172.21.15.138:36710) 2024-04-26T20:57:00.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.373+0000 7fadfb200640 1 -- 172.21.15.138:0/1715474933 learned_addr learned my addr 172.21.15.138:0/1715474933 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:00.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.373+0000 7fadfb200640 1 -- 172.21.15.138:0/1715474933 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fadfc15ce20 msgr2=0x7fadfc1560e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:00.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.373+0000 7fadfb200640 1 --2- 172.21.15.138:0/1715474933 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fadfc15ce20 0x7fadfc1560e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:00.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.373+0000 7fadfb200640 1 -- 172.21.15.138:0/1715474933 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fadfc0cca00 msgr2=0x7fadfc0b37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:00.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.373+0000 7fadfb200640 1 --2- 172.21.15.138:0/1715474933 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fadfc0cca00 0x7fadfc0b37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:00.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.373+0000 7fadfb200640 1 -- 172.21.15.138:0/1715474933 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadfc0b5c70 con 0x7fadfc15e0c0 2024-04-26T20:57:00.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.373+0000 7fadf9e00640 1 --2- 172.21.15.138:0/1715474933 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fadfc15ce20 0x7fadfc1560e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:57:00.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.373+0000 7fadfa800640 1 --2- 172.21.15.138:0/1715474933 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fadfc0cca00 0x7fadfc0b37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:57:00.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.373+0000 7fadfb200640 1 --2- 172.21.15.138:0/1715474933 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fadfc15e0c0 0x7fadfc150150 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fadf40b0040 tx=0x7fadf4019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:00.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.373+0000 7fadf2a00640 1 -- 172.21.15.138:0/1715474933 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf40b2050 con 0x7fadfc15e0c0 2024-04-26T20:57:00.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.373+0000 7fadf2a00640 1 -- 172.21.15.138:0/1715474933 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadf40be070 con 0x7fadfc15e0c0 2024-04-26T20:57:00.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.373+0000 7fae01400640 1 -- 172.21.15.138:0/1715474933 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadfc0b5f50 con 0x7fadfc15e0c0 2024-04-26T20:57:00.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.373+0000 7fadf2a00640 1 -- 172.21.15.138:0/1715474933 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf40ada90 con 0x7fadfc15e0c0 2024-04-26T20:57:00.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.373+0000 7fae01400640 1 -- 172.21.15.138:0/1715474933 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadfc0b6510 con 0x7fadfc15e0c0 2024-04-26T20:57:00.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.373+0000 7fae01400640 1 -- 172.21.15.138:0/1715474933 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadfc069510 con 0x7fadfc15e0c0 2024-04-26T20:57:00.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.377+0000 7fadf2a00640 1 -- 172.21.15.138:0/1715474933 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fadf40adc30 con 0x7fadfc15e0c0 2024-04-26T20:57:00.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.377+0000 7fadf2a00640 1 --2- 172.21.15.138:0/1715474933 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7faddc068380 0x7faddc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:00.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.377+0000 7fadf2a00640 1 -- 172.21.15.138:0/1715474933 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fadf4121ce0 con 0x7fadfc15e0c0 2024-04-26T20:57:00.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.377+0000 7fadfa800640 1 --2- 172.21.15.138:0/1715474933 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7faddc068380 0x7faddc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:00.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.377+0000 7fadfa800640 1 --2- 172.21.15.138:0/1715474933 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7faddc068380 0x7faddc06a840 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fadec009630 tx=0x7fadec009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:00.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.381+0000 7fadf2a00640 1 -- 172.21.15.138:0/1715474933 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fadf4016560 con 0x7fadfc15e0c0 2024-04-26T20:57:00.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.541+0000 7fae01400640 1 -- 172.21.15.138:0/1715474933 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fadfc1613e0 con 0x7fadfc15e0c0 2024-04-26T20:57:00.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.541+0000 7fadf2a00640 1 -- 172.21.15.138:0/1715474933 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18578 (secure 0 0 0) 0x7fadf40f1900 con 0x7fadfc15e0c0 2024-04-26T20:57:00.546 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:57:00.546 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":27,"fsid":"c22b4730-12cc-4558-8535-b965384398c0","created":"2024-04-26T20:56:14.182475+0000","modified":"2024-04-26T20:56:44.633968+0000","last_up_change":"2024-04-26T20:56:26.013243+0000","last_in_change":"2024-04-26T20:56:16.714055+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:56:27.265834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:56:37.394398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:56:38.544369+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:56:42.240243+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3f9a2e34-3199-466f-a6cf-57927318121e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6801","nonce":3534772245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6803","nonce":3534772245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6807","nonce":3534772245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6805","nonce":3534772245}]},"public_addr":"172.21.15.138:6801/3534772245","cluster_addr":"172.21.15.138:6803/3534772245","heartbeat_back_addr":"172.21.15.138:6807/3534772245","heartbeat_front_addr":"172.21.15.138:6805/3534772245","state":["exists","up"]},{"osd":1,"uuid":"e881fcf6-3248-4696-a2ef-95d206d77712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6817","nonce":1427635773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6819","nonce":1427635773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6823","nonce":1427635773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6821","nonce":1427635773}]},"public_addr":"172.21.15.138:6817/1427635773","cluster_addr":"172.21.15.138:6819/1427635773","heartbeat_back_addr":"172.21.15.138:6823/1427635773","heartbeat_front_addr":"172.21.15.138:6821/1427635773","state":["exists","up"]},{"osd":2,"uuid":"f7d1db33-7672-4699-ae47-9f1e0a8e4222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6809","nonce":4273721573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6811","nonce":4273721573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6815","nonce":4273721573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6813","nonce":4273721573}]},"public_addr":"172.21.15.138:6809/4273721573","cluster_addr":"172.21.15.138:6811/4273721573","heartbeat_back_addr":"172.21.15.138:6815/4273721573","heartbeat_front_addr":"172.21.15.138:6813/4273721573","state":["exists","up"]},{"osd":3,"uuid":"2f4e0a9a-b8f6-4468-844a-a4501cd85054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6825","nonce":3098242154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6827","nonce":3098242154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6831","nonce":3098242154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6829","nonce":3098242154}]},"public_addr":"172.21.15.138:6825/3098242154","cluster_addr":"172.21.15.138:6827/3098242154","heartbeat_back_addr":"172.21.15.138:6831/3098242154","heartbeat_front_addr":"172.21.15.138:6829/3098242154","state":["exists","up"]},{"osd":4,"uuid":"c85df99b-3624-410e-866b-86830af2cfe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6801","nonce":2942056312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6803","nonce":2942056312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6807","nonce":2942056312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6805","nonce":2942056312}]},"public_addr":"172.21.15.143:6801/2942056312","cluster_addr":"172.21.15.143:6803/2942056312","heartbeat_back_addr":"172.21.15.143:6807/2942056312","heartbeat_front_addr":"172.21.15.143:6805/2942056312","state":["exists","up"]},{"osd":5,"uuid":"9af1efb5-c416-4808-b5ef-de0679ab9705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6809","nonce":1910222887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6811","nonce":1910222887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6815","nonce":1910222887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6813","nonce":1910222887}]},"public_addr":"172.21.15.143:6809/1910222887","cluster_addr":"172.21.15.143:6811/1910222887","heartbeat_back_addr":"172.21.15.143:6815/1910222887","heartbeat_front_addr":"172.21.15.143:6813/1910222887","state":["exists","up"]},{"osd":6,"uuid":"d7138615-8838-45ff-9072-2fd0683362f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6817","nonce":1082239825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6819","nonce":1082239825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6823","nonce":1082239825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6821","nonce":1082239825}]},"public_addr":"172.21.15.143:6817/1082239825","cluster_addr":"172.21.15.143:6819/1082239825","heartbeat_back_addr":"172.21.15.143:6823/1082239825","heartbeat_front_addr":"172.21.15.143:6821/1082239825","state":["exists","up"]},{"osd":7,"uuid":"0c27172b-35c4-49ec-ba0b-0137b8ff0010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6825","nonce":3295508495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6827","nonce":3295508495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6831","nonce":3295508495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6829","nonce":3295508495}]},"public_addr":"172.21.15.143:6825/3295508495","cluster_addr":"172.21.15.143:6827/3295508495","heartbeat_back_addr":"172.21.15.143:6831/3295508495","heartbeat_front_addr":"172.21.15.143:6829/3295508495","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.326627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.396119+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.433915+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.414179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.216947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.329272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.503073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.436382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:57:00.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.545+0000 7fae01400640 1 -- 172.21.15.138:0/1715474933 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7faddc068380 msgr2=0x7faddc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:00.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.545+0000 7fae01400640 1 --2- 172.21.15.138:0/1715474933 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7faddc068380 0x7faddc06a840 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fadec009630 tx=0x7fadec009240 comp rx=0 tx=0).stop 2024-04-26T20:57:00.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.545+0000 7fae01400640 1 -- 172.21.15.138:0/1715474933 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fadfc15e0c0 msgr2=0x7fadfc150150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:00.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.545+0000 7fae01400640 1 --2- 172.21.15.138:0/1715474933 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fadfc15e0c0 0x7fadfc150150 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fadf40b0040 tx=0x7fadf4019710 comp rx=0 tx=0).stop 2024-04-26T20:57:00.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.545+0000 7fae01400640 1 -- 172.21.15.138:0/1715474933 shutdown_connections 2024-04-26T20:57:00.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.545+0000 7fae01400640 1 --2- 172.21.15.138:0/1715474933 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7faddc068380 0x7faddc06a840 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:00.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.545+0000 7fae01400640 1 --2- 172.21.15.138:0/1715474933 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fadfc15e0c0 0x7fadfc150150 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:00.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.545+0000 7fae01400640 1 --2- 172.21.15.138:0/1715474933 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fadfc15ce20 0x7fadfc1560e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:00.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.545+0000 7fae01400640 1 --2- 172.21.15.138:0/1715474933 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fadfc0cca00 0x7fadfc0b37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:00.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.545+0000 7fae01400640 1 -- 172.21.15.138:0/1715474933 >> 172.21.15.138:0/1715474933 conn(0x7fadfc0d0b20 msgr2=0x7fadfc152c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:00.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.545+0000 7fae01400640 1 -- 172.21.15.138:0/1715474933 shutdown_connections 2024-04-26T20:57:00.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.545+0000 7fae01400640 1 -- 172.21.15.138:0/1715474933 wait complete. 2024-04-26T20:57:00.569 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-26T20:57:00.569 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:57:00.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.701+0000 7fb3ad000640 1 Processor -- start 2024-04-26T20:57:00.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.701+0000 7fb3ad000640 1 -- start start 2024-04-26T20:57:00.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.701+0000 7fb3ad000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb3a815f1d0 0x7fb3a8162da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:00.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.701+0000 7fb3ad000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb3a80b1200 0x7fb3a80cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:00.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.701+0000 7fb3ad000640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3a8163c90 con 0x7fb3a806c300 2024-04-26T20:57:00.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.701+0000 7fb3ad000640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fb3a80b1660 con 0x7fb3a80b1200 2024-04-26T20:57:00.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.701+0000 7fb3ad000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb3a81633f0 con 0x7fb3a815f1d0 2024-04-26T20:57:00.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.701+0000 7fb3a5400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb3a80b1200 0x7fb3a80cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:00.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.701+0000 7fb3a5400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb3a80b1200 0x7fb3a80cc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:56848/0 (socket says 172.21.15.138:56848) 2024-04-26T20:57:00.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.701+0000 7fb3a5400640 1 -- 172.21.15.138:0/4257645169 learned_addr learned my addr 172.21.15.138:0/4257645169 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:00.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.701+0000 7fb3a5e00640 1 --2- 172.21.15.138:0/4257645169 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb3a815f1d0 0x7fb3a8162da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:00.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.705+0000 7fb3a5400640 1 -- 172.21.15.138:0/4257645169 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb3a815f1d0 msgr2=0x7fb3a8162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:00.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.705+0000 7fb3a5400640 1 --2- 172.21.15.138:0/4257645169 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb3a815f1d0 0x7fb3a8162da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:00.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.705+0000 7fb3a5400640 1 -- 172.21.15.138:0/4257645169 >> v1:172.21.15.143:6789/0 conn(0x7fb3a806c300 legacy=0x7fb3a80c7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:00.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.705+0000 7fb3a5400640 1 -- 172.21.15.138:0/4257645169 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3a81636d0 con 0x7fb3a80b1200 2024-04-26T20:57:00.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.705+0000 7fb3a5400640 1 --2- 172.21.15.138:0/4257645169 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb3a80b1200 0x7fb3a80cc2f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb390009870 tx=0x7fb39001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb1a304ffc4db43c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:00.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.705+0000 7fb3a4a00640 1 -- 172.21.15.138:0/4257645169 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3900b0070 con 0x7fb3a80b1200 2024-04-26T20:57:00.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.705+0000 7fb3a4a00640 1 -- 172.21.15.138:0/4257645169 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3900ab600 con 0x7fb3a80b1200 2024-04-26T20:57:00.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.705+0000 7fb3a4a00640 1 -- 172.21.15.138:0/4257645169 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3900ab9d0 con 0x7fb3a80b1200 2024-04-26T20:57:00.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.705+0000 7fb3ad000640 1 -- 172.21.15.138:0/4257645169 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb3a80b1200 msgr2=0x7fb3a80cc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:00.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.705+0000 7fb3ad000640 1 --2- 172.21.15.138:0/4257645169 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb3a80b1200 0x7fb3a80cc2f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb390009870 tx=0x7fb39001c440 comp rx=0 tx=0).stop 2024-04-26T20:57:00.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.709+0000 7fb3ad000640 1 -- 172.21.15.138:0/4257645169 shutdown_connections 2024-04-26T20:57:00.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.709+0000 7fb3ad000640 1 --2- 172.21.15.138:0/4257645169 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb3a80b1200 0x7fb3a80cc2f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:00.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.709+0000 7fb3ad000640 1 --2- 172.21.15.138:0/4257645169 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb3a815f1d0 0x7fb3a8162da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:00.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.709+0000 7fb3ad000640 1 -- 172.21.15.138:0/4257645169 >> 172.21.15.138:0/4257645169 conn(0x7fb3a80d1c60 msgr2=0x7fb3a80d2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:00.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.709+0000 7fb3ad000640 1 -- 172.21.15.138:0/4257645169 shutdown_connections 2024-04-26T20:57:00.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.709+0000 7fb3ad000640 1 -- 172.21.15.138:0/4257645169 wait complete. 2024-04-26T20:57:00.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.709+0000 7fb3ad000640 1 Processor -- start 2024-04-26T20:57:00.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.709+0000 7fb3ad000640 1 -- start start 2024-04-26T20:57:00.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.709+0000 7fb3ad000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb3a806c300 0x7fb3a81ffc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:00.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.709+0000 7fb3ad000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb3a80b1200 0x7fb3a8162210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:00.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.709+0000 7fb3ad000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb3a815f1d0 0x7fb3a8155af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:00.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.709+0000 7fb3ad000640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a806cb20 con 0x7fb3a806c300 2024-04-26T20:57:00.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.709+0000 7fb3ad000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a816c0e0 con 0x7fb3a815f1d0 2024-04-26T20:57:00.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.709+0000 7fb3ad000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb3a80b4980 con 0x7fb3a80b1200 2024-04-26T20:57:00.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.709+0000 7fb3a5e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb3a806c300 0x7fb3a81ffc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:00.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.709+0000 7fb3a5e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb3a806c300 0x7fb3a81ffc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:56854/0 (socket says 172.21.15.138:56854) 2024-04-26T20:57:00.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.709+0000 7fb3a5e00640 1 -- 172.21.15.138:0/1341504131 learned_addr learned my addr 172.21.15.138:0/1341504131 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:00.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.709+0000 7fb3a5400640 1 --2- 172.21.15.138:0/1341504131 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb3a80b1200 0x7fb3a8162210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:00.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.709+0000 7fb3a6800640 1 --2- 172.21.15.138:0/1341504131 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb3a815f1d0 0x7fb3a8155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:00.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.709+0000 7fb3a5e00640 1 -- 172.21.15.138:0/1341504131 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb3a80b1200 msgr2=0x7fb3a8162210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:00.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.709+0000 7fb3a5e00640 1 --2- 172.21.15.138:0/1341504131 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb3a80b1200 0x7fb3a8162210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:00.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.709+0000 7fb3a5e00640 1 -- 172.21.15.138:0/1341504131 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb3a815f1d0 msgr2=0x7fb3a8155af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:00.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.709+0000 7fb3a5e00640 1 --2- 172.21.15.138:0/1341504131 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb3a815f1d0 0x7fb3a8155af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:00.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.709+0000 7fb3a5e00640 1 -- 172.21.15.138:0/1341504131 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3a8162750 con 0x7fb3a806c300 2024-04-26T20:57:00.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.709+0000 7fb3a5400640 1 --2- 172.21.15.138:0/1341504131 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb3a80b1200 0x7fb3a8162210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:00.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.709+0000 7fb3a6800640 1 --2- 172.21.15.138:0/1341504131 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb3a815f1d0 0x7fb3a8155af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:00.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.709+0000 7fb3a5e00640 1 --2- 172.21.15.138:0/1341504131 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb3a806c300 0x7fb3a81ffc70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb39800e8a0 tx=0x7fb39800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:00.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.709+0000 7fb39e000640 1 -- 172.21.15.138:0/1341504131 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb398017070 con 0x7fb3a806c300 2024-04-26T20:57:00.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.709+0000 7fb39e000640 1 -- 172.21.15.138:0/1341504131 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb39800c940 con 0x7fb3a806c300 2024-04-26T20:57:00.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.709+0000 7fb39e000640 1 -- 172.21.15.138:0/1341504131 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39800ccf0 con 0x7fb3a806c300 2024-04-26T20:57:00.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.709+0000 7fb3ad000640 1 -- 172.21.15.138:0/1341504131 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3a82002c0 con 0x7fb3a806c300 2024-04-26T20:57:00.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.713+0000 7fb3ad000640 1 -- 172.21.15.138:0/1341504131 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3a8200880 con 0x7fb3a806c300 2024-04-26T20:57:00.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.713+0000 7fb3ad000640 1 -- 172.21.15.138:0/1341504131 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3a8069510 con 0x7fb3a806c300 2024-04-26T20:57:00.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.713+0000 7fb39e000640 1 -- 172.21.15.138:0/1341504131 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb39801a070 con 0x7fb3a806c300 2024-04-26T20:57:00.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.713+0000 7fb39e000640 1 --2- 172.21.15.138:0/1341504131 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb384068380 0x7fb38406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:00.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.713+0000 7fb39e000640 1 -- 172.21.15.138:0/1341504131 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fb398086bf0 con 0x7fb3a806c300 2024-04-26T20:57:00.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.713+0000 7fb3a5400640 1 --2- 172.21.15.138:0/1341504131 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb384068380 0x7fb38406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:00.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.713+0000 7fb3a5400640 1 --2- 172.21.15.138:0/1341504131 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb384068380 0x7fb38406a840 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb3900ad000 tx=0x7fb390008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:00.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.717+0000 7fb39e000640 1 -- 172.21.15.138:0/1341504131 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb398056e60 con 0x7fb3a806c300 2024-04-26T20:57:00.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.877+0000 7fb3ad000640 1 -- 172.21.15.138:0/1341504131 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb3a80d2a90 con 0x7fb3a806c300 2024-04-26T20:57:00.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.881+0000 7fb39e000640 1 -- 172.21.15.138:0/1341504131 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18578 (secure 0 0 0) 0x7fb398056760 con 0x7fb3a806c300 2024-04-26T20:57:00.884 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:57:00.884 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":27,"fsid":"c22b4730-12cc-4558-8535-b965384398c0","created":"2024-04-26T20:56:14.182475+0000","modified":"2024-04-26T20:56:44.633968+0000","last_up_change":"2024-04-26T20:56:26.013243+0000","last_in_change":"2024-04-26T20:56:16.714055+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:56:27.265834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:56:37.394398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:56:38.544369+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:56:42.240243+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3f9a2e34-3199-466f-a6cf-57927318121e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6801","nonce":3534772245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6803","nonce":3534772245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6807","nonce":3534772245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6805","nonce":3534772245}]},"public_addr":"172.21.15.138:6801/3534772245","cluster_addr":"172.21.15.138:6803/3534772245","heartbeat_back_addr":"172.21.15.138:6807/3534772245","heartbeat_front_addr":"172.21.15.138:6805/3534772245","state":["exists","up"]},{"osd":1,"uuid":"e881fcf6-3248-4696-a2ef-95d206d77712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6817","nonce":1427635773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6819","nonce":1427635773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6823","nonce":1427635773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6821","nonce":1427635773}]},"public_addr":"172.21.15.138:6817/1427635773","cluster_addr":"172.21.15.138:6819/1427635773","heartbeat_back_addr":"172.21.15.138:6823/1427635773","heartbeat_front_addr":"172.21.15.138:6821/1427635773","state":["exists","up"]},{"osd":2,"uuid":"f7d1db33-7672-4699-ae47-9f1e0a8e4222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6809","nonce":4273721573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6811","nonce":4273721573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6815","nonce":4273721573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6813","nonce":4273721573}]},"public_addr":"172.21.15.138:6809/4273721573","cluster_addr":"172.21.15.138:6811/4273721573","heartbeat_back_addr":"172.21.15.138:6815/4273721573","heartbeat_front_addr":"172.21.15.138:6813/4273721573","state":["exists","up"]},{"osd":3,"uuid":"2f4e0a9a-b8f6-4468-844a-a4501cd85054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6825","nonce":3098242154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6827","nonce":3098242154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6831","nonce":3098242154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6829","nonce":3098242154}]},"public_addr":"172.21.15.138:6825/3098242154","cluster_addr":"172.21.15.138:6827/3098242154","heartbeat_back_addr":"172.21.15.138:6831/3098242154","heartbeat_front_addr":"172.21.15.138:6829/3098242154","state":["exists","up"]},{"osd":4,"uuid":"c85df99b-3624-410e-866b-86830af2cfe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6801","nonce":2942056312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6803","nonce":2942056312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6807","nonce":2942056312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6805","nonce":2942056312}]},"public_addr":"172.21.15.143:6801/2942056312","cluster_addr":"172.21.15.143:6803/2942056312","heartbeat_back_addr":"172.21.15.143:6807/2942056312","heartbeat_front_addr":"172.21.15.143:6805/2942056312","state":["exists","up"]},{"osd":5,"uuid":"9af1efb5-c416-4808-b5ef-de0679ab9705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6809","nonce":1910222887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6811","nonce":1910222887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6815","nonce":1910222887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6813","nonce":1910222887}]},"public_addr":"172.21.15.143:6809/1910222887","cluster_addr":"172.21.15.143:6811/1910222887","heartbeat_back_addr":"172.21.15.143:6815/1910222887","heartbeat_front_addr":"172.21.15.143:6813/1910222887","state":["exists","up"]},{"osd":6,"uuid":"d7138615-8838-45ff-9072-2fd0683362f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6817","nonce":1082239825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6819","nonce":1082239825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6823","nonce":1082239825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6821","nonce":1082239825}]},"public_addr":"172.21.15.143:6817/1082239825","cluster_addr":"172.21.15.143:6819/1082239825","heartbeat_back_addr":"172.21.15.143:6823/1082239825","heartbeat_front_addr":"172.21.15.143:6821/1082239825","state":["exists","up"]},{"osd":7,"uuid":"0c27172b-35c4-49ec-ba0b-0137b8ff0010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6825","nonce":3295508495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6827","nonce":3295508495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6831","nonce":3295508495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6829","nonce":3295508495}]},"public_addr":"172.21.15.143:6825/3295508495","cluster_addr":"172.21.15.143:6827/3295508495","heartbeat_back_addr":"172.21.15.143:6831/3295508495","heartbeat_front_addr":"172.21.15.143:6829/3295508495","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.326627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.396119+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.433915+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.414179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.216947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.329272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.503073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.436382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:57:00.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.881+0000 7fb3ad000640 1 -- 172.21.15.138:0/1341504131 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb384068380 msgr2=0x7fb38406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:00.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.881+0000 7fb3ad000640 1 --2- 172.21.15.138:0/1341504131 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb384068380 0x7fb38406a840 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb3900ad000 tx=0x7fb390008040 comp rx=0 tx=0).stop 2024-04-26T20:57:00.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.881+0000 7fb3ad000640 1 -- 172.21.15.138:0/1341504131 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb3a806c300 msgr2=0x7fb3a81ffc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:00.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.881+0000 7fb3ad000640 1 --2- 172.21.15.138:0/1341504131 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb3a806c300 0x7fb3a81ffc70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb39800e8a0 tx=0x7fb39800eca0 comp rx=0 tx=0).stop 2024-04-26T20:57:00.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.881+0000 7fb3ad000640 1 -- 172.21.15.138:0/1341504131 shutdown_connections 2024-04-26T20:57:00.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.881+0000 7fb3ad000640 1 --2- 172.21.15.138:0/1341504131 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb384068380 0x7fb38406a840 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:00.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.881+0000 7fb3ad000640 1 --2- 172.21.15.138:0/1341504131 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb3a815f1d0 0x7fb3a8155af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:00.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.881+0000 7fb3ad000640 1 --2- 172.21.15.138:0/1341504131 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb3a80b1200 0x7fb3a8162210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:00.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.881+0000 7fb3ad000640 1 --2- 172.21.15.138:0/1341504131 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb3a806c300 0x7fb3a81ffc70 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:00.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.881+0000 7fb3ad000640 1 -- 172.21.15.138:0/1341504131 >> 172.21.15.138:0/1341504131 conn(0x7fb3a80d1c60 msgr2=0x7fb3a80cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:00.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.881+0000 7fb3ad000640 1 -- 172.21.15.138:0/1341504131 shutdown_connections 2024-04-26T20:57:00.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:00.881+0000 7fb3ad000640 1 -- 172.21.15.138:0/1341504131 wait complete. 2024-04-26T20:57:00.905 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-26T20:57:00.906 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-26T20:57:00.906 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-26T20:57:00.907 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-26T20:57:00.907 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-26T20:57:00.907 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-26T20:57:00.908 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-26T20:57:00.908 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-26T20:57:01.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.141+0000 7fb107200640 1 Processor -- start 2024-04-26T20:57:01.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.141+0000 7fb107200640 1 -- start start 2024-04-26T20:57:01.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.141+0000 7fbd91600640 1 Processor -- start 2024-04-26T20:57:01.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.141+0000 7fbd91600640 1 -- start start 2024-04-26T20:57:01.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.141+0000 7fb563200640 1 Processor -- start 2024-04-26T20:57:01.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.145+0000 7fb563200640 1 -- start start 2024-04-26T20:57:01.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.145+0000 7fb107200640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb1000ccfc0 0x7fb1000d26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.145+0000 7fb107200640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1001603d0 con 0x7fb10015bfa0 2024-04-26T20:57:01.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.145+0000 7fb107200640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1001606b0 con 0x7fb1000b11c0 2024-04-26T20:57:01.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.145+0000 7fb107200640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fb1000cfc40 con 0x7fb1000ccfc0 2024-04-26T20:57:01.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.145+0000 7fbd91600640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fbd8c0afe20 0x7fbd8c0cb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.145+0000 7fbd91600640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fbd8c163b30 0x7fbd8c0ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.145+0000 7fbd91600640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd8c0d0850 con 0x7fbd8c163750 2024-04-26T20:57:01.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.145+0000 7fbd91600640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fbd8c0cf020 con 0x7fbd8c163b30 2024-04-26T20:57:01.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.145+0000 7fb563200640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb5640cfad0 0x7fb5640af960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.145+0000 7fbd91600640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fbd8c0cb730 con 0x7fbd8c0afe20 2024-04-26T20:57:01.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.145+0000 7fbd8b400640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fbd8c0afe20 0x7fbd8c0cb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.145+0000 7fbd8b400640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fbd8c0afe20 0x7fbd8c0cb0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.138:36734/0 (socket says 172.21.15.138:36734) 2024-04-26T20:57:01.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.145+0000 7fbd8b400640 1 -- 172.21.15.138:0/2845196370 learned_addr learned my addr 172.21.15.138:0/2845196370 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:01.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.145+0000 7fb0ff400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb1000ccfc0 0x7fb1000d26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.145+0000 7fb563200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb56406f970 0x7fb564071cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.145+0000 7fb563200640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb5640d1590 0x7fb564072230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.145+0000 7fb563200640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fb56406ddb0 con 0x7fb5640cfad0 2024-04-26T20:57:01.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.145+0000 7fb563200640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fb56406e090 con 0x7fb5640d1590 2024-04-26T20:57:01.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.145+0000 7fb563200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb56406e370 con 0x7fb56406f970 2024-04-26T20:57:01.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.145+0000 7fb561400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb56406f970 0x7fb564071cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.145+0000 7fb0ffe00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fb10015bfa0 0x7fb1000cc8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:43700/0 (socket says 172.21.15.138:43700) 2024-04-26T20:57:01.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.145+0000 7fb0ffe00640 1 -- 172.21.15.138:0/433958055 learned_addr learned my addr 172.21.15.138:0/433958055 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:01.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.145+0000 7fb561400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb56406f970 0x7fb564071cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.138:47708/0 (socket says 172.21.15.138:47708) 2024-04-26T20:57:01.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.145+0000 7fb561400640 1 -- 172.21.15.138:0/1093098996 learned_addr learned my addr 172.21.15.138:0/1093098996 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:01.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.149+0000 7fb562800640 1 --2- 172.21.15.138:0/1093098996 >> v2:172.21.15.143:3300/0 conn(0x7fb5640d1590 0x7fb564072230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.149+0000 7fb0fea00640 1 -- 172.21.15.138:0/433958055 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 736977456 0 0) 0x7fb1001606b0 con 0x7fb1000b11c0 2024-04-26T20:57:01.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.149+0000 7fb0fea00640 1 -- 172.21.15.138:0/433958055 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0e8003530 con 0x7fb1000b11c0 2024-04-26T20:57:01.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.149+0000 7fb0fea00640 1 -- 172.21.15.138:0/433958055 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4028335051 0 0) 0x7fb1001603d0 con 0x7fb10015bfa0 2024-04-26T20:57:01.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.149+0000 7fb0fea00640 1 -- 172.21.15.138:0/433958055 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1001606b0 con 0x7fb10015bfa0 2024-04-26T20:57:01.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.149+0000 7fb561e00640 1 --2- 172.21.15.138:0/1093098996 >> v2:172.21.15.138:3300/0 conn(0x7fb5640cfad0 0x7fb5640af960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.149+0000 7fb561400640 1 -- 172.21.15.138:0/1093098996 >> v2:172.21.15.143:3300/0 conn(0x7fb5640d1590 msgr2=0x7fb564072230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:01.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.149+0000 7fb561400640 1 --2- 172.21.15.138:0/1093098996 >> v2:172.21.15.143:3300/0 conn(0x7fb5640d1590 0x7fb564072230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.149+0000 7fb561400640 1 -- 172.21.15.138:0/1093098996 >> v2:172.21.15.138:3300/0 conn(0x7fb5640cfad0 msgr2=0x7fb5640af960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:01.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.149+0000 7fb561400640 1 --2- 172.21.15.138:0/1093098996 >> v2:172.21.15.138:3300/0 conn(0x7fb5640cfad0 0x7fb5640af960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.149+0000 7fb561400640 1 -- 172.21.15.138:0/1093098996 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb56406e650 con 0x7fb56406f970 2024-04-26T20:57:01.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.149+0000 7fb561e00640 1 --2- 172.21.15.138:0/1093098996 >> v2:172.21.15.138:3300/0 conn(0x7fb5640cfad0 0x7fb5640af960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:57:01.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.149+0000 7fb0fea00640 1 -- 172.21.15.138:0/433958055 <== mon.1 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2289255496 0 0) 0x7fb0e8003530 con 0x7fb1000b11c0 2024-04-26T20:57:01.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.149+0000 7fb0fea00640 1 -- 172.21.15.138:0/433958055 >> v2:172.21.15.138:3300/0 conn(0x7fb1000ccfc0 msgr2=0x7fb1000d26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:01.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.149+0000 7fb0fea00640 1 --2- 172.21.15.138:0/433958055 >> v2:172.21.15.138:3300/0 conn(0x7fb1000ccfc0 0x7fb1000d26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.149+0000 7fb0fea00640 1 -- 172.21.15.138:0/433958055 >> v1:172.21.15.138:6789/0 conn(0x7fb10015bfa0 legacy=0x7fb1000cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.149+0000 7fb0fea00640 1 -- 172.21.15.138:0/433958055 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1000cff20 con 0x7fb1000b11c0 2024-04-26T20:57:01.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.149+0000 7fb0fea00640 1 -- 172.21.15.138:0/433958055 <== mon.1 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2715389689 0 0) 0x7fb0ec001680 con 0x7fb1000b11c0 2024-04-26T20:57:01.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.149+0000 7fb0fea00640 1 -- 172.21.15.138:0/433958055 >> v1:172.21.15.143:6789/0 conn(0x7fb1000b11c0 legacy=0x7fb1000d0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.149+0000 7fb0fea00640 1 --2- 172.21.15.138:0/433958055 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0e8003ba0 0x7fb0e8003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.149+0000 7fb0fea00640 1 --2- 172.21.15.138:0/433958055 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0e8004810 0x7fb0e8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.149+0000 7fb0fea00640 1 --2- 172.21.15.138:0/433958055 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0e8005320 0x7fb0e800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.149+0000 7fb0fea00640 1 -- 172.21.15.138:0/433958055 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fb1000cfc40 con 0x7fb0e8004810 2024-04-26T20:57:01.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.149+0000 7fb0fea00640 1 -- 172.21.15.138:0/433958055 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fb0e800c260 con 0x7fb0e8005320 2024-04-26T20:57:01.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.149+0000 7fb0fea00640 1 -- 172.21.15.138:0/433958055 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb0e800c460 con 0x7fb0e8003ba0 2024-04-26T20:57:01.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.149+0000 7fb0ff400640 1 --2- 172.21.15.138:0/433958055 >> v2:172.21.15.138:3300/0 conn(0x7fb1000ccfc0 0x7fb1000d26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:57:01.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.149+0000 7fb105200640 1 --2- 172.21.15.138:0/433958055 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0e8005320 0x7fb0e800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.145+0000 7fbd8b400640 1 -- 172.21.15.138:0/2845196370 >> v2:172.21.15.138:3300/0 conn(0x7fbd8c163b30 msgr2=0x7fbd8c0ccde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:01.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.145+0000 7fbd8b400640 1 --2- 172.21.15.138:0/2845196370 >> v2:172.21.15.138:3300/0 conn(0x7fbd8c163b30 0x7fbd8c0ccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.145+0000 7fbd8b400640 1 -- 172.21.15.138:0/2845196370 >> v1:172.21.15.143:6789/0 conn(0x7fbd8c163750 legacy=0x7fbd8c0af710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.145+0000 7fbd8b400640 1 -- 172.21.15.138:0/2845196370 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd8c0cf260 con 0x7fbd8c0afe20 2024-04-26T20:57:01.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.145+0000 7fbd8aa00640 1 -- 172.21.15.138:0/2845196370 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2196804140 0 0) 0x7fbd8c0d0850 con 0x7fbd8c163750 2024-04-26T20:57:01.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.149+0000 7fb0ff400640 1 --2- 172.21.15.138:0/433958055 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0e8004810 0x7fb0e8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.149+0000 7fb0ffe00640 1 --2- 172.21.15.138:0/433958055 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0e8003ba0 0x7fb0e8003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.153+0000 7fbd8b400640 1 --2- 172.21.15.138:0/2845196370 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd8c0afe20 0x7fbd8c0cb0c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c1673e0 tx=0x7fbd7801c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92812eabf43be38a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.153+0000 7fb0ff400640 1 -- 172.21.15.138:0/433958055 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0e8003ba0 msgr2=0x7fb0e8003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:01.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.153+0000 7fb0ff400640 1 --2- 172.21.15.138:0/433958055 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0e8003ba0 0x7fb0e8003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.153+0000 7fb0ff400640 1 -- 172.21.15.138:0/433958055 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0e8005320 msgr2=0x7fb0e800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:01.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.153+0000 7fb0ff400640 1 --2- 172.21.15.138:0/433958055 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0e8005320 0x7fb0e800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.153+0000 7fb0ff400640 1 -- 172.21.15.138:0/433958055 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0e8003530 con 0x7fb0e8004810 2024-04-26T20:57:01.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.153+0000 7fb105200640 1 --2- 172.21.15.138:0/433958055 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0e8005320 0x7fb0e800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:57:01.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.153+0000 7fb105200640 1 -- 172.21.15.138:0/433958055 reap_dead start 2024-04-26T20:57:01.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.153+0000 7fbd8aa00640 1 -- 172.21.15.138:0/2845196370 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd780b0070 con 0x7fbd8c0afe20 2024-04-26T20:57:01.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.153+0000 7fbd8aa00640 1 -- 172.21.15.138:0/2845196370 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd780ab600 con 0x7fbd8c0afe20 2024-04-26T20:57:01.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.153+0000 7fbd8aa00640 1 -- 172.21.15.138:0/2845196370 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd780ab9d0 con 0x7fbd8c0afe20 2024-04-26T20:57:01.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.153+0000 7fb561400640 1 --2- 172.21.15.138:0/1093098996 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb56406f970 0x7fb564071cf0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb564071c80 tx=0x7fb55c01ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9622fa854c8d226 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.153+0000 7fb560a00640 1 -- 172.21.15.138:0/1093098996 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb55c0a5780 con 0x7fb56406f970 2024-04-26T20:57:01.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.153+0000 7fb560a00640 1 -- 172.21.15.138:0/1093098996 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb55c0a5920 con 0x7fb56406f970 2024-04-26T20:57:01.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.153+0000 7fb560a00640 1 -- 172.21.15.138:0/1093098996 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb55c0a5cf0 con 0x7fb56406f970 2024-04-26T20:57:01.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.153+0000 7fbd91600640 1 -- 172.21.15.138:0/2845196370 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd8c0afe20 msgr2=0x7fbd8c0cb0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.153+0000 7fbd91600640 1 --2- 172.21.15.138:0/2845196370 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd8c0afe20 0x7fbd8c0cb0c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c1673e0 tx=0x7fbd7801c4b0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.153+0000 7f5eb6200640 1 Processor -- start 2024-04-26T20:57:01.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.153+0000 7fbd91600640 1 -- 172.21.15.138:0/2845196370 shutdown_connections 2024-04-26T20:57:01.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.153+0000 7fbd91600640 1 --2- 172.21.15.138:0/2845196370 >> v2:172.21.15.138:3300/0 conn(0x7fbd8c163b30 0x7fbd8c0ccde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.153+0000 7fbd91600640 1 --2- 172.21.15.138:0/2845196370 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd8c0afe20 0x7fbd8c0cb0c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.153+0000 7fbd91600640 1 -- 172.21.15.138:0/2845196370 >> 172.21.15.138:0/2845196370 conn(0x7fbd8c0d0a70 msgr2=0x7fbd8c0d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:01.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.153+0000 7f5eb6200640 1 -- start start 2024-04-26T20:57:01.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.153+0000 7f09b1800640 1 Processor -- start 2024-04-26T20:57:01.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.153+0000 7f09b1800640 1 -- start start 2024-04-26T20:57:01.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.157+0000 7fb563200640 1 -- 172.21.15.138:0/1093098996 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb56406f970 msgr2=0x7fb564071cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.157+0000 7fb563200640 1 --2- 172.21.15.138:0/1093098996 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb56406f970 0x7fb564071cf0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb564071c80 tx=0x7fb55c01ca10 comp rx=0 tx=0).stop 2024-04-26T20:57:01.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.157+0000 7f5eb6200640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5eb015f3a0 0x7f5eb00cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.157+0000 7f5eb6200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5eb00d36c0 0x7f5eb00cf960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.157+0000 7f5eb6200640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5eb00d1df0 con 0x7f5eb006d6b0 2024-04-26T20:57:01.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.157+0000 7f5eb6200640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f5eb00cd1f0 con 0x7f5eb015f3a0 2024-04-26T20:57:01.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.157+0000 7f5eb6200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f5eb00cd7b0 con 0x7f5eb00d36c0 2024-04-26T20:57:01.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.157+0000 7f5eb4e00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5eb015f3a0 0x7f5eb00cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.157+0000 7f5eafe00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5eb00d36c0 0x7f5eb00cf960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.157+0000 7f5eb4e00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5eb015f3a0 0x7f5eb00cf420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.138:36774/0 (socket says 172.21.15.138:36774) 2024-04-26T20:57:01.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.157+0000 7f5eb4e00640 1 -- 172.21.15.138:0/3492433318 learned_addr learned my addr 172.21.15.138:0/3492433318 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:01.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.157+0000 7f5eafe00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5eb00d36c0 0x7f5eb00cf960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.138:47714/0 (socket says 172.21.15.138:47714) 2024-04-26T20:57:01.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.157+0000 7fbd91600640 1 -- 172.21.15.138:0/2845196370 shutdown_connections 2024-04-26T20:57:01.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.157+0000 7f09b1800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f09ac15ce20 0x7f09ac161340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.157+0000 7f09b1800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f09ac15e0c0 0x7f09ac071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.157+0000 7f09b1800640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09ac073b70 con 0x7f09ac0cca00 2024-04-26T20:57:01.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.157+0000 7f09b1800640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f09ac0d0700 con 0x7f09ac15e0c0 2024-04-26T20:57:01.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.157+0000 7f09b1800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f09ac073e10 con 0x7f09ac15ce20 2024-04-26T20:57:01.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.157+0000 7fb563200640 1 -- 172.21.15.138:0/1093098996 shutdown_connections 2024-04-26T20:57:01.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.157+0000 7fb563200640 1 --2- 172.21.15.138:0/1093098996 >> v2:172.21.15.143:3300/0 conn(0x7fb5640d1590 0x7fb564072230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.157+0000 7fb563200640 1 --2- 172.21.15.138:0/1093098996 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb56406f970 0x7fb564071cf0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.157+0000 7fb563200640 1 --2- 172.21.15.138:0/1093098996 >> v2:172.21.15.138:3300/0 conn(0x7fb5640cfad0 0x7fb5640af960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.157+0000 7fb563200640 1 -- 172.21.15.138:0/1093098996 >> 172.21.15.138:0/1093098996 conn(0x7fb5640d0a70 msgr2=0x7fb5640d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:01.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.157+0000 7f5eafe00640 1 -- 172.21.15.138:0/3492433318 >> v2:172.21.15.143:3300/0 conn(0x7f5eb015f3a0 msgr2=0x7f5eb00cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:01.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.157+0000 7f5eafe00640 1 --2- 172.21.15.138:0/3492433318 >> v2:172.21.15.143:3300/0 conn(0x7f5eb015f3a0 0x7f5eb00cf420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.157+0000 7f5eafe00640 1 -- 172.21.15.138:0/3492433318 >> v1:172.21.15.138:6789/0 conn(0x7f5eb006d6b0 legacy=0x7f5eb006db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:01.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.157+0000 7f5eafe00640 1 -- 172.21.15.138:0/3492433318 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5eb00d20d0 con 0x7f5eb00d36c0 2024-04-26T20:57:01.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.157+0000 7f09aaa00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f09ac15ce20 0x7f09ac161340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.157+0000 7fbd91600640 1 -- 172.21.15.138:0/2845196370 wait complete. 2024-04-26T20:57:01.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.157+0000 7f09aaa00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f09ac15ce20 0x7f09ac161340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.138:47728/0 (socket says 172.21.15.138:47728) 2024-04-26T20:57:01.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.157+0000 7f09aaa00640 1 -- 172.21.15.138:0/185183349 learned_addr learned my addr 172.21.15.138:0/185183349 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:01.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.157+0000 7f09aa000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f09ac15e0c0 0x7f09ac071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.157+0000 7fbc08800640 1 Processor -- start 2024-04-26T20:57:01.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.157+0000 7fb0ff400640 1 --2- 172.21.15.138:0/433958055 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0e8004810 0x7fb0e8004c90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb0f400a620 tx=0x7fb0f4020a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=464b4d8eda75a564 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.161+0000 7fb0fea00640 1 -- 172.21.15.138:0/433958055 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f400a660 con 0x7fb0e8004810 2024-04-26T20:57:01.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.161+0000 7fb0fea00640 1 -- 172.21.15.138:0/433958055 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0f4004220 con 0x7fb0e8004810 2024-04-26T20:57:01.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.161+0000 7fb0fea00640 1 -- 172.21.15.138:0/433958055 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f400a660 con 0x7fb0e8004810 2024-04-26T20:57:01.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.157+0000 7fb563200640 1 -- 172.21.15.138:0/1093098996 shutdown_connections 2024-04-26T20:57:01.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.157+0000 7fbd91600640 1 Processor -- start 2024-04-26T20:57:01.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.161+0000 7fbd91600640 1 -- start start 2024-04-26T20:57:01.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.157+0000 7fbc08800640 1 -- start start 2024-04-26T20:57:01.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.161+0000 7fbc08800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fbc000c48f0 0x7fbc000b0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.161+0000 7fbc08800640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc00161550 con 0x7fbc00161170 2024-04-26T20:57:01.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.161+0000 7fbc08800640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc000741c0 con 0x7fbc001647c0 2024-04-26T20:57:01.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.161+0000 7fbc08800640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fbc000744a0 con 0x7fbc000c48f0 2024-04-26T20:57:01.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.157+0000 7f09aaa00640 1 -- 172.21.15.138:0/185183349 >> v2:172.21.15.138:3300/0 conn(0x7f09ac15e0c0 msgr2=0x7f09ac071ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:01.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.157+0000 7f09aaa00640 1 --2- 172.21.15.138:0/185183349 >> v2:172.21.15.138:3300/0 conn(0x7f09ac15e0c0 0x7f09ac071ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.157+0000 7f09a9600640 1 -- 172.21.15.138:0/185183349 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2601399514 0 0) 0x7f09ac073b70 con 0x7f09ac0cca00 2024-04-26T20:57:01.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.157+0000 7f09aaa00640 1 -- 172.21.15.138:0/185183349 >> v1:172.21.15.138:6789/0 conn(0x7f09ac0cca00 legacy=0x7f09ac06de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.157+0000 7f09aaa00640 1 -- 172.21.15.138:0/185183349 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09ac0740f0 con 0x7f09ac15ce20 2024-04-26T20:57:01.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.157+0000 7f09aa000640 1 --2- 172.21.15.138:0/185183349 >> v2:172.21.15.138:3300/0 conn(0x7f09ac15e0c0 0x7f09ac071ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:57:01.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.157+0000 7fb563200640 1 -- 172.21.15.138:0/1093098996 wait complete. 2024-04-26T20:57:01.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.161+0000 7fb563200640 1 Processor -- start 2024-04-26T20:57:01.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.161+0000 7fbc05400640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fbc001647c0 0x7fbc000c41e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.138:36064/0 (socket says 172.21.15.138:36064) 2024-04-26T20:57:01.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.161+0000 7fbc05400640 1 -- 172.21.15.138:0/2446664033 learned_addr learned my addr 172.21.15.138:0/2446664033 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:01.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.161+0000 7fb563200640 1 -- start start 2024-04-26T20:57:01.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.161+0000 7f3d2a200640 1 Processor -- start 2024-04-26T20:57:01.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.161+0000 7fbd91600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd8c0afe20 0x7fbd8c15c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.161+0000 7fbd91600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbd8c163750 0x7fbd8c158190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.161+0000 7fbd91600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd8c163b30 0x7fbd8c15d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.161+0000 7fbd91600640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8c06e520 con 0x7fbd8c0afe20 2024-04-26T20:57:01.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.161+0000 7fbd91600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8c0cff50 con 0x7fbd8c163b30 2024-04-26T20:57:01.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.161+0000 7fbd91600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fbd8c06e6a0 con 0x7fbd8c163750 2024-04-26T20:57:01.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.161+0000 7fbc06800640 1 --2- 172.21.15.138:0/2446664033 >> v2:172.21.15.138:3300/0 conn(0x7fbc000c48f0 0x7fbc000b0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.161+0000 7f3d2a200640 1 -- start start 2024-04-26T20:57:01.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.161+0000 7fbd90c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd8c163b30 0x7fbd8c15d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.161+0000 7fbd90c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd8c163b30 0x7fbd8c15d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.138:36790/0 (socket says 172.21.15.138:36790) 2024-04-26T20:57:01.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.161+0000 7fbd90c00640 1 -- 172.21.15.138:0/2881343988 learned_addr learned my addr 172.21.15.138:0/2881343988 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:01.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.161+0000 7fb107200640 1 -- 172.21.15.138:0/433958055 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0e8004810 msgr2=0x7fb0e8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.161+0000 7fb107200640 1 --2- 172.21.15.138:0/433958055 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0e8004810 0x7fb0e8004c90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb0f400a620 tx=0x7fb0f4020a40 comp rx=0 tx=0).stop 2024-04-26T20:57:01.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.161+0000 7fbd8b400640 1 --2- 172.21.15.138:0/2881343988 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbd8c163750 0x7fbd8c158190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.161+0000 7fbd8be00640 1 --2- 172.21.15.138:0/2881343988 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd8c0afe20 0x7fbd8c15c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.161+0000 7f5eafe00640 1 --2- 172.21.15.138:0/3492433318 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5eb00d36c0 0x7f5eb00cf960 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c0097c0 tx=0x7f5e9c01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eeb18b95d9c3e256 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.161+0000 7fbc06800640 1 -- 172.21.15.138:0/2446664033 >> v1:172.21.15.143:6789/0 conn(0x7fbc001647c0 legacy=0x7fbc000c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.161+0000 7fbc06800640 1 -- 172.21.15.138:0/2446664033 >> v1:172.21.15.138:6789/0 conn(0x7fbc00161170 legacy=0x7fbc00073900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:01.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.161+0000 7fbd90c00640 1 -- 172.21.15.138:0/2881343988 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbd8c163750 msgr2=0x7fbd8c158190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.161+0000 7fbd90c00640 1 --2- 172.21.15.138:0/2881343988 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbd8c163750 0x7fbd8c158190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.161+0000 7fbd90c00640 1 -- 172.21.15.138:0/2881343988 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd8c0afe20 msgr2=0x7fbd8c15c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.161+0000 7fbd90c00640 1 --2- 172.21.15.138:0/2881343988 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd8c0afe20 0x7fbd8c15c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.161+0000 7fbd90c00640 1 -- 172.21.15.138:0/2881343988 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd8c15e0c0 con 0x7fbd8c163b30 2024-04-26T20:57:01.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.161+0000 7fb563200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb56406f970 0x7fb5641531e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.161+0000 7fbd8b400640 1 --2- 172.21.15.138:0/2881343988 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbd8c163750 0x7fbd8c158190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:01.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.161+0000 7fbc06800640 1 -- 172.21.15.138:0/2446664033 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc00074780 con 0x7fbc000c48f0 2024-04-26T20:57:01.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.161+0000 7fb563200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb5640cfad0 0x7fb5640b4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.161+0000 7fbd90c00640 1 --2- 172.21.15.138:0/2881343988 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd8c163b30 0x7fbd8c15d8e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbd8400b970 tx=0x7fbd8400be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.161+0000 7f5eaf400640 1 -- 172.21.15.138:0/3492433318 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c0ab610 con 0x7f5eb00d36c0 2024-04-26T20:57:01.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.161+0000 7f5eaf400640 1 -- 172.21.15.138:0/3492433318 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e9c0b0070 con 0x7f5eb00d36c0 2024-04-26T20:57:01.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.161+0000 7f5eaf400640 1 -- 172.21.15.138:0/3492433318 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c0ab610 con 0x7f5eb00d36c0 2024-04-26T20:57:01.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7fb563200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5640d1590 0x7fb5640b50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7fb561e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb56406f970 0x7fb5641531e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7fbd83e00640 1 -- 172.21.15.138:0/2881343988 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd84019070 con 0x7fbd8c163b30 2024-04-26T20:57:01.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7fbd83e00640 1 -- 172.21.15.138:0/2881343988 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd8400cb60 con 0x7fbd8c163b30 2024-04-26T20:57:01.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7fbd83e00640 1 -- 172.21.15.138:0/2881343988 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd84014440 con 0x7fbd8c163b30 2024-04-26T20:57:01.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7fb107200640 1 -- 172.21.15.138:0/433958055 shutdown_connections 2024-04-26T20:57:01.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7fb107200640 1 --2- 172.21.15.138:0/433958055 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0e8004810 0x7fb0e8004c90 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7fb107200640 1 -- 172.21.15.138:0/433958055 >> 172.21.15.138:0/433958055 conn(0x7fb1000d1ba0 msgr2=0x7fb1000d1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:01.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7fb561e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb56406f970 0x7fb5641531e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.138:36802/0 (socket says 172.21.15.138:36802) 2024-04-26T20:57:01.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7fb561e00640 1 -- 172.21.15.138:0/3409270217 learned_addr learned my addr 172.21.15.138:0/3409270217 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:01.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7fb563200640 1 -- 172.21.15.138:0/3409270217 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fb5640cb450 con 0x7fb5640cfad0 2024-04-26T20:57:01.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7fb563200640 1 -- 172.21.15.138:0/3409270217 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fb5640cb2d0 con 0x7fb56406f970 2024-04-26T20:57:01.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7fb562800640 1 --2- 172.21.15.138:0/3409270217 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5640d1590 0x7fb5640b50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7fb561400640 1 --2- 172.21.15.138:0/3409270217 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb5640cfad0 0x7fb5640b4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7fbd91600640 1 -- 172.21.15.138:0/2881343988 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd8c1586d0 con 0x7fbd8c163b30 2024-04-26T20:57:01.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7fbd91600640 1 -- 172.21.15.138:0/2881343988 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd8c0b5110 con 0x7fbd8c163b30 2024-04-26T20:57:01.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7f3d2a200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3d2415e7f0 0x7f3d2406f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7fb107200640 1 -- 172.21.15.138:0/433958055 shutdown_connections 2024-04-26T20:57:01.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7fb107200640 1 -- 172.21.15.138:0/433958055 wait complete. 2024-04-26T20:57:01.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7f09aaa00640 1 --2- 172.21.15.138:0/185183349 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f09ac15ce20 0x7f09ac161340 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f099c009870 tx=0x7f099c01c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9d6ca8381bb9682 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7f5eb6200640 1 -- 172.21.15.138:0/3492433318 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5eb00d36c0 msgr2=0x7f5eb00cf960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7f5eb6200640 1 --2- 172.21.15.138:0/3492433318 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5eb00d36c0 0x7f5eb00cf960 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c0097c0 tx=0x7f5e9c01c450 comp rx=0 tx=0).stop 2024-04-26T20:57:01.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7fb563200640 1 -- 172.21.15.138:0/3409270217 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb5640cb5d0 con 0x7fb5640d1590 2024-04-26T20:57:01.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7f09a9600640 1 -- 172.21.15.138:0/185183349 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f099c0ab640 con 0x7f09ac15ce20 2024-04-26T20:57:01.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7f09a9600640 1 -- 172.21.15.138:0/185183349 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f099c0b0070 con 0x7f09ac15ce20 2024-04-26T20:57:01.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7f09a9600640 1 -- 172.21.15.138:0/185183349 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f099c0ab640 con 0x7f09ac15ce20 2024-04-26T20:57:01.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7f3d2a200640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f3d240cf670 0x7f3d240cb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7f3d23400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3d2415e7f0 0x7f3d2406f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7f3d23400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3d2415e7f0 0x7f3d2406f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.138:47738/0 (socket says 172.21.15.138:47738) 2024-04-26T20:57:01.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7f3d23400640 1 -- 172.21.15.138:0/3302473834 learned_addr learned my addr 172.21.15.138:0/3302473834 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:01.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7f3d2a200640 1 --2- 172.21.15.138:0/3302473834 >> v2:172.21.15.143:3300/0 conn(0x7f3d240cfa90 0x7f3d240cb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7f3d2a200640 1 -- 172.21.15.138:0/3302473834 --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f3d2406de70 con 0x7f3d240cf670 2024-04-26T20:57:01.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7f3d2a200640 1 -- 172.21.15.138:0/3302473834 --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f3d2406e130 con 0x7f3d240cfa90 2024-04-26T20:57:01.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7f3d2a200640 1 -- 172.21.15.138:0/3302473834 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f3d2406e410 con 0x7f3d2415e7f0 2024-04-26T20:57:01.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7f3d22a00640 1 --2- 172.21.15.138:0/3302473834 >> v2:172.21.15.138:3300/0 conn(0x7f3d240cf670 0x7f3d240cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7f3d23e00640 1 --2- 172.21.15.138:0/3302473834 >> v2:172.21.15.143:3300/0 conn(0x7f3d240cfa90 0x7f3d240cb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7f3d23400640 1 -- 172.21.15.138:0/3302473834 >> v2:172.21.15.143:3300/0 conn(0x7f3d240cfa90 msgr2=0x7f3d240cb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:01.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7f3d23400640 1 --2- 172.21.15.138:0/3302473834 >> v2:172.21.15.143:3300/0 conn(0x7f3d240cfa90 0x7f3d240cb6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7f3d23400640 1 -- 172.21.15.138:0/3302473834 >> v2:172.21.15.138:3300/0 conn(0x7f3d240cf670 msgr2=0x7f3d240cb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:01.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7f3d23400640 1 --2- 172.21.15.138:0/3302473834 >> v2:172.21.15.138:3300/0 conn(0x7f3d240cf670 0x7f3d240cb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7ff110800640 1 Processor -- start 2024-04-26T20:57:01.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7f3d23400640 1 -- 172.21.15.138:0/3302473834 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d2406e6f0 con 0x7f3d2415e7f0 2024-04-26T20:57:01.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7f09b1800640 1 -- 172.21.15.138:0/185183349 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f09ac15ce20 msgr2=0x7f09ac161340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7f09b1800640 1 --2- 172.21.15.138:0/185183349 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f09ac15ce20 0x7f09ac161340 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f099c009870 tx=0x7f099c01c530 comp rx=0 tx=0).stop 2024-04-26T20:57:01.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7f09b1800640 1 -- 172.21.15.138:0/185183349 shutdown_connections 2024-04-26T20:57:01.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7f09b1800640 1 --2- 172.21.15.138:0/185183349 >> v2:172.21.15.138:3300/0 conn(0x7f09ac15e0c0 0x7f09ac071ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7f09b1800640 1 --2- 172.21.15.138:0/185183349 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f09ac15ce20 0x7f09ac161340 secure :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f099c009870 tx=0x7f099c01c530 comp rx=0 tx=0).stop 2024-04-26T20:57:01.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7f09b1800640 1 -- 172.21.15.138:0/185183349 >> 172.21.15.138:0/185183349 conn(0x7f09ac0d0b20 msgr2=0x7f09ac0d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:01.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7f3d23e00640 1 --2- 172.21.15.138:0/3302473834 >> v2:172.21.15.143:3300/0 conn(0x7f3d240cfa90 0x7f3d240cb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:57:01.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7f09b1800640 1 -- 172.21.15.138:0/185183349 shutdown_connections 2024-04-26T20:57:01.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7fb562800640 1 -- 172.21.15.138:0/3409270217 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb56406f970 msgr2=0x7fb5641531e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7fb562800640 1 --2- 172.21.15.138:0/3409270217 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb56406f970 0x7fb5641531e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7fb562800640 1 -- 172.21.15.138:0/3409270217 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb5640cfad0 msgr2=0x7fb5640b4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7fb562800640 1 --2- 172.21.15.138:0/3409270217 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb5640cfad0 0x7fb5640b4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7fb562800640 1 -- 172.21.15.138:0/3409270217 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5640b5f50 con 0x7fb5640d1590 2024-04-26T20:57:01.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7fb561400640 1 --2- 172.21.15.138:0/3409270217 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb5640cfad0 0x7fb5640b4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:57:01.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7fbd91600640 1 -- 172.21.15.138:0/2881343988 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbd64001040 con 0x7fbd8c163b30 2024-04-26T20:57:01.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7fb107200640 1 Processor -- start 2024-04-26T20:57:01.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7f09b1800640 1 -- 172.21.15.138:0/185183349 wait complete. 2024-04-26T20:57:01.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7fbd83e00640 1 -- 172.21.15.138:0/2881343988 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbd8401c070 con 0x7fbd8c163b30 2024-04-26T20:57:01.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7fb562800640 1 --2- 172.21.15.138:0/3409270217 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5640d1590 0x7fb5640b50a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb55400e7f0 tx=0x7fb55400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.165+0000 7ff110800640 1 -- start start 2024-04-26T20:57:01.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7ff110800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff1080c6410 0x7ff1080b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7ff110800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff1080d09e0 0x7ff1080d0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7ff110800640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1080b4270 con 0x7ff108166a20 2024-04-26T20:57:01.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7ff110800640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7ff10806db00 con 0x7ff1080d09e0 2024-04-26T20:57:01.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7ff110800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ff1080b35e0 con 0x7ff1080c6410 2024-04-26T20:57:01.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7f5eb6200640 1 -- 172.21.15.138:0/3492433318 shutdown_connections 2024-04-26T20:57:01.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7f5eb6200640 1 --2- 172.21.15.138:0/3492433318 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5eb00d36c0 0x7f5eb00cf960 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7f5eb6200640 1 --2- 172.21.15.138:0/3492433318 >> v2:172.21.15.143:3300/0 conn(0x7f5eb015f3a0 0x7f5eb00cf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7f5eb6200640 1 -- 172.21.15.138:0/3492433318 >> 172.21.15.138:0/3492433318 conn(0x7f5eb00d2ba0 msgr2=0x7f5eb00d2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:01.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7fb55a000640 1 -- 172.21.15.138:0/3409270217 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb554017070 con 0x7fb5640d1590 2024-04-26T20:57:01.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7fb55a000640 1 -- 172.21.15.138:0/3409270217 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb55400c730 con 0x7fb5640d1590 2024-04-26T20:57:01.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7fb563200640 1 -- 172.21.15.138:0/3409270217 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5640b6230 con 0x7fb5640d1590 2024-04-26T20:57:01.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7fb563200640 1 -- 172.21.15.138:0/3409270217 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb564153720 con 0x7fb5640d1590 2024-04-26T20:57:01.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7fb55a000640 1 -- 172.21.15.138:0/3409270217 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb55400cb00 con 0x7fb5640d1590 2024-04-26T20:57:01.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7fbd83e00640 1 --2- 172.21.15.138:0/2881343988 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fbd6c068450 0x7fbd6c06a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7fbd83e00640 1 -- 172.21.15.138:0/2881343988 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fbd84086a00 con 0x7fbd8c163b30 2024-04-26T20:57:01.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7fbd8be00640 1 --2- 172.21.15.138:0/2881343988 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fbd6c068450 0x7fbd6c06a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7fbd83e00640 1 --2- 172.21.15.138:0/2881343988 >> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] conn(0x7fbd6c071bd0 0x7fbd6c074010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7fbd83e00640 1 -- 172.21.15.138:0/2881343988 --> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbd6c0746e0 con 0x7fbd6c071bd0 2024-04-26T20:57:01.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7fbd83e00640 1 -- 172.21.15.138:0/2881343988 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbd8408b260 con 0x7fbd8c163b30 2024-04-26T20:57:01.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7f5eb6200640 1 -- 172.21.15.138:0/3492433318 shutdown_connections 2024-04-26T20:57:01.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7f5eb6200640 1 -- 172.21.15.138:0/3492433318 wait complete. 2024-04-26T20:57:01.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7f5eb6200640 1 Processor -- start 2024-04-26T20:57:01.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7fbc06800640 1 --2- 172.21.15.138:0/2446664033 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc000c48f0 0x7fbc000b0790 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc009d90 tx=0x7fbbfc01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eef644e818766a50 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7fbc04a00640 1 -- 172.21.15.138:0/2446664033 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc0b2070 con 0x7fbc000c48f0 2024-04-26T20:57:01.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7fbc04a00640 1 -- 172.21.15.138:0/2446664033 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbfc0a5940 con 0x7fbc000c48f0 2024-04-26T20:57:01.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7fbc04a00640 1 -- 172.21.15.138:0/2446664033 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc0a5d10 con 0x7fbc000c48f0 2024-04-26T20:57:01.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7fbc08800640 1 -- 172.21.15.138:0/2446664033 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc000c48f0 msgr2=0x7fbc000b0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7fbc08800640 1 --2- 172.21.15.138:0/2446664033 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc000c48f0 0x7fbc000b0790 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc009d90 tx=0x7fbbfc01c970 comp rx=0 tx=0).stop 2024-04-26T20:57:01.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7f09b1800640 1 Processor -- start 2024-04-26T20:57:01.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7f09b1800640 1 -- start start 2024-04-26T20:57:01.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7f09b1800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f09ac0cca00 0x7f09ac0b6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7f09b1800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09ac15e0c0 0x7f09ac0b37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7f09b1800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f09ac0b3d20 0x7f09ac14b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7f09b1800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f09ac0cd220 con 0x7f09ac15e0c0 2024-04-26T20:57:01.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7f09b1800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f09ac072420 con 0x7f09ac0cca00 2024-04-26T20:57:01.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7f09b1800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f09ac0b6850 con 0x7f09ac0b3d20 2024-04-26T20:57:01.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7f3d23400640 1 --2- 172.21.15.138:0/3302473834 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3d2415e7f0 0x7f3d2406f1d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3d240762d0 tx=0x7f3d1401c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a52d995994a9d6fe server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7ff10d400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff1080c6410 0x7ff1080b30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7ff10d400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff1080c6410 0x7ff1080b30a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.138:47754/0 (socket says 172.21.15.138:47754) 2024-04-26T20:57:01.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7ff10d400640 1 -- 172.21.15.138:0/1673886909 learned_addr learned my addr 172.21.15.138:0/1673886909 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:01.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7ff10e800640 1 --2- 172.21.15.138:0/1673886909 >> v2:172.21.15.138:3300/0 conn(0x7ff1080d09e0 0x7ff1080d0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7ff10e800640 1 -- 172.21.15.138:0/1673886909 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff1080c6410 msgr2=0x7ff1080b30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:01.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7ff10e800640 1 --2- 172.21.15.138:0/1673886909 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff1080c6410 0x7ff1080b30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7ff10e800640 1 -- 172.21.15.138:0/1673886909 >> v1:172.21.15.143:6789/0 conn(0x7ff108166a20 legacy=0x7ff1080c5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7ff10e800640 1 -- 172.21.15.138:0/1673886909 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1080b4550 con 0x7ff1080d09e0 2024-04-26T20:57:01.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7ff10d400640 1 --2- 172.21.15.138:0/1673886909 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff1080c6410 0x7ff1080b30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:01.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7fbc08800640 1 -- 172.21.15.138:0/2446664033 shutdown_connections 2024-04-26T20:57:01.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7fbc08800640 1 --2- 172.21.15.138:0/2446664033 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc000c48f0 0x7fbc000b0790 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7fbc08800640 1 -- 172.21.15.138:0/2446664033 >> 172.21.15.138:0/2446664033 conn(0x7fbc0006ce00 msgr2=0x7fbc000b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:01.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7f09aa000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09ac15e0c0 0x7f09ac0b37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7f09aa000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09ac15e0c0 0x7f09ac0b37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:56960/0 (socket says 172.21.15.138:56960) 2024-04-26T20:57:01.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7f09aa000640 1 -- 172.21.15.138:0/2809496322 learned_addr learned my addr 172.21.15.138:0/2809496322 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:01.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7f3d22000640 1 -- 172.21.15.138:0/3302473834 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d140ab620 con 0x7f3d2415e7f0 2024-04-26T20:57:01.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7f3d22000640 1 -- 172.21.15.138:0/3302473834 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d140b0070 con 0x7f3d2415e7f0 2024-04-26T20:57:01.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7fb563200640 1 -- 172.21.15.138:0/3409270217 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb564069430 con 0x7fb5640d1590 2024-04-26T20:57:01.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7fbd8be00640 1 --2- 172.21.15.138:0/2881343988 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fbd6c068450 0x7fbd6c06a910 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c15d430 tx=0x7fbd7c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7fbd8b400640 1 --2- 172.21.15.138:0/2881343988 >> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] conn(0x7fbd6c071bd0 0x7fbd6c074010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7fb107200640 1 -- start start 2024-04-26T20:57:01.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7f5eb6200640 1 -- start start 2024-04-26T20:57:01.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7f09ab400640 1 --2- 172.21.15.138:0/2809496322 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f09ac0b3d20 0x7f09ac14b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7f09aaa00640 1 --2- 172.21.15.138:0/2809496322 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f09ac0cca00 0x7f09ac0b6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7fb107200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0e8004810 0x7fb1001f8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7fb107200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb1000716b0 0x7fb1000b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7fb107200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb100070db0 0x7fb1000b6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7fb107200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fb1000d2840 con 0x7fb1000716b0 2024-04-26T20:57:01.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7fb107200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fb1000d26c0 con 0x7fb0e8004810 2024-04-26T20:57:01.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7fb107200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb1000d29c0 con 0x7fb100070db0 2024-04-26T20:57:01.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7fb0ffe00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0e8004810 0x7fb1001f8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7fb0ffe00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0e8004810 0x7fb1001f8ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.138:36828/0 (socket says 172.21.15.138:36828) 2024-04-26T20:57:01.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7fb0ffe00640 1 -- 172.21.15.138:0/979669825 learned_addr learned my addr 172.21.15.138:0/979669825 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:01.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7fb0ffe00640 1 -- 172.21.15.138:0/979669825 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb100070db0 msgr2=0x7fb1000b6320 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T20:57:01.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7fb0ffe00640 1 --2- 172.21.15.138:0/979669825 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb100070db0 0x7fb1000b6320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7fb0ffe00640 1 -- 172.21.15.138:0/979669825 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb1000716b0 msgr2=0x7fb1000b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7fbc08800640 1 -- 172.21.15.138:0/2446664033 shutdown_connections 2024-04-26T20:57:01.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.169+0000 7f3d22000640 1 -- 172.21.15.138:0/3302473834 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d140ab9e0 con 0x7f3d2415e7f0 2024-04-26T20:57:01.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7fb0ffe00640 1 --2- 172.21.15.138:0/979669825 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb1000716b0 0x7fb1000b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7fb0ffe00640 1 -- 172.21.15.138:0/979669825 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb10015de70 con 0x7fb0e8004810 2024-04-26T20:57:01.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7f09ab400640 1 -- 172.21.15.138:0/2809496322 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f09ac0cca00 msgr2=0x7f09ac0b6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7f09ab400640 1 --2- 172.21.15.138:0/2809496322 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f09ac0cca00 0x7f09ac0b6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7f09ab400640 1 -- 172.21.15.138:0/2809496322 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09ac15e0c0 msgr2=0x7f09ac0b37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7f09ab400640 1 --2- 172.21.15.138:0/2809496322 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09ac15e0c0 0x7f09ac0b37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7f09ab400640 1 -- 172.21.15.138:0/2809496322 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09ac0b5b70 con 0x7f09ac0b3d20 2024-04-26T20:57:01.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7f3d2a200640 1 -- 172.21.15.138:0/3302473834 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3d2415e7f0 msgr2=0x7f3d2406f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7f3d2a200640 1 --2- 172.21.15.138:0/3302473834 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3d2415e7f0 0x7f3d2406f1d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3d240762d0 tx=0x7f3d1401c460 comp rx=0 tx=0).stop 2024-04-26T20:57:01.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7f3d2a200640 1 -- 172.21.15.138:0/3302473834 shutdown_connections 2024-04-26T20:57:01.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7f3d2a200640 1 --2- 172.21.15.138:0/3302473834 >> v2:172.21.15.143:3300/0 conn(0x7f3d240cfa90 0x7f3d240cb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7f3d2a200640 1 --2- 172.21.15.138:0/3302473834 >> v2:172.21.15.138:3300/0 conn(0x7f3d240cf670 0x7f3d240cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7f3d2a200640 1 --2- 172.21.15.138:0/3302473834 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3d2415e7f0 0x7f3d2406f1d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7f3d2a200640 1 -- 172.21.15.138:0/3302473834 >> 172.21.15.138:0/3302473834 conn(0x7f3d240d0b20 msgr2=0x7f3d240d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:01.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7fb0ffe00640 1 --2- 172.21.15.138:0/979669825 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0e8004810 0x7fb1001f8ef0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8007a30 tx=0x7fb0f800f5a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7f3d2a200640 1 -- 172.21.15.138:0/3302473834 shutdown_connections 2024-04-26T20:57:01.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7f3d2a200640 1 -- 172.21.15.138:0/3302473834 wait complete. 2024-04-26T20:57:01.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7f09ab400640 1 --2- 172.21.15.138:0/2809496322 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f09ac0b3d20 0x7f09ac14b010 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f09a400c700 tx=0x7f09a400cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7fbd8b400640 1 --2- 172.21.15.138:0/2881343988 >> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] conn(0x7fbd6c071bd0 0x7fbd6c074010 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7fb0f3e00640 1 -- 172.21.15.138:0/979669825 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f801a070 con 0x7fb0e8004810 2024-04-26T20:57:01.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7fb0f3e00640 1 -- 172.21.15.138:0/979669825 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0f8012350 con 0x7fb0e8004810 2024-04-26T20:57:01.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7f5eb6200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5eb006d6b0 0x7f5eb0159190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7f5eb6200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5eb00d36c0 0x7f5eb00c7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7f5eb6200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5eb015f3a0 0x7f5eb00cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7f5eb4e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5eb006d6b0 0x7f5eb0159190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7fbc08800640 1 -- 172.21.15.138:0/2446664033 wait complete. 2024-04-26T20:57:01.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7fb55a000640 1 -- 172.21.15.138:0/3409270217 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb55401a070 con 0x7fb5640d1590 2024-04-26T20:57:01.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7f5eb4e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5eb006d6b0 0x7f5eb0159190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.138:36842/0 (socket says 172.21.15.138:36842) 2024-04-26T20:57:01.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7f5eafe00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5eb00d36c0 0x7f5eb00c7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7f5eafe00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5eb00d36c0 0x7f5eb00c7920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.138:47774/0 (socket says 172.21.15.138:47774) 2024-04-26T20:57:01.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7f09a2a00640 1 -- 172.21.15.138:0/2809496322 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a4003ba0 con 0x7f09ac0b3d20 2024-04-26T20:57:01.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7f09a2a00640 1 -- 172.21.15.138:0/2809496322 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09a4003d60 con 0x7f09ac0b3d20 2024-04-26T20:57:01.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7f09a2a00640 1 -- 172.21.15.138:0/2809496322 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a400aa90 con 0x7f09ac0b3d20 2024-04-26T20:57:01.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7f5eb5800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5eb015f3a0 0x7f5eb00cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7f09b1800640 1 -- 172.21.15.138:0/2809496322 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09ac14bbf0 con 0x7f09ac0b3d20 2024-04-26T20:57:01.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7f5eb5800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5eb015f3a0 0x7f5eb00cc0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:56968/0 (socket says 172.21.15.138:56968) 2024-04-26T20:57:01.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7f09b1800640 1 -- 172.21.15.138:0/2809496322 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f09ac14c1b0 con 0x7f09ac0b3d20 2024-04-26T20:57:01.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7f5eb6200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb016c550 con 0x7f5eb015f3a0 2024-04-26T20:57:01.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7f5eb6200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb00d1b90 con 0x7f5eb006d6b0 2024-04-26T20:57:01.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7f5eb6200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f5eb016c6d0 con 0x7f5eb00d36c0 2024-04-26T20:57:01.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7fbd83e00640 1 -- 172.21.15.138:0/2881343988 <== osd.2 v2:172.21.15.138:6808/4273721573 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbd6c0746e0 con 0x7fbd6c071bd0 2024-04-26T20:57:01.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7fb0f3e00640 1 -- 172.21.15.138:0/979669825 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f8012700 con 0x7fb0e8004810 2024-04-26T20:57:01.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7fb107200640 1 -- 172.21.15.138:0/979669825 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb10015e150 con 0x7fb0e8004810 2024-04-26T20:57:01.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7fb107200640 1 -- 172.21.15.138:0/979669825 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb10015e710 con 0x7fb0e8004810 2024-04-26T20:57:01.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7fbc08800640 1 Processor -- start 2024-04-26T20:57:01.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.173+0000 7f5eb4e00640 1 -- 172.21.15.138:0/4157540624 learned_addr learned my addr 172.21.15.138:0/4157540624 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:01.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.177+0000 7ff10e800640 1 --2- 172.21.15.138:0/1673886909 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1080d09e0 0x7ff1080d0e60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff104009d90 tx=0x7ff10401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12cdb9d6b5911217 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.177+0000 7f3d2a200640 1 Processor -- start 2024-04-26T20:57:01.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.177+0000 7f09b1800640 1 -- 172.21.15.138:0/2809496322 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f09ac14c3b0 con 0x7f09ac0b3d20 2024-04-26T20:57:01.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.177+0000 7fb107200640 1 -- 172.21.15.138:0/979669825 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb100069b40 con 0x7fb0e8004810 2024-04-26T20:57:01.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.177+0000 7fb55a000640 1 --2- 172.21.15.138:0/3409270217 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb544068480 0x7fb54406a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.177+0000 7f3d2a200640 1 -- start start 2024-04-26T20:57:01.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.177+0000 7ff10ca00640 1 -- 172.21.15.138:0/1673886909 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1040b2070 con 0x7ff1080d09e0 2024-04-26T20:57:01.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.177+0000 7ff10ca00640 1 -- 172.21.15.138:0/1673886909 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1040a5920 con 0x7ff1080d09e0 2024-04-26T20:57:01.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.177+0000 7ff10ca00640 1 -- 172.21.15.138:0/1673886909 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1040a5cf0 con 0x7ff1080d09e0 2024-04-26T20:57:01.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.177+0000 7f5eb4e00640 1 -- 172.21.15.138:0/4157540624 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5eb00d36c0 msgr2=0x7f5eb00c7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.177+0000 7f5eb4e00640 1 --2- 172.21.15.138:0/4157540624 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5eb00d36c0 0x7f5eb00c7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.177+0000 7f5eb4e00640 1 -- 172.21.15.138:0/4157540624 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5eb015f3a0 msgr2=0x7f5eb00cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.177+0000 7f5eb4e00640 1 --2- 172.21.15.138:0/4157540624 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5eb015f3a0 0x7f5eb00cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.177+0000 7f5eb4e00640 1 -- 172.21.15.138:0/4157540624 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5eb01596d0 con 0x7f5eb006d6b0 2024-04-26T20:57:01.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.177+0000 7f5eb4e00640 1 --2- 172.21.15.138:0/4157540624 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5eb006d6b0 0x7f5eb0159190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5ea000e8c0 tx=0x7f5ea000ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.177+0000 7fb55a000640 1 -- 172.21.15.138:0/3409270217 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fb5540869c0 con 0x7fb5640d1590 2024-04-26T20:57:01.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.177+0000 7fb55a000640 1 --2- 172.21.15.138:0/3409270217 >> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] conn(0x7fb544071bf0 0x7fb544074030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.177+0000 7f5eacc00640 1 -- 172.21.15.138:0/4157540624 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea0017070 con 0x7f5eb006d6b0 2024-04-26T20:57:01.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.177+0000 7fb55a000640 1 -- 172.21.15.138:0/3409270217 --> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb55400c730 con 0x7fb544071bf0 2024-04-26T20:57:01.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.177+0000 7fb55a000640 1 -- 172.21.15.138:0/3409270217 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb55408b2a0 con 0x7fb5640d1590 2024-04-26T20:57:01.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.177+0000 7fb561e00640 1 --2- 172.21.15.138:0/3409270217 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb544068480 0x7fb54406a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.177+0000 7f5eb6200640 1 -- 172.21.15.138:0/4157540624 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5eb00cb030 con 0x7f5eb006d6b0 2024-04-26T20:57:01.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.177+0000 7f5eacc00640 1 -- 172.21.15.138:0/4157540624 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ea000c940 con 0x7f5eb006d6b0 2024-04-26T20:57:01.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.177+0000 7f5eacc00640 1 -- 172.21.15.138:0/4157540624 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea0017070 con 0x7f5eb006d6b0 2024-04-26T20:57:01.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.177+0000 7fbc08800640 1 -- start start 2024-04-26T20:57:01.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.177+0000 7f3d2a200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d240cf670 0x7f3d240c6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.177+0000 7f3d2a200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3d240cfa90 0x7f3d2414ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.177+0000 7f3d2a200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3d2415e7f0 0x7f3d24150880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.177+0000 7ff110800640 1 -- 172.21.15.138:0/1673886909 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1080d09e0 msgr2=0x7ff1080d0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.177+0000 7ff110800640 1 --2- 172.21.15.138:0/1673886909 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1080d09e0 0x7ff1080d0e60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff104009d90 tx=0x7ff10401c970 comp rx=0 tx=0).stop 2024-04-26T20:57:01.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.177+0000 7f3d2a200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f3d240ceac0 con 0x7f3d240cf670 2024-04-26T20:57:01.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.177+0000 7f3d2a200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f3d240ce940 con 0x7f3d240cfa90 2024-04-26T20:57:01.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.177+0000 7f3d2a200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f3d240726f0 con 0x7f3d2415e7f0 2024-04-26T20:57:01.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.177+0000 7f3d23e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3d2415e7f0 0x7f3d24150880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.177+0000 7f3d23e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3d2415e7f0 0x7f3d24150880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.138:47776/0 (socket says 172.21.15.138:47776) 2024-04-26T20:57:01.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.177+0000 7f3d23e00640 1 -- 172.21.15.138:0/3869254801 learned_addr learned my addr 172.21.15.138:0/3869254801 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:01.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.177+0000 7f3d22a00640 1 --2- 172.21.15.138:0/3869254801 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3d240cfa90 0x7f3d2414ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.177+0000 7ff110800640 1 -- 172.21.15.138:0/1673886909 shutdown_connections 2024-04-26T20:57:01.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.177+0000 7ff110800640 1 --2- 172.21.15.138:0/1673886909 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1080d09e0 0x7ff1080d0e60 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.177+0000 7ff110800640 1 --2- 172.21.15.138:0/1673886909 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff1080c6410 0x7ff1080b30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.177+0000 7ff110800640 1 -- 172.21.15.138:0/1673886909 >> 172.21.15.138:0/1673886909 conn(0x7ff1080d2d30 msgr2=0x7ff1080d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:01.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.177+0000 7ff110800640 1 -- 172.21.15.138:0/1673886909 shutdown_connections 2024-04-26T20:57:01.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.177+0000 7fb561400640 1 --2- 172.21.15.138:0/3409270217 >> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] conn(0x7fb544071bf0 0x7fb544074030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.177+0000 7f3d23400640 1 --2- 172.21.15.138:0/3869254801 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d240cf670 0x7f3d240c6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.177+0000 7f3d23e00640 1 -- 172.21.15.138:0/3869254801 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3d240cfa90 msgr2=0x7f3d2414ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.177+0000 7f3d23e00640 1 --2- 172.21.15.138:0/3869254801 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3d240cfa90 0x7f3d2414ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.177+0000 7f3d23e00640 1 -- 172.21.15.138:0/3869254801 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d240cf670 msgr2=0x7f3d240c6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.177+0000 7f3d23e00640 1 --2- 172.21.15.138:0/3869254801 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d240cf670 0x7f3d240c6f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.177+0000 7f3d23e00640 1 -- 172.21.15.138:0/3869254801 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d24148d90 con 0x7f3d2415e7f0 2024-04-26T20:57:01.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.177+0000 7f3d23400640 1 --2- 172.21.15.138:0/3869254801 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d240cf670 0x7f3d240c6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:57:01.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.181+0000 7fb0f3e00640 1 -- 172.21.15.138:0/979669825 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb0f80128a0 con 0x7fb0e8004810 2024-04-26T20:57:01.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.181+0000 7f3d23e00640 1 --2- 172.21.15.138:0/3869254801 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3d2415e7f0 0x7f3d24150880 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c00cea0 tx=0x7f3d1c00cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.177+0000 7ff110800640 1 -- 172.21.15.138:0/1673886909 wait complete. 2024-04-26T20:57:01.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.177+0000 7f09a2a00640 1 -- 172.21.15.138:0/2809496322 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f09a400ac30 con 0x7f09ac0b3d20 2024-04-26T20:57:01.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.181+0000 7f09a2a00640 1 --2- 172.21.15.138:0/2809496322 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f098c068400 0x7f098c06a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.181+0000 7f09a2a00640 1 -- 172.21.15.138:0/2809496322 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f09a4086a90 con 0x7f09ac0b3d20 2024-04-26T20:57:01.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.181+0000 7f09a2a00640 1 --2- 172.21.15.138:0/2809496322 >> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] conn(0x7f098c071b00 0x7f098c073f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.181+0000 7f09a2a00640 1 -- 172.21.15.138:0/2809496322 --> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f098c074610 con 0x7f098c071b00 2024-04-26T20:57:01.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.181+0000 7f09a2a00640 1 -- 172.21.15.138:0/2809496322 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f09a4052940 con 0x7f09ac0b3d20 2024-04-26T20:57:01.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.181+0000 7f09aa000640 1 --2- 172.21.15.138:0/2809496322 >> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] conn(0x7f098c071b00 0x7f098c073f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.181+0000 7f3d1b400640 1 -- 172.21.15.138:0/3869254801 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d1c003ba0 con 0x7f3d2415e7f0 2024-04-26T20:57:01.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.181+0000 7f3d1b400640 1 -- 172.21.15.138:0/3869254801 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d1c003d60 con 0x7f3d2415e7f0 2024-04-26T20:57:01.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.181+0000 7f3d1b400640 1 -- 172.21.15.138:0/3869254801 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d1c00d880 con 0x7f3d2415e7f0 2024-04-26T20:57:01.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.181+0000 7f3d2a200640 1 -- 172.21.15.138:0/3869254801 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d24149070 con 0x7f3d2415e7f0 2024-04-26T20:57:01.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.181+0000 7f09aaa00640 1 --2- 172.21.15.138:0/2809496322 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f098c068400 0x7f098c06a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.181+0000 7fb0f3e00640 1 --2- 172.21.15.138:0/979669825 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb0e00683b0 0x7fb0e006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.181+0000 7fb561e00640 1 --2- 172.21.15.138:0/3409270217 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb544068480 0x7fb54406a940 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb550006b20 tx=0x7fb550008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.181+0000 7f3d2a200640 1 -- 172.21.15.138:0/3869254801 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d240c7450 con 0x7f3d2415e7f0 2024-04-26T20:57:01.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.181+0000 7fb0f3e00640 1 -- 172.21.15.138:0/979669825 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fb0f8087150 con 0x7fb0e8004810 2024-04-26T20:57:01.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.181+0000 7fb561400640 1 --2- 172.21.15.138:0/3409270217 >> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] conn(0x7fb544071bf0 0x7fb544074030 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.181+0000 7ff110800640 1 Processor -- start 2024-04-26T20:57:01.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.181+0000 7fb0f3e00640 1 --2- 172.21.15.138:0/979669825 >> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] conn(0x7fb0e0071aa0 0x7fb0e0073ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.181+0000 7fb0f3e00640 1 -- 172.21.15.138:0/979669825 --> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb0f8019ec0 con 0x7fb0e0071aa0 2024-04-26T20:57:01.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.181+0000 7fb0f3e00640 1 -- 172.21.15.138:0/979669825 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb0f8087500 con 0x7fb0e8004810 2024-04-26T20:57:01.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.181+0000 7fb0ff400640 1 --2- 172.21.15.138:0/979669825 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb0e00683b0 0x7fb0e006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.181+0000 7f5eacc00640 1 -- 172.21.15.138:0/4157540624 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5ea001a070 con 0x7f5eb006d6b0 2024-04-26T20:57:01.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.181+0000 7f5eb6200640 1 -- 172.21.15.138:0/4157540624 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5eb00cb5f0 con 0x7f5eb006d6b0 2024-04-26T20:57:01.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.181+0000 7f5eacc00640 1 --2- 172.21.15.138:0/4157540624 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5e90068580 0x7f5e9006aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.181+0000 7f5eacc00640 1 -- 172.21.15.138:0/4157540624 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f5ea00842f0 con 0x7f5eb006d6b0 2024-04-26T20:57:01.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.181+0000 7ff110800640 1 -- start start 2024-04-26T20:57:01.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.181+0000 7f3d2a200640 1 -- 172.21.15.138:0/3869254801 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3d24069510 con 0x7f3d2415e7f0 2024-04-26T20:57:01.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.181+0000 7fb55a000640 1 -- 172.21.15.138:0/3409270217 <== osd.1 v2:172.21.15.138:6816/1427635773 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb55400c730 con 0x7fb544071bf0 2024-04-26T20:57:01.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.181+0000 7f5eb6200640 1 --2- 172.21.15.138:0/4157540624 >> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] conn(0x7f5eb00cc610 0x7f5eb00cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.181+0000 7f5eb6200640 1 -- 172.21.15.138:0/4157540624 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5eb00cbd30 con 0x7f5eb00cc610 2024-04-26T20:57:01.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.181+0000 7f5eafe00640 1 --2- 172.21.15.138:0/4157540624 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5e90068580 0x7f5e9006aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.181+0000 7f5eb5800640 1 --2- 172.21.15.138:0/4157540624 >> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] conn(0x7f5eb00cc610 0x7f5eb00cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7f09aa000640 1 --2- 172.21.15.138:0/2809496322 >> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] conn(0x7f098c071b00 0x7f098c073f40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7f09aaa00640 1 --2- 172.21.15.138:0/2809496322 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f098c068400 0x7f098c06a8c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f099c0af000 tx=0x7f099c0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7f5eafe00640 1 --2- 172.21.15.138:0/4157540624 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5e90068580 0x7f5e9006aa40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c0af000 tx=0x7f5e9c0b6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7ff110800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1080c6410 0x7ff1081565a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7ff110800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff1080d09e0 0x7ff1080cc710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7ff110800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff108166a20 0x7ff108163900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7ff110800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff1080b3e90 con 0x7ff1080c6410 2024-04-26T20:57:01.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7ff110800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ff108166e00 con 0x7ff1080d09e0 2024-04-26T20:57:01.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7ff110800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ff1080b4010 con 0x7ff108166a20 2024-04-26T20:57:01.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7fbc08800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbc000c48f0 0x7fbc0015d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7fbc08800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc00161170 0x7fbc0015b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7fbc08800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbc001647c0 0x7fbc0015ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7fb105200640 1 --2- 172.21.15.138:0/979669825 >> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] conn(0x7fb0e0071aa0 0x7fb0e0073ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7fb0ff400640 1 --2- 172.21.15.138:0/979669825 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb0e00683b0 0x7fb0e006a870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb0f40b2000 tx=0x7fb0f4004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7ff10d400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff1080d09e0 0x7ff1080cc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7ff10d400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff1080d09e0 0x7ff1080cc710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.138:36858/0 (socket says 172.21.15.138:36858) 2024-04-26T20:57:01.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7ff10d400640 1 -- 172.21.15.138:0/1892651907 learned_addr learned my addr 172.21.15.138:0/1892651907 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:01.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7ff10e800640 1 --2- 172.21.15.138:0/1892651907 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff108166a20 0x7ff108163900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7fbc08800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fbc000d0f70 con 0x7fbc00161170 2024-04-26T20:57:01.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7fbc08800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fbc000d0df0 con 0x7fbc000c48f0 2024-04-26T20:57:01.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7fbc08800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fbc001714a0 con 0x7fbc001647c0 2024-04-26T20:57:01.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7fbc06800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbc001647c0 0x7fbc0015ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7fbc06800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbc001647c0 0x7fbc0015ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.138:47782/0 (socket says 172.21.15.138:47782) 2024-04-26T20:57:01.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7fbc06800640 1 -- 172.21.15.138:0/863097701 learned_addr learned my addr 172.21.15.138:0/863097701 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:01.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7fbc05e00640 1 --2- 172.21.15.138:0/863097701 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbc000c48f0 0x7fbc0015d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7f09a2a00640 1 -- 172.21.15.138:0/2809496322 <== osd.5 v2:172.21.15.143:6808/1910222887 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f098c074610 con 0x7f098c071b00 2024-04-26T20:57:01.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7f5eb5800640 1 --2- 172.21.15.138:0/4157540624 >> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] conn(0x7f5eb00cc610 0x7f5eb00cb7f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7ff10d400640 1 -- 172.21.15.138:0/1892651907 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff108166a20 msgr2=0x7ff108163900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7ff10d400640 1 --2- 172.21.15.138:0/1892651907 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff108166a20 0x7ff108163900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7ff10d400640 1 -- 172.21.15.138:0/1892651907 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1080c6410 msgr2=0x7ff1081565a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T20:57:01.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7f3d1b400640 1 -- 172.21.15.138:0/3869254801 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3d1c00da20 con 0x7f3d2415e7f0 2024-04-26T20:57:01.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7fbc06800640 1 -- 172.21.15.138:0/863097701 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbc000c48f0 msgr2=0x7fbc0015d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7fbc06800640 1 --2- 172.21.15.138:0/863097701 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbc000c48f0 0x7fbc0015d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7fbc06800640 1 -- 172.21.15.138:0/863097701 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc00161170 msgr2=0x7fbc0015b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7fbc06800640 1 --2- 172.21.15.138:0/863097701 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc00161170 0x7fbc0015b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7fbc06800640 1 -- 172.21.15.138:0/863097701 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc000c78d0 con 0x7fbc001647c0 2024-04-26T20:57:01.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7fbc06800640 1 --2- 172.21.15.138:0/863097701 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbc001647c0 0x7fbc0015ba80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc01a5a0 tx=0x7fbbfc019710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7f3d1b400640 1 --2- 172.21.15.138:0/3869254801 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f3d04068380 0x7f3d0406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7ff10de00640 1 --2- 172.21.15.138:0/1892651907 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1080c6410 0x7ff1081565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7ff10d400640 1 --2- 172.21.15.138:0/1892651907 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1080c6410 0x7ff1081565a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7ff10d400640 1 -- 172.21.15.138:0/1892651907 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff108156ae0 con 0x7ff1080d09e0 2024-04-26T20:57:01.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7f3d1b400640 1 -- 172.21.15.138:0/3869254801 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f3d1c0875c0 con 0x7f3d2415e7f0 2024-04-26T20:57:01.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7ff10de00640 1 --2- 172.21.15.138:0/1892651907 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1080c6410 0x7ff1081565a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:57:01.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7f5eacc00640 1 -- 172.21.15.138:0/4157540624 <== osd.3 v2:172.21.15.138:6824/3098242154 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5eb00cbd30 con 0x7f5eb00cc610 2024-04-26T20:57:01.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7f3d1b400640 1 --2- 172.21.15.138:0/3869254801 >> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] conn(0x7f3d04071af0 0x7f3d04073f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7f3d1b400640 1 -- 172.21.15.138:0/3869254801 --> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3d1c012e50 con 0x7f3d04071af0 2024-04-26T20:57:01.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7f3d1b400640 1 -- 172.21.15.138:0/3869254801 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3d1c08e050 con 0x7f3d2415e7f0 2024-04-26T20:57:01.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7ff10d400640 1 --2- 172.21.15.138:0/1892651907 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff1080d09e0 0x7ff1080cc710 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff0f800e810 tx=0x7ff0f800ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7fb105200640 1 --2- 172.21.15.138:0/979669825 >> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] conn(0x7fb0e0071aa0 0x7fb0e0073ee0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7f3d23400640 1 --2- 172.21.15.138:0/3869254801 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f3d04068380 0x7f3d0406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7ff102000640 1 -- 172.21.15.138:0/1892651907 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f800f040 con 0x7ff1080d09e0 2024-04-26T20:57:01.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7f3d22a00640 1 --2- 172.21.15.138:0/3869254801 >> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] conn(0x7f3d04071af0 0x7f3d04073f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7ff110800640 1 -- 172.21.15.138:0/1892651907 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff108162860 con 0x7ff1080d09e0 2024-04-26T20:57:01.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7ff102000640 1 -- 172.21.15.138:0/1892651907 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0f8004020 con 0x7ff1080d09e0 2024-04-26T20:57:01.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.185+0000 7ff110800640 1 -- 172.21.15.138:0/1892651907 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff108162e20 con 0x7ff1080d09e0 2024-04-26T20:57:01.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.189+0000 7fbbfa000640 1 -- 172.21.15.138:0/863097701 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc0b2050 con 0x7fbc001647c0 2024-04-26T20:57:01.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.189+0000 7fbbfa000640 1 -- 172.21.15.138:0/863097701 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbfc0be070 con 0x7fbc001647c0 2024-04-26T20:57:01.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.189+0000 7fbc08800640 1 -- 172.21.15.138:0/863097701 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc0015aa60 con 0x7fbc001647c0 2024-04-26T20:57:01.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.189+0000 7fbc08800640 1 -- 172.21.15.138:0/863097701 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc0015b020 con 0x7fbc001647c0 2024-04-26T20:57:01.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.189+0000 7fbbfa000640 1 -- 172.21.15.138:0/863097701 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc0adb90 con 0x7fbc001647c0 2024-04-26T20:57:01.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.189+0000 7f3d23400640 1 --2- 172.21.15.138:0/3869254801 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f3d04068380 0x7f3d0406a840 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3d140af000 tx=0x7f3d140a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.189+0000 7f3d22a00640 1 --2- 172.21.15.138:0/3869254801 >> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] conn(0x7f3d04071af0 0x7f3d04073f30 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.189+0000 7f3d1b400640 1 -- 172.21.15.138:0/3869254801 <== osd.6 v2:172.21.15.143:6816/1082239825 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3d1c012e50 con 0x7f3d04071af0 2024-04-26T20:57:01.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.189+0000 7ff102000640 1 -- 172.21.15.138:0/1892651907 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f80043d0 con 0x7ff1080d09e0 2024-04-26T20:57:01.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.189+0000 7ff110800640 1 -- 172.21.15.138:0/1892651907 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff108069b40 con 0x7ff1080d09e0 2024-04-26T20:57:01.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.189+0000 7ff102000640 1 -- 172.21.15.138:0/1892651907 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff0f80096c0 con 0x7ff1080d09e0 2024-04-26T20:57:01.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.193+0000 7fb0f3e00640 1 -- 172.21.15.138:0/979669825 <== osd.0 v2:172.21.15.138:6800/3534772245 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb0f8019ec0 con 0x7fb0e0071aa0 2024-04-26T20:57:01.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.193+0000 7fbbfa000640 1 -- 172.21.15.138:0/863097701 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbbfc0c3460 con 0x7fbc001647c0 2024-04-26T20:57:01.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.193+0000 7fbc08800640 1 -- 172.21.15.138:0/863097701 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbbdc001040 con 0x7fbc001647c0 2024-04-26T20:57:01.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.193+0000 7ff102000640 1 --2- 172.21.15.138:0/1892651907 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff0ec068380 0x7ff0ec06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.193+0000 7ff102000640 1 -- 172.21.15.138:0/1892651907 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7ff0f8086e00 con 0x7ff1080d09e0 2024-04-26T20:57:01.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.193+0000 7ff102000640 1 --2- 172.21.15.138:0/1892651907 >> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] conn(0x7ff0ec071b00 0x7ff0ec073f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.193+0000 7ff102000640 1 -- 172.21.15.138:0/1892651907 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff0f8001d40 con 0x7ff0ec071b00 2024-04-26T20:57:01.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.193+0000 7ff102000640 1 -- 172.21.15.138:0/1892651907 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff0f8089460 con 0x7ff1080d09e0 2024-04-26T20:57:01.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.193+0000 7fbbfa000640 1 --2- 172.21.15.138:0/863097701 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fbbe4068450 0x7fbbe406a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.193+0000 7ff10e800640 1 --2- 172.21.15.138:0/1892651907 >> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] conn(0x7ff0ec071b00 0x7ff0ec073f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.193+0000 7fbbfa000640 1 -- 172.21.15.138:0/863097701 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fbbfc121ff0 con 0x7fbc001647c0 2024-04-26T20:57:01.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.193+0000 7fbc05e00640 1 --2- 172.21.15.138:0/863097701 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fbbe4068450 0x7fbbe406a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.193+0000 7ff10e800640 1 --2- 172.21.15.138:0/1892651907 >> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] conn(0x7ff0ec071b00 0x7ff0ec073f40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.193+0000 7fbbfa000640 1 --2- 172.21.15.138:0/863097701 >> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] conn(0x7fbbe4071b40 0x7fbbe4073f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.193+0000 7fbbfa000640 1 -- 172.21.15.138:0/863097701 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbbfc0aaec0 con 0x7fbbe4071b40 2024-04-26T20:57:01.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.193+0000 7fbc05e00640 1 --2- 172.21.15.138:0/863097701 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fbbe4068450 0x7fbbe406a910 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4000f70 tx=0x7fbbf4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.193+0000 7fbbfa000640 1 -- 172.21.15.138:0/863097701 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbbfc0f1920 con 0x7fbc001647c0 2024-04-26T20:57:01.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.193+0000 7ff10de00640 1 --2- 172.21.15.138:0/1892651907 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff0ec068380 0x7ff0ec06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.193+0000 7fbc05400640 1 --2- 172.21.15.138:0/863097701 >> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] conn(0x7fbbe4071b40 0x7fbbe4073f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.193+0000 7ff102000640 1 -- 172.21.15.138:0/1892651907 <== osd.7 v2:172.21.15.143:6824/3295508495 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff0f8001d40 con 0x7ff0ec071b00 2024-04-26T20:57:01.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.201+0000 7fbc05400640 1 --2- 172.21.15.138:0/863097701 >> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] conn(0x7fbbe4071b40 0x7fbbe4073f80 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.201+0000 7ff10de00640 1 --2- 172.21.15.138:0/1892651907 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff0ec068380 0x7ff0ec06a840 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc000f70 tx=0x7ff0fc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.201+0000 7fbbfa000640 1 -- 172.21.15.138:0/863097701 <== osd.4 v2:172.21.15.143:6800/2942056312 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbbfc0aaec0 con 0x7fbbe4071b40 2024-04-26T20:57:01.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.209+0000 7fbd91600640 1 -- 172.21.15.138:0/2881343988 --> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbd64002de0 con 0x7fbd6c071bd0 2024-04-26T20:57:01.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.209+0000 7fbd83e00640 1 -- 172.21.15.138:0/2881343988 <== osd.2 v2:172.21.15.138:6808/4273721573 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fbd64002de0 con 0x7fbd6c071bd0 2024-04-26T20:57:01.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.209+0000 7fbd91600640 1 -- 172.21.15.138:0/2881343988 >> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] conn(0x7fbd6c071bd0 msgr2=0x7fbd6c074010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.209+0000 7fbd91600640 1 --2- 172.21.15.138:0/2881343988 >> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] conn(0x7fbd6c071bd0 0x7fbd6c074010 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.209+0000 7fbd91600640 1 -- 172.21.15.138:0/2881343988 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fbd6c068450 msgr2=0x7fbd6c06a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.209+0000 7fbd91600640 1 --2- 172.21.15.138:0/2881343988 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fbd6c068450 0x7fbd6c06a910 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c15d430 tx=0x7fbd7c009040 comp rx=0 tx=0).stop 2024-04-26T20:57:01.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.209+0000 7fbd91600640 1 -- 172.21.15.138:0/2881343988 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd8c163b30 msgr2=0x7fbd8c15d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.209+0000 7fbd91600640 1 --2- 172.21.15.138:0/2881343988 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd8c163b30 0x7fbd8c15d8e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbd8400b970 tx=0x7fbd8400be30 comp rx=0 tx=0).stop 2024-04-26T20:57:01.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.209+0000 7fbd90c00640 1 -- 172.21.15.138:0/2881343988 reap_dead start 2024-04-26T20:57:01.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.209+0000 7fbd91600640 1 -- 172.21.15.138:0/2881343988 shutdown_connections 2024-04-26T20:57:01.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.209+0000 7fbd91600640 1 -- 172.21.15.138:0/2881343988 >> 172.21.15.138:0/2881343988 conn(0x7fbd8c0d0a70 msgr2=0x7fbd8c0b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:01.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.209+0000 7fbd91600640 1 -- 172.21.15.138:0/2881343988 shutdown_connections 2024-04-26T20:57:01.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.209+0000 7fbd91600640 1 -- 172.21.15.138:0/2881343988 wait complete. 2024-04-26T20:57:01.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.209+0000 7f09b1800640 1 -- 172.21.15.138:0/2809496322 --> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f09ac06fdb0 con 0x7f098c071b00 2024-04-26T20:57:01.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.209+0000 7fb563200640 1 -- 172.21.15.138:0/3409270217 --> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb56415ce10 con 0x7fb544071bf0 2024-04-26T20:57:01.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.213+0000 7f09a2a00640 1 -- 172.21.15.138:0/2809496322 <== osd.5 v2:172.21.15.143:6808/1910222887 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f09ac06fdb0 con 0x7f098c071b00 2024-04-26T20:57:01.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.213+0000 7fb55a000640 1 -- 172.21.15.138:0/3409270217 <== osd.1 v2:172.21.15.138:6816/1427635773 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb56415ce10 con 0x7fb544071bf0 2024-04-26T20:57:01.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.213+0000 7f09b1800640 1 -- 172.21.15.138:0/2809496322 >> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] conn(0x7f098c071b00 msgr2=0x7f098c073f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.213+0000 7f09b1800640 1 --2- 172.21.15.138:0/2809496322 >> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] conn(0x7f098c071b00 0x7f098c073f40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.213+0000 7f09b1800640 1 -- 172.21.15.138:0/2809496322 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f098c068400 msgr2=0x7f098c06a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.213+0000 7f09b1800640 1 --2- 172.21.15.138:0/2809496322 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f098c068400 0x7f098c06a8c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f099c0af000 tx=0x7f099c0a7000 comp rx=0 tx=0).stop 2024-04-26T20:57:01.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.213+0000 7f09b1800640 1 -- 172.21.15.138:0/2809496322 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f09ac0b3d20 msgr2=0x7f09ac14b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.213+0000 7f09b1800640 1 --2- 172.21.15.138:0/2809496322 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f09ac0b3d20 0x7f09ac14b010 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f09a400c700 tx=0x7f09a400cbc0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.213+0000 7f09ab400640 1 -- 172.21.15.138:0/2809496322 reap_dead start 2024-04-26T20:57:01.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.213+0000 7f09b1800640 1 -- 172.21.15.138:0/2809496322 shutdown_connections 2024-04-26T20:57:01.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.213+0000 7f09b1800640 1 -- 172.21.15.138:0/2809496322 >> 172.21.15.138:0/2809496322 conn(0x7f09ac0d0b20 msgr2=0x7f09ac169e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:01.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.213+0000 7f09b1800640 1 -- 172.21.15.138:0/2809496322 shutdown_connections 2024-04-26T20:57:01.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.213+0000 7f09b1800640 1 -- 172.21.15.138:0/2809496322 wait complete. 2024-04-26T20:57:01.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.213+0000 7fb563200640 1 -- 172.21.15.138:0/3409270217 >> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] conn(0x7fb544071bf0 msgr2=0x7fb544074030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.213+0000 7fb563200640 1 --2- 172.21.15.138:0/3409270217 >> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] conn(0x7fb544071bf0 0x7fb544074030 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.213+0000 7fb563200640 1 -- 172.21.15.138:0/3409270217 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb544068480 msgr2=0x7fb54406a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.213+0000 7fb563200640 1 --2- 172.21.15.138:0/3409270217 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb544068480 0x7fb54406a940 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb550006b20 tx=0x7fb550008040 comp rx=0 tx=0).stop 2024-04-26T20:57:01.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.213+0000 7fb563200640 1 -- 172.21.15.138:0/3409270217 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5640d1590 msgr2=0x7fb5640b50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.213+0000 7fb563200640 1 --2- 172.21.15.138:0/3409270217 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5640d1590 0x7fb5640b50a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb55400e7f0 tx=0x7fb55400ecb0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.213+0000 7fb562800640 1 -- 172.21.15.138:0/3409270217 reap_dead start 2024-04-26T20:57:01.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.213+0000 7fb563200640 1 -- 172.21.15.138:0/3409270217 shutdown_connections 2024-04-26T20:57:01.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.213+0000 7fb563200640 1 -- 172.21.15.138:0/3409270217 >> 172.21.15.138:0/3409270217 conn(0x7fb5640d0a70 msgr2=0x7fb564071cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:01.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.213+0000 7fb563200640 1 -- 172.21.15.138:0/3409270217 shutdown_connections 2024-04-26T20:57:01.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.213+0000 7fb563200640 1 -- 172.21.15.138:0/3409270217 wait complete. 2024-04-26T20:57:01.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.221+0000 7f5eb6200640 1 -- 172.21.15.138:0/4157540624 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5eb015c170 con 0x7f5eb00cc610 2024-04-26T20:57:01.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.221+0000 7f3d2a200640 1 -- 172.21.15.138:0/3869254801 --> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3d240b6a40 con 0x7f3d04071af0 2024-04-26T20:57:01.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.221+0000 7fb107200640 1 -- 172.21.15.138:0/979669825 --> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb1000a2e70 con 0x7fb0e0071aa0 2024-04-26T20:57:01.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.221+0000 7f5eacc00640 1 -- 172.21.15.138:0/4157540624 <== osd.3 v2:172.21.15.138:6824/3098242154 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5eb015c170 con 0x7f5eb00cc610 2024-04-26T20:57:01.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.221+0000 7f3d1b400640 1 -- 172.21.15.138:0/3869254801 <== osd.6 v2:172.21.15.143:6816/1082239825 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3d240b6a40 con 0x7f3d04071af0 2024-04-26T20:57:01.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.221+0000 7f5eb6200640 1 -- 172.21.15.138:0/4157540624 >> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] conn(0x7f5eb00cc610 msgr2=0x7f5eb00cb7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.221+0000 7f5eb6200640 1 --2- 172.21.15.138:0/4157540624 >> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] conn(0x7f5eb00cc610 0x7f5eb00cb7f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.221+0000 7fb0f3e00640 1 -- 172.21.15.138:0/979669825 <== osd.0 v2:172.21.15.138:6800/3534772245 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb1000a2e70 con 0x7fb0e0071aa0 2024-04-26T20:57:01.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.221+0000 7f3d2a200640 1 -- 172.21.15.138:0/3869254801 >> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] conn(0x7f3d04071af0 msgr2=0x7f3d04073f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.221+0000 7f3d2a200640 1 --2- 172.21.15.138:0/3869254801 >> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] conn(0x7f3d04071af0 0x7f3d04073f30 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.221+0000 7f5eb6200640 1 -- 172.21.15.138:0/4157540624 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5e90068580 msgr2=0x7f5e9006aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.221+0000 7f5eb6200640 1 --2- 172.21.15.138:0/4157540624 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5e90068580 0x7f5e9006aa40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c0af000 tx=0x7f5e9c0b6040 comp rx=0 tx=0).stop 2024-04-26T20:57:01.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.221+0000 7f5eb6200640 1 -- 172.21.15.138:0/4157540624 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5eb006d6b0 msgr2=0x7f5eb0159190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.221+0000 7f5eb6200640 1 --2- 172.21.15.138:0/4157540624 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5eb006d6b0 0x7f5eb0159190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5ea000e8c0 tx=0x7f5ea000ed80 comp rx=0 tx=0).stop 2024-04-26T20:57:01.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.221+0000 7f5eb5800640 1 -- 172.21.15.138:0/4157540624 reap_dead start 2024-04-26T20:57:01.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.221+0000 7f3d2a200640 1 -- 172.21.15.138:0/3869254801 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f3d04068380 msgr2=0x7f3d0406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.221+0000 7f3d2a200640 1 --2- 172.21.15.138:0/3869254801 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f3d04068380 0x7f3d0406a840 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3d140af000 tx=0x7f3d140a7000 comp rx=0 tx=0).stop 2024-04-26T20:57:01.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.221+0000 7f3d2a200640 1 -- 172.21.15.138:0/3869254801 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3d2415e7f0 msgr2=0x7f3d24150880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.221+0000 7f3d2a200640 1 --2- 172.21.15.138:0/3869254801 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3d2415e7f0 0x7f3d24150880 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c00cea0 tx=0x7f3d1c00cf90 comp rx=0 tx=0).stop 2024-04-26T20:57:01.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.225+0000 7f3d23e00640 1 -- 172.21.15.138:0/3869254801 reap_dead start 2024-04-26T20:57:01.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.225+0000 7f5eb6200640 1 -- 172.21.15.138:0/4157540624 shutdown_connections 2024-04-26T20:57:01.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.225+0000 7f5eb6200640 1 -- 172.21.15.138:0/4157540624 >> 172.21.15.138:0/4157540624 conn(0x7f5eb00d2ba0 msgr2=0x7f5eb00cda90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:01.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.225+0000 7fb107200640 1 -- 172.21.15.138:0/979669825 >> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] conn(0x7fb0e0071aa0 msgr2=0x7fb0e0073ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.225+0000 7fb107200640 1 --2- 172.21.15.138:0/979669825 >> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] conn(0x7fb0e0071aa0 0x7fb0e0073ee0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.225+0000 7f3d2a200640 1 -- 172.21.15.138:0/3869254801 shutdown_connections 2024-04-26T20:57:01.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.225+0000 7ff110800640 1 -- 172.21.15.138:0/1892651907 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff10806f9f0 con 0x7ff0ec071b00 2024-04-26T20:57:01.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.225+0000 7f3d2a200640 1 -- 172.21.15.138:0/3869254801 >> 172.21.15.138:0/3869254801 conn(0x7f3d240d0b20 msgr2=0x7f3d240cd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:01.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.225+0000 7f3d2a200640 1 -- 172.21.15.138:0/3869254801 shutdown_connections 2024-04-26T20:57:01.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.225+0000 7fb107200640 1 -- 172.21.15.138:0/979669825 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb0e00683b0 msgr2=0x7fb0e006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.225+0000 7fb107200640 1 --2- 172.21.15.138:0/979669825 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb0e00683b0 0x7fb0e006a870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb0f40b2000 tx=0x7fb0f4004740 comp rx=0 tx=0).stop 2024-04-26T20:57:01.273 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.225+0000 7f5eb6200640 1 -- 172.21.15.138:0/4157540624 shutdown_connections 2024-04-26T20:57:01.273 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.225+0000 7f3d2a200640 1 -- 172.21.15.138:0/3869254801 wait complete. 2024-04-26T20:57:01.273 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.225+0000 7f5eb6200640 1 -- 172.21.15.138:0/4157540624 wait complete. 2024-04-26T20:57:01.273 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.225+0000 7fb107200640 1 -- 172.21.15.138:0/979669825 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0e8004810 msgr2=0x7fb1001f8ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.225+0000 7fb107200640 1 --2- 172.21.15.138:0/979669825 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0e8004810 0x7fb1001f8ef0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8007a30 tx=0x7fb0f800f5a0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.225+0000 7ff102000640 1 -- 172.21.15.138:0/1892651907 <== osd.7 v2:172.21.15.143:6824/3295508495 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff10806f9f0 con 0x7ff0ec071b00 2024-04-26T20:57:01.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.225+0000 7fb105200640 1 -- 172.21.15.138:0/979669825 reap_dead start 2024-04-26T20:57:01.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.225+0000 7fb107200640 1 -- 172.21.15.138:0/979669825 shutdown_connections 2024-04-26T20:57:01.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.225+0000 7fb107200640 1 -- 172.21.15.138:0/979669825 >> 172.21.15.138:0/979669825 conn(0x7fb1000d1ba0 msgr2=0x7fb100157810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:01.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.225+0000 7ff110800640 1 -- 172.21.15.138:0/1892651907 >> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] conn(0x7ff0ec071b00 msgr2=0x7ff0ec073f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.225+0000 7ff110800640 1 --2- 172.21.15.138:0/1892651907 >> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] conn(0x7ff0ec071b00 0x7ff0ec073f40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.225+0000 7fb107200640 1 -- 172.21.15.138:0/979669825 shutdown_connections 2024-04-26T20:57:01.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.229+0000 7ff110800640 1 -- 172.21.15.138:0/1892651907 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff0ec068380 msgr2=0x7ff0ec06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.229+0000 7ff110800640 1 --2- 172.21.15.138:0/1892651907 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff0ec068380 0x7ff0ec06a840 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc000f70 tx=0x7ff0fc009040 comp rx=0 tx=0).stop 2024-04-26T20:57:01.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.229+0000 7ff110800640 1 -- 172.21.15.138:0/1892651907 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff1080d09e0 msgr2=0x7ff1080cc710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.229+0000 7ff110800640 1 --2- 172.21.15.138:0/1892651907 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff1080d09e0 0x7ff1080cc710 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff0f800e810 tx=0x7ff0f800ecd0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.229+0000 7ff10e800640 1 -- 172.21.15.138:0/1892651907 reap_dead start 2024-04-26T20:57:01.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.229+0000 7fb107200640 1 -- 172.21.15.138:0/979669825 wait complete. 2024-04-26T20:57:01.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.229+0000 7ff110800640 1 -- 172.21.15.138:0/1892651907 shutdown_connections 2024-04-26T20:57:01.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.229+0000 7ff110800640 1 -- 172.21.15.138:0/1892651907 >> 172.21.15.138:0/1892651907 conn(0x7ff1080d2d30 msgr2=0x7ff1081662f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:01.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.229+0000 7ff110800640 1 -- 172.21.15.138:0/1892651907 shutdown_connections 2024-04-26T20:57:01.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.229+0000 7ff110800640 1 -- 172.21.15.138:0/1892651907 wait complete. 2024-04-26T20:57:01.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.229+0000 7fbc08800640 1 -- 172.21.15.138:0/863097701 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbbdc002de0 con 0x7fbbe4071b40 2024-04-26T20:57:01.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.229+0000 7fbbfa000640 1 -- 172.21.15.138:0/863097701 <== osd.4 v2:172.21.15.143:6800/2942056312 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fbbdc002de0 con 0x7fbbe4071b40 2024-04-26T20:57:01.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.229+0000 7fbc08800640 1 -- 172.21.15.138:0/863097701 >> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] conn(0x7fbbe4071b40 msgr2=0x7fbbe4073f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.229+0000 7fbc08800640 1 --2- 172.21.15.138:0/863097701 >> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] conn(0x7fbbe4071b40 0x7fbbe4073f80 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.229+0000 7fbc08800640 1 -- 172.21.15.138:0/863097701 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fbbe4068450 msgr2=0x7fbbe406a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.229+0000 7fbc08800640 1 --2- 172.21.15.138:0/863097701 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fbbe4068450 0x7fbbe406a910 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4000f70 tx=0x7fbbf4009040 comp rx=0 tx=0).stop 2024-04-26T20:57:01.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.229+0000 7fbc08800640 1 -- 172.21.15.138:0/863097701 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbc001647c0 msgr2=0x7fbc0015ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.229+0000 7fbc08800640 1 --2- 172.21.15.138:0/863097701 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbc001647c0 0x7fbc0015ba80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc01a5a0 tx=0x7fbbfc019710 comp rx=0 tx=0).stop 2024-04-26T20:57:01.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.229+0000 7fbc06800640 1 -- 172.21.15.138:0/863097701 reap_dead start 2024-04-26T20:57:01.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.229+0000 7fbc08800640 1 -- 172.21.15.138:0/863097701 shutdown_connections 2024-04-26T20:57:01.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.233+0000 7fbc08800640 1 -- 172.21.15.138:0/863097701 >> 172.21.15.138:0/863097701 conn(0x7fbc0006ce00 msgr2=0x7fbc00158bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:01.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.237+0000 7fbc08800640 1 -- 172.21.15.138:0/863097701 shutdown_connections 2024-04-26T20:57:01.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.237+0000 7fbc08800640 1 -- 172.21.15.138:0/863097701 wait complete. 2024-04-26T20:57:01.280 INFO:teuthology.orchestra.run.smithi138.stdout:64424509450 2024-04-26T20:57:01.280 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T20:57:01.281 INFO:teuthology.orchestra.run.smithi138.stdout:64424509449 2024-04-26T20:57:01.281 INFO:teuthology.orchestra.run.smithi138.stdout:64424509450 2024-04-26T20:57:01.282 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-26T20:57:01.282 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T20:57:01.283 INFO:teuthology.orchestra.run.smithi138.stdout:64424509448 2024-04-26T20:57:01.283 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T20:57:01.284 INFO:teuthology.orchestra.run.smithi138.stdout:64424509449 2024-04-26T20:57:01.284 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-26T20:57:01.285 INFO:teuthology.orchestra.run.smithi138.stdout:64424509450 2024-04-26T20:57:01.285 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-26T20:57:01.286 INFO:teuthology.orchestra.run.smithi138.stdout:55834574858 2024-04-26T20:57:01.286 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-26T20:57:01.287 INFO:teuthology.orchestra.run.smithi138.stdout:64424509450 2024-04-26T20:57:01.287 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-26T20:57:01.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.561+0000 7f05f3200640 1 Processor -- start 2024-04-26T20:57:01.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.561+0000 7f05f3200640 1 -- start start 2024-04-26T20:57:01.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.561+0000 7f05f3200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05e4033e40 0x7f05e40eb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.561+0000 7f05f3200640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f05e4005ea0 0x7f05e40062f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.561+0000 7f05f3200640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05e4034220 con 0x7f05e4047c20 2024-04-26T20:57:01.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.561+0000 7f05f3200640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f05e4050210 con 0x7f05e4005ea0 2024-04-26T20:57:01.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.561+0000 7f05f3200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f05e4037bc0 con 0x7f05e4033e40 2024-04-26T20:57:01.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.561+0000 7f9d11a00640 1 Processor -- start 2024-04-26T20:57:01.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.561+0000 7f05ebe00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05e4033e40 0x7f05e40eb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.561+0000 7f05eb400640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f05e4047c20 0x7f05e40eb6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:43742/0 (socket says 172.21.15.138:43742) 2024-04-26T20:57:01.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.561+0000 7f05ebe00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05e4033e40 0x7f05e40eb180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.138:47798/0 (socket says 172.21.15.138:47798) 2024-04-26T20:57:01.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.561+0000 7f05eb400640 1 -- 172.21.15.138:0/3861087389 learned_addr learned my addr 172.21.15.138:0/3861087389 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:01.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.561+0000 7f9d11a00640 1 -- start start 2024-04-26T20:57:01.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.565+0000 7f05f1200640 1 --2- 172.21.15.138:0/3861087389 >> v2:172.21.15.143:3300/0 conn(0x7f05e4005ea0 0x7f05e40062f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.565+0000 7f05ebe00640 1 -- 172.21.15.138:0/3861087389 >> v2:172.21.15.143:3300/0 conn(0x7f05e4005ea0 msgr2=0x7f05e40062f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:01.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.565+0000 7f05ebe00640 1 --2- 172.21.15.138:0/3861087389 >> v2:172.21.15.143:3300/0 conn(0x7f05e4005ea0 0x7f05e40062f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.565+0000 7f05ebe00640 1 -- 172.21.15.138:0/3861087389 >> v1:172.21.15.138:6789/0 conn(0x7f05e4047c20 legacy=0x7f05e40eb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.565+0000 7f05ebe00640 1 -- 172.21.15.138:0/3861087389 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05e404fa30 con 0x7f05e4033e40 2024-04-26T20:57:01.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.565+0000 7f9d11a00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9d0c0ce8c0 0x7f9d0c0d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.565+0000 7f9d11a00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f9d0c071ee0 0x7f9d0c0ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.565+0000 7f9d0aa00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9d0c0ce8c0 0x7f9d0c0d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.565+0000 7f9d0aa00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9d0c0ce8c0 0x7f9d0c0d0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.138:36880/0 (socket says 172.21.15.138:36880) 2024-04-26T20:57:01.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.565+0000 7ff167a00640 1 Processor -- start 2024-04-26T20:57:01.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.565+0000 7ff167a00640 1 -- start start 2024-04-26T20:57:01.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.565+0000 7f9d0a000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f9d0c071ee0 0x7f9d0c0ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.565+0000 7f9d0a000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f9d0c071ee0 0x7f9d0c0ceca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:57008/0 (socket says 172.21.15.138:57008) 2024-04-26T20:57:01.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.565+0000 7f9d11a00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d0c163a30 con 0x7f9d0c0cf1e0 2024-04-26T20:57:01.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.565+0000 7f9d11a00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f9d0c0d09a0 con 0x7f9d0c071ee0 2024-04-26T20:57:01.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.565+0000 7f9d11a00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f9d0c0cb170 con 0x7f9d0c0ce8c0 2024-04-26T20:57:01.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.565+0000 7f9d0aa00640 1 -- 172.21.15.138:0/1044945752 learned_addr learned my addr 172.21.15.138:0/1044945752 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:01.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.565+0000 7f9d0aa00640 1 -- 172.21.15.138:0/1044945752 >> v2:172.21.15.138:3300/0 conn(0x7f9d0c071ee0 msgr2=0x7f9d0c0ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:01.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.565+0000 7f9d0aa00640 1 --2- 172.21.15.138:0/1044945752 >> v2:172.21.15.138:3300/0 conn(0x7f9d0c071ee0 0x7f9d0c0ceca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.565+0000 7f9d0aa00640 1 -- 172.21.15.138:0/1044945752 >> v1:172.21.15.143:6789/0 conn(0x7f9d0c0cf1e0 legacy=0x7f9d0c06eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:01.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.565+0000 7f9d0aa00640 1 -- 172.21.15.138:0/1044945752 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d0c0cd1b0 con 0x7f9d0c0ce8c0 2024-04-26T20:57:01.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.569+0000 7ff167a00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff1580e35b0 0x7ff158051980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.569+0000 7ff167a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff1580514a0 0x7ff158036080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.569+0000 7ff167a00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff158052260 con 0x7ff1580365c0 2024-04-26T20:57:01.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.569+0000 7ff167a00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7ff158052540 con 0x7ff1580e35b0 2024-04-26T20:57:01.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.569+0000 7ff167a00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ff158052820 con 0x7ff1580514a0 2024-04-26T20:57:01.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.569+0000 7f0108800640 1 Processor -- start 2024-04-26T20:57:01.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.569+0000 7f0108800640 1 -- start start 2024-04-26T20:57:01.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.569+0000 7ff15fe00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff1580514a0 0x7ff158036080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.569+0000 7ff15fe00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff1580514a0 0x7ff158036080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.138:47812/0 (socket says 172.21.15.138:47812) 2024-04-26T20:57:01.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.569+0000 7ff15fe00640 1 -- 172.21.15.138:0/1355507878 learned_addr learned my addr 172.21.15.138:0/1355507878 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:01.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.569+0000 7ff165000640 1 --2- 172.21.15.138:0/1355507878 >> v2:172.21.15.138:3300/0 conn(0x7ff1580e35b0 0x7ff158051980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.569+0000 7ff165000640 1 -- 172.21.15.138:0/1355507878 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff1580514a0 msgr2=0x7ff158036080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:01.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.569+0000 7ff165000640 1 --2- 172.21.15.138:0/1355507878 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff1580514a0 0x7ff158036080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.569+0000 7ff165000640 1 -- 172.21.15.138:0/1355507878 >> v1:172.21.15.143:6789/0 conn(0x7ff1580365c0 legacy=0x7ff15803a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.569+0000 7fc7eaa00640 1 Processor -- start 2024-04-26T20:57:01.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.569+0000 7ff165000640 1 -- 172.21.15.138:0/1355507878 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff158052b00 con 0x7ff1580e35b0 2024-04-26T20:57:01.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.569+0000 7f0108800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f01000c84e0 0x7f01000d3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.569+0000 7fc7eaa00640 1 -- start start 2024-04-26T20:57:01.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.569+0000 7f0108800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f01000b3d10 0x7f01000d3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.569+0000 7f0108800640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01000d04d0 con 0x7f01000b4260 2024-04-26T20:57:01.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.569+0000 7f0108800640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f01000d07b0 con 0x7f01000b3d10 2024-04-26T20:57:01.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.569+0000 7f0108800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f01000d0a90 con 0x7f01000c84e0 2024-04-26T20:57:01.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.573+0000 7f0105e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f01000c84e0 0x7f01000d3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.573+0000 7f0105400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f01000b3d10 0x7f01000d3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.573+0000 7f0105e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f01000c84e0 0x7f01000d3450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.138:47824/0 (socket says 172.21.15.138:47824) 2024-04-26T20:57:01.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.573+0000 7f0105e00640 1 -- 172.21.15.138:0/597159672 learned_addr learned my addr 172.21.15.138:0/597159672 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:01.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.569+0000 7f563c000640 1 Processor -- start 2024-04-26T20:57:01.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.573+0000 7f563c000640 1 -- start start 2024-04-26T20:57:01.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.573+0000 7fc7eaa00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc7e40cb880 0x7fc7e406de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.569+0000 7f05ebe00640 1 --2- 172.21.15.138:0/3861087389 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05e4033e40 0x7f05e40eb180 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f05e00097c0 tx=0x7f05e001ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81039a72a3158c7a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.569+0000 7f9d0aa00640 1 --2- 172.21.15.138:0/1044945752 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9d0c0ce8c0 0x7f9d0c0d0460 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c06d9d0 tx=0x7f9cfc01eb10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9eeee444300987 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.573+0000 7fc7eaa00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7e40cec00 0x7fc7e406f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.573+0000 7f05eaa00640 1 -- 172.21.15.138:0/3861087389 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e00b5070 con 0x7f05e4033e40 2024-04-26T20:57:01.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.573+0000 7fc7eaa00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7e40cfce0 con 0x7fc7e415b1a0 2024-04-26T20:57:01.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.573+0000 7fc7eaa00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fc7e406fa10 con 0x7fc7e40cb880 2024-04-26T20:57:01.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.573+0000 7fc7eaa00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fc7e406e450 con 0x7fc7e40cec00 2024-04-26T20:57:01.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.573+0000 7f05eaa00640 1 -- 172.21.15.138:0/3861087389 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05e00a8990 con 0x7f05e4033e40 2024-04-26T20:57:01.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.573+0000 7f05eaa00640 1 -- 172.21.15.138:0/3861087389 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e00a8d60 con 0x7f05e4033e40 2024-04-26T20:57:01.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.573+0000 7f0105e00640 1 -- 172.21.15.138:0/597159672 >> v2:172.21.15.138:3300/0 conn(0x7f01000b3d10 msgr2=0x7f01000d3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:01.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.573+0000 7f0105e00640 1 --2- 172.21.15.138:0/597159672 >> v2:172.21.15.138:3300/0 conn(0x7f01000b3d10 0x7f01000d3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.573+0000 7f0105e00640 1 -- 172.21.15.138:0/597159672 >> v1:172.21.15.138:6789/0 conn(0x7f01000b4260 legacy=0x7f01000d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.573+0000 7f05f3200640 1 -- 172.21.15.138:0/3861087389 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05e4033e40 msgr2=0x7f05e40eb180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.573+0000 7f05f3200640 1 --2- 172.21.15.138:0/3861087389 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05e4033e40 0x7f05e40eb180 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f05e00097c0 tx=0x7f05e001ecb0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.573+0000 7f0105e00640 1 -- 172.21.15.138:0/597159672 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01000d5990 con 0x7f01000c84e0 2024-04-26T20:57:01.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.573+0000 7fc7e3400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc7e40cb880 0x7fc7e406de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.573+0000 7f9d09600640 1 -- 172.21.15.138:0/1044945752 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc0b5070 con 0x7f9d0c0ce8c0 2024-04-26T20:57:01.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.573+0000 7f9d09600640 1 -- 172.21.15.138:0/1044945752 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cfc0a87f0 con 0x7f9d0c0ce8c0 2024-04-26T20:57:01.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.573+0000 7f9d09600640 1 -- 172.21.15.138:0/1044945752 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc0a8bc0 con 0x7f9d0c0ce8c0 2024-04-26T20:57:01.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.573+0000 7f9d11a00640 1 -- 172.21.15.138:0/1044945752 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9d0c0ce8c0 msgr2=0x7f9d0c0d0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.573+0000 7f9d11a00640 1 --2- 172.21.15.138:0/1044945752 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9d0c0ce8c0 0x7f9d0c0d0460 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c06d9d0 tx=0x7f9cfc01eb10 comp rx=0 tx=0).stop 2024-04-26T20:57:01.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.573+0000 7f05f3200640 1 -- 172.21.15.138:0/3861087389 shutdown_connections 2024-04-26T20:57:01.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.573+0000 7f05f3200640 1 --2- 172.21.15.138:0/3861087389 >> v2:172.21.15.143:3300/0 conn(0x7f05e4005ea0 0x7f05e40062f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.573+0000 7f05f3200640 1 --2- 172.21.15.138:0/3861087389 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05e4033e40 0x7f05e40eb180 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.573+0000 7f05f3200640 1 -- 172.21.15.138:0/3861087389 >> 172.21.15.138:0/3861087389 conn(0x7f05e4009fc0 msgr2=0x7f05e400a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:01.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.573+0000 7f563c000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f563415b160 0x7f56340b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.573+0000 7f5639600640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f563406fe30 0x7f5634071f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.138:36104/0 (socket says 172.21.15.138:36104) 2024-04-26T20:57:01.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.573+0000 7f5639600640 1 -- 172.21.15.138:0/199043661 learned_addr learned my addr 172.21.15.138:0/199043661 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:01.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.573+0000 7f563c000640 1 -- 172.21.15.138:0/199043661 --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56340b4ed0 con 0x7f5634072610 2024-04-26T20:57:01.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.573+0000 7f563c000640 1 -- 172.21.15.138:0/199043661 --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56340b51b0 con 0x7f563406fe30 2024-04-26T20:57:01.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.573+0000 7f563c000640 1 -- 172.21.15.138:0/199043661 --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f56340b5770 con 0x7f563415b160 2024-04-26T20:57:01.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.573+0000 7fc7e8a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7e40cec00 0x7fc7e406f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.573+0000 7fc7e8a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7e40cec00 0x7fc7e406f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.138:47836/0 (socket says 172.21.15.138:47836) 2024-04-26T20:57:01.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.573+0000 7fc7e8a00640 1 -- 172.21.15.138:0/65338276 learned_addr learned my addr 172.21.15.138:0/65338276 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:01.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.573+0000 7fc7e8a00640 1 -- 172.21.15.138:0/65338276 >> v2:172.21.15.138:3300/0 conn(0x7fc7e40cb880 msgr2=0x7fc7e406de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:01.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.573+0000 7fc7e8a00640 1 --2- 172.21.15.138:0/65338276 >> v2:172.21.15.138:3300/0 conn(0x7fc7e40cb880 0x7fc7e406de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.573+0000 7fc7e8a00640 1 -- 172.21.15.138:0/65338276 >> v1:172.21.15.143:6789/0 conn(0x7fc7e415b1a0 legacy=0x7fc7e40cb170 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:57:01.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.573+0000 7f05f3200640 1 -- 172.21.15.138:0/3861087389 shutdown_connections 2024-04-26T20:57:01.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.573+0000 7f5633e00640 1 -- 172.21.15.138:0/199043661 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 707249148 0 0) 0x7f56340b51b0 con 0x7f563406fe30 2024-04-26T20:57:01.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.573+0000 7f05f3200640 1 -- 172.21.15.138:0/3861087389 wait complete. 2024-04-26T20:57:01.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.573+0000 7f5633e00640 1 -- 172.21.15.138:0/199043661 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f561c003530 con 0x7f563406fe30 2024-04-26T20:57:01.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.573+0000 7f9d11a00640 1 -- 172.21.15.138:0/1044945752 shutdown_connections 2024-04-26T20:57:01.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.573+0000 7f9d11a00640 1 --2- 172.21.15.138:0/1044945752 >> v2:172.21.15.138:3300/0 conn(0x7f9d0c071ee0 0x7f9d0c0ceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.573+0000 7f9d11a00640 1 --2- 172.21.15.138:0/1044945752 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9d0c0ce8c0 0x7f9d0c0d0460 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.573+0000 7f9d11a00640 1 -- 172.21.15.138:0/1044945752 >> 172.21.15.138:0/1044945752 conn(0x7f9d0c0d0b20 msgr2=0x7f9d0c0d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:01.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.573+0000 7f9d11a00640 1 -- 172.21.15.138:0/1044945752 shutdown_connections 2024-04-26T20:57:01.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.573+0000 7f9d11a00640 1 -- 172.21.15.138:0/1044945752 wait complete. 2024-04-26T20:57:01.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.577+0000 7f9d11a00640 1 Processor -- start 2024-04-26T20:57:01.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.577+0000 7ff165000640 1 --2- 172.21.15.138:0/1355507878 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1580e35b0 0x7ff158051980 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff160052120 tx=0x7ff1600990d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eda4a7eb7389d279 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.577+0000 7f0105e00640 1 --2- 172.21.15.138:0/597159672 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f01000c84e0 0x7f01000d3450 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f00f4009870 tx=0x7f00f401c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9e70b9457b8d03f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.577+0000 7f0104a00640 1 -- 172.21.15.138:0/597159672 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f40b1070 con 0x7f01000c84e0 2024-04-26T20:57:01.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.577+0000 7f0104a00640 1 -- 172.21.15.138:0/597159672 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00f40a8050 con 0x7f01000c84e0 2024-04-26T20:57:01.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.577+0000 7f0104a00640 1 -- 172.21.15.138:0/597159672 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f40ac860 con 0x7f01000c84e0 2024-04-26T20:57:01.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.573+0000 7f5633e00640 1 -- 172.21.15.138:0/199043661 <== mon.1 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3842625570 0 0) 0x7f561c003530 con 0x7f563406fe30 2024-04-26T20:57:01.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.577+0000 7f5633e00640 1 -- 172.21.15.138:0/199043661 >> v2:172.21.15.138:3300/0 conn(0x7f563415b160 msgr2=0x7f56340b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:01.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.577+0000 7f5633e00640 1 --2- 172.21.15.138:0/199043661 >> v2:172.21.15.138:3300/0 conn(0x7f563415b160 0x7f56340b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.577+0000 7f5633e00640 1 -- 172.21.15.138:0/199043661 >> v1:172.21.15.138:6789/0 conn(0x7f5634072610 legacy=0x7f5634163eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:01.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.577+0000 7f5633e00640 1 -- 172.21.15.138:0/199043661 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56340b5490 con 0x7f563406fe30 2024-04-26T20:57:01.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.577+0000 7f5633e00640 1 -- 172.21.15.138:0/199043661 <== mon.1 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2715389689 0 0) 0x7f562c001a00 con 0x7f563406fe30 2024-04-26T20:57:01.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.577+0000 7f5633e00640 1 -- 172.21.15.138:0/199043661 >> v1:172.21.15.143:6789/0 conn(0x7f563406fe30 legacy=0x7f5634071f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.577+0000 7f5633e00640 1 --2- 172.21.15.138:0/199043661 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f561c0039c0 0x7f561c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.577+0000 7f5633e00640 1 --2- 172.21.15.138:0/199043661 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f561c004810 0x7f561c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.577+0000 7f5633e00640 1 --2- 172.21.15.138:0/199043661 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f561c0051d0 0x7f561c00ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.577+0000 7f5633e00640 1 -- 172.21.15.138:0/199043661 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f56340b5770 con 0x7f561c0039c0 2024-04-26T20:57:01.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.577+0000 7f5633e00640 1 -- 172.21.15.138:0/199043661 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f561c0106b0 con 0x7f561c004810 2024-04-26T20:57:01.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.577+0000 7f5633e00640 1 -- 172.21.15.138:0/199043661 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f561c010880 con 0x7f561c0051d0 2024-04-26T20:57:01.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.577+0000 7f5638c00640 1 --2- 172.21.15.138:0/199043661 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f561c004810 0x7f561c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.577+0000 7f5639600640 1 --2- 172.21.15.138:0/199043661 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f561c0039c0 0x7f561c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.577+0000 7f563a000640 1 --2- 172.21.15.138:0/199043661 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f561c0051d0 0x7f561c00ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.577+0000 7f5639600640 1 -- 172.21.15.138:0/199043661 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f561c0051d0 msgr2=0x7f561c00ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:01.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.577+0000 7f5639600640 1 --2- 172.21.15.138:0/199043661 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f561c0051d0 0x7f561c00ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.577+0000 7f5639600640 1 -- 172.21.15.138:0/199043661 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f561c004810 msgr2=0x7f561c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:01.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.577+0000 7f5639600640 1 --2- 172.21.15.138:0/199043661 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f561c004810 0x7f561c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.577+0000 7f5639600640 1 -- 172.21.15.138:0/199043661 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f561c003530 con 0x7f561c0039c0 2024-04-26T20:57:01.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.577+0000 7f5638c00640 1 --2- 172.21.15.138:0/199043661 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f561c004810 0x7f561c004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:01.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.577+0000 7f563a000640 1 -- 172.21.15.138:0/199043661 reap_dead start 2024-04-26T20:57:01.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.573+0000 7fc7e8a00640 1 -- 172.21.15.138:0/65338276 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7e406e730 con 0x7fc7e40cec00 2024-04-26T20:57:01.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.577+0000 7f9d11a00640 1 -- start start 2024-04-26T20:57:01.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.577+0000 7f05f3200640 1 Processor -- start 2024-04-26T20:57:01.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.577+0000 7ff15f400640 1 -- 172.21.15.138:0/1355507878 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff16012e070 con 0x7ff1580e35b0 2024-04-26T20:57:01.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.577+0000 7ff15f400640 1 -- 172.21.15.138:0/1355507878 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff160121c50 con 0x7ff1580e35b0 2024-04-26T20:57:01.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.577+0000 7ff15f400640 1 -- 172.21.15.138:0/1355507878 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff160129640 con 0x7ff1580e35b0 2024-04-26T20:57:01.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.577+0000 7f05f3200640 1 -- start start 2024-04-26T20:57:01.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.577+0000 7f0108800640 1 -- 172.21.15.138:0/597159672 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f01000c84e0 msgr2=0x7f01000d3450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.577+0000 7f0108800640 1 --2- 172.21.15.138:0/597159672 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f01000c84e0 0x7f01000d3450 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f00f4009870 tx=0x7f00f401c4d0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.577+0000 7fc7e8a00640 1 --2- 172.21.15.138:0/65338276 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7e40cec00 0x7fc7e406f4d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc009870 tx=0x7fc7dc01ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b344deb88fe38fe8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.577+0000 7f0108800640 1 -- 172.21.15.138:0/597159672 shutdown_connections 2024-04-26T20:57:01.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.577+0000 7f0108800640 1 --2- 172.21.15.138:0/597159672 >> v2:172.21.15.138:3300/0 conn(0x7f01000b3d10 0x7f01000d3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.577+0000 7f0108800640 1 --2- 172.21.15.138:0/597159672 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f01000c84e0 0x7f01000d3450 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.577+0000 7f0108800640 1 -- 172.21.15.138:0/597159672 >> 172.21.15.138:0/597159672 conn(0x7f01000d4e70 msgr2=0x7f01000d5280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:01.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7ff167a00640 1 -- 172.21.15.138:0/1355507878 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1580e35b0 msgr2=0x7ff158051980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7ff167a00640 1 --2- 172.21.15.138:0/1355507878 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1580e35b0 0x7ff158051980 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff160052120 tx=0x7ff1600990d0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.577+0000 7f0108800640 1 -- 172.21.15.138:0/597159672 shutdown_connections 2024-04-26T20:57:01.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7f9d11a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9d0c071ee0 0x7f9d0c2059b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7f9d11a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9d0c0ce8c0 0x7f9d0c0c61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7f05f3200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05e4005ea0 0x7f05e4049c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7f05f3200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f05e4033e40 0x7f05e40482c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7f05f3200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05e4047c20 0x7f05e40dbd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7f05f3200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f05e404fd80 con 0x7f05e4005ea0 2024-04-26T20:57:01.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7f05f3200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f05e404f090 con 0x7f05e4033e40 2024-04-26T20:57:01.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7f05f3200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f05e404f5c0 con 0x7f05e4047c20 2024-04-26T20:57:01.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.577+0000 7f0108800640 1 -- 172.21.15.138:0/597159672 wait complete. 2024-04-26T20:57:01.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7fc7e2a00640 1 -- 172.21.15.138:0/65338276 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc0b5070 con 0x7fc7e40cec00 2024-04-26T20:57:01.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7ff167a00640 1 -- 172.21.15.138:0/1355507878 shutdown_connections 2024-04-26T20:57:01.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7ff167a00640 1 --2- 172.21.15.138:0/1355507878 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff1580514a0 0x7ff158036080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7ff167a00640 1 --2- 172.21.15.138:0/1355507878 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1580e35b0 0x7ff158051980 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7ff167a00640 1 -- 172.21.15.138:0/1355507878 >> 172.21.15.138:0/1355507878 conn(0x7ff15801e6d0 msgr2=0x7ff158055400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:01.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7fc7e2a00640 1 -- 172.21.15.138:0/65338276 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7dc0a89d0 con 0x7fc7e40cec00 2024-04-26T20:57:01.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7fc7e2a00640 1 -- 172.21.15.138:0/65338276 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc0a8da0 con 0x7fc7e40cec00 2024-04-26T20:57:01.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7ff167a00640 1 -- 172.21.15.138:0/1355507878 shutdown_connections 2024-04-26T20:57:01.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7f9d11a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9d0c0cf1e0 0x7f9d0c1f7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7ff167a00640 1 -- 172.21.15.138:0/1355507878 wait complete. 2024-04-26T20:57:01.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7f9d0aa00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9d0c071ee0 0x7f9d0c2059b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7f9d0aa00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9d0c071ee0 0x7f9d0c2059b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.138:47864/0 (socket says 172.21.15.138:47864) 2024-04-26T20:57:01.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7f9d0a000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9d0c0ce8c0 0x7f9d0c0c61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7f9d0a000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9d0c0ce8c0 0x7f9d0c0c61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.138:36892/0 (socket says 172.21.15.138:36892) 2024-04-26T20:57:01.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7f05ebe00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05e4005ea0 0x7f05e4049c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7f05ebe00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05e4005ea0 0x7f05e4049c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:57058/0 (socket says 172.21.15.138:57058) 2024-04-26T20:57:01.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7f05ebe00640 1 -- 172.21.15.138:0/2742048960 learned_addr learned my addr 172.21.15.138:0/2742048960 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:01.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7f9d0aa00640 1 -- 172.21.15.138:0/1015947086 learned_addr learned my addr 172.21.15.138:0/1015947086 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:01.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7f9d11a00640 1 -- 172.21.15.138:0/1015947086 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0c06e880 con 0x7f9d0c0cf1e0 2024-04-26T20:57:01.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7f9d11a00640 1 -- 172.21.15.138:0/1015947086 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0c0cb6a0 con 0x7f9d0c0ce8c0 2024-04-26T20:57:01.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7f0108800640 1 Processor -- start 2024-04-26T20:57:01.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7f9d0b400640 1 --2- 172.21.15.138:0/1015947086 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9d0c0cf1e0 0x7f9d0c1f7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7f9d11a00640 1 -- 172.21.15.138:0/1015947086 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f9d0c0c3fb0 con 0x7f9d0c071ee0 2024-04-26T20:57:01.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7f05f1200640 1 --2- 172.21.15.138:0/2742048960 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05e4047c20 0x7f05e40dbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7f05eb400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f05e4033e40 0x7f05e40482c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7f9d0a000640 1 -- 172.21.15.138:0/1015947086 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9d0c071ee0 msgr2=0x7f9d0c2059b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7f9d0a000640 1 --2- 172.21.15.138:0/1015947086 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9d0c071ee0 0x7f9d0c2059b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7f9d0a000640 1 -- 172.21.15.138:0/1015947086 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9d0c0cf1e0 msgr2=0x7f9d0c1f7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7f9d0a000640 1 --2- 172.21.15.138:0/1015947086 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9d0c0cf1e0 0x7f9d0c1f7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7f9d0a000640 1 -- 172.21.15.138:0/1015947086 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d0c1f7760 con 0x7f9d0c0ce8c0 2024-04-26T20:57:01.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7f9d0b400640 1 --2- 172.21.15.138:0/1015947086 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9d0c0cf1e0 0x7f9d0c1f7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:57:01.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7f05f1200640 1 -- 172.21.15.138:0/2742048960 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f05e4033e40 msgr2=0x7f05e40482c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7f5639600640 1 --2- 172.21.15.138:0/199043661 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f561c0039c0 0x7f561c003da0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f562c005a80 tx=0x7f562c01d8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a39772854963de70 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7fc7eaa00640 1 -- 172.21.15.138:0/65338276 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7e40cec00 msgr2=0x7fc7e406f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7fc7eaa00640 1 --2- 172.21.15.138:0/65338276 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7e40cec00 0x7fc7e406f4d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc009870 tx=0x7fc7dc01ed10 comp rx=0 tx=0).stop 2024-04-26T20:57:01.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7f05f1200640 1 --2- 172.21.15.138:0/2742048960 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f05e4033e40 0x7f05e40482c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7f05f1200640 1 -- 172.21.15.138:0/2742048960 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05e4005ea0 msgr2=0x7f05e4049c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7f05f1200640 1 --2- 172.21.15.138:0/2742048960 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05e4005ea0 0x7f05e4049c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7f05f1200640 1 -- 172.21.15.138:0/2742048960 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05e4048b80 con 0x7f05e4047c20 2024-04-26T20:57:01.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7f05ebe00640 1 --2- 172.21.15.138:0/2742048960 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05e4005ea0 0x7f05e4049c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:57:01.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7f05eb400640 1 --2- 172.21.15.138:0/2742048960 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f05e4033e40 0x7f05e40482c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:57:01.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7f0108800640 1 -- start start 2024-04-26T20:57:01.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7f5633e00640 1 -- 172.21.15.138:0/199043661 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f562c005650 con 0x7f561c0039c0 2024-04-26T20:57:01.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7f9d0a000640 1 --2- 172.21.15.138:0/1015947086 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9d0c0ce8c0 0x7f9d0c0c61d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9d04007e60 tx=0x7f9d0400e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7f05f1200640 1 --2- 172.21.15.138:0/2742048960 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05e4047c20 0x7f05e40dbd30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f05ec000b70 tx=0x7f05ec050c40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7fe728400640 1 Processor -- start 2024-04-26T20:57:01.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7fcb1be00640 1 Processor -- start 2024-04-26T20:57:01.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7fe728400640 1 -- start start 2024-04-26T20:57:01.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7f9d02a00640 1 -- 172.21.15.138:0/1015947086 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d04014620 con 0x7f9d0c0ce8c0 2024-04-26T20:57:01.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7f9d02a00640 1 -- 172.21.15.138:0/1015947086 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d04019070 con 0x7f9d0c0ce8c0 2024-04-26T20:57:01.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7f9d02a00640 1 -- 172.21.15.138:0/1015947086 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d040149e0 con 0x7f9d0c0ce8c0 2024-04-26T20:57:01.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7fcb1be00640 1 -- start start 2024-04-26T20:57:01.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.581+0000 7f5633e00640 1 -- 172.21.15.138:0/199043661 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f562c0ad070 con 0x7f561c0039c0 2024-04-26T20:57:01.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7f5633e00640 1 -- 172.21.15.138:0/199043661 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f562c0a78e0 con 0x7f561c0039c0 2024-04-26T20:57:01.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7f05dfe00640 1 -- 172.21.15.138:0/2742048960 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ec0742c0 con 0x7f05e4047c20 2024-04-26T20:57:01.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7f05dfe00640 1 -- 172.21.15.138:0/2742048960 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05ec074460 con 0x7f05e4047c20 2024-04-26T20:57:01.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7f05dfe00640 1 -- 172.21.15.138:0/2742048960 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ec074850 con 0x7f05e4047c20 2024-04-26T20:57:01.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7f05f3200640 1 -- 172.21.15.138:0/2742048960 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05e4048e60 con 0x7f05e4047c20 2024-04-26T20:57:01.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7f9d11a00640 1 -- 172.21.15.138:0/1015947086 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d0c201930 con 0x7f9d0c0ce8c0 2024-04-26T20:57:01.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7f9d11a00640 1 -- 172.21.15.138:0/1015947086 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d0c201ef0 con 0x7f9d0c0ce8c0 2024-04-26T20:57:01.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7f05f3200640 1 -- 172.21.15.138:0/2742048960 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f05e4049700 con 0x7f05e4047c20 2024-04-26T20:57:01.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7f0108800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01000b3d10 0x7f01000ba6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7f0108800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f01000b4260 0x7f010015de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7f0108800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f01001638f0 0x7f010015e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7f0108800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f01001703f0 con 0x7f01000b3d10 2024-04-26T20:57:01.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7f0108800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f0100170270 con 0x7f01000b4260 2024-04-26T20:57:01.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7f0108800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f0100170570 con 0x7f01001638f0 2024-04-26T20:57:01.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7f563c000640 1 -- 172.21.15.138:0/199043661 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f561c0039c0 msgr2=0x7f561c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7f563c000640 1 --2- 172.21.15.138:0/199043661 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f561c0039c0 0x7f561c003da0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f562c005a80 tx=0x7f562c01d8d0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7fc7eaa00640 1 -- 172.21.15.138:0/65338276 shutdown_connections 2024-04-26T20:57:01.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7fc7eaa00640 1 --2- 172.21.15.138:0/65338276 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7e40cec00 0x7fc7e406f4d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7fc7eaa00640 1 --2- 172.21.15.138:0/65338276 >> v2:172.21.15.138:3300/0 conn(0x7fc7e40cb880 0x7fc7e406de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7fc7eaa00640 1 -- 172.21.15.138:0/65338276 >> 172.21.15.138:0/65338276 conn(0x7fc7e40d0b20 msgr2=0x7fc7e40d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:01.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7fc7eaa00640 1 -- 172.21.15.138:0/65338276 shutdown_connections 2024-04-26T20:57:01.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7f0106800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f01001638f0 0x7f010015e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7f0106800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f01001638f0 0x7f010015e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.138:47878/0 (socket says 172.21.15.138:47878) 2024-04-26T20:57:01.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7f0106800640 1 -- 172.21.15.138:0/1830149397 learned_addr learned my addr 172.21.15.138:0/1830149397 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:01.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7fcb1be00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fcb14007430 0x7fcb140078b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7fcb1be00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fcb1404f4e0 0x7fcb1404f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7fcb1be00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb140e5440 con 0x7fcb140e5060 2024-04-26T20:57:01.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7fcb1be00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fcb1404fe90 con 0x7fcb14007430 2024-04-26T20:57:01.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7fcb1be00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fcb14006390 con 0x7fcb1404f4e0 2024-04-26T20:57:01.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7fe728400640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe7200c5270 0x7fe720073a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7fe728400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe72006c300 0x7fe72006c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7fe728400640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7200cfb20 con 0x7fe7200d12d0 2024-04-26T20:57:01.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7fe728400640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fe7200cc990 con 0x7fe72006c300 2024-04-26T20:57:01.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7fe728400640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fe7201670f0 con 0x7fe7200c5270 2024-04-26T20:57:01.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7f05f3200640 1 -- 172.21.15.138:0/2742048960 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05c80052a0 con 0x7f05e4047c20 2024-04-26T20:57:01.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7f0105400640 1 --2- 172.21.15.138:0/1830149397 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f01000b4260 0x7f010015de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7f0105e00640 1 --2- 172.21.15.138:0/1830149397 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01000b3d10 0x7f01000ba6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7fc7eaa00640 1 -- 172.21.15.138:0/65338276 wait complete. 2024-04-26T20:57:01.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7f9d11a00640 1 -- 172.21.15.138:0/1015947086 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d0c069510 con 0x7f9d0c0ce8c0 2024-04-26T20:57:01.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.589+0000 7f05dfe00640 1 -- 172.21.15.138:0/2742048960 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f05ec095480 con 0x7f05e4047c20 2024-04-26T20:57:01.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.589+0000 7f05dfe00640 1 --2- 172.21.15.138:0/2742048960 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f05cc0683d0 0x7f05cc06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.589+0000 7f05dfe00640 1 -- 172.21.15.138:0/2742048960 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f05ec102ce0 con 0x7f05e4047c20 2024-04-26T20:57:01.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.589+0000 7f05ebe00640 1 --2- 172.21.15.138:0/2742048960 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f05cc0683d0 0x7f05cc06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7ff167a00640 1 Processor -- start 2024-04-26T20:57:01.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.589+0000 7ff167a00640 1 -- start start 2024-04-26T20:57:01.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7f0105e00640 1 -- 172.21.15.138:0/1830149397 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f01001638f0 msgr2=0x7f010015e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7f0105e00640 1 --2- 172.21.15.138:0/1830149397 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f01001638f0 0x7f010015e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7f0105e00640 1 -- 172.21.15.138:0/1830149397 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f01000b4260 msgr2=0x7f010015de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7f0105e00640 1 --2- 172.21.15.138:0/1830149397 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f01000b4260 0x7f010015de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7f0105e00640 1 -- 172.21.15.138:0/1830149397 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01000ca4d0 con 0x7f01000b3d10 2024-04-26T20:57:01.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7f0105e00640 1 --2- 172.21.15.138:0/1830149397 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01000b3d10 0x7f01000ba6b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f00f40ac000 tx=0x7f00f4019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.589+0000 7f00fa000640 1 -- 172.21.15.138:0/1830149397 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f40b1040 con 0x7f01000b3d10 2024-04-26T20:57:01.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.589+0000 7f00fa000640 1 -- 172.21.15.138:0/1830149397 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00f40b7470 con 0x7f01000b3d10 2024-04-26T20:57:01.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.589+0000 7f00fa000640 1 -- 172.21.15.138:0/1830149397 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f40b7880 con 0x7f01000b3d10 2024-04-26T20:57:01.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.589+0000 7f0108800640 1 -- 172.21.15.138:0/1830149397 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0100163de0 con 0x7f01000b3d10 2024-04-26T20:57:01.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.589+0000 7f0108800640 1 -- 172.21.15.138:0/1830149397 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f010015f0e0 con 0x7f01000b3d10 2024-04-26T20:57:01.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7f563c000640 1 -- 172.21.15.138:0/199043661 shutdown_connections 2024-04-26T20:57:01.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7f563c000640 1 --2- 172.21.15.138:0/199043661 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f561c0039c0 0x7f561c003da0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7f563c000640 1 -- 172.21.15.138:0/199043661 >> 172.21.15.138:0/199043661 conn(0x7f563406c300 msgr2=0x7f563406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:01.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7f563c000640 1 -- 172.21.15.138:0/199043661 shutdown_connections 2024-04-26T20:57:01.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7f563c000640 1 -- 172.21.15.138:0/199043661 wait complete. 2024-04-26T20:57:01.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7fcb1b400640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fcb1404f4e0 0x7fcb1404f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7fcb1b400640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fcb1404f4e0 0x7fcb1404f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.138:36928/0 (socket says 172.21.15.138:36928) 2024-04-26T20:57:01.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7fcb1b400640 1 -- 172.21.15.138:0/3316541664 learned_addr learned my addr 172.21.15.138:0/3316541664 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:01.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7fcb1b400640 1 -- 172.21.15.138:0/3316541664 >> v2:172.21.15.138:3300/0 conn(0x7fcb14007430 msgr2=0x7fcb140078b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:01.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7fcb1b400640 1 --2- 172.21.15.138:0/3316541664 >> v2:172.21.15.138:3300/0 conn(0x7fcb14007430 0x7fcb140078b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7fcb1b400640 1 -- 172.21.15.138:0/3316541664 >> v1:172.21.15.138:6789/0 conn(0x7fcb140e5060 legacy=0x7fcb1403a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:01.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7fcb1b400640 1 -- 172.21.15.138:0/3316541664 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb14006670 con 0x7fcb1404f4e0 2024-04-26T20:57:01.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7fe725a00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe7200c5270 0x7fe720073a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7fe725a00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe7200c5270 0x7fe720073a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.138:36924/0 (socket says 172.21.15.138:36924) 2024-04-26T20:57:01.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7fe725a00640 1 -- 172.21.15.138:0/3345514460 learned_addr learned my addr 172.21.15.138:0/3345514460 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:01.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7fe726400640 1 --2- 172.21.15.138:0/3345514460 >> v2:172.21.15.138:3300/0 conn(0x7fe72006c300 0x7fe72006c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.585+0000 7fe71fe00640 1 -- 172.21.15.138:0/3345514460 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1499409167 0 0) 0x7fe7200cfb20 con 0x7fe7200d12d0 2024-04-26T20:57:01.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.589+0000 7fe71fe00640 1 -- 172.21.15.138:0/3345514460 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe708003530 con 0x7fe7200d12d0 2024-04-26T20:57:01.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.589+0000 7fe725a00640 1 -- 172.21.15.138:0/3345514460 >> v2:172.21.15.138:3300/0 conn(0x7fe72006c300 msgr2=0x7fe72006c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:01.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.589+0000 7fe725a00640 1 --2- 172.21.15.138:0/3345514460 >> v2:172.21.15.138:3300/0 conn(0x7fe72006c300 0x7fe72006c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.589+0000 7fe725a00640 1 -- 172.21.15.138:0/3345514460 >> v1:172.21.15.143:6789/0 conn(0x7fe7200d12d0 legacy=0x7fe7200cc280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.589+0000 7fe725a00640 1 -- 172.21.15.138:0/3345514460 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7200d1860 con 0x7fe7200c5270 2024-04-26T20:57:01.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.589+0000 7fe726400640 1 --2- 172.21.15.138:0/3345514460 >> v2:172.21.15.138:3300/0 conn(0x7fe72006c300 0x7fe72006c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:01.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.589+0000 7f563c000640 1 Processor -- start 2024-04-26T20:57:01.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.589+0000 7fc7eaa00640 1 Processor -- start 2024-04-26T20:57:01.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.589+0000 7fc7eaa00640 1 -- start start 2024-04-26T20:57:01.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.589+0000 7f563c000640 1 -- start start 2024-04-26T20:57:01.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.589+0000 7f9d02a00640 1 -- 172.21.15.138:0/1015947086 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9d04014b80 con 0x7f9d0c0ce8c0 2024-04-26T20:57:01.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.589+0000 7f05ebe00640 1 --2- 172.21.15.138:0/2742048960 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f05cc0683d0 0x7f05cc06a890 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f05e00097c0 tx=0x7f05e00aa070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.589+0000 7fc7eaa00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc7e40cb880 0x7fc7e413f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.589+0000 7f0108800640 1 -- 172.21.15.138:0/1830149397 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00dc0052a0 con 0x7f01000b3d10 2024-04-26T20:57:01.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.589+0000 7f9d02a00640 1 --2- 172.21.15.138:0/1015947086 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9cec068450 0x7f9cec06a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.589+0000 7fc7e3e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc7e40cb880 0x7fc7e413f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.589+0000 7f9d02a00640 1 -- 172.21.15.138:0/1015947086 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f9d04087410 con 0x7f9d0c0ce8c0 2024-04-26T20:57:01.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.589+0000 7ff167a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff1580365c0 0x7ff15816bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.589+0000 7fc7eaa00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7e40cec00 0x7fc7e40ca540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.589+0000 7fc7eaa00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7e415b1a0 0x7fc7e40c7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.589+0000 7fc7eaa00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e406efd0 con 0x7fc7e40cb880 2024-04-26T20:57:01.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.589+0000 7fc7eaa00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e406ecf0 con 0x7fc7e415b1a0 2024-04-26T20:57:01.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.589+0000 7fc7eaa00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fc7e415b580 con 0x7fc7e40cec00 2024-04-26T20:57:01.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7f9d0aa00640 1 --2- 172.21.15.138:0/1015947086 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9cec068450 0x7f9cec06a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7ff167a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff1580514a0 0x7ff1580073a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7fcb1b400640 1 --2- 172.21.15.138:0/3316541664 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcb1404f4e0 0x7fcb1404f950 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c06c2b0 tx=0x7fcb1c098eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9596a3f45373e729 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7f00fa000640 1 -- 172.21.15.138:0/1830149397 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f00f40c0070 con 0x7f01000b3d10 2024-04-26T20:57:01.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7fc7e8a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7e415b1a0 0x7fc7e40c7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7fc7e8a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7e415b1a0 0x7fc7e40c7bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.138:36930/0 (socket says 172.21.15.138:36930) 2024-04-26T20:57:01.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7fc7e8a00640 1 -- 172.21.15.138:0/1095589245 learned_addr learned my addr 172.21.15.138:0/1095589245 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:01.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7f563c000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f561c0039c0 0x7f5634139bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7ff167a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1580e35b0 0x7ff1580078e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7f563c000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f563413c350 0x7f563413c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7f563c000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f563415d730 0x7f563415dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7f563c000640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f5634072290 con 0x7f561c0039c0 2024-04-26T20:57:01.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7f563c000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f5634072110 con 0x7f563413c350 2024-04-26T20:57:01.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7f563c000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f5634072410 con 0x7f563415d730 2024-04-26T20:57:01.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7ff165000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff1580365c0 0x7ff15816bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7ff167a00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff158050fc0 con 0x7ff1580e35b0 2024-04-26T20:57:01.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7ff167a00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ff158050e40 con 0x7ff1580514a0 2024-04-26T20:57:01.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7ff167a00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ff158051140 con 0x7ff1580365c0 2024-04-26T20:57:01.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7f563a000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f563415d730 0x7f563415dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7f563a000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f563415d730 0x7f563415dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.138:47896/0 (socket says 172.21.15.138:47896) 2024-04-26T20:57:01.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7f563a000640 1 -- 172.21.15.138:0/1570966204 learned_addr learned my addr 172.21.15.138:0/1570966204 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:01.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7ff165a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1580e35b0 0x7ff1580078e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7ff165a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1580e35b0 0x7ff1580078e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:57124/0 (socket says 172.21.15.138:57124) 2024-04-26T20:57:01.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7ff165a00640 1 -- 172.21.15.138:0/2444889673 learned_addr learned my addr 172.21.15.138:0/2444889673 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:01.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7f5638c00640 1 --2- 172.21.15.138:0/1570966204 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f563413c350 0x7f563413c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7f5639600640 1 --2- 172.21.15.138:0/1570966204 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f561c0039c0 0x7f5634139bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7fc7e8a00640 1 -- 172.21.15.138:0/1095589245 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7e40cec00 msgr2=0x7fc7e40ca540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7f9d0aa00640 1 --2- 172.21.15.138:0/1015947086 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9cec068450 0x7f9cec06a910 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc01eb50 tx=0x7f9cfc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7ff15fe00640 1 --2- 172.21.15.138:0/2444889673 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff1580514a0 0x7ff1580073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7f563a000640 1 -- 172.21.15.138:0/1570966204 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f563413c350 msgr2=0x7f563413c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7f563a000640 1 --2- 172.21.15.138:0/1570966204 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f563413c350 0x7f563413c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7f563a000640 1 -- 172.21.15.138:0/1570966204 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f561c0039c0 msgr2=0x7f5634139bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7f563a000640 1 --2- 172.21.15.138:0/1570966204 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f561c0039c0 0x7f5634139bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7f563a000640 1 -- 172.21.15.138:0/1570966204 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f563413cf10 con 0x7f563415d730 2024-04-26T20:57:01.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7f5639600640 1 --2- 172.21.15.138:0/1570966204 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f561c0039c0 0x7f5634139bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:57:01.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7fc7e3400640 1 --2- 172.21.15.138:0/1095589245 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7e40cec00 0x7fc7e40ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7fc7e8a00640 1 --2- 172.21.15.138:0/1095589245 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7e40cec00 0x7fc7e40ca540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7fc7e8a00640 1 -- 172.21.15.138:0/1095589245 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc7e40cb880 msgr2=0x7fc7e413f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7fc7e8a00640 1 --2- 172.21.15.138:0/1095589245 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc7e40cb880 0x7fc7e413f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7fc7e8a00640 1 -- 172.21.15.138:0/1095589245 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7e408b2e0 con 0x7fc7e415b1a0 2024-04-26T20:57:01.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7fc7e3e00640 1 --2- 172.21.15.138:0/1095589245 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc7e40cb880 0x7fc7e413f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:57:01.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7ff165000640 1 -- 172.21.15.138:0/2444889673 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff1580514a0 msgr2=0x7ff1580073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7ff165000640 1 --2- 172.21.15.138:0/2444889673 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff1580514a0 0x7ff1580073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7ff165000640 1 -- 172.21.15.138:0/2444889673 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1580e35b0 msgr2=0x7ff1580078e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7ff165000640 1 --2- 172.21.15.138:0/2444889673 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1580e35b0 0x7ff1580078e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7f00fa000640 1 --2- 172.21.15.138:0/1830149397 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f00e40683d0 0x7f00e406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7f00fa000640 1 -- 172.21.15.138:0/1830149397 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f00f4120bc0 con 0x7f01000b3d10 2024-04-26T20:57:01.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7ff165000640 1 -- 172.21.15.138:0/2444889673 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1580df7d0 con 0x7ff1580365c0 2024-04-26T20:57:01.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7ff165a00640 1 --2- 172.21.15.138:0/2444889673 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1580e35b0 0x7ff1580078e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:57:01.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7fc7e8a00640 1 --2- 172.21.15.138:0/1095589245 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7e415b1a0 0x7fc7e40c7bf0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc01d3c0 tx=0x7fc7dc01bab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7fe725a00640 1 --2- 172.21.15.138:0/3345514460 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7200c5270 0x7fe720073a00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe7200640b0 tx=0x7fe71401c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e78882edc89c845 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7ff165000640 1 --2- 172.21.15.138:0/2444889673 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff1580365c0 0x7ff15816bbe0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff16006abb0 tx=0x7ff16006a1b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7f563a000640 1 --2- 172.21.15.138:0/1570966204 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f563415d730 0x7f563415dbb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f563415fbd0 tx=0x7f562000e9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7f0105400640 1 --2- 172.21.15.138:0/1830149397 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f00e40683d0 0x7f00e406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7f0105400640 1 --2- 172.21.15.138:0/1830149397 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f00e40683d0 0x7f00e406a890 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0100160e90 tx=0x7f00f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7fc7dbe00640 1 -- 172.21.15.138:0/1095589245 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc0b5050 con 0x7fc7e415b1a0 2024-04-26T20:57:01.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7fe71fe00640 1 -- 172.21.15.138:0/3345514460 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7140b0070 con 0x7fe7200c5270 2024-04-26T20:57:01.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.597+0000 7fc7dbe00640 1 -- 172.21.15.138:0/1095589245 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7dc0bf070 con 0x7fc7e415b1a0 2024-04-26T20:57:01.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.593+0000 7ff15cc00640 1 -- 172.21.15.138:0/2444889673 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff16012e040 con 0x7ff1580365c0 2024-04-26T20:57:01.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.597+0000 7fc7eaa00640 1 -- 172.21.15.138:0/1095589245 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7e413fd10 con 0x7fc7e415b1a0 2024-04-26T20:57:01.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.597+0000 7f5631600640 1 -- 172.21.15.138:0/1570966204 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5620013680 con 0x7f563415d730 2024-04-26T20:57:01.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.597+0000 7f5631600640 1 -- 172.21.15.138:0/1570966204 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f562001a070 con 0x7f563415d730 2024-04-26T20:57:01.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.597+0000 7f5631600640 1 -- 172.21.15.138:0/1570966204 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5620013a60 con 0x7f563415d730 2024-04-26T20:57:01.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.597+0000 7fc7eaa00640 1 -- 172.21.15.138:0/1095589245 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7e41402d0 con 0x7fc7e415b1a0 2024-04-26T20:57:01.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.597+0000 7fe71fe00640 1 -- 172.21.15.138:0/3345514460 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7140ab600 con 0x7fe7200c5270 2024-04-26T20:57:01.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.597+0000 7fe71fe00640 1 -- 172.21.15.138:0/3345514460 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7140ab9b0 con 0x7fe7200c5270 2024-04-26T20:57:01.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.597+0000 7ff15cc00640 1 -- 172.21.15.138:0/2444889673 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff160129b80 con 0x7ff1580365c0 2024-04-26T20:57:01.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.597+0000 7ff15cc00640 1 -- 172.21.15.138:0/2444889673 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff160129d30 con 0x7ff1580365c0 2024-04-26T20:57:01.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.597+0000 7fc7dbe00640 1 -- 172.21.15.138:0/1095589245 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc0b0bd0 con 0x7fc7e415b1a0 2024-04-26T20:57:01.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.597+0000 7f05dfe00640 1 -- 172.21.15.138:0/2742048960 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f05ec0d29f0 con 0x7f05e4047c20 2024-04-26T20:57:01.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.597+0000 7f563c000640 1 -- 172.21.15.138:0/1570966204 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f563413d1f0 con 0x7f563415d730 2024-04-26T20:57:01.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.597+0000 7f563c000640 1 -- 172.21.15.138:0/1570966204 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f563413a5f0 con 0x7f563415d730 2024-04-26T20:57:01.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.597+0000 7fcb19600640 1 -- 172.21.15.138:0/3316541664 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c12e070 con 0x7fcb1404f4e0 2024-04-26T20:57:01.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.597+0000 7fcb19600640 1 -- 172.21.15.138:0/3316541664 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb1c1219c0 con 0x7fcb1404f4e0 2024-04-26T20:57:01.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.597+0000 7fcb19600640 1 -- 172.21.15.138:0/3316541664 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c121e50 con 0x7fcb1404f4e0 2024-04-26T20:57:01.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.597+0000 7f563c000640 1 -- 172.21.15.138:0/1570966204 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56100052a0 con 0x7f563415d730 2024-04-26T20:57:01.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.597+0000 7fcb1be00640 1 -- 172.21.15.138:0/3316541664 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcb1404f4e0 msgr2=0x7fcb1404f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.597+0000 7fcb1be00640 1 --2- 172.21.15.138:0/3316541664 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcb1404f4e0 0x7fcb1404f950 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c06c2b0 tx=0x7fcb1c098eb0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.597+0000 7fe728400640 1 -- 172.21.15.138:0/3345514460 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7200c5270 msgr2=0x7fe720073a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.597+0000 7fe728400640 1 --2- 172.21.15.138:0/3345514460 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7200c5270 0x7fe720073a00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe7200640b0 tx=0x7fe71401c520 comp rx=0 tx=0).stop 2024-04-26T20:57:01.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.597+0000 7ff167a00640 1 -- 172.21.15.138:0/2444889673 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1580def30 con 0x7ff1580365c0 2024-04-26T20:57:01.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.597+0000 7ff167a00640 1 -- 172.21.15.138:0/2444889673 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1580df4f0 con 0x7ff1580365c0 2024-04-26T20:57:01.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.597+0000 7fe728400640 1 -- 172.21.15.138:0/3345514460 shutdown_connections 2024-04-26T20:57:01.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.597+0000 7fe728400640 1 --2- 172.21.15.138:0/3345514460 >> v2:172.21.15.138:3300/0 conn(0x7fe72006c300 0x7fe72006c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.597+0000 7fe728400640 1 --2- 172.21.15.138:0/3345514460 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7200c5270 0x7fe720073a00 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.597+0000 7fe728400640 1 -- 172.21.15.138:0/3345514460 >> 172.21.15.138:0/3345514460 conn(0x7fe7200d1c30 msgr2=0x7fe7200d2040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:01.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.597+0000 7fc7d9600640 1 -- 172.21.15.138:0/1095589245 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7b80052a0 con 0x7fc7e415b1a0 2024-04-26T20:57:01.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.597+0000 7ff152000640 1 -- 172.21.15.138:0/2444889673 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1580057f0 con 0x7ff1580365c0 2024-04-26T20:57:01.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.597+0000 7fcb1be00640 1 -- 172.21.15.138:0/3316541664 shutdown_connections 2024-04-26T20:57:01.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.597+0000 7fcb1be00640 1 --2- 172.21.15.138:0/3316541664 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcb1404f4e0 0x7fcb1404f950 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.597+0000 7fcb1be00640 1 --2- 172.21.15.138:0/3316541664 >> v2:172.21.15.138:3300/0 conn(0x7fcb14007430 0x7fcb140078b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.597+0000 7fcb1be00640 1 -- 172.21.15.138:0/3316541664 >> 172.21.15.138:0/3316541664 conn(0x7fcb1400a410 msgr2=0x7fcb1400a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:01.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.597+0000 7f9d02a00640 1 -- 172.21.15.138:0/1015947086 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9d04057020 con 0x7f9d0c0ce8c0 2024-04-26T20:57:01.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.601+0000 7fe728400640 1 -- 172.21.15.138:0/3345514460 shutdown_connections 2024-04-26T20:57:01.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.597+0000 7fcb1be00640 1 -- 172.21.15.138:0/3316541664 shutdown_connections 2024-04-26T20:57:01.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.601+0000 7fcb1be00640 1 -- 172.21.15.138:0/3316541664 wait complete. 2024-04-26T20:57:01.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.601+0000 7fe728400640 1 -- 172.21.15.138:0/3345514460 wait complete. 2024-04-26T20:57:01.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.601+0000 7f5631600640 1 -- 172.21.15.138:0/1570966204 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5620013c00 con 0x7f563415d730 2024-04-26T20:57:01.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.601+0000 7ff15cc00640 1 -- 172.21.15.138:0/2444889673 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff160139030 con 0x7ff1580365c0 2024-04-26T20:57:01.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.601+0000 7ff15cc00640 1 --2- 172.21.15.138:0/2444889673 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff1400683b0 0x7ff14006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.601+0000 7ff15cc00640 1 -- 172.21.15.138:0/2444889673 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7ff16019c910 con 0x7ff1580365c0 2024-04-26T20:57:01.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.601+0000 7fe728400640 1 Processor -- start 2024-04-26T20:57:01.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.601+0000 7fcb1be00640 1 Processor -- start 2024-04-26T20:57:01.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.601+0000 7fe728400640 1 -- start start 2024-04-26T20:57:01.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.601+0000 7f5631600640 1 --2- 172.21.15.138:0/1570966204 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f56140683d0 0x7f561406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.601+0000 7f5631600640 1 -- 172.21.15.138:0/1570966204 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f5620087500 con 0x7f563415d730 2024-04-26T20:57:01.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.601+0000 7f00fa000640 1 -- 172.21.15.138:0/1830149397 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f00f4016150 con 0x7f01000b3d10 2024-04-26T20:57:01.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.601+0000 7f5639600640 1 --2- 172.21.15.138:0/1570966204 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f56140683d0 0x7f561406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.601+0000 7fc7dbe00640 1 -- 172.21.15.138:0/1095589245 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc7dc0e0ab0 con 0x7fc7e415b1a0 2024-04-26T20:57:01.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.601+0000 7fc7dbe00640 1 --2- 172.21.15.138:0/1095589245 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc7c4068380 0x7fc7c406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.605+0000 7ff15fe00640 1 --2- 172.21.15.138:0/2444889673 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff1400683b0 0x7ff14006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.605+0000 7f5631600640 1 -- 172.21.15.138:0/1570966204 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5620057760 con 0x7f563415d730 2024-04-26T20:57:01.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.605+0000 7fc7e3e00640 1 --2- 172.21.15.138:0/1095589245 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc7c4068380 0x7fc7c406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.605+0000 7fc7dbe00640 1 -- 172.21.15.138:0/1095589245 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fc7dc124790 con 0x7fc7e415b1a0 2024-04-26T20:57:01.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.605+0000 7f5639600640 1 --2- 172.21.15.138:0/1570966204 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f56140683d0 0x7f561406a890 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f562c0ac000 tx=0x7f562c0a8000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.605+0000 7fe728400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe72006c300 0x7fe7200c8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.605+0000 7fe728400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7200c5270 0x7fe7200cab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.605+0000 7fe725000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7200c5270 0x7fe7200cab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.605+0000 7fe725000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7200c5270 0x7fe7200cab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.138:36942/0 (socket says 172.21.15.138:36942) 2024-04-26T20:57:01.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.605+0000 7fe728400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7200d12d0 0x7fe72015ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.605+0000 7fe725000640 1 -- 172.21.15.138:0/1981720823 learned_addr learned my addr 172.21.15.138:0/1981720823 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:01.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.605+0000 7fe728400640 1 -- 172.21.15.138:0/1981720823 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe720167d90 con 0x7fe72006c300 2024-04-26T20:57:01.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.605+0000 7fe728400640 1 -- 172.21.15.138:0/1981720823 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fe72006cc70 con 0x7fe7200c5270 2024-04-26T20:57:01.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.605+0000 7ff15fe00640 1 --2- 172.21.15.138:0/2444889673 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff1400683b0 0x7ff14006a870 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff158007ff0 tx=0x7ff154008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.605+0000 7fe728400640 1 -- 172.21.15.138:0/1981720823 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fe720167f10 con 0x7fe7200d12d0 2024-04-26T20:57:01.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.605+0000 7fc7dbe00640 1 -- 172.21.15.138:0/1095589245 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc7dc018870 con 0x7fc7e415b1a0 2024-04-26T20:57:01.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.605+0000 7fe725000640 1 -- 172.21.15.138:0/1981720823 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7200d12d0 msgr2=0x7fe72015ca90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T20:57:01.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.605+0000 7fe725000640 1 --2- 172.21.15.138:0/1981720823 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7200d12d0 0x7fe72015ca90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.605+0000 7fe725000640 1 -- 172.21.15.138:0/1981720823 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe72006c300 msgr2=0x7fe7200c8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.605+0000 7fe725000640 1 --2- 172.21.15.138:0/1981720823 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe72006c300 0x7fe7200c8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.605+0000 7fe725000640 1 -- 172.21.15.138:0/1981720823 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7200c9af0 con 0x7fe7200c5270 2024-04-26T20:57:01.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.601+0000 7fcb1be00640 1 -- start start 2024-04-26T20:57:01.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.605+0000 7fcb1be00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcb14007430 0x7fcb140dde60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.605+0000 7fcb1be00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcb1404f4e0 0x7fcb140d7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.605+0000 7fcb1be00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb140e5060 0x7fcb14034fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.605+0000 7fcb1be00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fcb14034530 con 0x7fcb14007430 2024-04-26T20:57:01.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.605+0000 7fcb1be00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fcb140343b0 con 0x7fcb1404f4e0 2024-04-26T20:57:01.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.605+0000 7fcb1be00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fcb140346b0 con 0x7fcb140e5060 2024-04-26T20:57:01.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.605+0000 7fcb1a000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcb1404f4e0 0x7fcb140d7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.605+0000 7fcb1a000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcb1404f4e0 0x7fcb140d7f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.138:36944/0 (socket says 172.21.15.138:36944) 2024-04-26T20:57:01.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.605+0000 7fcb1a000640 1 -- 172.21.15.138:0/2718481939 learned_addr learned my addr 172.21.15.138:0/2718481939 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:01.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.605+0000 7fe725000640 1 --2- 172.21.15.138:0/1981720823 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7200c5270 0x7fe7200cab90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe70c00c430 tx=0x7fe70c00c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.605+0000 7fc7e3e00640 1 --2- 172.21.15.138:0/1095589245 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc7c4068380 0x7fc7c406a840 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc7e40b5bc0 tx=0x7fc7d400d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.605+0000 7fcb1a000640 1 -- 172.21.15.138:0/2718481939 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb140e5060 msgr2=0x7fcb14034fb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T20:57:01.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.605+0000 7fcb1a000640 1 --2- 172.21.15.138:0/2718481939 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb140e5060 0x7fcb14034fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.605+0000 7fcb1a000640 1 -- 172.21.15.138:0/2718481939 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcb14007430 msgr2=0x7fcb140dde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.605+0000 7fcb1a000640 1 --2- 172.21.15.138:0/2718481939 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcb14007430 0x7fcb140dde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.605+0000 7fcb1a000640 1 -- 172.21.15.138:0/2718481939 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb140d89e0 con 0x7fcb1404f4e0 2024-04-26T20:57:01.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.605+0000 7fe71d600640 1 -- 172.21.15.138:0/1981720823 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe70c017070 con 0x7fe7200c5270 2024-04-26T20:57:01.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.605+0000 7fe71d600640 1 -- 172.21.15.138:0/1981720823 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe70c0052d0 con 0x7fe7200c5270 2024-04-26T20:57:01.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.605+0000 7fe71d600640 1 -- 172.21.15.138:0/1981720823 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe70c011890 con 0x7fe7200c5270 2024-04-26T20:57:01.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.605+0000 7fe728400640 1 -- 172.21.15.138:0/1981720823 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7200c9dd0 con 0x7fe7200c5270 2024-04-26T20:57:01.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.605+0000 7fe728400640 1 -- 172.21.15.138:0/1981720823 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7200ca390 con 0x7fe7200c5270 2024-04-26T20:57:01.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.609+0000 7ff15cc00640 1 -- 172.21.15.138:0/2444889673 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff160140060 con 0x7ff1580365c0 2024-04-26T20:57:01.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.609+0000 7fcb1a000640 1 --2- 172.21.15.138:0/2718481939 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcb1404f4e0 0x7fcb140d7f90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcb0800b440 tx=0x7fcb0800b900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.609+0000 7fe728400640 1 -- 172.21.15.138:0/1981720823 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe720069510 con 0x7fe7200c5270 2024-04-26T20:57:01.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.609+0000 7fe71d600640 1 -- 172.21.15.138:0/1981720823 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe70c01a070 con 0x7fe7200c5270 2024-04-26T20:57:01.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.609+0000 7fe71d600640 1 --2- 172.21.15.138:0/1981720823 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe7000683d0 0x7fe70006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.609+0000 7fe71d600640 1 -- 172.21.15.138:0/1981720823 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fe70c085ff0 con 0x7fe7200c5270 2024-04-26T20:57:01.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.613+0000 7fe725a00640 1 --2- 172.21.15.138:0/1981720823 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe7000683d0 0x7fe70006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.613+0000 7fe725a00640 1 --2- 172.21.15.138:0/1981720823 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe7000683d0 0x7fe70006a890 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe7140ad000 tx=0x7fe714004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.613+0000 7fcb13400640 1 -- 172.21.15.138:0/2718481939 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb08015020 con 0x7fcb1404f4e0 2024-04-26T20:57:01.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.613+0000 7fcb13400640 1 -- 172.21.15.138:0/2718481939 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb08011890 con 0x7fcb1404f4e0 2024-04-26T20:57:01.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.613+0000 7fcb13400640 1 -- 172.21.15.138:0/2718481939 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb08011c80 con 0x7fcb1404f4e0 2024-04-26T20:57:01.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.617+0000 7fcb1be00640 1 -- 172.21.15.138:0/2718481939 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb140dfb90 con 0x7fcb1404f4e0 2024-04-26T20:57:01.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.617+0000 7fcb1be00640 1 -- 172.21.15.138:0/2718481939 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb140e0150 con 0x7fcb1404f4e0 2024-04-26T20:57:01.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.617+0000 7fcb1be00640 1 -- 172.21.15.138:0/2718481939 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb14008e30 con 0x7fcb1404f4e0 2024-04-26T20:57:01.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.613+0000 7fe71d600640 1 -- 172.21.15.138:0/1981720823 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe70c005480 con 0x7fe7200c5270 2024-04-26T20:57:01.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.621+0000 7fcb13400640 1 -- 172.21.15.138:0/2718481939 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcb08018020 con 0x7fcb1404f4e0 2024-04-26T20:57:01.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.621+0000 7fcb13400640 1 --2- 172.21.15.138:0/2718481939 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fcafc068450 0x7fcafc06a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.621+0000 7fcb13400640 1 -- 172.21.15.138:0/2718481939 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fcb080872f0 con 0x7fcb1404f4e0 2024-04-26T20:57:01.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.621+0000 7fcb1aa00640 1 --2- 172.21.15.138:0/2718481939 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fcafc068450 0x7fcafc06a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.625+0000 7fcb13400640 1 -- 172.21.15.138:0/2718481939 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fcb0801f020 con 0x7fcb1404f4e0 2024-04-26T20:57:01.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.629+0000 7fcb1aa00640 1 --2- 172.21.15.138:0/2718481939 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fcafc068450 0x7fcafc06a910 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c007fd0 tx=0x7fcb0c0079a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.937+0000 7f9d11a00640 1 -- 172.21.15.138:0/1015947086 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f9d0c0c3640 con 0x7f9d0c0ce8c0 2024-04-26T20:57:01.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.937+0000 7f0108800640 1 -- 172.21.15.138:0/1830149397 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f00dc005590 con 0x7f01000b3d10 2024-04-26T20:57:01.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.941+0000 7f05f3200640 1 -- 172.21.15.138:0/2742048960 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f05c8005860 con 0x7f05e4047c20 2024-04-26T20:57:01.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.941+0000 7f00fa000640 1 -- 172.21.15.138:0/1830149397 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f00f40f0e20 con 0x7f01000b3d10 2024-04-26T20:57:01.944 INFO:teuthology.orchestra.run.smithi138.stdout:64424509448 2024-04-26T20:57:01.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.941+0000 7f9d02a00640 1 -- 172.21.15.138:0/1015947086 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9d0405b320 con 0x7f9d0c0ce8c0 2024-04-26T20:57:01.945 INFO:teuthology.orchestra.run.smithi138.stdout:64424509450 2024-04-26T20:57:01.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.941+0000 7f05dfe00640 1 -- 172.21.15.138:0/2742048960 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f05ec0d6cf0 con 0x7f05e4047c20 2024-04-26T20:57:01.947 INFO:teuthology.orchestra.run.smithi138.stdout:64424509450 2024-04-26T20:57:01.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.945+0000 7f9d11a00640 1 -- 172.21.15.138:0/1015947086 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9cec068450 msgr2=0x7f9cec06a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.945+0000 7f9d11a00640 1 --2- 172.21.15.138:0/1015947086 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9cec068450 0x7f9cec06a910 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc01eb50 tx=0x7f9cfc009040 comp rx=0 tx=0).stop 2024-04-26T20:57:01.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.945+0000 7f0108800640 1 -- 172.21.15.138:0/1830149397 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f00e40683d0 msgr2=0x7f00e406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.945+0000 7f0108800640 1 --2- 172.21.15.138:0/1830149397 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f00e40683d0 0x7f00e406a890 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0100160e90 tx=0x7f00f0008040 comp rx=0 tx=0).stop 2024-04-26T20:57:01.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.945+0000 7f0108800640 1 -- 172.21.15.138:0/1830149397 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01000b3d10 msgr2=0x7f01000ba6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.945+0000 7f0108800640 1 --2- 172.21.15.138:0/1830149397 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01000b3d10 0x7f01000ba6b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f00f40ac000 tx=0x7f00f4019270 comp rx=0 tx=0).stop 2024-04-26T20:57:01.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.945+0000 7f9d11a00640 1 -- 172.21.15.138:0/1015947086 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9d0c0ce8c0 msgr2=0x7f9d0c0c61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.945+0000 7f9d11a00640 1 --2- 172.21.15.138:0/1015947086 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9d0c0ce8c0 0x7f9d0c0c61d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9d04007e60 tx=0x7f9d0400e4b0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.945+0000 7f9d11a00640 1 -- 172.21.15.138:0/1015947086 shutdown_connections 2024-04-26T20:57:01.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.945+0000 7f9d11a00640 1 --2- 172.21.15.138:0/1015947086 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9cec068450 0x7f9cec06a910 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.945+0000 7f9d11a00640 1 --2- 172.21.15.138:0/1015947086 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9d0c0cf1e0 0x7f9d0c1f7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.945+0000 7f9d11a00640 1 --2- 172.21.15.138:0/1015947086 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9d0c0ce8c0 0x7f9d0c0c61d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.945+0000 7f9d11a00640 1 --2- 172.21.15.138:0/1015947086 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9d0c071ee0 0x7f9d0c2059b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.945+0000 7f9d11a00640 1 -- 172.21.15.138:0/1015947086 >> 172.21.15.138:0/1015947086 conn(0x7f9d0c0d0b20 msgr2=0x7f9d0c073530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:01.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.945+0000 7f0108800640 1 -- 172.21.15.138:0/1830149397 shutdown_connections 2024-04-26T20:57:01.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.945+0000 7f0108800640 1 --2- 172.21.15.138:0/1830149397 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f00e40683d0 0x7f00e406a890 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.945+0000 7f0108800640 1 --2- 172.21.15.138:0/1830149397 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f01001638f0 0x7f010015e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.945+0000 7f0108800640 1 --2- 172.21.15.138:0/1830149397 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f01000b4260 0x7f010015de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.945+0000 7f0108800640 1 --2- 172.21.15.138:0/1830149397 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01000b3d10 0x7f01000ba6b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.945+0000 7f0108800640 1 -- 172.21.15.138:0/1830149397 >> 172.21.15.138:0/1830149397 conn(0x7f01000d4e70 msgr2=0x7f01000b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:01.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.945+0000 7f05f3200640 1 -- 172.21.15.138:0/2742048960 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f05cc0683d0 msgr2=0x7f05cc06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.945+0000 7f05f3200640 1 --2- 172.21.15.138:0/2742048960 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f05cc0683d0 0x7f05cc06a890 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f05e00097c0 tx=0x7f05e00aa070 comp rx=0 tx=0).stop 2024-04-26T20:57:01.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.945+0000 7f05f3200640 1 -- 172.21.15.138:0/2742048960 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05e4047c20 msgr2=0x7f05e40dbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.945+0000 7f05f3200640 1 --2- 172.21.15.138:0/2742048960 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05e4047c20 0x7f05e40dbd30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f05ec000b70 tx=0x7f05ec050c40 comp rx=0 tx=0).stop 2024-04-26T20:57:01.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.945+0000 7f0108800640 1 -- 172.21.15.138:0/1830149397 shutdown_connections 2024-04-26T20:57:01.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.945+0000 7f05f3200640 1 -- 172.21.15.138:0/2742048960 shutdown_connections 2024-04-26T20:57:01.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.945+0000 7f05f3200640 1 --2- 172.21.15.138:0/2742048960 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f05cc0683d0 0x7f05cc06a890 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.945+0000 7f05f3200640 1 --2- 172.21.15.138:0/2742048960 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05e4047c20 0x7f05e40dbd30 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.945+0000 7f05f3200640 1 --2- 172.21.15.138:0/2742048960 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f05e4033e40 0x7f05e40482c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.945+0000 7f05f3200640 1 --2- 172.21.15.138:0/2742048960 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05e4005ea0 0x7f05e4049c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.945+0000 7f0108800640 1 -- 172.21.15.138:0/1830149397 wait complete. 2024-04-26T20:57:01.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.945+0000 7f05f3200640 1 -- 172.21.15.138:0/2742048960 >> 172.21.15.138:0/2742048960 conn(0x7f05e4009fc0 msgr2=0x7f05e40e5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:01.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.945+0000 7f9d11a00640 1 -- 172.21.15.138:0/1015947086 shutdown_connections 2024-04-26T20:57:01.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.945+0000 7f05f3200640 1 -- 172.21.15.138:0/2742048960 shutdown_connections 2024-04-26T20:57:01.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.945+0000 7fc7d9600640 1 -- 172.21.15.138:0/1095589245 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fc7b8005860 con 0x7fc7e415b1a0 2024-04-26T20:57:01.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.945+0000 7f9d11a00640 1 -- 172.21.15.138:0/1015947086 wait complete. 2024-04-26T20:57:01.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.945+0000 7f05f3200640 1 -- 172.21.15.138:0/2742048960 wait complete. 2024-04-26T20:57:01.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.945+0000 7fc7dbe00640 1 -- 172.21.15.138:0/1095589245 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc7dc0f49f0 con 0x7fc7e415b1a0 2024-04-26T20:57:01.955 INFO:teuthology.orchestra.run.smithi138.stdout:64424509450 2024-04-26T20:57:01.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.949+0000 7f563c000640 1 -- 172.21.15.138:0/1570966204 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f5610005860 con 0x7f563415d730 2024-04-26T20:57:01.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.949+0000 7f5631600640 1 -- 172.21.15.138:0/1570966204 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5620057060 con 0x7f563415d730 2024-04-26T20:57:01.956 INFO:teuthology.orchestra.run.smithi138.stdout:64424509449 2024-04-26T20:57:01.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.949+0000 7fc7d9600640 1 -- 172.21.15.138:0/1095589245 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc7c4068380 msgr2=0x7fc7c406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.949+0000 7fc7d9600640 1 --2- 172.21.15.138:0/1095589245 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc7c4068380 0x7fc7c406a840 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc7e40b5bc0 tx=0x7fc7d400d040 comp rx=0 tx=0).stop 2024-04-26T20:57:01.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.949+0000 7fc7d9600640 1 -- 172.21.15.138:0/1095589245 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7e415b1a0 msgr2=0x7fc7e40c7bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.949+0000 7fc7d9600640 1 --2- 172.21.15.138:0/1095589245 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7e415b1a0 0x7fc7e40c7bf0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc01d3c0 tx=0x7fc7dc01bab0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.949+0000 7fc7d9600640 1 -- 172.21.15.138:0/1095589245 shutdown_connections 2024-04-26T20:57:01.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.949+0000 7fc7d9600640 1 --2- 172.21.15.138:0/1095589245 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc7c4068380 0x7fc7c406a840 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.949+0000 7fc7d9600640 1 --2- 172.21.15.138:0/1095589245 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7e415b1a0 0x7fc7e40c7bf0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.949+0000 7fc7d9600640 1 --2- 172.21.15.138:0/1095589245 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7e40cec00 0x7fc7e40ca540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.949+0000 7fc7d9600640 1 --2- 172.21.15.138:0/1095589245 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc7e40cb880 0x7fc7e413f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.949+0000 7fc7d9600640 1 -- 172.21.15.138:0/1095589245 >> 172.21.15.138:0/1095589245 conn(0x7fc7e40d0b20 msgr2=0x7fc7e40b6280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:01.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.953+0000 7fc7d9600640 1 -- 172.21.15.138:0/1095589245 shutdown_connections 2024-04-26T20:57:01.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.953+0000 7fc7d9600640 1 -- 172.21.15.138:0/1095589245 wait complete. 2024-04-26T20:57:01.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.953+0000 7fe728400640 1 -- 172.21.15.138:0/1981720823 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fe72006ce30 con 0x7fe7200c5270 2024-04-26T20:57:01.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.953+0000 7fe71d600640 1 -- 172.21.15.138:0/1981720823 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe70c055c40 con 0x7fe7200c5270 2024-04-26T20:57:01.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.953+0000 7f563c000640 1 -- 172.21.15.138:0/1570966204 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f56140683d0 msgr2=0x7f561406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.953+0000 7f563c000640 1 --2- 172.21.15.138:0/1570966204 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f56140683d0 0x7f561406a890 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f562c0ac000 tx=0x7f562c0a8000 comp rx=0 tx=0).stop 2024-04-26T20:57:01.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.953+0000 7f563c000640 1 -- 172.21.15.138:0/1570966204 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f563415d730 msgr2=0x7f563415dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.953+0000 7f563c000640 1 --2- 172.21.15.138:0/1570966204 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f563415d730 0x7f563415dbb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f563415fbd0 tx=0x7f562000e9b0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.953+0000 7f563c000640 1 -- 172.21.15.138:0/1570966204 shutdown_connections 2024-04-26T20:57:01.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.953+0000 7f563c000640 1 --2- 172.21.15.138:0/1570966204 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f56140683d0 0x7f561406a890 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.953+0000 7f563c000640 1 --2- 172.21.15.138:0/1570966204 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f563415d730 0x7f563415dbb0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.953+0000 7f563c000640 1 --2- 172.21.15.138:0/1570966204 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f563413c350 0x7f563413c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.953+0000 7f563c000640 1 --2- 172.21.15.138:0/1570966204 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f561c0039c0 0x7f5634139bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.953+0000 7f563c000640 1 -- 172.21.15.138:0/1570966204 >> 172.21.15.138:0/1570966204 conn(0x7f563406c300 msgr2=0x7f563414ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:01.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.953+0000 7ff152000640 1 -- 172.21.15.138:0/2444889673 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7ff1580084a0 con 0x7ff1580365c0 2024-04-26T20:57:01.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.953+0000 7f563c000640 1 -- 172.21.15.138:0/1570966204 shutdown_connections 2024-04-26T20:57:01.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.953+0000 7f563c000640 1 -- 172.21.15.138:0/1570966204 wait complete. 2024-04-26T20:57:01.960 INFO:teuthology.orchestra.run.smithi138.stdout:64424509450 2024-04-26T20:57:01.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.953+0000 7ff15cc00640 1 -- 172.21.15.138:0/2444889673 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff160092ef0 con 0x7ff1580365c0 2024-04-26T20:57:01.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.953+0000 7fcb1be00640 1 -- 172.21.15.138:0/2718481939 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fcb140f2390 con 0x7fcb1404f4e0 2024-04-26T20:57:01.961 INFO:teuthology.orchestra.run.smithi138.stdout:64424509449 2024-04-26T20:57:01.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.953+0000 7fcb13400640 1 -- 172.21.15.138:0/2718481939 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcb0800d040 con 0x7fcb1404f4e0 2024-04-26T20:57:01.962 INFO:teuthology.orchestra.run.smithi138.stdout:55834574858 2024-04-26T20:57:01.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.957+0000 7ff152000640 1 -- 172.21.15.138:0/2444889673 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff1400683b0 msgr2=0x7ff14006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.957+0000 7ff152000640 1 --2- 172.21.15.138:0/2444889673 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff1400683b0 0x7ff14006a870 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff158007ff0 tx=0x7ff154008040 comp rx=0 tx=0).stop 2024-04-26T20:57:01.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.957+0000 7ff152000640 1 -- 172.21.15.138:0/2444889673 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff1580365c0 msgr2=0x7ff15816bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.957+0000 7ff152000640 1 --2- 172.21.15.138:0/2444889673 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff1580365c0 0x7ff15816bbe0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff16006abb0 tx=0x7ff16006a1b0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.957+0000 7ff152000640 1 -- 172.21.15.138:0/2444889673 shutdown_connections 2024-04-26T20:57:01.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.957+0000 7ff152000640 1 --2- 172.21.15.138:0/2444889673 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff1400683b0 0x7ff14006a870 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.957+0000 7ff152000640 1 --2- 172.21.15.138:0/2444889673 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1580e35b0 0x7ff1580078e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.957+0000 7ff152000640 1 --2- 172.21.15.138:0/2444889673 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff1580514a0 0x7ff1580073a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.957+0000 7ff152000640 1 --2- 172.21.15.138:0/2444889673 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff1580365c0 0x7ff15816bbe0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.957+0000 7ff152000640 1 -- 172.21.15.138:0/2444889673 >> 172.21.15.138:0/2444889673 conn(0x7ff15801e6d0 msgr2=0x7ff158036ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:01.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.961+0000 7fcb1be00640 1 -- 172.21.15.138:0/2718481939 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fcafc068450 msgr2=0x7fcafc06a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.961+0000 7fcb1be00640 1 --2- 172.21.15.138:0/2718481939 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fcafc068450 0x7fcafc06a910 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c007fd0 tx=0x7fcb0c0079a0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.961+0000 7fcb1be00640 1 -- 172.21.15.138:0/2718481939 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcb1404f4e0 msgr2=0x7fcb140d7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.961+0000 7fcb1be00640 1 --2- 172.21.15.138:0/2718481939 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcb1404f4e0 0x7fcb140d7f90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcb0800b440 tx=0x7fcb0800b900 comp rx=0 tx=0).stop 2024-04-26T20:57:01.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.961+0000 7fcb1be00640 1 -- 172.21.15.138:0/2718481939 shutdown_connections 2024-04-26T20:57:01.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.961+0000 7fcb1be00640 1 --2- 172.21.15.138:0/2718481939 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fcafc068450 0x7fcafc06a910 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.961+0000 7fcb1be00640 1 --2- 172.21.15.138:0/2718481939 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb140e5060 0x7fcb14034fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.961+0000 7fcb1be00640 1 --2- 172.21.15.138:0/2718481939 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcb1404f4e0 0x7fcb140d7f90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.961+0000 7fcb1be00640 1 --2- 172.21.15.138:0/2718481939 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcb14007430 0x7fcb140dde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.961+0000 7fcb1be00640 1 -- 172.21.15.138:0/2718481939 >> 172.21.15.138:0/2718481939 conn(0x7fcb1400a410 msgr2=0x7fcb1400a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:01.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.961+0000 7fcb1be00640 1 -- 172.21.15.138:0/2718481939 shutdown_connections 2024-04-26T20:57:01.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.961+0000 7fcb1be00640 1 -- 172.21.15.138:0/2718481939 wait complete. 2024-04-26T20:57:01.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.961+0000 7fe728400640 1 -- 172.21.15.138:0/1981720823 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe7000683d0 msgr2=0x7fe70006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.961+0000 7fe728400640 1 --2- 172.21.15.138:0/1981720823 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe7000683d0 0x7fe70006a890 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe7140ad000 tx=0x7fe714004740 comp rx=0 tx=0).stop 2024-04-26T20:57:01.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.961+0000 7fe728400640 1 -- 172.21.15.138:0/1981720823 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7200c5270 msgr2=0x7fe7200cab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.961+0000 7fe728400640 1 --2- 172.21.15.138:0/1981720823 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7200c5270 0x7fe7200cab90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe70c00c430 tx=0x7fe70c00c8f0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.961+0000 7fe728400640 1 -- 172.21.15.138:0/1981720823 shutdown_connections 2024-04-26T20:57:01.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.961+0000 7fe728400640 1 --2- 172.21.15.138:0/1981720823 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe7000683d0 0x7fe70006a890 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.961+0000 7fe728400640 1 --2- 172.21.15.138:0/1981720823 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7200d12d0 0x7fe72015ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.961+0000 7fe728400640 1 --2- 172.21.15.138:0/1981720823 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7200c5270 0x7fe7200cab90 secure :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe70c00c430 tx=0x7fe70c00c8f0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.961+0000 7fe728400640 1 --2- 172.21.15.138:0/1981720823 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe72006c300 0x7fe7200c8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.961+0000 7fe728400640 1 -- 172.21.15.138:0/1981720823 >> 172.21.15.138:0/1981720823 conn(0x7fe7200d1c30 msgr2=0x7fe7200ceec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:01.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.961+0000 7fe728400640 1 -- 172.21.15.138:0/1981720823 shutdown_connections 2024-04-26T20:57:01.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.961+0000 7fe728400640 1 -- 172.21.15.138:0/1981720823 wait complete. 2024-04-26T20:57:01.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.961+0000 7ff152000640 1 -- 172.21.15.138:0/2444889673 shutdown_connections 2024-04-26T20:57:01.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:01.961+0000 7ff152000640 1 -- 172.21.15.138:0/2444889673 wait complete. 2024-04-26T20:57:01.997 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.0 2024-04-26T20:57:01.997 DEBUG:teuthology.parallel:result is None 2024-04-26T20:57:02.001 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.2 2024-04-26T20:57:02.001 DEBUG:teuthology.parallel:result is None 2024-04-26T20:57:02.001 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.5 2024-04-26T20:57:02.001 DEBUG:teuthology.parallel:result is None 2024-04-26T20:57:02.009 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.3 2024-04-26T20:57:02.010 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.6 2024-04-26T20:57:02.010 DEBUG:teuthology.parallel:result is None 2024-04-26T20:57:02.010 DEBUG:teuthology.parallel:result is None 2024-04-26T20:57:02.011 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.7 2024-04-26T20:57:02.011 DEBUG:teuthology.parallel:result is None 2024-04-26T20:57:02.014 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.4 2024-04-26T20:57:02.015 DEBUG:teuthology.parallel:result is None 2024-04-26T20:57:02.015 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.1 2024-04-26T20:57:02.015 DEBUG:teuthology.parallel:result is None 2024-04-26T20:57:02.015 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T20:57:02.015 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T20:57:02.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.185+0000 7ffaa9400640 1 Processor -- start 2024-04-26T20:57:02.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.185+0000 7ffaa9400640 1 -- start start 2024-04-26T20:57:02.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.189+0000 7ffaa9400640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ffaa415cf80 0x7ffaa4073b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:02.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.189+0000 7ffaa9400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ffaa40cc1e0 0x7ffaa40ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:02.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.189+0000 7ffaa9400640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffaa40727f0 con 0x7ffaa40cbe00 2024-04-26T20:57:02.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.189+0000 7ffaa9400640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7ffaa4073680 con 0x7ffaa40cc1e0 2024-04-26T20:57:02.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.189+0000 7ffaa9400640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7ffaa4072a70 con 0x7ffaa415cf80 2024-04-26T20:57:02.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.189+0000 7ffaa2800640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7ffaa40cbe00 0x7ffaa406de70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:43780/0 (socket says 172.21.15.138:43780) 2024-04-26T20:57:02.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.189+0000 7ffaa2800640 1 -- 172.21.15.138:0/199739541 learned_addr learned my addr 172.21.15.138:0/199739541 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:02.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.189+0000 7ffaa3200640 1 --2- 172.21.15.138:0/199739541 >> v2:172.21.15.138:3300/0 conn(0x7ffaa40cc1e0 0x7ffaa40ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:02.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.189+0000 7ffaa1e00640 1 -- 172.21.15.138:0/199739541 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1341881435 0 0) 0x7ffa94001120 con 0x7ffaa40cbe00 2024-04-26T20:57:02.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.189+0000 7ffa9be00640 1 --2- 172.21.15.138:0/199739541 >> v2:172.21.15.143:3300/0 conn(0x7ffaa415cf80 0x7ffaa4073b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:02.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.189+0000 7ffaa1e00640 1 -- 172.21.15.138:0/199739541 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa88003530 con 0x7ffaa40cbe00 2024-04-26T20:57:02.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.189+0000 7ffaa3200640 1 -- 172.21.15.138:0/199739541 >> v2:172.21.15.143:3300/0 conn(0x7ffaa415cf80 msgr2=0x7ffaa4073b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:02.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.189+0000 7ffaa3200640 1 --2- 172.21.15.138:0/199739541 >> v2:172.21.15.143:3300/0 conn(0x7ffaa415cf80 0x7ffaa4073b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:02.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.189+0000 7ffaa3200640 1 -- 172.21.15.138:0/199739541 >> v1:172.21.15.138:6789/0 conn(0x7ffaa40cbe00 legacy=0x7ffaa406de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:02.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.189+0000 7ffaa3200640 1 -- 172.21.15.138:0/199739541 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaa4072d50 con 0x7ffaa40cc1e0 2024-04-26T20:57:02.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.189+0000 7ffa9be00640 1 --2- 172.21.15.138:0/199739541 >> v2:172.21.15.143:3300/0 conn(0x7ffaa415cf80 0x7ffaa4073b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:57:02.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.193+0000 7ffaa3200640 1 --2- 172.21.15.138:0/199739541 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffaa40cc1e0 0x7ffaa40ce6f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ffaa40b6c50 tx=0x7ffa9c01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=835a85454a5f2739 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:02.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.193+0000 7ffaa1e00640 1 -- 172.21.15.138:0/199739541 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c0b2070 con 0x7ffaa40cc1e0 2024-04-26T20:57:02.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.193+0000 7ffaa1e00640 1 -- 172.21.15.138:0/199739541 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa9c0a57f0 con 0x7ffaa40cc1e0 2024-04-26T20:57:02.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.193+0000 7ffaa1e00640 1 -- 172.21.15.138:0/199739541 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c0a5bc0 con 0x7ffaa40cc1e0 2024-04-26T20:57:02.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.193+0000 7ffaa9400640 1 -- 172.21.15.138:0/199739541 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffaa40cc1e0 msgr2=0x7ffaa40ce6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:02.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.193+0000 7ffaa9400640 1 --2- 172.21.15.138:0/199739541 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffaa40cc1e0 0x7ffaa40ce6f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ffaa40b6c50 tx=0x7ffa9c01c930 comp rx=0 tx=0).stop 2024-04-26T20:57:02.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.193+0000 7ffaa9400640 1 -- 172.21.15.138:0/199739541 shutdown_connections 2024-04-26T20:57:02.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.193+0000 7ffaa9400640 1 --2- 172.21.15.138:0/199739541 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffaa40cc1e0 0x7ffaa40ce6f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:02.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.193+0000 7ffaa9400640 1 --2- 172.21.15.138:0/199739541 >> v2:172.21.15.143:3300/0 conn(0x7ffaa415cf80 0x7ffaa4073b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:02.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.193+0000 7ffaa9400640 1 -- 172.21.15.138:0/199739541 >> 172.21.15.138:0/199739541 conn(0x7ffaa40d0b20 msgr2=0x7ffaa40d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:02.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.193+0000 7ffaa9400640 1 -- 172.21.15.138:0/199739541 shutdown_connections 2024-04-26T20:57:02.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.193+0000 7ffaa9400640 1 -- 172.21.15.138:0/199739541 wait complete. 2024-04-26T20:57:02.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.193+0000 7ffaa9400640 1 Processor -- start 2024-04-26T20:57:02.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.193+0000 7ffaa9400640 1 -- start start 2024-04-26T20:57:02.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.193+0000 7ffaa9400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffaa40cbe00 0x7ffaa41522a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:02.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.193+0000 7ffaa9400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffaa40cc1e0 0x7ffaa40b4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:02.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.193+0000 7ffaa9400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffaa415cf80 0x7ffaa40c8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:02.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.193+0000 7ffaa9400640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa40741d0 con 0x7ffaa415cf80 2024-04-26T20:57:02.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.193+0000 7ffaa9400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa4074050 con 0x7ffaa40cbe00 2024-04-26T20:57:02.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.193+0000 7ffaa9400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ffaa40d0780 con 0x7ffaa40cc1e0 2024-04-26T20:57:02.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.193+0000 7ffaa3200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffaa415cf80 0x7ffaa40c8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:02.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.193+0000 7ffaa3200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffaa415cf80 0x7ffaa40c8d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:57174/0 (socket says 172.21.15.138:57174) 2024-04-26T20:57:02.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.193+0000 7ffaa3200640 1 -- 172.21.15.138:0/3696211079 learned_addr learned my addr 172.21.15.138:0/3696211079 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:02.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.197+0000 7ffa9be00640 1 --2- 172.21.15.138:0/3696211079 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffaa40cc1e0 0x7ffaa40b4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:02.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.197+0000 7ffaa2800640 1 --2- 172.21.15.138:0/3696211079 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffaa40cbe00 0x7ffaa41522a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:02.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.197+0000 7ffaa3200640 1 -- 172.21.15.138:0/3696211079 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffaa40cc1e0 msgr2=0x7ffaa40b4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:02.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.197+0000 7ffaa3200640 1 --2- 172.21.15.138:0/3696211079 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffaa40cc1e0 0x7ffaa40b4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:02.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.197+0000 7ffaa3200640 1 -- 172.21.15.138:0/3696211079 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffaa40cbe00 msgr2=0x7ffaa41522a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:02.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.197+0000 7ffaa3200640 1 --2- 172.21.15.138:0/3696211079 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffaa40cbe00 0x7ffaa41522a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:02.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.197+0000 7ffaa3200640 1 -- 172.21.15.138:0/3696211079 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaa41694f0 con 0x7ffaa415cf80 2024-04-26T20:57:02.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.197+0000 7ffaa2800640 1 --2- 172.21.15.138:0/3696211079 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffaa40cbe00 0x7ffaa41522a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:02.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.197+0000 7ffaa3200640 1 --2- 172.21.15.138:0/3696211079 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffaa415cf80 0x7ffaa40c8d70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c0b0040 tx=0x7ffa9c0196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:02.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.197+0000 7ffa9aa00640 1 -- 172.21.15.138:0/3696211079 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c0b2040 con 0x7ffaa415cf80 2024-04-26T20:57:02.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.197+0000 7ffa9aa00640 1 -- 172.21.15.138:0/3696211079 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa9c0bf070 con 0x7ffaa415cf80 2024-04-26T20:57:02.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.197+0000 7ffa9aa00640 1 -- 172.21.15.138:0/3696211079 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c0b86b0 con 0x7ffaa415cf80 2024-04-26T20:57:02.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.197+0000 7ffaa9400640 1 -- 172.21.15.138:0/3696211079 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaa4169790 con 0x7ffaa415cf80 2024-04-26T20:57:02.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.197+0000 7ffaa9400640 1 -- 172.21.15.138:0/3696211079 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaa40b3c40 con 0x7ffaa415cf80 2024-04-26T20:57:02.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.197+0000 7ffaa9400640 1 -- 172.21.15.138:0/3696211079 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaa4069510 con 0x7ffaa415cf80 2024-04-26T20:57:02.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.197+0000 7ffa9aa00640 1 -- 172.21.15.138:0/3696211079 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ffa9c0b8850 con 0x7ffaa415cf80 2024-04-26T20:57:02.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.197+0000 7ffa9aa00640 1 --2- 172.21.15.138:0/3696211079 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ffa80068380 0x7ffa8006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:02.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.197+0000 7ffa9aa00640 1 -- 172.21.15.138:0/3696211079 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7ffa9c121ee0 con 0x7ffaa415cf80 2024-04-26T20:57:02.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.201+0000 7ffaa2800640 1 --2- 172.21.15.138:0/3696211079 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ffa80068380 0x7ffa8006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:02.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.201+0000 7ffaa2800640 1 --2- 172.21.15.138:0/3696211079 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ffa80068380 0x7ffa8006a840 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ffa94005890 tx=0x7ffa94009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:02.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.201+0000 7ffa9aa00640 1 -- 172.21.15.138:0/3696211079 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ffa9c016520 con 0x7ffaa415cf80 2024-04-26T20:57:02.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.357+0000 7ffaa9400640 1 -- 172.21.15.138:0/3696211079 --> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffaa40cf380 con 0x7ffa80068380 2024-04-26T20:57:02.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.365+0000 7ffa9aa00640 1 -- 172.21.15.138:0/3696211079 <== mgr.4100 v2:172.21.15.143:6832/4275464198 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7ffaa40cf380 con 0x7ffa80068380 2024-04-26T20:57:02.373 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:57:02.376 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-04-26T20:57:02.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.369+0000 7ffaa9400640 1 -- 172.21.15.138:0/3696211079 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ffa80068380 msgr2=0x7ffa8006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:02.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.369+0000 7ffaa9400640 1 --2- 172.21.15.138:0/3696211079 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ffa80068380 0x7ffa8006a840 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ffa94005890 tx=0x7ffa94009040 comp rx=0 tx=0).stop 2024-04-26T20:57:02.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.369+0000 7ffaa9400640 1 -- 172.21.15.138:0/3696211079 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffaa415cf80 msgr2=0x7ffaa40c8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:02.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.369+0000 7ffaa9400640 1 --2- 172.21.15.138:0/3696211079 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffaa415cf80 0x7ffaa40c8d70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c0b0040 tx=0x7ffa9c0196d0 comp rx=0 tx=0).stop 2024-04-26T20:57:02.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.369+0000 7ffaa9400640 1 -- 172.21.15.138:0/3696211079 shutdown_connections 2024-04-26T20:57:02.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.369+0000 7ffaa9400640 1 --2- 172.21.15.138:0/3696211079 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ffa80068380 0x7ffa8006a840 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:02.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.369+0000 7ffaa9400640 1 --2- 172.21.15.138:0/3696211079 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffaa415cf80 0x7ffaa40c8d70 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:02.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.369+0000 7ffaa9400640 1 --2- 172.21.15.138:0/3696211079 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffaa40cc1e0 0x7ffaa40b4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:02.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.369+0000 7ffaa9400640 1 --2- 172.21.15.138:0/3696211079 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffaa40cbe00 0x7ffaa41522a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:02.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.369+0000 7ffaa9400640 1 -- 172.21.15.138:0/3696211079 >> 172.21.15.138:0/3696211079 conn(0x7ffaa40d0b20 msgr2=0x7ffaa4159de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:02.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.369+0000 7ffaa9400640 1 -- 172.21.15.138:0/3696211079 shutdown_connections 2024-04-26T20:57:02.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.369+0000 7ffaa9400640 1 -- 172.21.15.138:0/3696211079 wait complete. 2024-04-26T20:57:02.393 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-04-26T20:57:01.244795+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219600,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755120,"statfs":{"total":773094113280,"available":772869242880,"internally_reserved":0,"allocated":3514368,"data_stored":2074536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003590"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789875+0000","last_change":"2024-04-26T20:56:39.229878+0000","last_active":"2024-04-26T20:56:45.789875+0000","last_peered":"2024-04-26T20:56:45.789875+0000","last_clean":"2024-04-26T20:56:45.789875+0000","last_became_active":"2024-04-26T20:56:39.229574+0000","last_became_peered":"2024-04-26T20:56:39.229574+0000","last_unstale":"2024-04-26T20:56:45.789875+0000","last_undegraded":"2024-04-26T20:56:45.789875+0000","last_fullsized":"2024-04-26T20:56:45.789875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:24:19.832688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789650+0000","last_change":"2024-04-26T20:56:40.249312+0000","last_active":"2024-04-26T20:56:45.789650+0000","last_peered":"2024-04-26T20:56:45.789650+0000","last_clean":"2024-04-26T20:56:45.789650+0000","last_became_active":"2024-04-26T20:56:40.249079+0000","last_became_peered":"2024-04-26T20:56:40.249079+0000","last_unstale":"2024-04-26T20:56:45.789650+0000","last_undegraded":"2024-04-26T20:56:45.789650+0000","last_fullsized":"2024-04-26T20:56:45.789650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:11:49.558212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.280455+0000","last_change":"2024-04-26T20:56:44.274985+0000","last_active":"2024-04-26T20:56:45.280455+0000","last_peered":"2024-04-26T20:56:45.280455+0000","last_clean":"2024-04-26T20:56:45.280455+0000","last_became_active":"2024-04-26T20:56:44.274510+0000","last_became_peered":"2024-04-26T20:56:44.274510+0000","last_unstale":"2024-04-26T20:56:45.280455+0000","last_undegraded":"2024-04-26T20:56:45.280455+0000","last_fullsized":"2024-04-26T20:56:45.280455+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:59.157222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789762+0000","last_change":"2024-04-26T20:56:39.213876+0000","last_active":"2024-04-26T20:56:45.789762+0000","last_peered":"2024-04-26T20:56:45.789762+0000","last_clean":"2024-04-26T20:56:45.789762+0000","last_became_active":"2024-04-26T20:56:39.213454+0000","last_became_peered":"2024-04-26T20:56:39.213454+0000","last_unstale":"2024-04-26T20:56:45.789762+0000","last_undegraded":"2024-04-26T20:56:45.789762+0000","last_fullsized":"2024-04-26T20:56:45.789762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:40:48.839377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789322+0000","last_change":"2024-04-26T20:56:40.247462+0000","last_active":"2024-04-26T20:56:45.789322+0000","last_peered":"2024-04-26T20:56:45.789322+0000","last_clean":"2024-04-26T20:56:45.789322+0000","last_became_active":"2024-04-26T20:56:40.246735+0000","last_became_peered":"2024-04-26T20:56:40.246735+0000","last_unstale":"2024-04-26T20:56:45.789322+0000","last_undegraded":"2024-04-26T20:56:45.789322+0000","last_fullsized":"2024-04-26T20:56:45.789322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:29.705970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.279752+0000","last_change":"2024-04-26T20:56:44.275068+0000","last_active":"2024-04-26T20:56:45.279752+0000","last_peered":"2024-04-26T20:56:45.279752+0000","last_clean":"2024-04-26T20:56:45.279752+0000","last_became_active":"2024-04-26T20:56:44.273517+0000","last_became_peered":"2024-04-26T20:56:44.273517+0000","last_unstale":"2024-04-26T20:56:45.279752+0000","last_undegraded":"2024-04-26T20:56:45.279752+0000","last_fullsized":"2024-04-26T20:56:45.279752+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:41:08.276592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278739+0000","last_change":"2024-04-26T20:56:39.213779+0000","last_active":"2024-04-26T20:56:45.278739+0000","last_peered":"2024-04-26T20:56:45.278739+0000","last_clean":"2024-04-26T20:56:45.278739+0000","last_became_active":"2024-04-26T20:56:39.213433+0000","last_became_peered":"2024-04-26T20:56:39.213433+0000","last_unstale":"2024-04-26T20:56:45.278739+0000","last_undegraded":"2024-04-26T20:56:45.278739+0000","last_fullsized":"2024-04-26T20:56:45.278739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:33.595789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.465212+0000","last_change":"2024-04-26T20:56:40.240847+0000","last_active":"2024-04-26T20:56:45.465212+0000","last_peered":"2024-04-26T20:56:45.465212+0000","last_clean":"2024-04-26T20:56:45.465212+0000","last_became_active":"2024-04-26T20:56:40.240513+0000","last_became_peered":"2024-04-26T20:56:40.240513+0000","last_unstale":"2024-04-26T20:56:45.465212+0000","last_undegraded":"2024-04-26T20:56:45.465212+0000","last_fullsized":"2024-04-26T20:56:45.465212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:31.742963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.280055+0000","last_change":"2024-04-26T20:56:44.268256+0000","last_active":"2024-04-26T20:56:45.280055+0000","last_peered":"2024-04-26T20:56:45.280055+0000","last_clean":"2024-04-26T20:56:45.280055+0000","last_became_active":"2024-04-26T20:56:44.267885+0000","last_became_peered":"2024-04-26T20:56:44.267885+0000","last_unstale":"2024-04-26T20:56:45.280055+0000","last_undegraded":"2024-04-26T20:56:45.280055+0000","last_fullsized":"2024-04-26T20:56:45.280055+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:24:14.331856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278928+0000","last_change":"2024-04-26T20:56:39.210434+0000","last_active":"2024-04-26T20:56:45.278928+0000","last_peered":"2024-04-26T20:56:45.278928+0000","last_clean":"2024-04-26T20:56:45.278928+0000","last_became_active":"2024-04-26T20:56:39.210149+0000","last_became_peered":"2024-04-26T20:56:39.210149+0000","last_unstale":"2024-04-26T20:56:45.278928+0000","last_undegraded":"2024-04-26T20:56:45.278928+0000","last_fullsized":"2024-04-26T20:56:45.278928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:57.508629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786985+0000","last_change":"2024-04-26T20:56:40.232523+0000","last_active":"2024-04-26T20:56:45.786985+0000","last_peered":"2024-04-26T20:56:45.786985+0000","last_clean":"2024-04-26T20:56:45.786985+0000","last_became_active":"2024-04-26T20:56:40.230256+0000","last_became_peered":"2024-04-26T20:56:40.230256+0000","last_unstale":"2024-04-26T20:56:45.786985+0000","last_undegraded":"2024-04-26T20:56:45.786985+0000","last_fullsized":"2024-04-26T20:56:45.786985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:16:36.927553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.279880+0000","last_change":"2024-04-26T20:56:44.274965+0000","last_active":"2024-04-26T20:56:45.279880+0000","last_peered":"2024-04-26T20:56:45.279880+0000","last_clean":"2024-04-26T20:56:45.279880+0000","last_became_active":"2024-04-26T20:56:44.274623+0000","last_became_peered":"2024-04-26T20:56:44.274623+0000","last_unstale":"2024-04-26T20:56:45.279880+0000","last_undegraded":"2024-04-26T20:56:45.279880+0000","last_fullsized":"2024-04-26T20:56:45.279880+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:20:44.467468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786581+0000","last_change":"2024-04-26T20:56:40.245428+0000","last_active":"2024-04-26T20:56:45.786581+0000","last_peered":"2024-04-26T20:56:45.786581+0000","last_clean":"2024-04-26T20:56:45.786581+0000","last_became_active":"2024-04-26T20:56:40.245183+0000","last_became_peered":"2024-04-26T20:56:40.245183+0000","last_unstale":"2024-04-26T20:56:45.786581+0000","last_undegraded":"2024-04-26T20:56:45.786581+0000","last_fullsized":"2024-04-26T20:56:45.786581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:39:41.674507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786761+0000","last_change":"2024-04-26T20:56:39.230950+0000","last_active":"2024-04-26T20:56:45.786761+0000","last_peered":"2024-04-26T20:56:45.786761+0000","last_clean":"2024-04-26T20:56:45.786761+0000","last_became_active":"2024-04-26T20:56:39.229924+0000","last_became_peered":"2024-04-26T20:56:39.229924+0000","last_unstale":"2024-04-26T20:56:45.786761+0000","last_undegraded":"2024-04-26T20:56:45.786761+0000","last_fullsized":"2024-04-26T20:56:45.786761+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:57.508629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786803+0000","last_change":"2024-04-26T20:56:44.266930+0000","last_active":"2024-04-26T20:56:45.786803+0000","last_peered":"2024-04-26T20:56:45.786803+0000","last_clean":"2024-04-26T20:56:45.786803+0000","last_became_active":"2024-04-26T20:56:44.266307+0000","last_became_peered":"2024-04-26T20:56:44.266307+0000","last_unstale":"2024-04-26T20:56:45.786803+0000","last_undegraded":"2024-04-26T20:56:45.786803+0000","last_fullsized":"2024-04-26T20:56:45.786803+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:49:09.870181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.281399+0000","last_change":"2024-04-26T20:56:40.243411+0000","last_active":"2024-04-26T20:56:45.281399+0000","last_peered":"2024-04-26T20:56:45.281399+0000","last_clean":"2024-04-26T20:56:45.281399+0000","last_became_active":"2024-04-26T20:56:40.242875+0000","last_became_peered":"2024-04-26T20:56:40.242875+0000","last_unstale":"2024-04-26T20:56:45.281399+0000","last_undegraded":"2024-04-26T20:56:45.281399+0000","last_fullsized":"2024-04-26T20:56:45.281399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:10:58.729505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788799+0000","last_change":"2024-04-26T20:56:39.224859+0000","last_active":"2024-04-26T20:56:45.788799+0000","last_peered":"2024-04-26T20:56:45.788799+0000","last_clean":"2024-04-26T20:56:45.788799+0000","last_became_active":"2024-04-26T20:56:39.223684+0000","last_became_peered":"2024-04-26T20:56:39.223684+0000","last_unstale":"2024-04-26T20:56:45.788799+0000","last_undegraded":"2024-04-26T20:56:45.788799+0000","last_fullsized":"2024-04-26T20:56:45.788799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:41:13.015392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278377+0000","last_change":"2024-04-26T20:56:44.269716+0000","last_active":"2024-04-26T20:56:45.278377+0000","last_peered":"2024-04-26T20:56:45.278377+0000","last_clean":"2024-04-26T20:56:45.278377+0000","last_became_active":"2024-04-26T20:56:44.269363+0000","last_became_peered":"2024-04-26T20:56:44.269363+0000","last_unstale":"2024-04-26T20:56:45.278377+0000","last_undegraded":"2024-04-26T20:56:45.278377+0000","last_fullsized":"2024-04-26T20:56:45.278377+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:39:45.714289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789241+0000","last_change":"2024-04-26T20:56:40.233387+0000","last_active":"2024-04-26T20:56:45.789241+0000","last_peered":"2024-04-26T20:56:45.789241+0000","last_clean":"2024-04-26T20:56:45.789241+0000","last_became_active":"2024-04-26T20:56:40.233078+0000","last_became_peered":"2024-04-26T20:56:40.233078+0000","last_unstale":"2024-04-26T20:56:45.789241+0000","last_undegraded":"2024-04-26T20:56:45.789241+0000","last_fullsized":"2024-04-26T20:56:45.789241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:10:26.700437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788991+0000","last_change":"2024-04-26T20:56:39.211859+0000","last_active":"2024-04-26T20:56:45.788991+0000","last_peered":"2024-04-26T20:56:45.788991+0000","last_clean":"2024-04-26T20:56:45.788991+0000","last_became_active":"2024-04-26T20:56:39.211629+0000","last_became_peered":"2024-04-26T20:56:39.211629+0000","last_unstale":"2024-04-26T20:56:45.788991+0000","last_undegraded":"2024-04-26T20:56:45.788991+0000","last_fullsized":"2024-04-26T20:56:45.788991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:27.088665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.281180+0000","last_change":"2024-04-26T20:56:44.276902+0000","last_active":"2024-04-26T20:56:45.281180+0000","last_peered":"2024-04-26T20:56:45.281180+0000","last_clean":"2024-04-26T20:56:45.281180+0000","last_became_active":"2024-04-26T20:56:44.276509+0000","last_became_peered":"2024-04-26T20:56:44.276509+0000","last_unstale":"2024-04-26T20:56:45.281180+0000","last_undegraded":"2024-04-26T20:56:45.281180+0000","last_fullsized":"2024-04-26T20:56:45.281180+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:07:31.106137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786397+0000","last_change":"2024-04-26T20:56:40.229542+0000","last_active":"2024-04-26T20:56:45.786397+0000","last_peered":"2024-04-26T20:56:45.786397+0000","last_clean":"2024-04-26T20:56:45.786397+0000","last_became_active":"2024-04-26T20:56:40.227907+0000","last_became_peered":"2024-04-26T20:56:40.227907+0000","last_unstale":"2024-04-26T20:56:45.786397+0000","last_undegraded":"2024-04-26T20:56:45.786397+0000","last_fullsized":"2024-04-26T20:56:45.786397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:32:50.377638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.277959+0000","last_change":"2024-04-26T20:56:39.226639+0000","last_active":"2024-04-26T20:56:45.277959+0000","last_peered":"2024-04-26T20:56:45.277959+0000","last_clean":"2024-04-26T20:56:45.277959+0000","last_became_active":"2024-04-26T20:56:39.226040+0000","last_became_peered":"2024-04-26T20:56:39.226040+0000","last_unstale":"2024-04-26T20:56:45.277959+0000","last_undegraded":"2024-04-26T20:56:45.277959+0000","last_fullsized":"2024-04-26T20:56:45.277959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:11:12.183144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.280450+0000","last_change":"2024-04-26T20:56:44.264659+0000","last_active":"2024-04-26T20:56:45.280450+0000","last_peered":"2024-04-26T20:56:45.280450+0000","last_clean":"2024-04-26T20:56:45.280450+0000","last_became_active":"2024-04-26T20:56:44.264283+0000","last_became_peered":"2024-04-26T20:56:44.264283+0000","last_unstale":"2024-04-26T20:56:45.280450+0000","last_undegraded":"2024-04-26T20:56:45.280450+0000","last_fullsized":"2024-04-26T20:56:45.280450+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:50:30.081888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789823+0000","last_change":"2024-04-26T20:56:40.254246+0000","last_active":"2024-04-26T20:56:45.789823+0000","last_peered":"2024-04-26T20:56:45.789823+0000","last_clean":"2024-04-26T20:56:45.789823+0000","last_became_active":"2024-04-26T20:56:40.253998+0000","last_became_peered":"2024-04-26T20:56:40.253998+0000","last_unstale":"2024-04-26T20:56:45.789823+0000","last_undegraded":"2024-04-26T20:56:45.789823+0000","last_fullsized":"2024-04-26T20:56:45.789823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:15.179866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.787122+0000","last_change":"2024-04-26T20:56:39.228884+0000","last_active":"2024-04-26T20:56:45.787122+0000","last_peered":"2024-04-26T20:56:45.787122+0000","last_clean":"2024-04-26T20:56:45.787122+0000","last_became_active":"2024-04-26T20:56:39.228629+0000","last_became_peered":"2024-04-26T20:56:39.228629+0000","last_unstale":"2024-04-26T20:56:45.787122+0000","last_undegraded":"2024-04-26T20:56:45.787122+0000","last_fullsized":"2024-04-26T20:56:45.787122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:41:03.229071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.279855+0000","last_change":"2024-04-26T20:56:44.260583+0000","last_active":"2024-04-26T20:56:45.279855+0000","last_peered":"2024-04-26T20:56:45.279855+0000","last_clean":"2024-04-26T20:56:45.279855+0000","last_became_active":"2024-04-26T20:56:44.260203+0000","last_became_peered":"2024-04-26T20:56:44.260203+0000","last_unstale":"2024-04-26T20:56:45.279855+0000","last_undegraded":"2024-04-26T20:56:45.279855+0000","last_fullsized":"2024-04-26T20:56:45.279855+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:11:53.597994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789753+0000","last_change":"2024-04-26T20:56:40.248051+0000","last_active":"2024-04-26T20:56:45.789753+0000","last_peered":"2024-04-26T20:56:45.789753+0000","last_clean":"2024-04-26T20:56:45.789753+0000","last_became_active":"2024-04-26T20:56:40.247752+0000","last_became_peered":"2024-04-26T20:56:40.247752+0000","last_unstale":"2024-04-26T20:56:45.789753+0000","last_undegraded":"2024-04-26T20:56:45.789753+0000","last_fullsized":"2024-04-26T20:56:45.789753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:12:39.534861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.790043+0000","last_change":"2024-04-26T20:56:39.215006+0000","last_active":"2024-04-26T20:56:45.790043+0000","last_peered":"2024-04-26T20:56:45.790043+0000","last_clean":"2024-04-26T20:56:45.790043+0000","last_became_active":"2024-04-26T20:56:39.214568+0000","last_became_peered":"2024-04-26T20:56:39.214568+0000","last_unstale":"2024-04-26T20:56:45.790043+0000","last_undegraded":"2024-04-26T20:56:45.790043+0000","last_fullsized":"2024-04-26T20:56:45.790043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:48:30.348419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788054+0000","last_change":"2024-04-26T20:56:44.266191+0000","last_active":"2024-04-26T20:56:45.788054+0000","last_peered":"2024-04-26T20:56:45.788054+0000","last_clean":"2024-04-26T20:56:45.788054+0000","last_became_active":"2024-04-26T20:56:44.265828+0000","last_became_peered":"2024-04-26T20:56:44.265828+0000","last_unstale":"2024-04-26T20:56:45.788054+0000","last_undegraded":"2024-04-26T20:56:45.788054+0000","last_fullsized":"2024-04-26T20:56:45.788054+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:07.880235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.790688+0000","last_change":"2024-04-26T20:56:40.235429+0000","last_active":"2024-04-26T20:56:45.790688+0000","last_peered":"2024-04-26T20:56:45.790688+0000","last_clean":"2024-04-26T20:56:45.790688+0000","last_became_active":"2024-04-26T20:56:40.234817+0000","last_became_peered":"2024-04-26T20:56:40.234817+0000","last_unstale":"2024-04-26T20:56:45.790688+0000","last_undegraded":"2024-04-26T20:56:45.790688+0000","last_fullsized":"2024-04-26T20:56:45.790688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:41:03.691519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.787238+0000","last_change":"2024-04-26T20:56:39.224333+0000","last_active":"2024-04-26T20:56:45.787238+0000","last_peered":"2024-04-26T20:56:45.787238+0000","last_clean":"2024-04-26T20:56:45.787238+0000","last_became_active":"2024-04-26T20:56:39.220936+0000","last_became_peered":"2024-04-26T20:56:39.220936+0000","last_unstale":"2024-04-26T20:56:45.787238+0000","last_undegraded":"2024-04-26T20:56:45.787238+0000","last_fullsized":"2024-04-26T20:56:45.787238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:57:35.827912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788284+0000","last_change":"2024-04-26T20:56:44.257752+0000","last_active":"2024-04-26T20:56:45.788284+0000","last_peered":"2024-04-26T20:56:45.788284+0000","last_clean":"2024-04-26T20:56:45.788284+0000","last_became_active":"2024-04-26T20:56:44.257338+0000","last_became_peered":"2024-04-26T20:56:44.257338+0000","last_unstale":"2024-04-26T20:56:45.788284+0000","last_undegraded":"2024-04-26T20:56:45.788284+0000","last_fullsized":"2024-04-26T20:56:45.788284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:20:44.467468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.280289+0000","last_change":"2024-04-26T20:56:40.245228+0000","last_active":"2024-04-26T20:56:45.280289+0000","last_peered":"2024-04-26T20:56:45.280289+0000","last_clean":"2024-04-26T20:56:45.280289+0000","last_became_active":"2024-04-26T20:56:40.244846+0000","last_became_peered":"2024-04-26T20:56:40.244846+0000","last_unstale":"2024-04-26T20:56:45.280289+0000","last_undegraded":"2024-04-26T20:56:45.280289+0000","last_fullsized":"2024-04-26T20:56:45.280289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:41:13.644088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788644+0000","last_change":"2024-04-26T20:56:39.220939+0000","last_active":"2024-04-26T20:56:45.788644+0000","last_peered":"2024-04-26T20:56:45.788644+0000","last_clean":"2024-04-26T20:56:45.788644+0000","last_became_active":"2024-04-26T20:56:39.220267+0000","last_became_peered":"2024-04-26T20:56:39.220267+0000","last_unstale":"2024-04-26T20:56:45.788644+0000","last_undegraded":"2024-04-26T20:56:45.788644+0000","last_fullsized":"2024-04-26T20:56:45.788644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:14:14.002707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788475+0000","last_change":"2024-04-26T20:56:44.257761+0000","last_active":"2024-04-26T20:56:45.788475+0000","last_peered":"2024-04-26T20:56:45.788475+0000","last_clean":"2024-04-26T20:56:45.788475+0000","last_became_active":"2024-04-26T20:56:44.257291+0000","last_became_peered":"2024-04-26T20:56:44.257291+0000","last_unstale":"2024-04-26T20:56:45.788475+0000","last_undegraded":"2024-04-26T20:56:45.788475+0000","last_fullsized":"2024-04-26T20:56:45.788475+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:24:14.331856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278555+0000","last_change":"2024-04-26T20:56:40.224373+0000","last_active":"2024-04-26T20:56:45.278555+0000","last_peered":"2024-04-26T20:56:45.278555+0000","last_clean":"2024-04-26T20:56:45.278555+0000","last_became_active":"2024-04-26T20:56:40.224141+0000","last_became_peered":"2024-04-26T20:56:40.224141+0000","last_unstale":"2024-04-26T20:56:45.278555+0000","last_undegraded":"2024-04-26T20:56:45.278555+0000","last_fullsized":"2024-04-26T20:56:45.278555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:50:26.042106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786967+0000","last_change":"2024-04-26T20:56:39.225627+0000","last_active":"2024-04-26T20:56:45.786967+0000","last_peered":"2024-04-26T20:56:45.786967+0000","last_clean":"2024-04-26T20:56:45.786967+0000","last_became_active":"2024-04-26T20:56:39.224819+0000","last_became_peered":"2024-04-26T20:56:39.224819+0000","last_unstale":"2024-04-26T20:56:45.786967+0000","last_undegraded":"2024-04-26T20:56:45.786967+0000","last_fullsized":"2024-04-26T20:56:45.786967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:54.109701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.790603+0000","last_change":"2024-04-26T20:56:44.268007+0000","last_active":"2024-04-26T20:56:45.790603+0000","last_peered":"2024-04-26T20:56:45.790603+0000","last_clean":"2024-04-26T20:56:45.790603+0000","last_became_active":"2024-04-26T20:56:44.267593+0000","last_became_peered":"2024-04-26T20:56:44.267593+0000","last_unstale":"2024-04-26T20:56:45.790603+0000","last_undegraded":"2024-04-26T20:56:45.790603+0000","last_fullsized":"2024-04-26T20:56:45.790603+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:43:21.248440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788110+0000","last_change":"2024-04-26T20:56:40.232686+0000","last_active":"2024-04-26T20:56:45.788110+0000","last_peered":"2024-04-26T20:56:45.788110+0000","last_clean":"2024-04-26T20:56:45.788110+0000","last_became_active":"2024-04-26T20:56:40.232406+0000","last_became_peered":"2024-04-26T20:56:40.232406+0000","last_unstale":"2024-04-26T20:56:45.788110+0000","last_undegraded":"2024-04-26T20:56:45.788110+0000","last_fullsized":"2024-04-26T20:56:45.788110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:44:46.926225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.280640+0000","last_change":"2024-04-26T20:56:39.224479+0000","last_active":"2024-04-26T20:56:45.280640+0000","last_peered":"2024-04-26T20:56:45.280640+0000","last_clean":"2024-04-26T20:56:45.280640+0000","last_became_active":"2024-04-26T20:56:39.224106+0000","last_became_peered":"2024-04-26T20:56:39.224106+0000","last_unstale":"2024-04-26T20:56:45.280640+0000","last_undegraded":"2024-04-26T20:56:45.280640+0000","last_fullsized":"2024-04-26T20:56:45.280640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:31:59.475595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.790288+0000","last_change":"2024-04-26T20:56:44.264512+0000","last_active":"2024-04-26T20:56:45.790288+0000","last_peered":"2024-04-26T20:56:45.790288+0000","last_clean":"2024-04-26T20:56:45.790288+0000","last_became_active":"2024-04-26T20:56:44.264211+0000","last_became_peered":"2024-04-26T20:56:44.264211+0000","last_unstale":"2024-04-26T20:56:45.790288+0000","last_undegraded":"2024-04-26T20:56:45.790288+0000","last_fullsized":"2024-04-26T20:56:45.790288+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:33.745752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788142+0000","last_change":"2024-04-26T20:56:40.248343+0000","last_active":"2024-04-26T20:56:45.788142+0000","last_peered":"2024-04-26T20:56:45.788142+0000","last_clean":"2024-04-26T20:56:45.788142+0000","last_became_active":"2024-04-26T20:56:40.248044+0000","last_became_peered":"2024-04-26T20:56:40.248044+0000","last_unstale":"2024-04-26T20:56:45.788142+0000","last_undegraded":"2024-04-26T20:56:45.788142+0000","last_fullsized":"2024-04-26T20:56:45.788142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:14:12.321345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786512+0000","last_change":"2024-04-26T20:56:39.224746+0000","last_active":"2024-04-26T20:56:45.786512+0000","last_peered":"2024-04-26T20:56:45.786512+0000","last_clean":"2024-04-26T20:56:45.786512+0000","last_became_active":"2024-04-26T20:56:39.224396+0000","last_became_peered":"2024-04-26T20:56:39.224396+0000","last_unstale":"2024-04-26T20:56:45.786512+0000","last_undegraded":"2024-04-26T20:56:45.786512+0000","last_fullsized":"2024-04-26T20:56:45.786512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:33.595789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789520+0000","last_change":"2024-04-26T20:56:44.263211+0000","last_active":"2024-04-26T20:56:45.789520+0000","last_peered":"2024-04-26T20:56:45.789520+0000","last_clean":"2024-04-26T20:56:45.789520+0000","last_became_active":"2024-04-26T20:56:44.262730+0000","last_became_peered":"2024-04-26T20:56:44.262730+0000","last_unstale":"2024-04-26T20:56:45.789520+0000","last_undegraded":"2024-04-26T20:56:45.789520+0000","last_fullsized":"2024-04-26T20:56:45.789520+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:00.508968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789184+0000","last_change":"2024-04-26T20:56:40.231800+0000","last_active":"2024-04-26T20:56:45.789184+0000","last_peered":"2024-04-26T20:56:45.789184+0000","last_clean":"2024-04-26T20:56:45.789184+0000","last_became_active":"2024-04-26T20:56:40.231372+0000","last_became_peered":"2024-04-26T20:56:40.231372+0000","last_unstale":"2024-04-26T20:56:45.789184+0000","last_undegraded":"2024-04-26T20:56:45.789184+0000","last_fullsized":"2024-04-26T20:56:45.789184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:25:09.320511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786818+0000","last_change":"2024-04-26T20:56:39.219637+0000","last_active":"2024-04-26T20:56:45.786818+0000","last_peered":"2024-04-26T20:56:45.786818+0000","last_clean":"2024-04-26T20:56:45.786818+0000","last_became_active":"2024-04-26T20:56:39.219390+0000","last_became_peered":"2024-04-26T20:56:39.219390+0000","last_unstale":"2024-04-26T20:56:45.786818+0000","last_undegraded":"2024-04-26T20:56:45.786818+0000","last_fullsized":"2024-04-26T20:56:45.786818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:41:12.636349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":178,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.464868+0000","last_change":"2024-04-26T20:56:29.347462+0000","last_active":"2024-04-26T20:56:45.464868+0000","last_peered":"2024-04-26T20:56:45.464868+0000","last_clean":"2024-04-26T20:56:45.464868+0000","last_became_active":"2024-04-26T20:56:29.346224+0000","last_became_peered":"2024-04-26T20:56:29.346224+0000","last_unstale":"2024-04-26T20:56:45.464868+0000","last_undegraded":"2024-04-26T20:56:45.464868+0000","last_fullsized":"2024-04-26T20:56:45.464868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:28.079105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:28.079105+0000","last_clean_scrub_stamp":"2024-04-26T20:56:28.079105+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:13.693525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.787244+0000","last_change":"2024-04-26T20:56:44.256761+0000","last_active":"2024-04-26T20:56:45.787244+0000","last_peered":"2024-04-26T20:56:45.787244+0000","last_clean":"2024-04-26T20:56:45.787244+0000","last_became_active":"2024-04-26T20:56:44.256253+0000","last_became_peered":"2024-04-26T20:56:44.256253+0000","last_unstale":"2024-04-26T20:56:45.787244+0000","last_undegraded":"2024-04-26T20:56:45.787244+0000","last_fullsized":"2024-04-26T20:56:45.787244+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:34.373869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.787072+0000","last_change":"2024-04-26T20:56:40.245995+0000","last_active":"2024-04-26T20:56:45.787072+0000","last_peered":"2024-04-26T20:56:45.787072+0000","last_clean":"2024-04-26T20:56:45.787072+0000","last_became_active":"2024-04-26T20:56:40.245694+0000","last_became_peered":"2024-04-26T20:56:40.245694+0000","last_unstale":"2024-04-26T20:56:45.787072+0000","last_undegraded":"2024-04-26T20:56:45.787072+0000","last_fullsized":"2024-04-26T20:56:45.787072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:52.333752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.790781+0000","last_change":"2024-04-26T20:56:39.224388+0000","last_active":"2024-04-26T20:56:45.790781+0000","last_peered":"2024-04-26T20:56:45.790781+0000","last_clean":"2024-04-26T20:56:45.790781+0000","last_became_active":"2024-04-26T20:56:39.224125+0000","last_became_peered":"2024-04-26T20:56:39.224125+0000","last_unstale":"2024-04-26T20:56:45.790781+0000","last_undegraded":"2024-04-26T20:56:45.790781+0000","last_fullsized":"2024-04-26T20:56:45.790781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:40:48.839377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.279794+0000","last_change":"2024-04-26T20:56:44.266270+0000","last_active":"2024-04-26T20:56:45.279794+0000","last_peered":"2024-04-26T20:56:45.279794+0000","last_clean":"2024-04-26T20:56:45.279794+0000","last_became_active":"2024-04-26T20:56:44.265879+0000","last_became_peered":"2024-04-26T20:56:44.265879+0000","last_unstale":"2024-04-26T20:56:45.279794+0000","last_undegraded":"2024-04-26T20:56:45.279794+0000","last_fullsized":"2024-04-26T20:56:45.279794+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:28:42.894461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278895+0000","last_change":"2024-04-26T20:56:40.232540+0000","last_active":"2024-04-26T20:56:45.278895+0000","last_peered":"2024-04-26T20:56:45.278895+0000","last_clean":"2024-04-26T20:56:45.278895+0000","last_became_active":"2024-04-26T20:56:40.231008+0000","last_became_peered":"2024-04-26T20:56:40.231008+0000","last_unstale":"2024-04-26T20:56:45.278895+0000","last_undegraded":"2024-04-26T20:56:45.278895+0000","last_fullsized":"2024-04-26T20:56:45.278895+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:20:40.427686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789243+0000","last_change":"2024-04-26T20:56:39.222383+0000","last_active":"2024-04-26T20:56:45.789243+0000","last_peered":"2024-04-26T20:56:45.789243+0000","last_clean":"2024-04-26T20:56:45.789243+0000","last_became_active":"2024-04-26T20:56:39.222014+0000","last_became_peered":"2024-04-26T20:56:39.222014+0000","last_unstale":"2024-04-26T20:56:45.789243+0000","last_undegraded":"2024-04-26T20:56:45.789243+0000","last_fullsized":"2024-04-26T20:56:45.789243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:03:29.476982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788357+0000","last_change":"2024-04-26T20:56:44.264780+0000","last_active":"2024-04-26T20:56:45.788357+0000","last_peered":"2024-04-26T20:56:45.788357+0000","last_clean":"2024-04-26T20:56:45.788357+0000","last_became_active":"2024-04-26T20:56:44.260516+0000","last_became_peered":"2024-04-26T20:56:44.260516+0000","last_unstale":"2024-04-26T20:56:45.788357+0000","last_undegraded":"2024-04-26T20:56:45.788357+0000","last_fullsized":"2024-04-26T20:56:45.788357+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:56.373533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278843+0000","last_change":"2024-04-26T20:56:40.245302+0000","last_active":"2024-04-26T20:56:45.278843+0000","last_peered":"2024-04-26T20:56:45.278843+0000","last_clean":"2024-04-26T20:56:45.278843+0000","last_became_active":"2024-04-26T20:56:40.245020+0000","last_became_peered":"2024-04-26T20:56:40.245020+0000","last_unstale":"2024-04-26T20:56:45.278843+0000","last_undegraded":"2024-04-26T20:56:45.278843+0000","last_fullsized":"2024-04-26T20:56:45.278843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:32:50.377638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789962+0000","last_change":"2024-04-26T20:56:39.212876+0000","last_active":"2024-04-26T20:56:45.789962+0000","last_peered":"2024-04-26T20:56:45.789962+0000","last_clean":"2024-04-26T20:56:45.789962+0000","last_became_active":"2024-04-26T20:56:39.210505+0000","last_became_peered":"2024-04-26T20:56:39.210505+0000","last_unstale":"2024-04-26T20:56:45.789962+0000","last_undegraded":"2024-04-26T20:56:45.789962+0000","last_fullsized":"2024-04-26T20:56:45.789962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:29:37.126090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786321+0000","last_change":"2024-04-26T20:56:44.269758+0000","last_active":"2024-04-26T20:56:45.786321+0000","last_peered":"2024-04-26T20:56:45.786321+0000","last_clean":"2024-04-26T20:56:45.786321+0000","last_became_active":"2024-04-26T20:56:44.267320+0000","last_became_peered":"2024-04-26T20:56:44.267320+0000","last_unstale":"2024-04-26T20:56:45.786321+0000","last_undegraded":"2024-04-26T20:56:45.786321+0000","last_fullsized":"2024-04-26T20:56:45.786321+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:28.426749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.280509+0000","last_change":"2024-04-26T20:56:40.224152+0000","last_active":"2024-04-26T20:56:45.280509+0000","last_peered":"2024-04-26T20:56:45.280509+0000","last_clean":"2024-04-26T20:56:45.280509+0000","last_became_active":"2024-04-26T20:56:40.223000+0000","last_became_peered":"2024-04-26T20:56:40.223000+0000","last_unstale":"2024-04-26T20:56:45.280509+0000","last_undegraded":"2024-04-26T20:56:45.280509+0000","last_fullsized":"2024-04-26T20:56:45.280509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:46.709617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278951+0000","last_change":"2024-04-26T20:56:39.210612+0000","last_active":"2024-04-26T20:56:45.278951+0000","last_peered":"2024-04-26T20:56:45.278951+0000","last_clean":"2024-04-26T20:56:45.278951+0000","last_became_active":"2024-04-26T20:56:39.210308+0000","last_became_peered":"2024-04-26T20:56:39.210308+0000","last_unstale":"2024-04-26T20:56:45.278951+0000","last_undegraded":"2024-04-26T20:56:45.278951+0000","last_fullsized":"2024-04-26T20:56:45.278951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:10:57.721766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.465006+0000","last_change":"2024-04-26T20:56:44.255699+0000","last_active":"2024-04-26T20:56:45.465006+0000","last_peered":"2024-04-26T20:56:45.465006+0000","last_clean":"2024-04-26T20:56:45.465006+0000","last_became_active":"2024-04-26T20:56:44.255377+0000","last_became_peered":"2024-04-26T20:56:44.255377+0000","last_unstale":"2024-04-26T20:56:45.465006+0000","last_undegraded":"2024-04-26T20:56:45.465006+0000","last_fullsized":"2024-04-26T20:56:45.465006+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:35.050613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786401+0000","last_change":"2024-04-26T20:56:40.223324+0000","last_active":"2024-04-26T20:56:45.786401+0000","last_peered":"2024-04-26T20:56:45.786401+0000","last_clean":"2024-04-26T20:56:45.786401+0000","last_became_active":"2024-04-26T20:56:40.223003+0000","last_became_peered":"2024-04-26T20:56:40.223003+0000","last_unstale":"2024-04-26T20:56:45.786401+0000","last_undegraded":"2024-04-26T20:56:45.786401+0000","last_fullsized":"2024-04-26T20:56:45.786401+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:14:26.269699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789347+0000","last_change":"2024-04-26T20:56:39.217490+0000","last_active":"2024-04-26T20:56:45.789347+0000","last_peered":"2024-04-26T20:56:45.789347+0000","last_clean":"2024-04-26T20:56:45.789347+0000","last_became_active":"2024-04-26T20:56:39.217064+0000","last_became_peered":"2024-04-26T20:56:39.217064+0000","last_unstale":"2024-04-26T20:56:45.789347+0000","last_undegraded":"2024-04-26T20:56:45.789347+0000","last_fullsized":"2024-04-26T20:56:45.789347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:58:35.548325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789701+0000","last_change":"2024-04-26T20:56:44.262792+0000","last_active":"2024-04-26T20:56:45.789701+0000","last_peered":"2024-04-26T20:56:45.789701+0000","last_clean":"2024-04-26T20:56:45.789701+0000","last_became_active":"2024-04-26T20:56:44.260202+0000","last_became_peered":"2024-04-26T20:56:44.260202+0000","last_unstale":"2024-04-26T20:56:45.789701+0000","last_undegraded":"2024-04-26T20:56:45.789701+0000","last_fullsized":"2024-04-26T20:56:45.789701+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:54:15.702050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.464817+0000","last_change":"2024-04-26T20:56:40.259427+0000","last_active":"2024-04-26T20:56:45.464817+0000","last_peered":"2024-04-26T20:56:45.464817+0000","last_clean":"2024-04-26T20:56:45.464817+0000","last_became_active":"2024-04-26T20:56:40.258928+0000","last_became_peered":"2024-04-26T20:56:40.258928+0000","last_unstale":"2024-04-26T20:56:45.464817+0000","last_undegraded":"2024-04-26T20:56:45.464817+0000","last_fullsized":"2024-04-26T20:56:45.464817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:10:58.729505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278176+0000","last_change":"2024-04-26T20:56:39.223722+0000","last_active":"2024-04-26T20:56:45.278176+0000","last_peered":"2024-04-26T20:56:45.278176+0000","last_clean":"2024-04-26T20:56:45.278176+0000","last_became_active":"2024-04-26T20:56:39.223385+0000","last_became_peered":"2024-04-26T20:56:39.223385+0000","last_unstale":"2024-04-26T20:56:45.278176+0000","last_undegraded":"2024-04-26T20:56:45.278176+0000","last_fullsized":"2024-04-26T20:56:45.278176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:41:13.015392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789491+0000","last_change":"2024-04-26T20:56:44.259808+0000","last_active":"2024-04-26T20:56:45.789491+0000","last_peered":"2024-04-26T20:56:45.789491+0000","last_clean":"2024-04-26T20:56:45.789491+0000","last_became_active":"2024-04-26T20:56:44.259170+0000","last_became_peered":"2024-04-26T20:56:44.259170+0000","last_unstale":"2024-04-26T20:56:45.789491+0000","last_undegraded":"2024-04-26T20:56:45.789491+0000","last_fullsized":"2024-04-26T20:56:45.789491+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:18:11.962630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786651+0000","last_change":"2024-04-26T20:56:40.233004+0000","last_active":"2024-04-26T20:56:45.786651+0000","last_peered":"2024-04-26T20:56:45.786651+0000","last_clean":"2024-04-26T20:56:45.786651+0000","last_became_active":"2024-04-26T20:56:40.232735+0000","last_became_peered":"2024-04-26T20:56:40.232735+0000","last_unstale":"2024-04-26T20:56:45.786651+0000","last_undegraded":"2024-04-26T20:56:45.786651+0000","last_fullsized":"2024-04-26T20:56:45.786651+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:32:02.092294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786874+0000","last_change":"2024-04-26T20:56:39.224061+0000","last_active":"2024-04-26T20:56:45.786874+0000","last_peered":"2024-04-26T20:56:45.786874+0000","last_clean":"2024-04-26T20:56:45.786874+0000","last_became_active":"2024-04-26T20:56:39.223790+0000","last_became_peered":"2024-04-26T20:56:39.223790+0000","last_unstale":"2024-04-26T20:56:45.786874+0000","last_undegraded":"2024-04-26T20:56:45.786874+0000","last_fullsized":"2024-04-26T20:56:45.786874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:14:11.313606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.790509+0000","last_change":"2024-04-26T20:56:44.269183+0000","last_active":"2024-04-26T20:56:45.790509+0000","last_peered":"2024-04-26T20:56:45.790509+0000","last_clean":"2024-04-26T20:56:45.790509+0000","last_became_active":"2024-04-26T20:56:44.266986+0000","last_became_peered":"2024-04-26T20:56:44.266986+0000","last_unstale":"2024-04-26T20:56:45.790509+0000","last_undegraded":"2024-04-26T20:56:45.790509+0000","last_fullsized":"2024-04-26T20:56:45.790509+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:50:30.081888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788704+0000","last_change":"2024-04-26T20:56:40.245751+0000","last_active":"2024-04-26T20:56:45.788704+0000","last_peered":"2024-04-26T20:56:45.788704+0000","last_clean":"2024-04-26T20:56:45.788704+0000","last_became_active":"2024-04-26T20:56:40.245369+0000","last_became_peered":"2024-04-26T20:56:40.245369+0000","last_unstale":"2024-04-26T20:56:45.788704+0000","last_undegraded":"2024-04-26T20:56:45.788704+0000","last_fullsized":"2024-04-26T20:56:45.788704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:59.357459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.281500+0000","last_change":"2024-04-26T20:56:39.225785+0000","last_active":"2024-04-26T20:56:45.281500+0000","last_peered":"2024-04-26T20:56:45.281500+0000","last_clean":"2024-04-26T20:56:45.281500+0000","last_became_active":"2024-04-26T20:56:39.225542+0000","last_became_peered":"2024-04-26T20:56:39.225542+0000","last_unstale":"2024-04-26T20:56:45.281500+0000","last_undegraded":"2024-04-26T20:56:45.281500+0000","last_fullsized":"2024-04-26T20:56:45.281500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:03:29.476982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.787074+0000","last_change":"2024-04-26T20:56:44.253303+0000","last_active":"2024-04-26T20:56:45.787074+0000","last_peered":"2024-04-26T20:56:45.787074+0000","last_clean":"2024-04-26T20:56:45.787074+0000","last_became_active":"2024-04-26T20:56:44.252962+0000","last_became_peered":"2024-04-26T20:56:44.252962+0000","last_unstale":"2024-04-26T20:56:45.787074+0000","last_undegraded":"2024-04-26T20:56:45.787074+0000","last_fullsized":"2024-04-26T20:56:45.787074+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:51:16.305273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278531+0000","last_change":"2024-04-26T20:56:40.242121+0000","last_active":"2024-04-26T20:56:45.278531+0000","last_peered":"2024-04-26T20:56:45.278531+0000","last_clean":"2024-04-26T20:56:45.278531+0000","last_became_active":"2024-04-26T20:56:40.241861+0000","last_became_peered":"2024-04-26T20:56:40.241861+0000","last_unstale":"2024-04-26T20:56:45.278531+0000","last_undegraded":"2024-04-26T20:56:45.278531+0000","last_fullsized":"2024-04-26T20:56:45.278531+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:11:49.558212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'10","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:55.394552+0000","last_change":"2024-04-26T20:56:39.215684+0000","last_active":"2024-04-26T20:56:55.394552+0000","last_peered":"2024-04-26T20:56:55.394552+0000","last_clean":"2024-04-26T20:56:55.394552+0000","last_became_active":"2024-04-26T20:56:39.215414+0000","last_became_peered":"2024-04-26T20:56:39.215414+0000","last_unstale":"2024-04-26T20:56:55.394552+0000","last_undegraded":"2024-04-26T20:56:55.394552+0000","last_fullsized":"2024-04-26T20:56:55.394552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:19:34.743821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789857+0000","last_change":"2024-04-26T20:56:44.268455+0000","last_active":"2024-04-26T20:56:45.789857+0000","last_peered":"2024-04-26T20:56:45.789857+0000","last_clean":"2024-04-26T20:56:45.789857+0000","last_became_active":"2024-04-26T20:56:44.267050+0000","last_became_peered":"2024-04-26T20:56:44.267050+0000","last_unstale":"2024-04-26T20:56:45.789857+0000","last_undegraded":"2024-04-26T20:56:45.789857+0000","last_fullsized":"2024-04-26T20:56:45.789857+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:53:37.753988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786653+0000","last_change":"2024-04-26T20:56:40.234863+0000","last_active":"2024-04-26T20:56:45.786653+0000","last_peered":"2024-04-26T20:56:45.786653+0000","last_clean":"2024-04-26T20:56:45.786653+0000","last_became_active":"2024-04-26T20:56:40.233643+0000","last_became_peered":"2024-04-26T20:56:40.233643+0000","last_unstale":"2024-04-26T20:56:45.786653+0000","last_undegraded":"2024-04-26T20:56:45.786653+0000","last_fullsized":"2024-04-26T20:56:45.786653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:33:12.507172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.281206+0000","last_change":"2024-04-26T20:56:39.226868+0000","last_active":"2024-04-26T20:56:45.281206+0000","last_peered":"2024-04-26T20:56:45.281206+0000","last_clean":"2024-04-26T20:56:45.281206+0000","last_became_active":"2024-04-26T20:56:39.224374+0000","last_became_peered":"2024-04-26T20:56:39.224374+0000","last_unstale":"2024-04-26T20:56:45.281206+0000","last_undegraded":"2024-04-26T20:56:45.281206+0000","last_fullsized":"2024-04-26T20:56:45.281206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:14:14.002707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.280149+0000","last_change":"2024-04-26T20:56:44.267204+0000","last_active":"2024-04-26T20:56:45.280149+0000","last_peered":"2024-04-26T20:56:45.280149+0000","last_clean":"2024-04-26T20:56:45.280149+0000","last_became_active":"2024-04-26T20:56:44.265067+0000","last_became_peered":"2024-04-26T20:56:44.265067+0000","last_unstale":"2024-04-26T20:56:45.280149+0000","last_undegraded":"2024-04-26T20:56:45.280149+0000","last_fullsized":"2024-04-26T20:56:45.280149+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:33.745752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789404+0000","last_change":"2024-04-26T20:56:40.250180+0000","last_active":"2024-04-26T20:56:45.789404+0000","last_peered":"2024-04-26T20:56:45.789404+0000","last_clean":"2024-04-26T20:56:45.789404+0000","last_became_active":"2024-04-26T20:56:40.241673+0000","last_became_peered":"2024-04-26T20:56:40.241673+0000","last_unstale":"2024-04-26T20:56:45.789404+0000","last_undegraded":"2024-04-26T20:56:45.789404+0000","last_fullsized":"2024-04-26T20:56:45.789404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:43:17.208658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278532+0000","last_change":"2024-04-26T20:56:39.212686+0000","last_active":"2024-04-26T20:56:45.278532+0000","last_peered":"2024-04-26T20:56:45.278532+0000","last_clean":"2024-04-26T20:56:45.278532+0000","last_became_active":"2024-04-26T20:56:39.211596+0000","last_became_peered":"2024-04-26T20:56:39.211596+0000","last_unstale":"2024-04-26T20:56:45.278532+0000","last_undegraded":"2024-04-26T20:56:45.278532+0000","last_fullsized":"2024-04-26T20:56:45.278532+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:40:48.839377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.280382+0000","last_change":"2024-04-26T20:56:44.271569+0000","last_active":"2024-04-26T20:56:45.280382+0000","last_peered":"2024-04-26T20:56:45.280382+0000","last_clean":"2024-04-26T20:56:45.280382+0000","last_became_active":"2024-04-26T20:56:44.271199+0000","last_became_peered":"2024-04-26T20:56:44.271199+0000","last_unstale":"2024-04-26T20:56:45.280382+0000","last_undegraded":"2024-04-26T20:56:45.280382+0000","last_fullsized":"2024-04-26T20:56:45.280382+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:03.397241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.280443+0000","last_change":"2024-04-26T20:56:40.218097+0000","last_active":"2024-04-26T20:56:45.280443+0000","last_peered":"2024-04-26T20:56:45.280443+0000","last_clean":"2024-04-26T20:56:45.280443+0000","last_became_active":"2024-04-26T20:56:40.217279+0000","last_became_peered":"2024-04-26T20:56:40.217279+0000","last_unstale":"2024-04-26T20:56:45.280443+0000","last_undegraded":"2024-04-26T20:56:45.280443+0000","last_fullsized":"2024-04-26T20:56:45.280443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:31.742963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.465604+0000","last_change":"2024-04-26T20:56:39.206681+0000","last_active":"2024-04-26T20:56:45.465604+0000","last_peered":"2024-04-26T20:56:45.465604+0000","last_clean":"2024-04-26T20:56:45.465604+0000","last_became_active":"2024-04-26T20:56:39.206387+0000","last_became_peered":"2024-04-26T20:56:39.206387+0000","last_unstale":"2024-04-26T20:56:45.465604+0000","last_undegraded":"2024-04-26T20:56:45.465604+0000","last_fullsized":"2024-04-26T20:56:45.465604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:41:13.015392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788775+0000","last_change":"2024-04-26T20:56:44.272225+0000","last_active":"2024-04-26T20:56:45.788775+0000","last_peered":"2024-04-26T20:56:45.788775+0000","last_clean":"2024-04-26T20:56:45.788775+0000","last_became_active":"2024-04-26T20:56:44.268540+0000","last_became_peered":"2024-04-26T20:56:44.268540+0000","last_unstale":"2024-04-26T20:56:45.788775+0000","last_undegraded":"2024-04-26T20:56:45.788775+0000","last_fullsized":"2024-04-26T20:56:45.788775+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:20:27.945065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789725+0000","last_change":"2024-04-26T20:56:44.270140+0000","last_active":"2024-04-26T20:56:45.789725+0000","last_peered":"2024-04-26T20:56:45.789725+0000","last_clean":"2024-04-26T20:56:45.789725+0000","last_became_active":"2024-04-26T20:56:44.269804+0000","last_became_peered":"2024-04-26T20:56:44.269804+0000","last_unstale":"2024-04-26T20:56:45.789725+0000","last_undegraded":"2024-04-26T20:56:45.789725+0000","last_fullsized":"2024-04-26T20:56:45.789725+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:56:25.438566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788888+0000","last_change":"2024-04-26T20:56:40.242067+0000","last_active":"2024-04-26T20:56:45.788888+0000","last_peered":"2024-04-26T20:56:45.788888+0000","last_clean":"2024-04-26T20:56:45.788888+0000","last_became_active":"2024-04-26T20:56:40.241730+0000","last_became_peered":"2024-04-26T20:56:40.241730+0000","last_unstale":"2024-04-26T20:56:45.788888+0000","last_undegraded":"2024-04-26T20:56:45.788888+0000","last_fullsized":"2024-04-26T20:56:45.788888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:30:32.775766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786403+0000","last_change":"2024-04-26T20:56:39.224756+0000","last_active":"2024-04-26T20:56:45.786403+0000","last_peered":"2024-04-26T20:56:45.786403+0000","last_clean":"2024-04-26T20:56:45.786403+0000","last_became_active":"2024-04-26T20:56:39.224355+0000","last_became_peered":"2024-04-26T20:56:39.224355+0000","last_unstale":"2024-04-26T20:56:45.786403+0000","last_undegraded":"2024-04-26T20:56:45.786403+0000","last_fullsized":"2024-04-26T20:56:45.786403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:10:57.721766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.787013+0000","last_change":"2024-04-26T20:56:44.259652+0000","last_active":"2024-04-26T20:56:45.787013+0000","last_peered":"2024-04-26T20:56:45.787013+0000","last_clean":"2024-04-26T20:56:45.787013+0000","last_became_active":"2024-04-26T20:56:44.259253+0000","last_became_peered":"2024-04-26T20:56:44.259253+0000","last_unstale":"2024-04-26T20:56:45.787013+0000","last_undegraded":"2024-04-26T20:56:45.787013+0000","last_fullsized":"2024-04-26T20:56:45.787013+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:34:23.113242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788223+0000","last_change":"2024-04-26T20:56:40.252069+0000","last_active":"2024-04-26T20:56:45.788223+0000","last_peered":"2024-04-26T20:56:45.788223+0000","last_clean":"2024-04-26T20:56:45.788223+0000","last_became_active":"2024-04-26T20:56:40.251800+0000","last_became_peered":"2024-04-26T20:56:40.251800+0000","last_unstale":"2024-04-26T20:56:45.788223+0000","last_undegraded":"2024-04-26T20:56:45.788223+0000","last_fullsized":"2024-04-26T20:56:45.788223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:50:26.042106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789011+0000","last_change":"2024-04-26T20:56:39.222979+0000","last_active":"2024-04-26T20:56:45.789011+0000","last_peered":"2024-04-26T20:56:45.789011+0000","last_clean":"2024-04-26T20:56:45.789011+0000","last_became_active":"2024-04-26T20:56:39.222514+0000","last_became_peered":"2024-04-26T20:56:39.222514+0000","last_unstale":"2024-04-26T20:56:45.789011+0000","last_undegraded":"2024-04-26T20:56:45.789011+0000","last_fullsized":"2024-04-26T20:56:45.789011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:03:29.476982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786759+0000","last_change":"2024-04-26T20:56:39.229726+0000","last_active":"2024-04-26T20:56:45.786759+0000","last_peered":"2024-04-26T20:56:45.786759+0000","last_clean":"2024-04-26T20:56:45.786759+0000","last_became_active":"2024-04-26T20:56:39.228823+0000","last_became_peered":"2024-04-26T20:56:39.228823+0000","last_unstale":"2024-04-26T20:56:45.786759+0000","last_undegraded":"2024-04-26T20:56:45.786759+0000","last_fullsized":"2024-04-26T20:56:45.786759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:45.701878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788829+0000","last_change":"2024-04-26T20:56:40.237552+0000","last_active":"2024-04-26T20:56:45.788829+0000","last_peered":"2024-04-26T20:56:45.788829+0000","last_clean":"2024-04-26T20:56:45.788829+0000","last_became_active":"2024-04-26T20:56:40.234148+0000","last_became_peered":"2024-04-26T20:56:40.234148+0000","last_unstale":"2024-04-26T20:56:45.788829+0000","last_undegraded":"2024-04-26T20:56:45.788829+0000","last_fullsized":"2024-04-26T20:56:45.788829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:05:09.050038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789111+0000","last_change":"2024-04-26T20:56:44.268137+0000","last_active":"2024-04-26T20:56:45.789111+0000","last_peered":"2024-04-26T20:56:45.789111+0000","last_clean":"2024-04-26T20:56:45.789111+0000","last_became_active":"2024-04-26T20:56:44.267618+0000","last_became_peered":"2024-04-26T20:56:44.267618+0000","last_unstale":"2024-04-26T20:56:45.789111+0000","last_undegraded":"2024-04-26T20:56:45.789111+0000","last_fullsized":"2024-04-26T20:56:45.789111+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:47:30.881003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788498+0000","last_change":"2024-04-26T20:56:39.219724+0000","last_active":"2024-04-26T20:56:45.788498+0000","last_peered":"2024-04-26T20:56:45.788498+0000","last_clean":"2024-04-26T20:56:45.788498+0000","last_became_active":"2024-04-26T20:56:39.219485+0000","last_became_peered":"2024-04-26T20:56:39.219485+0000","last_unstale":"2024-04-26T20:56:45.788498+0000","last_undegraded":"2024-04-26T20:56:45.788498+0000","last_fullsized":"2024-04-26T20:56:45.788498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:11:12.183144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.465256+0000","last_change":"2024-04-26T20:56:40.242585+0000","last_active":"2024-04-26T20:56:45.465256+0000","last_peered":"2024-04-26T20:56:45.465256+0000","last_clean":"2024-04-26T20:56:45.465256+0000","last_became_active":"2024-04-26T20:56:40.242312+0000","last_became_peered":"2024-04-26T20:56:40.242312+0000","last_unstale":"2024-04-26T20:56:45.465256+0000","last_undegraded":"2024-04-26T20:56:45.465256+0000","last_fullsized":"2024-04-26T20:56:45.465256+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:58.516368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.281033+0000","last_change":"2024-04-26T20:56:44.278669+0000","last_active":"2024-04-26T20:56:45.281033+0000","last_peered":"2024-04-26T20:56:45.281033+0000","last_clean":"2024-04-26T20:56:45.281033+0000","last_became_active":"2024-04-26T20:56:44.278144+0000","last_became_peered":"2024-04-26T20:56:44.278144+0000","last_unstale":"2024-04-26T20:56:45.281033+0000","last_undegraded":"2024-04-26T20:56:45.281033+0000","last_fullsized":"2024-04-26T20:56:45.281033+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:35.050613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.279742+0000","last_change":"2024-04-26T20:56:40.239350+0000","last_active":"2024-04-26T20:56:45.279742+0000","last_peered":"2024-04-26T20:56:45.279742+0000","last_clean":"2024-04-26T20:56:45.279742+0000","last_became_active":"2024-04-26T20:56:40.238857+0000","last_became_peered":"2024-04-26T20:56:40.238857+0000","last_unstale":"2024-04-26T20:56:45.279742+0000","last_undegraded":"2024-04-26T20:56:45.279742+0000","last_fullsized":"2024-04-26T20:56:45.279742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:34.603528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.280519+0000","last_change":"2024-04-26T20:56:40.250462+0000","last_active":"2024-04-26T20:56:45.280519+0000","last_peered":"2024-04-26T20:56:45.280519+0000","last_clean":"2024-04-26T20:56:45.280519+0000","last_became_active":"2024-04-26T20:56:40.250111+0000","last_became_peered":"2024-04-26T20:56:40.250111+0000","last_unstale":"2024-04-26T20:56:45.280519+0000","last_undegraded":"2024-04-26T20:56:45.280519+0000","last_fullsized":"2024-04-26T20:56:45.280519+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:34.603528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786771+0000","last_change":"2024-04-26T20:56:40.243150+0000","last_active":"2024-04-26T20:56:45.786771+0000","last_peered":"2024-04-26T20:56:45.786771+0000","last_clean":"2024-04-26T20:56:45.786771+0000","last_became_active":"2024-04-26T20:56:40.242878+0000","last_became_peered":"2024-04-26T20:56:40.242878+0000","last_unstale":"2024-04-26T20:56:45.786771+0000","last_undegraded":"2024-04-26T20:56:45.786771+0000","last_fullsized":"2024-04-26T20:56:45.786771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:38.504120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788406+0000","last_change":"2024-04-26T20:56:40.246148+0000","last_active":"2024-04-26T20:56:45.788406+0000","last_peered":"2024-04-26T20:56:45.788406+0000","last_clean":"2024-04-26T20:56:45.788406+0000","last_became_active":"2024-04-26T20:56:40.241050+0000","last_became_peered":"2024-04-26T20:56:40.241050+0000","last_unstale":"2024-04-26T20:56:45.788406+0000","last_undegraded":"2024-04-26T20:56:45.788406+0000","last_fullsized":"2024-04-26T20:56:45.788406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:41:04.236810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.790634+0000","last_change":"2024-04-26T20:56:40.240515+0000","last_active":"2024-04-26T20:56:45.790634+0000","last_peered":"2024-04-26T20:56:45.790634+0000","last_clean":"2024-04-26T20:56:45.790634+0000","last_became_active":"2024-04-26T20:56:40.240214+0000","last_became_peered":"2024-04-26T20:56:40.240214+0000","last_unstale":"2024-04-26T20:56:45.790634+0000","last_undegraded":"2024-04-26T20:56:45.790634+0000","last_fullsized":"2024-04-26T20:56:45.790634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:07:27.066355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.790023+0000","last_change":"2024-04-26T20:56:40.237603+0000","last_active":"2024-04-26T20:56:45.790023+0000","last_peered":"2024-04-26T20:56:45.790023+0000","last_clean":"2024-04-26T20:56:45.790023+0000","last_became_active":"2024-04-26T20:56:40.237312+0000","last_became_peered":"2024-04-26T20:56:40.237312+0000","last_unstale":"2024-04-26T20:56:45.790023+0000","last_undegraded":"2024-04-26T20:56:45.790023+0000","last_fullsized":"2024-04-26T20:56:45.790023+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:31.010832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.280394+0000","last_change":"2024-04-26T20:56:40.224409+0000","last_active":"2024-04-26T20:56:45.280394+0000","last_peered":"2024-04-26T20:56:45.280394+0000","last_clean":"2024-04-26T20:56:45.280394+0000","last_became_active":"2024-04-26T20:56:40.223783+0000","last_became_peered":"2024-04-26T20:56:40.223783+0000","last_unstale":"2024-04-26T20:56:45.280394+0000","last_undegraded":"2024-04-26T20:56:45.280394+0000","last_fullsized":"2024-04-26T20:56:45.280394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:57:36.835651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789132+0000","last_change":"2024-04-26T20:56:40.247698+0000","last_active":"2024-04-26T20:56:45.789132+0000","last_peered":"2024-04-26T20:56:45.789132+0000","last_clean":"2024-04-26T20:56:45.789132+0000","last_became_active":"2024-04-26T20:56:40.247096+0000","last_became_peered":"2024-04-26T20:56:40.247096+0000","last_unstale":"2024-04-26T20:56:45.789132+0000","last_undegraded":"2024-04-26T20:56:45.789132+0000","last_fullsized":"2024-04-26T20:56:45.789132+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:20:40.427686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786399+0000","last_change":"2024-04-26T20:56:40.258240+0000","last_active":"2024-04-26T20:56:45.786399+0000","last_peered":"2024-04-26T20:56:45.786399+0000","last_clean":"2024-04-26T20:56:45.786399+0000","last_became_active":"2024-04-26T20:56:40.257922+0000","last_became_peered":"2024-04-26T20:56:40.257922+0000","last_unstale":"2024-04-26T20:56:45.786399+0000","last_undegraded":"2024-04-26T20:56:45.786399+0000","last_fullsized":"2024-04-26T20:56:45.786399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:43:17.208658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788602+0000","last_change":"2024-04-26T20:56:40.234841+0000","last_active":"2024-04-26T20:56:45.788602+0000","last_peered":"2024-04-26T20:56:45.788602+0000","last_clean":"2024-04-26T20:56:45.788602+0000","last_became_active":"2024-04-26T20:56:40.234455+0000","last_became_peered":"2024-04-26T20:56:40.234455+0000","last_unstale":"2024-04-26T20:56:45.788602+0000","last_undegraded":"2024-04-26T20:56:45.788602+0000","last_fullsized":"2024-04-26T20:56:45.788602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:03:10.550412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.465190+0000","last_change":"2024-04-26T20:56:40.236302+0000","last_active":"2024-04-26T20:56:45.465190+0000","last_peered":"2024-04-26T20:56:45.465190+0000","last_clean":"2024-04-26T20:56:45.465190+0000","last_became_active":"2024-04-26T20:56:40.236036+0000","last_became_peered":"2024-04-26T20:56:40.236036+0000","last_unstale":"2024-04-26T20:56:45.465190+0000","last_undegraded":"2024-04-26T20:56:45.465190+0000","last_fullsized":"2024-04-26T20:56:45.465190+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:41:13.644088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789474+0000","last_change":"2024-04-26T20:56:40.234738+0000","last_active":"2024-04-26T20:56:45.789474+0000","last_peered":"2024-04-26T20:56:45.789474+0000","last_clean":"2024-04-26T20:56:45.789474+0000","last_became_active":"2024-04-26T20:56:40.231985+0000","last_became_peered":"2024-04-26T20:56:40.231985+0000","last_unstale":"2024-04-26T20:56:45.789474+0000","last_undegraded":"2024-04-26T20:56:45.789474+0000","last_fullsized":"2024-04-26T20:56:45.789474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:57:53.450954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278740+0000","last_change":"2024-04-26T20:56:40.249286+0000","last_active":"2024-04-26T20:56:45.278740+0000","last_peered":"2024-04-26T20:56:45.278740+0000","last_clean":"2024-04-26T20:56:45.278740+0000","last_became_active":"2024-04-26T20:56:40.249012+0000","last_became_peered":"2024-04-26T20:56:40.249012+0000","last_unstale":"2024-04-26T20:56:45.278740+0000","last_undegraded":"2024-04-26T20:56:45.278740+0000","last_fullsized":"2024-04-26T20:56:45.278740+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:43:17.208658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.787152+0000","last_change":"2024-04-26T20:56:40.228646+0000","last_active":"2024-04-26T20:56:45.787152+0000","last_peered":"2024-04-26T20:56:45.787152+0000","last_clean":"2024-04-26T20:56:45.787152+0000","last_became_active":"2024-04-26T20:56:40.228368+0000","last_became_peered":"2024-04-26T20:56:40.228368+0000","last_unstale":"2024-04-26T20:56:45.787152+0000","last_undegraded":"2024-04-26T20:56:45.787152+0000","last_fullsized":"2024-04-26T20:56:45.787152+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:18:07.922849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.281190+0000","last_change":"2024-04-26T20:56:40.225730+0000","last_active":"2024-04-26T20:56:45.281190+0000","last_peered":"2024-04-26T20:56:45.281190+0000","last_clean":"2024-04-26T20:56:45.281190+0000","last_became_active":"2024-04-26T20:56:40.225431+0000","last_became_peered":"2024-04-26T20:56:40.225431+0000","last_unstale":"2024-04-26T20:56:45.281190+0000","last_undegraded":"2024-04-26T20:56:45.281190+0000","last_fullsized":"2024-04-26T20:56:45.281190+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:58.516368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.787104+0000","last_change":"2024-04-26T20:56:40.232831+0000","last_active":"2024-04-26T20:56:45.787104+0000","last_peered":"2024-04-26T20:56:45.787104+0000","last_clean":"2024-04-26T20:56:45.787104+0000","last_became_active":"2024-04-26T20:56:40.229977+0000","last_became_peered":"2024-04-26T20:56:40.229977+0000","last_unstale":"2024-04-26T20:56:45.787104+0000","last_undegraded":"2024-04-26T20:56:45.787104+0000","last_fullsized":"2024-04-26T20:56:45.787104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:56.469187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786286+0000","last_change":"2024-04-26T20:56:40.222579+0000","last_active":"2024-04-26T20:56:45.786286+0000","last_peered":"2024-04-26T20:56:45.786286+0000","last_clean":"2024-04-26T20:56:45.786286+0000","last_became_active":"2024-04-26T20:56:40.222116+0000","last_became_peered":"2024-04-26T20:56:40.222116+0000","last_unstale":"2024-04-26T20:56:45.786286+0000","last_undegraded":"2024-04-26T20:56:45.786286+0000","last_fullsized":"2024-04-26T20:56:45.786286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:50:26.042106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788401+0000","last_change":"2024-04-26T20:56:40.245721+0000","last_active":"2024-04-26T20:56:45.788401+0000","last_peered":"2024-04-26T20:56:45.788401+0000","last_clean":"2024-04-26T20:56:45.788401+0000","last_became_active":"2024-04-26T20:56:40.240783+0000","last_became_peered":"2024-04-26T20:56:40.240783+0000","last_unstale":"2024-04-26T20:56:45.788401+0000","last_undegraded":"2024-04-26T20:56:45.788401+0000","last_fullsized":"2024-04-26T20:56:45.788401+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:07:27.066355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788602+0000","last_change":"2024-04-26T20:56:40.239382+0000","last_active":"2024-04-26T20:56:45.788602+0000","last_peered":"2024-04-26T20:56:45.788602+0000","last_clean":"2024-04-26T20:56:45.788602+0000","last_became_active":"2024-04-26T20:56:40.239118+0000","last_became_peered":"2024-04-26T20:56:40.239118+0000","last_unstale":"2024-04-26T20:56:45.788602+0000","last_undegraded":"2024-04-26T20:56:45.788602+0000","last_fullsized":"2024-04-26T20:56:45.788602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:46.709617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788816+0000","last_change":"2024-04-26T20:56:40.236079+0000","last_active":"2024-04-26T20:56:45.788816+0000","last_peered":"2024-04-26T20:56:45.788816+0000","last_clean":"2024-04-26T20:56:45.788816+0000","last_became_active":"2024-04-26T20:56:40.235815+0000","last_became_peered":"2024-04-26T20:56:40.235815+0000","last_unstale":"2024-04-26T20:56:45.788816+0000","last_undegraded":"2024-04-26T20:56:45.788816+0000","last_fullsized":"2024-04-26T20:56:45.788816+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:55.117440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278710+0000","last_change":"2024-04-26T20:56:40.249327+0000","last_active":"2024-04-26T20:56:45.278710+0000","last_peered":"2024-04-26T20:56:45.278710+0000","last_clean":"2024-04-26T20:56:45.278710+0000","last_became_active":"2024-04-26T20:56:40.249079+0000","last_became_peered":"2024-04-26T20:56:40.249079+0000","last_unstale":"2024-04-26T20:56:45.278710+0000","last_undegraded":"2024-04-26T20:56:45.278710+0000","last_fullsized":"2024-04-26T20:56:45.278710+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:41:04.236810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278396+0000","last_change":"2024-04-26T20:56:40.233773+0000","last_active":"2024-04-26T20:56:45.278396+0000","last_peered":"2024-04-26T20:56:45.278396+0000","last_clean":"2024-04-26T20:56:45.278396+0000","last_became_active":"2024-04-26T20:56:40.233225+0000","last_became_peered":"2024-04-26T20:56:40.233225+0000","last_unstale":"2024-04-26T20:56:45.278396+0000","last_undegraded":"2024-04-26T20:56:45.278396+0000","last_fullsized":"2024-04-26T20:56:45.278396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:28:38.854680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278624+0000","last_change":"2024-04-26T20:56:40.227906+0000","last_active":"2024-04-26T20:56:45.278624+0000","last_peered":"2024-04-26T20:56:45.278624+0000","last_clean":"2024-04-26T20:56:45.278624+0000","last_became_active":"2024-04-26T20:56:40.227613+0000","last_became_peered":"2024-04-26T20:56:40.227613+0000","last_unstale":"2024-04-26T20:56:45.278624+0000","last_undegraded":"2024-04-26T20:56:45.278624+0000","last_fullsized":"2024-04-26T20:56:45.278624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:14:26.269699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.465600+0000","last_change":"2024-04-26T20:56:40.236919+0000","last_active":"2024-04-26T20:56:45.465600+0000","last_peered":"2024-04-26T20:56:45.465600+0000","last_clean":"2024-04-26T20:56:45.465600+0000","last_became_active":"2024-04-26T20:56:40.236544+0000","last_became_peered":"2024-04-26T20:56:40.236544+0000","last_unstale":"2024-04-26T20:56:45.465600+0000","last_undegraded":"2024-04-26T20:56:45.465600+0000","last_fullsized":"2024-04-26T20:56:45.465600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:57:36.835651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.787998+0000","last_change":"2024-04-26T20:56:40.251770+0000","last_active":"2024-04-26T20:56:45.787998+0000","last_peered":"2024-04-26T20:56:45.787998+0000","last_clean":"2024-04-26T20:56:45.787998+0000","last_became_active":"2024-04-26T20:56:40.251426+0000","last_became_peered":"2024-04-26T20:56:40.251426+0000","last_unstale":"2024-04-26T20:56:45.787998+0000","last_undegraded":"2024-04-26T20:56:45.787998+0000","last_fullsized":"2024-04-26T20:56:45.787998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:41:03.691519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278135+0000","last_change":"2024-04-26T20:56:40.227391+0000","last_active":"2024-04-26T20:56:45.278135+0000","last_peered":"2024-04-26T20:56:45.278135+0000","last_clean":"2024-04-26T20:56:45.278135+0000","last_became_active":"2024-04-26T20:56:40.226681+0000","last_became_peered":"2024-04-26T20:56:40.226681+0000","last_unstale":"2024-04-26T20:56:45.278135+0000","last_undegraded":"2024-04-26T20:56:45.278135+0000","last_fullsized":"2024-04-26T20:56:45.278135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:44:46.926225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.279941+0000","last_change":"2024-04-26T20:56:40.225067+0000","last_active":"2024-04-26T20:56:45.279941+0000","last_peered":"2024-04-26T20:56:45.279941+0000","last_clean":"2024-04-26T20:56:45.279941+0000","last_became_active":"2024-04-26T20:56:40.224764+0000","last_became_peered":"2024-04-26T20:56:40.224764+0000","last_unstale":"2024-04-26T20:56:45.279941+0000","last_undegraded":"2024-04-26T20:56:45.279941+0000","last_fullsized":"2024-04-26T20:56:45.279941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:10:58.729505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278406+0000","last_change":"2024-04-26T20:56:40.253423+0000","last_active":"2024-04-26T20:56:45.278406+0000","last_peered":"2024-04-26T20:56:45.278406+0000","last_clean":"2024-04-26T20:56:45.278406+0000","last_became_active":"2024-04-26T20:56:40.253195+0000","last_became_peered":"2024-04-26T20:56:40.253195+0000","last_unstale":"2024-04-26T20:56:45.278406+0000","last_undegraded":"2024-04-26T20:56:45.278406+0000","last_fullsized":"2024-04-26T20:56:45.278406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:24:10.292075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.280200+0000","last_change":"2024-04-26T20:56:40.225398+0000","last_active":"2024-04-26T20:56:45.280200+0000","last_peered":"2024-04-26T20:56:45.280200+0000","last_clean":"2024-04-26T20:56:45.280200+0000","last_became_active":"2024-04-26T20:56:40.225061+0000","last_became_peered":"2024-04-26T20:56:40.225061+0000","last_unstale":"2024-04-26T20:56:45.280200+0000","last_undegraded":"2024-04-26T20:56:45.280200+0000","last_fullsized":"2024-04-26T20:56:45.280200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:58.516368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789064+0000","last_change":"2024-04-26T20:56:40.248772+0000","last_active":"2024-04-26T20:56:45.789064+0000","last_peered":"2024-04-26T20:56:45.789064+0000","last_clean":"2024-04-26T20:56:45.789064+0000","last_became_active":"2024-04-26T20:56:40.240740+0000","last_became_peered":"2024-04-26T20:56:40.240740+0000","last_unstale":"2024-04-26T20:56:45.789064+0000","last_undegraded":"2024-04-26T20:56:45.789064+0000","last_fullsized":"2024-04-26T20:56:45.789064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:28:38.854680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789550+0000","last_change":"2024-04-26T20:56:40.251885+0000","last_active":"2024-04-26T20:56:45.789550+0000","last_peered":"2024-04-26T20:56:45.789550+0000","last_clean":"2024-04-26T20:56:45.789550+0000","last_became_active":"2024-04-26T20:56:40.251578+0000","last_became_peered":"2024-04-26T20:56:40.251578+0000","last_unstale":"2024-04-26T20:56:45.789550+0000","last_undegraded":"2024-04-26T20:56:45.789550+0000","last_fullsized":"2024-04-26T20:56:45.789550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:24:10.292075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278816+0000","last_change":"2024-04-26T20:56:40.235504+0000","last_active":"2024-04-26T20:56:45.278816+0000","last_peered":"2024-04-26T20:56:45.278816+0000","last_clean":"2024-04-26T20:56:45.278816+0000","last_became_active":"2024-04-26T20:56:40.234572+0000","last_became_peered":"2024-04-26T20:56:40.234572+0000","last_unstale":"2024-04-26T20:56:45.278816+0000","last_undegraded":"2024-04-26T20:56:45.278816+0000","last_fullsized":"2024-04-26T20:56:45.278816+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:29.705970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":110689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":110565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":884736,"data_stored":701025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":111147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509450,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":114407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":880640,"data_stored":701003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":110621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":115079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T20:57:02.398 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T20:57:02.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.565+0000 7f09e8400640 1 Processor -- start 2024-04-26T20:57:02.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.565+0000 7f09e8400640 1 -- start start 2024-04-26T20:57:02.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.569+0000 7f09e8400640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f09e015f510 0x7f09e00ce480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:02.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.569+0000 7f09e8400640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09e00d2180 con 0x7f09e015f130 2024-04-26T20:57:02.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.569+0000 7f09e8400640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09e00cd570 con 0x7f09e00cfd10 2024-04-26T20:57:02.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.569+0000 7f09e8400640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f09e00cd850 con 0x7f09e015f510 2024-04-26T20:57:02.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.569+0000 7f09e5a00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f09e015f130 0x7f09e00cf600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:43786/0 (socket says 172.21.15.138:43786) 2024-04-26T20:57:02.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.569+0000 7f09e5a00640 1 -- 172.21.15.138:0/2826172558 learned_addr learned my addr 172.21.15.138:0/2826172558 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:02.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.569+0000 7f09e6400640 1 --2- 172.21.15.138:0/2826172558 >> v2:172.21.15.143:3300/0 conn(0x7f09e015f510 0x7f09e00ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:02.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.569+0000 7f09dfe00640 1 -- 172.21.15.138:0/2826172558 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3439027133 0 0) 0x7f09e00d2180 con 0x7f09e015f130 2024-04-26T20:57:02.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.569+0000 7f09dfe00640 1 -- 172.21.15.138:0/2826172558 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09c8003530 con 0x7f09e015f130 2024-04-26T20:57:02.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.569+0000 7f09dfe00640 1 -- 172.21.15.138:0/2826172558 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1875568210 0 0) 0x7f09e00cd570 con 0x7f09e00cfd10 2024-04-26T20:57:02.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.569+0000 7f09dfe00640 1 -- 172.21.15.138:0/2826172558 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09e00d2180 con 0x7f09e00cfd10 2024-04-26T20:57:02.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.569+0000 7f09e6400640 1 -- 172.21.15.138:0/2826172558 >> v1:172.21.15.143:6789/0 conn(0x7f09e00cfd10 legacy=0x7f09e00cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:02.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.569+0000 7f09e6400640 1 -- 172.21.15.138:0/2826172558 >> v1:172.21.15.138:6789/0 conn(0x7f09e015f130 legacy=0x7f09e00cf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:02.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.569+0000 7f09dfe00640 1 -- 172.21.15.138:0/2826172558 <== mon.0 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3749161095 0 0) 0x7f09c8003530 con 0x7f09e015f130 2024-04-26T20:57:02.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.569+0000 7f09e6400640 1 -- 172.21.15.138:0/2826172558 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09e006e730 con 0x7f09e015f510 2024-04-26T20:57:02.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.573+0000 7f09e6400640 1 --2- 172.21.15.138:0/2826172558 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f09e015f510 0x7f09e00ce480 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f09d8009d90 tx=0x7f09d801f080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80f030282e14b35d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:02.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.573+0000 7f09dfe00640 1 -- 172.21.15.138:0/2826172558 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d80b5070 con 0x7f09e015f510 2024-04-26T20:57:02.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.573+0000 7f09dfe00640 1 -- 172.21.15.138:0/2826172558 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09d80a8c10 con 0x7f09e015f510 2024-04-26T20:57:02.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.573+0000 7f09dfe00640 1 -- 172.21.15.138:0/2826172558 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d4001680 con 0x7f09e015f510 2024-04-26T20:57:02.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.573+0000 7f09e8400640 1 -- 172.21.15.138:0/2826172558 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f09e015f510 msgr2=0x7f09e00ce480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:02.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.573+0000 7f09e8400640 1 --2- 172.21.15.138:0/2826172558 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f09e015f510 0x7f09e00ce480 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f09d8009d90 tx=0x7f09d801f080 comp rx=0 tx=0).stop 2024-04-26T20:57:02.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.573+0000 7f09e8400640 1 -- 172.21.15.138:0/2826172558 shutdown_connections 2024-04-26T20:57:02.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.573+0000 7f09e8400640 1 --2- 172.21.15.138:0/2826172558 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f09e015f510 0x7f09e00ce480 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:02.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.573+0000 7f09e8400640 1 -- 172.21.15.138:0/2826172558 >> 172.21.15.138:0/2826172558 conn(0x7f09e00d2d80 msgr2=0x7f09e00d3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:02.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.573+0000 7f09e8400640 1 -- 172.21.15.138:0/2826172558 shutdown_connections 2024-04-26T20:57:02.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.573+0000 7f09e8400640 1 -- 172.21.15.138:0/2826172558 wait complete. 2024-04-26T20:57:02.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.573+0000 7f09e8400640 1 Processor -- start 2024-04-26T20:57:02.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.573+0000 7f09e8400640 1 -- start start 2024-04-26T20:57:02.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.577+0000 7f09e8400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f09e00cfd10 0x7f09e00cb070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:02.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.577+0000 7f09e8400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f09e015f130 0x7f09e015a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:02.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.577+0000 7f09e8400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09e015f510 0x7f09e00c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:02.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.577+0000 7f09e8400640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f09e00d0670 con 0x7f09e015f510 2024-04-26T20:57:02.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.577+0000 7f09e8400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f09e00d04f0 con 0x7f09e015f130 2024-04-26T20:57:02.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.577+0000 7f09e8400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f09e00d3870 con 0x7f09e00cfd10 2024-04-26T20:57:02.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.577+0000 7f09e6400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09e015f510 0x7f09e00c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:02.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.577+0000 7f09e6400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09e015f510 0x7f09e00c9e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:57180/0 (socket says 172.21.15.138:57180) 2024-04-26T20:57:02.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.577+0000 7f09e6400640 1 -- 172.21.15.138:0/2098336293 learned_addr learned my addr 172.21.15.138:0/2098336293 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:02.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.577+0000 7f09e5000640 1 --2- 172.21.15.138:0/2098336293 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f09e015f130 0x7f09e015a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:02.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.577+0000 7f09e5a00640 1 --2- 172.21.15.138:0/2098336293 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f09e00cfd10 0x7f09e00cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:02.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.577+0000 7f09e6400640 1 -- 172.21.15.138:0/2098336293 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f09e00cfd10 msgr2=0x7f09e00cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:02.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.577+0000 7f09e6400640 1 --2- 172.21.15.138:0/2098336293 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f09e00cfd10 0x7f09e00cb070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:02.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.577+0000 7f09e6400640 1 -- 172.21.15.138:0/2098336293 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f09e015f130 msgr2=0x7f09e015a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:02.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.577+0000 7f09e6400640 1 --2- 172.21.15.138:0/2098336293 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f09e015f130 0x7f09e015a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:02.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.577+0000 7f09e6400640 1 -- 172.21.15.138:0/2098336293 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09e00cac10 con 0x7f09e015f510 2024-04-26T20:57:02.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.577+0000 7f09e6400640 1 --2- 172.21.15.138:0/2098336293 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09e015f510 0x7f09e00c9e50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f09d80b3040 tx=0x7f09d801be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:02.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.577+0000 7f09dd600640 1 -- 172.21.15.138:0/2098336293 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d80b5040 con 0x7f09e015f510 2024-04-26T20:57:02.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.577+0000 7f09dd600640 1 -- 172.21.15.138:0/2098336293 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09d80c2070 con 0x7f09e015f510 2024-04-26T20:57:02.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.577+0000 7f09e8400640 1 -- 172.21.15.138:0/2098336293 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09e00cb700 con 0x7f09e015f510 2024-04-26T20:57:02.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.577+0000 7f09dd600640 1 -- 172.21.15.138:0/2098336293 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d8009450 con 0x7f09e015f510 2024-04-26T20:57:02.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.577+0000 7f09e8400640 1 -- 172.21.15.138:0/2098336293 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09e00cbcc0 con 0x7f09e015f510 2024-04-26T20:57:02.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.577+0000 7f09e8400640 1 -- 172.21.15.138:0/2098336293 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09e0069510 con 0x7f09e015f510 2024-04-26T20:57:02.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.577+0000 7f09dd600640 1 -- 172.21.15.138:0/2098336293 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f09d80bb470 con 0x7f09e015f510 2024-04-26T20:57:02.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.581+0000 7f09dd600640 1 --2- 172.21.15.138:0/2098336293 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f09c0068380 0x7f09c006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:02.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.581+0000 7f09dd600640 1 -- 172.21.15.138:0/2098336293 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f09d8125470 con 0x7f09e015f510 2024-04-26T20:57:02.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.581+0000 7f09e5a00640 1 --2- 172.21.15.138:0/2098336293 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f09c0068380 0x7f09c006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:02.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.581+0000 7f09e5a00640 1 --2- 172.21.15.138:0/2098336293 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f09c0068380 0x7f09c006a840 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f09d4001000 tx=0x7f09d4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:02.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.585+0000 7f09dd600640 1 -- 172.21.15.138:0/2098336293 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f09d8018be0 con 0x7f09e015f510 2024-04-26T20:57:02.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.733+0000 7f09e8400640 1 -- 172.21.15.138:0/2098336293 --> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f09e006e2a0 con 0x7f09c0068380 2024-04-26T20:57:02.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.745+0000 7f09dd600640 1 -- 172.21.15.138:0/2098336293 <== mgr.4100 v2:172.21.15.143:6832/4275464198 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f09e006e2a0 con 0x7f09c0068380 2024-04-26T20:57:02.751 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:57:02.753 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-04-26T20:57:02.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.749+0000 7f09e8400640 1 -- 172.21.15.138:0/2098336293 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f09c0068380 msgr2=0x7f09c006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:02.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.749+0000 7f09e8400640 1 --2- 172.21.15.138:0/2098336293 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f09c0068380 0x7f09c006a840 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f09d4001000 tx=0x7f09d4009040 comp rx=0 tx=0).stop 2024-04-26T20:57:02.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.749+0000 7f09e8400640 1 -- 172.21.15.138:0/2098336293 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09e015f510 msgr2=0x7f09e00c9e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:02.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.749+0000 7f09e8400640 1 --2- 172.21.15.138:0/2098336293 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09e015f510 0x7f09e00c9e50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f09d80b3040 tx=0x7f09d801be20 comp rx=0 tx=0).stop 2024-04-26T20:57:02.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.749+0000 7f09e8400640 1 -- 172.21.15.138:0/2098336293 shutdown_connections 2024-04-26T20:57:02.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.749+0000 7f09e8400640 1 --2- 172.21.15.138:0/2098336293 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f09c0068380 0x7f09c006a840 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:02.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.749+0000 7f09e8400640 1 --2- 172.21.15.138:0/2098336293 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09e015f510 0x7f09e00c9e50 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:02.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.749+0000 7f09e8400640 1 --2- 172.21.15.138:0/2098336293 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f09e015f130 0x7f09e015a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:02.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.749+0000 7f09e8400640 1 --2- 172.21.15.138:0/2098336293 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f09e00cfd10 0x7f09e00cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:02.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.749+0000 7f09e8400640 1 -- 172.21.15.138:0/2098336293 >> 172.21.15.138:0/2098336293 conn(0x7f09e00d2d80 msgr2=0x7f09e00ce600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:02.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.749+0000 7f09e8400640 1 -- 172.21.15.138:0/2098336293 shutdown_connections 2024-04-26T20:57:02.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.749+0000 7f09e8400640 1 -- 172.21.15.138:0/2098336293 wait complete. 2024-04-26T20:57:02.771 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-04-26T20:57:01.244795+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219600,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755120,"statfs":{"total":773094113280,"available":772869242880,"internally_reserved":0,"allocated":3514368,"data_stored":2074536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003590"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789875+0000","last_change":"2024-04-26T20:56:39.229878+0000","last_active":"2024-04-26T20:56:45.789875+0000","last_peered":"2024-04-26T20:56:45.789875+0000","last_clean":"2024-04-26T20:56:45.789875+0000","last_became_active":"2024-04-26T20:56:39.229574+0000","last_became_peered":"2024-04-26T20:56:39.229574+0000","last_unstale":"2024-04-26T20:56:45.789875+0000","last_undegraded":"2024-04-26T20:56:45.789875+0000","last_fullsized":"2024-04-26T20:56:45.789875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:24:19.832688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789650+0000","last_change":"2024-04-26T20:56:40.249312+0000","last_active":"2024-04-26T20:56:45.789650+0000","last_peered":"2024-04-26T20:56:45.789650+0000","last_clean":"2024-04-26T20:56:45.789650+0000","last_became_active":"2024-04-26T20:56:40.249079+0000","last_became_peered":"2024-04-26T20:56:40.249079+0000","last_unstale":"2024-04-26T20:56:45.789650+0000","last_undegraded":"2024-04-26T20:56:45.789650+0000","last_fullsized":"2024-04-26T20:56:45.789650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:11:49.558212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.280455+0000","last_change":"2024-04-26T20:56:44.274985+0000","last_active":"2024-04-26T20:56:45.280455+0000","last_peered":"2024-04-26T20:56:45.280455+0000","last_clean":"2024-04-26T20:56:45.280455+0000","last_became_active":"2024-04-26T20:56:44.274510+0000","last_became_peered":"2024-04-26T20:56:44.274510+0000","last_unstale":"2024-04-26T20:56:45.280455+0000","last_undegraded":"2024-04-26T20:56:45.280455+0000","last_fullsized":"2024-04-26T20:56:45.280455+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:59.157222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789762+0000","last_change":"2024-04-26T20:56:39.213876+0000","last_active":"2024-04-26T20:56:45.789762+0000","last_peered":"2024-04-26T20:56:45.789762+0000","last_clean":"2024-04-26T20:56:45.789762+0000","last_became_active":"2024-04-26T20:56:39.213454+0000","last_became_peered":"2024-04-26T20:56:39.213454+0000","last_unstale":"2024-04-26T20:56:45.789762+0000","last_undegraded":"2024-04-26T20:56:45.789762+0000","last_fullsized":"2024-04-26T20:56:45.789762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:40:48.839377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789322+0000","last_change":"2024-04-26T20:56:40.247462+0000","last_active":"2024-04-26T20:56:45.789322+0000","last_peered":"2024-04-26T20:56:45.789322+0000","last_clean":"2024-04-26T20:56:45.789322+0000","last_became_active":"2024-04-26T20:56:40.246735+0000","last_became_peered":"2024-04-26T20:56:40.246735+0000","last_unstale":"2024-04-26T20:56:45.789322+0000","last_undegraded":"2024-04-26T20:56:45.789322+0000","last_fullsized":"2024-04-26T20:56:45.789322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:29.705970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.279752+0000","last_change":"2024-04-26T20:56:44.275068+0000","last_active":"2024-04-26T20:56:45.279752+0000","last_peered":"2024-04-26T20:56:45.279752+0000","last_clean":"2024-04-26T20:56:45.279752+0000","last_became_active":"2024-04-26T20:56:44.273517+0000","last_became_peered":"2024-04-26T20:56:44.273517+0000","last_unstale":"2024-04-26T20:56:45.279752+0000","last_undegraded":"2024-04-26T20:56:45.279752+0000","last_fullsized":"2024-04-26T20:56:45.279752+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:41:08.276592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278739+0000","last_change":"2024-04-26T20:56:39.213779+0000","last_active":"2024-04-26T20:56:45.278739+0000","last_peered":"2024-04-26T20:56:45.278739+0000","last_clean":"2024-04-26T20:56:45.278739+0000","last_became_active":"2024-04-26T20:56:39.213433+0000","last_became_peered":"2024-04-26T20:56:39.213433+0000","last_unstale":"2024-04-26T20:56:45.278739+0000","last_undegraded":"2024-04-26T20:56:45.278739+0000","last_fullsized":"2024-04-26T20:56:45.278739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:33.595789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.465212+0000","last_change":"2024-04-26T20:56:40.240847+0000","last_active":"2024-04-26T20:56:45.465212+0000","last_peered":"2024-04-26T20:56:45.465212+0000","last_clean":"2024-04-26T20:56:45.465212+0000","last_became_active":"2024-04-26T20:56:40.240513+0000","last_became_peered":"2024-04-26T20:56:40.240513+0000","last_unstale":"2024-04-26T20:56:45.465212+0000","last_undegraded":"2024-04-26T20:56:45.465212+0000","last_fullsized":"2024-04-26T20:56:45.465212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:31.742963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.280055+0000","last_change":"2024-04-26T20:56:44.268256+0000","last_active":"2024-04-26T20:56:45.280055+0000","last_peered":"2024-04-26T20:56:45.280055+0000","last_clean":"2024-04-26T20:56:45.280055+0000","last_became_active":"2024-04-26T20:56:44.267885+0000","last_became_peered":"2024-04-26T20:56:44.267885+0000","last_unstale":"2024-04-26T20:56:45.280055+0000","last_undegraded":"2024-04-26T20:56:45.280055+0000","last_fullsized":"2024-04-26T20:56:45.280055+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:24:14.331856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278928+0000","last_change":"2024-04-26T20:56:39.210434+0000","last_active":"2024-04-26T20:56:45.278928+0000","last_peered":"2024-04-26T20:56:45.278928+0000","last_clean":"2024-04-26T20:56:45.278928+0000","last_became_active":"2024-04-26T20:56:39.210149+0000","last_became_peered":"2024-04-26T20:56:39.210149+0000","last_unstale":"2024-04-26T20:56:45.278928+0000","last_undegraded":"2024-04-26T20:56:45.278928+0000","last_fullsized":"2024-04-26T20:56:45.278928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:57.508629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786985+0000","last_change":"2024-04-26T20:56:40.232523+0000","last_active":"2024-04-26T20:56:45.786985+0000","last_peered":"2024-04-26T20:56:45.786985+0000","last_clean":"2024-04-26T20:56:45.786985+0000","last_became_active":"2024-04-26T20:56:40.230256+0000","last_became_peered":"2024-04-26T20:56:40.230256+0000","last_unstale":"2024-04-26T20:56:45.786985+0000","last_undegraded":"2024-04-26T20:56:45.786985+0000","last_fullsized":"2024-04-26T20:56:45.786985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:16:36.927553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.279880+0000","last_change":"2024-04-26T20:56:44.274965+0000","last_active":"2024-04-26T20:56:45.279880+0000","last_peered":"2024-04-26T20:56:45.279880+0000","last_clean":"2024-04-26T20:56:45.279880+0000","last_became_active":"2024-04-26T20:56:44.274623+0000","last_became_peered":"2024-04-26T20:56:44.274623+0000","last_unstale":"2024-04-26T20:56:45.279880+0000","last_undegraded":"2024-04-26T20:56:45.279880+0000","last_fullsized":"2024-04-26T20:56:45.279880+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:20:44.467468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786581+0000","last_change":"2024-04-26T20:56:40.245428+0000","last_active":"2024-04-26T20:56:45.786581+0000","last_peered":"2024-04-26T20:56:45.786581+0000","last_clean":"2024-04-26T20:56:45.786581+0000","last_became_active":"2024-04-26T20:56:40.245183+0000","last_became_peered":"2024-04-26T20:56:40.245183+0000","last_unstale":"2024-04-26T20:56:45.786581+0000","last_undegraded":"2024-04-26T20:56:45.786581+0000","last_fullsized":"2024-04-26T20:56:45.786581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:39:41.674507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786761+0000","last_change":"2024-04-26T20:56:39.230950+0000","last_active":"2024-04-26T20:56:45.786761+0000","last_peered":"2024-04-26T20:56:45.786761+0000","last_clean":"2024-04-26T20:56:45.786761+0000","last_became_active":"2024-04-26T20:56:39.229924+0000","last_became_peered":"2024-04-26T20:56:39.229924+0000","last_unstale":"2024-04-26T20:56:45.786761+0000","last_undegraded":"2024-04-26T20:56:45.786761+0000","last_fullsized":"2024-04-26T20:56:45.786761+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:57.508629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786803+0000","last_change":"2024-04-26T20:56:44.266930+0000","last_active":"2024-04-26T20:56:45.786803+0000","last_peered":"2024-04-26T20:56:45.786803+0000","last_clean":"2024-04-26T20:56:45.786803+0000","last_became_active":"2024-04-26T20:56:44.266307+0000","last_became_peered":"2024-04-26T20:56:44.266307+0000","last_unstale":"2024-04-26T20:56:45.786803+0000","last_undegraded":"2024-04-26T20:56:45.786803+0000","last_fullsized":"2024-04-26T20:56:45.786803+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:49:09.870181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.281399+0000","last_change":"2024-04-26T20:56:40.243411+0000","last_active":"2024-04-26T20:56:45.281399+0000","last_peered":"2024-04-26T20:56:45.281399+0000","last_clean":"2024-04-26T20:56:45.281399+0000","last_became_active":"2024-04-26T20:56:40.242875+0000","last_became_peered":"2024-04-26T20:56:40.242875+0000","last_unstale":"2024-04-26T20:56:45.281399+0000","last_undegraded":"2024-04-26T20:56:45.281399+0000","last_fullsized":"2024-04-26T20:56:45.281399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:10:58.729505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788799+0000","last_change":"2024-04-26T20:56:39.224859+0000","last_active":"2024-04-26T20:56:45.788799+0000","last_peered":"2024-04-26T20:56:45.788799+0000","last_clean":"2024-04-26T20:56:45.788799+0000","last_became_active":"2024-04-26T20:56:39.223684+0000","last_became_peered":"2024-04-26T20:56:39.223684+0000","last_unstale":"2024-04-26T20:56:45.788799+0000","last_undegraded":"2024-04-26T20:56:45.788799+0000","last_fullsized":"2024-04-26T20:56:45.788799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:41:13.015392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278377+0000","last_change":"2024-04-26T20:56:44.269716+0000","last_active":"2024-04-26T20:56:45.278377+0000","last_peered":"2024-04-26T20:56:45.278377+0000","last_clean":"2024-04-26T20:56:45.278377+0000","last_became_active":"2024-04-26T20:56:44.269363+0000","last_became_peered":"2024-04-26T20:56:44.269363+0000","last_unstale":"2024-04-26T20:56:45.278377+0000","last_undegraded":"2024-04-26T20:56:45.278377+0000","last_fullsized":"2024-04-26T20:56:45.278377+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:39:45.714289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789241+0000","last_change":"2024-04-26T20:56:40.233387+0000","last_active":"2024-04-26T20:56:45.789241+0000","last_peered":"2024-04-26T20:56:45.789241+0000","last_clean":"2024-04-26T20:56:45.789241+0000","last_became_active":"2024-04-26T20:56:40.233078+0000","last_became_peered":"2024-04-26T20:56:40.233078+0000","last_unstale":"2024-04-26T20:56:45.789241+0000","last_undegraded":"2024-04-26T20:56:45.789241+0000","last_fullsized":"2024-04-26T20:56:45.789241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:10:26.700437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788991+0000","last_change":"2024-04-26T20:56:39.211859+0000","last_active":"2024-04-26T20:56:45.788991+0000","last_peered":"2024-04-26T20:56:45.788991+0000","last_clean":"2024-04-26T20:56:45.788991+0000","last_became_active":"2024-04-26T20:56:39.211629+0000","last_became_peered":"2024-04-26T20:56:39.211629+0000","last_unstale":"2024-04-26T20:56:45.788991+0000","last_undegraded":"2024-04-26T20:56:45.788991+0000","last_fullsized":"2024-04-26T20:56:45.788991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:27.088665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.281180+0000","last_change":"2024-04-26T20:56:44.276902+0000","last_active":"2024-04-26T20:56:45.281180+0000","last_peered":"2024-04-26T20:56:45.281180+0000","last_clean":"2024-04-26T20:56:45.281180+0000","last_became_active":"2024-04-26T20:56:44.276509+0000","last_became_peered":"2024-04-26T20:56:44.276509+0000","last_unstale":"2024-04-26T20:56:45.281180+0000","last_undegraded":"2024-04-26T20:56:45.281180+0000","last_fullsized":"2024-04-26T20:56:45.281180+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:07:31.106137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786397+0000","last_change":"2024-04-26T20:56:40.229542+0000","last_active":"2024-04-26T20:56:45.786397+0000","last_peered":"2024-04-26T20:56:45.786397+0000","last_clean":"2024-04-26T20:56:45.786397+0000","last_became_active":"2024-04-26T20:56:40.227907+0000","last_became_peered":"2024-04-26T20:56:40.227907+0000","last_unstale":"2024-04-26T20:56:45.786397+0000","last_undegraded":"2024-04-26T20:56:45.786397+0000","last_fullsized":"2024-04-26T20:56:45.786397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:32:50.377638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.277959+0000","last_change":"2024-04-26T20:56:39.226639+0000","last_active":"2024-04-26T20:56:45.277959+0000","last_peered":"2024-04-26T20:56:45.277959+0000","last_clean":"2024-04-26T20:56:45.277959+0000","last_became_active":"2024-04-26T20:56:39.226040+0000","last_became_peered":"2024-04-26T20:56:39.226040+0000","last_unstale":"2024-04-26T20:56:45.277959+0000","last_undegraded":"2024-04-26T20:56:45.277959+0000","last_fullsized":"2024-04-26T20:56:45.277959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:11:12.183144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.280450+0000","last_change":"2024-04-26T20:56:44.264659+0000","last_active":"2024-04-26T20:56:45.280450+0000","last_peered":"2024-04-26T20:56:45.280450+0000","last_clean":"2024-04-26T20:56:45.280450+0000","last_became_active":"2024-04-26T20:56:44.264283+0000","last_became_peered":"2024-04-26T20:56:44.264283+0000","last_unstale":"2024-04-26T20:56:45.280450+0000","last_undegraded":"2024-04-26T20:56:45.280450+0000","last_fullsized":"2024-04-26T20:56:45.280450+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:50:30.081888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789823+0000","last_change":"2024-04-26T20:56:40.254246+0000","last_active":"2024-04-26T20:56:45.789823+0000","last_peered":"2024-04-26T20:56:45.789823+0000","last_clean":"2024-04-26T20:56:45.789823+0000","last_became_active":"2024-04-26T20:56:40.253998+0000","last_became_peered":"2024-04-26T20:56:40.253998+0000","last_unstale":"2024-04-26T20:56:45.789823+0000","last_undegraded":"2024-04-26T20:56:45.789823+0000","last_fullsized":"2024-04-26T20:56:45.789823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:15.179866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.787122+0000","last_change":"2024-04-26T20:56:39.228884+0000","last_active":"2024-04-26T20:56:45.787122+0000","last_peered":"2024-04-26T20:56:45.787122+0000","last_clean":"2024-04-26T20:56:45.787122+0000","last_became_active":"2024-04-26T20:56:39.228629+0000","last_became_peered":"2024-04-26T20:56:39.228629+0000","last_unstale":"2024-04-26T20:56:45.787122+0000","last_undegraded":"2024-04-26T20:56:45.787122+0000","last_fullsized":"2024-04-26T20:56:45.787122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:41:03.229071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.279855+0000","last_change":"2024-04-26T20:56:44.260583+0000","last_active":"2024-04-26T20:56:45.279855+0000","last_peered":"2024-04-26T20:56:45.279855+0000","last_clean":"2024-04-26T20:56:45.279855+0000","last_became_active":"2024-04-26T20:56:44.260203+0000","last_became_peered":"2024-04-26T20:56:44.260203+0000","last_unstale":"2024-04-26T20:56:45.279855+0000","last_undegraded":"2024-04-26T20:56:45.279855+0000","last_fullsized":"2024-04-26T20:56:45.279855+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:11:53.597994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789753+0000","last_change":"2024-04-26T20:56:40.248051+0000","last_active":"2024-04-26T20:56:45.789753+0000","last_peered":"2024-04-26T20:56:45.789753+0000","last_clean":"2024-04-26T20:56:45.789753+0000","last_became_active":"2024-04-26T20:56:40.247752+0000","last_became_peered":"2024-04-26T20:56:40.247752+0000","last_unstale":"2024-04-26T20:56:45.789753+0000","last_undegraded":"2024-04-26T20:56:45.789753+0000","last_fullsized":"2024-04-26T20:56:45.789753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:12:39.534861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.790043+0000","last_change":"2024-04-26T20:56:39.215006+0000","last_active":"2024-04-26T20:56:45.790043+0000","last_peered":"2024-04-26T20:56:45.790043+0000","last_clean":"2024-04-26T20:56:45.790043+0000","last_became_active":"2024-04-26T20:56:39.214568+0000","last_became_peered":"2024-04-26T20:56:39.214568+0000","last_unstale":"2024-04-26T20:56:45.790043+0000","last_undegraded":"2024-04-26T20:56:45.790043+0000","last_fullsized":"2024-04-26T20:56:45.790043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:48:30.348419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788054+0000","last_change":"2024-04-26T20:56:44.266191+0000","last_active":"2024-04-26T20:56:45.788054+0000","last_peered":"2024-04-26T20:56:45.788054+0000","last_clean":"2024-04-26T20:56:45.788054+0000","last_became_active":"2024-04-26T20:56:44.265828+0000","last_became_peered":"2024-04-26T20:56:44.265828+0000","last_unstale":"2024-04-26T20:56:45.788054+0000","last_undegraded":"2024-04-26T20:56:45.788054+0000","last_fullsized":"2024-04-26T20:56:45.788054+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:07.880235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.790688+0000","last_change":"2024-04-26T20:56:40.235429+0000","last_active":"2024-04-26T20:56:45.790688+0000","last_peered":"2024-04-26T20:56:45.790688+0000","last_clean":"2024-04-26T20:56:45.790688+0000","last_became_active":"2024-04-26T20:56:40.234817+0000","last_became_peered":"2024-04-26T20:56:40.234817+0000","last_unstale":"2024-04-26T20:56:45.790688+0000","last_undegraded":"2024-04-26T20:56:45.790688+0000","last_fullsized":"2024-04-26T20:56:45.790688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:41:03.691519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.787238+0000","last_change":"2024-04-26T20:56:39.224333+0000","last_active":"2024-04-26T20:56:45.787238+0000","last_peered":"2024-04-26T20:56:45.787238+0000","last_clean":"2024-04-26T20:56:45.787238+0000","last_became_active":"2024-04-26T20:56:39.220936+0000","last_became_peered":"2024-04-26T20:56:39.220936+0000","last_unstale":"2024-04-26T20:56:45.787238+0000","last_undegraded":"2024-04-26T20:56:45.787238+0000","last_fullsized":"2024-04-26T20:56:45.787238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:57:35.827912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788284+0000","last_change":"2024-04-26T20:56:44.257752+0000","last_active":"2024-04-26T20:56:45.788284+0000","last_peered":"2024-04-26T20:56:45.788284+0000","last_clean":"2024-04-26T20:56:45.788284+0000","last_became_active":"2024-04-26T20:56:44.257338+0000","last_became_peered":"2024-04-26T20:56:44.257338+0000","last_unstale":"2024-04-26T20:56:45.788284+0000","last_undegraded":"2024-04-26T20:56:45.788284+0000","last_fullsized":"2024-04-26T20:56:45.788284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:20:44.467468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.280289+0000","last_change":"2024-04-26T20:56:40.245228+0000","last_active":"2024-04-26T20:56:45.280289+0000","last_peered":"2024-04-26T20:56:45.280289+0000","last_clean":"2024-04-26T20:56:45.280289+0000","last_became_active":"2024-04-26T20:56:40.244846+0000","last_became_peered":"2024-04-26T20:56:40.244846+0000","last_unstale":"2024-04-26T20:56:45.280289+0000","last_undegraded":"2024-04-26T20:56:45.280289+0000","last_fullsized":"2024-04-26T20:56:45.280289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:41:13.644088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788644+0000","last_change":"2024-04-26T20:56:39.220939+0000","last_active":"2024-04-26T20:56:45.788644+0000","last_peered":"2024-04-26T20:56:45.788644+0000","last_clean":"2024-04-26T20:56:45.788644+0000","last_became_active":"2024-04-26T20:56:39.220267+0000","last_became_peered":"2024-04-26T20:56:39.220267+0000","last_unstale":"2024-04-26T20:56:45.788644+0000","last_undegraded":"2024-04-26T20:56:45.788644+0000","last_fullsized":"2024-04-26T20:56:45.788644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:14:14.002707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788475+0000","last_change":"2024-04-26T20:56:44.257761+0000","last_active":"2024-04-26T20:56:45.788475+0000","last_peered":"2024-04-26T20:56:45.788475+0000","last_clean":"2024-04-26T20:56:45.788475+0000","last_became_active":"2024-04-26T20:56:44.257291+0000","last_became_peered":"2024-04-26T20:56:44.257291+0000","last_unstale":"2024-04-26T20:56:45.788475+0000","last_undegraded":"2024-04-26T20:56:45.788475+0000","last_fullsized":"2024-04-26T20:56:45.788475+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:24:14.331856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278555+0000","last_change":"2024-04-26T20:56:40.224373+0000","last_active":"2024-04-26T20:56:45.278555+0000","last_peered":"2024-04-26T20:56:45.278555+0000","last_clean":"2024-04-26T20:56:45.278555+0000","last_became_active":"2024-04-26T20:56:40.224141+0000","last_became_peered":"2024-04-26T20:56:40.224141+0000","last_unstale":"2024-04-26T20:56:45.278555+0000","last_undegraded":"2024-04-26T20:56:45.278555+0000","last_fullsized":"2024-04-26T20:56:45.278555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:50:26.042106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786967+0000","last_change":"2024-04-26T20:56:39.225627+0000","last_active":"2024-04-26T20:56:45.786967+0000","last_peered":"2024-04-26T20:56:45.786967+0000","last_clean":"2024-04-26T20:56:45.786967+0000","last_became_active":"2024-04-26T20:56:39.224819+0000","last_became_peered":"2024-04-26T20:56:39.224819+0000","last_unstale":"2024-04-26T20:56:45.786967+0000","last_undegraded":"2024-04-26T20:56:45.786967+0000","last_fullsized":"2024-04-26T20:56:45.786967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:54.109701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.790603+0000","last_change":"2024-04-26T20:56:44.268007+0000","last_active":"2024-04-26T20:56:45.790603+0000","last_peered":"2024-04-26T20:56:45.790603+0000","last_clean":"2024-04-26T20:56:45.790603+0000","last_became_active":"2024-04-26T20:56:44.267593+0000","last_became_peered":"2024-04-26T20:56:44.267593+0000","last_unstale":"2024-04-26T20:56:45.790603+0000","last_undegraded":"2024-04-26T20:56:45.790603+0000","last_fullsized":"2024-04-26T20:56:45.790603+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:43:21.248440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788110+0000","last_change":"2024-04-26T20:56:40.232686+0000","last_active":"2024-04-26T20:56:45.788110+0000","last_peered":"2024-04-26T20:56:45.788110+0000","last_clean":"2024-04-26T20:56:45.788110+0000","last_became_active":"2024-04-26T20:56:40.232406+0000","last_became_peered":"2024-04-26T20:56:40.232406+0000","last_unstale":"2024-04-26T20:56:45.788110+0000","last_undegraded":"2024-04-26T20:56:45.788110+0000","last_fullsized":"2024-04-26T20:56:45.788110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:44:46.926225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.280640+0000","last_change":"2024-04-26T20:56:39.224479+0000","last_active":"2024-04-26T20:56:45.280640+0000","last_peered":"2024-04-26T20:56:45.280640+0000","last_clean":"2024-04-26T20:56:45.280640+0000","last_became_active":"2024-04-26T20:56:39.224106+0000","last_became_peered":"2024-04-26T20:56:39.224106+0000","last_unstale":"2024-04-26T20:56:45.280640+0000","last_undegraded":"2024-04-26T20:56:45.280640+0000","last_fullsized":"2024-04-26T20:56:45.280640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:31:59.475595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.790288+0000","last_change":"2024-04-26T20:56:44.264512+0000","last_active":"2024-04-26T20:56:45.790288+0000","last_peered":"2024-04-26T20:56:45.790288+0000","last_clean":"2024-04-26T20:56:45.790288+0000","last_became_active":"2024-04-26T20:56:44.264211+0000","last_became_peered":"2024-04-26T20:56:44.264211+0000","last_unstale":"2024-04-26T20:56:45.790288+0000","last_undegraded":"2024-04-26T20:56:45.790288+0000","last_fullsized":"2024-04-26T20:56:45.790288+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:33.745752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788142+0000","last_change":"2024-04-26T20:56:40.248343+0000","last_active":"2024-04-26T20:56:45.788142+0000","last_peered":"2024-04-26T20:56:45.788142+0000","last_clean":"2024-04-26T20:56:45.788142+0000","last_became_active":"2024-04-26T20:56:40.248044+0000","last_became_peered":"2024-04-26T20:56:40.248044+0000","last_unstale":"2024-04-26T20:56:45.788142+0000","last_undegraded":"2024-04-26T20:56:45.788142+0000","last_fullsized":"2024-04-26T20:56:45.788142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:14:12.321345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786512+0000","last_change":"2024-04-26T20:56:39.224746+0000","last_active":"2024-04-26T20:56:45.786512+0000","last_peered":"2024-04-26T20:56:45.786512+0000","last_clean":"2024-04-26T20:56:45.786512+0000","last_became_active":"2024-04-26T20:56:39.224396+0000","last_became_peered":"2024-04-26T20:56:39.224396+0000","last_unstale":"2024-04-26T20:56:45.786512+0000","last_undegraded":"2024-04-26T20:56:45.786512+0000","last_fullsized":"2024-04-26T20:56:45.786512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:33.595789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789520+0000","last_change":"2024-04-26T20:56:44.263211+0000","last_active":"2024-04-26T20:56:45.789520+0000","last_peered":"2024-04-26T20:56:45.789520+0000","last_clean":"2024-04-26T20:56:45.789520+0000","last_became_active":"2024-04-26T20:56:44.262730+0000","last_became_peered":"2024-04-26T20:56:44.262730+0000","last_unstale":"2024-04-26T20:56:45.789520+0000","last_undegraded":"2024-04-26T20:56:45.789520+0000","last_fullsized":"2024-04-26T20:56:45.789520+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:00.508968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789184+0000","last_change":"2024-04-26T20:56:40.231800+0000","last_active":"2024-04-26T20:56:45.789184+0000","last_peered":"2024-04-26T20:56:45.789184+0000","last_clean":"2024-04-26T20:56:45.789184+0000","last_became_active":"2024-04-26T20:56:40.231372+0000","last_became_peered":"2024-04-26T20:56:40.231372+0000","last_unstale":"2024-04-26T20:56:45.789184+0000","last_undegraded":"2024-04-26T20:56:45.789184+0000","last_fullsized":"2024-04-26T20:56:45.789184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:25:09.320511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786818+0000","last_change":"2024-04-26T20:56:39.219637+0000","last_active":"2024-04-26T20:56:45.786818+0000","last_peered":"2024-04-26T20:56:45.786818+0000","last_clean":"2024-04-26T20:56:45.786818+0000","last_became_active":"2024-04-26T20:56:39.219390+0000","last_became_peered":"2024-04-26T20:56:39.219390+0000","last_unstale":"2024-04-26T20:56:45.786818+0000","last_undegraded":"2024-04-26T20:56:45.786818+0000","last_fullsized":"2024-04-26T20:56:45.786818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:41:12.636349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":178,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.464868+0000","last_change":"2024-04-26T20:56:29.347462+0000","last_active":"2024-04-26T20:56:45.464868+0000","last_peered":"2024-04-26T20:56:45.464868+0000","last_clean":"2024-04-26T20:56:45.464868+0000","last_became_active":"2024-04-26T20:56:29.346224+0000","last_became_peered":"2024-04-26T20:56:29.346224+0000","last_unstale":"2024-04-26T20:56:45.464868+0000","last_undegraded":"2024-04-26T20:56:45.464868+0000","last_fullsized":"2024-04-26T20:56:45.464868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:28.079105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:28.079105+0000","last_clean_scrub_stamp":"2024-04-26T20:56:28.079105+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:13.693525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.787244+0000","last_change":"2024-04-26T20:56:44.256761+0000","last_active":"2024-04-26T20:56:45.787244+0000","last_peered":"2024-04-26T20:56:45.787244+0000","last_clean":"2024-04-26T20:56:45.787244+0000","last_became_active":"2024-04-26T20:56:44.256253+0000","last_became_peered":"2024-04-26T20:56:44.256253+0000","last_unstale":"2024-04-26T20:56:45.787244+0000","last_undegraded":"2024-04-26T20:56:45.787244+0000","last_fullsized":"2024-04-26T20:56:45.787244+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:34.373869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.787072+0000","last_change":"2024-04-26T20:56:40.245995+0000","last_active":"2024-04-26T20:56:45.787072+0000","last_peered":"2024-04-26T20:56:45.787072+0000","last_clean":"2024-04-26T20:56:45.787072+0000","last_became_active":"2024-04-26T20:56:40.245694+0000","last_became_peered":"2024-04-26T20:56:40.245694+0000","last_unstale":"2024-04-26T20:56:45.787072+0000","last_undegraded":"2024-04-26T20:56:45.787072+0000","last_fullsized":"2024-04-26T20:56:45.787072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:52.333752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.790781+0000","last_change":"2024-04-26T20:56:39.224388+0000","last_active":"2024-04-26T20:56:45.790781+0000","last_peered":"2024-04-26T20:56:45.790781+0000","last_clean":"2024-04-26T20:56:45.790781+0000","last_became_active":"2024-04-26T20:56:39.224125+0000","last_became_peered":"2024-04-26T20:56:39.224125+0000","last_unstale":"2024-04-26T20:56:45.790781+0000","last_undegraded":"2024-04-26T20:56:45.790781+0000","last_fullsized":"2024-04-26T20:56:45.790781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:40:48.839377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.279794+0000","last_change":"2024-04-26T20:56:44.266270+0000","last_active":"2024-04-26T20:56:45.279794+0000","last_peered":"2024-04-26T20:56:45.279794+0000","last_clean":"2024-04-26T20:56:45.279794+0000","last_became_active":"2024-04-26T20:56:44.265879+0000","last_became_peered":"2024-04-26T20:56:44.265879+0000","last_unstale":"2024-04-26T20:56:45.279794+0000","last_undegraded":"2024-04-26T20:56:45.279794+0000","last_fullsized":"2024-04-26T20:56:45.279794+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:28:42.894461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278895+0000","last_change":"2024-04-26T20:56:40.232540+0000","last_active":"2024-04-26T20:56:45.278895+0000","last_peered":"2024-04-26T20:56:45.278895+0000","last_clean":"2024-04-26T20:56:45.278895+0000","last_became_active":"2024-04-26T20:56:40.231008+0000","last_became_peered":"2024-04-26T20:56:40.231008+0000","last_unstale":"2024-04-26T20:56:45.278895+0000","last_undegraded":"2024-04-26T20:56:45.278895+0000","last_fullsized":"2024-04-26T20:56:45.278895+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:20:40.427686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789243+0000","last_change":"2024-04-26T20:56:39.222383+0000","last_active":"2024-04-26T20:56:45.789243+0000","last_peered":"2024-04-26T20:56:45.789243+0000","last_clean":"2024-04-26T20:56:45.789243+0000","last_became_active":"2024-04-26T20:56:39.222014+0000","last_became_peered":"2024-04-26T20:56:39.222014+0000","last_unstale":"2024-04-26T20:56:45.789243+0000","last_undegraded":"2024-04-26T20:56:45.789243+0000","last_fullsized":"2024-04-26T20:56:45.789243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:03:29.476982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788357+0000","last_change":"2024-04-26T20:56:44.264780+0000","last_active":"2024-04-26T20:56:45.788357+0000","last_peered":"2024-04-26T20:56:45.788357+0000","last_clean":"2024-04-26T20:56:45.788357+0000","last_became_active":"2024-04-26T20:56:44.260516+0000","last_became_peered":"2024-04-26T20:56:44.260516+0000","last_unstale":"2024-04-26T20:56:45.788357+0000","last_undegraded":"2024-04-26T20:56:45.788357+0000","last_fullsized":"2024-04-26T20:56:45.788357+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:56.373533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278843+0000","last_change":"2024-04-26T20:56:40.245302+0000","last_active":"2024-04-26T20:56:45.278843+0000","last_peered":"2024-04-26T20:56:45.278843+0000","last_clean":"2024-04-26T20:56:45.278843+0000","last_became_active":"2024-04-26T20:56:40.245020+0000","last_became_peered":"2024-04-26T20:56:40.245020+0000","last_unstale":"2024-04-26T20:56:45.278843+0000","last_undegraded":"2024-04-26T20:56:45.278843+0000","last_fullsized":"2024-04-26T20:56:45.278843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:32:50.377638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789962+0000","last_change":"2024-04-26T20:56:39.212876+0000","last_active":"2024-04-26T20:56:45.789962+0000","last_peered":"2024-04-26T20:56:45.789962+0000","last_clean":"2024-04-26T20:56:45.789962+0000","last_became_active":"2024-04-26T20:56:39.210505+0000","last_became_peered":"2024-04-26T20:56:39.210505+0000","last_unstale":"2024-04-26T20:56:45.789962+0000","last_undegraded":"2024-04-26T20:56:45.789962+0000","last_fullsized":"2024-04-26T20:56:45.789962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:29:37.126090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786321+0000","last_change":"2024-04-26T20:56:44.269758+0000","last_active":"2024-04-26T20:56:45.786321+0000","last_peered":"2024-04-26T20:56:45.786321+0000","last_clean":"2024-04-26T20:56:45.786321+0000","last_became_active":"2024-04-26T20:56:44.267320+0000","last_became_peered":"2024-04-26T20:56:44.267320+0000","last_unstale":"2024-04-26T20:56:45.786321+0000","last_undegraded":"2024-04-26T20:56:45.786321+0000","last_fullsized":"2024-04-26T20:56:45.786321+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:28.426749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.280509+0000","last_change":"2024-04-26T20:56:40.224152+0000","last_active":"2024-04-26T20:56:45.280509+0000","last_peered":"2024-04-26T20:56:45.280509+0000","last_clean":"2024-04-26T20:56:45.280509+0000","last_became_active":"2024-04-26T20:56:40.223000+0000","last_became_peered":"2024-04-26T20:56:40.223000+0000","last_unstale":"2024-04-26T20:56:45.280509+0000","last_undegraded":"2024-04-26T20:56:45.280509+0000","last_fullsized":"2024-04-26T20:56:45.280509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:46.709617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278951+0000","last_change":"2024-04-26T20:56:39.210612+0000","last_active":"2024-04-26T20:56:45.278951+0000","last_peered":"2024-04-26T20:56:45.278951+0000","last_clean":"2024-04-26T20:56:45.278951+0000","last_became_active":"2024-04-26T20:56:39.210308+0000","last_became_peered":"2024-04-26T20:56:39.210308+0000","last_unstale":"2024-04-26T20:56:45.278951+0000","last_undegraded":"2024-04-26T20:56:45.278951+0000","last_fullsized":"2024-04-26T20:56:45.278951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:10:57.721766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.465006+0000","last_change":"2024-04-26T20:56:44.255699+0000","last_active":"2024-04-26T20:56:45.465006+0000","last_peered":"2024-04-26T20:56:45.465006+0000","last_clean":"2024-04-26T20:56:45.465006+0000","last_became_active":"2024-04-26T20:56:44.255377+0000","last_became_peered":"2024-04-26T20:56:44.255377+0000","last_unstale":"2024-04-26T20:56:45.465006+0000","last_undegraded":"2024-04-26T20:56:45.465006+0000","last_fullsized":"2024-04-26T20:56:45.465006+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:35.050613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786401+0000","last_change":"2024-04-26T20:56:40.223324+0000","last_active":"2024-04-26T20:56:45.786401+0000","last_peered":"2024-04-26T20:56:45.786401+0000","last_clean":"2024-04-26T20:56:45.786401+0000","last_became_active":"2024-04-26T20:56:40.223003+0000","last_became_peered":"2024-04-26T20:56:40.223003+0000","last_unstale":"2024-04-26T20:56:45.786401+0000","last_undegraded":"2024-04-26T20:56:45.786401+0000","last_fullsized":"2024-04-26T20:56:45.786401+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:14:26.269699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789347+0000","last_change":"2024-04-26T20:56:39.217490+0000","last_active":"2024-04-26T20:56:45.789347+0000","last_peered":"2024-04-26T20:56:45.789347+0000","last_clean":"2024-04-26T20:56:45.789347+0000","last_became_active":"2024-04-26T20:56:39.217064+0000","last_became_peered":"2024-04-26T20:56:39.217064+0000","last_unstale":"2024-04-26T20:56:45.789347+0000","last_undegraded":"2024-04-26T20:56:45.789347+0000","last_fullsized":"2024-04-26T20:56:45.789347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:58:35.548325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789701+0000","last_change":"2024-04-26T20:56:44.262792+0000","last_active":"2024-04-26T20:56:45.789701+0000","last_peered":"2024-04-26T20:56:45.789701+0000","last_clean":"2024-04-26T20:56:45.789701+0000","last_became_active":"2024-04-26T20:56:44.260202+0000","last_became_peered":"2024-04-26T20:56:44.260202+0000","last_unstale":"2024-04-26T20:56:45.789701+0000","last_undegraded":"2024-04-26T20:56:45.789701+0000","last_fullsized":"2024-04-26T20:56:45.789701+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:54:15.702050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.464817+0000","last_change":"2024-04-26T20:56:40.259427+0000","last_active":"2024-04-26T20:56:45.464817+0000","last_peered":"2024-04-26T20:56:45.464817+0000","last_clean":"2024-04-26T20:56:45.464817+0000","last_became_active":"2024-04-26T20:56:40.258928+0000","last_became_peered":"2024-04-26T20:56:40.258928+0000","last_unstale":"2024-04-26T20:56:45.464817+0000","last_undegraded":"2024-04-26T20:56:45.464817+0000","last_fullsized":"2024-04-26T20:56:45.464817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:10:58.729505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278176+0000","last_change":"2024-04-26T20:56:39.223722+0000","last_active":"2024-04-26T20:56:45.278176+0000","last_peered":"2024-04-26T20:56:45.278176+0000","last_clean":"2024-04-26T20:56:45.278176+0000","last_became_active":"2024-04-26T20:56:39.223385+0000","last_became_peered":"2024-04-26T20:56:39.223385+0000","last_unstale":"2024-04-26T20:56:45.278176+0000","last_undegraded":"2024-04-26T20:56:45.278176+0000","last_fullsized":"2024-04-26T20:56:45.278176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:41:13.015392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789491+0000","last_change":"2024-04-26T20:56:44.259808+0000","last_active":"2024-04-26T20:56:45.789491+0000","last_peered":"2024-04-26T20:56:45.789491+0000","last_clean":"2024-04-26T20:56:45.789491+0000","last_became_active":"2024-04-26T20:56:44.259170+0000","last_became_peered":"2024-04-26T20:56:44.259170+0000","last_unstale":"2024-04-26T20:56:45.789491+0000","last_undegraded":"2024-04-26T20:56:45.789491+0000","last_fullsized":"2024-04-26T20:56:45.789491+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:18:11.962630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786651+0000","last_change":"2024-04-26T20:56:40.233004+0000","last_active":"2024-04-26T20:56:45.786651+0000","last_peered":"2024-04-26T20:56:45.786651+0000","last_clean":"2024-04-26T20:56:45.786651+0000","last_became_active":"2024-04-26T20:56:40.232735+0000","last_became_peered":"2024-04-26T20:56:40.232735+0000","last_unstale":"2024-04-26T20:56:45.786651+0000","last_undegraded":"2024-04-26T20:56:45.786651+0000","last_fullsized":"2024-04-26T20:56:45.786651+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:32:02.092294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786874+0000","last_change":"2024-04-26T20:56:39.224061+0000","last_active":"2024-04-26T20:56:45.786874+0000","last_peered":"2024-04-26T20:56:45.786874+0000","last_clean":"2024-04-26T20:56:45.786874+0000","last_became_active":"2024-04-26T20:56:39.223790+0000","last_became_peered":"2024-04-26T20:56:39.223790+0000","last_unstale":"2024-04-26T20:56:45.786874+0000","last_undegraded":"2024-04-26T20:56:45.786874+0000","last_fullsized":"2024-04-26T20:56:45.786874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:14:11.313606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.790509+0000","last_change":"2024-04-26T20:56:44.269183+0000","last_active":"2024-04-26T20:56:45.790509+0000","last_peered":"2024-04-26T20:56:45.790509+0000","last_clean":"2024-04-26T20:56:45.790509+0000","last_became_active":"2024-04-26T20:56:44.266986+0000","last_became_peered":"2024-04-26T20:56:44.266986+0000","last_unstale":"2024-04-26T20:56:45.790509+0000","last_undegraded":"2024-04-26T20:56:45.790509+0000","last_fullsized":"2024-04-26T20:56:45.790509+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:50:30.081888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788704+0000","last_change":"2024-04-26T20:56:40.245751+0000","last_active":"2024-04-26T20:56:45.788704+0000","last_peered":"2024-04-26T20:56:45.788704+0000","last_clean":"2024-04-26T20:56:45.788704+0000","last_became_active":"2024-04-26T20:56:40.245369+0000","last_became_peered":"2024-04-26T20:56:40.245369+0000","last_unstale":"2024-04-26T20:56:45.788704+0000","last_undegraded":"2024-04-26T20:56:45.788704+0000","last_fullsized":"2024-04-26T20:56:45.788704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:59.357459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.281500+0000","last_change":"2024-04-26T20:56:39.225785+0000","last_active":"2024-04-26T20:56:45.281500+0000","last_peered":"2024-04-26T20:56:45.281500+0000","last_clean":"2024-04-26T20:56:45.281500+0000","last_became_active":"2024-04-26T20:56:39.225542+0000","last_became_peered":"2024-04-26T20:56:39.225542+0000","last_unstale":"2024-04-26T20:56:45.281500+0000","last_undegraded":"2024-04-26T20:56:45.281500+0000","last_fullsized":"2024-04-26T20:56:45.281500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:03:29.476982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.787074+0000","last_change":"2024-04-26T20:56:44.253303+0000","last_active":"2024-04-26T20:56:45.787074+0000","last_peered":"2024-04-26T20:56:45.787074+0000","last_clean":"2024-04-26T20:56:45.787074+0000","last_became_active":"2024-04-26T20:56:44.252962+0000","last_became_peered":"2024-04-26T20:56:44.252962+0000","last_unstale":"2024-04-26T20:56:45.787074+0000","last_undegraded":"2024-04-26T20:56:45.787074+0000","last_fullsized":"2024-04-26T20:56:45.787074+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:51:16.305273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278531+0000","last_change":"2024-04-26T20:56:40.242121+0000","last_active":"2024-04-26T20:56:45.278531+0000","last_peered":"2024-04-26T20:56:45.278531+0000","last_clean":"2024-04-26T20:56:45.278531+0000","last_became_active":"2024-04-26T20:56:40.241861+0000","last_became_peered":"2024-04-26T20:56:40.241861+0000","last_unstale":"2024-04-26T20:56:45.278531+0000","last_undegraded":"2024-04-26T20:56:45.278531+0000","last_fullsized":"2024-04-26T20:56:45.278531+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:11:49.558212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'10","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:55.394552+0000","last_change":"2024-04-26T20:56:39.215684+0000","last_active":"2024-04-26T20:56:55.394552+0000","last_peered":"2024-04-26T20:56:55.394552+0000","last_clean":"2024-04-26T20:56:55.394552+0000","last_became_active":"2024-04-26T20:56:39.215414+0000","last_became_peered":"2024-04-26T20:56:39.215414+0000","last_unstale":"2024-04-26T20:56:55.394552+0000","last_undegraded":"2024-04-26T20:56:55.394552+0000","last_fullsized":"2024-04-26T20:56:55.394552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:19:34.743821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789857+0000","last_change":"2024-04-26T20:56:44.268455+0000","last_active":"2024-04-26T20:56:45.789857+0000","last_peered":"2024-04-26T20:56:45.789857+0000","last_clean":"2024-04-26T20:56:45.789857+0000","last_became_active":"2024-04-26T20:56:44.267050+0000","last_became_peered":"2024-04-26T20:56:44.267050+0000","last_unstale":"2024-04-26T20:56:45.789857+0000","last_undegraded":"2024-04-26T20:56:45.789857+0000","last_fullsized":"2024-04-26T20:56:45.789857+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:53:37.753988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786653+0000","last_change":"2024-04-26T20:56:40.234863+0000","last_active":"2024-04-26T20:56:45.786653+0000","last_peered":"2024-04-26T20:56:45.786653+0000","last_clean":"2024-04-26T20:56:45.786653+0000","last_became_active":"2024-04-26T20:56:40.233643+0000","last_became_peered":"2024-04-26T20:56:40.233643+0000","last_unstale":"2024-04-26T20:56:45.786653+0000","last_undegraded":"2024-04-26T20:56:45.786653+0000","last_fullsized":"2024-04-26T20:56:45.786653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:33:12.507172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.281206+0000","last_change":"2024-04-26T20:56:39.226868+0000","last_active":"2024-04-26T20:56:45.281206+0000","last_peered":"2024-04-26T20:56:45.281206+0000","last_clean":"2024-04-26T20:56:45.281206+0000","last_became_active":"2024-04-26T20:56:39.224374+0000","last_became_peered":"2024-04-26T20:56:39.224374+0000","last_unstale":"2024-04-26T20:56:45.281206+0000","last_undegraded":"2024-04-26T20:56:45.281206+0000","last_fullsized":"2024-04-26T20:56:45.281206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:14:14.002707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.280149+0000","last_change":"2024-04-26T20:56:44.267204+0000","last_active":"2024-04-26T20:56:45.280149+0000","last_peered":"2024-04-26T20:56:45.280149+0000","last_clean":"2024-04-26T20:56:45.280149+0000","last_became_active":"2024-04-26T20:56:44.265067+0000","last_became_peered":"2024-04-26T20:56:44.265067+0000","last_unstale":"2024-04-26T20:56:45.280149+0000","last_undegraded":"2024-04-26T20:56:45.280149+0000","last_fullsized":"2024-04-26T20:56:45.280149+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:33.745752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789404+0000","last_change":"2024-04-26T20:56:40.250180+0000","last_active":"2024-04-26T20:56:45.789404+0000","last_peered":"2024-04-26T20:56:45.789404+0000","last_clean":"2024-04-26T20:56:45.789404+0000","last_became_active":"2024-04-26T20:56:40.241673+0000","last_became_peered":"2024-04-26T20:56:40.241673+0000","last_unstale":"2024-04-26T20:56:45.789404+0000","last_undegraded":"2024-04-26T20:56:45.789404+0000","last_fullsized":"2024-04-26T20:56:45.789404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:43:17.208658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278532+0000","last_change":"2024-04-26T20:56:39.212686+0000","last_active":"2024-04-26T20:56:45.278532+0000","last_peered":"2024-04-26T20:56:45.278532+0000","last_clean":"2024-04-26T20:56:45.278532+0000","last_became_active":"2024-04-26T20:56:39.211596+0000","last_became_peered":"2024-04-26T20:56:39.211596+0000","last_unstale":"2024-04-26T20:56:45.278532+0000","last_undegraded":"2024-04-26T20:56:45.278532+0000","last_fullsized":"2024-04-26T20:56:45.278532+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:40:48.839377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.280382+0000","last_change":"2024-04-26T20:56:44.271569+0000","last_active":"2024-04-26T20:56:45.280382+0000","last_peered":"2024-04-26T20:56:45.280382+0000","last_clean":"2024-04-26T20:56:45.280382+0000","last_became_active":"2024-04-26T20:56:44.271199+0000","last_became_peered":"2024-04-26T20:56:44.271199+0000","last_unstale":"2024-04-26T20:56:45.280382+0000","last_undegraded":"2024-04-26T20:56:45.280382+0000","last_fullsized":"2024-04-26T20:56:45.280382+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:03.397241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.280443+0000","last_change":"2024-04-26T20:56:40.218097+0000","last_active":"2024-04-26T20:56:45.280443+0000","last_peered":"2024-04-26T20:56:45.280443+0000","last_clean":"2024-04-26T20:56:45.280443+0000","last_became_active":"2024-04-26T20:56:40.217279+0000","last_became_peered":"2024-04-26T20:56:40.217279+0000","last_unstale":"2024-04-26T20:56:45.280443+0000","last_undegraded":"2024-04-26T20:56:45.280443+0000","last_fullsized":"2024-04-26T20:56:45.280443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:31.742963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.465604+0000","last_change":"2024-04-26T20:56:39.206681+0000","last_active":"2024-04-26T20:56:45.465604+0000","last_peered":"2024-04-26T20:56:45.465604+0000","last_clean":"2024-04-26T20:56:45.465604+0000","last_became_active":"2024-04-26T20:56:39.206387+0000","last_became_peered":"2024-04-26T20:56:39.206387+0000","last_unstale":"2024-04-26T20:56:45.465604+0000","last_undegraded":"2024-04-26T20:56:45.465604+0000","last_fullsized":"2024-04-26T20:56:45.465604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:41:13.015392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788775+0000","last_change":"2024-04-26T20:56:44.272225+0000","last_active":"2024-04-26T20:56:45.788775+0000","last_peered":"2024-04-26T20:56:45.788775+0000","last_clean":"2024-04-26T20:56:45.788775+0000","last_became_active":"2024-04-26T20:56:44.268540+0000","last_became_peered":"2024-04-26T20:56:44.268540+0000","last_unstale":"2024-04-26T20:56:45.788775+0000","last_undegraded":"2024-04-26T20:56:45.788775+0000","last_fullsized":"2024-04-26T20:56:45.788775+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:20:27.945065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789725+0000","last_change":"2024-04-26T20:56:44.270140+0000","last_active":"2024-04-26T20:56:45.789725+0000","last_peered":"2024-04-26T20:56:45.789725+0000","last_clean":"2024-04-26T20:56:45.789725+0000","last_became_active":"2024-04-26T20:56:44.269804+0000","last_became_peered":"2024-04-26T20:56:44.269804+0000","last_unstale":"2024-04-26T20:56:45.789725+0000","last_undegraded":"2024-04-26T20:56:45.789725+0000","last_fullsized":"2024-04-26T20:56:45.789725+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:56:25.438566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788888+0000","last_change":"2024-04-26T20:56:40.242067+0000","last_active":"2024-04-26T20:56:45.788888+0000","last_peered":"2024-04-26T20:56:45.788888+0000","last_clean":"2024-04-26T20:56:45.788888+0000","last_became_active":"2024-04-26T20:56:40.241730+0000","last_became_peered":"2024-04-26T20:56:40.241730+0000","last_unstale":"2024-04-26T20:56:45.788888+0000","last_undegraded":"2024-04-26T20:56:45.788888+0000","last_fullsized":"2024-04-26T20:56:45.788888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:30:32.775766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786403+0000","last_change":"2024-04-26T20:56:39.224756+0000","last_active":"2024-04-26T20:56:45.786403+0000","last_peered":"2024-04-26T20:56:45.786403+0000","last_clean":"2024-04-26T20:56:45.786403+0000","last_became_active":"2024-04-26T20:56:39.224355+0000","last_became_peered":"2024-04-26T20:56:39.224355+0000","last_unstale":"2024-04-26T20:56:45.786403+0000","last_undegraded":"2024-04-26T20:56:45.786403+0000","last_fullsized":"2024-04-26T20:56:45.786403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:10:57.721766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.787013+0000","last_change":"2024-04-26T20:56:44.259652+0000","last_active":"2024-04-26T20:56:45.787013+0000","last_peered":"2024-04-26T20:56:45.787013+0000","last_clean":"2024-04-26T20:56:45.787013+0000","last_became_active":"2024-04-26T20:56:44.259253+0000","last_became_peered":"2024-04-26T20:56:44.259253+0000","last_unstale":"2024-04-26T20:56:45.787013+0000","last_undegraded":"2024-04-26T20:56:45.787013+0000","last_fullsized":"2024-04-26T20:56:45.787013+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:34:23.113242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788223+0000","last_change":"2024-04-26T20:56:40.252069+0000","last_active":"2024-04-26T20:56:45.788223+0000","last_peered":"2024-04-26T20:56:45.788223+0000","last_clean":"2024-04-26T20:56:45.788223+0000","last_became_active":"2024-04-26T20:56:40.251800+0000","last_became_peered":"2024-04-26T20:56:40.251800+0000","last_unstale":"2024-04-26T20:56:45.788223+0000","last_undegraded":"2024-04-26T20:56:45.788223+0000","last_fullsized":"2024-04-26T20:56:45.788223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:50:26.042106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789011+0000","last_change":"2024-04-26T20:56:39.222979+0000","last_active":"2024-04-26T20:56:45.789011+0000","last_peered":"2024-04-26T20:56:45.789011+0000","last_clean":"2024-04-26T20:56:45.789011+0000","last_became_active":"2024-04-26T20:56:39.222514+0000","last_became_peered":"2024-04-26T20:56:39.222514+0000","last_unstale":"2024-04-26T20:56:45.789011+0000","last_undegraded":"2024-04-26T20:56:45.789011+0000","last_fullsized":"2024-04-26T20:56:45.789011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:03:29.476982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786759+0000","last_change":"2024-04-26T20:56:39.229726+0000","last_active":"2024-04-26T20:56:45.786759+0000","last_peered":"2024-04-26T20:56:45.786759+0000","last_clean":"2024-04-26T20:56:45.786759+0000","last_became_active":"2024-04-26T20:56:39.228823+0000","last_became_peered":"2024-04-26T20:56:39.228823+0000","last_unstale":"2024-04-26T20:56:45.786759+0000","last_undegraded":"2024-04-26T20:56:45.786759+0000","last_fullsized":"2024-04-26T20:56:45.786759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:45.701878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788829+0000","last_change":"2024-04-26T20:56:40.237552+0000","last_active":"2024-04-26T20:56:45.788829+0000","last_peered":"2024-04-26T20:56:45.788829+0000","last_clean":"2024-04-26T20:56:45.788829+0000","last_became_active":"2024-04-26T20:56:40.234148+0000","last_became_peered":"2024-04-26T20:56:40.234148+0000","last_unstale":"2024-04-26T20:56:45.788829+0000","last_undegraded":"2024-04-26T20:56:45.788829+0000","last_fullsized":"2024-04-26T20:56:45.788829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:05:09.050038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789111+0000","last_change":"2024-04-26T20:56:44.268137+0000","last_active":"2024-04-26T20:56:45.789111+0000","last_peered":"2024-04-26T20:56:45.789111+0000","last_clean":"2024-04-26T20:56:45.789111+0000","last_became_active":"2024-04-26T20:56:44.267618+0000","last_became_peered":"2024-04-26T20:56:44.267618+0000","last_unstale":"2024-04-26T20:56:45.789111+0000","last_undegraded":"2024-04-26T20:56:45.789111+0000","last_fullsized":"2024-04-26T20:56:45.789111+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:47:30.881003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788498+0000","last_change":"2024-04-26T20:56:39.219724+0000","last_active":"2024-04-26T20:56:45.788498+0000","last_peered":"2024-04-26T20:56:45.788498+0000","last_clean":"2024-04-26T20:56:45.788498+0000","last_became_active":"2024-04-26T20:56:39.219485+0000","last_became_peered":"2024-04-26T20:56:39.219485+0000","last_unstale":"2024-04-26T20:56:45.788498+0000","last_undegraded":"2024-04-26T20:56:45.788498+0000","last_fullsized":"2024-04-26T20:56:45.788498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:38.180112+0000","last_clean_scrub_stamp":"2024-04-26T20:56:38.180112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:11:12.183144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.465256+0000","last_change":"2024-04-26T20:56:40.242585+0000","last_active":"2024-04-26T20:56:45.465256+0000","last_peered":"2024-04-26T20:56:45.465256+0000","last_clean":"2024-04-26T20:56:45.465256+0000","last_became_active":"2024-04-26T20:56:40.242312+0000","last_became_peered":"2024-04-26T20:56:40.242312+0000","last_unstale":"2024-04-26T20:56:45.465256+0000","last_undegraded":"2024-04-26T20:56:45.465256+0000","last_fullsized":"2024-04-26T20:56:45.465256+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:58.516368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.281033+0000","last_change":"2024-04-26T20:56:44.278669+0000","last_active":"2024-04-26T20:56:45.281033+0000","last_peered":"2024-04-26T20:56:45.281033+0000","last_clean":"2024-04-26T20:56:45.281033+0000","last_became_active":"2024-04-26T20:56:44.278144+0000","last_became_peered":"2024-04-26T20:56:44.278144+0000","last_unstale":"2024-04-26T20:56:45.281033+0000","last_undegraded":"2024-04-26T20:56:45.281033+0000","last_fullsized":"2024-04-26T20:56:45.281033+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:43.227633+0000","last_clean_scrub_stamp":"2024-04-26T20:56:43.227633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:35.050613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.279742+0000","last_change":"2024-04-26T20:56:40.239350+0000","last_active":"2024-04-26T20:56:45.279742+0000","last_peered":"2024-04-26T20:56:45.279742+0000","last_clean":"2024-04-26T20:56:45.279742+0000","last_became_active":"2024-04-26T20:56:40.238857+0000","last_became_peered":"2024-04-26T20:56:40.238857+0000","last_unstale":"2024-04-26T20:56:45.279742+0000","last_undegraded":"2024-04-26T20:56:45.279742+0000","last_fullsized":"2024-04-26T20:56:45.279742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:34.603528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.280519+0000","last_change":"2024-04-26T20:56:40.250462+0000","last_active":"2024-04-26T20:56:45.280519+0000","last_peered":"2024-04-26T20:56:45.280519+0000","last_clean":"2024-04-26T20:56:45.280519+0000","last_became_active":"2024-04-26T20:56:40.250111+0000","last_became_peered":"2024-04-26T20:56:40.250111+0000","last_unstale":"2024-04-26T20:56:45.280519+0000","last_undegraded":"2024-04-26T20:56:45.280519+0000","last_fullsized":"2024-04-26T20:56:45.280519+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:34.603528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786771+0000","last_change":"2024-04-26T20:56:40.243150+0000","last_active":"2024-04-26T20:56:45.786771+0000","last_peered":"2024-04-26T20:56:45.786771+0000","last_clean":"2024-04-26T20:56:45.786771+0000","last_became_active":"2024-04-26T20:56:40.242878+0000","last_became_peered":"2024-04-26T20:56:40.242878+0000","last_unstale":"2024-04-26T20:56:45.786771+0000","last_undegraded":"2024-04-26T20:56:45.786771+0000","last_fullsized":"2024-04-26T20:56:45.786771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:38.504120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788406+0000","last_change":"2024-04-26T20:56:40.246148+0000","last_active":"2024-04-26T20:56:45.788406+0000","last_peered":"2024-04-26T20:56:45.788406+0000","last_clean":"2024-04-26T20:56:45.788406+0000","last_became_active":"2024-04-26T20:56:40.241050+0000","last_became_peered":"2024-04-26T20:56:40.241050+0000","last_unstale":"2024-04-26T20:56:45.788406+0000","last_undegraded":"2024-04-26T20:56:45.788406+0000","last_fullsized":"2024-04-26T20:56:45.788406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:41:04.236810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.790634+0000","last_change":"2024-04-26T20:56:40.240515+0000","last_active":"2024-04-26T20:56:45.790634+0000","last_peered":"2024-04-26T20:56:45.790634+0000","last_clean":"2024-04-26T20:56:45.790634+0000","last_became_active":"2024-04-26T20:56:40.240214+0000","last_became_peered":"2024-04-26T20:56:40.240214+0000","last_unstale":"2024-04-26T20:56:45.790634+0000","last_undegraded":"2024-04-26T20:56:45.790634+0000","last_fullsized":"2024-04-26T20:56:45.790634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:07:27.066355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.790023+0000","last_change":"2024-04-26T20:56:40.237603+0000","last_active":"2024-04-26T20:56:45.790023+0000","last_peered":"2024-04-26T20:56:45.790023+0000","last_clean":"2024-04-26T20:56:45.790023+0000","last_became_active":"2024-04-26T20:56:40.237312+0000","last_became_peered":"2024-04-26T20:56:40.237312+0000","last_unstale":"2024-04-26T20:56:45.790023+0000","last_undegraded":"2024-04-26T20:56:45.790023+0000","last_fullsized":"2024-04-26T20:56:45.790023+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:31.010832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.280394+0000","last_change":"2024-04-26T20:56:40.224409+0000","last_active":"2024-04-26T20:56:45.280394+0000","last_peered":"2024-04-26T20:56:45.280394+0000","last_clean":"2024-04-26T20:56:45.280394+0000","last_became_active":"2024-04-26T20:56:40.223783+0000","last_became_peered":"2024-04-26T20:56:40.223783+0000","last_unstale":"2024-04-26T20:56:45.280394+0000","last_undegraded":"2024-04-26T20:56:45.280394+0000","last_fullsized":"2024-04-26T20:56:45.280394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:57:36.835651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789132+0000","last_change":"2024-04-26T20:56:40.247698+0000","last_active":"2024-04-26T20:56:45.789132+0000","last_peered":"2024-04-26T20:56:45.789132+0000","last_clean":"2024-04-26T20:56:45.789132+0000","last_became_active":"2024-04-26T20:56:40.247096+0000","last_became_peered":"2024-04-26T20:56:40.247096+0000","last_unstale":"2024-04-26T20:56:45.789132+0000","last_undegraded":"2024-04-26T20:56:45.789132+0000","last_fullsized":"2024-04-26T20:56:45.789132+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:20:40.427686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786399+0000","last_change":"2024-04-26T20:56:40.258240+0000","last_active":"2024-04-26T20:56:45.786399+0000","last_peered":"2024-04-26T20:56:45.786399+0000","last_clean":"2024-04-26T20:56:45.786399+0000","last_became_active":"2024-04-26T20:56:40.257922+0000","last_became_peered":"2024-04-26T20:56:40.257922+0000","last_unstale":"2024-04-26T20:56:45.786399+0000","last_undegraded":"2024-04-26T20:56:45.786399+0000","last_fullsized":"2024-04-26T20:56:45.786399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:43:17.208658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788602+0000","last_change":"2024-04-26T20:56:40.234841+0000","last_active":"2024-04-26T20:56:45.788602+0000","last_peered":"2024-04-26T20:56:45.788602+0000","last_clean":"2024-04-26T20:56:45.788602+0000","last_became_active":"2024-04-26T20:56:40.234455+0000","last_became_peered":"2024-04-26T20:56:40.234455+0000","last_unstale":"2024-04-26T20:56:45.788602+0000","last_undegraded":"2024-04-26T20:56:45.788602+0000","last_fullsized":"2024-04-26T20:56:45.788602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:03:10.550412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.465190+0000","last_change":"2024-04-26T20:56:40.236302+0000","last_active":"2024-04-26T20:56:45.465190+0000","last_peered":"2024-04-26T20:56:45.465190+0000","last_clean":"2024-04-26T20:56:45.465190+0000","last_became_active":"2024-04-26T20:56:40.236036+0000","last_became_peered":"2024-04-26T20:56:40.236036+0000","last_unstale":"2024-04-26T20:56:45.465190+0000","last_undegraded":"2024-04-26T20:56:45.465190+0000","last_fullsized":"2024-04-26T20:56:45.465190+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:41:13.644088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789474+0000","last_change":"2024-04-26T20:56:40.234738+0000","last_active":"2024-04-26T20:56:45.789474+0000","last_peered":"2024-04-26T20:56:45.789474+0000","last_clean":"2024-04-26T20:56:45.789474+0000","last_became_active":"2024-04-26T20:56:40.231985+0000","last_became_peered":"2024-04-26T20:56:40.231985+0000","last_unstale":"2024-04-26T20:56:45.789474+0000","last_undegraded":"2024-04-26T20:56:45.789474+0000","last_fullsized":"2024-04-26T20:56:45.789474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:57:53.450954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278740+0000","last_change":"2024-04-26T20:56:40.249286+0000","last_active":"2024-04-26T20:56:45.278740+0000","last_peered":"2024-04-26T20:56:45.278740+0000","last_clean":"2024-04-26T20:56:45.278740+0000","last_became_active":"2024-04-26T20:56:40.249012+0000","last_became_peered":"2024-04-26T20:56:40.249012+0000","last_unstale":"2024-04-26T20:56:45.278740+0000","last_undegraded":"2024-04-26T20:56:45.278740+0000","last_fullsized":"2024-04-26T20:56:45.278740+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:43:17.208658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.787152+0000","last_change":"2024-04-26T20:56:40.228646+0000","last_active":"2024-04-26T20:56:45.787152+0000","last_peered":"2024-04-26T20:56:45.787152+0000","last_clean":"2024-04-26T20:56:45.787152+0000","last_became_active":"2024-04-26T20:56:40.228368+0000","last_became_peered":"2024-04-26T20:56:40.228368+0000","last_unstale":"2024-04-26T20:56:45.787152+0000","last_undegraded":"2024-04-26T20:56:45.787152+0000","last_fullsized":"2024-04-26T20:56:45.787152+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:18:07.922849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.281190+0000","last_change":"2024-04-26T20:56:40.225730+0000","last_active":"2024-04-26T20:56:45.281190+0000","last_peered":"2024-04-26T20:56:45.281190+0000","last_clean":"2024-04-26T20:56:45.281190+0000","last_became_active":"2024-04-26T20:56:40.225431+0000","last_became_peered":"2024-04-26T20:56:40.225431+0000","last_unstale":"2024-04-26T20:56:45.281190+0000","last_undegraded":"2024-04-26T20:56:45.281190+0000","last_fullsized":"2024-04-26T20:56:45.281190+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:58.516368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.787104+0000","last_change":"2024-04-26T20:56:40.232831+0000","last_active":"2024-04-26T20:56:45.787104+0000","last_peered":"2024-04-26T20:56:45.787104+0000","last_clean":"2024-04-26T20:56:45.787104+0000","last_became_active":"2024-04-26T20:56:40.229977+0000","last_became_peered":"2024-04-26T20:56:40.229977+0000","last_unstale":"2024-04-26T20:56:45.787104+0000","last_undegraded":"2024-04-26T20:56:45.787104+0000","last_fullsized":"2024-04-26T20:56:45.787104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:56.469187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.786286+0000","last_change":"2024-04-26T20:56:40.222579+0000","last_active":"2024-04-26T20:56:45.786286+0000","last_peered":"2024-04-26T20:56:45.786286+0000","last_clean":"2024-04-26T20:56:45.786286+0000","last_became_active":"2024-04-26T20:56:40.222116+0000","last_became_peered":"2024-04-26T20:56:40.222116+0000","last_unstale":"2024-04-26T20:56:45.786286+0000","last_undegraded":"2024-04-26T20:56:45.786286+0000","last_fullsized":"2024-04-26T20:56:45.786286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:50:26.042106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788401+0000","last_change":"2024-04-26T20:56:40.245721+0000","last_active":"2024-04-26T20:56:45.788401+0000","last_peered":"2024-04-26T20:56:45.788401+0000","last_clean":"2024-04-26T20:56:45.788401+0000","last_became_active":"2024-04-26T20:56:40.240783+0000","last_became_peered":"2024-04-26T20:56:40.240783+0000","last_unstale":"2024-04-26T20:56:45.788401+0000","last_undegraded":"2024-04-26T20:56:45.788401+0000","last_fullsized":"2024-04-26T20:56:45.788401+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:07:27.066355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788602+0000","last_change":"2024-04-26T20:56:40.239382+0000","last_active":"2024-04-26T20:56:45.788602+0000","last_peered":"2024-04-26T20:56:45.788602+0000","last_clean":"2024-04-26T20:56:45.788602+0000","last_became_active":"2024-04-26T20:56:40.239118+0000","last_became_peered":"2024-04-26T20:56:40.239118+0000","last_unstale":"2024-04-26T20:56:45.788602+0000","last_undegraded":"2024-04-26T20:56:45.788602+0000","last_fullsized":"2024-04-26T20:56:45.788602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:46.709617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.788816+0000","last_change":"2024-04-26T20:56:40.236079+0000","last_active":"2024-04-26T20:56:45.788816+0000","last_peered":"2024-04-26T20:56:45.788816+0000","last_clean":"2024-04-26T20:56:45.788816+0000","last_became_active":"2024-04-26T20:56:40.235815+0000","last_became_peered":"2024-04-26T20:56:40.235815+0000","last_unstale":"2024-04-26T20:56:45.788816+0000","last_undegraded":"2024-04-26T20:56:45.788816+0000","last_fullsized":"2024-04-26T20:56:45.788816+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:55.117440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278710+0000","last_change":"2024-04-26T20:56:40.249327+0000","last_active":"2024-04-26T20:56:45.278710+0000","last_peered":"2024-04-26T20:56:45.278710+0000","last_clean":"2024-04-26T20:56:45.278710+0000","last_became_active":"2024-04-26T20:56:40.249079+0000","last_became_peered":"2024-04-26T20:56:40.249079+0000","last_unstale":"2024-04-26T20:56:45.278710+0000","last_undegraded":"2024-04-26T20:56:45.278710+0000","last_fullsized":"2024-04-26T20:56:45.278710+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:41:04.236810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278396+0000","last_change":"2024-04-26T20:56:40.233773+0000","last_active":"2024-04-26T20:56:45.278396+0000","last_peered":"2024-04-26T20:56:45.278396+0000","last_clean":"2024-04-26T20:56:45.278396+0000","last_became_active":"2024-04-26T20:56:40.233225+0000","last_became_peered":"2024-04-26T20:56:40.233225+0000","last_unstale":"2024-04-26T20:56:45.278396+0000","last_undegraded":"2024-04-26T20:56:45.278396+0000","last_fullsized":"2024-04-26T20:56:45.278396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:28:38.854680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278624+0000","last_change":"2024-04-26T20:56:40.227906+0000","last_active":"2024-04-26T20:56:45.278624+0000","last_peered":"2024-04-26T20:56:45.278624+0000","last_clean":"2024-04-26T20:56:45.278624+0000","last_became_active":"2024-04-26T20:56:40.227613+0000","last_became_peered":"2024-04-26T20:56:40.227613+0000","last_unstale":"2024-04-26T20:56:45.278624+0000","last_undegraded":"2024-04-26T20:56:45.278624+0000","last_fullsized":"2024-04-26T20:56:45.278624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:14:26.269699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.465600+0000","last_change":"2024-04-26T20:56:40.236919+0000","last_active":"2024-04-26T20:56:45.465600+0000","last_peered":"2024-04-26T20:56:45.465600+0000","last_clean":"2024-04-26T20:56:45.465600+0000","last_became_active":"2024-04-26T20:56:40.236544+0000","last_became_peered":"2024-04-26T20:56:40.236544+0000","last_unstale":"2024-04-26T20:56:45.465600+0000","last_undegraded":"2024-04-26T20:56:45.465600+0000","last_fullsized":"2024-04-26T20:56:45.465600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:57:36.835651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.787998+0000","last_change":"2024-04-26T20:56:40.251770+0000","last_active":"2024-04-26T20:56:45.787998+0000","last_peered":"2024-04-26T20:56:45.787998+0000","last_clean":"2024-04-26T20:56:45.787998+0000","last_became_active":"2024-04-26T20:56:40.251426+0000","last_became_peered":"2024-04-26T20:56:40.251426+0000","last_unstale":"2024-04-26T20:56:45.787998+0000","last_undegraded":"2024-04-26T20:56:45.787998+0000","last_fullsized":"2024-04-26T20:56:45.787998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:41:03.691519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278135+0000","last_change":"2024-04-26T20:56:40.227391+0000","last_active":"2024-04-26T20:56:45.278135+0000","last_peered":"2024-04-26T20:56:45.278135+0000","last_clean":"2024-04-26T20:56:45.278135+0000","last_became_active":"2024-04-26T20:56:40.226681+0000","last_became_peered":"2024-04-26T20:56:40.226681+0000","last_unstale":"2024-04-26T20:56:45.278135+0000","last_undegraded":"2024-04-26T20:56:45.278135+0000","last_fullsized":"2024-04-26T20:56:45.278135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:44:46.926225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.279941+0000","last_change":"2024-04-26T20:56:40.225067+0000","last_active":"2024-04-26T20:56:45.279941+0000","last_peered":"2024-04-26T20:56:45.279941+0000","last_clean":"2024-04-26T20:56:45.279941+0000","last_became_active":"2024-04-26T20:56:40.224764+0000","last_became_peered":"2024-04-26T20:56:40.224764+0000","last_unstale":"2024-04-26T20:56:45.279941+0000","last_undegraded":"2024-04-26T20:56:45.279941+0000","last_fullsized":"2024-04-26T20:56:45.279941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:10:58.729505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278406+0000","last_change":"2024-04-26T20:56:40.253423+0000","last_active":"2024-04-26T20:56:45.278406+0000","last_peered":"2024-04-26T20:56:45.278406+0000","last_clean":"2024-04-26T20:56:45.278406+0000","last_became_active":"2024-04-26T20:56:40.253195+0000","last_became_peered":"2024-04-26T20:56:40.253195+0000","last_unstale":"2024-04-26T20:56:45.278406+0000","last_undegraded":"2024-04-26T20:56:45.278406+0000","last_fullsized":"2024-04-26T20:56:45.278406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:24:10.292075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.280200+0000","last_change":"2024-04-26T20:56:40.225398+0000","last_active":"2024-04-26T20:56:45.280200+0000","last_peered":"2024-04-26T20:56:45.280200+0000","last_clean":"2024-04-26T20:56:45.280200+0000","last_became_active":"2024-04-26T20:56:40.225061+0000","last_became_peered":"2024-04-26T20:56:40.225061+0000","last_unstale":"2024-04-26T20:56:45.280200+0000","last_undegraded":"2024-04-26T20:56:45.280200+0000","last_fullsized":"2024-04-26T20:56:45.280200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:58.516368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789064+0000","last_change":"2024-04-26T20:56:40.248772+0000","last_active":"2024-04-26T20:56:45.789064+0000","last_peered":"2024-04-26T20:56:45.789064+0000","last_clean":"2024-04-26T20:56:45.789064+0000","last_became_active":"2024-04-26T20:56:40.240740+0000","last_became_peered":"2024-04-26T20:56:40.240740+0000","last_unstale":"2024-04-26T20:56:45.789064+0000","last_undegraded":"2024-04-26T20:56:45.789064+0000","last_fullsized":"2024-04-26T20:56:45.789064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:28:38.854680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.789550+0000","last_change":"2024-04-26T20:56:40.251885+0000","last_active":"2024-04-26T20:56:45.789550+0000","last_peered":"2024-04-26T20:56:45.789550+0000","last_clean":"2024-04-26T20:56:45.789550+0000","last_became_active":"2024-04-26T20:56:40.251578+0000","last_became_peered":"2024-04-26T20:56:40.251578+0000","last_unstale":"2024-04-26T20:56:45.789550+0000","last_undegraded":"2024-04-26T20:56:45.789550+0000","last_fullsized":"2024-04-26T20:56:45.789550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:24:10.292075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T20:56:45.278816+0000","last_change":"2024-04-26T20:56:40.235504+0000","last_active":"2024-04-26T20:56:45.278816+0000","last_peered":"2024-04-26T20:56:45.278816+0000","last_clean":"2024-04-26T20:56:45.278816+0000","last_became_active":"2024-04-26T20:56:40.234572+0000","last_became_peered":"2024-04-26T20:56:40.234572+0000","last_unstale":"2024-04-26T20:56:45.278816+0000","last_undegraded":"2024-04-26T20:56:45.278816+0000","last_fullsized":"2024-04-26T20:56:45.278816+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:39.187851+0000","last_clean_scrub_stamp":"2024-04-26T20:56:39.187851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:29.705970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":110689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":110565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":884736,"data_stored":701025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":111147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509450,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":114407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":880640,"data_stored":701003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":110621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":115079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T20:57:02.776 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T20:57:02.776 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-26T20:57:02.776 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-26T20:57:02.776 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-26T20:57:02.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.945+0000 7f202e800640 1 Processor -- start 2024-04-26T20:57:02.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.945+0000 7f202e800640 1 -- start start 2024-04-26T20:57:02.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.949+0000 7f202e800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f202806eac0 0x7f20280b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:02.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.949+0000 7f202e800640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20280d1b60 con 0x7f2028162a20 2024-04-26T20:57:02.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.949+0000 7f202e800640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20280b3230 con 0x7f20280b1d70 2024-04-26T20:57:02.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.949+0000 7f202e800640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f20280d1e40 con 0x7f202806eac0 2024-04-26T20:57:02.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.949+0000 7f201ea00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f202806eac0 0x7f20280b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:02.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.949+0000 7f2027400640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f2028162a20 0x7f20280afb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:43794/0 (socket says 172.21.15.138:43794) 2024-04-26T20:57:02.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.949+0000 7f2027400640 1 -- 172.21.15.138:0/3698378577 learned_addr learned my addr 172.21.15.138:0/3698378577 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:02.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.949+0000 7f201ea00640 1 -- 172.21.15.138:0/3698378577 >> v1:172.21.15.143:6789/0 conn(0x7f20280b1d70 legacy=0x7f20280d0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:02.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.949+0000 7f2026a00640 1 -- 172.21.15.138:0/3698378577 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 593552795 0 0) 0x7f20280d1b60 con 0x7f2028162a20 2024-04-26T20:57:02.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.949+0000 7f201ea00640 1 -- 172.21.15.138:0/3698378577 >> v1:172.21.15.138:6789/0 conn(0x7f2028162a20 legacy=0x7f20280afb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:02.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.949+0000 7f201ea00640 1 -- 172.21.15.138:0/3698378577 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20280b3510 con 0x7f202806eac0 2024-04-26T20:57:02.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.949+0000 7f201ea00640 1 --2- 172.21.15.138:0/3698378577 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f202806eac0 0x7f20280b3d10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f20100097c0 tx=0x7f201001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f24be73ee151d30 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:02.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.953+0000 7f2026a00640 1 -- 172.21.15.138:0/3698378577 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20100b0070 con 0x7f202806eac0 2024-04-26T20:57:02.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.953+0000 7f2026a00640 1 -- 172.21.15.138:0/3698378577 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20100ab600 con 0x7f202806eac0 2024-04-26T20:57:02.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.953+0000 7f2026a00640 1 -- 172.21.15.138:0/3698378577 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20100ab9d0 con 0x7f202806eac0 2024-04-26T20:57:02.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.953+0000 7f202e800640 1 -- 172.21.15.138:0/3698378577 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f202806eac0 msgr2=0x7f20280b3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:02.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.953+0000 7f202e800640 1 --2- 172.21.15.138:0/3698378577 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f202806eac0 0x7f20280b3d10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f20100097c0 tx=0x7f201001c4a0 comp rx=0 tx=0).stop 2024-04-26T20:57:02.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.953+0000 7f202e800640 1 -- 172.21.15.138:0/3698378577 shutdown_connections 2024-04-26T20:57:02.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.953+0000 7f202e800640 1 --2- 172.21.15.138:0/3698378577 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f202806eac0 0x7f20280b3d10 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:02.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.953+0000 7f202e800640 1 -- 172.21.15.138:0/3698378577 >> 172.21.15.138:0/3698378577 conn(0x7f20280d2dc0 msgr2=0x7f20280d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:02.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.953+0000 7f202e800640 1 -- 172.21.15.138:0/3698378577 shutdown_connections 2024-04-26T20:57:02.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.953+0000 7f202e800640 1 -- 172.21.15.138:0/3698378577 wait complete. 2024-04-26T20:57:02.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.953+0000 7f202e800640 1 Processor -- start 2024-04-26T20:57:02.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.953+0000 7f202e800640 1 -- start start 2024-04-26T20:57:02.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.953+0000 7f202e800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f202806eac0 0x7f2028152920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:02.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.953+0000 7f202e800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f20280b1d70 0x7f2028154580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:02.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.953+0000 7f202e800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2028162a20 0x7f2028156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:02.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.953+0000 7f202e800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f202816d9c0 con 0x7f202806eac0 2024-04-26T20:57:02.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.953+0000 7f202e800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f20280b3880 con 0x7f20280b1d70 2024-04-26T20:57:02.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.953+0000 7f202e800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f202816db40 con 0x7f2028162a20 2024-04-26T20:57:02.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.953+0000 7f2027400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f202806eac0 0x7f2028152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:02.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.953+0000 7f2027400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f202806eac0 0x7f2028152920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:57186/0 (socket says 172.21.15.138:57186) 2024-04-26T20:57:02.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.953+0000 7f2027400640 1 -- 172.21.15.138:0/4212579004 learned_addr learned my addr 172.21.15.138:0/4212579004 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:02.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.953+0000 7f2027400640 1 -- 172.21.15.138:0/4212579004 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2028162a20 msgr2=0x7f2028156a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:02.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.957+0000 7f2027400640 1 --2- 172.21.15.138:0/4212579004 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2028162a20 0x7f2028156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:02.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.957+0000 7f2027400640 1 -- 172.21.15.138:0/4212579004 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f20280b1d70 msgr2=0x7f2028154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:02.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.957+0000 7f2027400640 1 --2- 172.21.15.138:0/4212579004 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f20280b1d70 0x7f2028154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:02.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.957+0000 7f2027400640 1 -- 172.21.15.138:0/4212579004 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20280ca300 con 0x7f202806eac0 2024-04-26T20:57:02.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.957+0000 7f2027400640 1 --2- 172.21.15.138:0/4212579004 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f202806eac0 0x7f2028152920 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f201800c440 tx=0x7f201800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:02.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.957+0000 7f201fe00640 1 -- 172.21.15.138:0/4212579004 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2018018070 con 0x7f202806eac0 2024-04-26T20:57:02.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.957+0000 7f201fe00640 1 -- 172.21.15.138:0/4212579004 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20180074e0 con 0x7f202806eac0 2024-04-26T20:57:02.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.957+0000 7f201fe00640 1 -- 172.21.15.138:0/4212579004 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2018004a10 con 0x7f202806eac0 2024-04-26T20:57:02.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.957+0000 7f202e800640 1 -- 172.21.15.138:0/4212579004 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20280cccf0 con 0x7f202806eac0 2024-04-26T20:57:02.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.957+0000 7f202e800640 1 -- 172.21.15.138:0/4212579004 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2028155050 con 0x7f202806eac0 2024-04-26T20:57:02.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.957+0000 7f202e800640 1 -- 172.21.15.138:0/4212579004 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2028069510 con 0x7f202806eac0 2024-04-26T20:57:02.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.957+0000 7f201fe00640 1 -- 172.21.15.138:0/4212579004 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f201801b070 con 0x7f202806eac0 2024-04-26T20:57:02.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.957+0000 7f201fe00640 1 --2- 172.21.15.138:0/4212579004 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f2004068380 0x7f200406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:02.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.957+0000 7f201fe00640 1 -- 172.21.15.138:0/4212579004 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f2018085f90 con 0x7f202806eac0 2024-04-26T20:57:02.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.957+0000 7f201ea00640 1 --2- 172.21.15.138:0/4212579004 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f2004068380 0x7f200406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:02.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.961+0000 7f201ea00640 1 --2- 172.21.15.138:0/4212579004 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f2004068380 0x7f200406a840 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f20100ad000 tx=0x7f2010004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:02.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:02.961+0000 7f201fe00640 1 -- 172.21.15.138:0/4212579004 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2018056210 con 0x7f202806eac0 2024-04-26T20:57:03.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.153+0000 7f202e800640 1 -- 172.21.15.138:0/4212579004 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f20280b2eb0 con 0x7f202806eac0 2024-04-26T20:57:03.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.153+0000 7f201fe00640 1 -- 172.21.15.138:0/4212579004 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f2018055b10 con 0x7f202806eac0 2024-04-26T20:57:03.156 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:57:03.156 INFO:teuthology.orchestra.run.smithi138.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-26T20:57:03.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.153+0000 7f202e800640 1 -- 172.21.15.138:0/4212579004 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f2004068380 msgr2=0x7f200406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:03.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.153+0000 7f202e800640 1 --2- 172.21.15.138:0/4212579004 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f2004068380 0x7f200406a840 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f20100ad000 tx=0x7f2010004740 comp rx=0 tx=0).stop 2024-04-26T20:57:03.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.153+0000 7f202e800640 1 -- 172.21.15.138:0/4212579004 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f202806eac0 msgr2=0x7f2028152920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:03.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.153+0000 7f202e800640 1 --2- 172.21.15.138:0/4212579004 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f202806eac0 0x7f2028152920 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f201800c440 tx=0x7f201800c900 comp rx=0 tx=0).stop 2024-04-26T20:57:03.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.153+0000 7f202e800640 1 -- 172.21.15.138:0/4212579004 shutdown_connections 2024-04-26T20:57:03.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.153+0000 7f202e800640 1 --2- 172.21.15.138:0/4212579004 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f2004068380 0x7f200406a840 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:03.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.153+0000 7f202e800640 1 --2- 172.21.15.138:0/4212579004 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2028162a20 0x7f2028156a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:03.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.153+0000 7f202e800640 1 --2- 172.21.15.138:0/4212579004 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f20280b1d70 0x7f2028154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:03.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.153+0000 7f202e800640 1 --2- 172.21.15.138:0/4212579004 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f202806eac0 0x7f2028152920 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:03.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.153+0000 7f202e800640 1 -- 172.21.15.138:0/4212579004 >> 172.21.15.138:0/4212579004 conn(0x7f20280d2dc0 msgr2=0x7f2028071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:03.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.153+0000 7f202e800640 1 -- 172.21.15.138:0/4212579004 shutdown_connections 2024-04-26T20:57:03.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.153+0000 7f202e800640 1 -- 172.21.15.138:0/4212579004 wait complete. 2024-04-26T20:57:03.177 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-26T20:57:03.177 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:57:03.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.313+0000 7fbc6da00640 1 Processor -- start 2024-04-26T20:57:03.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.313+0000 7fbc6da00640 1 -- start start 2024-04-26T20:57:03.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.313+0000 7fbc6da00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fbc680b2280 0x7fbc680b2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:03.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.313+0000 7fbc6da00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc680ce540 con 0x7fbc6815d0f0 2024-04-26T20:57:03.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.313+0000 7fbc6da00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc680ce820 con 0x7fbc680d1720 2024-04-26T20:57:03.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.313+0000 7fbc6da00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fbc680d0e50 con 0x7fbc680b2280 2024-04-26T20:57:03.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.313+0000 7fbc66a00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fbc6815d0f0 0x7fbc680d1010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:43800/0 (socket says 172.21.15.138:43800) 2024-04-26T20:57:03.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.313+0000 7fbc66a00640 1 -- 172.21.15.138:0/2131260231 learned_addr learned my addr 172.21.15.138:0/2131260231 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:03.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.313+0000 7fbc66000640 1 --2- 172.21.15.138:0/2131260231 >> v2:172.21.15.143:3300/0 conn(0x7fbc680b2280 0x7fbc680b2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:03.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.313+0000 7fbc65600640 1 -- 172.21.15.138:0/2131260231 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2092477025 0 0) 0x7fbc680ce540 con 0x7fbc6815d0f0 2024-04-26T20:57:03.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.313+0000 7fbc65600640 1 -- 172.21.15.138:0/2131260231 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc4c003530 con 0x7fbc6815d0f0 2024-04-26T20:57:03.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.313+0000 7fbc66000640 1 -- 172.21.15.138:0/2131260231 >> v1:172.21.15.143:6789/0 conn(0x7fbc680d1720 legacy=0x7fbc680b30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:03.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.313+0000 7fbc66000640 1 -- 172.21.15.138:0/2131260231 >> v1:172.21.15.138:6789/0 conn(0x7fbc6815d0f0 legacy=0x7fbc680d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:03.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.313+0000 7fbc66000640 1 -- 172.21.15.138:0/2131260231 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc680ceb00 con 0x7fbc680b2280 2024-04-26T20:57:03.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.317+0000 7fbc66000640 1 --2- 172.21.15.138:0/2131260231 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbc680b2280 0x7fbc680b2b70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbc540097c0 tx=0x7fbc5401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4da63077fcd8c0ef server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:03.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.317+0000 7fbc65600640 1 -- 172.21.15.138:0/2131260231 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc540b0070 con 0x7fbc680b2280 2024-04-26T20:57:03.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.317+0000 7fbc65600640 1 -- 172.21.15.138:0/2131260231 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc540ab600 con 0x7fbc680b2280 2024-04-26T20:57:03.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.317+0000 7fbc65600640 1 -- 172.21.15.138:0/2131260231 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc540ab9b0 con 0x7fbc680b2280 2024-04-26T20:57:03.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.317+0000 7fbc6da00640 1 -- 172.21.15.138:0/2131260231 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbc680b2280 msgr2=0x7fbc680b2b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:03.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.317+0000 7fbc6da00640 1 --2- 172.21.15.138:0/2131260231 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbc680b2280 0x7fbc680b2b70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbc540097c0 tx=0x7fbc5401c4a0 comp rx=0 tx=0).stop 2024-04-26T20:57:03.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.317+0000 7fbc6da00640 1 -- 172.21.15.138:0/2131260231 shutdown_connections 2024-04-26T20:57:03.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.317+0000 7fbc6da00640 1 --2- 172.21.15.138:0/2131260231 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbc680b2280 0x7fbc680b2b70 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:03.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.317+0000 7fbc6da00640 1 -- 172.21.15.138:0/2131260231 >> 172.21.15.138:0/2131260231 conn(0x7fbc680d2d80 msgr2=0x7fbc680d3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:03.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.317+0000 7fbc6da00640 1 -- 172.21.15.138:0/2131260231 shutdown_connections 2024-04-26T20:57:03.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.317+0000 7fbc6da00640 1 -- 172.21.15.138:0/2131260231 wait complete. 2024-04-26T20:57:03.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.321+0000 7fbc6da00640 1 Processor -- start 2024-04-26T20:57:03.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.321+0000 7fbc6da00640 1 -- start start 2024-04-26T20:57:03.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.321+0000 7fbc6da00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc680b2280 0x7fbc68155550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:03.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.321+0000 7fbc6da00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbc680d1720 0x7fbc680c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:03.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.321+0000 7fbc6da00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbc6815d0f0 0x7fbc680cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:03.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.321+0000 7fbc6da00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fbc6816b050 con 0x7fbc680b2280 2024-04-26T20:57:03.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.321+0000 7fbc6da00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fbc6816aed0 con 0x7fbc6815d0f0 2024-04-26T20:57:03.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.321+0000 7fbc6da00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fbc6816b1d0 con 0x7fbc680d1720 2024-04-26T20:57:03.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.321+0000 7fbc66a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc680b2280 0x7fbc68155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:03.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.321+0000 7fbc66a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc680b2280 0x7fbc68155550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:57192/0 (socket says 172.21.15.138:57192) 2024-04-26T20:57:03.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.321+0000 7fbc66a00640 1 -- 172.21.15.138:0/508907859 learned_addr learned my addr 172.21.15.138:0/508907859 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:03.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.321+0000 7fbc66000640 1 --2- 172.21.15.138:0/508907859 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbc680d1720 0x7fbc680c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:03.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.321+0000 7fbc67400640 1 --2- 172.21.15.138:0/508907859 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbc6815d0f0 0x7fbc680cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:03.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.321+0000 7fbc66a00640 1 -- 172.21.15.138:0/508907859 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbc680d1720 msgr2=0x7fbc680c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:03.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.321+0000 7fbc66a00640 1 --2- 172.21.15.138:0/508907859 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbc680d1720 0x7fbc680c82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:03.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.321+0000 7fbc66a00640 1 -- 172.21.15.138:0/508907859 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbc6815d0f0 msgr2=0x7fbc680cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:03.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.321+0000 7fbc66a00640 1 --2- 172.21.15.138:0/508907859 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbc6815d0f0 0x7fbc680cbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:03.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.321+0000 7fbc66a00640 1 -- 172.21.15.138:0/508907859 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc680cc580 con 0x7fbc680b2280 2024-04-26T20:57:03.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.321+0000 7fbc67400640 1 --2- 172.21.15.138:0/508907859 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbc6815d0f0 0x7fbc680cbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:03.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.321+0000 7fbc66a00640 1 --2- 172.21.15.138:0/508907859 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc680b2280 0x7fbc68155550 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbc5800c4d0 tx=0x7fbc5800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:03.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.321+0000 7fbc5ea00640 1 -- 172.21.15.138:0/508907859 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc58017070 con 0x7fbc680b2280 2024-04-26T20:57:03.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.321+0000 7fbc5ea00640 1 -- 172.21.15.138:0/508907859 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc58005cf0 con 0x7fbc680b2280 2024-04-26T20:57:03.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.321+0000 7fbc5ea00640 1 -- 172.21.15.138:0/508907859 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc58007270 con 0x7fbc680b2280 2024-04-26T20:57:03.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.321+0000 7fbc6da00640 1 -- 172.21.15.138:0/508907859 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc680c7810 con 0x7fbc680b2280 2024-04-26T20:57:03.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.321+0000 7fbc6da00640 1 -- 172.21.15.138:0/508907859 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc680c7dd0 con 0x7fbc680b2280 2024-04-26T20:57:03.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.325+0000 7fbc6da00640 1 -- 172.21.15.138:0/508907859 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc68069510 con 0x7fbc680b2280 2024-04-26T20:57:03.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.325+0000 7fbc5ea00640 1 -- 172.21.15.138:0/508907859 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbc5801a070 con 0x7fbc680b2280 2024-04-26T20:57:03.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.325+0000 7fbc5ea00640 1 --2- 172.21.15.138:0/508907859 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fbc480683b0 0x7fbc4806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:03.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.325+0000 7fbc5ea00640 1 -- 172.21.15.138:0/508907859 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fbc58086110 con 0x7fbc680b2280 2024-04-26T20:57:03.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.325+0000 7fbc66000640 1 --2- 172.21.15.138:0/508907859 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fbc480683b0 0x7fbc4806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:03.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.325+0000 7fbc66000640 1 --2- 172.21.15.138:0/508907859 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fbc480683b0 0x7fbc4806a870 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbc540ad000 tx=0x7fbc540a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:03.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.329+0000 7fbc5ea00640 1 -- 172.21.15.138:0/508907859 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fbc58055c10 con 0x7fbc680b2280 2024-04-26T20:57:03.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.489+0000 7fbc6da00640 1 -- 172.21.15.138:0/508907859 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbc6806df80 con 0x7fbc680b2280 2024-04-26T20:57:03.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.489+0000 7fbc5ea00640 1 -- 172.21.15.138:0/508907859 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18578 (secure 0 0 0) 0x7fbc58059f10 con 0x7fbc680b2280 2024-04-26T20:57:03.495 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:57:03.495 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":27,"fsid":"c22b4730-12cc-4558-8535-b965384398c0","created":"2024-04-26T20:56:14.182475+0000","modified":"2024-04-26T20:56:44.633968+0000","last_up_change":"2024-04-26T20:56:26.013243+0000","last_in_change":"2024-04-26T20:56:16.714055+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:56:27.265834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:56:37.394398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:56:38.544369+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:56:42.240243+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3f9a2e34-3199-466f-a6cf-57927318121e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6801","nonce":3534772245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6803","nonce":3534772245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6807","nonce":3534772245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6805","nonce":3534772245}]},"public_addr":"172.21.15.138:6801/3534772245","cluster_addr":"172.21.15.138:6803/3534772245","heartbeat_back_addr":"172.21.15.138:6807/3534772245","heartbeat_front_addr":"172.21.15.138:6805/3534772245","state":["exists","up"]},{"osd":1,"uuid":"e881fcf6-3248-4696-a2ef-95d206d77712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6817","nonce":1427635773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6819","nonce":1427635773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6823","nonce":1427635773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6821","nonce":1427635773}]},"public_addr":"172.21.15.138:6817/1427635773","cluster_addr":"172.21.15.138:6819/1427635773","heartbeat_back_addr":"172.21.15.138:6823/1427635773","heartbeat_front_addr":"172.21.15.138:6821/1427635773","state":["exists","up"]},{"osd":2,"uuid":"f7d1db33-7672-4699-ae47-9f1e0a8e4222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6809","nonce":4273721573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6811","nonce":4273721573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6815","nonce":4273721573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6813","nonce":4273721573}]},"public_addr":"172.21.15.138:6809/4273721573","cluster_addr":"172.21.15.138:6811/4273721573","heartbeat_back_addr":"172.21.15.138:6815/4273721573","heartbeat_front_addr":"172.21.15.138:6813/4273721573","state":["exists","up"]},{"osd":3,"uuid":"2f4e0a9a-b8f6-4468-844a-a4501cd85054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6825","nonce":3098242154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6827","nonce":3098242154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6831","nonce":3098242154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6829","nonce":3098242154}]},"public_addr":"172.21.15.138:6825/3098242154","cluster_addr":"172.21.15.138:6827/3098242154","heartbeat_back_addr":"172.21.15.138:6831/3098242154","heartbeat_front_addr":"172.21.15.138:6829/3098242154","state":["exists","up"]},{"osd":4,"uuid":"c85df99b-3624-410e-866b-86830af2cfe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6801","nonce":2942056312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6803","nonce":2942056312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6807","nonce":2942056312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6805","nonce":2942056312}]},"public_addr":"172.21.15.143:6801/2942056312","cluster_addr":"172.21.15.143:6803/2942056312","heartbeat_back_addr":"172.21.15.143:6807/2942056312","heartbeat_front_addr":"172.21.15.143:6805/2942056312","state":["exists","up"]},{"osd":5,"uuid":"9af1efb5-c416-4808-b5ef-de0679ab9705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6809","nonce":1910222887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6811","nonce":1910222887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6815","nonce":1910222887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6813","nonce":1910222887}]},"public_addr":"172.21.15.143:6809/1910222887","cluster_addr":"172.21.15.143:6811/1910222887","heartbeat_back_addr":"172.21.15.143:6815/1910222887","heartbeat_front_addr":"172.21.15.143:6813/1910222887","state":["exists","up"]},{"osd":6,"uuid":"d7138615-8838-45ff-9072-2fd0683362f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6817","nonce":1082239825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6819","nonce":1082239825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6823","nonce":1082239825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6821","nonce":1082239825}]},"public_addr":"172.21.15.143:6817/1082239825","cluster_addr":"172.21.15.143:6819/1082239825","heartbeat_back_addr":"172.21.15.143:6823/1082239825","heartbeat_front_addr":"172.21.15.143:6821/1082239825","state":["exists","up"]},{"osd":7,"uuid":"0c27172b-35c4-49ec-ba0b-0137b8ff0010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6825","nonce":3295508495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6827","nonce":3295508495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6831","nonce":3295508495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6829","nonce":3295508495}]},"public_addr":"172.21.15.143:6825/3295508495","cluster_addr":"172.21.15.143:6827/3295508495","heartbeat_back_addr":"172.21.15.143:6831/3295508495","heartbeat_front_addr":"172.21.15.143:6829/3295508495","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.326627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.396119+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.433915+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.414179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.216947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.329272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.503073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.436382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:57:03.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.493+0000 7fbc6da00640 1 -- 172.21.15.138:0/508907859 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fbc480683b0 msgr2=0x7fbc4806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:03.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.493+0000 7fbc6da00640 1 --2- 172.21.15.138:0/508907859 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fbc480683b0 0x7fbc4806a870 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbc540ad000 tx=0x7fbc540a6000 comp rx=0 tx=0).stop 2024-04-26T20:57:03.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.493+0000 7fbc6da00640 1 -- 172.21.15.138:0/508907859 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc680b2280 msgr2=0x7fbc68155550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:03.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.493+0000 7fbc6da00640 1 --2- 172.21.15.138:0/508907859 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc680b2280 0x7fbc68155550 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbc5800c4d0 tx=0x7fbc5800c990 comp rx=0 tx=0).stop 2024-04-26T20:57:03.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.493+0000 7fbc6da00640 1 -- 172.21.15.138:0/508907859 shutdown_connections 2024-04-26T20:57:03.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.493+0000 7fbc6da00640 1 --2- 172.21.15.138:0/508907859 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fbc480683b0 0x7fbc4806a870 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:03.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.493+0000 7fbc6da00640 1 --2- 172.21.15.138:0/508907859 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbc6815d0f0 0x7fbc680cbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:03.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.493+0000 7fbc6da00640 1 --2- 172.21.15.138:0/508907859 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbc680d1720 0x7fbc680c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:03.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.493+0000 7fbc6da00640 1 --2- 172.21.15.138:0/508907859 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc680b2280 0x7fbc68155550 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:03.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.493+0000 7fbc6da00640 1 -- 172.21.15.138:0/508907859 >> 172.21.15.138:0/508907859 conn(0x7fbc680d2d80 msgr2=0x7fbc680d3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:03.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.493+0000 7fbc6da00640 1 -- 172.21.15.138:0/508907859 shutdown_connections 2024-04-26T20:57:03.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.493+0000 7fbc6da00640 1 -- 172.21.15.138:0/508907859 wait complete. 2024-04-26T20:57:03.517 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:56:27.265834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T20:56:37.394398+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T20:56:38.544369+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T20:56:42.240243+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T20:57:03.517 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T20:57:03.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.649+0000 7f4ed2c00640 1 Processor -- start 2024-04-26T20:57:03.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.649+0000 7f4ed2c00640 1 -- start start 2024-04-26T20:57:03.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.653+0000 7f4ed2c00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4ecc15e180 0x7f4ecc0cb200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:03.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.653+0000 7f4ed2c00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4ecc0cb740 0x7f4ecc0b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:03.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.653+0000 7f4ed2c00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ecc0cd210 con 0x7f4ecc15aa60 2024-04-26T20:57:03.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.653+0000 7f4ed2c00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f4ecc15d6a0 con 0x7f4ecc15e180 2024-04-26T20:57:03.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.653+0000 7f4ed2c00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f4ecc15d980 con 0x7f4ecc0cb740 2024-04-26T20:57:03.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.653+0000 7f4ec3400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4ecc15e180 0x7f4ecc0cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:03.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.653+0000 7f4ecbe00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f4ecc15aa60 0x7f4ecc0cc7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:37756/0 (socket says 172.21.15.138:37756) 2024-04-26T20:57:03.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.653+0000 7f4ec3400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4ecc15e180 0x7f4ecc0cb200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:57998/0 (socket says 172.21.15.138:57998) 2024-04-26T20:57:03.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.653+0000 7f4ecbe00640 1 -- 172.21.15.138:0/3376156383 learned_addr learned my addr 172.21.15.138:0/3376156383 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:03.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.653+0000 7f4ed0c00640 1 --2- 172.21.15.138:0/3376156383 >> v2:172.21.15.143:3300/0 conn(0x7f4ecc0cb740 0x7f4ecc0b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:03.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.653+0000 7f4ec3400640 1 -- 172.21.15.138:0/3376156383 >> v2:172.21.15.143:3300/0 conn(0x7f4ecc0cb740 msgr2=0x7f4ecc0b5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:03.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.653+0000 7f4ec3400640 1 --2- 172.21.15.138:0/3376156383 >> v2:172.21.15.143:3300/0 conn(0x7f4ecc0cb740 0x7f4ecc0b5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:03.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.653+0000 7f4ec3400640 1 -- 172.21.15.138:0/3376156383 >> v1:172.21.15.138:6789/0 conn(0x7f4ecc15aa60 legacy=0x7f4ecc0cc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:03.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.653+0000 7f4ecb400640 1 -- 172.21.15.138:0/3376156383 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 142761927 0 0) 0x7f4ecc0cd210 con 0x7f4ecc15aa60 2024-04-26T20:57:03.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.653+0000 7f4ec3400640 1 -- 172.21.15.138:0/3376156383 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ecc15dc60 con 0x7f4ecc15e180 2024-04-26T20:57:03.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.657+0000 7f4ec3400640 1 --2- 172.21.15.138:0/3376156383 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ecc15e180 0x7f4ecc0cb200 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc06dd00 tx=0x7f4eb401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=979fee4cab2eb055 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:03.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.657+0000 7f4ecb400640 1 -- 172.21.15.138:0/3376156383 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb40b0070 con 0x7f4ecc15e180 2024-04-26T20:57:03.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.657+0000 7f4ecb400640 1 -- 172.21.15.138:0/3376156383 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4eb40ab600 con 0x7f4ecc15e180 2024-04-26T20:57:03.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.657+0000 7f4ecb400640 1 -- 172.21.15.138:0/3376156383 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb40ab9d0 con 0x7f4ecc15e180 2024-04-26T20:57:03.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.657+0000 7f4ed2c00640 1 -- 172.21.15.138:0/3376156383 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ecc15e180 msgr2=0x7f4ecc0cb200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:03.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.657+0000 7f4ed2c00640 1 --2- 172.21.15.138:0/3376156383 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ecc15e180 0x7f4ecc0cb200 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc06dd00 tx=0x7f4eb401c480 comp rx=0 tx=0).stop 2024-04-26T20:57:03.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.657+0000 7f4ed2c00640 1 -- 172.21.15.138:0/3376156383 shutdown_connections 2024-04-26T20:57:03.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.657+0000 7f4ed2c00640 1 --2- 172.21.15.138:0/3376156383 >> v2:172.21.15.143:3300/0 conn(0x7f4ecc0cb740 0x7f4ecc0b5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:03.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.657+0000 7f4ed2c00640 1 --2- 172.21.15.138:0/3376156383 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ecc15e180 0x7f4ecc0cb200 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:03.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.657+0000 7f4ed2c00640 1 -- 172.21.15.138:0/3376156383 >> 172.21.15.138:0/3376156383 conn(0x7f4ecc0d0bb0 msgr2=0x7f4ecc0d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:03.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.657+0000 7f4ed2c00640 1 -- 172.21.15.138:0/3376156383 shutdown_connections 2024-04-26T20:57:03.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.657+0000 7f4ed2c00640 1 -- 172.21.15.138:0/3376156383 wait complete. 2024-04-26T20:57:03.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.657+0000 7f4ed2c00640 1 Processor -- start 2024-04-26T20:57:03.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.657+0000 7f4ed2c00640 1 -- start start 2024-04-26T20:57:03.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.657+0000 7f4ed2c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4ecc0cb740 0x7f4ecc0d00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:03.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.657+0000 7f4ed2c00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ecc15aa60 0x7f4ecc152790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:03.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.657+0000 7f4ed2c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ecc15e180 0x7f4ecc15c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:03.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.657+0000 7f4ed2c00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f4ecc0cbb50 con 0x7f4ecc15aa60 2024-04-26T20:57:03.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.657+0000 7f4ed2c00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f4ecc072240 con 0x7f4ecc15e180 2024-04-26T20:57:03.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.657+0000 7f4ed2c00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f4ecc06dee0 con 0x7f4ecc0cb740 2024-04-26T20:57:03.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.661+0000 7f4ec3400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ecc15aa60 0x7f4ecc152790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:03.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.661+0000 7f4ec3400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ecc15aa60 0x7f4ecc152790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:58014/0 (socket says 172.21.15.138:58014) 2024-04-26T20:57:03.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.661+0000 7f4ec3400640 1 -- 172.21.15.138:0/624310082 learned_addr learned my addr 172.21.15.138:0/624310082 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:03.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.661+0000 7f4ecbe00640 1 --2- 172.21.15.138:0/624310082 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4ecc0cb740 0x7f4ecc0d00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:03.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.661+0000 7f4ed0c00640 1 --2- 172.21.15.138:0/624310082 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ecc15e180 0x7f4ecc15c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:03.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.661+0000 7f4ec3400640 1 -- 172.21.15.138:0/624310082 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4ecc0cb740 msgr2=0x7f4ecc0d00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:03.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.661+0000 7f4ec3400640 1 --2- 172.21.15.138:0/624310082 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4ecc0cb740 0x7f4ecc0d00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:03.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.661+0000 7f4ec3400640 1 -- 172.21.15.138:0/624310082 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ecc15e180 msgr2=0x7f4ecc15c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:03.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.661+0000 7f4ec3400640 1 --2- 172.21.15.138:0/624310082 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ecc15e180 0x7f4ecc15c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:03.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.661+0000 7f4ec3400640 1 -- 172.21.15.138:0/624310082 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ecc0cf910 con 0x7f4ecc15aa60 2024-04-26T20:57:03.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.661+0000 7f4ec3400640 1 --2- 172.21.15.138:0/624310082 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ecc15aa60 0x7f4ecc152790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4eb40ae040 tx=0x7f4eb4019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:03.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.661+0000 7f4ec8c00640 1 -- 172.21.15.138:0/624310082 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb40b0040 con 0x7f4ecc15aa60 2024-04-26T20:57:03.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.661+0000 7f4ec8c00640 1 -- 172.21.15.138:0/624310082 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4eb40ba070 con 0x7f4ecc15aa60 2024-04-26T20:57:03.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.661+0000 7f4ec8c00640 1 -- 172.21.15.138:0/624310082 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb40b4630 con 0x7f4ecc15aa60 2024-04-26T20:57:03.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.661+0000 7f4ed2c00640 1 -- 172.21.15.138:0/624310082 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ecc15ca10 con 0x7f4ecc15aa60 2024-04-26T20:57:03.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.661+0000 7f4ed2c00640 1 -- 172.21.15.138:0/624310082 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ecc0cfbd0 con 0x7f4ecc15aa60 2024-04-26T20:57:03.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.661+0000 7f4ed2c00640 1 -- 172.21.15.138:0/624310082 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ecc069430 con 0x7f4ecc15aa60 2024-04-26T20:57:03.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.661+0000 7f4ec8c00640 1 -- 172.21.15.138:0/624310082 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4eb40b47d0 con 0x7f4ecc15aa60 2024-04-26T20:57:03.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.661+0000 7f4ec8c00640 1 --2- 172.21.15.138:0/624310082 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4ea8068380 0x7f4ea806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:03.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.661+0000 7f4ec8c00640 1 -- 172.21.15.138:0/624310082 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f4eb4120900 con 0x7f4ecc15aa60 2024-04-26T20:57:03.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.665+0000 7f4ecbe00640 1 --2- 172.21.15.138:0/624310082 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4ea8068380 0x7f4ea806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:03.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.665+0000 7f4ecbe00640 1 --2- 172.21.15.138:0/624310082 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4ea8068380 0x7f4ea806a840 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc0012f0 tx=0x7f4ebc001770 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:03.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.665+0000 7f4ec8c00640 1 -- 172.21.15.138:0/624310082 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4eb4016070 con 0x7f4ecc15aa60 2024-04-26T20:57:03.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.825+0000 7f4ed2c00640 1 -- 172.21.15.138:0/624310082 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4ecc06fbd0 con 0x7f4ecc15aa60 2024-04-26T20:57:03.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.825+0000 7f4ec8c00640 1 -- 172.21.15.138:0/624310082 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f4eb40f0490 con 0x7f4ecc15aa60 2024-04-26T20:57:03.831 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 1 2024-04-26T20:57:03.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.829+0000 7f4ed2c00640 1 -- 172.21.15.138:0/624310082 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4ea8068380 msgr2=0x7f4ea806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:03.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.829+0000 7f4ed2c00640 1 --2- 172.21.15.138:0/624310082 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4ea8068380 0x7f4ea806a840 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc0012f0 tx=0x7f4ebc001770 comp rx=0 tx=0).stop 2024-04-26T20:57:03.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.829+0000 7f4ed2c00640 1 -- 172.21.15.138:0/624310082 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ecc15aa60 msgr2=0x7f4ecc152790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:03.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.829+0000 7f4ed2c00640 1 --2- 172.21.15.138:0/624310082 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ecc15aa60 0x7f4ecc152790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4eb40ae040 tx=0x7f4eb4019220 comp rx=0 tx=0).stop 2024-04-26T20:57:03.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.829+0000 7f4ed2c00640 1 -- 172.21.15.138:0/624310082 shutdown_connections 2024-04-26T20:57:03.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.829+0000 7f4ed2c00640 1 --2- 172.21.15.138:0/624310082 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4ea8068380 0x7f4ea806a840 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:03.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.829+0000 7f4ed2c00640 1 --2- 172.21.15.138:0/624310082 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ecc15e180 0x7f4ecc15c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:03.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.829+0000 7f4ed2c00640 1 --2- 172.21.15.138:0/624310082 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ecc15aa60 0x7f4ecc152790 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:03.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.829+0000 7f4ed2c00640 1 --2- 172.21.15.138:0/624310082 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4ecc0cb740 0x7f4ecc0d00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:03.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.829+0000 7f4ed2c00640 1 -- 172.21.15.138:0/624310082 >> 172.21.15.138:0/624310082 conn(0x7f4ecc0d0bb0 msgr2=0x7f4ecc159f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:03.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.829+0000 7f4ed2c00640 1 -- 172.21.15.138:0/624310082 shutdown_connections 2024-04-26T20:57:03.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.829+0000 7f4ed2c00640 1 -- 172.21.15.138:0/624310082 wait complete. 2024-04-26T20:57:03.853 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T20:57:03.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.989+0000 7fe15ae00640 1 Processor -- start 2024-04-26T20:57:03.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.989+0000 7fe15ae00640 1 -- start start 2024-04-26T20:57:03.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.989+0000 7fe15ae00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe1540cb910 0x7fe1540b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:03.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.989+0000 7fe15ae00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1540cd210 con 0x7fe15415aa60 2024-04-26T20:57:03.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.989+0000 7fe15ae00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe15415d6a0 con 0x7fe15415e180 2024-04-26T20:57:03.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.989+0000 7fe15ae00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fe15415d980 con 0x7fe1540cb910 2024-04-26T20:57:03.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.989+0000 7fe153e00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fe15415aa60 0x7fe1540cc7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:37764/0 (socket says 172.21.15.138:37764) 2024-04-26T20:57:03.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.989+0000 7fe153e00640 1 -- 172.21.15.138:0/842987669 learned_addr learned my addr 172.21.15.138:0/842987669 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:03.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.989+0000 7fe158e00640 1 --2- 172.21.15.138:0/842987669 >> v2:172.21.15.143:3300/0 conn(0x7fe1540cb910 0x7fe1540b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:03.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.989+0000 7fe153400640 1 -- 172.21.15.138:0/842987669 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2801583914 0 0) 0x7fe1540cd210 con 0x7fe15415aa60 2024-04-26T20:57:03.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.989+0000 7fe153400640 1 -- 172.21.15.138:0/842987669 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe138003530 con 0x7fe15415aa60 2024-04-26T20:57:03.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.989+0000 7fe158e00640 1 -- 172.21.15.138:0/842987669 >> v1:172.21.15.143:6789/0 conn(0x7fe15415e180 legacy=0x7fe1540cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:03.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.989+0000 7fe153400640 1 -- 172.21.15.138:0/842987669 <== mon.0 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2481406362 0 0) 0x7fe138003530 con 0x7fe15415aa60 2024-04-26T20:57:03.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.989+0000 7fe158e00640 1 -- 172.21.15.138:0/842987669 >> v1:172.21.15.138:6789/0 conn(0x7fe15415aa60 legacy=0x7fe1540cc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:03.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.989+0000 7fe158e00640 1 -- 172.21.15.138:0/842987669 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe15415dc60 con 0x7fe1540cb910 2024-04-26T20:57:03.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.993+0000 7fe158e00640 1 --2- 172.21.15.138:0/842987669 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe1540cb910 0x7fe1540b5aa0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe14c009d90 tx=0x7fe14c01c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4ad2e3638b7b3b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:03.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.993+0000 7fe153400640 1 -- 172.21.15.138:0/842987669 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe144001680 con 0x7fe1540cb910 2024-04-26T20:57:03.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.993+0000 7fe153400640 1 -- 172.21.15.138:0/842987669 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe14c0a64e0 con 0x7fe1540cb910 2024-04-26T20:57:03.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.993+0000 7fe153400640 1 -- 172.21.15.138:0/842987669 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe14c0a68b0 con 0x7fe1540cb910 2024-04-26T20:57:03.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.993+0000 7fe15ae00640 1 -- 172.21.15.138:0/842987669 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe1540cb910 msgr2=0x7fe1540b5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:03.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.993+0000 7fe15ae00640 1 --2- 172.21.15.138:0/842987669 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe1540cb910 0x7fe1540b5aa0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe14c009d90 tx=0x7fe14c01c890 comp rx=0 tx=0).stop 2024-04-26T20:57:03.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.993+0000 7fe15ae00640 1 -- 172.21.15.138:0/842987669 shutdown_connections 2024-04-26T20:57:03.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.993+0000 7fe15ae00640 1 --2- 172.21.15.138:0/842987669 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe1540cb910 0x7fe1540b5aa0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:03.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.993+0000 7fe15ae00640 1 -- 172.21.15.138:0/842987669 >> 172.21.15.138:0/842987669 conn(0x7fe1540d0bb0 msgr2=0x7fe1540d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:03.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.993+0000 7fe15ae00640 1 -- 172.21.15.138:0/842987669 shutdown_connections 2024-04-26T20:57:03.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.993+0000 7fe15ae00640 1 -- 172.21.15.138:0/842987669 wait complete. 2024-04-26T20:57:03.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.997+0000 7fe15ae00640 1 Processor -- start 2024-04-26T20:57:03.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.997+0000 7fe15ae00640 1 -- start start 2024-04-26T20:57:04.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.997+0000 7fe15ae00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe1540cb910 0x7fe1540d0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:04.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.997+0000 7fe15ae00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe15415aa60 0x7fe1540c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:04.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.997+0000 7fe15ae00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe15415e180 0x7fe1540b3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:04.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.997+0000 7fe15ae00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe15416ae30 con 0x7fe1540cb910 2024-04-26T20:57:04.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.997+0000 7fe15ae00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fe154072240 con 0x7fe15415aa60 2024-04-26T20:57:04.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.997+0000 7fe15ae00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fe15416afb0 con 0x7fe15415e180 2024-04-26T20:57:04.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.997+0000 7fe153e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe1540cb910 0x7fe1540d0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:04.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.997+0000 7fe153e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe1540cb910 0x7fe1540d0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:58018/0 (socket says 172.21.15.138:58018) 2024-04-26T20:57:04.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.997+0000 7fe153e00640 1 -- 172.21.15.138:0/3264432094 learned_addr learned my addr 172.21.15.138:0/3264432094 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:04.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.997+0000 7fe153e00640 1 -- 172.21.15.138:0/3264432094 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe15415e180 msgr2=0x7fe1540b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:04.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.997+0000 7fe153e00640 1 --2- 172.21.15.138:0/3264432094 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe15415e180 0x7fe1540b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:04.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.997+0000 7fe153e00640 1 -- 172.21.15.138:0/3264432094 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe15415aa60 msgr2=0x7fe1540c7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:04.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.997+0000 7fe153e00640 1 --2- 172.21.15.138:0/3264432094 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe15415aa60 0x7fe1540c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:04.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.997+0000 7fe153e00640 1 -- 172.21.15.138:0/3264432094 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe15415c700 con 0x7fe1540cb910 2024-04-26T20:57:04.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.997+0000 7fe153e00640 1 --2- 172.21.15.138:0/3264432094 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe1540cb910 0x7fe1540d0370 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe14400c760 tx=0x7fe14400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:04.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.997+0000 7fe150c00640 1 -- 172.21.15.138:0/3264432094 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe144017070 con 0x7fe1540cb910 2024-04-26T20:57:04.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.997+0000 7fe150c00640 1 -- 172.21.15.138:0/3264432094 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe144005b00 con 0x7fe1540cb910 2024-04-26T20:57:04.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.997+0000 7fe150c00640 1 -- 172.21.15.138:0/3264432094 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe144007070 con 0x7fe1540cb910 2024-04-26T20:57:04.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.997+0000 7fe15ae00640 1 -- 172.21.15.138:0/3264432094 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe15415c9e0 con 0x7fe1540cb910 2024-04-26T20:57:04.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.997+0000 7fe15ae00640 1 -- 172.21.15.138:0/3264432094 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe15415ee30 con 0x7fe1540cb910 2024-04-26T20:57:04.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:03.997+0000 7fe15ae00640 1 -- 172.21.15.138:0/3264432094 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe154069430 con 0x7fe1540cb910 2024-04-26T20:57:04.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.001+0000 7fe150c00640 1 -- 172.21.15.138:0/3264432094 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe14401a070 con 0x7fe1540cb910 2024-04-26T20:57:04.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.001+0000 7fe150c00640 1 --2- 172.21.15.138:0/3264432094 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe130068380 0x7fe13006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:04.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.001+0000 7fe150c00640 1 -- 172.21.15.138:0/3264432094 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fe1440862a0 con 0x7fe1540cb910 2024-04-26T20:57:04.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.001+0000 7fe14b400640 1 --2- 172.21.15.138:0/3264432094 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe130068380 0x7fe13006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:04.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.001+0000 7fe14b400640 1 --2- 172.21.15.138:0/3264432094 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe130068380 0x7fe13006a840 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe13c000f70 tx=0x7fe13c0079c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:04.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.005+0000 7fe150c00640 1 -- 172.21.15.138:0/3264432094 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe144056510 con 0x7fe1540cb910 2024-04-26T20:57:04.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.161+0000 7fe15ae00640 1 -- 172.21.15.138:0/3264432094 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe154069f00 con 0x7fe1540cb910 2024-04-26T20:57:04.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.161+0000 7fe150c00640 1 -- 172.21.15.138:0/3264432094 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7fe144055e10 con 0x7fe1540cb910 2024-04-26T20:57:04.169 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 32 2024-04-26T20:57:04.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.165+0000 7fe15ae00640 1 -- 172.21.15.138:0/3264432094 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe130068380 msgr2=0x7fe13006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:04.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.165+0000 7fe15ae00640 1 --2- 172.21.15.138:0/3264432094 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe130068380 0x7fe13006a840 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe13c000f70 tx=0x7fe13c0079c0 comp rx=0 tx=0).stop 2024-04-26T20:57:04.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.165+0000 7fe15ae00640 1 -- 172.21.15.138:0/3264432094 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe1540cb910 msgr2=0x7fe1540d0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:04.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.165+0000 7fe15ae00640 1 --2- 172.21.15.138:0/3264432094 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe1540cb910 0x7fe1540d0370 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe14400c760 tx=0x7fe14400cc20 comp rx=0 tx=0).stop 2024-04-26T20:57:04.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.165+0000 7fe15ae00640 1 -- 172.21.15.138:0/3264432094 shutdown_connections 2024-04-26T20:57:04.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.165+0000 7fe15ae00640 1 --2- 172.21.15.138:0/3264432094 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe130068380 0x7fe13006a840 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:04.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.165+0000 7fe15ae00640 1 --2- 172.21.15.138:0/3264432094 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe15415e180 0x7fe1540b3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:04.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.165+0000 7fe15ae00640 1 --2- 172.21.15.138:0/3264432094 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe15415aa60 0x7fe1540c7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:04.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.165+0000 7fe15ae00640 1 --2- 172.21.15.138:0/3264432094 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe1540cb910 0x7fe1540d0370 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:04.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.165+0000 7fe15ae00640 1 -- 172.21.15.138:0/3264432094 >> 172.21.15.138:0/3264432094 conn(0x7fe1540d0bb0 msgr2=0x7fe1540cb1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:04.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.165+0000 7fe15ae00640 1 -- 172.21.15.138:0/3264432094 shutdown_connections 2024-04-26T20:57:04.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.165+0000 7fe15ae00640 1 -- 172.21.15.138:0/3264432094 wait complete. 2024-04-26T20:57:04.187 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T20:57:04.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.325+0000 7fe16f600640 1 Processor -- start 2024-04-26T20:57:04.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.325+0000 7fe16f600640 1 -- start start 2024-04-26T20:57:04.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.325+0000 7fe16f600640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe168073d70 0x7fe168160040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:04.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.325+0000 7fe16f600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe16806f880 0x7fe1680ce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:04.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.325+0000 7fe16f600640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe16806dee0 con 0x7fe16815bdc0 2024-04-26T20:57:04.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.325+0000 7fe16f600640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fe16815c1a0 con 0x7fe168073d70 2024-04-26T20:57:04.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.325+0000 7fe16f600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fe16806e180 con 0x7fe16806f880 2024-04-26T20:57:04.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.325+0000 7fe16cc00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fe16815bdc0 0x7fe16815f930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:37780/0 (socket says 172.21.15.138:37780) 2024-04-26T20:57:04.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.325+0000 7fe16cc00640 1 -- 172.21.15.138:0/2353007545 learned_addr learned my addr 172.21.15.138:0/2353007545 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:04.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.329+0000 7fe167e00640 1 -- 172.21.15.138:0/2353007545 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2803345531 0 0) 0x7fe16806dee0 con 0x7fe16815bdc0 2024-04-26T20:57:04.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.329+0000 7fe15fe00640 1 --2- 172.21.15.138:0/2353007545 >> v2:172.21.15.143:3300/0 conn(0x7fe168073d70 0x7fe168160040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:04.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.329+0000 7fe167e00640 1 -- 172.21.15.138:0/2353007545 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe14c003530 con 0x7fe16815bdc0 2024-04-26T20:57:04.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.329+0000 7fe16d600640 1 --2- 172.21.15.138:0/2353007545 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe16806f880 0x7fe1680ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:04.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.329+0000 7fe167e00640 1 -- 172.21.15.138:0/2353007545 <== mon.0 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2380804985 0 0) 0x7fe14c003530 con 0x7fe16815bdc0 2024-04-26T20:57:04.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.329+0000 7fe167e00640 1 -- 172.21.15.138:0/2353007545 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe16806f880 msgr2=0x7fe1680ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:04.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.329+0000 7fe167e00640 1 --2- 172.21.15.138:0/2353007545 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe16806f880 0x7fe1680ce780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:04.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.329+0000 7fe167e00640 1 -- 172.21.15.138:0/2353007545 >> v2:172.21.15.143:3300/0 conn(0x7fe168073d70 msgr2=0x7fe168160040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:04.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.329+0000 7fe167e00640 1 --2- 172.21.15.138:0/2353007545 >> v2:172.21.15.143:3300/0 conn(0x7fe168073d70 0x7fe168160040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:04.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.329+0000 7fe167e00640 1 -- 172.21.15.138:0/2353007545 --> v1:172.21.15.138:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe16806e460 con 0x7fe16815bdc0 2024-04-26T20:57:04.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.329+0000 7fe167e00640 1 -- 172.21.15.138:0/2353007545 <== mon.0 v1:172.21.15.138:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2715389689 0 0) 0x7fe1580016a0 con 0x7fe16815bdc0 2024-04-26T20:57:04.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.329+0000 7fe167e00640 1 -- 172.21.15.138:0/2353007545 >> v1:172.21.15.138:6789/0 conn(0x7fe16815bdc0 legacy=0x7fe16815f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:04.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.329+0000 7fe167e00640 1 --2- 172.21.15.138:0/2353007545 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe14c003a30 0x7fe14c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:04.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.329+0000 7fe167e00640 1 --2- 172.21.15.138:0/2353007545 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe14c004810 0x7fe14c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:04.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.329+0000 7fe167e00640 1 --2- 172.21.15.138:0/2353007545 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe16806f880 0x7fe14c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:04.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.329+0000 7fe167e00640 1 -- 172.21.15.138:0/2353007545 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe16815c1a0 con 0x7fe14c004810 2024-04-26T20:57:04.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.329+0000 7fe167e00640 1 -- 172.21.15.138:0/2353007545 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fe16806e180 con 0x7fe14c003a30 2024-04-26T20:57:04.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.329+0000 7fe167e00640 1 -- 172.21.15.138:0/2353007545 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fe14c00dc60 con 0x7fe16806f880 2024-04-26T20:57:04.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.329+0000 7fe15fe00640 1 --2- 172.21.15.138:0/2353007545 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe14c004810 0x7fe14c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:04.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.329+0000 7fe16cc00640 1 --2- 172.21.15.138:0/2353007545 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe14c003a30 0x7fe14c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:04.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.329+0000 7fe16d600640 1 --2- 172.21.15.138:0/2353007545 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe16806f880 0x7fe14c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:04.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.329+0000 7fe15fe00640 1 -- 172.21.15.138:0/2353007545 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe16806f880 msgr2=0x7fe14c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:04.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.329+0000 7fe15fe00640 1 --2- 172.21.15.138:0/2353007545 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe16806f880 0x7fe14c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:04.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.329+0000 7fe15fe00640 1 -- 172.21.15.138:0/2353007545 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe14c003a30 msgr2=0x7fe14c003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:04.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.329+0000 7fe15fe00640 1 --2- 172.21.15.138:0/2353007545 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe14c003a30 0x7fe14c003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:04.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.329+0000 7fe15fe00640 1 -- 172.21.15.138:0/2353007545 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe14c003530 con 0x7fe14c004810 2024-04-26T20:57:04.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.333+0000 7fe15fe00640 1 --2- 172.21.15.138:0/2353007545 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe14c004810 0x7fe14c004c90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe150009ab0 tx=0x7fe15001ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a72703e9c84a56a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:04.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.333+0000 7fe167e00640 1 -- 172.21.15.138:0/2353007545 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1500096b0 con 0x7fe14c004810 2024-04-26T20:57:04.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.333+0000 7fe167e00640 1 -- 172.21.15.138:0/2353007545 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1500a6480 con 0x7fe14c004810 2024-04-26T20:57:04.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.333+0000 7fe167e00640 1 -- 172.21.15.138:0/2353007545 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1500a6870 con 0x7fe14c004810 2024-04-26T20:57:04.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.333+0000 7fe16f600640 1 -- 172.21.15.138:0/2353007545 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe14c004810 msgr2=0x7fe14c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:04.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.333+0000 7fe16f600640 1 --2- 172.21.15.138:0/2353007545 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe14c004810 0x7fe14c004c90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe150009ab0 tx=0x7fe15001ca90 comp rx=0 tx=0).stop 2024-04-26T20:57:04.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.333+0000 7fe16d600640 1 -- 172.21.15.138:0/2353007545 reap_dead start 2024-04-26T20:57:04.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.333+0000 7fe16f600640 1 -- 172.21.15.138:0/2353007545 shutdown_connections 2024-04-26T20:57:04.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.333+0000 7fe16f600640 1 -- 172.21.15.138:0/2353007545 >> 172.21.15.138:0/2353007545 conn(0x7fe1680d0bb0 msgr2=0x7fe1680d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:04.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.333+0000 7fe16f600640 1 -- 172.21.15.138:0/2353007545 shutdown_connections 2024-04-26T20:57:04.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.333+0000 7fe16f600640 1 -- 172.21.15.138:0/2353007545 wait complete. 2024-04-26T20:57:04.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.333+0000 7fe16f600640 1 Processor -- start 2024-04-26T20:57:04.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.333+0000 7fe16f600640 1 -- start start 2024-04-26T20:57:04.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.333+0000 7fe16f600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe14c004810 0x7fe1680b20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:04.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.333+0000 7fe16f600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe1681f7ae0 0x7fe1681fbae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:04.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.333+0000 7fe16f600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe1680ca4f0 0x7fe1680ca9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:04.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.333+0000 7fe16f600640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe1680cef90 con 0x7fe1680ca4f0 2024-04-26T20:57:04.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.333+0000 7fe16f600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fe168160790 con 0x7fe1681f7ae0 2024-04-26T20:57:04.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.333+0000 7fe16f600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fe1680cf110 con 0x7fe14c004810 2024-04-26T20:57:04.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.333+0000 7fe16d600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe1680ca4f0 0x7fe1680ca9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:04.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.337+0000 7fe16d600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe1680ca4f0 0x7fe1680ca9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:58034/0 (socket says 172.21.15.138:58034) 2024-04-26T20:57:04.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.337+0000 7fe16cc00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe14c004810 0x7fe1680b20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:04.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.337+0000 7fe16d600640 1 -- 172.21.15.138:0/2497603010 learned_addr learned my addr 172.21.15.138:0/2497603010 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:04.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.337+0000 7fe15fe00640 1 --2- 172.21.15.138:0/2497603010 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe1681f7ae0 0x7fe1681fbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:04.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.337+0000 7fe16d600640 1 -- 172.21.15.138:0/2497603010 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe14c004810 msgr2=0x7fe1680b20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:04.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.337+0000 7fe16d600640 1 --2- 172.21.15.138:0/2497603010 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe14c004810 0x7fe1680b20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:04.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.337+0000 7fe16d600640 1 -- 172.21.15.138:0/2497603010 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe1681f7ae0 msgr2=0x7fe1681fbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:04.341 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.337+0000 7fe16d600640 1 --2- 172.21.15.138:0/2497603010 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe1681f7ae0 0x7fe1681fbae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:04.341 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.337+0000 7fe16d600640 1 -- 172.21.15.138:0/2497603010 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe168158eb0 con 0x7fe1680ca4f0 2024-04-26T20:57:04.341 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.337+0000 7fe16d600640 1 --2- 172.21.15.138:0/2497603010 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe1680ca4f0 0x7fe1680ca9a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe1680c4350 tx=0x7fe16000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:04.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.337+0000 7fe165600640 1 -- 172.21.15.138:0/2497603010 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe16000fd80 con 0x7fe1680ca4f0 2024-04-26T20:57:04.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.337+0000 7fe165600640 1 -- 172.21.15.138:0/2497603010 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe16001d070 con 0x7fe1680ca4f0 2024-04-26T20:57:04.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.337+0000 7fe165600640 1 -- 172.21.15.138:0/2497603010 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe160015670 con 0x7fe1680ca4f0 2024-04-26T20:57:04.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.337+0000 7fe16f600640 1 -- 172.21.15.138:0/2497603010 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1681fc020 con 0x7fe1680ca4f0 2024-04-26T20:57:04.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.337+0000 7fe16f600640 1 -- 172.21.15.138:0/2497603010 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1681f82f0 con 0x7fe1680ca4f0 2024-04-26T20:57:04.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.337+0000 7fe16f600640 1 -- 172.21.15.138:0/2497603010 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe168069430 con 0x7fe1680ca4f0 2024-04-26T20:57:04.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.337+0000 7fe165600640 1 -- 172.21.15.138:0/2497603010 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe160015810 con 0x7fe1680ca4f0 2024-04-26T20:57:04.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.337+0000 7fe165600640 1 --2- 172.21.15.138:0/2497603010 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe1440683b0 0x7fe14406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:04.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.337+0000 7fe165600640 1 -- 172.21.15.138:0/2497603010 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fe1600873f0 con 0x7fe1680ca4f0 2024-04-26T20:57:04.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.341+0000 7fe16cc00640 1 --2- 172.21.15.138:0/2497603010 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe1440683b0 0x7fe14406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:04.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.341+0000 7fe16cc00640 1 --2- 172.21.15.138:0/2497603010 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe1440683b0 0x7fe14406a870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe168159470 tx=0x7fe158007900 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:04.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.341+0000 7fe165600640 1 -- 172.21.15.138:0/2497603010 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe1681fc020 con 0x7fe1680ca4f0 2024-04-26T20:57:04.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.501+0000 7fe16f600640 1 -- 172.21.15.138:0/2497603010 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe1680d19c0 con 0x7fe1680ca4f0 2024-04-26T20:57:04.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.501+0000 7fe165600640 1 -- 172.21.15.138:0/2497603010 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7fe168158eb0 con 0x7fe1680ca4f0 2024-04-26T20:57:04.505 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 64 2024-04-26T20:57:04.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.501+0000 7fe16f600640 1 -- 172.21.15.138:0/2497603010 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe1440683b0 msgr2=0x7fe14406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:04.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.501+0000 7fe16f600640 1 --2- 172.21.15.138:0/2497603010 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe1440683b0 0x7fe14406a870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe168159470 tx=0x7fe158007900 comp rx=0 tx=0).stop 2024-04-26T20:57:04.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.501+0000 7fe16f600640 1 -- 172.21.15.138:0/2497603010 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe1680ca4f0 msgr2=0x7fe1680ca9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:04.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.501+0000 7fe16f600640 1 --2- 172.21.15.138:0/2497603010 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe1680ca4f0 0x7fe1680ca9a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe1680c4350 tx=0x7fe16000f580 comp rx=0 tx=0).stop 2024-04-26T20:57:04.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.501+0000 7fe16f600640 1 -- 172.21.15.138:0/2497603010 shutdown_connections 2024-04-26T20:57:04.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.501+0000 7fe16f600640 1 --2- 172.21.15.138:0/2497603010 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe1440683b0 0x7fe14406a870 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:04.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.501+0000 7fe16f600640 1 --2- 172.21.15.138:0/2497603010 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe1680ca4f0 0x7fe1680ca9a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:04.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.501+0000 7fe16f600640 1 --2- 172.21.15.138:0/2497603010 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe1681f7ae0 0x7fe1681fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:04.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.501+0000 7fe16f600640 1 --2- 172.21.15.138:0/2497603010 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe14c004810 0x7fe1680b20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:04.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.501+0000 7fe16f600640 1 -- 172.21.15.138:0/2497603010 >> 172.21.15.138:0/2497603010 conn(0x7fe1680d0bb0 msgr2=0x7fe1680c9970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:04.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.501+0000 7fe16f600640 1 -- 172.21.15.138:0/2497603010 shutdown_connections 2024-04-26T20:57:04.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.501+0000 7fe16f600640 1 -- 172.21.15.138:0/2497603010 wait complete. 2024-04-26T20:57:04.526 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T20:57:04.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.661+0000 7f93f8000640 1 Processor -- start 2024-04-26T20:57:04.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.661+0000 7f93f8000640 1 -- start start 2024-04-26T20:57:04.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.661+0000 7f93f8000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f93f0070720 0x7f93f0073060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:04.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.661+0000 7f93f8000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f93f00735a0 0x7f93f0160b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:04.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.661+0000 7f93f8000640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93f01617e0 con 0x7f93f015d0c0 2024-04-26T20:57:04.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.661+0000 7f93f8000640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f93f0072330 con 0x7f93f00735a0 2024-04-26T20:57:04.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.661+0000 7f93f8000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f93f0072bd0 con 0x7f93f0070720 2024-04-26T20:57:04.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.661+0000 7f93f6000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f93f00735a0 0x7f93f0160b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:04.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.661+0000 7f93f6000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f93f00735a0 0x7f93f0160b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:58044/0 (socket says 172.21.15.138:58044) 2024-04-26T20:57:04.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.661+0000 7f93f6000640 1 -- 172.21.15.138:0/885265773 learned_addr learned my addr 172.21.15.138:0/885265773 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:04.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.661+0000 7f93f4c00640 1 --2- 172.21.15.138:0/885265773 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f93f0070720 0x7f93f0073060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:04.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.661+0000 7f93f6000640 1 -- 172.21.15.138:0/885265773 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f93f0070720 msgr2=0x7f93f0073060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:04.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.661+0000 7f93f6000640 1 --2- 172.21.15.138:0/885265773 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f93f0070720 0x7f93f0073060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:04.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.661+0000 7f93f6000640 1 -- 172.21.15.138:0/885265773 >> v1:172.21.15.143:6789/0 conn(0x7f93f015d0c0 legacy=0x7f93f00ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:04.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.661+0000 7f93f6000640 1 -- 172.21.15.138:0/885265773 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93f0072580 con 0x7f93f00735a0 2024-04-26T20:57:04.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.665+0000 7f93f6000640 1 --2- 172.21.15.138:0/885265773 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f93f00735a0 0x7f93f0160b10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f93e8009e50 tx=0x7f93e801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=153361afebd7a446 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:04.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.665+0000 7f93efe00640 1 -- 172.21.15.138:0/885265773 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e80a55d0 con 0x7f93f00735a0 2024-04-26T20:57:04.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.665+0000 7f93efe00640 1 -- 172.21.15.138:0/885265773 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93e80a5770 con 0x7f93f00735a0 2024-04-26T20:57:04.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.665+0000 7f93efe00640 1 -- 172.21.15.138:0/885265773 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e80a5b40 con 0x7f93f00735a0 2024-04-26T20:57:04.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.665+0000 7f93f8000640 1 -- 172.21.15.138:0/885265773 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f93f00735a0 msgr2=0x7f93f0160b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:04.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.665+0000 7f93f8000640 1 --2- 172.21.15.138:0/885265773 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f93f00735a0 0x7f93f0160b10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f93e8009e50 tx=0x7f93e801c910 comp rx=0 tx=0).stop 2024-04-26T20:57:04.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.665+0000 7f93f8000640 1 -- 172.21.15.138:0/885265773 shutdown_connections 2024-04-26T20:57:04.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.665+0000 7f93f8000640 1 --2- 172.21.15.138:0/885265773 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f93f00735a0 0x7f93f0160b10 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:04.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.665+0000 7f93f8000640 1 --2- 172.21.15.138:0/885265773 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f93f0070720 0x7f93f0073060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:04.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.665+0000 7f93f8000640 1 -- 172.21.15.138:0/885265773 >> 172.21.15.138:0/885265773 conn(0x7f93f00d0fd0 msgr2=0x7f93f00d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:04.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.665+0000 7f93f8000640 1 -- 172.21.15.138:0/885265773 shutdown_connections 2024-04-26T20:57:04.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.665+0000 7f93f8000640 1 -- 172.21.15.138:0/885265773 wait complete. 2024-04-26T20:57:04.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.665+0000 7f93f8000640 1 Processor -- start 2024-04-26T20:57:04.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.665+0000 7f93f8000640 1 -- start start 2024-04-26T20:57:04.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.669+0000 7f93f8000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f93f0070720 0x7f93f015a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:04.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.669+0000 7f93f8000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f93f00735a0 0x7f93f015ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:04.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.669+0000 7f93f8000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93f015d0c0 0x7f93f0158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:04.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.669+0000 7f93f8000640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f93f00cf2b0 con 0x7f93f0070720 2024-04-26T20:57:04.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.669+0000 7f93f8000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f93f00d0bb0 con 0x7f93f015d0c0 2024-04-26T20:57:04.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.669+0000 7f93f8000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f93f015af60 con 0x7f93f00735a0 2024-04-26T20:57:04.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.669+0000 7f93f5600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f93f0070720 0x7f93f015a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:04.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.669+0000 7f93f5600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f93f0070720 0x7f93f015a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:58060/0 (socket says 172.21.15.138:58060) 2024-04-26T20:57:04.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.669+0000 7f93f5600640 1 -- 172.21.15.138:0/2843787201 learned_addr learned my addr 172.21.15.138:0/2843787201 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:04.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.669+0000 7f93f6000640 1 --2- 172.21.15.138:0/2843787201 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93f015d0c0 0x7f93f0158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:04.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.669+0000 7f93f4c00640 1 --2- 172.21.15.138:0/2843787201 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f93f00735a0 0x7f93f015ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:04.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.669+0000 7f93f5600640 1 -- 172.21.15.138:0/2843787201 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f93f00735a0 msgr2=0x7f93f015ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:04.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.669+0000 7f93f5600640 1 --2- 172.21.15.138:0/2843787201 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f93f00735a0 0x7f93f015ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:04.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.669+0000 7f93f5600640 1 -- 172.21.15.138:0/2843787201 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93f015d0c0 msgr2=0x7f93f0158ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:04.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.669+0000 7f93f5600640 1 --2- 172.21.15.138:0/2843787201 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93f015d0c0 0x7f93f0158ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:04.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.669+0000 7f93f5600640 1 -- 172.21.15.138:0/2843787201 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93f015b240 con 0x7f93f0070720 2024-04-26T20:57:04.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.669+0000 7f93f6000640 1 --2- 172.21.15.138:0/2843787201 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93f015d0c0 0x7f93f0158ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:04.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.669+0000 7f93f4c00640 1 --2- 172.21.15.138:0/2843787201 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f93f00735a0 0x7f93f015ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:04.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.669+0000 7f93f5600640 1 --2- 172.21.15.138:0/2843787201 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f93f0070720 0x7f93f015a980 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f93e400c420 tx=0x7f93e400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:04.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.669+0000 7f93ed600640 1 -- 172.21.15.138:0/2843787201 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e40052d0 con 0x7f93f0070720 2024-04-26T20:57:04.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.669+0000 7f93ed600640 1 -- 172.21.15.138:0/2843787201 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93e4005470 con 0x7f93f0070720 2024-04-26T20:57:04.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.669+0000 7f93f8000640 1 -- 172.21.15.138:0/2843787201 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93f00c9390 con 0x7f93f0070720 2024-04-26T20:57:04.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.669+0000 7f93ed600640 1 -- 172.21.15.138:0/2843787201 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e4007260 con 0x7f93f0070720 2024-04-26T20:57:04.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.669+0000 7f93f8000640 1 -- 172.21.15.138:0/2843787201 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93f015d810 con 0x7f93f0070720 2024-04-26T20:57:04.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.669+0000 7f93f8000640 1 -- 172.21.15.138:0/2843787201 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93f0069430 con 0x7f93f0070720 2024-04-26T20:57:04.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.669+0000 7f93ed600640 1 -- 172.21.15.138:0/2843787201 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f93e4007400 con 0x7f93f0070720 2024-04-26T20:57:04.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.673+0000 7f93ed600640 1 --2- 172.21.15.138:0/2843787201 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f93d0068380 0x7f93d006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:04.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.673+0000 7f93ed600640 1 -- 172.21.15.138:0/2843787201 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f93e4086300 con 0x7f93f0070720 2024-04-26T20:57:04.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.673+0000 7f93f4c00640 1 --2- 172.21.15.138:0/2843787201 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f93d0068380 0x7f93d006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:04.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.673+0000 7f93f4c00640 1 --2- 172.21.15.138:0/2843787201 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f93d0068380 0x7f93d006a840 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f93f01fbf10 tx=0x7f93dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:04.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.677+0000 7f93ed600640 1 -- 172.21.15.138:0/2843787201 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f93e40564e0 con 0x7f93f0070720 2024-04-26T20:57:04.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.833+0000 7f93f8000640 1 -- 172.21.15.138:0/2843787201 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f93f00a2180 con 0x7f93f0070720 2024-04-26T20:57:04.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.833+0000 7f93ed600640 1 -- 172.21.15.138:0/2843787201 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f93e40860c0 con 0x7f93f0070720 2024-04-26T20:57:04.838 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 32 2024-04-26T20:57:04.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.833+0000 7f93f8000640 1 -- 172.21.15.138:0/2843787201 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f93d0068380 msgr2=0x7f93d006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:04.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.833+0000 7f93f8000640 1 --2- 172.21.15.138:0/2843787201 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f93d0068380 0x7f93d006a840 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f93f01fbf10 tx=0x7f93dc008040 comp rx=0 tx=0).stop 2024-04-26T20:57:04.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.833+0000 7f93f8000640 1 -- 172.21.15.138:0/2843787201 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f93f0070720 msgr2=0x7f93f015a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:04.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.833+0000 7f93f8000640 1 --2- 172.21.15.138:0/2843787201 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f93f0070720 0x7f93f015a980 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f93e400c420 tx=0x7f93e400c8e0 comp rx=0 tx=0).stop 2024-04-26T20:57:04.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.833+0000 7f93f8000640 1 -- 172.21.15.138:0/2843787201 shutdown_connections 2024-04-26T20:57:04.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.833+0000 7f93f8000640 1 --2- 172.21.15.138:0/2843787201 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f93d0068380 0x7f93d006a840 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:04.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.833+0000 7f93f8000640 1 --2- 172.21.15.138:0/2843787201 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93f015d0c0 0x7f93f0158ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:04.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.833+0000 7f93f8000640 1 --2- 172.21.15.138:0/2843787201 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f93f00735a0 0x7f93f015ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:04.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.833+0000 7f93f8000640 1 --2- 172.21.15.138:0/2843787201 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f93f0070720 0x7f93f015a980 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:04.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.833+0000 7f93f8000640 1 -- 172.21.15.138:0/2843787201 >> 172.21.15.138:0/2843787201 conn(0x7f93f00d0fd0 msgr2=0x7f93f015bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:04.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.837+0000 7f93f8000640 1 -- 172.21.15.138:0/2843787201 shutdown_connections 2024-04-26T20:57:04.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.837+0000 7f93f8000640 1 -- 172.21.15.138:0/2843787201 wait complete. 2024-04-26T20:57:04.859 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:57:04.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.989+0000 7f5246800640 1 Processor -- start 2024-04-26T20:57:04.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.989+0000 7f5246800640 1 -- start start 2024-04-26T20:57:04.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.993+0000 7f5246800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f524015cf80 0x7f5240073b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:04.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.993+0000 7f5246800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f52400cc1e0 0x7f52400ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:04.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.993+0000 7f5246800640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52400727f0 con 0x7f52400cbe00 2024-04-26T20:57:04.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.993+0000 7f5246800640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f5240073680 con 0x7f52400cc1e0 2024-04-26T20:57:04.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.993+0000 7f5246800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f5240072a70 con 0x7f524015cf80 2024-04-26T20:57:04.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.993+0000 7f523fe00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f52400cc1e0 0x7f52400ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:04.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.993+0000 7f523fe00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f52400cc1e0 0x7f52400ce6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:58064/0 (socket says 172.21.15.138:58064) 2024-04-26T20:57:04.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.993+0000 7f523fe00640 1 -- 172.21.15.138:0/2610148527 learned_addr learned my addr 172.21.15.138:0/2610148527 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:04.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.993+0000 7f5236a00640 1 --2- 172.21.15.138:0/2610148527 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f524015cf80 0x7f5240073b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:04.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.993+0000 7f523fe00640 1 -- 172.21.15.138:0/2610148527 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f524015cf80 msgr2=0x7f5240073b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:04.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.993+0000 7f523fe00640 1 --2- 172.21.15.138:0/2610148527 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f524015cf80 0x7f5240073b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:04.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.993+0000 7f523fe00640 1 -- 172.21.15.138:0/2610148527 >> v1:172.21.15.143:6789/0 conn(0x7f52400cbe00 legacy=0x7f524006de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:04.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.993+0000 7f523fe00640 1 -- 172.21.15.138:0/2610148527 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5240072d50 con 0x7f52400cc1e0 2024-04-26T20:57:04.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.997+0000 7f523fe00640 1 --2- 172.21.15.138:0/2610148527 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52400cc1e0 0x7f52400ce6f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5238009e50 tx=0x7f523801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fd82ba252d126ca server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:05.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.997+0000 7f523ea00640 1 -- 172.21.15.138:0/2610148527 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52380a5700 con 0x7f52400cc1e0 2024-04-26T20:57:05.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.997+0000 7f523ea00640 1 -- 172.21.15.138:0/2610148527 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52380a58a0 con 0x7f52400cc1e0 2024-04-26T20:57:05.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.997+0000 7f523ea00640 1 -- 172.21.15.138:0/2610148527 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52380a5c70 con 0x7f52400cc1e0 2024-04-26T20:57:05.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.997+0000 7f5246800640 1 -- 172.21.15.138:0/2610148527 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52400cc1e0 msgr2=0x7f52400ce6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:05.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.997+0000 7f5246800640 1 --2- 172.21.15.138:0/2610148527 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52400cc1e0 0x7f52400ce6f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5238009e50 tx=0x7f523801ca30 comp rx=0 tx=0).stop 2024-04-26T20:57:05.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.997+0000 7f5246800640 1 -- 172.21.15.138:0/2610148527 shutdown_connections 2024-04-26T20:57:05.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.997+0000 7f5246800640 1 --2- 172.21.15.138:0/2610148527 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52400cc1e0 0x7f52400ce6f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:05.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.997+0000 7f5246800640 1 --2- 172.21.15.138:0/2610148527 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f524015cf80 0x7f5240073b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:05.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.997+0000 7f5246800640 1 -- 172.21.15.138:0/2610148527 >> 172.21.15.138:0/2610148527 conn(0x7f52400d0b20 msgr2=0x7f52400d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:05.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.997+0000 7f5246800640 1 -- 172.21.15.138:0/2610148527 shutdown_connections 2024-04-26T20:57:05.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.997+0000 7f5246800640 1 -- 172.21.15.138:0/2610148527 wait complete. 2024-04-26T20:57:05.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.997+0000 7f5246800640 1 Processor -- start 2024-04-26T20:57:05.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.997+0000 7f5246800640 1 -- start start 2024-04-26T20:57:05.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.997+0000 7f5246800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f52400cbe00 0x7f5240148fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:05.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.997+0000 7f5246800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52400cc1e0 0x7f5240159910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:05.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.997+0000 7f5246800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f524015cf80 0x7f52400b5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:05.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.997+0000 7f5246800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f52400741d0 con 0x7f52400cc1e0 2024-04-26T20:57:05.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.997+0000 7f5246800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f5240074050 con 0x7f524015cf80 2024-04-26T20:57:05.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.997+0000 7f5246800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f52400d0780 con 0x7f52400cbe00 2024-04-26T20:57:05.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.997+0000 7f5236a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52400cc1e0 0x7f5240159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:05.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:04.997+0000 7f5236a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52400cc1e0 0x7f5240159910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:58070/0 (socket says 172.21.15.138:58070) 2024-04-26T20:57:05.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.001+0000 7f5236a00640 1 -- 172.21.15.138:0/3647082429 learned_addr learned my addr 172.21.15.138:0/3647082429 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:05.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.001+0000 7f523fe00640 1 --2- 172.21.15.138:0/3647082429 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f524015cf80 0x7f52400b5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:05.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.001+0000 7f523f400640 1 --2- 172.21.15.138:0/3647082429 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f52400cbe00 0x7f5240148fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:05.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.001+0000 7f5236a00640 1 -- 172.21.15.138:0/3647082429 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f52400cbe00 msgr2=0x7f5240148fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:05.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.001+0000 7f5236a00640 1 --2- 172.21.15.138:0/3647082429 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f52400cbe00 0x7f5240148fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:05.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.001+0000 7f5236a00640 1 -- 172.21.15.138:0/3647082429 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f524015cf80 msgr2=0x7f52400b5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:05.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.001+0000 7f5236a00640 1 --2- 172.21.15.138:0/3647082429 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f524015cf80 0x7f52400b5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:05.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.001+0000 7f5236a00640 1 -- 172.21.15.138:0/3647082429 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f524015ab30 con 0x7f52400cc1e0 2024-04-26T20:57:05.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.001+0000 7f5236a00640 1 --2- 172.21.15.138:0/3647082429 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52400cc1e0 0x7f5240159910 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f522800d620 tx=0x7f522800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:05.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.001+0000 7f5237e00640 1 -- 172.21.15.138:0/3647082429 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f522800b620 con 0x7f52400cc1e0 2024-04-26T20:57:05.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.001+0000 7f5237e00640 1 -- 172.21.15.138:0/3647082429 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5228019070 con 0x7f52400cc1e0 2024-04-26T20:57:05.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.001+0000 7f5237e00640 1 -- 172.21.15.138:0/3647082429 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f522800b9e0 con 0x7f52400cc1e0 2024-04-26T20:57:05.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.001+0000 7f5246800640 1 -- 172.21.15.138:0/3647082429 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f524015a290 con 0x7f52400cc1e0 2024-04-26T20:57:05.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.001+0000 7f5246800640 1 -- 172.21.15.138:0/3647082429 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f524015a850 con 0x7f52400cc1e0 2024-04-26T20:57:05.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.001+0000 7f5246800640 1 -- 172.21.15.138:0/3647082429 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5240069510 con 0x7f52400cc1e0 2024-04-26T20:57:05.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.001+0000 7f5237e00640 1 -- 172.21.15.138:0/3647082429 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f522800bb80 con 0x7f52400cc1e0 2024-04-26T20:57:05.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.001+0000 7f5237e00640 1 --2- 172.21.15.138:0/3647082429 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f521c068380 0x7f521c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:05.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.001+0000 7f5237e00640 1 -- 172.21.15.138:0/3647082429 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f5228087070 con 0x7f52400cc1e0 2024-04-26T20:57:05.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.001+0000 7f523f400640 1 --2- 172.21.15.138:0/3647082429 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f521c068380 0x7f521c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:05.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.005+0000 7f523f400640 1 --2- 172.21.15.138:0/3647082429 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f521c068380 0x7f521c06a840 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5230001810 tx=0x7f5230009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:05.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.005+0000 7f5237e00640 1 -- 172.21.15.138:0/3647082429 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5228056c00 con 0x7f52400cc1e0 2024-04-26T20:57:05.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.197+0000 7f5246800640 1 -- 172.21.15.138:0/3647082429 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5240156260 con 0x7f52400cc1e0 2024-04-26T20:57:05.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.197+0000 7f5237e00640 1 -- 172.21.15.138:0/3647082429 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5189 (secure 0 0 0) 0x7f522805af00 con 0x7f52400cc1e0 2024-04-26T20:57:05.203 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:57:05.203 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/3495262740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3495262740},{"type":"v1","addr":"172.21.15.143:6837","nonce":3495262740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4273,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/1806638334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":1806638334},{"type":"v1","addr":"172.21.15.138:6834","nonce":1806638334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/3333703637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":3333703637},{"type":"v1","addr":"172.21.15.138:6835","nonce":3333703637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:56:39.581500+0000","modified":"2024-04-26T20:56:57.692718+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6836/3598364176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":3598364176},{"type":"v1","addr":"172.21.15.143:6836","nonce":3598364176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-04-26T20:57:05.204 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 9 2024-04-26T20:57:05.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.201+0000 7f5246800640 1 -- 172.21.15.138:0/3647082429 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f521c068380 msgr2=0x7f521c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:05.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.201+0000 7f5246800640 1 --2- 172.21.15.138:0/3647082429 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f521c068380 0x7f521c06a840 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5230001810 tx=0x7f5230009040 comp rx=0 tx=0).stop 2024-04-26T20:57:05.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.201+0000 7f5246800640 1 -- 172.21.15.138:0/3647082429 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52400cc1e0 msgr2=0x7f5240159910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:05.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.201+0000 7f5246800640 1 --2- 172.21.15.138:0/3647082429 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52400cc1e0 0x7f5240159910 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f522800d620 tx=0x7f522800dae0 comp rx=0 tx=0).stop 2024-04-26T20:57:05.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.201+0000 7f5246800640 1 -- 172.21.15.138:0/3647082429 shutdown_connections 2024-04-26T20:57:05.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.201+0000 7f5246800640 1 --2- 172.21.15.138:0/3647082429 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f521c068380 0x7f521c06a840 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:05.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.201+0000 7f5246800640 1 --2- 172.21.15.138:0/3647082429 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f524015cf80 0x7f52400b5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:05.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.201+0000 7f5246800640 1 --2- 172.21.15.138:0/3647082429 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52400cc1e0 0x7f5240159910 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:05.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.201+0000 7f5246800640 1 --2- 172.21.15.138:0/3647082429 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f52400cbe00 0x7f5240148fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:05.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.201+0000 7f5246800640 1 -- 172.21.15.138:0/3647082429 >> 172.21.15.138:0/3647082429 conn(0x7f52400d0b20 msgr2=0x7f524006e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:05.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.201+0000 7f5246800640 1 -- 172.21.15.138:0/3647082429 shutdown_connections 2024-04-26T20:57:05.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.201+0000 7f5246800640 1 -- 172.21.15.138:0/3647082429 wait complete. 2024-04-26T20:57:05.225 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:57:05.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.357+0000 7f89d2000640 1 Processor -- start 2024-04-26T20:57:05.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.357+0000 7f89d2000640 1 -- start start 2024-04-26T20:57:05.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.361+0000 7f89d2000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f89cc15f130 0x7f89cc0cf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:05.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.361+0000 7f89d2000640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f89cc15f510 0x7f89cc0cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:05.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.361+0000 7f89d2000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f89cc0d3870 0x7f89cc06d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:05.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.361+0000 7f89d2000640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f89cc0d2180 con 0x7f89cc15f130 2024-04-26T20:57:05.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.361+0000 7f89d2000640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f89cc0cd570 con 0x7f89cc15f510 2024-04-26T20:57:05.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.361+0000 7f89d2000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f89cc0cd850 con 0x7f89cc0d3870 2024-04-26T20:57:05.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.361+0000 7f89cb400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f89cc15f130 0x7f89cc0cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:05.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.361+0000 7f89cb400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f89cc15f130 0x7f89cc0cf600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:58080/0 (socket says 172.21.15.138:58080) 2024-04-26T20:57:05.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.361+0000 7f89cb400640 1 -- 172.21.15.138:0/544688167 learned_addr learned my addr 172.21.15.138:0/544688167 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:05.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.361+0000 7f89cbe00640 1 --2- 172.21.15.138:0/544688167 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f89cc0d3870 0x7f89cc06d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:05.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.361+0000 7f89c3e00640 1 --2- 172.21.15.138:0/544688167 >> v2:172.21.15.143:3300/0 conn(0x7f89cc15f510 0x7f89cc0cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:05.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.361+0000 7f89cb400640 1 -- 172.21.15.138:0/544688167 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f89cc0d3870 msgr2=0x7f89cc06d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:05.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.361+0000 7f89cb400640 1 --2- 172.21.15.138:0/544688167 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f89cc0d3870 0x7f89cc06d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:05.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.361+0000 7f89cb400640 1 -- 172.21.15.138:0/544688167 >> v2:172.21.15.143:3300/0 conn(0x7f89cc15f510 msgr2=0x7f89cc0cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:05.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.361+0000 7f89cb400640 1 --2- 172.21.15.138:0/544688167 >> v2:172.21.15.143:3300/0 conn(0x7f89cc15f510 0x7f89cc0cfb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:05.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.361+0000 7f89cb400640 1 -- 172.21.15.138:0/544688167 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89cc06e730 con 0x7f89cc15f130 2024-04-26T20:57:05.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.365+0000 7f89cb400640 1 --2- 172.21.15.138:0/544688167 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f89cc15f130 0x7f89cc0cf600 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f89cc0b8e00 tx=0x7f89bc01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=803a693ff4c039ed server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:05.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.365+0000 7f89caa00640 1 -- 172.21.15.138:0/544688167 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89bc0b5070 con 0x7f89cc15f130 2024-04-26T20:57:05.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.365+0000 7f89caa00640 1 -- 172.21.15.138:0/544688167 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89bc0a89d0 con 0x7f89cc15f130 2024-04-26T20:57:05.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.365+0000 7f89caa00640 1 -- 172.21.15.138:0/544688167 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89bc0a8da0 con 0x7f89cc15f130 2024-04-26T20:57:05.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.365+0000 7f89d2000640 1 -- 172.21.15.138:0/544688167 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f89cc15f130 msgr2=0x7f89cc0cf600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:05.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.365+0000 7f89d2000640 1 --2- 172.21.15.138:0/544688167 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f89cc15f130 0x7f89cc0cf600 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f89cc0b8e00 tx=0x7f89bc01ed10 comp rx=0 tx=0).stop 2024-04-26T20:57:05.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.365+0000 7f89d2000640 1 -- 172.21.15.138:0/544688167 shutdown_connections 2024-04-26T20:57:05.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.365+0000 7f89d2000640 1 --2- 172.21.15.138:0/544688167 >> v2:172.21.15.143:3300/0 conn(0x7f89cc15f510 0x7f89cc0cfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:05.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.365+0000 7f89d2000640 1 --2- 172.21.15.138:0/544688167 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f89cc0d3870 0x7f89cc06d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:05.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.365+0000 7f89d2000640 1 --2- 172.21.15.138:0/544688167 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f89cc15f130 0x7f89cc0cf600 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:05.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.365+0000 7f89d2000640 1 -- 172.21.15.138:0/544688167 >> 172.21.15.138:0/544688167 conn(0x7f89cc0d2d80 msgr2=0x7f89cc0d3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:05.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.365+0000 7f89d2000640 1 -- 172.21.15.138:0/544688167 shutdown_connections 2024-04-26T20:57:05.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.365+0000 7f89d2000640 1 -- 172.21.15.138:0/544688167 wait complete. 2024-04-26T20:57:05.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.365+0000 7f89d2000640 1 Processor -- start 2024-04-26T20:57:05.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.365+0000 7f89d2000640 1 -- start start 2024-04-26T20:57:05.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.365+0000 7f89d2000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89cc0d3870 0x7f89cc1623b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:05.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.365+0000 7f89d2000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f89cc15f130 0x7f89cc0d1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:05.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.365+0000 7f89d2000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f89cc15f510 0x7f89cc0c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:05.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.365+0000 7f89d2000640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f89cc0d0670 con 0x7f89cc15f130 2024-04-26T20:57:05.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.365+0000 7f89d2000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f89cc0d04f0 con 0x7f89cc0d3870 2024-04-26T20:57:05.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.365+0000 7f89d2000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f89cc06db60 con 0x7f89cc15f510 2024-04-26T20:57:05.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.365+0000 7f89c3e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f89cc15f130 0x7f89cc0d1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:05.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.369+0000 7f89c3e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f89cc15f130 0x7f89cc0d1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:58082/0 (socket says 172.21.15.138:58082) 2024-04-26T20:57:05.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.369+0000 7f89c3e00640 1 -- 172.21.15.138:0/785557773 learned_addr learned my addr 172.21.15.138:0/785557773 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:05.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.369+0000 7f89cb400640 1 --2- 172.21.15.138:0/785557773 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89cc0d3870 0x7f89cc1623b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:05.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.369+0000 7f89cbe00640 1 --2- 172.21.15.138:0/785557773 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f89cc15f510 0x7f89cc0c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:05.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.369+0000 7f89c3e00640 1 -- 172.21.15.138:0/785557773 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f89cc15f510 msgr2=0x7f89cc0c8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:05.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.369+0000 7f89c3e00640 1 --2- 172.21.15.138:0/785557773 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f89cc15f510 0x7f89cc0c8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:05.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.369+0000 7f89c3e00640 1 -- 172.21.15.138:0/785557773 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89cc0d3870 msgr2=0x7f89cc1623b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:05.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.369+0000 7f89c3e00640 1 --2- 172.21.15.138:0/785557773 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89cc0d3870 0x7f89cc1623b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:05.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.369+0000 7f89c3e00640 1 -- 172.21.15.138:0/785557773 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89cc0c7d40 con 0x7f89cc15f130 2024-04-26T20:57:05.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.369+0000 7f89cbe00640 1 --2- 172.21.15.138:0/785557773 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f89cc15f510 0x7f89cc0c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:05.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.369+0000 7f89c3e00640 1 --2- 172.21.15.138:0/785557773 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f89cc15f130 0x7f89cc0d1690 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f89b400e870 tx=0x7f89b400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:05.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.369+0000 7f89c3400640 1 -- 172.21.15.138:0/785557773 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b4017070 con 0x7f89cc15f130 2024-04-26T20:57:05.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.369+0000 7f89c3400640 1 -- 172.21.15.138:0/785557773 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89b400ee60 con 0x7f89cc15f130 2024-04-26T20:57:05.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.369+0000 7f89c3400640 1 -- 172.21.15.138:0/785557773 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b400cb40 con 0x7f89cc15f130 2024-04-26T20:57:05.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.369+0000 7f89d2000640 1 -- 172.21.15.138:0/785557773 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89cc0c8020 con 0x7f89cc15f130 2024-04-26T20:57:05.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.369+0000 7f89d2000640 1 -- 172.21.15.138:0/785557773 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89cc0c88c0 con 0x7f89cc15f130 2024-04-26T20:57:05.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.369+0000 7f89d2000640 1 -- 172.21.15.138:0/785557773 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89cc069510 con 0x7f89cc15f130 2024-04-26T20:57:05.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.369+0000 7f89c3400640 1 -- 172.21.15.138:0/785557773 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f89b401a070 con 0x7f89cc15f130 2024-04-26T20:57:05.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.369+0000 7f89c3400640 1 --2- 172.21.15.138:0/785557773 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f89a8068380 0x7f89a806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:05.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.369+0000 7f89c3400640 1 -- 172.21.15.138:0/785557773 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f89b4086e10 con 0x7f89cc15f130 2024-04-26T20:57:05.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.373+0000 7f89cb400640 1 --2- 172.21.15.138:0/785557773 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f89a8068380 0x7f89a806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:05.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.373+0000 7f89cb400640 1 --2- 172.21.15.138:0/785557773 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f89a8068380 0x7f89a806a840 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f89bc0b2000 tx=0x7f89bc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:05.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.373+0000 7f89c3400640 1 -- 172.21.15.138:0/785557773 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f89b408a030 con 0x7f89cc15f130 2024-04-26T20:57:05.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.533+0000 7f89d2000640 1 -- 172.21.15.138:0/785557773 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f89cc162950 con 0x7f89cc15f130 2024-04-26T20:57:05.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.533+0000 7f89c3400640 1 -- 172.21.15.138:0/785557773 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18578 (secure 0 0 0) 0x7f89b4056a30 con 0x7f89cc15f130 2024-04-26T20:57:05.538 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:57:05.538 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":27,"fsid":"c22b4730-12cc-4558-8535-b965384398c0","created":"2024-04-26T20:56:14.182475+0000","modified":"2024-04-26T20:56:44.633968+0000","last_up_change":"2024-04-26T20:56:26.013243+0000","last_in_change":"2024-04-26T20:56:16.714055+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:56:27.265834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:56:37.394398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:56:38.544369+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:56:42.240243+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3f9a2e34-3199-466f-a6cf-57927318121e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6801","nonce":3534772245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6803","nonce":3534772245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6807","nonce":3534772245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6805","nonce":3534772245}]},"public_addr":"172.21.15.138:6801/3534772245","cluster_addr":"172.21.15.138:6803/3534772245","heartbeat_back_addr":"172.21.15.138:6807/3534772245","heartbeat_front_addr":"172.21.15.138:6805/3534772245","state":["exists","up"]},{"osd":1,"uuid":"e881fcf6-3248-4696-a2ef-95d206d77712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6817","nonce":1427635773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6819","nonce":1427635773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6823","nonce":1427635773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6821","nonce":1427635773}]},"public_addr":"172.21.15.138:6817/1427635773","cluster_addr":"172.21.15.138:6819/1427635773","heartbeat_back_addr":"172.21.15.138:6823/1427635773","heartbeat_front_addr":"172.21.15.138:6821/1427635773","state":["exists","up"]},{"osd":2,"uuid":"f7d1db33-7672-4699-ae47-9f1e0a8e4222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6809","nonce":4273721573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6811","nonce":4273721573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6815","nonce":4273721573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6813","nonce":4273721573}]},"public_addr":"172.21.15.138:6809/4273721573","cluster_addr":"172.21.15.138:6811/4273721573","heartbeat_back_addr":"172.21.15.138:6815/4273721573","heartbeat_front_addr":"172.21.15.138:6813/4273721573","state":["exists","up"]},{"osd":3,"uuid":"2f4e0a9a-b8f6-4468-844a-a4501cd85054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6825","nonce":3098242154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6827","nonce":3098242154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6831","nonce":3098242154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6829","nonce":3098242154}]},"public_addr":"172.21.15.138:6825/3098242154","cluster_addr":"172.21.15.138:6827/3098242154","heartbeat_back_addr":"172.21.15.138:6831/3098242154","heartbeat_front_addr":"172.21.15.138:6829/3098242154","state":["exists","up"]},{"osd":4,"uuid":"c85df99b-3624-410e-866b-86830af2cfe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6801","nonce":2942056312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6803","nonce":2942056312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6807","nonce":2942056312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6805","nonce":2942056312}]},"public_addr":"172.21.15.143:6801/2942056312","cluster_addr":"172.21.15.143:6803/2942056312","heartbeat_back_addr":"172.21.15.143:6807/2942056312","heartbeat_front_addr":"172.21.15.143:6805/2942056312","state":["exists","up"]},{"osd":5,"uuid":"9af1efb5-c416-4808-b5ef-de0679ab9705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6809","nonce":1910222887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6811","nonce":1910222887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6815","nonce":1910222887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6813","nonce":1910222887}]},"public_addr":"172.21.15.143:6809/1910222887","cluster_addr":"172.21.15.143:6811/1910222887","heartbeat_back_addr":"172.21.15.143:6815/1910222887","heartbeat_front_addr":"172.21.15.143:6813/1910222887","state":["exists","up"]},{"osd":6,"uuid":"d7138615-8838-45ff-9072-2fd0683362f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6817","nonce":1082239825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6819","nonce":1082239825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6823","nonce":1082239825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6821","nonce":1082239825}]},"public_addr":"172.21.15.143:6817/1082239825","cluster_addr":"172.21.15.143:6819/1082239825","heartbeat_back_addr":"172.21.15.143:6823/1082239825","heartbeat_front_addr":"172.21.15.143:6821/1082239825","state":["exists","up"]},{"osd":7,"uuid":"0c27172b-35c4-49ec-ba0b-0137b8ff0010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6825","nonce":3295508495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6827","nonce":3295508495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6831","nonce":3295508495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6829","nonce":3295508495}]},"public_addr":"172.21.15.143:6825/3295508495","cluster_addr":"172.21.15.143:6827/3295508495","heartbeat_back_addr":"172.21.15.143:6831/3295508495","heartbeat_front_addr":"172.21.15.143:6829/3295508495","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.326627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.396119+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.433915+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.414179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.216947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.329272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.503073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.436382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:57:05.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.537+0000 7f89d2000640 1 -- 172.21.15.138:0/785557773 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f89a8068380 msgr2=0x7f89a806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:05.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.537+0000 7f89d2000640 1 --2- 172.21.15.138:0/785557773 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f89a8068380 0x7f89a806a840 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f89bc0b2000 tx=0x7f89bc009040 comp rx=0 tx=0).stop 2024-04-26T20:57:05.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.537+0000 7f89d2000640 1 -- 172.21.15.138:0/785557773 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f89cc15f130 msgr2=0x7f89cc0d1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:05.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.537+0000 7f89d2000640 1 --2- 172.21.15.138:0/785557773 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f89cc15f130 0x7f89cc0d1690 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f89b400e870 tx=0x7f89b400ed30 comp rx=0 tx=0).stop 2024-04-26T20:57:05.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.537+0000 7f89d2000640 1 -- 172.21.15.138:0/785557773 shutdown_connections 2024-04-26T20:57:05.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.537+0000 7f89d2000640 1 --2- 172.21.15.138:0/785557773 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f89a8068380 0x7f89a806a840 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:05.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.537+0000 7f89d2000640 1 --2- 172.21.15.138:0/785557773 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f89cc15f510 0x7f89cc0c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:05.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.537+0000 7f89d2000640 1 --2- 172.21.15.138:0/785557773 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f89cc15f130 0x7f89cc0d1690 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:05.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.537+0000 7f89d2000640 1 --2- 172.21.15.138:0/785557773 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89cc0d3870 0x7f89cc1623b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:05.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.537+0000 7f89d2000640 1 -- 172.21.15.138:0/785557773 >> 172.21.15.138:0/785557773 conn(0x7f89cc0d2d80 msgr2=0x7f89cc0cf830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:05.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.537+0000 7f89d2000640 1 -- 172.21.15.138:0/785557773 shutdown_connections 2024-04-26T20:57:05.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.537+0000 7f89d2000640 1 -- 172.21.15.138:0/785557773 wait complete. 2024-04-26T20:57:05.560 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:56:27.265834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T20:56:37.394398+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T20:56:38.544369+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T20:56:42.240243+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T20:57:05.560 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T20:57:05.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.693+0000 7fc042a00640 1 Processor -- start 2024-04-26T20:57:05.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.693+0000 7fc042a00640 1 -- start start 2024-04-26T20:57:05.700 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.697+0000 7fc042a00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc03c15bdc0 0x7fc03c15f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:05.700 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.697+0000 7fc042a00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc03c06dee0 con 0x7fc03c073d70 2024-04-26T20:57:05.700 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.697+0000 7fc042a00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc03c15c1a0 con 0x7fc03c06f880 2024-04-26T20:57:05.700 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.697+0000 7fc042a00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fc03c06e180 con 0x7fc03c15bdc0 2024-04-26T20:57:05.700 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.697+0000 7fc033400640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fc03c073d70 0x7fc03c15fe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:37790/0 (socket says 172.21.15.138:37790) 2024-04-26T20:57:05.700 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.697+0000 7fc033400640 1 -- 172.21.15.138:0/2107925418 learned_addr learned my addr 172.21.15.138:0/2107925418 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:05.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.697+0000 7fc03be00640 1 --2- 172.21.15.138:0/2107925418 >> v2:172.21.15.143:3300/0 conn(0x7fc03c15bdc0 0x7fc03c15f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:05.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.697+0000 7fc03b400640 1 -- 172.21.15.138:0/2107925418 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2509034051 0 0) 0x7fc03c06dee0 con 0x7fc03c073d70 2024-04-26T20:57:05.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.697+0000 7fc03b400640 1 -- 172.21.15.138:0/2107925418 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc020005740 con 0x7fc03c073d70 2024-04-26T20:57:05.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.697+0000 7fc03b400640 1 -- 172.21.15.138:0/2107925418 <== mon.0 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2488804134 0 0) 0x7fc020005740 con 0x7fc03c073d70 2024-04-26T20:57:05.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.697+0000 7fc03b400640 1 -- 172.21.15.138:0/2107925418 >> v2:172.21.15.143:3300/0 conn(0x7fc03c15bdc0 msgr2=0x7fc03c15f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:05.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.697+0000 7fc03b400640 1 --2- 172.21.15.138:0/2107925418 >> v2:172.21.15.143:3300/0 conn(0x7fc03c15bdc0 0x7fc03c15f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:05.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.697+0000 7fc03b400640 1 -- 172.21.15.138:0/2107925418 >> v1:172.21.15.143:6789/0 conn(0x7fc03c06f880 legacy=0x7fc03c0ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:05.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.697+0000 7fc03b400640 1 -- 172.21.15.138:0/2107925418 --> v1:172.21.15.138:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc03c06e460 con 0x7fc03c073d70 2024-04-26T20:57:05.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.697+0000 7fc03b400640 1 -- 172.21.15.138:0/2107925418 <== mon.0 v1:172.21.15.138:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2715389689 0 0) 0x7fc024001680 con 0x7fc03c073d70 2024-04-26T20:57:05.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.697+0000 7fc03b400640 1 -- 172.21.15.138:0/2107925418 >> v1:172.21.15.138:6789/0 conn(0x7fc03c073d70 legacy=0x7fc03c15fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:05.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.697+0000 7fc03b400640 1 --2- 172.21.15.138:0/2107925418 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc020005c40 0x7fc020006060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:05.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.697+0000 7fc03b400640 1 --2- 172.21.15.138:0/2107925418 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc020006a20 0x7fc020006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:05.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.697+0000 7fc03b400640 1 --2- 172.21.15.138:0/2107925418 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc0200074e0 0x7fc02000dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:05.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.697+0000 7fc03b400640 1 -- 172.21.15.138:0/2107925418 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc03c06e180 con 0x7fc020006a20 2024-04-26T20:57:05.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.697+0000 7fc03b400640 1 -- 172.21.15.138:0/2107925418 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fc02000e420 con 0x7fc020005c40 2024-04-26T20:57:05.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.697+0000 7fc03b400640 1 -- 172.21.15.138:0/2107925418 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fc02000e620 con 0x7fc0200074e0 2024-04-26T20:57:05.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.697+0000 7fc033400640 1 --2- 172.21.15.138:0/2107925418 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc020006a20 0x7fc020006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:05.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.697+0000 7fc03be00640 1 --2- 172.21.15.138:0/2107925418 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc020005c40 0x7fc020006060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:05.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.697+0000 7fc040a00640 1 --2- 172.21.15.138:0/2107925418 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc0200074e0 0x7fc02000dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:05.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.697+0000 7fc033400640 1 -- 172.21.15.138:0/2107925418 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc0200074e0 msgr2=0x7fc02000dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:05.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.697+0000 7fc033400640 1 --2- 172.21.15.138:0/2107925418 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc0200074e0 0x7fc02000dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:05.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.697+0000 7fc033400640 1 -- 172.21.15.138:0/2107925418 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc020005c40 msgr2=0x7fc020006060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:05.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.697+0000 7fc033400640 1 --2- 172.21.15.138:0/2107925418 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc020005c40 0x7fc020006060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:05.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.697+0000 7fc033400640 1 -- 172.21.15.138:0/2107925418 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc020005740 con 0x7fc020006a20 2024-04-26T20:57:05.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.697+0000 7fc040a00640 1 --2- 172.21.15.138:0/2107925418 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc0200074e0 0x7fc02000dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:05.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.697+0000 7fc040a00640 1 -- 172.21.15.138:0/2107925418 reap_dead start 2024-04-26T20:57:05.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.701+0000 7fc033400640 1 --2- 172.21.15.138:0/2107925418 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc020006a20 0x7fc020006ea0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc02400c210 tx=0x7fc02401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98227e2b208b22ac server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:05.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.701+0000 7fc03b400640 1 -- 172.21.15.138:0/2107925418 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc024007d40 con 0x7fc020006a20 2024-04-26T20:57:05.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.701+0000 7fc03b400640 1 -- 172.21.15.138:0/2107925418 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0240a9070 con 0x7fc020006a20 2024-04-26T20:57:05.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.701+0000 7fc03b400640 1 -- 172.21.15.138:0/2107925418 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc024005d40 con 0x7fc020006a20 2024-04-26T20:57:05.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.701+0000 7fc042a00640 1 -- 172.21.15.138:0/2107925418 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc020006a20 msgr2=0x7fc020006ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:05.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.701+0000 7fc042a00640 1 --2- 172.21.15.138:0/2107925418 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc020006a20 0x7fc020006ea0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc02400c210 tx=0x7fc02401cc80 comp rx=0 tx=0).stop 2024-04-26T20:57:05.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.701+0000 7fc042a00640 1 -- 172.21.15.138:0/2107925418 shutdown_connections 2024-04-26T20:57:05.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.701+0000 7fc042a00640 1 --2- 172.21.15.138:0/2107925418 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc020006a20 0x7fc020006ea0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:05.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.701+0000 7fc042a00640 1 -- 172.21.15.138:0/2107925418 >> 172.21.15.138:0/2107925418 conn(0x7fc03c0d0bb0 msgr2=0x7fc03c0d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:05.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.701+0000 7fc042a00640 1 -- 172.21.15.138:0/2107925418 shutdown_connections 2024-04-26T20:57:05.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.701+0000 7fc042a00640 1 -- 172.21.15.138:0/2107925418 wait complete. 2024-04-26T20:57:05.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.701+0000 7fc042a00640 1 Processor -- start 2024-04-26T20:57:05.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.705+0000 7fc042a00640 1 -- start start 2024-04-26T20:57:05.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.705+0000 7fc042a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc020006a20 0x7fc03c15e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:05.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.705+0000 7fc042a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc03c0c4380 0x7fc03c158ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:05.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.705+0000 7fc042a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc03c0b1a20 0x7fc03c0b1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:05.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.705+0000 7fc042a00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc03c1604d0 con 0x7fc03c0c4380 2024-04-26T20:57:05.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.705+0000 7fc042a00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fc03c160350 con 0x7fc03c0b1a20 2024-04-26T20:57:05.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.705+0000 7fc042a00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fc03c160650 con 0x7fc020006a20 2024-04-26T20:57:05.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.705+0000 7fc033400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc03c0c4380 0x7fc03c158ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:05.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.705+0000 7fc033400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc03c0c4380 0x7fc03c158ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:58112/0 (socket says 172.21.15.138:58112) 2024-04-26T20:57:05.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.705+0000 7fc033400640 1 -- 172.21.15.138:0/733908637 learned_addr learned my addr 172.21.15.138:0/733908637 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:05.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.705+0000 7fc040a00640 1 --2- 172.21.15.138:0/733908637 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc03c0b1a20 0x7fc03c0b1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:05.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.705+0000 7fc03be00640 1 --2- 172.21.15.138:0/733908637 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc020006a20 0x7fc03c15e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:05.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.705+0000 7fc033400640 1 -- 172.21.15.138:0/733908637 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc020006a20 msgr2=0x7fc03c15e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:05.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.705+0000 7fc033400640 1 --2- 172.21.15.138:0/733908637 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc020006a20 0x7fc03c15e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:05.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.705+0000 7fc033400640 1 -- 172.21.15.138:0/733908637 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc03c0b1a20 msgr2=0x7fc03c0b1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:05.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.705+0000 7fc033400640 1 --2- 172.21.15.138:0/733908637 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc03c0b1a20 0x7fc03c0b1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:05.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.705+0000 7fc033400640 1 -- 172.21.15.138:0/733908637 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc03c0c4880 con 0x7fc03c0c4380 2024-04-26T20:57:05.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.705+0000 7fc040a00640 1 --2- 172.21.15.138:0/733908637 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc03c0b1a20 0x7fc03c0b1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:05.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.705+0000 7fc033400640 1 --2- 172.21.15.138:0/733908637 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc03c0c4380 0x7fc03c158ce0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc024001980 tx=0x7fc020007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:05.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.705+0000 7fc038c00640 1 -- 172.21.15.138:0/733908637 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc024007d40 con 0x7fc03c0c4380 2024-04-26T20:57:05.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.705+0000 7fc038c00640 1 -- 172.21.15.138:0/733908637 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc024004e50 con 0x7fc03c0c4380 2024-04-26T20:57:05.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.705+0000 7fc042a00640 1 -- 172.21.15.138:0/733908637 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc03c0c4b60 con 0x7fc03c0c4380 2024-04-26T20:57:05.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.705+0000 7fc038c00640 1 -- 172.21.15.138:0/733908637 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc024001440 con 0x7fc03c0c4380 2024-04-26T20:57:05.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.705+0000 7fc042a00640 1 -- 172.21.15.138:0/733908637 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc03c0c5120 con 0x7fc03c0c4380 2024-04-26T20:57:05.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.705+0000 7fc042a00640 1 -- 172.21.15.138:0/733908637 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc03c0c5900 con 0x7fc03c0c4380 2024-04-26T20:57:05.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.709+0000 7fc038c00640 1 -- 172.21.15.138:0/733908637 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc024007180 con 0x7fc03c0c4380 2024-04-26T20:57:05.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.709+0000 7fc038c00640 1 --2- 172.21.15.138:0/733908637 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc0180683b0 0x7fc01806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:05.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.709+0000 7fc038c00640 1 -- 172.21.15.138:0/733908637 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fc024120580 con 0x7fc03c0c4380 2024-04-26T20:57:05.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.709+0000 7fc03be00640 1 --2- 172.21.15.138:0/733908637 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc0180683b0 0x7fc01806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:05.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.709+0000 7fc03be00640 1 --2- 172.21.15.138:0/733908637 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc0180683b0 0x7fc01806a870 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc03c15e080 tx=0x7fc02c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:05.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.713+0000 7fc038c00640 1 -- 172.21.15.138:0/733908637 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc024016990 con 0x7fc03c0c4380 2024-04-26T20:57:05.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.869+0000 7fc042a00640 1 -- 172.21.15.138:0/733908637 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc03c0d19c0 con 0x7fc03c0c4380 2024-04-26T20:57:05.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.869+0000 7fc038c00640 1 -- 172.21.15.138:0/733908637 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7fc0240f06d0 con 0x7fc03c0c4380 2024-04-26T20:57:05.873 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 1 2024-04-26T20:57:05.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.869+0000 7fc042a00640 1 -- 172.21.15.138:0/733908637 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc0180683b0 msgr2=0x7fc01806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:05.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.869+0000 7fc042a00640 1 --2- 172.21.15.138:0/733908637 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc0180683b0 0x7fc01806a870 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc03c15e080 tx=0x7fc02c008040 comp rx=0 tx=0).stop 2024-04-26T20:57:05.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.869+0000 7fc042a00640 1 -- 172.21.15.138:0/733908637 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc03c0c4380 msgr2=0x7fc03c158ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:05.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.869+0000 7fc042a00640 1 --2- 172.21.15.138:0/733908637 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc03c0c4380 0x7fc03c158ce0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc024001980 tx=0x7fc020007a50 comp rx=0 tx=0).stop 2024-04-26T20:57:05.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.873+0000 7fc042a00640 1 -- 172.21.15.138:0/733908637 shutdown_connections 2024-04-26T20:57:05.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.873+0000 7fc042a00640 1 --2- 172.21.15.138:0/733908637 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc0180683b0 0x7fc01806a870 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:05.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.873+0000 7fc042a00640 1 --2- 172.21.15.138:0/733908637 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc03c0b1a20 0x7fc03c0b1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:05.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.873+0000 7fc042a00640 1 --2- 172.21.15.138:0/733908637 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc03c0c4380 0x7fc03c158ce0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:05.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.873+0000 7fc042a00640 1 --2- 172.21.15.138:0/733908637 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc020006a20 0x7fc03c15e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:05.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.873+0000 7fc042a00640 1 -- 172.21.15.138:0/733908637 >> 172.21.15.138:0/733908637 conn(0x7fc03c0d0bb0 msgr2=0x7fc03c0ce760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:05.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.873+0000 7fc042a00640 1 -- 172.21.15.138:0/733908637 shutdown_connections 2024-04-26T20:57:05.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:05.873+0000 7fc042a00640 1 -- 172.21.15.138:0/733908637 wait complete. 2024-04-26T20:57:05.894 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T20:57:06.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.029+0000 7f3e62200640 1 Processor -- start 2024-04-26T20:57:06.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.033+0000 7f3e62200640 1 -- start start 2024-04-26T20:57:06.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.033+0000 7f3e62200640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f3e5c15d0d0 0x7f3e5c0d0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:06.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.033+0000 7f3e62200640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f3e5c0cfd40 0x7f3e5c0d1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:06.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.033+0000 7f3e62200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3e5c0d1880 0x7f3e5c0cd970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:06.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.033+0000 7f3e62200640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f3e5c0d1cd0 con 0x7f3e5c15d0d0 2024-04-26T20:57:06.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.033+0000 7f3e62200640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f3e5c0cedf0 con 0x7f3e5c0cfd40 2024-04-26T20:57:06.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.033+0000 7f3e62200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f3e5c0d3920 con 0x7f3e5c0d1880 2024-04-26T20:57:06.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.033+0000 7f3e5b400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f3e5c15d0d0 0x7f3e5c0d0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:06.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.033+0000 7f3e5b400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f3e5c15d0d0 0x7f3e5c0d0b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:58124/0 (socket says 172.21.15.138:58124) 2024-04-26T20:57:06.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.033+0000 7f3e5b400640 1 -- 172.21.15.138:0/4191125491 learned_addr learned my addr 172.21.15.138:0/4191125491 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:06.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.033+0000 7f3e5aa00640 1 --2- 172.21.15.138:0/4191125491 >> v2:172.21.15.143:3300/0 conn(0x7f3e5c0cfd40 0x7f3e5c0d1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:06.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.033+0000 7f3e5be00640 1 --2- 172.21.15.138:0/4191125491 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3e5c0d1880 0x7f3e5c0cd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:06.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.033+0000 7f3e5b400640 1 -- 172.21.15.138:0/4191125491 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3e5c0d1880 msgr2=0x7f3e5c0cd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:06.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.033+0000 7f3e5b400640 1 --2- 172.21.15.138:0/4191125491 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3e5c0d1880 0x7f3e5c0cd970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:06.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.033+0000 7f3e5b400640 1 -- 172.21.15.138:0/4191125491 >> v2:172.21.15.143:3300/0 conn(0x7f3e5c0cfd40 msgr2=0x7f3e5c0d1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:06.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.033+0000 7f3e5b400640 1 --2- 172.21.15.138:0/4191125491 >> v2:172.21.15.143:3300/0 conn(0x7f3e5c0cfd40 0x7f3e5c0d1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:06.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.033+0000 7f3e5b400640 1 -- 172.21.15.138:0/4191125491 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e5c0d3c00 con 0x7f3e5c15d0d0 2024-04-26T20:57:06.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.037+0000 7f3e5b400640 1 --2- 172.21.15.138:0/4191125491 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e5c15d0d0 0x7f3e5c0d0b40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c0c9de0 tx=0x7f3e4c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e3d90847ec056f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:06.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.037+0000 7f3e5a000640 1 -- 172.21.15.138:0/4191125491 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c0b1070 con 0x7f3e5c15d0d0 2024-04-26T20:57:06.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.037+0000 7f3e5a000640 1 -- 172.21.15.138:0/4191125491 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e4c0ac620 con 0x7f3e5c15d0d0 2024-04-26T20:57:06.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.037+0000 7f3e5a000640 1 -- 172.21.15.138:0/4191125491 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c0ac9f0 con 0x7f3e5c15d0d0 2024-04-26T20:57:06.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.037+0000 7f3e62200640 1 -- 172.21.15.138:0/4191125491 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e5c15d0d0 msgr2=0x7f3e5c0d0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:06.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.037+0000 7f3e62200640 1 --2- 172.21.15.138:0/4191125491 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e5c15d0d0 0x7f3e5c0d0b40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c0c9de0 tx=0x7f3e4c01c4f0 comp rx=0 tx=0).stop 2024-04-26T20:57:06.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.037+0000 7f3e62200640 1 -- 172.21.15.138:0/4191125491 shutdown_connections 2024-04-26T20:57:06.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.037+0000 7f3e62200640 1 --2- 172.21.15.138:0/4191125491 >> v2:172.21.15.143:3300/0 conn(0x7f3e5c0cfd40 0x7f3e5c0d1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:06.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.037+0000 7f3e62200640 1 --2- 172.21.15.138:0/4191125491 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3e5c0d1880 0x7f3e5c0cd970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:06.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.037+0000 7f3e62200640 1 --2- 172.21.15.138:0/4191125491 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e5c15d0d0 0x7f3e5c0d0b40 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:06.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.037+0000 7f3e62200640 1 -- 172.21.15.138:0/4191125491 >> 172.21.15.138:0/4191125491 conn(0x7f3e5c0d2d60 msgr2=0x7f3e5c0d3170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:06.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.037+0000 7f3e62200640 1 -- 172.21.15.138:0/4191125491 shutdown_connections 2024-04-26T20:57:06.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.037+0000 7f3e62200640 1 -- 172.21.15.138:0/4191125491 wait complete. 2024-04-26T20:57:06.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.037+0000 7f3e62200640 1 Processor -- start 2024-04-26T20:57:06.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.037+0000 7f3e62200640 1 -- start start 2024-04-26T20:57:06.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.041+0000 7f3e62200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e5c0cfd40 0x7f3e5c06d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:06.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.041+0000 7f3e62200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3e5c0d1880 0x7f3e5c0b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:06.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.041+0000 7f3e62200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e5c15f0e0 0x7f3e5c06eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:06.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.041+0000 7f3e62200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5c0ce840 con 0x7f3e5c0cfd40 2024-04-26T20:57:06.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.041+0000 7f3e62200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5c0ce6c0 con 0x7f3e5c15f0e0 2024-04-26T20:57:06.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.041+0000 7f3e62200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f3e5c0ce9c0 con 0x7f3e5c0d1880 2024-04-26T20:57:06.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.041+0000 7f3e5b400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e5c0cfd40 0x7f3e5c06d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:06.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.041+0000 7f3e5b400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e5c0cfd40 0x7f3e5c06d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:58140/0 (socket says 172.21.15.138:58140) 2024-04-26T20:57:06.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.041+0000 7f3e5b400640 1 -- 172.21.15.138:0/4218625420 learned_addr learned my addr 172.21.15.138:0/4218625420 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:06.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.041+0000 7f3e5aa00640 1 --2- 172.21.15.138:0/4218625420 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3e5c0d1880 0x7f3e5c0b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:06.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.041+0000 7f3e5be00640 1 --2- 172.21.15.138:0/4218625420 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e5c15f0e0 0x7f3e5c06eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:06.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.041+0000 7f3e5b400640 1 -- 172.21.15.138:0/4218625420 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3e5c0d1880 msgr2=0x7f3e5c0b78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:06.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.041+0000 7f3e5b400640 1 --2- 172.21.15.138:0/4218625420 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3e5c0d1880 0x7f3e5c0b78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:06.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.041+0000 7f3e5b400640 1 -- 172.21.15.138:0/4218625420 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e5c15f0e0 msgr2=0x7f3e5c06eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:06.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.041+0000 7f3e5b400640 1 --2- 172.21.15.138:0/4218625420 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e5c15f0e0 0x7f3e5c06eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:06.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.041+0000 7f3e5b400640 1 -- 172.21.15.138:0/4218625420 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e5c06daf0 con 0x7f3e5c0cfd40 2024-04-26T20:57:06.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.041+0000 7f3e5aa00640 1 --2- 172.21.15.138:0/4218625420 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3e5c0d1880 0x7f3e5c0b78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:06.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.041+0000 7f3e5be00640 1 --2- 172.21.15.138:0/4218625420 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e5c15f0e0 0x7f3e5c06eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:06.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.041+0000 7f3e5b400640 1 --2- 172.21.15.138:0/4218625420 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e5c0cfd40 0x7f3e5c06d410 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c01cd90 tx=0x7f3e4c019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:06.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.041+0000 7f3e53400640 1 -- 172.21.15.138:0/4218625420 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c0b1040 con 0x7f3e5c0cfd40 2024-04-26T20:57:06.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.041+0000 7f3e53400640 1 -- 172.21.15.138:0/4218625420 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e4c0ba070 con 0x7f3e5c0cfd40 2024-04-26T20:57:06.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.041+0000 7f3e62200640 1 -- 172.21.15.138:0/4218625420 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e5c06ddd0 con 0x7f3e5c0cfd40 2024-04-26T20:57:06.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.041+0000 7f3e53400640 1 -- 172.21.15.138:0/4218625420 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c0b5660 con 0x7f3e5c0cfd40 2024-04-26T20:57:06.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.041+0000 7f3e62200640 1 -- 172.21.15.138:0/4218625420 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e5c06e390 con 0x7f3e5c0cfd40 2024-04-26T20:57:06.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.041+0000 7f3e62200640 1 -- 172.21.15.138:0/4218625420 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e5c069430 con 0x7f3e5c0cfd40 2024-04-26T20:57:06.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.041+0000 7f3e53400640 1 -- 172.21.15.138:0/4218625420 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3e4c0b5800 con 0x7f3e5c0cfd40 2024-04-26T20:57:06.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.045+0000 7f3e53400640 1 --2- 172.21.15.138:0/4218625420 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f3e3c068380 0x7f3e3c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:06.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.045+0000 7f3e53400640 1 -- 172.21.15.138:0/4218625420 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f3e4c120af0 con 0x7f3e5c0cfd40 2024-04-26T20:57:06.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.045+0000 7f3e5aa00640 1 --2- 172.21.15.138:0/4218625420 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f3e3c068380 0x7f3e3c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:06.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.045+0000 7f3e5aa00640 1 --2- 172.21.15.138:0/4218625420 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f3e3c068380 0x7f3e3c06a840 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c0b83d0 tx=0x7f3e48008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:06.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.049+0000 7f3e53400640 1 -- 172.21.15.138:0/4218625420 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3e4c016110 con 0x7f3e5c0cfd40 2024-04-26T20:57:06.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.209+0000 7f3e62200640 1 -- 172.21.15.138:0/4218625420 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f3e5c071120 con 0x7f3e5c0cfd40 2024-04-26T20:57:06.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.209+0000 7f3e53400640 1 -- 172.21.15.138:0/4218625420 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f3e4c0f0cd0 con 0x7f3e5c0cfd40 2024-04-26T20:57:06.213 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 32 2024-04-26T20:57:06.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.209+0000 7f3e62200640 1 -- 172.21.15.138:0/4218625420 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f3e3c068380 msgr2=0x7f3e3c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:06.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.209+0000 7f3e62200640 1 --2- 172.21.15.138:0/4218625420 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f3e3c068380 0x7f3e3c06a840 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c0b83d0 tx=0x7f3e48008040 comp rx=0 tx=0).stop 2024-04-26T20:57:06.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.209+0000 7f3e62200640 1 -- 172.21.15.138:0/4218625420 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e5c0cfd40 msgr2=0x7f3e5c06d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:06.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.209+0000 7f3e62200640 1 --2- 172.21.15.138:0/4218625420 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e5c0cfd40 0x7f3e5c06d410 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c01cd90 tx=0x7f3e4c019290 comp rx=0 tx=0).stop 2024-04-26T20:57:06.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.209+0000 7f3e62200640 1 -- 172.21.15.138:0/4218625420 shutdown_connections 2024-04-26T20:57:06.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.209+0000 7f3e62200640 1 --2- 172.21.15.138:0/4218625420 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f3e3c068380 0x7f3e3c06a840 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:06.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.209+0000 7f3e62200640 1 --2- 172.21.15.138:0/4218625420 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e5c15f0e0 0x7f3e5c06eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:06.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.209+0000 7f3e62200640 1 --2- 172.21.15.138:0/4218625420 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3e5c0d1880 0x7f3e5c0b78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:06.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.209+0000 7f3e62200640 1 --2- 172.21.15.138:0/4218625420 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e5c0cfd40 0x7f3e5c06d410 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:06.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.209+0000 7f3e62200640 1 -- 172.21.15.138:0/4218625420 >> 172.21.15.138:0/4218625420 conn(0x7f3e5c0d2d60 msgr2=0x7f3e5c1562e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:06.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.209+0000 7f3e62200640 1 -- 172.21.15.138:0/4218625420 shutdown_connections 2024-04-26T20:57:06.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.209+0000 7f3e62200640 1 -- 172.21.15.138:0/4218625420 wait complete. 2024-04-26T20:57:06.234 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T20:57:06.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.369+0000 7f75c2000640 1 Processor -- start 2024-04-26T20:57:06.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.369+0000 7f75c2000640 1 -- start start 2024-04-26T20:57:06.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.369+0000 7f75c2000640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f75bc15e180 0x7f75bc0cb200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:06.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.369+0000 7f75c2000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f75bc0cb740 0x7f75bc0b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:06.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.369+0000 7f75c2000640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75bc0cd210 con 0x7f75bc15aa60 2024-04-26T20:57:06.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.369+0000 7f75c2000640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f75bc15d6a0 con 0x7f75bc0cb740 2024-04-26T20:57:06.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.369+0000 7f75c2000640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f75bc15d980 con 0x7f75bc15e180 2024-04-26T20:57:06.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.369+0000 7f75bb400640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f75bc15aa60 0x7f75bc0cc7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:37796/0 (socket says 172.21.15.138:37796) 2024-04-26T20:57:06.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.369+0000 7f75bb400640 1 -- 172.21.15.138:0/1998408525 learned_addr learned my addr 172.21.15.138:0/1998408525 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:06.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.369+0000 7f75bbe00640 1 --2- 172.21.15.138:0/1998408525 >> v2:172.21.15.138:3300/0 conn(0x7f75bc0cb740 0x7f75bc0b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:06.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.369+0000 7f75baa00640 1 --2- 172.21.15.138:0/1998408525 >> v2:172.21.15.143:3300/0 conn(0x7f75bc15e180 0x7f75bc0cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:06.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.369+0000 7f75bbe00640 1 -- 172.21.15.138:0/1998408525 >> v2:172.21.15.143:3300/0 conn(0x7f75bc15e180 msgr2=0x7f75bc0cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:06.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.369+0000 7f75bbe00640 1 --2- 172.21.15.138:0/1998408525 >> v2:172.21.15.143:3300/0 conn(0x7f75bc15e180 0x7f75bc0cb200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:06.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.369+0000 7f75bbe00640 1 -- 172.21.15.138:0/1998408525 >> v1:172.21.15.138:6789/0 conn(0x7f75bc15aa60 legacy=0x7f75bc0cc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:06.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.369+0000 7f75bbe00640 1 -- 172.21.15.138:0/1998408525 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75bc15dc60 con 0x7f75bc0cb740 2024-04-26T20:57:06.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.369+0000 7f75ba000640 1 -- 172.21.15.138:0/1998408525 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2269319506 0 0) 0x7f75bc0cd210 con 0x7f75bc15aa60 2024-04-26T20:57:06.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.373+0000 7f75bbe00640 1 --2- 172.21.15.138:0/1998408525 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75bc0cb740 0x7f75bc0b5aa0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f75bc074b90 tx=0x7f75b401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cad389976091acd5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:06.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.373+0000 7f75ba000640 1 -- 172.21.15.138:0/1998408525 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b40b2070 con 0x7f75bc0cb740 2024-04-26T20:57:06.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.373+0000 7f75ba000640 1 -- 172.21.15.138:0/1998408525 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75b40a57f0 con 0x7f75bc0cb740 2024-04-26T20:57:06.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.373+0000 7f75ba000640 1 -- 172.21.15.138:0/1998408525 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b40a5bc0 con 0x7f75bc0cb740 2024-04-26T20:57:06.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.373+0000 7f75c2000640 1 -- 172.21.15.138:0/1998408525 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75bc0cb740 msgr2=0x7f75bc0b5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:06.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.373+0000 7f75c2000640 1 --2- 172.21.15.138:0/1998408525 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75bc0cb740 0x7f75bc0b5aa0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f75bc074b90 tx=0x7f75b401c930 comp rx=0 tx=0).stop 2024-04-26T20:57:06.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.373+0000 7f75c2000640 1 -- 172.21.15.138:0/1998408525 shutdown_connections 2024-04-26T20:57:06.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.373+0000 7f75c2000640 1 --2- 172.21.15.138:0/1998408525 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75bc0cb740 0x7f75bc0b5aa0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:06.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.373+0000 7f75c2000640 1 --2- 172.21.15.138:0/1998408525 >> v2:172.21.15.143:3300/0 conn(0x7f75bc15e180 0x7f75bc0cb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:06.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.373+0000 7f75c2000640 1 -- 172.21.15.138:0/1998408525 >> 172.21.15.138:0/1998408525 conn(0x7f75bc0d0bb0 msgr2=0x7f75bc0d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:06.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.373+0000 7f75c2000640 1 -- 172.21.15.138:0/1998408525 shutdown_connections 2024-04-26T20:57:06.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.373+0000 7f75c2000640 1 -- 172.21.15.138:0/1998408525 wait complete. 2024-04-26T20:57:06.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.377+0000 7f75c2000640 1 Processor -- start 2024-04-26T20:57:06.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.377+0000 7f75c2000640 1 -- start start 2024-04-26T20:57:06.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.377+0000 7f75c2000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f75bc0cb740 0x7f75bc0c46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:06.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.377+0000 7f75c2000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75bc15aa60 0x7f75bc0af9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:06.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.377+0000 7f75c2000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75bc15e180 0x7f75bc0aff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:06.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.377+0000 7f75c2000640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f75bc06dee0 con 0x7f75bc15aa60 2024-04-26T20:57:06.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.377+0000 7f75c2000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f75bc072240 con 0x7f75bc0cb740 2024-04-26T20:57:06.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.377+0000 7f75c2000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f75bc06e060 con 0x7f75bc15e180 2024-04-26T20:57:06.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.377+0000 7f75baa00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75bc15aa60 0x7f75bc0af9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:06.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.377+0000 7f75baa00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75bc15aa60 0x7f75bc0af9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:58154/0 (socket says 172.21.15.138:58154) 2024-04-26T20:57:06.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.377+0000 7f75baa00640 1 -- 172.21.15.138:0/4077460433 learned_addr learned my addr 172.21.15.138:0/4077460433 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:06.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.377+0000 7f75bb400640 1 --2- 172.21.15.138:0/4077460433 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f75bc0cb740 0x7f75bc0c46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:06.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.377+0000 7f75bbe00640 1 --2- 172.21.15.138:0/4077460433 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75bc15e180 0x7f75bc0aff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:06.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.377+0000 7f75baa00640 1 -- 172.21.15.138:0/4077460433 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75bc15e180 msgr2=0x7f75bc0aff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:06.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.377+0000 7f75baa00640 1 --2- 172.21.15.138:0/4077460433 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75bc15e180 0x7f75bc0aff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:06.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.377+0000 7f75baa00640 1 -- 172.21.15.138:0/4077460433 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f75bc0cb740 msgr2=0x7f75bc0c46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:06.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.377+0000 7f75baa00640 1 --2- 172.21.15.138:0/4077460433 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f75bc0cb740 0x7f75bc0c46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:06.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.377+0000 7f75baa00640 1 -- 172.21.15.138:0/4077460433 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75bc1f8050 con 0x7f75bc15aa60 2024-04-26T20:57:06.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.377+0000 7f75baa00640 1 --2- 172.21.15.138:0/4077460433 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75bc15aa60 0x7f75bc0af9f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f75a800d5f0 tx=0x7f75a800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:06.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.377+0000 7f75b3400640 1 -- 172.21.15.138:0/4077460433 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a80125f0 con 0x7f75bc15aa60 2024-04-26T20:57:06.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.377+0000 7f75b3400640 1 -- 172.21.15.138:0/4077460433 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75a8019070 con 0x7f75bc15aa60 2024-04-26T20:57:06.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.377+0000 7f75b3400640 1 -- 172.21.15.138:0/4077460433 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a80129b0 con 0x7f75bc15aa60 2024-04-26T20:57:06.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.377+0000 7f75c2000640 1 -- 172.21.15.138:0/4077460433 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75bc1f8330 con 0x7f75bc15aa60 2024-04-26T20:57:06.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.377+0000 7f75c2000640 1 -- 172.21.15.138:0/4077460433 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75bc1f88f0 con 0x7f75bc15aa60 2024-04-26T20:57:06.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.377+0000 7f75c2000640 1 -- 172.21.15.138:0/4077460433 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75bc069430 con 0x7f75bc15aa60 2024-04-26T20:57:06.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.381+0000 7f75b3400640 1 -- 172.21.15.138:0/4077460433 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f75a8012b50 con 0x7f75bc15aa60 2024-04-26T20:57:06.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.381+0000 7f75b3400640 1 --2- 172.21.15.138:0/4077460433 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f759c068380 0x7f759c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:06.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.381+0000 7f75b3400640 1 -- 172.21.15.138:0/4077460433 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f75a8087190 con 0x7f75bc15aa60 2024-04-26T20:57:06.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.381+0000 7f75bb400640 1 --2- 172.21.15.138:0/4077460433 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f759c068380 0x7f759c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:06.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.381+0000 7f75bb400640 1 --2- 172.21.15.138:0/4077460433 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f759c068380 0x7f759c06a840 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f75ac000f70 tx=0x7f75ac007b80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:06.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.385+0000 7f75b3400640 1 -- 172.21.15.138:0/4077460433 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f75a8057370 con 0x7f75bc15aa60 2024-04-26T20:57:06.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.541+0000 7f75c2000640 1 -- 172.21.15.138:0/4077460433 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f75bc06fbd0 con 0x7f75bc15aa60 2024-04-26T20:57:06.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.541+0000 7f75b3400640 1 -- 172.21.15.138:0/4077460433 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f75a805d030 con 0x7f75bc15aa60 2024-04-26T20:57:06.546 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 64 2024-04-26T20:57:06.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.545+0000 7f75c2000640 1 -- 172.21.15.138:0/4077460433 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f759c068380 msgr2=0x7f759c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:06.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.545+0000 7f75c2000640 1 --2- 172.21.15.138:0/4077460433 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f759c068380 0x7f759c06a840 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f75ac000f70 tx=0x7f75ac007b80 comp rx=0 tx=0).stop 2024-04-26T20:57:06.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.545+0000 7f75c2000640 1 -- 172.21.15.138:0/4077460433 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75bc15aa60 msgr2=0x7f75bc0af9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:06.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.545+0000 7f75c2000640 1 --2- 172.21.15.138:0/4077460433 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75bc15aa60 0x7f75bc0af9f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f75a800d5f0 tx=0x7f75a800dab0 comp rx=0 tx=0).stop 2024-04-26T20:57:06.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.545+0000 7f75c2000640 1 -- 172.21.15.138:0/4077460433 shutdown_connections 2024-04-26T20:57:06.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.545+0000 7f75c2000640 1 --2- 172.21.15.138:0/4077460433 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f759c068380 0x7f759c06a840 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:06.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.545+0000 7f75c2000640 1 --2- 172.21.15.138:0/4077460433 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75bc15e180 0x7f75bc0aff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:06.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.545+0000 7f75c2000640 1 --2- 172.21.15.138:0/4077460433 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75bc15aa60 0x7f75bc0af9f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:06.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.545+0000 7f75c2000640 1 --2- 172.21.15.138:0/4077460433 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f75bc0cb740 0x7f75bc0c46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:06.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.545+0000 7f75c2000640 1 -- 172.21.15.138:0/4077460433 >> 172.21.15.138:0/4077460433 conn(0x7f75bc0d0bb0 msgr2=0x7f75bc0b06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:06.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.545+0000 7f75c2000640 1 -- 172.21.15.138:0/4077460433 shutdown_connections 2024-04-26T20:57:06.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.545+0000 7f75c2000640 1 -- 172.21.15.138:0/4077460433 wait complete. 2024-04-26T20:57:06.568 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T20:57:06.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.701+0000 7f87f6600640 1 Processor -- start 2024-04-26T20:57:06.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.701+0000 7f87f6600640 1 -- start start 2024-04-26T20:57:06.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.701+0000 7f87f6600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87f015aa60 0x7f87f00cc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:06.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.701+0000 7f87f6600640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f87f00cb910 0x7f87f00b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:06.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.705+0000 7f87f6600640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87f00cd210 con 0x7f87f00ccd20 2024-04-26T20:57:06.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.705+0000 7f87f6600640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f87f015d6a0 con 0x7f87f00cb910 2024-04-26T20:57:06.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.705+0000 7f87f6600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f87f015d980 con 0x7f87f015aa60 2024-04-26T20:57:06.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.705+0000 7f87efe00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f87f00cb910 0x7f87f00b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:06.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.705+0000 7f87efe00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f87f00cb910 0x7f87f00b5aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:58162/0 (socket says 172.21.15.138:58162) 2024-04-26T20:57:06.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.705+0000 7f87efe00640 1 -- 172.21.15.138:0/4229736789 learned_addr learned my addr 172.21.15.138:0/4229736789 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:06.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.705+0000 7f87ef400640 1 --2- 172.21.15.138:0/4229736789 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87f015aa60 0x7f87f00cc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:06.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.705+0000 7f87efe00640 1 -- 172.21.15.138:0/4229736789 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87f015aa60 msgr2=0x7f87f00cc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:06.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.705+0000 7f87efe00640 1 --2- 172.21.15.138:0/4229736789 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87f015aa60 0x7f87f00cc7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:06.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.705+0000 7f87efe00640 1 -- 172.21.15.138:0/4229736789 >> v1:172.21.15.143:6789/0 conn(0x7f87f00ccd20 legacy=0x7f87f00cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:06.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.705+0000 7f87efe00640 1 -- 172.21.15.138:0/4229736789 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87f015dc60 con 0x7f87f00cb910 2024-04-26T20:57:06.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.705+0000 7f87efe00640 1 --2- 172.21.15.138:0/4229736789 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f87f00cb910 0x7f87f00b5aa0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f87e8009870 tx=0x7f87e801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21b8511310c4ce61 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:06.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.705+0000 7f87ee000640 1 -- 172.21.15.138:0/4229736789 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e80b2070 con 0x7f87f00cb910 2024-04-26T20:57:06.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.705+0000 7f87ee000640 1 -- 172.21.15.138:0/4229736789 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87e80a9070 con 0x7f87f00cb910 2024-04-26T20:57:06.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.705+0000 7f87ee000640 1 -- 172.21.15.138:0/4229736789 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e80ad880 con 0x7f87f00cb910 2024-04-26T20:57:06.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.709+0000 7f87f6600640 1 -- 172.21.15.138:0/4229736789 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f87f00cb910 msgr2=0x7f87f00b5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:06.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.709+0000 7f87f6600640 1 --2- 172.21.15.138:0/4229736789 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f87f00cb910 0x7f87f00b5aa0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f87e8009870 tx=0x7f87e801c560 comp rx=0 tx=0).stop 2024-04-26T20:57:06.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.709+0000 7f87f6600640 1 -- 172.21.15.138:0/4229736789 shutdown_connections 2024-04-26T20:57:06.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.709+0000 7f87f6600640 1 --2- 172.21.15.138:0/4229736789 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f87f00cb910 0x7f87f00b5aa0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:06.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.709+0000 7f87f6600640 1 --2- 172.21.15.138:0/4229736789 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87f015aa60 0x7f87f00cc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:06.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.709+0000 7f87f6600640 1 -- 172.21.15.138:0/4229736789 >> 172.21.15.138:0/4229736789 conn(0x7f87f00d0bb0 msgr2=0x7f87f00d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:06.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.709+0000 7f87f6600640 1 -- 172.21.15.138:0/4229736789 shutdown_connections 2024-04-26T20:57:06.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.709+0000 7f87f6600640 1 -- 172.21.15.138:0/4229736789 wait complete. 2024-04-26T20:57:06.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.709+0000 7f87f6600640 1 Processor -- start 2024-04-26T20:57:06.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.709+0000 7f87f6600640 1 -- start start 2024-04-26T20:57:06.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.709+0000 7f87f6600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f87f00cb910 0x7f87f0157640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:06.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.709+0000 7f87f6600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f87f00ccd20 0x7f87f0150580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:06.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.709+0000 7f87f6600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87f015aa60 0x7f87f00b3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:06.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.709+0000 7f87f6600640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f87f006e0f0 con 0x7f87f00cb910 2024-04-26T20:57:06.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.709+0000 7f87f6600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f87f0072240 con 0x7f87f00ccd20 2024-04-26T20:57:06.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.709+0000 7f87f6600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f87f006e270 con 0x7f87f015aa60 2024-04-26T20:57:06.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.709+0000 7f87ef400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f87f00cb910 0x7f87f0157640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:06.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.709+0000 7f87ef400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f87f00cb910 0x7f87f0157640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:58172/0 (socket says 172.21.15.138:58172) 2024-04-26T20:57:06.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.709+0000 7f87ef400640 1 -- 172.21.15.138:0/446005945 learned_addr learned my addr 172.21.15.138:0/446005945 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:06.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.709+0000 7f87eea00640 1 --2- 172.21.15.138:0/446005945 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f87f00ccd20 0x7f87f0150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:06.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.709+0000 7f87efe00640 1 --2- 172.21.15.138:0/446005945 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87f015aa60 0x7f87f00b3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:06.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.709+0000 7f87ef400640 1 -- 172.21.15.138:0/446005945 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87f015aa60 msgr2=0x7f87f00b3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:06.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.709+0000 7f87ef400640 1 --2- 172.21.15.138:0/446005945 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87f015aa60 0x7f87f00b3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:06.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.709+0000 7f87ef400640 1 -- 172.21.15.138:0/446005945 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f87f00ccd20 msgr2=0x7f87f0150580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:06.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.709+0000 7f87ef400640 1 --2- 172.21.15.138:0/446005945 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f87f00ccd20 0x7f87f0150580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:06.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.709+0000 7f87ef400640 1 -- 172.21.15.138:0/446005945 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87f01545b0 con 0x7f87f00cb910 2024-04-26T20:57:06.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.709+0000 7f87eea00640 1 --2- 172.21.15.138:0/446005945 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f87f00ccd20 0x7f87f0150580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:06.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.709+0000 7f87ef400640 1 --2- 172.21.15.138:0/446005945 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f87f00cb910 0x7f87f0157640 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f87e0009d10 tx=0x7f87e000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:06.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.713+0000 7f87e7400640 1 -- 172.21.15.138:0/446005945 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e0018020 con 0x7f87f00cb910 2024-04-26T20:57:06.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.713+0000 7f87e7400640 1 -- 172.21.15.138:0/446005945 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87e0014480 con 0x7f87f00cb910 2024-04-26T20:57:06.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.713+0000 7f87e7400640 1 -- 172.21.15.138:0/446005945 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e0014830 con 0x7f87f00cb910 2024-04-26T20:57:06.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.713+0000 7f87f6600640 1 -- 172.21.15.138:0/446005945 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87f01542d0 con 0x7f87f00cb910 2024-04-26T20:57:06.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.713+0000 7f87f6600640 1 -- 172.21.15.138:0/446005945 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87f01563a0 con 0x7f87f00cb910 2024-04-26T20:57:06.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.713+0000 7f87f6600640 1 -- 172.21.15.138:0/446005945 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87f0069430 con 0x7f87f00cb910 2024-04-26T20:57:06.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.713+0000 7f87e7400640 1 -- 172.21.15.138:0/446005945 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f87e001b020 con 0x7f87f00cb910 2024-04-26T20:57:06.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.713+0000 7f87e7400640 1 --2- 172.21.15.138:0/446005945 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f87d00683b0 0x7f87d006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:06.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.713+0000 7f87e7400640 1 -- 172.21.15.138:0/446005945 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f87e0087730 con 0x7f87f00cb910 2024-04-26T20:57:06.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.713+0000 7f87eea00640 1 --2- 172.21.15.138:0/446005945 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f87d00683b0 0x7f87d006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:06.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.717+0000 7f87eea00640 1 --2- 172.21.15.138:0/446005945 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f87d00683b0 0x7f87d006a870 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f87f00c4360 tx=0x7f87dc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:06.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.717+0000 7f87e7400640 1 -- 172.21.15.138:0/446005945 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f87e0022070 con 0x7f87f00cb910 2024-04-26T20:57:06.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.873+0000 7f87f6600640 1 -- 172.21.15.138:0/446005945 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f87f006fbd0 con 0x7f87f00cb910 2024-04-26T20:57:06.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.873+0000 7f87e7400640 1 -- 172.21.15.138:0/446005945 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f87e0010040 con 0x7f87f00cb910 2024-04-26T20:57:06.878 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 32 2024-04-26T20:57:06.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.877+0000 7f87f6600640 1 -- 172.21.15.138:0/446005945 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f87d00683b0 msgr2=0x7f87d006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:06.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.877+0000 7f87f6600640 1 --2- 172.21.15.138:0/446005945 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f87d00683b0 0x7f87d006a870 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f87f00c4360 tx=0x7f87dc009040 comp rx=0 tx=0).stop 2024-04-26T20:57:06.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.877+0000 7f87f6600640 1 -- 172.21.15.138:0/446005945 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f87f00cb910 msgr2=0x7f87f0157640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:06.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.877+0000 7f87f6600640 1 --2- 172.21.15.138:0/446005945 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f87f00cb910 0x7f87f0157640 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f87e0009d10 tx=0x7f87e000c490 comp rx=0 tx=0).stop 2024-04-26T20:57:06.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.877+0000 7f87f6600640 1 -- 172.21.15.138:0/446005945 shutdown_connections 2024-04-26T20:57:06.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.877+0000 7f87f6600640 1 --2- 172.21.15.138:0/446005945 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f87d00683b0 0x7f87d006a870 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:06.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.877+0000 7f87f6600640 1 --2- 172.21.15.138:0/446005945 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87f015aa60 0x7f87f00b3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:06.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.877+0000 7f87f6600640 1 --2- 172.21.15.138:0/446005945 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f87f00ccd20 0x7f87f0150580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:06.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.877+0000 7f87f6600640 1 --2- 172.21.15.138:0/446005945 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f87f00cb910 0x7f87f0157640 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:06.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.877+0000 7f87f6600640 1 -- 172.21.15.138:0/446005945 >> 172.21.15.138:0/446005945 conn(0x7f87f00d0bb0 msgr2=0x7f87f006e670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:06.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.877+0000 7f87f6600640 1 -- 172.21.15.138:0/446005945 shutdown_connections 2024-04-26T20:57:06.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:06.877+0000 7f87f6600640 1 -- 172.21.15.138:0/446005945 wait complete. 2024-04-26T20:57:06.899 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:57:07.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.029+0000 7f6fff200640 1 Processor -- start 2024-04-26T20:57:07.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.029+0000 7f6fff200640 1 -- start start 2024-04-26T20:57:07.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.029+0000 7f6fff200640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f6ff80cbe00 0x7f6ff806de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:07.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.029+0000 7f6fff200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ff80cc1e0 0x7f6ff8073b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:07.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.029+0000 7f6fff200640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6ff80ce6f0 0x7f6ff80ceb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:07.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.029+0000 7f6fff200640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f6ff8073680 con 0x7f6ff80cbe00 2024-04-26T20:57:07.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.029+0000 7f6fff200640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f6ff80727f0 con 0x7f6ff80ce6f0 2024-04-26T20:57:07.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.029+0000 7f6fff200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f6ff8072a70 con 0x7f6ff80cc1e0 2024-04-26T20:57:07.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.033+0000 7f6ff7e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f6ff80cbe00 0x7f6ff806de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:07.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.033+0000 7f6ff7e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f6ff80cbe00 0x7f6ff806de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:58174/0 (socket says 172.21.15.138:58174) 2024-04-26T20:57:07.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.033+0000 7f6ff7e00640 1 -- 172.21.15.138:0/1827556820 learned_addr learned my addr 172.21.15.138:0/1827556820 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:07.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.033+0000 7f6fefe00640 1 --2- 172.21.15.138:0/1827556820 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ff80cc1e0 0x7f6ff8073b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:07.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.033+0000 7f6ffd200640 1 --2- 172.21.15.138:0/1827556820 >> v2:172.21.15.143:3300/0 conn(0x7f6ff80ce6f0 0x7f6ff80ceb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:07.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.033+0000 7f6ff7e00640 1 -- 172.21.15.138:0/1827556820 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ff80cc1e0 msgr2=0x7f6ff8073b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:07.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.033+0000 7f6ff7e00640 1 --2- 172.21.15.138:0/1827556820 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ff80cc1e0 0x7f6ff8073b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:07.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.033+0000 7f6ff7e00640 1 -- 172.21.15.138:0/1827556820 >> v2:172.21.15.143:3300/0 conn(0x7f6ff80ce6f0 msgr2=0x7f6ff80ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:07.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.033+0000 7f6ff7e00640 1 --2- 172.21.15.138:0/1827556820 >> v2:172.21.15.143:3300/0 conn(0x7f6ff80ce6f0 0x7f6ff80ceb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:07.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.033+0000 7f6ff7e00640 1 -- 172.21.15.138:0/1827556820 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ff8072d50 con 0x7f6ff80cbe00 2024-04-26T20:57:07.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.033+0000 7f6ff7e00640 1 --2- 172.21.15.138:0/1827556820 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ff80cbe00 0x7f6ff806de70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8071b00 tx=0x7f6fe801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=112e570fadf26c41 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:07.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.033+0000 7f6ff7400640 1 -- 172.21.15.138:0/1827556820 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe80b0070 con 0x7f6ff80cbe00 2024-04-26T20:57:07.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.033+0000 7f6ff7400640 1 -- 172.21.15.138:0/1827556820 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fe80ab600 con 0x7f6ff80cbe00 2024-04-26T20:57:07.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.033+0000 7f6ff7400640 1 -- 172.21.15.138:0/1827556820 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe80ab9d0 con 0x7f6ff80cbe00 2024-04-26T20:57:07.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.037+0000 7f6fff200640 1 -- 172.21.15.138:0/1827556820 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ff80cbe00 msgr2=0x7f6ff806de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:07.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.037+0000 7f6fff200640 1 --2- 172.21.15.138:0/1827556820 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ff80cbe00 0x7f6ff806de70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8071b00 tx=0x7f6fe801c520 comp rx=0 tx=0).stop 2024-04-26T20:57:07.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.037+0000 7f6fff200640 1 -- 172.21.15.138:0/1827556820 shutdown_connections 2024-04-26T20:57:07.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.037+0000 7f6fff200640 1 --2- 172.21.15.138:0/1827556820 >> v2:172.21.15.143:3300/0 conn(0x7f6ff80ce6f0 0x7f6ff80ceb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:07.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.037+0000 7f6fff200640 1 --2- 172.21.15.138:0/1827556820 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ff80cc1e0 0x7f6ff8073b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:07.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.037+0000 7f6fff200640 1 --2- 172.21.15.138:0/1827556820 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ff80cbe00 0x7f6ff806de70 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:07.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.037+0000 7f6fff200640 1 -- 172.21.15.138:0/1827556820 >> 172.21.15.138:0/1827556820 conn(0x7f6ff80d0b20 msgr2=0x7f6ff80d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:07.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.037+0000 7f6fff200640 1 -- 172.21.15.138:0/1827556820 shutdown_connections 2024-04-26T20:57:07.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.037+0000 7f6fff200640 1 -- 172.21.15.138:0/1827556820 wait complete. 2024-04-26T20:57:07.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.037+0000 7f6fff200640 1 Processor -- start 2024-04-26T20:57:07.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.037+0000 7f6fff200640 1 -- start start 2024-04-26T20:57:07.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.037+0000 7f6fff200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ff80cbe00 0x7f6ff80b5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:07.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.037+0000 7f6fff200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6ff80cc1e0 0x7f6ff8152730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:07.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.037+0000 7f6fff200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ff80ce6f0 0x7f6ff80c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:07.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.037+0000 7f6fff200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff806e530 con 0x7f6ff80cbe00 2024-04-26T20:57:07.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.037+0000 7f6fff200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff806e3b0 con 0x7f6ff80cc1e0 2024-04-26T20:57:07.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.037+0000 7f6fff200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f6ff8074050 con 0x7f6ff80ce6f0 2024-04-26T20:57:07.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.037+0000 7f6ff7e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ff80cbe00 0x7f6ff80b5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:07.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.037+0000 7f6ff7e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ff80cbe00 0x7f6ff80b5780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:58190/0 (socket says 172.21.15.138:58190) 2024-04-26T20:57:07.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.037+0000 7f6ff7e00640 1 -- 172.21.15.138:0/1109375217 learned_addr learned my addr 172.21.15.138:0/1109375217 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:07.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.037+0000 7f6fefe00640 1 --2- 172.21.15.138:0/1109375217 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6ff80cc1e0 0x7f6ff8152730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:07.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.037+0000 7f6ffd200640 1 --2- 172.21.15.138:0/1109375217 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ff80ce6f0 0x7f6ff80c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:07.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.037+0000 7f6ff7e00640 1 -- 172.21.15.138:0/1109375217 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ff80ce6f0 msgr2=0x7f6ff80c5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:07.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.037+0000 7f6ff7e00640 1 --2- 172.21.15.138:0/1109375217 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ff80ce6f0 0x7f6ff80c5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:07.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.037+0000 7f6ff7e00640 1 -- 172.21.15.138:0/1109375217 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6ff80cc1e0 msgr2=0x7f6ff8152730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:07.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.037+0000 7f6ff7e00640 1 --2- 172.21.15.138:0/1109375217 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6ff80cc1e0 0x7f6ff8152730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:07.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.037+0000 7f6ff7e00640 1 -- 172.21.15.138:0/1109375217 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ff80b5cc0 con 0x7f6ff80cbe00 2024-04-26T20:57:07.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.037+0000 7f6fefe00640 1 --2- 172.21.15.138:0/1109375217 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6ff80cc1e0 0x7f6ff8152730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:07.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.041+0000 7f6ff7e00640 1 --2- 172.21.15.138:0/1109375217 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ff80cbe00 0x7f6ff80b5780 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6fe80ae040 tx=0x7f6fe801ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:07.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.041+0000 7f6ff4c00640 1 -- 172.21.15.138:0/1109375217 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe80ba020 con 0x7f6ff80cbe00 2024-04-26T20:57:07.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.041+0000 7f6ff4c00640 1 -- 172.21.15.138:0/1109375217 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fe80abe20 con 0x7f6ff80cbe00 2024-04-26T20:57:07.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.041+0000 7f6fff200640 1 -- 172.21.15.138:0/1109375217 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ff8158150 con 0x7f6ff80cbe00 2024-04-26T20:57:07.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.041+0000 7f6ff4c00640 1 -- 172.21.15.138:0/1109375217 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe80b0040 con 0x7f6ff80cbe00 2024-04-26T20:57:07.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.041+0000 7f6fff200640 1 -- 172.21.15.138:0/1109375217 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ff8158710 con 0x7f6ff80cbe00 2024-04-26T20:57:07.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.041+0000 7f6fff200640 1 -- 172.21.15.138:0/1109375217 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ff8069510 con 0x7f6ff80cbe00 2024-04-26T20:57:07.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.041+0000 7f6ff4c00640 1 -- 172.21.15.138:0/1109375217 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6fe80bd020 con 0x7f6ff80cbe00 2024-04-26T20:57:07.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.041+0000 7f6ff4c00640 1 --2- 172.21.15.138:0/1109375217 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6fd4068380 0x7f6fd406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:07.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.041+0000 7f6ff4c00640 1 -- 172.21.15.138:0/1109375217 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f6fe8120e60 con 0x7f6ff80cbe00 2024-04-26T20:57:07.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.045+0000 7f6fefe00640 1 --2- 172.21.15.138:0/1109375217 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6fd4068380 0x7f6fd406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:07.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.045+0000 7f6fefe00640 1 --2- 172.21.15.138:0/1109375217 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6fd4068380 0x7f6fd406a840 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8156a90 tx=0x7f6fe0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:07.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.045+0000 7f6ff4c00640 1 -- 172.21.15.138:0/1109375217 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6fe80c4030 con 0x7f6ff80cbe00 2024-04-26T20:57:07.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.237+0000 7f6fff200640 1 -- 172.21.15.138:0/1109375217 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6ff80ce250 con 0x7f6ff80cbe00 2024-04-26T20:57:07.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.237+0000 7f6ff4c00640 1 -- 172.21.15.138:0/1109375217 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5189 (secure 0 0 0) 0x7f6fe8016110 con 0x7f6ff80cbe00 2024-04-26T20:57:07.242 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:57:07.242 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/3495262740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3495262740},{"type":"v1","addr":"172.21.15.143:6837","nonce":3495262740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4273,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/1806638334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":1806638334},{"type":"v1","addr":"172.21.15.138:6834","nonce":1806638334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/3333703637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":3333703637},{"type":"v1","addr":"172.21.15.138:6835","nonce":3333703637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:56:39.581500+0000","modified":"2024-04-26T20:56:57.692718+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6836/3598364176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":3598364176},{"type":"v1","addr":"172.21.15.143:6836","nonce":3598364176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-04-26T20:57:07.243 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 9 2024-04-26T20:57:07.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.241+0000 7f6fff200640 1 -- 172.21.15.138:0/1109375217 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6fd4068380 msgr2=0x7f6fd406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:07.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.241+0000 7f6fff200640 1 --2- 172.21.15.138:0/1109375217 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6fd4068380 0x7f6fd406a840 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8156a90 tx=0x7f6fe0008040 comp rx=0 tx=0).stop 2024-04-26T20:57:07.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.241+0000 7f6fff200640 1 -- 172.21.15.138:0/1109375217 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ff80cbe00 msgr2=0x7f6ff80b5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:07.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.241+0000 7f6fff200640 1 --2- 172.21.15.138:0/1109375217 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ff80cbe00 0x7f6ff80b5780 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6fe80ae040 tx=0x7f6fe801ad60 comp rx=0 tx=0).stop 2024-04-26T20:57:07.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.241+0000 7f6fff200640 1 -- 172.21.15.138:0/1109375217 shutdown_connections 2024-04-26T20:57:07.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.241+0000 7f6fff200640 1 --2- 172.21.15.138:0/1109375217 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6fd4068380 0x7f6fd406a840 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:07.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.241+0000 7f6fff200640 1 --2- 172.21.15.138:0/1109375217 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ff80ce6f0 0x7f6ff80c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:07.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.241+0000 7f6fff200640 1 --2- 172.21.15.138:0/1109375217 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6ff80cc1e0 0x7f6ff8152730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:07.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.241+0000 7f6fff200640 1 --2- 172.21.15.138:0/1109375217 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ff80cbe00 0x7f6ff80b5780 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:07.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.241+0000 7f6fff200640 1 -- 172.21.15.138:0/1109375217 >> 172.21.15.138:0/1109375217 conn(0x7f6ff80d0b20 msgr2=0x7f6ff80caf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:07.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.241+0000 7f6fff200640 1 -- 172.21.15.138:0/1109375217 shutdown_connections 2024-04-26T20:57:07.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.241+0000 7f6fff200640 1 -- 172.21.15.138:0/1109375217 wait complete. 2024-04-26T20:57:07.264 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:57:07.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.397+0000 7fd828c00640 1 Processor -- start 2024-04-26T20:57:07.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.397+0000 7fd828c00640 1 -- start start 2024-04-26T20:57:07.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.397+0000 7fd828c00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd82415d0f0 0x7fd8240d1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:07.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.397+0000 7fd828c00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8240d0570 con 0x7fd8240b2280 2024-04-26T20:57:07.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.397+0000 7fd828c00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8240ce540 con 0x7fd8240d0950 2024-04-26T20:57:07.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.397+0000 7fd828c00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fd8240d0e50 con 0x7fd82415d0f0 2024-04-26T20:57:07.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.397+0000 7fd821e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd82415d0f0 0x7fd8240d1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:07.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.397+0000 7fd819400640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fd8240b2280 0x7fd8240cf750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:37802/0 (socket says 172.21.15.138:37802) 2024-04-26T20:57:07.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.397+0000 7fd819400640 1 -- 172.21.15.138:0/3051053278 learned_addr learned my addr 172.21.15.138:0/3051053278 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:07.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.397+0000 7fd821e00640 1 -- 172.21.15.138:0/3051053278 >> v1:172.21.15.143:6789/0 conn(0x7fd8240d0950 legacy=0x7fd8240cfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:07.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.397+0000 7fd821e00640 1 -- 172.21.15.138:0/3051053278 >> v1:172.21.15.138:6789/0 conn(0x7fd8240b2280 legacy=0x7fd8240cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:07.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.397+0000 7fd821e00640 1 -- 172.21.15.138:0/3051053278 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8240ce820 con 0x7fd82415d0f0 2024-04-26T20:57:07.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.401+0000 7fd821e00640 1 --2- 172.21.15.138:0/3051053278 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd82415d0f0 0x7fd8240d1010 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd80c0097c0 tx=0x7fd80c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86d28710b3fad21b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:07.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.401+0000 7fd821400640 1 -- 172.21.15.138:0/3051053278 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd80c0b0070 con 0x7fd82415d0f0 2024-04-26T20:57:07.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.401+0000 7fd821400640 1 -- 172.21.15.138:0/3051053278 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd80c0ab600 con 0x7fd82415d0f0 2024-04-26T20:57:07.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.401+0000 7fd821400640 1 -- 172.21.15.138:0/3051053278 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd80c0ab9d0 con 0x7fd82415d0f0 2024-04-26T20:57:07.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.401+0000 7fd828c00640 1 -- 172.21.15.138:0/3051053278 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd82415d0f0 msgr2=0x7fd8240d1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:07.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.401+0000 7fd828c00640 1 --2- 172.21.15.138:0/3051053278 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd82415d0f0 0x7fd8240d1010 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd80c0097c0 tx=0x7fd80c01c460 comp rx=0 tx=0).stop 2024-04-26T20:57:07.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.401+0000 7fd828c00640 1 -- 172.21.15.138:0/3051053278 shutdown_connections 2024-04-26T20:57:07.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.401+0000 7fd828c00640 1 --2- 172.21.15.138:0/3051053278 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd82415d0f0 0x7fd8240d1010 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:07.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.401+0000 7fd828c00640 1 -- 172.21.15.138:0/3051053278 >> 172.21.15.138:0/3051053278 conn(0x7fd8240d2d80 msgr2=0x7fd8240d3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:07.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.401+0000 7fd828c00640 1 -- 172.21.15.138:0/3051053278 shutdown_connections 2024-04-26T20:57:07.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.401+0000 7fd828c00640 1 -- 172.21.15.138:0/3051053278 wait complete. 2024-04-26T20:57:07.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.405+0000 7fd828c00640 1 Processor -- start 2024-04-26T20:57:07.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.405+0000 7fd828c00640 1 -- start start 2024-04-26T20:57:07.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.405+0000 7fd828c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd8240b2280 0x7fd8240c8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:07.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.405+0000 7fd828c00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd8240d0950 0x7fd82415b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:07.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.405+0000 7fd828c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd82415d0f0 0x7fd8240c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:07.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.405+0000 7fd828c00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd8240d18e0 con 0x7fd8240d0950 2024-04-26T20:57:07.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.405+0000 7fd828c00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fd8240d1760 con 0x7fd82415d0f0 2024-04-26T20:57:07.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.405+0000 7fd828c00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fd82416b4d0 con 0x7fd8240b2280 2024-04-26T20:57:07.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.405+0000 7fd819400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd8240d0950 0x7fd82415b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:07.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.405+0000 7fd821e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd8240b2280 0x7fd8240c8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:07.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.405+0000 7fd819400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd8240d0950 0x7fd82415b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:58208/0 (socket says 172.21.15.138:58208) 2024-04-26T20:57:07.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.405+0000 7fd819400640 1 -- 172.21.15.138:0/1339536640 learned_addr learned my addr 172.21.15.138:0/1339536640 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:07.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.405+0000 7fd822800640 1 --2- 172.21.15.138:0/1339536640 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd82415d0f0 0x7fd8240c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:07.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.405+0000 7fd819400640 1 -- 172.21.15.138:0/1339536640 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd8240b2280 msgr2=0x7fd8240c8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:07.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.405+0000 7fd819400640 1 --2- 172.21.15.138:0/1339536640 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd8240b2280 0x7fd8240c8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:07.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.405+0000 7fd819400640 1 -- 172.21.15.138:0/1339536640 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd82415d0f0 msgr2=0x7fd8240c9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:07.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.405+0000 7fd819400640 1 --2- 172.21.15.138:0/1339536640 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd82415d0f0 0x7fd8240c9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:07.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.405+0000 7fd819400640 1 -- 172.21.15.138:0/1339536640 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd82415bf10 con 0x7fd8240d0950 2024-04-26T20:57:07.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.405+0000 7fd822800640 1 --2- 172.21.15.138:0/1339536640 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd82415d0f0 0x7fd8240c9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:07.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.405+0000 7fd819400640 1 --2- 172.21.15.138:0/1339536640 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd8240d0950 0x7fd82415b5f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd81400c420 tx=0x7fd81400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:07.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.405+0000 7fd81aa00640 1 -- 172.21.15.138:0/1339536640 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd814017070 con 0x7fd8240d0950 2024-04-26T20:57:07.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.405+0000 7fd81aa00640 1 -- 172.21.15.138:0/1339536640 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd814005cf0 con 0x7fd8240d0950 2024-04-26T20:57:07.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.405+0000 7fd81aa00640 1 -- 172.21.15.138:0/1339536640 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8140072f0 con 0x7fd8240d0950 2024-04-26T20:57:07.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.405+0000 7fd828c00640 1 -- 172.21.15.138:0/1339536640 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd824156d20 con 0x7fd8240d0950 2024-04-26T20:57:07.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.405+0000 7fd828c00640 1 -- 172.21.15.138:0/1339536640 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8241572e0 con 0x7fd8240d0950 2024-04-26T20:57:07.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.405+0000 7fd828c00640 1 -- 172.21.15.138:0/1339536640 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8241574e0 con 0x7fd8240d0950 2024-04-26T20:57:07.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.409+0000 7fd81aa00640 1 -- 172.21.15.138:0/1339536640 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd81401a070 con 0x7fd8240d0950 2024-04-26T20:57:07.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.409+0000 7fd81aa00640 1 --2- 172.21.15.138:0/1339536640 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd800068380 0x7fd80006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:07.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.409+0000 7fd81aa00640 1 -- 172.21.15.138:0/1339536640 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fd814086100 con 0x7fd8240d0950 2024-04-26T20:57:07.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.409+0000 7fd821e00640 1 --2- 172.21.15.138:0/1339536640 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd800068380 0x7fd80006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:07.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.409+0000 7fd821e00640 1 --2- 172.21.15.138:0/1339536640 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd800068380 0x7fd80006a840 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd80c0ad000 tx=0x7fd80c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:07.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.413+0000 7fd81aa00640 1 -- 172.21.15.138:0/1339536640 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd8241574e0 con 0x7fd8240d0950 2024-04-26T20:57:07.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.569+0000 7fd828c00640 1 -- 172.21.15.138:0/1339536640 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd8240b8c40 con 0x7fd8240d0950 2024-04-26T20:57:07.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.573+0000 7fd81aa00640 1 -- 172.21.15.138:0/1339536640 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18578 (secure 0 0 0) 0x7fd814055c90 con 0x7fd8240d0950 2024-04-26T20:57:07.576 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:57:07.576 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":27,"fsid":"c22b4730-12cc-4558-8535-b965384398c0","created":"2024-04-26T20:56:14.182475+0000","modified":"2024-04-26T20:56:44.633968+0000","last_up_change":"2024-04-26T20:56:26.013243+0000","last_in_change":"2024-04-26T20:56:16.714055+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:56:27.265834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:56:37.394398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:56:38.544369+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:56:42.240243+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3f9a2e34-3199-466f-a6cf-57927318121e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6801","nonce":3534772245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6803","nonce":3534772245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6807","nonce":3534772245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6805","nonce":3534772245}]},"public_addr":"172.21.15.138:6801/3534772245","cluster_addr":"172.21.15.138:6803/3534772245","heartbeat_back_addr":"172.21.15.138:6807/3534772245","heartbeat_front_addr":"172.21.15.138:6805/3534772245","state":["exists","up"]},{"osd":1,"uuid":"e881fcf6-3248-4696-a2ef-95d206d77712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6817","nonce":1427635773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6819","nonce":1427635773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6823","nonce":1427635773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6821","nonce":1427635773}]},"public_addr":"172.21.15.138:6817/1427635773","cluster_addr":"172.21.15.138:6819/1427635773","heartbeat_back_addr":"172.21.15.138:6823/1427635773","heartbeat_front_addr":"172.21.15.138:6821/1427635773","state":["exists","up"]},{"osd":2,"uuid":"f7d1db33-7672-4699-ae47-9f1e0a8e4222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6809","nonce":4273721573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6811","nonce":4273721573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6815","nonce":4273721573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6813","nonce":4273721573}]},"public_addr":"172.21.15.138:6809/4273721573","cluster_addr":"172.21.15.138:6811/4273721573","heartbeat_back_addr":"172.21.15.138:6815/4273721573","heartbeat_front_addr":"172.21.15.138:6813/4273721573","state":["exists","up"]},{"osd":3,"uuid":"2f4e0a9a-b8f6-4468-844a-a4501cd85054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6825","nonce":3098242154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6827","nonce":3098242154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6831","nonce":3098242154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6829","nonce":3098242154}]},"public_addr":"172.21.15.138:6825/3098242154","cluster_addr":"172.21.15.138:6827/3098242154","heartbeat_back_addr":"172.21.15.138:6831/3098242154","heartbeat_front_addr":"172.21.15.138:6829/3098242154","state":["exists","up"]},{"osd":4,"uuid":"c85df99b-3624-410e-866b-86830af2cfe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6801","nonce":2942056312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6803","nonce":2942056312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6807","nonce":2942056312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6805","nonce":2942056312}]},"public_addr":"172.21.15.143:6801/2942056312","cluster_addr":"172.21.15.143:6803/2942056312","heartbeat_back_addr":"172.21.15.143:6807/2942056312","heartbeat_front_addr":"172.21.15.143:6805/2942056312","state":["exists","up"]},{"osd":5,"uuid":"9af1efb5-c416-4808-b5ef-de0679ab9705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6809","nonce":1910222887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6811","nonce":1910222887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6815","nonce":1910222887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6813","nonce":1910222887}]},"public_addr":"172.21.15.143:6809/1910222887","cluster_addr":"172.21.15.143:6811/1910222887","heartbeat_back_addr":"172.21.15.143:6815/1910222887","heartbeat_front_addr":"172.21.15.143:6813/1910222887","state":["exists","up"]},{"osd":6,"uuid":"d7138615-8838-45ff-9072-2fd0683362f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6817","nonce":1082239825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6819","nonce":1082239825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6823","nonce":1082239825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6821","nonce":1082239825}]},"public_addr":"172.21.15.143:6817/1082239825","cluster_addr":"172.21.15.143:6819/1082239825","heartbeat_back_addr":"172.21.15.143:6823/1082239825","heartbeat_front_addr":"172.21.15.143:6821/1082239825","state":["exists","up"]},{"osd":7,"uuid":"0c27172b-35c4-49ec-ba0b-0137b8ff0010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6825","nonce":3295508495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6827","nonce":3295508495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6831","nonce":3295508495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6829","nonce":3295508495}]},"public_addr":"172.21.15.143:6825/3295508495","cluster_addr":"172.21.15.143:6827/3295508495","heartbeat_back_addr":"172.21.15.143:6831/3295508495","heartbeat_front_addr":"172.21.15.143:6829/3295508495","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.326627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.396119+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.433915+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.414179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.216947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.329272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.503073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.436382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:57:07.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.573+0000 7fd828c00640 1 -- 172.21.15.138:0/1339536640 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd800068380 msgr2=0x7fd80006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:07.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.573+0000 7fd828c00640 1 --2- 172.21.15.138:0/1339536640 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd800068380 0x7fd80006a840 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd80c0ad000 tx=0x7fd80c0a6000 comp rx=0 tx=0).stop 2024-04-26T20:57:07.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.573+0000 7fd828c00640 1 -- 172.21.15.138:0/1339536640 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd8240d0950 msgr2=0x7fd82415b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:07.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.573+0000 7fd828c00640 1 --2- 172.21.15.138:0/1339536640 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd8240d0950 0x7fd82415b5f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd81400c420 tx=0x7fd81400c8e0 comp rx=0 tx=0).stop 2024-04-26T20:57:07.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.573+0000 7fd828c00640 1 -- 172.21.15.138:0/1339536640 shutdown_connections 2024-04-26T20:57:07.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.573+0000 7fd828c00640 1 --2- 172.21.15.138:0/1339536640 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd800068380 0x7fd80006a840 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:07.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.573+0000 7fd828c00640 1 --2- 172.21.15.138:0/1339536640 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd82415d0f0 0x7fd8240c9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:07.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.573+0000 7fd828c00640 1 --2- 172.21.15.138:0/1339536640 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd8240d0950 0x7fd82415b5f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:07.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.573+0000 7fd828c00640 1 --2- 172.21.15.138:0/1339536640 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd8240b2280 0x7fd8240c8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:07.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.573+0000 7fd828c00640 1 -- 172.21.15.138:0/1339536640 >> 172.21.15.138:0/1339536640 conn(0x7fd8240d2d80 msgr2=0x7fd8240b13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:07.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.573+0000 7fd828c00640 1 -- 172.21.15.138:0/1339536640 shutdown_connections 2024-04-26T20:57:07.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.573+0000 7fd828c00640 1 -- 172.21.15.138:0/1339536640 wait complete. 2024-04-26T20:57:07.598 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:57:07.669 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:57:07.672 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:57:07.733 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.729+0000 7fe3a2400640 1 Processor -- start 2024-04-26T20:57:07.733 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.729+0000 7fe3a2400640 1 -- start start 2024-04-26T20:57:07.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.729+0000 7fe3a2400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe39c0cbe00 0x7fe39c06de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:07.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.729+0000 7fe3a2400640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe39c0cc1e0 0x7fe39c073b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:07.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.729+0000 7fe3a2400640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe39c0727f0 con 0x7fe39c0ce6f0 2024-04-26T20:57:07.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.729+0000 7fe3a2400640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fe39c073680 con 0x7fe39c0cbe00 2024-04-26T20:57:07.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.729+0000 7fe3a2400640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fe39c072a70 con 0x7fe39c0cc1e0 2024-04-26T20:57:07.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.729+0000 7fe39b400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe39c0cbe00 0x7fe39c06de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:07.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.729+0000 7fe39be00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fe39c0ce6f0 0x7fe39c0ceb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:37806/0 (socket says 172.21.15.138:37806) 2024-04-26T20:57:07.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.729+0000 7fe39be00640 1 -- 172.21.15.138:0/228866938 learned_addr learned my addr 172.21.15.138:0/228866938 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:07.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.729+0000 7fe39b400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe39c0cbe00 0x7fe39c06de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:58214/0 (socket says 172.21.15.138:58214) 2024-04-26T20:57:07.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.729+0000 7fe39b400640 1 -- 172.21.15.138:0/228866938 >> v2:172.21.15.143:3300/0 conn(0x7fe39c0cc1e0 msgr2=0x7fe39c073b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:07.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.729+0000 7fe39b400640 1 --2- 172.21.15.138:0/228866938 >> v2:172.21.15.143:3300/0 conn(0x7fe39c0cc1e0 0x7fe39c073b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:07.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.729+0000 7fe39b400640 1 -- 172.21.15.138:0/228866938 >> v1:172.21.15.138:6789/0 conn(0x7fe39c0ce6f0 legacy=0x7fe39c0ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:07.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.729+0000 7fe39b400640 1 -- 172.21.15.138:0/228866938 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe39c072d50 con 0x7fe39c0cbe00 2024-04-26T20:57:07.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.729+0000 7fe39a000640 1 -- 172.21.15.138:0/228866938 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 913511122 0 0) 0x7fe3940014a0 con 0x7fe39c0ce6f0 2024-04-26T20:57:07.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.733+0000 7fe39b400640 1 --2- 172.21.15.138:0/228866938 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe39c0cbe00 0x7fe39c06de70 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe39c0b6c50 tx=0x7fe38c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d0ab8b4019f3820 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:07.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.733+0000 7fe39a000640 1 -- 172.21.15.138:0/228866938 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38c0b0070 con 0x7fe39c0cbe00 2024-04-26T20:57:07.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.733+0000 7fe39a000640 1 -- 172.21.15.138:0/228866938 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe38c0ab600 con 0x7fe39c0cbe00 2024-04-26T20:57:07.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.733+0000 7fe39a000640 1 -- 172.21.15.138:0/228866938 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38c0ab9d0 con 0x7fe39c0cbe00 2024-04-26T20:57:07.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.733+0000 7fe3a2400640 1 -- 172.21.15.138:0/228866938 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe39c0cbe00 msgr2=0x7fe39c06de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:07.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.733+0000 7fe3a2400640 1 --2- 172.21.15.138:0/228866938 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe39c0cbe00 0x7fe39c06de70 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe39c0b6c50 tx=0x7fe38c01c480 comp rx=0 tx=0).stop 2024-04-26T20:57:07.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.733+0000 7fe3a2400640 1 -- 172.21.15.138:0/228866938 shutdown_connections 2024-04-26T20:57:07.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.733+0000 7fe3a2400640 1 --2- 172.21.15.138:0/228866938 >> v2:172.21.15.143:3300/0 conn(0x7fe39c0cc1e0 0x7fe39c073b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:07.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.733+0000 7fe3a2400640 1 --2- 172.21.15.138:0/228866938 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe39c0cbe00 0x7fe39c06de70 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:07.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.733+0000 7fe3a2400640 1 -- 172.21.15.138:0/228866938 >> 172.21.15.138:0/228866938 conn(0x7fe39c0d0b20 msgr2=0x7fe39c0d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:07.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.733+0000 7fe3a2400640 1 -- 172.21.15.138:0/228866938 shutdown_connections 2024-04-26T20:57:07.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.733+0000 7fe3a2400640 1 -- 172.21.15.138:0/228866938 wait complete. 2024-04-26T20:57:07.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.737+0000 7fe3a2400640 1 Processor -- start 2024-04-26T20:57:07.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.737+0000 7fe3a2400640 1 -- start start 2024-04-26T20:57:07.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.737+0000 7fe3a2400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe39c0cbe00 0x7fe39c14e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:07.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.737+0000 7fe3a2400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe39c0cc1e0 0x7fe39c1f7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:07.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.737+0000 7fe3a2400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe39c0ce6f0 0x7fe39c0ced80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:07.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.737+0000 7fe3a2400640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe39c0741d0 con 0x7fe39c0ce6f0 2024-04-26T20:57:07.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.737+0000 7fe3a2400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fe39c074050 con 0x7fe39c0cc1e0 2024-04-26T20:57:07.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.737+0000 7fe3a2400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fe39c0d0780 con 0x7fe39c0cbe00 2024-04-26T20:57:07.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.737+0000 7fe39be00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe39c0ce6f0 0x7fe39c0ced80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:07.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.737+0000 7fe39be00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe39c0ce6f0 0x7fe39c0ced80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:58228/0 (socket says 172.21.15.138:58228) 2024-04-26T20:57:07.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.737+0000 7fe39be00640 1 -- 172.21.15.138:0/1297963825 learned_addr learned my addr 172.21.15.138:0/1297963825 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:07.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.737+0000 7fe39b400640 1 --2- 172.21.15.138:0/1297963825 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe39c0cbe00 0x7fe39c14e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:07.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.737+0000 7fe39aa00640 1 --2- 172.21.15.138:0/1297963825 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe39c0cc1e0 0x7fe39c1f7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:07.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.737+0000 7fe39be00640 1 -- 172.21.15.138:0/1297963825 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe39c0cbe00 msgr2=0x7fe39c14e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:07.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.737+0000 7fe39be00640 1 --2- 172.21.15.138:0/1297963825 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe39c0cbe00 0x7fe39c14e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:07.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.737+0000 7fe39be00640 1 -- 172.21.15.138:0/1297963825 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe39c0cc1e0 msgr2=0x7fe39c1f7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:07.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.737+0000 7fe39be00640 1 --2- 172.21.15.138:0/1297963825 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe39c0cc1e0 0x7fe39c1f7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:07.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.737+0000 7fe39be00640 1 -- 172.21.15.138:0/1297963825 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe39c1524b0 con 0x7fe39c0ce6f0 2024-04-26T20:57:07.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.737+0000 7fe39aa00640 1 --2- 172.21.15.138:0/1297963825 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe39c0cc1e0 0x7fe39c1f7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:07.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.737+0000 7fe39be00640 1 --2- 172.21.15.138:0/1297963825 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe39c0ce6f0 0x7fe39c0ced80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe39400c700 tx=0x7fe39400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:07.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.737+0000 7fe393400640 1 -- 172.21.15.138:0/1297963825 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe394018070 con 0x7fe39c0ce6f0 2024-04-26T20:57:07.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.737+0000 7fe393400640 1 -- 172.21.15.138:0/1297963825 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe39400ce10 con 0x7fe39c0ce6f0 2024-04-26T20:57:07.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.737+0000 7fe3a2400640 1 -- 172.21.15.138:0/1297963825 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe39c152790 con 0x7fe39c0ce6f0 2024-04-26T20:57:07.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.737+0000 7fe393400640 1 -- 172.21.15.138:0/1297963825 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39400a860 con 0x7fe39c0ce6f0 2024-04-26T20:57:07.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.737+0000 7fe3a2400640 1 -- 172.21.15.138:0/1297963825 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe39c15a010 con 0x7fe39c0ce6f0 2024-04-26T20:57:07.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.741+0000 7fe3a2400640 1 -- 172.21.15.138:0/1297963825 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe39c069510 con 0x7fe39c0ce6f0 2024-04-26T20:57:07.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.741+0000 7fe393400640 1 -- 172.21.15.138:0/1297963825 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe39401b070 con 0x7fe39c0ce6f0 2024-04-26T20:57:07.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.741+0000 7fe393400640 1 --2- 172.21.15.138:0/1297963825 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe37c068380 0x7fe37c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:07.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.741+0000 7fe393400640 1 -- 172.21.15.138:0/1297963825 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fe394086190 con 0x7fe39c0ce6f0 2024-04-26T20:57:07.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.741+0000 7fe39b400640 1 --2- 172.21.15.138:0/1297963825 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe37c068380 0x7fe37c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:07.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.741+0000 7fe39b400640 1 --2- 172.21.15.138:0/1297963825 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe37c068380 0x7fe37c06a840 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe38c0ad000 tx=0x7fe38c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:07.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.745+0000 7fe393400640 1 -- 172.21.15.138:0/1297963825 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe39c0727f0 con 0x7fe39c0ce6f0 2024-04-26T20:57:07.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.933+0000 7fe3a2400640 1 -- 172.21.15.138:0/1297963825 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe39c075260 con 0x7fe39c0ce6f0 2024-04-26T20:57:07.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.933+0000 7fe393400640 1 -- 172.21.15.138:0/1297963825 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5189 (secure 0 0 0) 0x7fe394055db0 con 0x7fe39c0ce6f0 2024-04-26T20:57:07.938 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:57:07.938 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/3495262740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3495262740},{"type":"v1","addr":"172.21.15.143:6837","nonce":3495262740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4273,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/1806638334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":1806638334},{"type":"v1","addr":"172.21.15.138:6834","nonce":1806638334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/3333703637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":3333703637},{"type":"v1","addr":"172.21.15.138:6835","nonce":3333703637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:56:39.581500+0000","modified":"2024-04-26T20:56:57.692718+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6836/3598364176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":3598364176},{"type":"v1","addr":"172.21.15.143:6836","nonce":3598364176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-04-26T20:57:07.939 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 9 2024-04-26T20:57:07.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.937+0000 7fe3a2400640 1 -- 172.21.15.138:0/1297963825 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe37c068380 msgr2=0x7fe37c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:07.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.937+0000 7fe3a2400640 1 --2- 172.21.15.138:0/1297963825 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe37c068380 0x7fe37c06a840 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe38c0ad000 tx=0x7fe38c0a6000 comp rx=0 tx=0).stop 2024-04-26T20:57:07.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.937+0000 7fe3a2400640 1 -- 172.21.15.138:0/1297963825 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe39c0ce6f0 msgr2=0x7fe39c0ced80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:07.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.937+0000 7fe3a2400640 1 --2- 172.21.15.138:0/1297963825 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe39c0ce6f0 0x7fe39c0ced80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe39400c700 tx=0x7fe39400cbc0 comp rx=0 tx=0).stop 2024-04-26T20:57:07.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.937+0000 7fe3a2400640 1 -- 172.21.15.138:0/1297963825 shutdown_connections 2024-04-26T20:57:07.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.937+0000 7fe3a2400640 1 --2- 172.21.15.138:0/1297963825 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe37c068380 0x7fe37c06a840 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:07.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.937+0000 7fe3a2400640 1 --2- 172.21.15.138:0/1297963825 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe39c0ce6f0 0x7fe39c0ced80 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:07.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.937+0000 7fe3a2400640 1 --2- 172.21.15.138:0/1297963825 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe39c0cc1e0 0x7fe39c1f7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:07.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.937+0000 7fe3a2400640 1 --2- 172.21.15.138:0/1297963825 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe39c0cbe00 0x7fe39c14e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:07.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.937+0000 7fe3a2400640 1 -- 172.21.15.138:0/1297963825 >> 172.21.15.138:0/1297963825 conn(0x7fe39c0d0b20 msgr2=0x7fe39c1572b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:07.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.937+0000 7fe3a2400640 1 -- 172.21.15.138:0/1297963825 shutdown_connections 2024-04-26T20:57:07.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:07.937+0000 7fe3a2400640 1 -- 172.21.15.138:0/1297963825 wait complete. 2024-04-26T20:57:08.363 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T20:56:39.581500+0000', 'modified': '2024-04-26T20:56:57.692718+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4290}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4290': {'gid': 4290, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.143:6836/3598364176', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6834', 'nonce': 3598364176}, {'type': 'v1', 'addr': '172.21.15.143:6836', 'nonce': 3598364176}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4290, 'qdb_cluster': [4290]} 2024-04-26T20:57:08.363 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T20:57:08.363 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-26T20:57:08.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.497+0000 7fc947e00640 1 Processor -- start 2024-04-26T20:57:08.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.497+0000 7fc947e00640 1 -- start start 2024-04-26T20:57:08.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.497+0000 7fc947e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc94015ce20 0x7fc940161340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:08.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.497+0000 7fc947e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc9400cca00 0x7fc9400cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:08.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.497+0000 7fc947e00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9400cd360 con 0x7fc94015e0c0 2024-04-26T20:57:08.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.497+0000 7fc947e00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fc940073b70 con 0x7fc94015ce20 2024-04-26T20:57:08.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.497+0000 7fc947e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fc940073e10 con 0x7fc9400cca00 2024-04-26T20:57:08.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.497+0000 7fc945400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc94015ce20 0x7fc940161340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:08.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.497+0000 7fc945400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc94015ce20 0x7fc940161340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:58238/0 (socket says 172.21.15.138:58238) 2024-04-26T20:57:08.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.497+0000 7fc945400640 1 -- 172.21.15.138:0/2223847463 learned_addr learned my addr 172.21.15.138:0/2223847463 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:08.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.497+0000 7fc945e00640 1 --2- 172.21.15.138:0/2223847463 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc9400cca00 0x7fc9400cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:08.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.497+0000 7fc945400640 1 -- 172.21.15.138:0/2223847463 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc9400cca00 msgr2=0x7fc9400cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:08.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.497+0000 7fc945400640 1 --2- 172.21.15.138:0/2223847463 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc9400cca00 0x7fc9400cce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:08.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.497+0000 7fc945400640 1 -- 172.21.15.138:0/2223847463 >> v1:172.21.15.143:6789/0 conn(0x7fc94015e0c0 legacy=0x7fc940071ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:08.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.497+0000 7fc945400640 1 -- 172.21.15.138:0/2223847463 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9400740f0 con 0x7fc94015ce20 2024-04-26T20:57:08.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.501+0000 7fc945400640 1 --2- 172.21.15.138:0/2223847463 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc94015ce20 0x7fc940161340 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc934009870 tx=0x7fc93401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=138f365c703761f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:08.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.501+0000 7fc93fe00640 1 -- 172.21.15.138:0/2223847463 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9340a7070 con 0x7fc94015ce20 2024-04-26T20:57:08.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.501+0000 7fc93fe00640 1 -- 172.21.15.138:0/2223847463 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9340b0070 con 0x7fc94015ce20 2024-04-26T20:57:08.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.501+0000 7fc93fe00640 1 -- 172.21.15.138:0/2223847463 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9340ab890 con 0x7fc94015ce20 2024-04-26T20:57:08.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.501+0000 7fc947e00640 1 -- 172.21.15.138:0/2223847463 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc94015ce20 msgr2=0x7fc940161340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:08.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.501+0000 7fc947e00640 1 --2- 172.21.15.138:0/2223847463 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc94015ce20 0x7fc940161340 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc934009870 tx=0x7fc93401c560 comp rx=0 tx=0).stop 2024-04-26T20:57:08.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.501+0000 7fc947e00640 1 -- 172.21.15.138:0/2223847463 shutdown_connections 2024-04-26T20:57:08.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.501+0000 7fc947e00640 1 --2- 172.21.15.138:0/2223847463 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc9400cca00 0x7fc9400cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:08.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.501+0000 7fc947e00640 1 --2- 172.21.15.138:0/2223847463 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc94015ce20 0x7fc940161340 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:08.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.501+0000 7fc947e00640 1 -- 172.21.15.138:0/2223847463 >> 172.21.15.138:0/2223847463 conn(0x7fc9400d0b20 msgr2=0x7fc9400d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:08.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.501+0000 7fc947e00640 1 -- 172.21.15.138:0/2223847463 shutdown_connections 2024-04-26T20:57:08.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.501+0000 7fc947e00640 1 -- 172.21.15.138:0/2223847463 wait complete. 2024-04-26T20:57:08.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.505+0000 7fc947e00640 1 Processor -- start 2024-04-26T20:57:08.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.505+0000 7fc947e00640 1 -- start start 2024-04-26T20:57:08.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.505+0000 7fc947e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc9400cca00 0x7fc9400b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:08.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.505+0000 7fc947e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc94015ce20 0x7fc94014ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:08.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.505+0000 7fc947e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc94015e0c0 0x7fc9400c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:08.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.505+0000 7fc947e00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc94015d380 con 0x7fc9400cca00 2024-04-26T20:57:08.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.505+0000 7fc947e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fc94015d200 con 0x7fc94015ce20 2024-04-26T20:57:08.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.505+0000 7fc947e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fc94006e680 con 0x7fc94015e0c0 2024-04-26T20:57:08.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.505+0000 7fc945400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc9400cca00 0x7fc9400b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:08.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.505+0000 7fc945400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc9400cca00 0x7fc9400b6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:58254/0 (socket says 172.21.15.138:58254) 2024-04-26T20:57:08.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.505+0000 7fc945400640 1 -- 172.21.15.138:0/3276858763 learned_addr learned my addr 172.21.15.138:0/3276858763 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:08.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.505+0000 7fc945e00640 1 --2- 172.21.15.138:0/3276858763 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc94015e0c0 0x7fc9400c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:08.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.505+0000 7fc944a00640 1 --2- 172.21.15.138:0/3276858763 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc94015ce20 0x7fc94014ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:08.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.505+0000 7fc945400640 1 -- 172.21.15.138:0/3276858763 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc94015e0c0 msgr2=0x7fc9400c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:08.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.505+0000 7fc945400640 1 --2- 172.21.15.138:0/3276858763 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc94015e0c0 0x7fc9400c7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:08.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.505+0000 7fc945400640 1 -- 172.21.15.138:0/3276858763 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc94015ce20 msgr2=0x7fc94014ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:08.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.505+0000 7fc945400640 1 --2- 172.21.15.138:0/3276858763 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc94015ce20 0x7fc94014ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:08.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.505+0000 7fc945400640 1 -- 172.21.15.138:0/3276858763 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9400ca0a0 con 0x7fc9400cca00 2024-04-26T20:57:08.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.505+0000 7fc945400640 1 --2- 172.21.15.138:0/3276858763 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc9400cca00 0x7fc9400b6120 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc9340ad040 tx=0x7fc93401ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:08.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.505+0000 7fc93d600640 1 -- 172.21.15.138:0/3276858763 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9340be5f0 con 0x7fc9400cca00 2024-04-26T20:57:08.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.505+0000 7fc93d600640 1 -- 172.21.15.138:0/3276858763 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9340be7b0 con 0x7fc9400cca00 2024-04-26T20:57:08.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.505+0000 7fc93d600640 1 -- 172.21.15.138:0/3276858763 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9340beba0 con 0x7fc9400cca00 2024-04-26T20:57:08.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.505+0000 7fc947e00640 1 -- 172.21.15.138:0/3276858763 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9400ca380 con 0x7fc9400cca00 2024-04-26T20:57:08.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.505+0000 7fc947e00640 1 -- 172.21.15.138:0/3276858763 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9400b6660 con 0x7fc9400cca00 2024-04-26T20:57:08.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.509+0000 7fc93d600640 1 -- 172.21.15.138:0/3276858763 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc9340b43f0 con 0x7fc9400cca00 2024-04-26T20:57:08.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.509+0000 7fc93d600640 1 --2- 172.21.15.138:0/3276858763 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc920068380 0x7fc92006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:08.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.509+0000 7fc93d600640 1 -- 172.21.15.138:0/3276858763 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fc934121970 con 0x7fc9400cca00 2024-04-26T20:57:08.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.509+0000 7fc94b1fa000 1 Processor -- start 2024-04-26T20:57:08.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.509+0000 7fc944a00640 1 --2- 172.21.15.138:0/3276858763 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc920068380 0x7fc92006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:08.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.509+0000 7fc94b1fa000 1 -- start start 2024-04-26T20:57:08.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.509+0000 7fc944a00640 1 --2- 172.21.15.138:0/3276858763 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc920068380 0x7fc92006a840 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc94014f8d0 tx=0x7fc92c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:08.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.509+0000 7fc94b1fa000 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cb3d04e700 0x55cb3d04eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:08.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.509+0000 7fc94b1fa000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cb3d04f020 0x55cb3d005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:08.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.509+0000 7fc94b1fa000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cb3d005740 0x55cb3d005b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:08.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.509+0000 7fc94b1fa000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55cb3cebd140 con 0x55cb3d04f020 2024-04-26T20:57:08.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.509+0000 7fc94b1fa000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55cb3ce52e00 con 0x55cb3d005740 2024-04-26T20:57:08.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.509+0000 7fc94b1fa000 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55cb3ce0ba00 con 0x55cb3d04e700 2024-04-26T20:57:08.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.509+0000 7fc944a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cb3d04f020 0x55cb3d005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:08.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.509+0000 7fc944a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cb3d04f020 0x55cb3d005200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:58260/0 (socket says 172.21.15.138:58260) 2024-04-26T20:57:08.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.509+0000 7fc944a00640 1 -- 172.21.15.138:0/139598082 learned_addr learned my addr 172.21.15.138:0/139598082 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:08.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.509+0000 7fc945400640 1 --2- 172.21.15.138:0/139598082 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cb3d04e700 0x55cb3d04eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:08.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.509+0000 7fc944a00640 1 -- 172.21.15.138:0/139598082 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cb3d04e700 msgr2=0x55cb3d04eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:08.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.509+0000 7fc944a00640 1 --2- 172.21.15.138:0/139598082 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cb3d04e700 0x55cb3d04eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:08.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.509+0000 7fc944a00640 1 -- 172.21.15.138:0/139598082 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cb3d005740 msgr2=0x55cb3d005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:08.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.509+0000 7fc944a00640 1 --2- 172.21.15.138:0/139598082 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cb3d005740 0x55cb3d005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:08.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.509+0000 7fc944a00640 1 -- 172.21.15.138:0/139598082 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb3ce100e0 con 0x55cb3d04f020 2024-04-26T20:57:08.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.509+0000 7fc945400640 1 --2- 172.21.15.138:0/139598082 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cb3d04e700 0x55cb3d04eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:57:08.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.509+0000 7fc944a00640 1 --2- 172.21.15.138:0/139598082 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cb3d04f020 0x55cb3d005200 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc92c00f8d0 tx=0x7fc92c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8204a357f524225 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:08.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.513+0000 7fc932000640 1 -- 172.21.15.138:0/139598082 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92c025070 con 0x55cb3d04f020 2024-04-26T20:57:08.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.513+0000 7fc932000640 1 -- 172.21.15.138:0/139598082 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc92c01b050 con 0x55cb3d04f020 2024-04-26T20:57:08.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.513+0000 7fc932000640 1 -- 172.21.15.138:0/139598082 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92c014de0 con 0x55cb3d04f020 2024-04-26T20:57:08.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.513+0000 7fc94b1fa000 1 -- 172.21.15.138:0/139598082 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cb3d04f020 msgr2=0x55cb3d005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:08.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.513+0000 7fc94b1fa000 1 --2- 172.21.15.138:0/139598082 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cb3d04f020 0x55cb3d005200 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc92c00f8d0 tx=0x7fc92c012000 comp rx=0 tx=0).stop 2024-04-26T20:57:08.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.513+0000 7fc94b1fa000 1 -- 172.21.15.138:0/139598082 shutdown_connections 2024-04-26T20:57:08.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.513+0000 7fc94b1fa000 1 --2- 172.21.15.138:0/139598082 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cb3d005740 0x55cb3d005b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:08.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.513+0000 7fc94b1fa000 1 --2- 172.21.15.138:0/139598082 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cb3d04f020 0x55cb3d005200 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:08.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.513+0000 7fc94b1fa000 1 --2- 172.21.15.138:0/139598082 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cb3d04e700 0x55cb3d04eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:08.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.513+0000 7fc94b1fa000 1 -- 172.21.15.138:0/139598082 >> 172.21.15.138:0/139598082 conn(0x55cb3d0016f0 msgr2=0x55cb3d003ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:08.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.513+0000 7fc94b1fa000 1 -- 172.21.15.138:0/139598082 shutdown_connections 2024-04-26T20:57:08.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.513+0000 7fc94b1fa000 1 -- 172.21.15.138:0/139598082 wait complete. 2024-04-26T20:57:08.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.513+0000 7fc94b1fa000 1 -- start start 2024-04-26T20:57:08.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.513+0000 7fc94b1fa000 1 Processor -- start 2024-04-26T20:57:08.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.513+0000 7fc94b1fa000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cb3d005740 0x55cb3d0100a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:08.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.513+0000 7fc94b1fa000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cb3d04e700 0x55cb3d0105e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:08.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.513+0000 7fc94b1fa000 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cb3d04f020 0x55cb3d010b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:08.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.513+0000 7fc94b1fa000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55cb3ce60200 con 0x55cb3d005740 2024-04-26T20:57:08.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.513+0000 7fc94b1fa000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55cb3cdf6e80 con 0x55cb3d04e700 2024-04-26T20:57:08.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.513+0000 7fc94b1fa000 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55cb3ce4dae0 con 0x55cb3d04f020 2024-04-26T20:57:08.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.513+0000 7fc94b1fa000 10 client.0 _ll_register_callbacks cb 0x55cb3ce5fda0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:57:08.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.513+0000 7fc945400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cb3d005740 0x55cb3d0100a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:08.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.513+0000 7fc945400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cb3d005740 0x55cb3d0100a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:58272/0 (socket says 172.21.15.138:58272) 2024-04-26T20:57:08.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.513+0000 7fc945400640 1 -- 172.21.15.138:0/1942505231 learned_addr learned my addr 172.21.15.138:0/1942505231 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:08.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.513+0000 7fc945e00640 1 --2- 172.21.15.138:0/1942505231 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cb3d04f020 0x55cb3d010b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:08.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.513+0000 7fc944a00640 1 --2- 172.21.15.138:0/1942505231 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cb3d04e700 0x55cb3d0105e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:08.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.513+0000 7fc945400640 1 -- 172.21.15.138:0/1942505231 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cb3d04f020 msgr2=0x55cb3d010b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:08.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.513+0000 7fc945400640 1 --2- 172.21.15.138:0/1942505231 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cb3d04f020 0x55cb3d010b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:08.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.513+0000 7fc945400640 1 -- 172.21.15.138:0/1942505231 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cb3d04e700 msgr2=0x55cb3d0105e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:08.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.513+0000 7fc945400640 1 --2- 172.21.15.138:0/1942505231 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cb3d04e700 0x55cb3d0105e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:08.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.513+0000 7fc945400640 1 -- 172.21.15.138:0/1942505231 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb3cdf24e0 con 0x55cb3d005740 2024-04-26T20:57:08.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.513+0000 7fc944a00640 1 --2- 172.21.15.138:0/1942505231 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cb3d04e700 0x55cb3d0105e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:08.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.513+0000 7fc945400640 1 --2- 172.21.15.138:0/1942505231 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cb3d005740 0x55cb3d0100a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc9340eda80 tx=0x7fc9340abf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d62e16bd7ef8f776 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:08.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.513+0000 7fc926a00640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-04-26T20:57:08.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.513+0000 7fc926a00640 1 -- 172.21.15.138:0/1942505231 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9340f0c70 con 0x55cb3d005740 2024-04-26T20:57:08.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.513+0000 7fc926a00640 1 -- 172.21.15.138:0/1942505231 <== mon.0 v2:172.21.15.138:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fc9340ed370 con 0x55cb3d005740 2024-04-26T20:57:08.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.513+0000 7fc94b1fa000 1 -- 172.21.15.138:0/1942505231 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc92c01b050 con 0x55cb3d005740 2024-04-26T20:57:08.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.517+0000 7fc926a00640 1 -- 172.21.15.138:0/1942505231 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fc9340f5920 con 0x55cb3d005740 2024-04-26T20:57:08.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.517+0000 7fc94b1fa000 10 client.4785 fetch_fsmap learned FSMap version 9 2024-04-26T20:57:08.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.517+0000 7fc94b1fa000 1 -- 172.21.15.138:0/1942505231 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55cb3cdd8e80 con 0x55cb3d005740 2024-04-26T20:57:08.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.517+0000 7fc926a00640 1 -- 172.21.15.138:0/1942505231 <== mon.0 v2:172.21.15.138:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc92c01b050 con 0x55cb3d005740 2024-04-26T20:57:08.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.517+0000 7fc926a00640 1 -- 172.21.15.138:0/1942505231 <== mon.0 v2:172.21.15.138:3300/0 5 ==== fsmap(e 9) ==== 3502+0+0 (secure 0 0 0) 0x7fc9340c7070 con 0x55cb3d005740 2024-04-26T20:57:08.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.517+0000 7fc94b1fa000 10 client.4785 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T20:57:08.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.517+0000 7fc94b1fa000 10 client.4785 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T20:57:08.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.517+0000 7fc94b1fa000 20 client.4785 populate_metadata read hostname 'smithi138' 2024-04-26T20:57:08.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.517+0000 7fc94b1fa000 1 --2- 172.21.15.138:0/1942505231 >> [v2:172.21.15.143:6834/3598364176,v1:172.21.15.143:6836/3598364176] conn(0x55cb3d011530 0x55cb3d0607b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:08.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.517+0000 7fc94b1fa000 4 client.4785 mds_command: new command op to 4290 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:57:08.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.517+0000 7fc94b1fa000 1 -- 172.21.15.138:0/1942505231 --> [v2:172.21.15.143:6834/3598364176,v1:172.21.15.143:6836/3598364176] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cb3cdebbc0 con 0x55cb3d011530 2024-04-26T20:57:08.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.517+0000 7fc944a00640 1 --2- 172.21.15.138:0/1942505231 >> [v2:172.21.15.143:6834/3598364176,v1:172.21.15.143:6836/3598364176] conn(0x55cb3d011530 0x55cb3d0607b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:08.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.517+0000 7fc944a00640 1 --2- 172.21.15.138:0/1942505231 >> [v2:172.21.15.143:6834/3598364176,v1:172.21.15.143:6836/3598364176] conn(0x55cb3d011530 0x55cb3d0607b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=485e13450f0f31c6 server_cookie=5cb446b48c4c335d in_seq=0 out_seq=0 2024-04-26T20:57:08.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.517+0000 7fc926a00640 10 client.4785 ms_handle_connect on v2:172.21.15.143:6834/3598364176 2024-04-26T20:57:08.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.517+0000 7fc926a00640 1 -- 172.21.15.138:0/1942505231 <== mds.0 v2:172.21.15.143:6834/3598364176 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55cb3cdebbc0 con 0x55cb3d011530 2024-04-26T20:57:08.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.517+0000 7fc926a00640 10 client.4785 handle_command_reply: tid=0 2024-04-26T20:57:08.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.517+0000 7fc94b1fa000 1 client.4785 shutdown 2024-04-26T20:57:08.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.517+0000 7fc94b1fa000 1 -- 172.21.15.138:0/1942505231 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cb3d005740 msgr2=0x55cb3d0100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:08.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.517+0000 7fc94b1fa000 1 --2- 172.21.15.138:0/1942505231 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cb3d005740 0x55cb3d0100a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc9340eda80 tx=0x7fc9340abf90 comp rx=0 tx=0).stop 2024-04-26T20:57:08.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.517+0000 7fc94b1fa000 1 -- 172.21.15.138:0/1942505231 shutdown_connections 2024-04-26T20:57:08.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.517+0000 7fc94b1fa000 1 --2- 172.21.15.138:0/1942505231 >> [v2:172.21.15.143:6834/3598364176,v1:172.21.15.143:6836/3598364176] conn(0x55cb3d011530 0x55cb3d0607b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:08.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.517+0000 7fc94b1fa000 1 --2- 172.21.15.138:0/1942505231 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cb3d04f020 0x55cb3d010b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:08.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.517+0000 7fc94b1fa000 1 --2- 172.21.15.138:0/1942505231 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cb3d04e700 0x55cb3d0105e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:08.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.517+0000 7fc94b1fa000 1 --2- 172.21.15.138:0/1942505231 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cb3d005740 0x55cb3d0100a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:08.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.517+0000 7fc94b1fa000 1 -- 172.21.15.138:0/1942505231 >> 172.21.15.138:0/1942505231 conn(0x55cb3d0016f0 msgr2=0x55cb3d004370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:08.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.517+0000 7fc926a00640 0 client.4785 ms_handle_reset on v2:172.21.15.143:6834/3598364176 2024-04-26T20:57:08.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.517+0000 7fc94b1fa000 1 -- 172.21.15.138:0/1942505231 shutdown_connections 2024-04-26T20:57:08.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.517+0000 7fc94b1fa000 1 -- 172.21.15.138:0/1942505231 wait complete. 2024-04-26T20:57:08.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.517+0000 7fc94b1fa000 20 client.4785 trim_cache size 0 max 16384 2024-04-26T20:57:08.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.537+0000 7fc94b1fa000 1 Processor -- start 2024-04-26T20:57:08.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.537+0000 7fc94b1fa000 1 -- start start 2024-04-26T20:57:08.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.537+0000 7fc94b1fa000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cb3d00ade0 0x55cb3d004af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:08.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.537+0000 7fc94b1fa000 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cb3d0016f0 0x55cb3d005030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:08.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.537+0000 7fc94b1fa000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cb3d005740 0x55cb3d0607b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:08.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.537+0000 7fc94b1fa000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc9402058f0 con 0x55cb3d00ade0 2024-04-26T20:57:08.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.537+0000 7fc94b1fa000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fc9402048d0 con 0x55cb3d005740 2024-04-26T20:57:08.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.537+0000 7fc94b1fa000 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fc940204280 con 0x55cb3d0016f0 2024-04-26T20:57:08.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.537+0000 7fc945400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cb3d00ade0 0x55cb3d004af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:08.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.537+0000 7fc945400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cb3d00ade0 0x55cb3d004af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:58274/0 (socket says 172.21.15.138:58274) 2024-04-26T20:57:08.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.537+0000 7fc945400640 1 -- 172.21.15.138:0/3438577908 learned_addr learned my addr 172.21.15.138:0/3438577908 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:08.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.537+0000 7fc945400640 1 -- 172.21.15.138:0/3438577908 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cb3d0016f0 msgr2=0x55cb3d005030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:08.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.537+0000 7fc945400640 1 --2- 172.21.15.138:0/3438577908 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cb3d0016f0 0x55cb3d005030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:08.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.537+0000 7fc945400640 1 -- 172.21.15.138:0/3438577908 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cb3d005740 msgr2=0x55cb3d0607b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:08.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.537+0000 7fc945400640 1 --2- 172.21.15.138:0/3438577908 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cb3d005740 0x55cb3d0607b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:08.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.537+0000 7fc945400640 1 -- 172.21.15.138:0/3438577908 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb3ce0bc50 con 0x55cb3d00ade0 2024-04-26T20:57:08.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.537+0000 7fc945400640 1 --2- 172.21.15.138:0/3438577908 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cb3d00ade0 0x55cb3d004af0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc9340edfa0 tx=0x7fc9340c0000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0d7f62661664157 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:08.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.537+0000 7fc931600640 1 -- 172.21.15.138:0/3438577908 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9340f13f0 con 0x55cb3d00ade0 2024-04-26T20:57:08.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.537+0000 7fc931600640 1 -- 172.21.15.138:0/3438577908 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9340b0040 con 0x55cb3d00ade0 2024-04-26T20:57:08.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.537+0000 7fc931600640 1 -- 172.21.15.138:0/3438577908 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9340ed370 con 0x55cb3d00ade0 2024-04-26T20:57:08.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.537+0000 7fc94b1fa000 1 -- 172.21.15.138:0/3438577908 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cb3d00ade0 msgr2=0x55cb3d004af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:08.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.537+0000 7fc94b1fa000 1 --2- 172.21.15.138:0/3438577908 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cb3d00ade0 0x55cb3d004af0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc9340edfa0 tx=0x7fc9340c0000 comp rx=0 tx=0).stop 2024-04-26T20:57:08.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.537+0000 7fc94b1fa000 1 -- 172.21.15.138:0/3438577908 shutdown_connections 2024-04-26T20:57:08.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.537+0000 7fc94b1fa000 1 --2- 172.21.15.138:0/3438577908 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cb3d005740 0x55cb3d0607b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:08.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.537+0000 7fc94b1fa000 1 --2- 172.21.15.138:0/3438577908 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cb3d0016f0 0x55cb3d005030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:08.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.537+0000 7fc94b1fa000 1 --2- 172.21.15.138:0/3438577908 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cb3d00ade0 0x55cb3d004af0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:08.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.537+0000 7fc94b1fa000 1 -- 172.21.15.138:0/3438577908 >> 172.21.15.138:0/3438577908 conn(0x55cb3d04da80 msgr2=0x55cb3d05b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:08.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.537+0000 7fc94b1fa000 1 -- 172.21.15.138:0/3438577908 shutdown_connections 2024-04-26T20:57:08.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.537+0000 7fc94b1fa000 1 -- 172.21.15.138:0/3438577908 wait complete. 2024-04-26T20:57:08.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.537+0000 7fc94b1fa000 1 -- start start 2024-04-26T20:57:08.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.541+0000 7fc94b1fa000 1 Processor -- start 2024-04-26T20:57:08.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.541+0000 7fc94b1fa000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cb3d0016f0 0x55cb3d063830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:08.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.541+0000 7fc94b1fa000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cb3d005740 0x55cb3d07a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:08.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.541+0000 7fc94b1fa000 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cb3d00ade0 0x55cb3d07a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:08.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.541+0000 7fc94b1fa000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55cb3ce52110 con 0x55cb3d005740 2024-04-26T20:57:08.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.541+0000 7fc94b1fa000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55cb3cde87b0 con 0x55cb3d0016f0 2024-04-26T20:57:08.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.541+0000 7fc94b1fa000 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55cb3ce57430 con 0x55cb3d00ade0 2024-04-26T20:57:08.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.541+0000 7fc94b1fa000 10 client.0 _ll_register_callbacks cb 0x7fc9380096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:57:08.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.541+0000 7fc944a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cb3d005740 0x55cb3d07a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:08.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.541+0000 7fc944a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cb3d005740 0x55cb3d07a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:58276/0 (socket says 172.21.15.138:58276) 2024-04-26T20:57:08.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.541+0000 7fc944a00640 1 -- 172.21.15.138:0/3293018838 learned_addr learned my addr 172.21.15.138:0/3293018838 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:08.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.541+0000 7fc945400640 1 --2- 172.21.15.138:0/3293018838 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cb3d0016f0 0x55cb3d063830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:08.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.541+0000 7fc945e00640 1 --2- 172.21.15.138:0/3293018838 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cb3d00ade0 0x55cb3d07a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:08.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.541+0000 7fc944a00640 1 -- 172.21.15.138:0/3293018838 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cb3d00ade0 msgr2=0x55cb3d07a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:08.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.541+0000 7fc944a00640 1 --2- 172.21.15.138:0/3293018838 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cb3d00ade0 0x55cb3d07a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:08.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.541+0000 7fc944a00640 1 -- 172.21.15.138:0/3293018838 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cb3d0016f0 msgr2=0x55cb3d063830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:08.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.541+0000 7fc944a00640 1 --2- 172.21.15.138:0/3293018838 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cb3d0016f0 0x55cb3d063830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:08.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.541+0000 7fc944a00640 1 -- 172.21.15.138:0/3293018838 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb3ced5160 con 0x55cb3d005740 2024-04-26T20:57:08.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.541+0000 7fc944a00640 1 --2- 172.21.15.138:0/3293018838 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cb3d005740 0x55cb3d07a340 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc92c020000 tx=0x7fc92c007e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed6bf9c262087f65 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:08.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.541+0000 7fc926a00640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-04-26T20:57:08.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.541+0000 7fc926a00640 1 -- 172.21.15.138:0/3293018838 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92c025040 con 0x55cb3d005740 2024-04-26T20:57:08.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.541+0000 7fc926a00640 1 -- 172.21.15.138:0/3293018838 <== mon.0 v2:172.21.15.138:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fc92c031220 con 0x55cb3d005740 2024-04-26T20:57:08.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.541+0000 7fc94b1fa000 1 -- 172.21.15.138:0/3293018838 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9340b0040 con 0x55cb3d005740 2024-04-26T20:57:08.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.541+0000 7fc926a00640 1 -- 172.21.15.138:0/3293018838 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fc92c031480 con 0x55cb3d005740 2024-04-26T20:57:08.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.541+0000 7fc94b1fa000 10 client.4791 fetch_fsmap learned FSMap version 9 2024-04-26T20:57:08.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.541+0000 7fc94b1fa000 1 -- 172.21.15.138:0/3293018838 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55cb3cb0c0c0 con 0x55cb3d005740 2024-04-26T20:57:08.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.541+0000 7fc926a00640 1 -- 172.21.15.138:0/3293018838 <== mon.0 v2:172.21.15.138:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9340b0040 con 0x55cb3d005740 2024-04-26T20:57:08.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.541+0000 7fc926a00640 1 -- 172.21.15.138:0/3293018838 <== mon.0 v2:172.21.15.138:3300/0 5 ==== fsmap(e 9) ==== 3502+0+0 (secure 0 0 0) 0x7fc92c031620 con 0x55cb3d005740 2024-04-26T20:57:08.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.541+0000 7fc94b1fa000 10 client.4791 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T20:57:08.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.541+0000 7fc94b1fa000 10 client.4791 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T20:57:08.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.541+0000 7fc94b1fa000 20 client.4791 populate_metadata read hostname 'smithi138' 2024-04-26T20:57:08.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.541+0000 7fc94b1fa000 1 --2- 172.21.15.138:0/3293018838 >> [v2:172.21.15.143:6834/3598364176,v1:172.21.15.143:6836/3598364176] conn(0x55cb3d04e700 0x55cb3d0bd980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:08.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.541+0000 7fc94b1fa000 4 client.4791 mds_command: new command op to 4290 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T20:57:08.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.541+0000 7fc94b1fa000 1 -- 172.21.15.138:0/3293018838 --> [v2:172.21.15.143:6834/3598364176,v1:172.21.15.143:6836/3598364176] -- command(tid 0: {"prefix": "status"}) -- 0x55cb3d04de60 con 0x55cb3d04e700 2024-04-26T20:57:08.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.541+0000 7fc945400640 1 --2- 172.21.15.138:0/3293018838 >> [v2:172.21.15.143:6834/3598364176,v1:172.21.15.143:6836/3598364176] conn(0x55cb3d04e700 0x55cb3d0bd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:08.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.545+0000 7fc926a00640 10 client.4791 ms_handle_connect on v2:172.21.15.143:6834/3598364176 2024-04-26T20:57:08.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.541+0000 7fc945400640 1 --2- 172.21.15.138:0/3293018838 >> [v2:172.21.15.143:6834/3598364176,v1:172.21.15.143:6836/3598364176] conn(0x55cb3d04e700 0x55cb3d0bd980 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=875b0c43379a2ac0 server_cookie=f6d44aa0fb91c4dc in_seq=0 out_seq=0 2024-04-26T20:57:08.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.545+0000 7fc926a00640 1 -- 172.21.15.138:0/3293018838 <== mds.0 v2:172.21.15.143:6834/3598364176 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x55cb3d04de60 con 0x55cb3d04e700 2024-04-26T20:57:08.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.545+0000 7fc926a00640 10 client.4791 handle_command_reply: tid=0 2024-04-26T20:57:08.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.545+0000 7fc94b1fa000 1 client.4791 shutdown 2024-04-26T20:57:08.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.545+0000 7fc94b1fa000 1 -- 172.21.15.138:0/3293018838 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cb3d005740 msgr2=0x55cb3d07a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:08.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.545+0000 7fc94b1fa000 1 --2- 172.21.15.138:0/3293018838 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cb3d005740 0x55cb3d07a340 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc92c020000 tx=0x7fc92c007e60 comp rx=0 tx=0).stop 2024-04-26T20:57:08.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.545+0000 7fc94b1fa000 1 -- 172.21.15.138:0/3293018838 shutdown_connections 2024-04-26T20:57:08.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.545+0000 7fc94b1fa000 1 --2- 172.21.15.138:0/3293018838 >> [v2:172.21.15.143:6834/3598364176,v1:172.21.15.143:6836/3598364176] conn(0x55cb3d04e700 0x55cb3d0bd980 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:08.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.545+0000 7fc94b1fa000 1 --2- 172.21.15.138:0/3293018838 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cb3d00ade0 0x55cb3d07a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:08.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.545+0000 7fc94b1fa000 1 --2- 172.21.15.138:0/3293018838 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cb3d005740 0x55cb3d07a340 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:08.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.545+0000 7fc94b1fa000 1 --2- 172.21.15.138:0/3293018838 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cb3d0016f0 0x55cb3d063830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:08.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.545+0000 7fc94b1fa000 1 -- 172.21.15.138:0/3293018838 >> 172.21.15.138:0/3293018838 conn(0x55cb3d04da80 msgr2=0x55cb3d05bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:08.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.545+0000 7fc926a00640 0 client.4791 ms_handle_reset on v2:172.21.15.143:6834/3598364176 2024-04-26T20:57:08.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.545+0000 7fc94b1fa000 1 -- 172.21.15.138:0/3293018838 shutdown_connections 2024-04-26T20:57:08.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.545+0000 7fc94b1fa000 1 -- 172.21.15.138:0/3293018838 wait complete. 2024-04-26T20:57:08.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.545+0000 7fc94b1fa000 20 client.4791 trim_cache size 0 max 16384 2024-04-26T20:57:08.552 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-26T20:57:08.552 INFO:teuthology.orchestra.run.smithi138.stdout: "cluster_fsid": "c22b4730-12cc-4558-8535-b965384398c0", 2024-04-26T20:57:08.552 INFO:teuthology.orchestra.run.smithi138.stdout: "whoami": 0, 2024-04-26T20:57:08.552 INFO:teuthology.orchestra.run.smithi138.stdout: "id": 4290, 2024-04-26T20:57:08.552 INFO:teuthology.orchestra.run.smithi138.stdout: "want_state": "up:active", 2024-04-26T20:57:08.552 INFO:teuthology.orchestra.run.smithi138.stdout: "state": "up:active", 2024-04-26T20:57:08.552 INFO:teuthology.orchestra.run.smithi138.stdout: "fs_name": "cephfs", 2024-04-26T20:57:08.552 INFO:teuthology.orchestra.run.smithi138.stdout: "rank_uptime": 28.327924978999999, 2024-04-26T20:57:08.553 INFO:teuthology.orchestra.run.smithi138.stdout: "mdsmap_epoch": 9, 2024-04-26T20:57:08.553 INFO:teuthology.orchestra.run.smithi138.stdout: "osdmap_epoch": 27, 2024-04-26T20:57:08.553 INFO:teuthology.orchestra.run.smithi138.stdout: "osdmap_epoch_barrier": 27, 2024-04-26T20:57:08.553 INFO:teuthology.orchestra.run.smithi138.stdout: "uptime": 35.788081742000003 2024-04-26T20:57:08.553 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-26T20:57:08.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.545+0000 7fc947e00640 1 -- 172.21.15.138:0/3276858763 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc920068380 msgr2=0x7fc92006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:08.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.545+0000 7fc947e00640 1 --2- 172.21.15.138:0/3276858763 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc920068380 0x7fc92006a840 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc94014f8d0 tx=0x7fc92c009040 comp rx=0 tx=0).stop 2024-04-26T20:57:08.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.545+0000 7fc947e00640 1 -- 172.21.15.138:0/3276858763 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc9400cca00 msgr2=0x7fc9400b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:08.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.545+0000 7fc947e00640 1 --2- 172.21.15.138:0/3276858763 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc9400cca00 0x7fc9400b6120 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc9340ad040 tx=0x7fc93401ada0 comp rx=0 tx=0).stop 2024-04-26T20:57:08.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.545+0000 7fc947e00640 1 -- 172.21.15.138:0/3276858763 shutdown_connections 2024-04-26T20:57:08.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.545+0000 7fc947e00640 1 --2- 172.21.15.138:0/3276858763 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc920068380 0x7fc92006a840 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:08.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.545+0000 7fc947e00640 1 --2- 172.21.15.138:0/3276858763 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc94015e0c0 0x7fc9400c7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:08.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.545+0000 7fc947e00640 1 --2- 172.21.15.138:0/3276858763 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc94015ce20 0x7fc94014ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:08.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.545+0000 7fc947e00640 1 --2- 172.21.15.138:0/3276858763 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc9400cca00 0x7fc9400b6120 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:08.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.545+0000 7fc947e00640 1 -- 172.21.15.138:0/3276858763 >> 172.21.15.138:0/3276858763 conn(0x7fc9400d0b20 msgr2=0x7fc9400cdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:08.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.545+0000 7fc947e00640 1 -- 172.21.15.138:0/3276858763 shutdown_connections 2024-04-26T20:57:08.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:08.545+0000 7fc947e00640 1 -- 172.21.15.138:0/3276858763 wait complete. 2024-04-26T20:57:08.568 INFO:teuthology.run_tasks:Running task sequential... 2024-04-26T20:57:08.577 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-26T20:57:08.577 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-26T20:57:08.578 INFO:teuthology.task.print:Enabling mgr modules 2024-04-26T20:57:08.578 INFO:teuthology.run_tasks:Running task kclient... 2024-04-26T20:57:08.595 INFO:tasks.kclient:Mounting kernel clients... 2024-04-26T20:57:08.595 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-04-26T20:57:08.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:57:08.595 DEBUG:teuthology.orchestra.run.smithi138:> ip netns list 2024-04-26T20:57:08.604 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-04-26T20:57:08.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:57:08.605 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T20:57:08.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:57:08.667 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link delete ceph-brx 2024-04-26T20:57:08.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:57:08.842 DEBUG:teuthology.orchestra.run.smithi138:> ip netns list 2024-04-26T20:57:08.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:57:08.851 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link delete ceph-brx 2024-04-26T20:57:08.916 INFO:teuthology.orchestra.run.smithi138.stderr:Cannot find device "ceph-brx" 2024-04-26T20:57:08.918 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:57:08.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:57:08.918 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list 2024-04-26T20:57:08.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:57:08.929 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link delete ceph-brx 2024-04-26T20:57:08.998 INFO:teuthology.orchestra.run.smithi143.stderr:Cannot find device "ceph-brx" 2024-04-26T20:57:09.000 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:57:09.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:57:09.000 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list 2024-04-26T20:57:09.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:57:09.050 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link delete ceph-brx 2024-04-26T20:57:09.118 INFO:teuthology.orchestra.run.smithi143.stderr:Cannot find device "ceph-brx" 2024-04-26T20:57:09.120 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:57:09.120 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-04-26T20:57:09.120 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T20:57:09.120 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T20:57:09.121 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T20:57:09.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.253+0000 7fc58e600640 1 Processor -- start 2024-04-26T20:57:09.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.253+0000 7fc58e600640 1 -- start start 2024-04-26T20:57:09.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.253+0000 7fc58e600640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc58815ef60 0x7fc5880cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:09.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.253+0000 7fc58e600640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc58806d990 con 0x7fc5880b4030 2024-04-26T20:57:09.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.253+0000 7fc58e600640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc58806dfc0 con 0x7fc5880ce4d0 2024-04-26T20:57:09.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.253+0000 7fc58e600640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fc58806e2a0 con 0x7fc58815ef60 2024-04-26T20:57:09.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.253+0000 7fc58d200640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fc5880b4030 0x7fc58815e850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:37818/0 (socket says 172.21.15.138:37818) 2024-04-26T20:57:09.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.253+0000 7fc58d200640 1 -- 172.21.15.138:0/1972246195 learned_addr learned my addr 172.21.15.138:0/1972246195 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:09.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.253+0000 7fc57fe00640 1 --2- 172.21.15.138:0/1972246195 >> v2:172.21.15.138:3300/0 conn(0x7fc58815ef60 0x7fc5880cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:09.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.253+0000 7fc57fe00640 1 -- 172.21.15.138:0/1972246195 >> v1:172.21.15.143:6789/0 conn(0x7fc5880ce4d0 legacy=0x7fc5880ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:09.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.253+0000 7fc57fe00640 1 -- 172.21.15.138:0/1972246195 >> v1:172.21.15.138:6789/0 conn(0x7fc5880b4030 legacy=0x7fc58815e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:09.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.253+0000 7fc57fe00640 1 -- 172.21.15.138:0/1972246195 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc58806e580 con 0x7fc58815ef60 2024-04-26T20:57:09.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.253+0000 7fc587e00640 1 -- 172.21.15.138:0/1972246195 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1241098938 0 0) 0x7fc58806d990 con 0x7fc5880b4030 2024-04-26T20:57:09.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.257+0000 7fc57fe00640 1 --2- 172.21.15.138:0/1972246195 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc58815ef60 0x7fc5880cdf90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc5700097c0 tx=0x7fc57001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35b345c042846587 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:09.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.257+0000 7fc587e00640 1 -- 172.21.15.138:0/1972246195 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5700b1070 con 0x7fc58815ef60 2024-04-26T20:57:09.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.257+0000 7fc587e00640 1 -- 172.21.15.138:0/1972246195 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5700ac620 con 0x7fc58815ef60 2024-04-26T20:57:09.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.257+0000 7fc587e00640 1 -- 172.21.15.138:0/1972246195 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5700ac9f0 con 0x7fc58815ef60 2024-04-26T20:57:09.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.257+0000 7fc58e600640 1 -- 172.21.15.138:0/1972246195 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc58815ef60 msgr2=0x7fc5880cdf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:09.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.257+0000 7fc58e600640 1 --2- 172.21.15.138:0/1972246195 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc58815ef60 0x7fc5880cdf90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc5700097c0 tx=0x7fc57001c460 comp rx=0 tx=0).stop 2024-04-26T20:57:09.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.257+0000 7fc58e600640 1 -- 172.21.15.138:0/1972246195 shutdown_connections 2024-04-26T20:57:09.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.257+0000 7fc58e600640 1 --2- 172.21.15.138:0/1972246195 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc58815ef60 0x7fc5880cdf90 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:09.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.257+0000 7fc58e600640 1 -- 172.21.15.138:0/1972246195 >> 172.21.15.138:0/1972246195 conn(0x7fc5880d2be0 msgr2=0x7fc5880d2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:09.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.257+0000 7fc58e600640 1 -- 172.21.15.138:0/1972246195 shutdown_connections 2024-04-26T20:57:09.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.257+0000 7fc58e600640 1 -- 172.21.15.138:0/1972246195 wait complete. 2024-04-26T20:57:09.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.261+0000 7fc58e600640 1 Processor -- start 2024-04-26T20:57:09.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.261+0000 7fc58e600640 1 -- start start 2024-04-26T20:57:09.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.261+0000 7fc58e600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc5880b4030 0x7fc5881582a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:09.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.261+0000 7fc58e600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc5880ce4d0 0x7fc588155990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:09.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.261+0000 7fc58e600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc58815ef60 0x7fc5881562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:09.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.261+0000 7fc58e600640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc58816d550 con 0x7fc58815ef60 2024-04-26T20:57:09.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.261+0000 7fc58e600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fc5880d22d0 con 0x7fc5880ce4d0 2024-04-26T20:57:09.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.261+0000 7fc58e600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fc58816d6d0 con 0x7fc5880b4030 2024-04-26T20:57:09.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.261+0000 7fc58dc00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc58815ef60 0x7fc5881562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:09.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.261+0000 7fc58dc00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc58815ef60 0x7fc5881562a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:58294/0 (socket says 172.21.15.138:58294) 2024-04-26T20:57:09.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.261+0000 7fc58dc00640 1 -- 172.21.15.138:0/615948779 learned_addr learned my addr 172.21.15.138:0/615948779 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:09.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.261+0000 7fc57fe00640 1 --2- 172.21.15.138:0/615948779 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc5880ce4d0 0x7fc588155990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:09.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.261+0000 7fc58d200640 1 --2- 172.21.15.138:0/615948779 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc5880b4030 0x7fc5881582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:09.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.261+0000 7fc58dc00640 1 -- 172.21.15.138:0/615948779 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc5880b4030 msgr2=0x7fc5881582a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:09.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.261+0000 7fc58dc00640 1 --2- 172.21.15.138:0/615948779 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc5880b4030 0x7fc5881582a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:09.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.261+0000 7fc58dc00640 1 -- 172.21.15.138:0/615948779 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc5880ce4d0 msgr2=0x7fc588155990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:09.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.261+0000 7fc58dc00640 1 --2- 172.21.15.138:0/615948779 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc5880ce4d0 0x7fc588155990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:09.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.261+0000 7fc58dc00640 1 -- 172.21.15.138:0/615948779 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc588157200 con 0x7fc58815ef60 2024-04-26T20:57:09.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.261+0000 7fc58dc00640 1 --2- 172.21.15.138:0/615948779 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc58815ef60 0x7fc5881562a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc58000b9c0 tx=0x7fc58000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:09.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.261+0000 7fc585600640 1 -- 172.21.15.138:0/615948779 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc580019070 con 0x7fc58815ef60 2024-04-26T20:57:09.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.261+0000 7fc585600640 1 -- 172.21.15.138:0/615948779 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc58000cba0 con 0x7fc58815ef60 2024-04-26T20:57:09.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.261+0000 7fc585600640 1 -- 172.21.15.138:0/615948779 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc580014440 con 0x7fc58815ef60 2024-04-26T20:57:09.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.261+0000 7fc58e600640 1 -- 172.21.15.138:0/615948779 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5881574e0 con 0x7fc58815ef60 2024-04-26T20:57:09.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.261+0000 7fc58e600640 1 -- 172.21.15.138:0/615948779 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc588157aa0 con 0x7fc58815ef60 2024-04-26T20:57:09.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.265+0000 7fc58e600640 1 -- 172.21.15.138:0/615948779 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc588069b40 con 0x7fc58815ef60 2024-04-26T20:57:09.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.265+0000 7fc585600640 1 -- 172.21.15.138:0/615948779 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc58001c070 con 0x7fc58815ef60 2024-04-26T20:57:09.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.265+0000 7fc585600640 1 --2- 172.21.15.138:0/615948779 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc564068380 0x7fc56406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:09.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.265+0000 7fc585600640 1 -- 172.21.15.138:0/615948779 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fc580086980 con 0x7fc58815ef60 2024-04-26T20:57:09.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.265+0000 7fc58d200640 1 --2- 172.21.15.138:0/615948779 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc564068380 0x7fc56406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:09.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.265+0000 7fc58d200640 1 --2- 172.21.15.138:0/615948779 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc564068380 0x7fc56406a840 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc578000f70 tx=0x7fc578007df0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:09.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.269+0000 7fc585600640 1 -- 172.21.15.138:0/615948779 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc5800565b0 con 0x7fc58815ef60 2024-04-26T20:57:09.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.461+0000 7fc58e600640 1 -- 172.21.15.138:0/615948779 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc58816a840 con 0x7fc58815ef60 2024-04-26T20:57:09.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.465+0000 7fc585600640 1 -- 172.21.15.138:0/615948779 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7fc58005a8b0 con 0x7fc58815ef60 2024-04-26T20:57:09.467 INFO:teuthology.orchestra.run.smithi138.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-26T20:57:09.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.465+0000 7fc58e600640 1 -- 172.21.15.138:0/615948779 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc564068380 msgr2=0x7fc56406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:09.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.465+0000 7fc58e600640 1 --2- 172.21.15.138:0/615948779 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc564068380 0x7fc56406a840 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc578000f70 tx=0x7fc578007df0 comp rx=0 tx=0).stop 2024-04-26T20:57:09.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.465+0000 7fc58e600640 1 -- 172.21.15.138:0/615948779 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc58815ef60 msgr2=0x7fc5881562a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:09.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.465+0000 7fc58e600640 1 --2- 172.21.15.138:0/615948779 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc58815ef60 0x7fc5881562a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc58000b9c0 tx=0x7fc58000be80 comp rx=0 tx=0).stop 2024-04-26T20:57:09.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.465+0000 7fc58e600640 1 -- 172.21.15.138:0/615948779 shutdown_connections 2024-04-26T20:57:09.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.465+0000 7fc58e600640 1 --2- 172.21.15.138:0/615948779 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc564068380 0x7fc56406a840 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:09.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.465+0000 7fc58e600640 1 --2- 172.21.15.138:0/615948779 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc58815ef60 0x7fc5881562a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:09.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.465+0000 7fc58e600640 1 --2- 172.21.15.138:0/615948779 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc5880ce4d0 0x7fc588155990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:09.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.465+0000 7fc58e600640 1 --2- 172.21.15.138:0/615948779 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc5880b4030 0x7fc5881582a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:09.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.465+0000 7fc58e600640 1 -- 172.21.15.138:0/615948779 >> 172.21.15.138:0/615948779 conn(0x7fc5880d2be0 msgr2=0x7fc5880ce920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:09.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.465+0000 7fc58e600640 1 -- 172.21.15.138:0/615948779 shutdown_connections 2024-04-26T20:57:09.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09.465+0000 7fc58e600640 1 -- 172.21.15.138:0/615948779 wait complete. 2024-04-26T20:57:09.489 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T20:57:09.489 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T20:57:09.489 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi138.front.sepia.ceph.com 2024-04-26T20:57:09.489 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T20:57:09.489 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T20:57:09.490 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T20:57:09.490 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T20:57:09.490 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T20:57:09.490 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T20:57:09.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:57:09.490 DEBUG:teuthology.orchestra.run.smithi138:> ip addr 2024-04-26T20:57:09.498 INFO:teuthology.orchestra.run.smithi138.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T20:57:09.498 INFO:teuthology.orchestra.run.smithi138.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T20:57:09.498 INFO:teuthology.orchestra.run.smithi138.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T20:57:09.498 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:57:09.499 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 ::1/128 scope host 2024-04-26T20:57:09.499 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:57:09.499 INFO:teuthology.orchestra.run.smithi138.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T20:57:09.499 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:d9:36:7a brd ff:ff:ff:ff:ff:ff 2024-04-26T20:57:09.499 INFO:teuthology.orchestra.run.smithi138.stdout: altname enp7s0f0 2024-04-26T20:57:09.499 INFO:teuthology.orchestra.run.smithi138.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T20:57:09.499 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:d9:36:7b brd ff:ff:ff:ff:ff:ff 2024-04-26T20:57:09.499 INFO:teuthology.orchestra.run.smithi138.stdout: altname enp7s0f1 2024-04-26T20:57:09.499 INFO:teuthology.orchestra.run.smithi138.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T20:57:09.499 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:88:6f:70 brd ff:ff:ff:ff:ff:ff 2024-04-26T20:57:09.499 INFO:teuthology.orchestra.run.smithi138.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T20:57:09.499 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:88:6f:71 brd ff:ff:ff:ff:ff:ff 2024-04-26T20:57:09.499 INFO:teuthology.orchestra.run.smithi138.stdout: inet 172.21.15.138/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-26T20:57:09.499 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft 42395sec preferred_lft 42395sec 2024-04-26T20:57:09.500 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 fe80::ec4:7aff:fe88:6f71/64 scope link 2024-04-26T20:57:09.500 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:57:09.500 INFO:teuthology.orchestra.run.smithi138.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-26T20:57:09.500 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 02:42:f3:4e:97:bb brd ff:ff:ff:ff:ff:ff 2024-04-26T20:57:09.500 INFO:teuthology.orchestra.run.smithi138.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-26T20:57:09.500 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:57:09.501 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-26T20:57:09.501 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T20:57:09.501 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2024-04-26T20:57:09.501 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link add name ceph-brx type bridge 2024-04-26T20:57:09.501 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip addr flush dev ceph-brx 2024-04-26T20:57:09.501 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link set ceph-brx up 2024-04-26T20:57:09.501 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-26T20:57:09.501 DEBUG:teuthology.orchestra.run.smithi138:> ') 2024-04-26T20:57:09.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:57:09.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:57:09.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:57:09.659 DEBUG:teuthology.orchestra.run.smithi138:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T20:57:09.677 INFO:teuthology.orchestra.run.smithi138.stdout:1 2024-04-26T20:57:09.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:57:09.679 DEBUG:teuthology.orchestra.run.smithi138:> route 2024-04-26T20:57:09.738 INFO:teuthology.orchestra.run.smithi138.stdout:Kernel IP routing table 2024-04-26T20:57:09.738 INFO:teuthology.orchestra.run.smithi138.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T20:57:09.738 INFO:teuthology.orchestra.run.smithi138.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-26T20:57:09.738 INFO:teuthology.orchestra.run.smithi138.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T20:57:09.738 INFO:teuthology.orchestra.run.smithi138.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-26T20:57:09.738 INFO:teuthology.orchestra.run.smithi138.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-26T20:57:09.738 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T20:57:09.738 INFO:teuthology.orchestra.run.smithi138.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T20:57:09.738 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T20:57:09.739 INFO:teuthology.orchestra.run.smithi138.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T20:57:09.739 INFO:teuthology.orchestra.run.smithi138.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T20:57:09.739 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T20:57:09.739 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2024-04-26T20:57:09.739 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T20:57:09.739 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T20:57:09.739 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T20:57:09.739 DEBUG:teuthology.orchestra.run.smithi138:> ') 2024-04-26T20:57:09.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:57:09.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:57:09.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:57:09.875 DEBUG:teuthology.orchestra.run.smithi138:> ip netns list 2024-04-26T20:57:09.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:57:09.928 DEBUG:teuthology.orchestra.run.smithi138:> ip netns list-id 2024-04-26T20:57:09.979 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T20:57:09.979 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2024-04-26T20:57:09.980 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T20:57:09.980 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-26T20:57:09.980 DEBUG:teuthology.orchestra.run.smithi138:> ') 2024-04-26T20:57:10.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:57:10.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:57:10.109 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-26T20:57:10.110 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T20:57:10.110 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2024-04-26T20:57:10.110 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-26T20:57:10.110 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-26T20:57:10.110 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-26T20:57:10.110 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-26T20:57:10.110 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-26T20:57:10.110 DEBUG:teuthology.orchestra.run.smithi138:> ') 2024-04-26T20:57:10.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:57:10.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:57:10.251 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T20:57:10.251 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2024-04-26T20:57:10.251 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link set brx.0 up 2024-04-26T20:57:10.251 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link set dev brx.0 master ceph-brx 2024-04-26T20:57:10.251 DEBUG:teuthology.orchestra.run.smithi138:> ') 2024-04-26T20:57:10.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:57:10.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:57:10.379 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T20:57:10.379 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T20:57:10.387 INFO:teuthology.orchestra.run.smithi138.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T20:57:10.387 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T20:57:10.388 DEBUG:teuthology.orchestra.run.smithi138:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T20:57:10.442 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-26T20:57:10.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:57:10.443 DEBUG:teuthology.orchestra.run.smithi138:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T20:57:10.531 INFO:teuthology.orchestra.run.smithi138.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T20:57:10.531 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T20:57:11.041 INFO:teuthology.orchestra.run.smithi138.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T20:57:11.041 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T20:57:11.041 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: resolved to: "172.21.15.138:3300,172.21.15.143:3300,172.21.15.143:3301" 2024-04-26T20:57:11.041 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: trying mount with new device syntax: 0@c22b4730-12cc-4558-8535-b965384398c0.cephfs=/ 2024-04-26T20:57:11.041 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.138:3300/172.21.15.143:3300/172.21.15.143:3301" will pass to kernel 2024-04-26T20:57:11.045 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-26T20:57:11.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:57:11.045 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T20:57:11.064 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T20:57:11.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T20:57:11.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:57:11.165 INFO:teuthology.orchestra.run.smithi138.stdout:client4750 2024-04-26T20:57:11.165 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-26T20:57:11.166 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T20:57:11.174 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T20:57:11.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T20:57:11.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:57:11.276 INFO:teuthology.orchestra.run.smithi138.stdout:client4750 2024-04-26T20:57:11.276 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T20:57:11.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T20:57:11.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:57:11.374 INFO:teuthology.orchestra.run.smithi138.stdout:client4750 2024-04-26T20:57:11.375 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/c22b4730-12cc-4558-8535-b965384398c0.client4750/status') 2024-04-26T20:57:11.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:57:11.472 INFO:teuthology.orchestra.run.smithi138.stdout:instance: client.4750 (3)172.21.15.138:0/1736697521 2024-04-26T20:57:11.473 INFO:teuthology.orchestra.run.smithi138.stdout:blocklisted: false 2024-04-26T20:57:11.473 INFO:teuthology.orchestra.run.smithi138.stderr:0+1 records in 2024-04-26T20:57:11.473 INFO:teuthology.orchestra.run.smithi138.stderr:0+1 records out 2024-04-26T20:57:11.473 INFO:teuthology.orchestra.run.smithi138.stderr:71 bytes copied, 4.868e-05 s, 1.5 MB/s 2024-04-26T20:57:11.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:57:11.481 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-04-26T20:57:11.481 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T20:57:11.481 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-26T20:57:11.481 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T20:57:11.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.613+0000 7f7ea6000640 1 Processor -- start 2024-04-26T20:57:11.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.613+0000 7f7ea6000640 1 -- start start 2024-04-26T20:57:11.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.613+0000 7f7ea6000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f7ea00cc1e0 0x7f7ea00ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:11.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.613+0000 7f7ea6000640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ea00727f0 con 0x7f7ea00cbe00 2024-04-26T20:57:11.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.613+0000 7f7ea6000640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ea0072a70 con 0x7f7ea015cf80 2024-04-26T20:57:11.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.613+0000 7f7ea6000640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f7ea0074220 con 0x7f7ea00cc1e0 2024-04-26T20:57:11.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.613+0000 7f7e9f400640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f7ea00cbe00 0x7f7ea006de70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:37822/0 (socket says 172.21.15.138:37822) 2024-04-26T20:57:11.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.613+0000 7f7e9f400640 1 -- 172.21.15.138:0/1865133446 learned_addr learned my addr 172.21.15.138:0/1865133446 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:11.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.613+0000 7f7e9fe00640 1 --2- 172.21.15.138:0/1865133446 >> v2:172.21.15.138:3300/0 conn(0x7f7ea00cc1e0 0x7f7ea00ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:11.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.613+0000 7f7e9ea00640 1 -- 172.21.15.138:0/1865133446 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 6381889 0 0) 0x7f7e900014a0 con 0x7f7ea00cbe00 2024-04-26T20:57:11.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.613+0000 7f7e9ea00640 1 -- 172.21.15.138:0/1865133446 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e84005740 con 0x7f7ea00cbe00 2024-04-26T20:57:11.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.613+0000 7f7e9fe00640 1 -- 172.21.15.138:0/1865133446 >> v1:172.21.15.143:6789/0 conn(0x7f7ea015cf80 legacy=0x7f7ea0073b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:11.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.613+0000 7f7e9fe00640 1 -- 172.21.15.138:0/1865133446 >> v1:172.21.15.138:6789/0 conn(0x7f7ea00cbe00 legacy=0x7f7ea006de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:11.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.613+0000 7f7e9fe00640 1 -- 172.21.15.138:0/1865133446 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ea0072d50 con 0x7f7ea00cc1e0 2024-04-26T20:57:11.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.617+0000 7f7e9fe00640 1 --2- 172.21.15.138:0/1865133446 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ea00cc1e0 0x7f7ea00ce6f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7e980097c0 tx=0x7f7e9801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5656337411409ab0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:11.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.617+0000 7f7e9ea00640 1 -- 172.21.15.138:0/1865133446 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e980b0070 con 0x7f7ea00cc1e0 2024-04-26T20:57:11.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.617+0000 7f7e9ea00640 1 -- 172.21.15.138:0/1865133446 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e980ab600 con 0x7f7ea00cc1e0 2024-04-26T20:57:11.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.617+0000 7f7e9ea00640 1 -- 172.21.15.138:0/1865133446 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e980ab9d0 con 0x7f7ea00cc1e0 2024-04-26T20:57:11.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.617+0000 7f7ea6000640 1 -- 172.21.15.138:0/1865133446 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ea00cc1e0 msgr2=0x7f7ea00ce6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:11.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.617+0000 7f7ea6000640 1 --2- 172.21.15.138:0/1865133446 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ea00cc1e0 0x7f7ea00ce6f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7e980097c0 tx=0x7f7e9801c4a0 comp rx=0 tx=0).stop 2024-04-26T20:57:11.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.617+0000 7f7ea6000640 1 -- 172.21.15.138:0/1865133446 shutdown_connections 2024-04-26T20:57:11.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.617+0000 7f7ea6000640 1 --2- 172.21.15.138:0/1865133446 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ea00cc1e0 0x7f7ea00ce6f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:11.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.617+0000 7f7ea6000640 1 -- 172.21.15.138:0/1865133446 >> 172.21.15.138:0/1865133446 conn(0x7f7ea00d0b20 msgr2=0x7f7ea00d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:11.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.617+0000 7f7ea6000640 1 -- 172.21.15.138:0/1865133446 shutdown_connections 2024-04-26T20:57:11.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.617+0000 7f7ea6000640 1 -- 172.21.15.138:0/1865133446 wait complete. 2024-04-26T20:57:11.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.621+0000 7f7ea6000640 1 Processor -- start 2024-04-26T20:57:11.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.621+0000 7f7ea6000640 1 -- start start 2024-04-26T20:57:11.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.621+0000 7f7ea6000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7ea00cbe00 0x7f7ea00c6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:11.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.621+0000 7f7ea6000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ea00cc1e0 0x7f7ea00b1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:11.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.621+0000 7f7ea6000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ea015cf80 0x7f7ea00b18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:11.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.621+0000 7f7ea6000640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea00d0780 con 0x7f7ea015cf80 2024-04-26T20:57:11.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.621+0000 7f7ea6000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea0073680 con 0x7f7ea00cc1e0 2024-04-26T20:57:11.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.621+0000 7f7ea6000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f7ea00d0900 con 0x7f7ea00cbe00 2024-04-26T20:57:11.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.621+0000 7f7e9fe00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ea015cf80 0x7f7ea00b18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:11.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.621+0000 7f7e9fe00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ea015cf80 0x7f7ea00b18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:58314/0 (socket says 172.21.15.138:58314) 2024-04-26T20:57:11.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.621+0000 7f7e9fe00640 1 -- 172.21.15.138:0/3915051882 learned_addr learned my addr 172.21.15.138:0/3915051882 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:11.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.621+0000 7f7e9f400640 1 --2- 172.21.15.138:0/3915051882 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7ea00cbe00 0x7f7ea00c6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:11.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.621+0000 7f7e96a00640 1 --2- 172.21.15.138:0/3915051882 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ea00cc1e0 0x7f7ea00b1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:11.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.621+0000 7f7e9fe00640 1 -- 172.21.15.138:0/3915051882 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7ea00cbe00 msgr2=0x7f7ea00c6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:11.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.621+0000 7f7e9fe00640 1 --2- 172.21.15.138:0/3915051882 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7ea00cbe00 0x7f7ea00c6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:11.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.621+0000 7f7e9fe00640 1 -- 172.21.15.138:0/3915051882 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ea00cc1e0 msgr2=0x7f7ea00b1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:11.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.621+0000 7f7e9fe00640 1 --2- 172.21.15.138:0/3915051882 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ea00cc1e0 0x7f7ea00b1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:11.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.621+0000 7f7e9fe00640 1 -- 172.21.15.138:0/3915051882 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ea00ae9d0 con 0x7f7ea015cf80 2024-04-26T20:57:11.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.621+0000 7f7e9fe00640 1 --2- 172.21.15.138:0/3915051882 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ea015cf80 0x7f7ea00b18c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7e980190b0 tx=0x7f7e9801ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:11.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.621+0000 7f7e97e00640 1 -- 172.21.15.138:0/3915051882 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e980b0050 con 0x7f7ea015cf80 2024-04-26T20:57:11.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.621+0000 7f7e97e00640 1 -- 172.21.15.138:0/3915051882 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e980bc070 con 0x7f7ea015cf80 2024-04-26T20:57:11.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.621+0000 7f7ea6000640 1 -- 172.21.15.138:0/3915051882 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ea00aecb0 con 0x7f7ea015cf80 2024-04-26T20:57:11.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.621+0000 7f7e97e00640 1 -- 172.21.15.138:0/3915051882 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e980abe60 con 0x7f7ea015cf80 2024-04-26T20:57:11.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.621+0000 7f7ea6000640 1 -- 172.21.15.138:0/3915051882 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ea00af270 con 0x7f7ea015cf80 2024-04-26T20:57:11.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.625+0000 7f7ea6000640 1 -- 172.21.15.138:0/3915051882 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ea0069510 con 0x7f7ea015cf80 2024-04-26T20:57:11.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.625+0000 7f7e97e00640 1 -- 172.21.15.138:0/3915051882 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7e980b5830 con 0x7f7ea015cf80 2024-04-26T20:57:11.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.625+0000 7f7e97e00640 1 --2- 172.21.15.138:0/3915051882 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7e7c068380 0x7f7e7c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:11.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.625+0000 7f7e97e00640 1 -- 172.21.15.138:0/3915051882 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f7e981213b0 con 0x7f7ea015cf80 2024-04-26T20:57:11.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.625+0000 7f7e9f400640 1 --2- 172.21.15.138:0/3915051882 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7e7c068380 0x7f7e7c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:11.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.625+0000 7f7e9f400640 1 --2- 172.21.15.138:0/3915051882 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7e7c068380 0x7f7e7c06a840 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7e90001640 tx=0x7f7e90001ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:11.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.629+0000 7f7e97e00640 1 -- 172.21.15.138:0/3915051882 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7e98016090 con 0x7f7ea015cf80 2024-04-26T20:57:11.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.821+0000 7f7ea6000640 1 -- 172.21.15.138:0/3915051882 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7ea01531e0 con 0x7f7ea015cf80 2024-04-26T20:57:11.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.821+0000 7f7e97e00640 1 -- 172.21.15.138:0/3915051882 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f7e980f1060 con 0x7f7ea015cf80 2024-04-26T20:57:11.827 INFO:teuthology.orchestra.run.smithi138.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-26T20:57:11.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.825+0000 7f7ea6000640 1 -- 172.21.15.138:0/3915051882 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7e7c068380 msgr2=0x7f7e7c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:11.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.825+0000 7f7ea6000640 1 --2- 172.21.15.138:0/3915051882 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7e7c068380 0x7f7e7c06a840 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7e90001640 tx=0x7f7e90001ab0 comp rx=0 tx=0).stop 2024-04-26T20:57:11.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.825+0000 7f7ea6000640 1 -- 172.21.15.138:0/3915051882 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ea015cf80 msgr2=0x7f7ea00b18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:11.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.825+0000 7f7ea6000640 1 --2- 172.21.15.138:0/3915051882 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ea015cf80 0x7f7ea00b18c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7e980190b0 tx=0x7f7e9801ace0 comp rx=0 tx=0).stop 2024-04-26T20:57:11.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.825+0000 7f7ea6000640 1 -- 172.21.15.138:0/3915051882 shutdown_connections 2024-04-26T20:57:11.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.825+0000 7f7ea6000640 1 --2- 172.21.15.138:0/3915051882 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7e7c068380 0x7f7e7c06a840 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:11.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.825+0000 7f7ea6000640 1 --2- 172.21.15.138:0/3915051882 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ea015cf80 0x7f7ea00b18c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:11.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.825+0000 7f7ea6000640 1 --2- 172.21.15.138:0/3915051882 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ea00cc1e0 0x7f7ea00b1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:11.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.825+0000 7f7ea6000640 1 --2- 172.21.15.138:0/3915051882 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7ea00cbe00 0x7f7ea00c6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:11.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.825+0000 7f7ea6000640 1 -- 172.21.15.138:0/3915051882 >> 172.21.15.138:0/3915051882 conn(0x7f7ea00d0b20 msgr2=0x7f7ea015bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:11.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.825+0000 7f7ea6000640 1 -- 172.21.15.138:0/3915051882 shutdown_connections 2024-04-26T20:57:11.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:11.825+0000 7f7ea6000640 1 -- 172.21.15.138:0/3915051882 wait complete. 2024-04-26T20:57:11.847 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T20:57:11.847 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T20:57:11.847 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi138.front.sepia.ceph.com 2024-04-26T20:57:11.848 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-04-26T20:57:11.848 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-26T20:57:11.848 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T20:57:11.848 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T20:57:11.848 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T20:57:11.848 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-04-26T20:57:11.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:57:11.848 DEBUG:teuthology.orchestra.run.smithi138:> ip addr 2024-04-26T20:57:11.857 INFO:teuthology.orchestra.run.smithi138.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T20:57:11.857 INFO:teuthology.orchestra.run.smithi138.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T20:57:11.857 INFO:teuthology.orchestra.run.smithi138.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T20:57:11.857 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:57:11.857 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 ::1/128 scope host 2024-04-26T20:57:11.857 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:57:11.857 INFO:teuthology.orchestra.run.smithi138.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T20:57:11.857 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:d9:36:7a brd ff:ff:ff:ff:ff:ff 2024-04-26T20:57:11.857 INFO:teuthology.orchestra.run.smithi138.stdout: altname enp7s0f0 2024-04-26T20:57:11.857 INFO:teuthology.orchestra.run.smithi138.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T20:57:11.857 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:d9:36:7b brd ff:ff:ff:ff:ff:ff 2024-04-26T20:57:11.857 INFO:teuthology.orchestra.run.smithi138.stdout: altname enp7s0f1 2024-04-26T20:57:11.858 INFO:teuthology.orchestra.run.smithi138.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T20:57:11.858 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:88:6f:70 brd ff:ff:ff:ff:ff:ff 2024-04-26T20:57:11.858 INFO:teuthology.orchestra.run.smithi138.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T20:57:11.858 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:88:6f:71 brd ff:ff:ff:ff:ff:ff 2024-04-26T20:57:11.858 INFO:teuthology.orchestra.run.smithi138.stdout: inet 172.21.15.138/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-26T20:57:11.858 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft 42393sec preferred_lft 42393sec 2024-04-26T20:57:11.858 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 fe80::ec4:7aff:fe88:6f71/64 scope link 2024-04-26T20:57:11.858 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:57:11.858 INFO:teuthology.orchestra.run.smithi138.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-26T20:57:11.858 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 02:42:f3:4e:97:bb brd ff:ff:ff:ff:ff:ff 2024-04-26T20:57:11.858 INFO:teuthology.orchestra.run.smithi138.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-26T20:57:11.858 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:57:11.858 INFO:teuthology.orchestra.run.smithi138.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T20:57:11.858 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-26T20:57:11.859 INFO:teuthology.orchestra.run.smithi138.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-26T20:57:11.859 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:57:11.859 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2024-04-26T20:57:11.859 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:57:11.859 INFO:teuthology.orchestra.run.smithi138.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T20:57:11.859 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T20:57:11.859 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2024-04-26T20:57:11.859 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:57:11.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:57:11.860 DEBUG:teuthology.orchestra.run.smithi138:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T20:57:11.920 INFO:teuthology.orchestra.run.smithi138.stdout:1 2024-04-26T20:57:11.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:57:11.922 DEBUG:teuthology.orchestra.run.smithi138:> route 2024-04-26T20:57:11.974 INFO:teuthology.orchestra.run.smithi138.stdout:Kernel IP routing table 2024-04-26T20:57:11.974 INFO:teuthology.orchestra.run.smithi138.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T20:57:11.974 INFO:teuthology.orchestra.run.smithi138.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-26T20:57:11.974 INFO:teuthology.orchestra.run.smithi138.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T20:57:11.974 INFO:teuthology.orchestra.run.smithi138.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-26T20:57:11.974 INFO:teuthology.orchestra.run.smithi138.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-26T20:57:11.974 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T20:57:11.974 INFO:teuthology.orchestra.run.smithi138.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T20:57:11.974 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T20:57:11.975 INFO:teuthology.orchestra.run.smithi138.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T20:57:11.975 INFO:teuthology.orchestra.run.smithi138.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T20:57:11.975 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T20:57:11.975 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2024-04-26T20:57:11.975 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T20:57:11.975 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T20:57:11.975 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T20:57:11.975 DEBUG:teuthology.orchestra.run.smithi138:> ') 2024-04-26T20:57:12.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:57:12.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:57:12.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:57:12.112 DEBUG:teuthology.orchestra.run.smithi138:> ip netns list 2024-04-26T20:57:12.121 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T20:57:12.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:57:12.122 DEBUG:teuthology.orchestra.run.smithi138:> ip netns list-id 2024-04-26T20:57:12.170 INFO:teuthology.orchestra.run.smithi138.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-04-26T20:57:12.172 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T20:57:12.172 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2024-04-26T20:57:12.172 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T20:57:12.172 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-04-26T20:57:12.172 DEBUG:teuthology.orchestra.run.smithi138:> ') 2024-04-26T20:57:12.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:57:12.295 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:57:12.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:57:12.302 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-26T20:57:12.322 INFO:teuthology.orchestra.run.smithi138.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T20:57:12.322 INFO:teuthology.orchestra.run.smithi138.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T20:57:12.323 INFO:teuthology.orchestra.run.smithi138.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T20:57:12.323 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:57:12.323 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 ::1/128 scope host 2024-04-26T20:57:12.323 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:57:12.323 INFO:teuthology.orchestra.run.smithi138.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T20:57:12.323 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 82:72:3c:72:e4:b7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-26T20:57:12.323 INFO:teuthology.orchestra.run.smithi138.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-26T20:57:12.323 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:57:12.323 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 fe80::8072:3cff:fe72:e4b7/64 scope link tentative 2024-04-26T20:57:12.323 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:57:12.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:57:12.324 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-26T20:57:12.391 INFO:teuthology.orchestra.run.smithi138.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T20:57:12.392 INFO:teuthology.orchestra.run.smithi138.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T20:57:12.392 INFO:teuthology.orchestra.run.smithi138.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T20:57:12.392 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:57:12.392 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 ::1/128 scope host 2024-04-26T20:57:12.392 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:57:12.392 INFO:teuthology.orchestra.run.smithi138.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T20:57:12.392 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 82:72:3c:72:e4:b7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-26T20:57:12.392 INFO:teuthology.orchestra.run.smithi138.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-26T20:57:12.392 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:57:12.392 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 fe80::8072:3cff:fe72:e4b7/64 scope link 2024-04-26T20:57:12.392 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:57:12.394 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-04-26T20:57:12.394 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T20:57:12.394 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2024-04-26T20:57:12.394 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-04-26T20:57:12.394 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-26T20:57:12.394 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-04-26T20:57:12.394 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-04-26T20:57:12.394 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-04-26T20:57:12.394 DEBUG:teuthology.orchestra.run.smithi138:> ') 2024-04-26T20:57:12.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:57:12.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:57:12.572 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T20:57:12.572 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2024-04-26T20:57:12.572 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link set brx.1 up 2024-04-26T20:57:12.572 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link set dev brx.1 master ceph-brx 2024-04-26T20:57:12.572 DEBUG:teuthology.orchestra.run.smithi138:> ') 2024-04-26T20:57:12.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:57:12.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:57:12.697 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T20:57:12.697 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-04-26T20:57:12.706 INFO:teuthology.orchestra.run.smithi138.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-04-26T20:57:12.706 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T20:57:12.706 DEBUG:teuthology.orchestra.run.smithi138:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-04-26T20:57:12.758 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-04-26T20:57:12.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:57:12.758 DEBUG:teuthology.orchestra.run.smithi138:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T20:57:12.846 INFO:teuthology.orchestra.run.smithi138.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T20:57:12.846 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T20:57:12.860 INFO:teuthology.orchestra.run.smithi138.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T20:57:12.860 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T20:57:12.860 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: resolved to: "172.21.15.138:3300,172.21.15.143:3300,172.21.15.143:3301" 2024-04-26T20:57:12.860 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: trying mount with new device syntax: 2@c22b4730-12cc-4558-8535-b965384398c0.cephfs=/ 2024-04-26T20:57:12.860 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.138:3300/172.21.15.143:3300/172.21.15.143:3301" will pass to kernel 2024-04-26T20:57:12.864 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-26T20:57:12.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:57:12.864 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-04-26T20:57:12.925 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T20:57:13.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T20:57:13.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:57:13.027 INFO:teuthology.orchestra.run.smithi138.stdout:client4553 2024-04-26T20:57:13.027 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-26T20:57:13.027 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T20:57:13.036 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T20:57:13.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T20:57:13.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:57:13.134 INFO:teuthology.orchestra.run.smithi138.stdout:client4553 2024-04-26T20:57:13.135 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T20:57:13.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T20:57:13.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:57:13.190 INFO:teuthology.orchestra.run.smithi138.stdout:client4553 2024-04-26T20:57:13.190 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/c22b4730-12cc-4558-8535-b965384398c0.client4553/status') 2024-04-26T20:57:13.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:57:13.249 INFO:teuthology.orchestra.run.smithi138.stdout:instance: client.4553 (3)172.21.15.138:0/4021932103 2024-04-26T20:57:13.250 INFO:teuthology.orchestra.run.smithi138.stdout:blocklisted: false 2024-04-26T20:57:13.250 INFO:teuthology.orchestra.run.smithi138.stderr:0+1 records in 2024-04-26T20:57:13.250 INFO:teuthology.orchestra.run.smithi138.stderr:0+1 records out 2024-04-26T20:57:13.250 INFO:teuthology.orchestra.run.smithi138.stderr:71 bytes copied, 6.4749e-05 s, 1.1 MB/s 2024-04-26T20:57:13.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:57:13.258 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-04-26T20:57:13.258 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T20:57:13.258 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-26T20:57:13.258 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T20:57:13.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.389+0000 7f7b60800640 1 Processor -- start 2024-04-26T20:57:13.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.389+0000 7f7b60800640 1 -- start start 2024-04-26T20:57:13.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.393+0000 7f7b60800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7b58159250 0x7f7b580cb380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:13.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.393+0000 7f7b60800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f7b5815c270 0x7f7b58072bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:13.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.393+0000 7f7b60800640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b58072130 con 0x7f7b580cb8c0 2024-04-26T20:57:13.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.393+0000 7f7b60800640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f7b5815f4e0 con 0x7f7b5815c270 2024-04-26T20:57:13.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.393+0000 7f7b60800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f7b580cbd20 con 0x7f7b58159250 2024-04-26T20:57:13.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.393+0000 7f7b5e800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f7b5815c270 0x7f7b58072bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:13.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.393+0000 7f7b5e800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f7b5815c270 0x7f7b58072bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:58326/0 (socket says 172.21.15.138:58326) 2024-04-26T20:57:13.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.393+0000 7f7b5e800640 1 -- 172.21.15.138:0/3470713414 learned_addr learned my addr 172.21.15.138:0/3470713414 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:13.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.393+0000 7f7b5de00640 1 --2- 172.21.15.138:0/3470713414 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7b58159250 0x7f7b580cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:13.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.393+0000 7f7b5e800640 1 -- 172.21.15.138:0/3470713414 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7b58159250 msgr2=0x7f7b580cb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:13.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.393+0000 7f7b5e800640 1 --2- 172.21.15.138:0/3470713414 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7b58159250 0x7f7b580cb380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:13.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.393+0000 7f7b5e800640 1 -- 172.21.15.138:0/3470713414 >> v1:172.21.15.143:6789/0 conn(0x7f7b580cb8c0 legacy=0x7f7b5815bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:13.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.393+0000 7f7b5e800640 1 -- 172.21.15.138:0/3470713414 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b5815cae0 con 0x7f7b5815c270 2024-04-26T20:57:13.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.393+0000 7f7b5de00640 1 --2- 172.21.15.138:0/3470713414 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7b58159250 0x7f7b580cb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:13.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.397+0000 7f7b5e800640 1 --2- 172.21.15.138:0/3470713414 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b5815c270 0x7f7b58072bd0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7b54009e50 tx=0x7f7b5401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8aa448a624e7054 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:13.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.397+0000 7f7b5ca00640 1 -- 172.21.15.138:0/3470713414 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b540a5570 con 0x7f7b5815c270 2024-04-26T20:57:13.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.397+0000 7f7b5ca00640 1 -- 172.21.15.138:0/3470713414 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b540a5710 con 0x7f7b5815c270 2024-04-26T20:57:13.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.397+0000 7f7b5ca00640 1 -- 172.21.15.138:0/3470713414 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b540a5ae0 con 0x7f7b5815c270 2024-04-26T20:57:13.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.397+0000 7f7b60800640 1 -- 172.21.15.138:0/3470713414 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b5815c270 msgr2=0x7f7b58072bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:13.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.397+0000 7f7b60800640 1 --2- 172.21.15.138:0/3470713414 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b5815c270 0x7f7b58072bd0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7b54009e50 tx=0x7f7b5401ca30 comp rx=0 tx=0).stop 2024-04-26T20:57:13.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.397+0000 7f7b60800640 1 -- 172.21.15.138:0/3470713414 shutdown_connections 2024-04-26T20:57:13.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.397+0000 7f7b60800640 1 --2- 172.21.15.138:0/3470713414 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b5815c270 0x7f7b58072bd0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:13.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.397+0000 7f7b60800640 1 --2- 172.21.15.138:0/3470713414 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7b58159250 0x7f7b580cb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:13.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.397+0000 7f7b60800640 1 -- 172.21.15.138:0/3470713414 >> 172.21.15.138:0/3470713414 conn(0x7f7b580d0b20 msgr2=0x7f7b580d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:13.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.397+0000 7f7b60800640 1 -- 172.21.15.138:0/3470713414 shutdown_connections 2024-04-26T20:57:13.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.397+0000 7f7b60800640 1 -- 172.21.15.138:0/3470713414 wait complete. 2024-04-26T20:57:13.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.397+0000 7f7b60800640 1 Processor -- start 2024-04-26T20:57:13.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.397+0000 7f7b60800640 1 -- start start 2024-04-26T20:57:13.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.397+0000 7f7b60800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7b580cb8c0 0x7f7b580b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:13.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.397+0000 7f7b60800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b58159250 0x7f7b58168600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:13.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.397+0000 7f7b60800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7b5815c270 0x7f7b581fc010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:13.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.397+0000 7f7b60800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f7b58073520 con 0x7f7b58159250 2024-04-26T20:57:13.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.397+0000 7f7b60800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f7b580733a0 con 0x7f7b5815c270 2024-04-26T20:57:13.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.397+0000 7f7b60800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f7b580736a0 con 0x7f7b580cb8c0 2024-04-26T20:57:13.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.401+0000 7f7b5d400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b58159250 0x7f7b58168600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:13.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.401+0000 7f7b5d400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b58159250 0x7f7b58168600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:58328/0 (socket says 172.21.15.138:58328) 2024-04-26T20:57:13.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.401+0000 7f7b5d400640 1 -- 172.21.15.138:0/2979099202 learned_addr learned my addr 172.21.15.138:0/2979099202 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:13.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.401+0000 7f7b5de00640 1 --2- 172.21.15.138:0/2979099202 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7b580cb8c0 0x7f7b580b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:13.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.401+0000 7f7b5e800640 1 --2- 172.21.15.138:0/2979099202 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7b5815c270 0x7f7b581fc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:13.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.401+0000 7f7b5d400640 1 -- 172.21.15.138:0/2979099202 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7b580cb8c0 msgr2=0x7f7b580b5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:13.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.401+0000 7f7b5d400640 1 --2- 172.21.15.138:0/2979099202 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7b580cb8c0 0x7f7b580b5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:13.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.401+0000 7f7b5d400640 1 -- 172.21.15.138:0/2979099202 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7b5815c270 msgr2=0x7f7b581fc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:13.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.401+0000 7f7b5d400640 1 --2- 172.21.15.138:0/2979099202 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7b5815c270 0x7f7b581fc010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:13.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.401+0000 7f7b5d400640 1 -- 172.21.15.138:0/2979099202 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b58168d30 con 0x7f7b58159250 2024-04-26T20:57:13.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.401+0000 7f7b5d400640 1 --2- 172.21.15.138:0/2979099202 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b58159250 0x7f7b58168600 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7b4800c450 tx=0x7f7b4800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:13.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.401+0000 7f7b52000640 1 -- 172.21.15.138:0/2979099202 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b48016020 con 0x7f7b58159250 2024-04-26T20:57:13.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.401+0000 7f7b52000640 1 -- 172.21.15.138:0/2979099202 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b480052d0 con 0x7f7b58159250 2024-04-26T20:57:13.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.401+0000 7f7b52000640 1 -- 172.21.15.138:0/2979099202 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b48007260 con 0x7f7b58159250 2024-04-26T20:57:13.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.401+0000 7f7b60800640 1 -- 172.21.15.138:0/2979099202 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b58169010 con 0x7f7b58159250 2024-04-26T20:57:13.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.401+0000 7f7b60800640 1 -- 172.21.15.138:0/2979099202 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b581fbaf0 con 0x7f7b58159250 2024-04-26T20:57:13.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.401+0000 7f7b60800640 1 -- 172.21.15.138:0/2979099202 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b581fbcf0 con 0x7f7b58159250 2024-04-26T20:57:13.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.401+0000 7f7b52000640 1 -- 172.21.15.138:0/2979099202 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7b48007400 con 0x7f7b58159250 2024-04-26T20:57:13.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.405+0000 7f7b52000640 1 --2- 172.21.15.138:0/2979099202 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7b3c068380 0x7f7b3c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:13.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.405+0000 7f7b52000640 1 -- 172.21.15.138:0/2979099202 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f7b480865a0 con 0x7f7b58159250 2024-04-26T20:57:13.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.405+0000 7f7b5de00640 1 --2- 172.21.15.138:0/2979099202 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7b3c068380 0x7f7b3c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:13.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.405+0000 7f7b5de00640 1 --2- 172.21.15.138:0/2979099202 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7b3c068380 0x7f7b3c06a840 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c009950 tx=0x7f7b4c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:13.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.405+0000 7f7b52000640 1 -- 172.21.15.138:0/2979099202 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7b581fbcf0 con 0x7f7b58159250 2024-04-26T20:57:13.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.597+0000 7f7b60800640 1 -- 172.21.15.138:0/2979099202 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7b581fb8e0 con 0x7f7b58159250 2024-04-26T20:57:13.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.601+0000 7f7b52000640 1 -- 172.21.15.138:0/2979099202 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f7b48020020 con 0x7f7b58159250 2024-04-26T20:57:13.604 INFO:teuthology.orchestra.run.smithi138.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-26T20:57:13.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.601+0000 7f7b60800640 1 -- 172.21.15.138:0/2979099202 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7b3c068380 msgr2=0x7f7b3c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:13.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.601+0000 7f7b60800640 1 --2- 172.21.15.138:0/2979099202 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7b3c068380 0x7f7b3c06a840 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c009950 tx=0x7f7b4c008040 comp rx=0 tx=0).stop 2024-04-26T20:57:13.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.601+0000 7f7b60800640 1 -- 172.21.15.138:0/2979099202 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b58159250 msgr2=0x7f7b58168600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:13.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.601+0000 7f7b60800640 1 --2- 172.21.15.138:0/2979099202 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b58159250 0x7f7b58168600 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7b4800c450 tx=0x7f7b4800c910 comp rx=0 tx=0).stop 2024-04-26T20:57:13.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.601+0000 7f7b60800640 1 -- 172.21.15.138:0/2979099202 shutdown_connections 2024-04-26T20:57:13.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.601+0000 7f7b60800640 1 --2- 172.21.15.138:0/2979099202 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7b3c068380 0x7f7b3c06a840 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:13.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.601+0000 7f7b60800640 1 --2- 172.21.15.138:0/2979099202 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7b5815c270 0x7f7b581fc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:13.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.601+0000 7f7b60800640 1 --2- 172.21.15.138:0/2979099202 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b58159250 0x7f7b58168600 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:13.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.601+0000 7f7b60800640 1 --2- 172.21.15.138:0/2979099202 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7b580cb8c0 0x7f7b580b5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:13.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.601+0000 7f7b60800640 1 -- 172.21.15.138:0/2979099202 >> 172.21.15.138:0/2979099202 conn(0x7f7b580d0b20 msgr2=0x7f7b5815e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:13.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.601+0000 7f7b60800640 1 -- 172.21.15.138:0/2979099202 shutdown_connections 2024-04-26T20:57:13.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:13.601+0000 7f7b60800640 1 -- 172.21.15.138:0/2979099202 wait complete. 2024-04-26T20:57:13.624 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T20:57:13.624 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T20:57:13.624 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi143.front.sepia.ceph.com 2024-04-26T20:57:13.625 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-26T20:57:13.625 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-26T20:57:13.625 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T20:57:13.625 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T20:57:13.625 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T20:57:13.625 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-26T20:57:13.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:57:13.625 DEBUG:teuthology.orchestra.run.smithi143:> ip addr 2024-04-26T20:57:13.635 INFO:teuthology.orchestra.run.smithi143.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T20:57:13.635 INFO:teuthology.orchestra.run.smithi143.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T20:57:13.635 INFO:teuthology.orchestra.run.smithi143.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T20:57:13.635 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:57:13.635 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 ::1/128 scope host 2024-04-26T20:57:13.635 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:57:13.635 INFO:teuthology.orchestra.run.smithi143.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T20:57:13.635 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:d9:3b:94 brd ff:ff:ff:ff:ff:ff 2024-04-26T20:57:13.635 INFO:teuthology.orchestra.run.smithi143.stdout: altname enp7s0f0 2024-04-26T20:57:13.635 INFO:teuthology.orchestra.run.smithi143.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T20:57:13.635 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:d9:3b:95 brd ff:ff:ff:ff:ff:ff 2024-04-26T20:57:13.635 INFO:teuthology.orchestra.run.smithi143.stdout: altname enp7s0f1 2024-04-26T20:57:13.635 INFO:teuthology.orchestra.run.smithi143.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T20:57:13.636 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:88:77:82 brd ff:ff:ff:ff:ff:ff 2024-04-26T20:57:13.636 INFO:teuthology.orchestra.run.smithi143.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T20:57:13.636 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:88:77:83 brd ff:ff:ff:ff:ff:ff 2024-04-26T20:57:13.636 INFO:teuthology.orchestra.run.smithi143.stdout: inet 172.21.15.143/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-26T20:57:13.636 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft 42382sec preferred_lft 42382sec 2024-04-26T20:57:13.636 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::ec4:7aff:fe88:7783/64 scope link 2024-04-26T20:57:13.636 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:57:13.636 INFO:teuthology.orchestra.run.smithi143.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-26T20:57:13.636 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 02:42:f8:d3:ba:f1 brd ff:ff:ff:ff:ff:ff 2024-04-26T20:57:13.636 INFO:teuthology.orchestra.run.smithi143.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-26T20:57:13.636 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:57:13.637 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-26T20:57:13.637 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T20:57:13.637 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2024-04-26T20:57:13.637 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link add name ceph-brx type bridge 2024-04-26T20:57:13.637 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip addr flush dev ceph-brx 2024-04-26T20:57:13.637 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link set ceph-brx up 2024-04-26T20:57:13.637 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-26T20:57:13.638 DEBUG:teuthology.orchestra.run.smithi143:> ') 2024-04-26T20:57:13.733 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:57:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:57:13.797 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:57:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:57:13.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:57:13.804 DEBUG:teuthology.orchestra.run.smithi143:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T20:57:13.822 INFO:teuthology.orchestra.run.smithi143.stdout:1 2024-04-26T20:57:13.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:57:13.825 DEBUG:teuthology.orchestra.run.smithi143:> route 2024-04-26T20:57:13.899 INFO:teuthology.orchestra.run.smithi143.stdout:Kernel IP routing table 2024-04-26T20:57:13.899 INFO:teuthology.orchestra.run.smithi143.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T20:57:13.899 INFO:teuthology.orchestra.run.smithi143.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-26T20:57:13.899 INFO:teuthology.orchestra.run.smithi143.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T20:57:13.899 INFO:teuthology.orchestra.run.smithi143.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-26T20:57:13.899 INFO:teuthology.orchestra.run.smithi143.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-26T20:57:13.899 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T20:57:13.899 INFO:teuthology.orchestra.run.smithi143.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T20:57:13.899 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T20:57:13.900 INFO:teuthology.orchestra.run.smithi143.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T20:57:13.900 INFO:teuthology.orchestra.run.smithi143.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T20:57:13.900 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T20:57:13.900 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2024-04-26T20:57:13.900 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T20:57:13.900 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T20:57:13.900 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T20:57:13.900 DEBUG:teuthology.orchestra.run.smithi143:> ') 2024-04-26T20:57:13.989 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:57:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:57:14.028 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:57:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:57:14.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:57:14.035 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list 2024-04-26T20:57:14.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:57:14.045 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list-id 2024-04-26T20:57:14.093 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T20:57:14.093 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2024-04-26T20:57:14.093 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T20:57:14.093 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-26T20:57:14.093 DEBUG:teuthology.orchestra.run.smithi143:> ') 2024-04-26T20:57:14.182 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:57:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:57:14.212 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:57:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:57:14.219 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-26T20:57:14.219 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T20:57:14.219 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2024-04-26T20:57:14.219 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-26T20:57:14.219 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-26T20:57:14.220 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-26T20:57:14.220 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-26T20:57:14.220 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-26T20:57:14.220 DEBUG:teuthology.orchestra.run.smithi143:> ') 2024-04-26T20:57:14.265 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:57:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:57:14.380 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:57:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:57:14.387 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T20:57:14.387 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2024-04-26T20:57:14.387 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link set brx.0 up 2024-04-26T20:57:14.387 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link set dev brx.0 master ceph-brx 2024-04-26T20:57:14.387 DEBUG:teuthology.orchestra.run.smithi143:> ') 2024-04-26T20:57:14.478 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:57:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:57:14.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:57:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:57:14.515 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T20:57:14.515 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-26T20:57:14.524 INFO:teuthology.orchestra.run.smithi143.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-26T20:57:14.524 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T20:57:14.524 DEBUG:teuthology.orchestra.run.smithi143:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-26T20:57:14.576 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-04-26T20:57:14.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:57:14.576 DEBUG:teuthology.orchestra.run.smithi143:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T20:57:14.668 INFO:teuthology.orchestra.run.smithi143.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T20:57:14.668 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T20:57:15.226 INFO:teuthology.orchestra.run.smithi143.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T20:57:15.226 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T20:57:15.226 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: resolved to: "172.21.15.138:3300,172.21.15.143:3300,172.21.15.143:3301" 2024-04-26T20:57:15.226 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: trying mount with new device syntax: 1@c22b4730-12cc-4558-8535-b965384398c0.cephfs=/ 2024-04-26T20:57:15.226 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.138:3300/172.21.15.143:3300/172.21.15.143:3301" will pass to kernel 2024-04-26T20:57:15.230 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-26T20:57:15.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:57:15.230 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-26T20:57:15.250 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T20:57:15.344 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:57:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T20:57:15.365 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:57:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:57:15.371 INFO:teuthology.orchestra.run.smithi143.stdout:client4562 2024-04-26T20:57:15.371 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T20:57:15.371 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T20:57:15.425 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T20:57:15.514 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:57:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T20:57:15.517 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:57:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:57:15.523 INFO:teuthology.orchestra.run.smithi143.stdout:client4562 2024-04-26T20:57:15.523 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T20:57:15.569 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:57:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T20:57:15.572 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:57:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:57:15.578 INFO:teuthology.orchestra.run.smithi143.stdout:client4562 2024-04-26T20:57:15.579 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/c22b4730-12cc-4558-8535-b965384398c0.client4562/status') 2024-04-26T20:57:15.666 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:57:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:57:15.678 INFO:teuthology.orchestra.run.smithi143.stdout:instance: client.4562 (3)192.168.0.1:0/3470090470 2024-04-26T20:57:15.679 INFO:teuthology.orchestra.run.smithi143.stdout:blocklisted: false 2024-04-26T20:57:15.679 INFO:teuthology.orchestra.run.smithi143.stderr:0+1 records in 2024-04-26T20:57:15.679 INFO:teuthology.orchestra.run.smithi143.stderr:0+1 records out 2024-04-26T20:57:15.679 INFO:teuthology.orchestra.run.smithi143.stderr:69 bytes copied, 6.5783e-05 s, 1.0 MB/s 2024-04-26T20:57:15.680 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:57:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:57:15.687 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-04-26T20:57:15.687 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T20:57:15.687 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-26T20:57:15.687 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T20:57:15.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.829+0000 7f6a6de00640 1 Processor -- start 2024-04-26T20:57:15.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.829+0000 7f6a6de00640 1 -- start start 2024-04-26T20:57:15.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.829+0000 7f6a6de00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f6a680cbe00 0x7f6a6806de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:15.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.829+0000 7f6a6de00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6a6815cf80 0x7f6a680ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:15.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.829+0000 7f6a6de00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a680727f0 con 0x7f6a680cc1e0 2024-04-26T20:57:15.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.829+0000 7f6a6de00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f6a68074220 con 0x7f6a680cbe00 2024-04-26T20:57:15.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.829+0000 7f6a6de00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f6a68073680 con 0x7f6a6815cf80 2024-04-26T20:57:15.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.829+0000 7f6a66a00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f6a680cbe00 0x7f6a6806de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:15.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.829+0000 7f6a66a00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f6a680cbe00 0x7f6a6806de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38256/0 (socket says 172.21.15.138:38256) 2024-04-26T20:57:15.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.829+0000 7f6a66a00640 1 -- 172.21.15.138:0/2557120095 learned_addr learned my addr 172.21.15.138:0/2557120095 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:15.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.829+0000 7f6a67400640 1 --2- 172.21.15.138:0/2557120095 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6a6815cf80 0x7f6a680ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:15.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.829+0000 7f6a66a00640 1 -- 172.21.15.138:0/2557120095 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6a6815cf80 msgr2=0x7f6a680ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:15.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.829+0000 7f6a66a00640 1 --2- 172.21.15.138:0/2557120095 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6a6815cf80 0x7f6a680ce6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:15.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.829+0000 7f6a66a00640 1 -- 172.21.15.138:0/2557120095 >> v1:172.21.15.143:6789/0 conn(0x7f6a680cc1e0 legacy=0x7f6a68073b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:15.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.829+0000 7f6a66a00640 1 -- 172.21.15.138:0/2557120095 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a68072a70 con 0x7f6a680cbe00 2024-04-26T20:57:15.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.833+0000 7f6a66a00640 1 --2- 172.21.15.138:0/2557120095 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6a680cbe00 0x7f6a6806de70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6a58009e50 tx=0x7f6a5801c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d06c0bff09625afd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:15.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.833+0000 7f6a65600640 1 -- 172.21.15.138:0/2557120095 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a580a5580 con 0x7f6a680cbe00 2024-04-26T20:57:15.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.833+0000 7f6a65600640 1 -- 172.21.15.138:0/2557120095 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a580a5720 con 0x7f6a680cbe00 2024-04-26T20:57:15.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.833+0000 7f6a65600640 1 -- 172.21.15.138:0/2557120095 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a580a5af0 con 0x7f6a680cbe00 2024-04-26T20:57:15.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.833+0000 7f6a6de00640 1 -- 172.21.15.138:0/2557120095 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6a680cbe00 msgr2=0x7f6a6806de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:15.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.833+0000 7f6a6de00640 1 --2- 172.21.15.138:0/2557120095 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6a680cbe00 0x7f6a6806de70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6a58009e50 tx=0x7f6a5801c810 comp rx=0 tx=0).stop 2024-04-26T20:57:15.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.833+0000 7f6a6de00640 1 -- 172.21.15.138:0/2557120095 shutdown_connections 2024-04-26T20:57:15.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.833+0000 7f6a6de00640 1 --2- 172.21.15.138:0/2557120095 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6a6815cf80 0x7f6a680ce6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:15.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.833+0000 7f6a6de00640 1 --2- 172.21.15.138:0/2557120095 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6a680cbe00 0x7f6a6806de70 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:15.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.833+0000 7f6a6de00640 1 -- 172.21.15.138:0/2557120095 >> 172.21.15.138:0/2557120095 conn(0x7f6a680d0b20 msgr2=0x7f6a680d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:15.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.833+0000 7f6a6de00640 1 -- 172.21.15.138:0/2557120095 shutdown_connections 2024-04-26T20:57:15.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.833+0000 7f6a6de00640 1 -- 172.21.15.138:0/2557120095 wait complete. 2024-04-26T20:57:15.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.837+0000 7f6a6de00640 1 Processor -- start 2024-04-26T20:57:15.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.837+0000 7f6a6de00640 1 -- start start 2024-04-26T20:57:15.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.837+0000 7f6a6de00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6a680cbe00 0x7f6a680ca7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:15.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.837+0000 7f6a6de00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6a680cc1e0 0x7f6a68141010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:15.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.837+0000 7f6a6de00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a6815cf80 0x7f6a680c6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:15.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.837+0000 7f6a6de00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6806e3b0 con 0x7f6a680cc1e0 2024-04-26T20:57:15.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.837+0000 7f6a6de00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f6a680cf040 con 0x7f6a6815cf80 2024-04-26T20:57:15.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.837+0000 7f6a6de00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f6a6806e530 con 0x7f6a680cbe00 2024-04-26T20:57:15.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.837+0000 7f6a66000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6a680cc1e0 0x7f6a68141010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:15.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.837+0000 7f6a66000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6a680cc1e0 0x7f6a68141010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38264/0 (socket says 172.21.15.138:38264) 2024-04-26T20:57:15.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.837+0000 7f6a66000640 1 -- 172.21.15.138:0/2018181823 learned_addr learned my addr 172.21.15.138:0/2018181823 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:15.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.837+0000 7f6a67400640 1 --2- 172.21.15.138:0/2018181823 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a6815cf80 0x7f6a680c6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:15.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.837+0000 7f6a66a00640 1 --2- 172.21.15.138:0/2018181823 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6a680cbe00 0x7f6a680ca7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:15.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.837+0000 7f6a66000640 1 -- 172.21.15.138:0/2018181823 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6a680cbe00 msgr2=0x7f6a680ca7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:15.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.837+0000 7f6a66000640 1 --2- 172.21.15.138:0/2018181823 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6a680cbe00 0x7f6a680ca7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:15.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.837+0000 7f6a66000640 1 -- 172.21.15.138:0/2018181823 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a6815cf80 msgr2=0x7f6a680c6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:15.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.837+0000 7f6a66000640 1 --2- 172.21.15.138:0/2018181823 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a6815cf80 0x7f6a680c6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:15.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.837+0000 7f6a66000640 1 -- 172.21.15.138:0/2018181823 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a680aa550 con 0x7f6a680cc1e0 2024-04-26T20:57:15.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.837+0000 7f6a66000640 1 --2- 172.21.15.138:0/2018181823 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6a680cc1e0 0x7f6a68141010 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6a5400c450 tx=0x7f6a5400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:15.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.837+0000 7f6a5f400640 1 -- 172.21.15.138:0/2018181823 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a54011790 con 0x7f6a680cc1e0 2024-04-26T20:57:15.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.837+0000 7f6a5f400640 1 -- 172.21.15.138:0/2018181823 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a54017070 con 0x7f6a680cc1e0 2024-04-26T20:57:15.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.837+0000 7f6a5f400640 1 -- 172.21.15.138:0/2018181823 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a54011b90 con 0x7f6a680cc1e0 2024-04-26T20:57:15.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.837+0000 7f6a6de00640 1 -- 172.21.15.138:0/2018181823 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a68141550 con 0x7f6a680cc1e0 2024-04-26T20:57:15.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.837+0000 7f6a6de00640 1 -- 172.21.15.138:0/2018181823 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a680c7fc0 con 0x7f6a680cc1e0 2024-04-26T20:57:15.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.841+0000 7f6a6de00640 1 -- 172.21.15.138:0/2018181823 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a680aaa00 con 0x7f6a680cc1e0 2024-04-26T20:57:15.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.841+0000 7f6a5f400640 1 -- 172.21.15.138:0/2018181823 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6a54011d30 con 0x7f6a680cc1e0 2024-04-26T20:57:15.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.841+0000 7f6a5f400640 1 --2- 172.21.15.138:0/2018181823 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6a48068380 0x7f6a4806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:15.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.841+0000 7f6a5f400640 1 -- 172.21.15.138:0/2018181823 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f6a54086ae0 con 0x7f6a680cc1e0 2024-04-26T20:57:15.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.841+0000 7f6a66a00640 1 --2- 172.21.15.138:0/2018181823 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6a48068380 0x7f6a4806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:15.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.841+0000 7f6a66a00640 1 --2- 172.21.15.138:0/2018181823 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6a48068380 0x7f6a4806a840 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6a580ae000 tx=0x7f6a580a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:15.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:15.845+0000 7f6a5f400640 1 -- 172.21.15.138:0/2018181823 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6a680aaa00 con 0x7f6a680cc1e0 2024-04-26T20:57:16.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:16.041+0000 7f6a6de00640 1 -- 172.21.15.138:0/2018181823 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6a68069510 con 0x7f6a680cc1e0 2024-04-26T20:57:16.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:16.041+0000 7f6a5f400640 1 -- 172.21.15.138:0/2018181823 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f6a54056c30 con 0x7f6a680cc1e0 2024-04-26T20:57:16.044 INFO:teuthology.orchestra.run.smithi138.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-26T20:57:16.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:16.041+0000 7f6a6de00640 1 -- 172.21.15.138:0/2018181823 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6a48068380 msgr2=0x7f6a4806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:16.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:16.041+0000 7f6a6de00640 1 --2- 172.21.15.138:0/2018181823 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6a48068380 0x7f6a4806a840 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6a580ae000 tx=0x7f6a580a7070 comp rx=0 tx=0).stop 2024-04-26T20:57:16.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:16.041+0000 7f6a6de00640 1 -- 172.21.15.138:0/2018181823 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6a680cc1e0 msgr2=0x7f6a68141010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:16.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:16.041+0000 7f6a6de00640 1 --2- 172.21.15.138:0/2018181823 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6a680cc1e0 0x7f6a68141010 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6a5400c450 tx=0x7f6a5400c850 comp rx=0 tx=0).stop 2024-04-26T20:57:16.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:16.041+0000 7f6a6de00640 1 -- 172.21.15.138:0/2018181823 shutdown_connections 2024-04-26T20:57:16.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:16.041+0000 7f6a6de00640 1 --2- 172.21.15.138:0/2018181823 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6a48068380 0x7f6a4806a840 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:16.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:16.041+0000 7f6a6de00640 1 --2- 172.21.15.138:0/2018181823 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6a6815cf80 0x7f6a680c6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:16.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:16.041+0000 7f6a6de00640 1 --2- 172.21.15.138:0/2018181823 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6a680cc1e0 0x7f6a68141010 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:16.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:16.041+0000 7f6a6de00640 1 --2- 172.21.15.138:0/2018181823 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6a680cbe00 0x7f6a680ca7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:16.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:16.041+0000 7f6a6de00640 1 -- 172.21.15.138:0/2018181823 >> 172.21.15.138:0/2018181823 conn(0x7f6a680d0b20 msgr2=0x7f6a680b45e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:16.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:16.041+0000 7f6a6de00640 1 -- 172.21.15.138:0/2018181823 shutdown_connections 2024-04-26T20:57:16.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:16.041+0000 7f6a6de00640 1 -- 172.21.15.138:0/2018181823 wait complete. 2024-04-26T20:57:16.066 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T20:57:16.066 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T20:57:16.066 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi143.front.sepia.ceph.com 2024-04-26T20:57:16.066 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-04-26T20:57:16.066 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-26T20:57:16.066 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T20:57:16.066 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T20:57:16.066 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T20:57:16.066 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-04-26T20:57:16.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:57:16.066 DEBUG:teuthology.orchestra.run.smithi143:> ip addr 2024-04-26T20:57:16.075 INFO:teuthology.orchestra.run.smithi143.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T20:57:16.075 INFO:teuthology.orchestra.run.smithi143.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T20:57:16.075 INFO:teuthology.orchestra.run.smithi143.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T20:57:16.075 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:57:16.075 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 ::1/128 scope host 2024-04-26T20:57:16.075 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:57:16.076 INFO:teuthology.orchestra.run.smithi143.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T20:57:16.076 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:d9:3b:94 brd ff:ff:ff:ff:ff:ff 2024-04-26T20:57:16.076 INFO:teuthology.orchestra.run.smithi143.stdout: altname enp7s0f0 2024-04-26T20:57:16.076 INFO:teuthology.orchestra.run.smithi143.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T20:57:16.076 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:d9:3b:95 brd ff:ff:ff:ff:ff:ff 2024-04-26T20:57:16.076 INFO:teuthology.orchestra.run.smithi143.stdout: altname enp7s0f1 2024-04-26T20:57:16.076 INFO:teuthology.orchestra.run.smithi143.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T20:57:16.076 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:88:77:82 brd ff:ff:ff:ff:ff:ff 2024-04-26T20:57:16.076 INFO:teuthology.orchestra.run.smithi143.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T20:57:16.076 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:88:77:83 brd ff:ff:ff:ff:ff:ff 2024-04-26T20:57:16.076 INFO:teuthology.orchestra.run.smithi143.stdout: inet 172.21.15.143/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-26T20:57:16.076 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft 42379sec preferred_lft 42379sec 2024-04-26T20:57:16.076 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::ec4:7aff:fe88:7783/64 scope link 2024-04-26T20:57:16.076 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:57:16.077 INFO:teuthology.orchestra.run.smithi143.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-26T20:57:16.077 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 02:42:f8:d3:ba:f1 brd ff:ff:ff:ff:ff:ff 2024-04-26T20:57:16.077 INFO:teuthology.orchestra.run.smithi143.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-26T20:57:16.077 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:57:16.077 INFO:teuthology.orchestra.run.smithi143.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T20:57:16.077 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-26T20:57:16.077 INFO:teuthology.orchestra.run.smithi143.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-26T20:57:16.077 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:57:16.077 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2024-04-26T20:57:16.077 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:57:16.077 INFO:teuthology.orchestra.run.smithi143.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T20:57:16.077 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T20:57:16.077 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2024-04-26T20:57:16.077 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:57:16.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:57:16.078 DEBUG:teuthology.orchestra.run.smithi143:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T20:57:16.139 INFO:teuthology.orchestra.run.smithi143.stdout:1 2024-04-26T20:57:16.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:57:16.141 DEBUG:teuthology.orchestra.run.smithi143:> route 2024-04-26T20:57:16.200 INFO:teuthology.orchestra.run.smithi143.stdout:Kernel IP routing table 2024-04-26T20:57:16.200 INFO:teuthology.orchestra.run.smithi143.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T20:57:16.200 INFO:teuthology.orchestra.run.smithi143.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-26T20:57:16.200 INFO:teuthology.orchestra.run.smithi143.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T20:57:16.200 INFO:teuthology.orchestra.run.smithi143.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-26T20:57:16.200 INFO:teuthology.orchestra.run.smithi143.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-26T20:57:16.200 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T20:57:16.200 INFO:teuthology.orchestra.run.smithi143.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T20:57:16.200 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T20:57:16.200 INFO:teuthology.orchestra.run.smithi143.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T20:57:16.200 INFO:teuthology.orchestra.run.smithi143.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T20:57:16.201 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T20:57:16.201 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2024-04-26T20:57:16.201 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T20:57:16.201 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T20:57:16.201 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T20:57:16.201 DEBUG:teuthology.orchestra.run.smithi143:> ') 2024-04-26T20:57:16.295 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:57:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:57:16.335 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:57:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:57:16.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:57:16.342 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list 2024-04-26T20:57:16.351 INFO:teuthology.orchestra.run.smithi143.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-26T20:57:16.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:57:16.351 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list-id 2024-04-26T20:57:16.405 INFO:teuthology.orchestra.run.smithi143.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-04-26T20:57:16.406 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T20:57:16.406 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2024-04-26T20:57:16.406 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T20:57:16.406 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-04-26T20:57:16.406 DEBUG:teuthology.orchestra.run.smithi143:> ') 2024-04-26T20:57:16.494 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:57:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:57:16.524 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:57:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:57:16.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:57:16.531 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-26T20:57:16.553 INFO:teuthology.orchestra.run.smithi143.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T20:57:16.553 INFO:teuthology.orchestra.run.smithi143.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T20:57:16.553 INFO:teuthology.orchestra.run.smithi143.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T20:57:16.553 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:57:16.553 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 ::1/128 scope host 2024-04-26T20:57:16.553 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:57:16.554 INFO:teuthology.orchestra.run.smithi143.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T20:57:16.554 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 8a:e7:f3:c5:1d:a5 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-26T20:57:16.554 INFO:teuthology.orchestra.run.smithi143.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-26T20:57:16.554 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:57:16.554 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::88e7:f3ff:fec5:1da5/64 scope link 2024-04-26T20:57:16.554 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:57:16.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:57:16.555 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-26T20:57:16.616 INFO:teuthology.orchestra.run.smithi143.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T20:57:16.616 INFO:teuthology.orchestra.run.smithi143.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T20:57:16.616 INFO:teuthology.orchestra.run.smithi143.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T20:57:16.617 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:57:16.617 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 ::1/128 scope host 2024-04-26T20:57:16.617 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:57:16.617 INFO:teuthology.orchestra.run.smithi143.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T20:57:16.617 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 8a:e7:f3:c5:1d:a5 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-26T20:57:16.617 INFO:teuthology.orchestra.run.smithi143.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-26T20:57:16.617 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:57:16.617 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::88e7:f3ff:fec5:1da5/64 scope link 2024-04-26T20:57:16.617 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:57:16.618 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-04-26T20:57:16.619 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T20:57:16.619 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2024-04-26T20:57:16.619 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-04-26T20:57:16.619 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-26T20:57:16.619 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-04-26T20:57:16.619 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-04-26T20:57:16.619 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-04-26T20:57:16.619 DEBUG:teuthology.orchestra.run.smithi143:> ') 2024-04-26T20:57:16.707 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:57:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:57:16.792 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:57:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:57:16.799 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T20:57:16.799 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2024-04-26T20:57:16.799 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link set brx.1 up 2024-04-26T20:57:16.799 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link set dev brx.1 master ceph-brx 2024-04-26T20:57:16.799 DEBUG:teuthology.orchestra.run.smithi143:> ') 2024-04-26T20:57:16.845 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:57:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:57:16.874 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:57:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:57:16.882 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T20:57:16.882 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-04-26T20:57:16.933 INFO:teuthology.orchestra.run.smithi143.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-04-26T20:57:16.933 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T20:57:16.933 DEBUG:teuthology.orchestra.run.smithi143:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-04-26T20:57:16.984 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-04-26T20:57:16.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:57:16.984 DEBUG:teuthology.orchestra.run.smithi143:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T20:57:17.073 INFO:teuthology.orchestra.run.smithi143.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T20:57:17.073 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T20:57:17.086 INFO:teuthology.orchestra.run.smithi143.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T20:57:17.086 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T20:57:17.086 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: resolved to: "172.21.15.138:3300,172.21.15.143:3300,172.21.15.143:3301" 2024-04-26T20:57:17.086 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: trying mount with new device syntax: 3@c22b4730-12cc-4558-8535-b965384398c0.cephfs=/ 2024-04-26T20:57:17.086 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.138:3300/172.21.15.143:3300/172.21.15.143:3301" will pass to kernel 2024-04-26T20:57:17.090 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-26T20:57:17.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:57:17.091 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-04-26T20:57:17.109 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T20:57:17.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:57:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T20:57:17.202 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:57:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:57:17.208 INFO:teuthology.orchestra.run.smithi143.stdout:client4571 2024-04-26T20:57:17.208 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T20:57:17.208 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T20:57:17.216 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T20:57:17.307 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:57:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T20:57:17.310 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:57:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:57:17.316 INFO:teuthology.orchestra.run.smithi143.stdout:client4571 2024-04-26T20:57:17.316 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T20:57:17.361 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:57:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T20:57:17.364 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:57:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:57:17.370 INFO:teuthology.orchestra.run.smithi143.stdout:client4571 2024-04-26T20:57:17.371 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/c22b4730-12cc-4558-8535-b965384398c0.client4571/status') 2024-04-26T20:57:17.462 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:57:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:57:17.474 INFO:teuthology.orchestra.run.smithi143.stdout:instance: client.4571 (3)192.168.0.2:0/2135239612 2024-04-26T20:57:17.475 INFO:teuthology.orchestra.run.smithi143.stdout:blocklisted: false 2024-04-26T20:57:17.475 INFO:teuthology.orchestra.run.smithi143.stderr:0+1 records in 2024-04-26T20:57:17.475 INFO:teuthology.orchestra.run.smithi143.stderr:0+1 records out 2024-04-26T20:57:17.475 INFO:teuthology.orchestra.run.smithi143.stderr:69 bytes copied, 4.854e-05 s, 1.4 MB/s 2024-04-26T20:57:17.476 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T20:57:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:57:17.483 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-04-26T20:57:17.499 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:57:17.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.641+0000 7fd9a4600640 1 Processor -- start 2024-04-26T20:57:17.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.641+0000 7fd9a4600640 1 -- start start 2024-04-26T20:57:17.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.641+0000 7fd9a4600640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd99c0ae8c0 0x7fd99c0ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:17.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.641+0000 7fd9a4600640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd99c0ccb60 con 0x7fd99c15f2b0 2024-04-26T20:57:17.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.641+0000 7fd9a4600640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd99c0cce40 con 0x7fd99c0cec30 2024-04-26T20:57:17.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.641+0000 7fd9a4600640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fd99c0cf0a0 con 0x7fd99c0ae8c0 2024-04-26T20:57:17.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.641+0000 7fd9a1c00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fd99c15f2b0 0x7fd99c1637d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:42514/0 (socket says 172.21.15.138:42514) 2024-04-26T20:57:17.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.641+0000 7fd9a1c00640 1 -- 172.21.15.138:0/106508304 learned_addr learned my addr 172.21.15.138:0/106508304 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:17.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.645+0000 7fd9a1200640 1 --2- 172.21.15.138:0/106508304 >> v2:172.21.15.143:3300/0 conn(0x7fd99c0ae8c0 0x7fd99c0ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:17.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.645+0000 7fd99be00640 1 -- 172.21.15.138:0/106508304 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2258252117 0 0) 0x7fd99c0ccb60 con 0x7fd99c15f2b0 2024-04-26T20:57:17.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.645+0000 7fd99be00640 1 -- 172.21.15.138:0/106508304 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd984003530 con 0x7fd99c15f2b0 2024-04-26T20:57:17.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.645+0000 7fd99be00640 1 -- 172.21.15.138:0/106508304 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4209855628 0 0) 0x7fd99c0cce40 con 0x7fd99c0cec30 2024-04-26T20:57:17.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.645+0000 7fd99be00640 1 -- 172.21.15.138:0/106508304 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd99c0ccb60 con 0x7fd99c0cec30 2024-04-26T20:57:17.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.645+0000 7fd99be00640 1 -- 172.21.15.138:0/106508304 <== mon.0 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3283078949 0 0) 0x7fd984003530 con 0x7fd99c15f2b0 2024-04-26T20:57:17.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.645+0000 7fd99be00640 1 -- 172.21.15.138:0/106508304 >> v2:172.21.15.143:3300/0 conn(0x7fd99c0ae8c0 msgr2=0x7fd99c0ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:17.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.645+0000 7fd99be00640 1 --2- 172.21.15.138:0/106508304 >> v2:172.21.15.143:3300/0 conn(0x7fd99c0ae8c0 0x7fd99c0ce6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:17.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.645+0000 7fd99be00640 1 -- 172.21.15.138:0/106508304 >> v1:172.21.15.143:6789/0 conn(0x7fd99c0cec30 legacy=0x7fd99c0cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:17.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.645+0000 7fd99be00640 1 -- 172.21.15.138:0/106508304 --> v1:172.21.15.138:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd99c0cb2a0 con 0x7fd99c15f2b0 2024-04-26T20:57:17.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.645+0000 7fd99be00640 1 -- 172.21.15.138:0/106508304 <== mon.0 v1:172.21.15.138:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2715389689 0 0) 0x7fd990001680 con 0x7fd99c15f2b0 2024-04-26T20:57:17.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.645+0000 7fd99be00640 1 -- 172.21.15.138:0/106508304 >> v1:172.21.15.138:6789/0 conn(0x7fd99c15f2b0 legacy=0x7fd99c1637d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:17.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.645+0000 7fd99be00640 1 --2- 172.21.15.138:0/106508304 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd984003b50 0x7fd984003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:17.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.645+0000 7fd99be00640 1 --2- 172.21.15.138:0/106508304 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd984004810 0x7fd984004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:17.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.645+0000 7fd99be00640 1 --2- 172.21.15.138:0/106508304 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd9840051d0 0x7fd98400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:17.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.645+0000 7fd99be00640 1 -- 172.21.15.138:0/106508304 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd99c0cf0a0 con 0x7fd984004810 2024-04-26T20:57:17.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.645+0000 7fd99be00640 1 -- 172.21.15.138:0/106508304 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fd98400c100 con 0x7fd9840051d0 2024-04-26T20:57:17.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.645+0000 7fd99be00640 1 -- 172.21.15.138:0/106508304 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fd98400c300 con 0x7fd984003b50 2024-04-26T20:57:17.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.645+0000 7fd9a1200640 1 --2- 172.21.15.138:0/106508304 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd984004810 0x7fd984004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:17.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.645+0000 7fd9a1c00640 1 --2- 172.21.15.138:0/106508304 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd984003b50 0x7fd984003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:17.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.645+0000 7fd9a2600640 1 --2- 172.21.15.138:0/106508304 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd9840051d0 0x7fd98400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:17.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.645+0000 7fd9a1200640 1 -- 172.21.15.138:0/106508304 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd984003b50 msgr2=0x7fd984003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:17.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.645+0000 7fd9a1200640 1 --2- 172.21.15.138:0/106508304 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd984003b50 0x7fd984003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:17.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.645+0000 7fd9a1200640 1 -- 172.21.15.138:0/106508304 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd9840051d0 msgr2=0x7fd98400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:17.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.645+0000 7fd9a1200640 1 --2- 172.21.15.138:0/106508304 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd9840051d0 0x7fd98400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:17.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.645+0000 7fd9a1200640 1 -- 172.21.15.138:0/106508304 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd984003530 con 0x7fd984004810 2024-04-26T20:57:17.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.645+0000 7fd9a2600640 1 -- 172.21.15.138:0/106508304 reap_dead start 2024-04-26T20:57:17.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.649+0000 7fd9a1200640 1 --2- 172.21.15.138:0/106508304 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd984004810 0x7fd984004c90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd988009ae0 tx=0x7fd98801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e0d3528d207b61b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:17.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.649+0000 7fd99be00640 1 -- 172.21.15.138:0/106508304 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9880096b0 con 0x7fd984004810 2024-04-26T20:57:17.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.649+0000 7fd99be00640 1 -- 172.21.15.138:0/106508304 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9880a6450 con 0x7fd984004810 2024-04-26T20:57:17.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.649+0000 7fd99be00640 1 -- 172.21.15.138:0/106508304 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9880a6840 con 0x7fd984004810 2024-04-26T20:57:17.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.649+0000 7fd9a4600640 1 -- 172.21.15.138:0/106508304 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd984004810 msgr2=0x7fd984004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:17.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.649+0000 7fd9a4600640 1 --2- 172.21.15.138:0/106508304 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd984004810 0x7fd984004c90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd988009ae0 tx=0x7fd98801ca70 comp rx=0 tx=0).stop 2024-04-26T20:57:17.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.649+0000 7fd9a4600640 1 -- 172.21.15.138:0/106508304 shutdown_connections 2024-04-26T20:57:17.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.649+0000 7fd9a4600640 1 --2- 172.21.15.138:0/106508304 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd984004810 0x7fd984004c90 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:17.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.649+0000 7fd9a4600640 1 -- 172.21.15.138:0/106508304 >> 172.21.15.138:0/106508304 conn(0x7fd99c0d0b20 msgr2=0x7fd99c0d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:17.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.649+0000 7fd9a4600640 1 -- 172.21.15.138:0/106508304 shutdown_connections 2024-04-26T20:57:17.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.649+0000 7fd9a4600640 1 -- 172.21.15.138:0/106508304 wait complete. 2024-04-26T20:57:17.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.649+0000 7fd9a4600640 1 Processor -- start 2024-04-26T20:57:17.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.649+0000 7fd9a4600640 1 -- start start 2024-04-26T20:57:17.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.653+0000 7fd9a4600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd984004810 0x7fd99c15f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:17.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.653+0000 7fd9a4600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd99c161f90 0x7fd99c154bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:17.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.653+0000 7fd9a4600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd99c162410 0x7fd99c155110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:17.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.653+0000 7fd9a4600640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd99c0cb610 con 0x7fd99c161f90 2024-04-26T20:57:17.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.653+0000 7fd9a4600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fd99c0cc4a0 con 0x7fd984004810 2024-04-26T20:57:17.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.653+0000 7fd9a4600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fd99c0cd120 con 0x7fd99c162410 2024-04-26T20:57:17.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.653+0000 7fd9a1200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd99c161f90 0x7fd99c154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:17.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.653+0000 7fd9a1200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd99c161f90 0x7fd99c154bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38274/0 (socket says 172.21.15.138:38274) 2024-04-26T20:57:17.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.653+0000 7fd9a1200640 1 -- 172.21.15.138:0/3922882724 learned_addr learned my addr 172.21.15.138:0/3922882724 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:17.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.653+0000 7fd9a1c00640 1 --2- 172.21.15.138:0/3922882724 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd984004810 0x7fd99c15f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:17.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.653+0000 7fd9a2600640 1 --2- 172.21.15.138:0/3922882724 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd99c162410 0x7fd99c155110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:17.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.653+0000 7fd9a1200640 1 -- 172.21.15.138:0/3922882724 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd99c162410 msgr2=0x7fd99c155110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:17.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.653+0000 7fd9a1200640 1 --2- 172.21.15.138:0/3922882724 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd99c162410 0x7fd99c155110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:17.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.653+0000 7fd9a1200640 1 -- 172.21.15.138:0/3922882724 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd984004810 msgr2=0x7fd99c15f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:17.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.653+0000 7fd9a1200640 1 --2- 172.21.15.138:0/3922882724 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd984004810 0x7fd99c15f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:17.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.653+0000 7fd9a1200640 1 -- 172.21.15.138:0/3922882724 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd99c0c60b0 con 0x7fd99c161f90 2024-04-26T20:57:17.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.653+0000 7fd9a1c00640 1 --2- 172.21.15.138:0/3922882724 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd984004810 0x7fd99c15f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:57:17.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.653+0000 7fd9a1200640 1 --2- 172.21.15.138:0/3922882724 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd99c161f90 0x7fd99c154bd0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd988009ae0 tx=0x7fd988019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:17.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.653+0000 7fd999600640 1 -- 172.21.15.138:0/3922882724 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9880096b0 con 0x7fd99c161f90 2024-04-26T20:57:17.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.653+0000 7fd999600640 1 -- 172.21.15.138:0/3922882724 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9880a6d00 con 0x7fd99c161f90 2024-04-26T20:57:17.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.653+0000 7fd999600640 1 -- 172.21.15.138:0/3922882724 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9880b9660 con 0x7fd99c161f90 2024-04-26T20:57:17.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.653+0000 7fd9a4600640 1 -- 172.21.15.138:0/3922882724 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd99c0c6390 con 0x7fd99c161f90 2024-04-26T20:57:17.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.653+0000 7fd9a4600640 1 -- 172.21.15.138:0/3922882724 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd99c0c6950 con 0x7fd99c161f90 2024-04-26T20:57:17.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.653+0000 7fd9a4600640 1 -- 172.21.15.138:0/3922882724 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd99c069510 con 0x7fd99c161f90 2024-04-26T20:57:17.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.653+0000 7fd999600640 1 -- 172.21.15.138:0/3922882724 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd9880a7430 con 0x7fd99c161f90 2024-04-26T20:57:17.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.657+0000 7fd999600640 1 --2- 172.21.15.138:0/3922882724 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd97c068380 0x7fd97c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:17.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.657+0000 7fd999600640 1 -- 172.21.15.138:0/3922882724 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fd988120580 con 0x7fd99c161f90 2024-04-26T20:57:17.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.657+0000 7fd9a1c00640 1 --2- 172.21.15.138:0/3922882724 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd97c068380 0x7fd97c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:17.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.657+0000 7fd9a1c00640 1 --2- 172.21.15.138:0/3922882724 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd97c068380 0x7fd97c06a840 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd990000c10 tx=0x7fd9900010e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:17.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.661+0000 7fd999600640 1 -- 172.21.15.138:0/3922882724 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd9880ac020 con 0x7fd99c161f90 2024-04-26T20:57:17.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.817+0000 7fd9a4600640 1 -- 172.21.15.138:0/3922882724 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd99c0d16a0 con 0x7fd99c161f90 2024-04-26T20:57:17.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.817+0000 7fd999600640 1 -- 172.21.15.138:0/3922882724 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18578 (secure 0 0 0) 0x7fd988016780 con 0x7fd99c161f90 2024-04-26T20:57:17.823 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:57:17.823 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":27,"fsid":"c22b4730-12cc-4558-8535-b965384398c0","created":"2024-04-26T20:56:14.182475+0000","modified":"2024-04-26T20:56:44.633968+0000","last_up_change":"2024-04-26T20:56:26.013243+0000","last_in_change":"2024-04-26T20:56:16.714055+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:56:27.265834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:56:37.394398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:56:38.544369+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:56:42.240243+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3f9a2e34-3199-466f-a6cf-57927318121e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6801","nonce":3534772245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6803","nonce":3534772245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6807","nonce":3534772245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6805","nonce":3534772245}]},"public_addr":"172.21.15.138:6801/3534772245","cluster_addr":"172.21.15.138:6803/3534772245","heartbeat_back_addr":"172.21.15.138:6807/3534772245","heartbeat_front_addr":"172.21.15.138:6805/3534772245","state":["exists","up"]},{"osd":1,"uuid":"e881fcf6-3248-4696-a2ef-95d206d77712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6817","nonce":1427635773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6819","nonce":1427635773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6823","nonce":1427635773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6821","nonce":1427635773}]},"public_addr":"172.21.15.138:6817/1427635773","cluster_addr":"172.21.15.138:6819/1427635773","heartbeat_back_addr":"172.21.15.138:6823/1427635773","heartbeat_front_addr":"172.21.15.138:6821/1427635773","state":["exists","up"]},{"osd":2,"uuid":"f7d1db33-7672-4699-ae47-9f1e0a8e4222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6809","nonce":4273721573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6811","nonce":4273721573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6815","nonce":4273721573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6813","nonce":4273721573}]},"public_addr":"172.21.15.138:6809/4273721573","cluster_addr":"172.21.15.138:6811/4273721573","heartbeat_back_addr":"172.21.15.138:6815/4273721573","heartbeat_front_addr":"172.21.15.138:6813/4273721573","state":["exists","up"]},{"osd":3,"uuid":"2f4e0a9a-b8f6-4468-844a-a4501cd85054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6825","nonce":3098242154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6827","nonce":3098242154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6831","nonce":3098242154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6829","nonce":3098242154}]},"public_addr":"172.21.15.138:6825/3098242154","cluster_addr":"172.21.15.138:6827/3098242154","heartbeat_back_addr":"172.21.15.138:6831/3098242154","heartbeat_front_addr":"172.21.15.138:6829/3098242154","state":["exists","up"]},{"osd":4,"uuid":"c85df99b-3624-410e-866b-86830af2cfe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6801","nonce":2942056312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6803","nonce":2942056312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6807","nonce":2942056312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6805","nonce":2942056312}]},"public_addr":"172.21.15.143:6801/2942056312","cluster_addr":"172.21.15.143:6803/2942056312","heartbeat_back_addr":"172.21.15.143:6807/2942056312","heartbeat_front_addr":"172.21.15.143:6805/2942056312","state":["exists","up"]},{"osd":5,"uuid":"9af1efb5-c416-4808-b5ef-de0679ab9705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6809","nonce":1910222887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6811","nonce":1910222887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6815","nonce":1910222887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6813","nonce":1910222887}]},"public_addr":"172.21.15.143:6809/1910222887","cluster_addr":"172.21.15.143:6811/1910222887","heartbeat_back_addr":"172.21.15.143:6815/1910222887","heartbeat_front_addr":"172.21.15.143:6813/1910222887","state":["exists","up"]},{"osd":6,"uuid":"d7138615-8838-45ff-9072-2fd0683362f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6817","nonce":1082239825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6819","nonce":1082239825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6823","nonce":1082239825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6821","nonce":1082239825}]},"public_addr":"172.21.15.143:6817/1082239825","cluster_addr":"172.21.15.143:6819/1082239825","heartbeat_back_addr":"172.21.15.143:6823/1082239825","heartbeat_front_addr":"172.21.15.143:6821/1082239825","state":["exists","up"]},{"osd":7,"uuid":"0c27172b-35c4-49ec-ba0b-0137b8ff0010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6825","nonce":3295508495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6827","nonce":3295508495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6831","nonce":3295508495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6829","nonce":3295508495}]},"public_addr":"172.21.15.143:6825/3295508495","cluster_addr":"172.21.15.143:6827/3295508495","heartbeat_back_addr":"172.21.15.143:6831/3295508495","heartbeat_front_addr":"172.21.15.143:6829/3295508495","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.326627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.396119+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.433915+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.414179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.216947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.329272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.503073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.436382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:57:17.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.821+0000 7fd9a4600640 1 -- 172.21.15.138:0/3922882724 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd97c068380 msgr2=0x7fd97c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:17.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.821+0000 7fd9a4600640 1 --2- 172.21.15.138:0/3922882724 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd97c068380 0x7fd97c06a840 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd990000c10 tx=0x7fd9900010e0 comp rx=0 tx=0).stop 2024-04-26T20:57:17.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.821+0000 7fd9a4600640 1 -- 172.21.15.138:0/3922882724 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd99c161f90 msgr2=0x7fd99c154bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:17.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.821+0000 7fd9a4600640 1 --2- 172.21.15.138:0/3922882724 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd99c161f90 0x7fd99c154bd0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd988009ae0 tx=0x7fd988019810 comp rx=0 tx=0).stop 2024-04-26T20:57:17.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.821+0000 7fd9a4600640 1 -- 172.21.15.138:0/3922882724 shutdown_connections 2024-04-26T20:57:17.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.821+0000 7fd9a4600640 1 --2- 172.21.15.138:0/3922882724 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd97c068380 0x7fd97c06a840 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:17.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.821+0000 7fd9a4600640 1 --2- 172.21.15.138:0/3922882724 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd99c162410 0x7fd99c155110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:17.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.821+0000 7fd9a4600640 1 --2- 172.21.15.138:0/3922882724 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd99c161f90 0x7fd99c154bd0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:17.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.821+0000 7fd9a4600640 1 --2- 172.21.15.138:0/3922882724 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd984004810 0x7fd99c15f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:17.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.821+0000 7fd9a4600640 1 -- 172.21.15.138:0/3922882724 >> 172.21.15.138:0/3922882724 conn(0x7fd99c0d0b20 msgr2=0x7fd99c072480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:17.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.821+0000 7fd9a4600640 1 -- 172.21.15.138:0/3922882724 shutdown_connections 2024-04-26T20:57:17.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.821+0000 7fd9a4600640 1 -- 172.21.15.138:0/3922882724 wait complete. 2024-04-26T20:57:17.845 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:56:27.265834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T20:56:37.394398+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T20:56:38.544369+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T20:56:42.240243+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T20:57:17.845 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T20:57:17.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.981+0000 7fcd9a000640 1 Processor -- start 2024-04-26T20:57:17.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.981+0000 7fcd9a000640 1 -- start start 2024-04-26T20:57:17.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.981+0000 7fcd9a000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcd9406f6e0 0x7fcd9406fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:17.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.981+0000 7fcd9a000640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fcd940ce0c0 0x7fcd940ce550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:17.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.981+0000 7fcd9a000640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd940707a0 con 0x7fcd9415bfe0 2024-04-26T20:57:17.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.981+0000 7fcd9a000640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fcd94070060 con 0x7fcd940ce0c0 2024-04-26T20:57:17.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.981+0000 7fcd9a000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fcd9415c3c0 con 0x7fcd9406f6e0 2024-04-26T20:57:17.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.981+0000 7fcd93e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcd9406f6e0 0x7fcd9406fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:17.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.981+0000 7fcd98c00640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fcd9415bfe0 0x7fcd940b4ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.138:43998/0 (socket says 172.21.15.138:43998) 2024-04-26T20:57:17.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.981+0000 7fcd98c00640 1 -- 172.21.15.138:0/1625389332 learned_addr learned my addr 172.21.15.138:0/1625389332 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:17.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.981+0000 7fcd99600640 1 --2- 172.21.15.138:0/1625389332 >> v2:172.21.15.143:3300/0 conn(0x7fcd940ce0c0 0x7fcd940ce550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:17.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.981+0000 7fcd93e00640 1 -- 172.21.15.138:0/1625389332 >> v2:172.21.15.143:3300/0 conn(0x7fcd940ce0c0 msgr2=0x7fcd940ce550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:17.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.981+0000 7fcd93e00640 1 --2- 172.21.15.138:0/1625389332 >> v2:172.21.15.143:3300/0 conn(0x7fcd940ce0c0 0x7fcd940ce550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:17.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.981+0000 7fcd93400640 1 -- 172.21.15.138:0/1625389332 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3901082753 0 0) 0x7fcd940707a0 con 0x7fcd9415bfe0 2024-04-26T20:57:17.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.981+0000 7fcd93e00640 1 -- 172.21.15.138:0/1625389332 >> v1:172.21.15.143:6789/0 conn(0x7fcd9415bfe0 legacy=0x7fcd940b4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:17.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.981+0000 7fcd93e00640 1 -- 172.21.15.138:0/1625389332 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd940727c0 con 0x7fcd9406f6e0 2024-04-26T20:57:17.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.981+0000 7fcd99600640 1 --2- 172.21.15.138:0/1625389332 >> v2:172.21.15.143:3300/0 conn(0x7fcd940ce0c0 0x7fcd940ce550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:57:17.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.985+0000 7fcd93e00640 1 --2- 172.21.15.138:0/1625389332 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcd9406f6e0 0x7fcd9406fb20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcd800097c0 tx=0x7fcd8001ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78c2f78c2d0a383b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:17.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.985+0000 7fcd93400640 1 -- 172.21.15.138:0/1625389332 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd800b5070 con 0x7fcd9406f6e0 2024-04-26T20:57:17.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.985+0000 7fcd93400640 1 -- 172.21.15.138:0/1625389332 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd800a8990 con 0x7fcd9406f6e0 2024-04-26T20:57:17.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.985+0000 7fcd93400640 1 -- 172.21.15.138:0/1625389332 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd800a8d60 con 0x7fcd9406f6e0 2024-04-26T20:57:17.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.985+0000 7fcd9a000640 1 -- 172.21.15.138:0/1625389332 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcd9406f6e0 msgr2=0x7fcd9406fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:17.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.985+0000 7fcd9a000640 1 --2- 172.21.15.138:0/1625389332 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcd9406f6e0 0x7fcd9406fb20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcd800097c0 tx=0x7fcd8001ec90 comp rx=0 tx=0).stop 2024-04-26T20:57:17.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.985+0000 7fcd9a000640 1 -- 172.21.15.138:0/1625389332 shutdown_connections 2024-04-26T20:57:17.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.985+0000 7fcd9a000640 1 --2- 172.21.15.138:0/1625389332 >> v2:172.21.15.143:3300/0 conn(0x7fcd940ce0c0 0x7fcd940ce550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:17.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.985+0000 7fcd9a000640 1 --2- 172.21.15.138:0/1625389332 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcd9406f6e0 0x7fcd9406fb20 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:17.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.985+0000 7fcd9a000640 1 -- 172.21.15.138:0/1625389332 >> 172.21.15.138:0/1625389332 conn(0x7fcd940b25c0 msgr2=0x7fcd940b29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:17.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.985+0000 7fcd9a000640 1 -- 172.21.15.138:0/1625389332 shutdown_connections 2024-04-26T20:57:17.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.985+0000 7fcd9a000640 1 -- 172.21.15.138:0/1625389332 wait complete. 2024-04-26T20:57:17.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.989+0000 7fcd9a000640 1 Processor -- start 2024-04-26T20:57:17.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.989+0000 7fcd9a000640 1 -- start start 2024-04-26T20:57:17.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.989+0000 7fcd9a000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd9406f6e0 0x7fcd9415b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:17.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.989+0000 7fcd9a000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcd940ce0c0 0x7fcd94155140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:17.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.989+0000 7fcd9a000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcd9415bfe0 0x7fcd9415cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:17.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.989+0000 7fcd9a000640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fcd94073020 con 0x7fcd9406f6e0 2024-04-26T20:57:17.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.989+0000 7fcd9a000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fcd94072d40 con 0x7fcd9415bfe0 2024-04-26T20:57:17.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.989+0000 7fcd9a000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fcd94073300 con 0x7fcd940ce0c0 2024-04-26T20:57:17.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.989+0000 7fcd98c00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd9406f6e0 0x7fcd9415b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:17.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.989+0000 7fcd98c00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd9406f6e0 0x7fcd9415b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38290/0 (socket says 172.21.15.138:38290) 2024-04-26T20:57:17.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.989+0000 7fcd98c00640 1 -- 172.21.15.138:0/2978601024 learned_addr learned my addr 172.21.15.138:0/2978601024 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:17.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.989+0000 7fcd93e00640 1 --2- 172.21.15.138:0/2978601024 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcd940ce0c0 0x7fcd94155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:17.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.989+0000 7fcd99600640 1 --2- 172.21.15.138:0/2978601024 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcd9415bfe0 0x7fcd9415cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:17.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.989+0000 7fcd93e00640 1 -- 172.21.15.138:0/2978601024 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcd9415bfe0 msgr2=0x7fcd9415cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:17.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.989+0000 7fcd93e00640 1 --2- 172.21.15.138:0/2978601024 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcd9415bfe0 0x7fcd9415cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:17.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.989+0000 7fcd93e00640 1 -- 172.21.15.138:0/2978601024 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd9406f6e0 msgr2=0x7fcd9415b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:17.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.989+0000 7fcd93e00640 1 --2- 172.21.15.138:0/2978601024 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd9406f6e0 0x7fcd9415b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:17.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.989+0000 7fcd93e00640 1 -- 172.21.15.138:0/2978601024 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd9415a150 con 0x7fcd940ce0c0 2024-04-26T20:57:17.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.989+0000 7fcd98c00640 1 --2- 172.21.15.138:0/2978601024 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd9406f6e0 0x7fcd9415b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:57:17.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.989+0000 7fcd93e00640 1 --2- 172.21.15.138:0/2978601024 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcd940ce0c0 0x7fcd94155140 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcd800af000 tx=0x7fcd8001ba30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:17.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.989+0000 7fcd90c00640 1 -- 172.21.15.138:0/2978601024 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd800b5040 con 0x7fcd940ce0c0 2024-04-26T20:57:17.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.989+0000 7fcd90c00640 1 -- 172.21.15.138:0/2978601024 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd80004270 con 0x7fcd940ce0c0 2024-04-26T20:57:17.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.989+0000 7fcd9a000640 1 -- 172.21.15.138:0/2978601024 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd9415a430 con 0x7fcd940ce0c0 2024-04-26T20:57:17.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.989+0000 7fcd90c00640 1 -- 172.21.15.138:0/2978601024 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd80003620 con 0x7fcd940ce0c0 2024-04-26T20:57:17.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.989+0000 7fcd9a000640 1 -- 172.21.15.138:0/2978601024 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd9415a9f0 con 0x7fcd940ce0c0 2024-04-26T20:57:17.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.989+0000 7fcd9a000640 1 -- 172.21.15.138:0/2978601024 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd94069430 con 0x7fcd940ce0c0 2024-04-26T20:57:17.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.993+0000 7fcd90c00640 1 -- 172.21.15.138:0/2978601024 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcd800037c0 con 0x7fcd940ce0c0 2024-04-26T20:57:17.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.993+0000 7fcd90c00640 1 --2- 172.21.15.138:0/2978601024 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fcd74068380 0x7fcd7406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:17.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.993+0000 7fcd90c00640 1 -- 172.21.15.138:0/2978601024 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fcd80124690 con 0x7fcd940ce0c0 2024-04-26T20:57:17.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.993+0000 7fcd98c00640 1 --2- 172.21.15.138:0/2978601024 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fcd74068380 0x7fcd7406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:17.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.993+0000 7fcd98c00640 1 --2- 172.21.15.138:0/2978601024 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fcd74068380 0x7fcd7406a840 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcd88000f70 tx=0x7fcd88007ee0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:18.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:17.997+0000 7fcd90c00640 1 -- 172.21.15.138:0/2978601024 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fcd800bd020 con 0x7fcd940ce0c0 2024-04-26T20:57:18.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.153+0000 7fcd9a000640 1 -- 172.21.15.138:0/2978601024 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fcd94155680 con 0x7fcd940ce0c0 2024-04-26T20:57:18.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.153+0000 7fcd90c00640 1 -- 172.21.15.138:0/2978601024 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7fcd800187f0 con 0x7fcd940ce0c0 2024-04-26T20:57:18.158 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 1 2024-04-26T20:57:18.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.157+0000 7fcd9a000640 1 -- 172.21.15.138:0/2978601024 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fcd74068380 msgr2=0x7fcd7406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:18.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.157+0000 7fcd9a000640 1 --2- 172.21.15.138:0/2978601024 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fcd74068380 0x7fcd7406a840 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcd88000f70 tx=0x7fcd88007ee0 comp rx=0 tx=0).stop 2024-04-26T20:57:18.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.157+0000 7fcd9a000640 1 -- 172.21.15.138:0/2978601024 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcd940ce0c0 msgr2=0x7fcd94155140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:18.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.157+0000 7fcd9a000640 1 --2- 172.21.15.138:0/2978601024 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcd940ce0c0 0x7fcd94155140 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcd800af000 tx=0x7fcd8001ba30 comp rx=0 tx=0).stop 2024-04-26T20:57:18.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.157+0000 7fcd9a000640 1 -- 172.21.15.138:0/2978601024 shutdown_connections 2024-04-26T20:57:18.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.157+0000 7fcd9a000640 1 --2- 172.21.15.138:0/2978601024 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fcd74068380 0x7fcd7406a840 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:18.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.157+0000 7fcd9a000640 1 --2- 172.21.15.138:0/2978601024 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcd9415bfe0 0x7fcd9415cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:18.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.157+0000 7fcd9a000640 1 --2- 172.21.15.138:0/2978601024 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcd940ce0c0 0x7fcd94155140 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:18.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.157+0000 7fcd9a000640 1 --2- 172.21.15.138:0/2978601024 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd9406f6e0 0x7fcd9415b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:18.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.157+0000 7fcd9a000640 1 -- 172.21.15.138:0/2978601024 >> 172.21.15.138:0/2978601024 conn(0x7fcd940b25c0 msgr2=0x7fcd941541d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:18.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.157+0000 7fcd9a000640 1 -- 172.21.15.138:0/2978601024 shutdown_connections 2024-04-26T20:57:18.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.157+0000 7fcd9a000640 1 -- 172.21.15.138:0/2978601024 wait complete. 2024-04-26T20:57:18.180 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T20:57:18.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.313+0000 7f4364c00640 1 Processor -- start 2024-04-26T20:57:18.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.313+0000 7f4364c00640 1 -- start start 2024-04-26T20:57:18.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.313+0000 7f4364c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4360073ad0 0x7f4360073eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:18.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.313+0000 7f4364c00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f43600d0490 0x7f43600d0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:18.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.313+0000 7f4364c00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43600743f0 con 0x7f4360162ca0 2024-04-26T20:57:18.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.313+0000 7f4364c00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f43600cf3f0 con 0x7f43600d0490 2024-04-26T20:57:18.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.313+0000 7f4364c00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f43600cf6d0 con 0x7f4360073ad0 2024-04-26T20:57:18.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.317+0000 7f4355400640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f4360162ca0 0x7f43600ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:42530/0 (socket says 172.21.15.138:42530) 2024-04-26T20:57:18.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.317+0000 7f4355400640 1 -- 172.21.15.138:0/1945900144 learned_addr learned my addr 172.21.15.138:0/1945900144 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:18.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.317+0000 7f435de00640 1 --2- 172.21.15.138:0/1945900144 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4360073ad0 0x7f4360073eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:18.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.317+0000 7f435e800640 1 --2- 172.21.15.138:0/1945900144 >> v2:172.21.15.143:3300/0 conn(0x7f43600d0490 0x7f43600d0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:18.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.317+0000 7f435d400640 1 -- 172.21.15.138:0/1945900144 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3784081664 0 0) 0x7f43600743f0 con 0x7f4360162ca0 2024-04-26T20:57:18.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.317+0000 7f435d400640 1 -- 172.21.15.138:0/1945900144 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4344003530 con 0x7f4360162ca0 2024-04-26T20:57:18.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.317+0000 7f435de00640 1 -- 172.21.15.138:0/1945900144 >> v2:172.21.15.143:3300/0 conn(0x7f43600d0490 msgr2=0x7f43600d0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:18.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.317+0000 7f435de00640 1 --2- 172.21.15.138:0/1945900144 >> v2:172.21.15.143:3300/0 conn(0x7f43600d0490 0x7f43600d0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:18.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.317+0000 7f435de00640 1 -- 172.21.15.138:0/1945900144 >> v1:172.21.15.138:6789/0 conn(0x7f4360162ca0 legacy=0x7f43600ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:18.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.317+0000 7f435de00640 1 -- 172.21.15.138:0/1945900144 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43600cf9b0 con 0x7f4360073ad0 2024-04-26T20:57:18.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.317+0000 7f435de00640 1 --2- 172.21.15.138:0/1945900144 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4360073ad0 0x7f4360073eb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f43500097c0 tx=0x7f435001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f39cebf5b838c9a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:18.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.317+0000 7f435d400640 1 -- 172.21.15.138:0/1945900144 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43500b2070 con 0x7f4360073ad0 2024-04-26T20:57:18.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.317+0000 7f435d400640 1 -- 172.21.15.138:0/1945900144 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43500ad640 con 0x7f4360073ad0 2024-04-26T20:57:18.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.317+0000 7f435d400640 1 -- 172.21.15.138:0/1945900144 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43500ada10 con 0x7f4360073ad0 2024-04-26T20:57:18.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.321+0000 7f4364c00640 1 -- 172.21.15.138:0/1945900144 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4360073ad0 msgr2=0x7f4360073eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:18.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.321+0000 7f4364c00640 1 --2- 172.21.15.138:0/1945900144 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4360073ad0 0x7f4360073eb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f43500097c0 tx=0x7f435001c4a0 comp rx=0 tx=0).stop 2024-04-26T20:57:18.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.321+0000 7f4364c00640 1 -- 172.21.15.138:0/1945900144 shutdown_connections 2024-04-26T20:57:18.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.321+0000 7f4364c00640 1 --2- 172.21.15.138:0/1945900144 >> v2:172.21.15.143:3300/0 conn(0x7f43600d0490 0x7f43600d0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:18.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.321+0000 7f4364c00640 1 --2- 172.21.15.138:0/1945900144 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4360073ad0 0x7f4360073eb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:18.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.321+0000 7f4364c00640 1 -- 172.21.15.138:0/1945900144 >> 172.21.15.138:0/1945900144 conn(0x7f43600d0fd0 msgr2=0x7f43600d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:18.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.321+0000 7f4364c00640 1 -- 172.21.15.138:0/1945900144 shutdown_connections 2024-04-26T20:57:18.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.321+0000 7f4364c00640 1 -- 172.21.15.138:0/1945900144 wait complete. 2024-04-26T20:57:18.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.321+0000 7f4364c00640 1 Processor -- start 2024-04-26T20:57:18.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.321+0000 7f4364c00640 1 -- start start 2024-04-26T20:57:18.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.321+0000 7f4364c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4360073ad0 0x7f43600c3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:18.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.321+0000 7f4364c00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f43600d0490 0x7f43600c39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:18.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.321+0000 7f4364c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4360162ca0 0x7f43600a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:18.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.321+0000 7f4364c00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f436016c1c0 con 0x7f43600d0490 2024-04-26T20:57:18.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.321+0000 7f4364c00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f436016c040 con 0x7f4360073ad0 2024-04-26T20:57:18.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.321+0000 7f4364c00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f436016c340 con 0x7f4360162ca0 2024-04-26T20:57:18.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.321+0000 7f4355400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f43600d0490 0x7f43600c39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:18.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.321+0000 7f4355400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f43600d0490 0x7f43600c39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38302/0 (socket says 172.21.15.138:38302) 2024-04-26T20:57:18.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.321+0000 7f4355400640 1 -- 172.21.15.138:0/3307298671 learned_addr learned my addr 172.21.15.138:0/3307298671 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:18.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.321+0000 7f435de00640 1 --2- 172.21.15.138:0/3307298671 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4360073ad0 0x7f43600c3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:18.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.321+0000 7f435e800640 1 --2- 172.21.15.138:0/3307298671 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4360162ca0 0x7f43600a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:18.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.321+0000 7f4355400640 1 -- 172.21.15.138:0/3307298671 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4360162ca0 msgr2=0x7f43600a1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:18.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.321+0000 7f4355400640 1 --2- 172.21.15.138:0/3307298671 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4360162ca0 0x7f43600a1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:18.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.325+0000 7f4355400640 1 -- 172.21.15.138:0/3307298671 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4360073ad0 msgr2=0x7f43600c3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:18.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.325+0000 7f4355400640 1 --2- 172.21.15.138:0/3307298671 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4360073ad0 0x7f43600c3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:18.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.325+0000 7f4355400640 1 -- 172.21.15.138:0/3307298671 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43600c4a80 con 0x7f43600d0490 2024-04-26T20:57:18.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.325+0000 7f4355400640 1 --2- 172.21.15.138:0/3307298671 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f43600d0490 0x7f43600c39d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f434800c3c0 tx=0x7f434800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:18.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.325+0000 7f4356a00640 1 -- 172.21.15.138:0/3307298671 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4348017070 con 0x7f43600d0490 2024-04-26T20:57:18.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.325+0000 7f4356a00640 1 -- 172.21.15.138:0/3307298671 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4348005cf0 con 0x7f43600d0490 2024-04-26T20:57:18.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.325+0000 7f4356a00640 1 -- 172.21.15.138:0/3307298671 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43480072f0 con 0x7f43600d0490 2024-04-26T20:57:18.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.325+0000 7f4364c00640 1 -- 172.21.15.138:0/3307298671 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43600c4d60 con 0x7f43600d0490 2024-04-26T20:57:18.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.325+0000 7f4364c00640 1 -- 172.21.15.138:0/3307298671 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43600c7540 con 0x7f43600d0490 2024-04-26T20:57:18.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.325+0000 7f4364c00640 1 -- 172.21.15.138:0/3307298671 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4360069430 con 0x7f43600d0490 2024-04-26T20:57:18.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.325+0000 7f4356a00640 1 -- 172.21.15.138:0/3307298671 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f434801a070 con 0x7f43600d0490 2024-04-26T20:57:18.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.325+0000 7f4356a00640 1 --2- 172.21.15.138:0/3307298671 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f433c068380 0x7f433c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:18.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.325+0000 7f4356a00640 1 -- 172.21.15.138:0/3307298671 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f43480860a0 con 0x7f43600d0490 2024-04-26T20:57:18.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.325+0000 7f435de00640 1 --2- 172.21.15.138:0/3307298671 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f433c068380 0x7f433c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:18.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.329+0000 7f435de00640 1 --2- 172.21.15.138:0/3307298671 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f433c068380 0x7f433c06a840 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f43500af000 tx=0x7f4350008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:18.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.329+0000 7f4356a00640 1 -- 172.21.15.138:0/3307298671 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4348055c30 con 0x7f43600d0490 2024-04-26T20:57:18.492 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.489+0000 7f4364c00640 1 -- 172.21.15.138:0/3307298671 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f43600d1d30 con 0x7f43600d0490 2024-04-26T20:57:18.492 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.489+0000 7f4356a00640 1 -- 172.21.15.138:0/3307298671 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f4348059f30 con 0x7f43600d0490 2024-04-26T20:57:18.493 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 32 2024-04-26T20:57:18.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.489+0000 7f4364c00640 1 -- 172.21.15.138:0/3307298671 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f433c068380 msgr2=0x7f433c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:18.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.489+0000 7f4364c00640 1 --2- 172.21.15.138:0/3307298671 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f433c068380 0x7f433c06a840 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f43500af000 tx=0x7f4350008040 comp rx=0 tx=0).stop 2024-04-26T20:57:18.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.489+0000 7f4364c00640 1 -- 172.21.15.138:0/3307298671 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f43600d0490 msgr2=0x7f43600c39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:18.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.489+0000 7f4364c00640 1 --2- 172.21.15.138:0/3307298671 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f43600d0490 0x7f43600c39d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f434800c3c0 tx=0x7f434800c880 comp rx=0 tx=0).stop 2024-04-26T20:57:18.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.489+0000 7f4364c00640 1 -- 172.21.15.138:0/3307298671 shutdown_connections 2024-04-26T20:57:18.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.489+0000 7f4364c00640 1 --2- 172.21.15.138:0/3307298671 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f433c068380 0x7f433c06a840 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:18.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.489+0000 7f4364c00640 1 --2- 172.21.15.138:0/3307298671 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4360162ca0 0x7f43600a1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:18.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.489+0000 7f4364c00640 1 --2- 172.21.15.138:0/3307298671 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f43600d0490 0x7f43600c39d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:18.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.489+0000 7f4364c00640 1 --2- 172.21.15.138:0/3307298671 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4360073ad0 0x7f43600c3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:18.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.489+0000 7f4364c00640 1 -- 172.21.15.138:0/3307298671 >> 172.21.15.138:0/3307298671 conn(0x7f43600d0fd0 msgr2=0x7f43600cc0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:18.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.489+0000 7f4364c00640 1 -- 172.21.15.138:0/3307298671 shutdown_connections 2024-04-26T20:57:18.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.489+0000 7f4364c00640 1 -- 172.21.15.138:0/3307298671 wait complete. 2024-04-26T20:57:18.515 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T20:57:18.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.649+0000 7feb58a00640 1 Processor -- start 2024-04-26T20:57:18.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.649+0000 7feb58a00640 1 -- start start 2024-04-26T20:57:18.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.649+0000 7feb58a00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7feb5415bdc0 0x7feb5415f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:18.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.649+0000 7feb58a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feb54073d70 0x7feb5415fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:18.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.649+0000 7feb58a00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7feb5406f880 0x7feb541603b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:18.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.649+0000 7feb58a00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7feb5406dee0 con 0x7feb5406f880 2024-04-26T20:57:18.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.649+0000 7feb58a00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7feb5415c1a0 con 0x7feb5415bdc0 2024-04-26T20:57:18.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.649+0000 7feb58a00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7feb5406e180 con 0x7feb54073d70 2024-04-26T20:57:18.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.649+0000 7feb52800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7feb5406f880 0x7feb541603b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:18.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.649+0000 7feb52800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7feb5406f880 0x7feb541603b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38308/0 (socket says 172.21.15.138:38308) 2024-04-26T20:57:18.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.649+0000 7feb52800640 1 -- 172.21.15.138:0/2917257388 learned_addr learned my addr 172.21.15.138:0/2917257388 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:18.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.649+0000 7feb51400640 1 --2- 172.21.15.138:0/2917257388 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feb54073d70 0x7feb5415fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:18.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.649+0000 7feb51e00640 1 --2- 172.21.15.138:0/2917257388 >> v2:172.21.15.143:3300/0 conn(0x7feb5415bdc0 0x7feb5415f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:18.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.649+0000 7feb52800640 1 -- 172.21.15.138:0/2917257388 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feb54073d70 msgr2=0x7feb5415fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:18.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.649+0000 7feb52800640 1 --2- 172.21.15.138:0/2917257388 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feb54073d70 0x7feb5415fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:18.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.649+0000 7feb52800640 1 -- 172.21.15.138:0/2917257388 >> v2:172.21.15.143:3300/0 conn(0x7feb5415bdc0 msgr2=0x7feb5415f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:18.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.649+0000 7feb52800640 1 --2- 172.21.15.138:0/2917257388 >> v2:172.21.15.143:3300/0 conn(0x7feb5415bdc0 0x7feb5415f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:18.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.649+0000 7feb52800640 1 -- 172.21.15.138:0/2917257388 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb5406e460 con 0x7feb5406f880 2024-04-26T20:57:18.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.653+0000 7feb52800640 1 --2- 172.21.15.138:0/2917257388 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb5406f880 0x7feb541603b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7feb54071b20 tx=0x7feb4c01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76344aa46d51828b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:18.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.653+0000 7feb50a00640 1 -- 172.21.15.138:0/2917257388 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb4c0a56d0 con 0x7feb5406f880 2024-04-26T20:57:18.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.653+0000 7feb50a00640 1 -- 172.21.15.138:0/2917257388 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb4c0a5870 con 0x7feb5406f880 2024-04-26T20:57:18.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.653+0000 7feb50a00640 1 -- 172.21.15.138:0/2917257388 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb4c0a5c40 con 0x7feb5406f880 2024-04-26T20:57:18.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.653+0000 7feb58a00640 1 -- 172.21.15.138:0/2917257388 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb5406f880 msgr2=0x7feb541603b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:18.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.653+0000 7feb58a00640 1 --2- 172.21.15.138:0/2917257388 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb5406f880 0x7feb541603b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7feb54071b20 tx=0x7feb4c01c960 comp rx=0 tx=0).stop 2024-04-26T20:57:18.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.653+0000 7feb58a00640 1 -- 172.21.15.138:0/2917257388 shutdown_connections 2024-04-26T20:57:18.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.653+0000 7feb58a00640 1 --2- 172.21.15.138:0/2917257388 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb5406f880 0x7feb541603b0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:18.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.653+0000 7feb58a00640 1 --2- 172.21.15.138:0/2917257388 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feb54073d70 0x7feb5415fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:18.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.653+0000 7feb58a00640 1 --2- 172.21.15.138:0/2917257388 >> v2:172.21.15.143:3300/0 conn(0x7feb5415bdc0 0x7feb5415f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:18.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.653+0000 7feb58a00640 1 -- 172.21.15.138:0/2917257388 >> 172.21.15.138:0/2917257388 conn(0x7feb540d0bb0 msgr2=0x7feb540d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:18.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.653+0000 7feb58a00640 1 -- 172.21.15.138:0/2917257388 shutdown_connections 2024-04-26T20:57:18.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.653+0000 7feb58a00640 1 -- 172.21.15.138:0/2917257388 wait complete. 2024-04-26T20:57:18.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.653+0000 7feb58a00640 1 Processor -- start 2024-04-26T20:57:18.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.653+0000 7feb58a00640 1 -- start start 2024-04-26T20:57:18.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.657+0000 7feb58a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb5406f880 0x7feb5415a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:18.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.657+0000 7feb58a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feb54073d70 0x7feb5415e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:18.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.657+0000 7feb58a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feb5415bdc0 0x7feb540c7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:18.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.657+0000 7feb58a00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7feb540cc280 con 0x7feb5406f880 2024-04-26T20:57:18.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.657+0000 7feb58a00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7feb540cc100 con 0x7feb54073d70 2024-04-26T20:57:18.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.657+0000 7feb58a00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7feb540cc400 con 0x7feb5415bdc0 2024-04-26T20:57:18.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.657+0000 7feb51e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb5406f880 0x7feb5415a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:18.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.657+0000 7feb51e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb5406f880 0x7feb5415a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38310/0 (socket says 172.21.15.138:38310) 2024-04-26T20:57:18.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.657+0000 7feb51e00640 1 -- 172.21.15.138:0/2210894204 learned_addr learned my addr 172.21.15.138:0/2210894204 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:18.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.657+0000 7feb51400640 1 --2- 172.21.15.138:0/2210894204 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feb54073d70 0x7feb5415e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:18.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.657+0000 7feb52800640 1 --2- 172.21.15.138:0/2210894204 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feb5415bdc0 0x7feb540c7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:18.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.657+0000 7feb51e00640 1 -- 172.21.15.138:0/2210894204 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feb5415bdc0 msgr2=0x7feb540c7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:18.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.657+0000 7feb51e00640 1 --2- 172.21.15.138:0/2210894204 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feb5415bdc0 0x7feb540c7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:18.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.657+0000 7feb51e00640 1 -- 172.21.15.138:0/2210894204 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feb54073d70 msgr2=0x7feb5415e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:18.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.657+0000 7feb51e00640 1 --2- 172.21.15.138:0/2210894204 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feb54073d70 0x7feb5415e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:18.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.657+0000 7feb51e00640 1 -- 172.21.15.138:0/2210894204 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb5415ea30 con 0x7feb5406f880 2024-04-26T20:57:18.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.657+0000 7feb51e00640 1 --2- 172.21.15.138:0/2210894204 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb5406f880 0x7feb5415a200 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7feb440086b0 tx=0x7feb44008b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:18.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.657+0000 7feb4a000640 1 -- 172.21.15.138:0/2210894204 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb44019070 con 0x7feb5406f880 2024-04-26T20:57:18.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.657+0000 7feb4a000640 1 -- 172.21.15.138:0/2210894204 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb4400d900 con 0x7feb5406f880 2024-04-26T20:57:18.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.657+0000 7feb58a00640 1 -- 172.21.15.138:0/2210894204 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb5415c600 con 0x7feb5406f880 2024-04-26T20:57:18.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.657+0000 7feb4a000640 1 -- 172.21.15.138:0/2210894204 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb4400dcd0 con 0x7feb5406f880 2024-04-26T20:57:18.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.657+0000 7feb58a00640 1 -- 172.21.15.138:0/2210894204 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb541554f0 con 0x7feb5406f880 2024-04-26T20:57:18.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.657+0000 7feb58a00640 1 -- 172.21.15.138:0/2210894204 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb5415c400 con 0x7feb5406f880 2024-04-26T20:57:18.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.661+0000 7feb4a000640 1 -- 172.21.15.138:0/2210894204 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7feb4401c070 con 0x7feb5406f880 2024-04-26T20:57:18.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.661+0000 7feb4a000640 1 --2- 172.21.15.138:0/2210894204 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7feb34068380 0x7feb3406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:18.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.661+0000 7feb4a000640 1 -- 172.21.15.138:0/2210894204 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7feb440865f0 con 0x7feb5406f880 2024-04-26T20:57:18.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.661+0000 7feb51400640 1 --2- 172.21.15.138:0/2210894204 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7feb34068380 0x7feb3406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:18.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.661+0000 7feb51400640 1 --2- 172.21.15.138:0/2210894204 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7feb34068380 0x7feb3406a840 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7feb540c94f0 tx=0x7feb40008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:18.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.665+0000 7feb4a000640 1 -- 172.21.15.138:0/2210894204 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7feb44056240 con 0x7feb5406f880 2024-04-26T20:57:18.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.817+0000 7feb58a00640 1 -- 172.21.15.138:0/2210894204 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7feb54069430 con 0x7feb5406f880 2024-04-26T20:57:18.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.821+0000 7feb4a000640 1 -- 172.21.15.138:0/2210894204 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7feb4405a540 con 0x7feb5406f880 2024-04-26T20:57:18.824 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 64 2024-04-26T20:57:18.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.821+0000 7feb58a00640 1 -- 172.21.15.138:0/2210894204 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7feb34068380 msgr2=0x7feb3406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:18.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.821+0000 7feb58a00640 1 --2- 172.21.15.138:0/2210894204 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7feb34068380 0x7feb3406a840 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7feb540c94f0 tx=0x7feb40008040 comp rx=0 tx=0).stop 2024-04-26T20:57:18.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.821+0000 7feb58a00640 1 -- 172.21.15.138:0/2210894204 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb5406f880 msgr2=0x7feb5415a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:18.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.821+0000 7feb58a00640 1 --2- 172.21.15.138:0/2210894204 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb5406f880 0x7feb5415a200 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7feb440086b0 tx=0x7feb44008b70 comp rx=0 tx=0).stop 2024-04-26T20:57:18.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.821+0000 7feb58a00640 1 -- 172.21.15.138:0/2210894204 shutdown_connections 2024-04-26T20:57:18.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.821+0000 7feb58a00640 1 --2- 172.21.15.138:0/2210894204 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7feb34068380 0x7feb3406a840 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:18.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.821+0000 7feb58a00640 1 --2- 172.21.15.138:0/2210894204 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feb5415bdc0 0x7feb540c7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:18.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.821+0000 7feb58a00640 1 --2- 172.21.15.138:0/2210894204 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feb54073d70 0x7feb5415e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:18.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.821+0000 7feb58a00640 1 --2- 172.21.15.138:0/2210894204 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb5406f880 0x7feb5415a200 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:18.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.821+0000 7feb58a00640 1 -- 172.21.15.138:0/2210894204 >> 172.21.15.138:0/2210894204 conn(0x7feb540d0bb0 msgr2=0x7feb540d0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:18.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.821+0000 7feb58a00640 1 -- 172.21.15.138:0/2210894204 shutdown_connections 2024-04-26T20:57:18.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.821+0000 7feb58a00640 1 -- 172.21.15.138:0/2210894204 wait complete. 2024-04-26T20:57:18.845 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T20:57:18.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.981+0000 7f4a9d800640 1 Processor -- start 2024-04-26T20:57:18.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.981+0000 7f4a9d800640 1 -- start start 2024-04-26T20:57:18.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.981+0000 7f4a9d800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4a98073d70 0x7f4a98160040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:18.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.981+0000 7f4a9d800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4a9806f880 0x7f4a980ce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:18.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.981+0000 7f4a9d800640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a9806dee0 con 0x7f4a9815bdc0 2024-04-26T20:57:18.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.981+0000 7f4a9d800640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f4a9815c1a0 con 0x7f4a98073d70 2024-04-26T20:57:18.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.981+0000 7f4a9d800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f4a9806e180 con 0x7f4a9806f880 2024-04-26T20:57:18.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.981+0000 7f4a8e000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4a98073d70 0x7f4a98160040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:18.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.981+0000 7f4a8e000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4a98073d70 0x7f4a98160040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38318/0 (socket says 172.21.15.138:38318) 2024-04-26T20:57:18.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.981+0000 7f4a96a00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f4a9815bdc0 0x7f4a9815f930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:42532/0 (socket says 172.21.15.138:42532) 2024-04-26T20:57:18.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.981+0000 7f4a8e000640 1 -- 172.21.15.138:0/1724550392 learned_addr learned my addr 172.21.15.138:0/1724550392 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:18.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.981+0000 7f4a97400640 1 --2- 172.21.15.138:0/1724550392 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4a9806f880 0x7f4a980ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:18.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.981+0000 7f4a8e000640 1 -- 172.21.15.138:0/1724550392 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4a9806f880 msgr2=0x7f4a980ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:18.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.981+0000 7f4a8e000640 1 --2- 172.21.15.138:0/1724550392 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4a9806f880 0x7f4a980ce780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:18.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.981+0000 7f4a8e000640 1 -- 172.21.15.138:0/1724550392 >> v1:172.21.15.138:6789/0 conn(0x7f4a9815bdc0 legacy=0x7f4a9815f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:18.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.981+0000 7f4a8e000640 1 -- 172.21.15.138:0/1724550392 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a9806e460 con 0x7f4a98073d70 2024-04-26T20:57:18.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.981+0000 7f4a96000640 1 -- 172.21.15.138:0/1724550392 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2715844066 0 0) 0x7f4a9806dee0 con 0x7f4a9815bdc0 2024-04-26T20:57:18.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.985+0000 7f4a8e000640 1 --2- 172.21.15.138:0/1724550392 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4a98073d70 0x7f4a98160040 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4a80009870 tx=0x7f4a8001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d87a941fcd3e9fcb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:18.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.985+0000 7f4a96000640 1 -- 172.21.15.138:0/1724550392 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a800b1070 con 0x7f4a98073d70 2024-04-26T20:57:18.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.985+0000 7f4a96000640 1 -- 172.21.15.138:0/1724550392 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a800ac620 con 0x7f4a98073d70 2024-04-26T20:57:18.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.985+0000 7f4a96000640 1 -- 172.21.15.138:0/1724550392 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a800ac9f0 con 0x7f4a98073d70 2024-04-26T20:57:18.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.985+0000 7f4a9d800640 1 -- 172.21.15.138:0/1724550392 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4a98073d70 msgr2=0x7f4a98160040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:18.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.985+0000 7f4a9d800640 1 --2- 172.21.15.138:0/1724550392 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4a98073d70 0x7f4a98160040 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4a80009870 tx=0x7f4a8001c4d0 comp rx=0 tx=0).stop 2024-04-26T20:57:18.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.985+0000 7f4a9d800640 1 -- 172.21.15.138:0/1724550392 shutdown_connections 2024-04-26T20:57:18.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.985+0000 7f4a9d800640 1 --2- 172.21.15.138:0/1724550392 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4a9806f880 0x7f4a980ce780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:18.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.985+0000 7f4a9d800640 1 --2- 172.21.15.138:0/1724550392 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4a98073d70 0x7f4a98160040 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:18.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.985+0000 7f4a9d800640 1 -- 172.21.15.138:0/1724550392 >> 172.21.15.138:0/1724550392 conn(0x7f4a980d0bb0 msgr2=0x7f4a980d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:18.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.985+0000 7f4a9d800640 1 -- 172.21.15.138:0/1724550392 shutdown_connections 2024-04-26T20:57:18.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.985+0000 7f4a9d800640 1 -- 172.21.15.138:0/1724550392 wait complete. 2024-04-26T20:57:18.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.985+0000 7f4a9d800640 1 Processor -- start 2024-04-26T20:57:18.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.985+0000 7f4a9d800640 1 -- start start 2024-04-26T20:57:18.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.989+0000 7f4a9d800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4a9806f880 0x7f4a9814fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:18.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.989+0000 7f4a9d800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a98073d70 0x7f4a98155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:18.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.989+0000 7f4a9d800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4a9815bdc0 0x7f4a98157c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:18.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.989+0000 7f4a9d800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f4a98168e50 con 0x7f4a9806f880 2024-04-26T20:57:18.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.989+0000 7f4a9d800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f4a98168cd0 con 0x7f4a98073d70 2024-04-26T20:57:18.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.989+0000 7f4a9d800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f4a98168fd0 con 0x7f4a9815bdc0 2024-04-26T20:57:18.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.989+0000 7f4a96a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4a9806f880 0x7f4a9814fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:18.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.989+0000 7f4a96a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4a9806f880 0x7f4a9814fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38320/0 (socket says 172.21.15.138:38320) 2024-04-26T20:57:18.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.989+0000 7f4a96a00640 1 -- 172.21.15.138:0/70174682 learned_addr learned my addr 172.21.15.138:0/70174682 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:18.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.989+0000 7f4a8e000640 1 --2- 172.21.15.138:0/70174682 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a98073d70 0x7f4a98155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:18.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.989+0000 7f4a97400640 1 --2- 172.21.15.138:0/70174682 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4a9815bdc0 0x7f4a98157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:18.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.989+0000 7f4a96a00640 1 -- 172.21.15.138:0/70174682 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4a9815bdc0 msgr2=0x7f4a98157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:18.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.989+0000 7f4a96a00640 1 --2- 172.21.15.138:0/70174682 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4a9815bdc0 0x7f4a98157c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:18.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.989+0000 7f4a96a00640 1 -- 172.21.15.138:0/70174682 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a98073d70 msgr2=0x7f4a98155c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:18.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.989+0000 7f4a96a00640 1 --2- 172.21.15.138:0/70174682 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a98073d70 0x7f4a98155c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:18.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.989+0000 7f4a96a00640 1 -- 172.21.15.138:0/70174682 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a98150340 con 0x7f4a9806f880 2024-04-26T20:57:18.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.989+0000 7f4a8e000640 1 --2- 172.21.15.138:0/70174682 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a98073d70 0x7f4a98155c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:18.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.989+0000 7f4a96a00640 1 --2- 172.21.15.138:0/70174682 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4a9806f880 0x7f4a9814fe00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4a8800c480 tx=0x7f4a8800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:18.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.989+0000 7f4a8f400640 1 -- 172.21.15.138:0/70174682 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a88018070 con 0x7f4a9806f880 2024-04-26T20:57:18.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.989+0000 7f4a8f400640 1 -- 172.21.15.138:0/70174682 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a880074a0 con 0x7f4a9806f880 2024-04-26T20:57:18.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.989+0000 7f4a9d800640 1 -- 172.21.15.138:0/70174682 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a980c7c80 con 0x7f4a9806f880 2024-04-26T20:57:18.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.989+0000 7f4a8f400640 1 -- 172.21.15.138:0/70174682 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a88004a30 con 0x7f4a9806f880 2024-04-26T20:57:18.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.989+0000 7f4a9d800640 1 -- 172.21.15.138:0/70174682 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a980c8240 con 0x7f4a9806f880 2024-04-26T20:57:18.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.989+0000 7f4a9d800640 1 -- 172.21.15.138:0/70174682 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a98069430 con 0x7f4a9806f880 2024-04-26T20:57:18.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.989+0000 7f4a8f400640 1 -- 172.21.15.138:0/70174682 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4a8801b070 con 0x7f4a9806f880 2024-04-26T20:57:18.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.993+0000 7f4a8f400640 1 --2- 172.21.15.138:0/70174682 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4a74068380 0x7f4a7406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:18.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.993+0000 7f4a8f400640 1 -- 172.21.15.138:0/70174682 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f4a88085ea0 con 0x7f4a9806f880 2024-04-26T20:57:18.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.993+0000 7f4a8e000640 1 --2- 172.21.15.138:0/70174682 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4a74068380 0x7f4a7406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:18.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.993+0000 7f4a8e000640 1 --2- 172.21.15.138:0/70174682 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4a74068380 0x7f4a7406a840 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4a800ae000 tx=0x7f4a800a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:19.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:18.997+0000 7f4a8f400640 1 -- 172.21.15.138:0/70174682 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4a98150340 con 0x7f4a9806f880 2024-04-26T20:57:19.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.153+0000 7f4a9d800640 1 -- 172.21.15.138:0/70174682 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f4a980d19c0 con 0x7f4a9806f880 2024-04-26T20:57:19.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.153+0000 7f4a8f400640 1 -- 172.21.15.138:0/70174682 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f4a880561b0 con 0x7f4a9806f880 2024-04-26T20:57:19.159 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 32 2024-04-26T20:57:19.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.157+0000 7f4a9d800640 1 -- 172.21.15.138:0/70174682 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4a74068380 msgr2=0x7f4a7406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:19.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.157+0000 7f4a9d800640 1 --2- 172.21.15.138:0/70174682 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4a74068380 0x7f4a7406a840 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4a800ae000 tx=0x7f4a800a7000 comp rx=0 tx=0).stop 2024-04-26T20:57:19.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.157+0000 7f4a9d800640 1 -- 172.21.15.138:0/70174682 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4a9806f880 msgr2=0x7f4a9814fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:19.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.157+0000 7f4a9d800640 1 --2- 172.21.15.138:0/70174682 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4a9806f880 0x7f4a9814fe00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4a8800c480 tx=0x7f4a8800c940 comp rx=0 tx=0).stop 2024-04-26T20:57:19.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.157+0000 7f4a9d800640 1 -- 172.21.15.138:0/70174682 shutdown_connections 2024-04-26T20:57:19.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.157+0000 7f4a9d800640 1 --2- 172.21.15.138:0/70174682 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4a74068380 0x7f4a7406a840 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:19.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.157+0000 7f4a9d800640 1 --2- 172.21.15.138:0/70174682 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4a9815bdc0 0x7f4a98157c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:19.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.157+0000 7f4a9d800640 1 --2- 172.21.15.138:0/70174682 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a98073d70 0x7f4a98155c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:19.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.157+0000 7f4a9d800640 1 --2- 172.21.15.138:0/70174682 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4a9806f880 0x7f4a9814fe00 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:19.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.157+0000 7f4a9d800640 1 -- 172.21.15.138:0/70174682 >> 172.21.15.138:0/70174682 conn(0x7f4a980d0bb0 msgr2=0x7f4a9815b110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:19.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.157+0000 7f4a9d800640 1 -- 172.21.15.138:0/70174682 shutdown_connections 2024-04-26T20:57:19.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.157+0000 7f4a9d800640 1 -- 172.21.15.138:0/70174682 wait complete. 2024-04-26T20:57:19.180 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:57:19.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.317+0000 7f051ae00640 1 Processor -- start 2024-04-26T20:57:19.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.317+0000 7f051ae00640 1 -- start start 2024-04-26T20:57:19.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.317+0000 7f051ae00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05140b4030 0x7f051415e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:19.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.317+0000 7f051ae00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f051415f210 0x7f05141632d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:19.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.317+0000 7f051ae00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f051406d990 con 0x7f051415ed90 2024-04-26T20:57:19.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.317+0000 7f051ae00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f051406dfc0 con 0x7f051415f210 2024-04-26T20:57:19.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.317+0000 7f051ae00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f051406e2a0 con 0x7f05140b4030 2024-04-26T20:57:19.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.317+0000 7f051a400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f051415f210 0x7f05141632d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:19.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.317+0000 7f051a400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f051415f210 0x7f05141632d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38322/0 (socket says 172.21.15.138:38322) 2024-04-26T20:57:19.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.317+0000 7f051a400640 1 -- 172.21.15.138:0/3410675725 learned_addr learned my addr 172.21.15.138:0/3410675725 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:19.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.317+0000 7f0519a00640 1 --2- 172.21.15.138:0/3410675725 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05140b4030 0x7f051415e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:19.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.317+0000 7f051a400640 1 -- 172.21.15.138:0/3410675725 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05140b4030 msgr2=0x7f051415e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:19.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.317+0000 7f051a400640 1 --2- 172.21.15.138:0/3410675725 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05140b4030 0x7f051415e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:19.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.317+0000 7f051a400640 1 -- 172.21.15.138:0/3410675725 >> v1:172.21.15.143:6789/0 conn(0x7f051415ed90 legacy=0x7f0514162bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:19.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.317+0000 7f051a400640 1 -- 172.21.15.138:0/3410675725 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f051406e580 con 0x7f051415f210 2024-04-26T20:57:19.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.321+0000 7f051a400640 1 --2- 172.21.15.138:0/3410675725 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f051415f210 0x7f05141632d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f050c009e50 tx=0x7f050c01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a7a239d6788a34f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:19.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.321+0000 7f0513e00640 1 -- 172.21.15.138:0/3410675725 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f050c0a5860 con 0x7f051415f210 2024-04-26T20:57:19.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.321+0000 7f0513e00640 1 -- 172.21.15.138:0/3410675725 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f050c0a5a00 con 0x7f051415f210 2024-04-26T20:57:19.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.321+0000 7f0513e00640 1 -- 172.21.15.138:0/3410675725 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f050c0a5dd0 con 0x7f051415f210 2024-04-26T20:57:19.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.321+0000 7f051ae00640 1 -- 172.21.15.138:0/3410675725 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f051415f210 msgr2=0x7f05141632d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:19.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.321+0000 7f051ae00640 1 --2- 172.21.15.138:0/3410675725 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f051415f210 0x7f05141632d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f050c009e50 tx=0x7f050c01ca30 comp rx=0 tx=0).stop 2024-04-26T20:57:19.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.321+0000 7f051ae00640 1 -- 172.21.15.138:0/3410675725 shutdown_connections 2024-04-26T20:57:19.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.321+0000 7f051ae00640 1 --2- 172.21.15.138:0/3410675725 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f051415f210 0x7f05141632d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:19.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.321+0000 7f051ae00640 1 --2- 172.21.15.138:0/3410675725 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05140b4030 0x7f051415e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:19.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.321+0000 7f051ae00640 1 -- 172.21.15.138:0/3410675725 >> 172.21.15.138:0/3410675725 conn(0x7f05140d2be0 msgr2=0x7f05140d2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:19.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.321+0000 7f051ae00640 1 -- 172.21.15.138:0/3410675725 shutdown_connections 2024-04-26T20:57:19.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.321+0000 7f051ae00640 1 -- 172.21.15.138:0/3410675725 wait complete. 2024-04-26T20:57:19.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.321+0000 7f051ae00640 1 Processor -- start 2024-04-26T20:57:19.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.321+0000 7f051ae00640 1 -- start start 2024-04-26T20:57:19.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.325+0000 7f051ae00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f05140b4030 0x7f05140c6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:19.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.325+0000 7f051ae00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f051415ed90 0x7f05141503d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:19.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.325+0000 7f051ae00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f051415f210 0x7f05140c88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:19.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.325+0000 7f051ae00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f05140d16c0 con 0x7f051415f210 2024-04-26T20:57:19.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.325+0000 7f051ae00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f0514163a20 con 0x7f05140b4030 2024-04-26T20:57:19.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.325+0000 7f051ae00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f05140d1840 con 0x7f051415ed90 2024-04-26T20:57:19.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.325+0000 7f051a400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f051415f210 0x7f05140c88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:19.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.325+0000 7f051a400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f051415f210 0x7f05140c88b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38330/0 (socket says 172.21.15.138:38330) 2024-04-26T20:57:19.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.325+0000 7f051a400640 1 -- 172.21.15.138:0/2247472574 learned_addr learned my addr 172.21.15.138:0/2247472574 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:19.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.325+0000 7f0519a00640 1 --2- 172.21.15.138:0/2247472574 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f05140b4030 0x7f05140c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:19.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.325+0000 7f0519000640 1 --2- 172.21.15.138:0/2247472574 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f051415ed90 0x7f05141503d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:19.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.325+0000 7f051a400640 1 -- 172.21.15.138:0/2247472574 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f051415ed90 msgr2=0x7f05141503d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:19.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.325+0000 7f051a400640 1 --2- 172.21.15.138:0/2247472574 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f051415ed90 0x7f05141503d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:19.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.325+0000 7f051a400640 1 -- 172.21.15.138:0/2247472574 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f05140b4030 msgr2=0x7f05140c6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:19.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.325+0000 7f051a400640 1 --2- 172.21.15.138:0/2247472574 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f05140b4030 0x7f05140c6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:19.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.325+0000 7f051a400640 1 -- 172.21.15.138:0/2247472574 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05140c7010 con 0x7f051415f210 2024-04-26T20:57:19.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.325+0000 7f051a400640 1 --2- 172.21.15.138:0/2247472574 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f051415f210 0x7f05140c88b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f050c0af040 tx=0x7f050c0197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:19.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.325+0000 7f0511600640 1 -- 172.21.15.138:0/2247472574 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f050c0b8440 con 0x7f051415f210 2024-04-26T20:57:19.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.325+0000 7f0511600640 1 -- 172.21.15.138:0/2247472574 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f050c0b85e0 con 0x7f051415f210 2024-04-26T20:57:19.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.325+0000 7f0511600640 1 -- 172.21.15.138:0/2247472574 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f050c0b89b0 con 0x7f051415f210 2024-04-26T20:57:19.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.325+0000 7f051ae00640 1 -- 172.21.15.138:0/2247472574 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05140c72f0 con 0x7f051415f210 2024-04-26T20:57:19.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.325+0000 7f051ae00640 1 -- 172.21.15.138:0/2247472574 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05140c78b0 con 0x7f051415f210 2024-04-26T20:57:19.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.325+0000 7f051ae00640 1 -- 172.21.15.138:0/2247472574 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0514069b40 con 0x7f051415f210 2024-04-26T20:57:19.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.329+0000 7f0511600640 1 -- 172.21.15.138:0/2247472574 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f050c0c1020 con 0x7f051415f210 2024-04-26T20:57:19.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.329+0000 7f0511600640 1 --2- 172.21.15.138:0/2247472574 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f04f4068380 0x7f04f406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:19.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.329+0000 7f0511600640 1 -- 172.21.15.138:0/2247472574 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f050c121140 con 0x7f051415f210 2024-04-26T20:57:19.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.329+0000 7f0519a00640 1 --2- 172.21.15.138:0/2247472574 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f04f4068380 0x7f04f406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:19.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.329+0000 7f0519a00640 1 --2- 172.21.15.138:0/2247472574 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f04f4068380 0x7f04f406a840 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0508007a60 tx=0x7f0508008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:19.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.333+0000 7f0511600640 1 -- 172.21.15.138:0/2247472574 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f050c0c8020 con 0x7f051415f210 2024-04-26T20:57:19.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.497+0000 7f051ae00640 1 -- 172.21.15.138:0/2247472574 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0514074f50 con 0x7f051415f210 2024-04-26T20:57:19.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.497+0000 7f0511600640 1 -- 172.21.15.138:0/2247472574 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18719 (secure 0 0 0) 0x7f050c016620 con 0x7f051415f210 2024-04-26T20:57:19.503 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:57:19.503 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":28,"fsid":"c22b4730-12cc-4558-8535-b965384398c0","created":"2024-04-26T20:56:14.182475+0000","modified":"2024-04-26T20:57:19.385032+0000","last_up_change":"2024-04-26T20:56:26.013243+0000","last_in_change":"2024-04-26T20:56:16.714055+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:56:27.265834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:56:37.394398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:56:38.544369+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:56:42.240243+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3f9a2e34-3199-466f-a6cf-57927318121e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6801","nonce":3534772245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6803","nonce":3534772245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6807","nonce":3534772245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6805","nonce":3534772245}]},"public_addr":"172.21.15.138:6801/3534772245","cluster_addr":"172.21.15.138:6803/3534772245","heartbeat_back_addr":"172.21.15.138:6807/3534772245","heartbeat_front_addr":"172.21.15.138:6805/3534772245","state":["exists","up"]},{"osd":1,"uuid":"e881fcf6-3248-4696-a2ef-95d206d77712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6817","nonce":1427635773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6819","nonce":1427635773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6823","nonce":1427635773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6821","nonce":1427635773}]},"public_addr":"172.21.15.138:6817/1427635773","cluster_addr":"172.21.15.138:6819/1427635773","heartbeat_back_addr":"172.21.15.138:6823/1427635773","heartbeat_front_addr":"172.21.15.138:6821/1427635773","state":["exists","up"]},{"osd":2,"uuid":"f7d1db33-7672-4699-ae47-9f1e0a8e4222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6809","nonce":4273721573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6811","nonce":4273721573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6815","nonce":4273721573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6813","nonce":4273721573}]},"public_addr":"172.21.15.138:6809/4273721573","cluster_addr":"172.21.15.138:6811/4273721573","heartbeat_back_addr":"172.21.15.138:6815/4273721573","heartbeat_front_addr":"172.21.15.138:6813/4273721573","state":["exists","up"]},{"osd":3,"uuid":"2f4e0a9a-b8f6-4468-844a-a4501cd85054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6825","nonce":3098242154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6827","nonce":3098242154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6831","nonce":3098242154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6829","nonce":3098242154}]},"public_addr":"172.21.15.138:6825/3098242154","cluster_addr":"172.21.15.138:6827/3098242154","heartbeat_back_addr":"172.21.15.138:6831/3098242154","heartbeat_front_addr":"172.21.15.138:6829/3098242154","state":["exists","up"]},{"osd":4,"uuid":"c85df99b-3624-410e-866b-86830af2cfe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6801","nonce":2942056312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6803","nonce":2942056312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6807","nonce":2942056312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6805","nonce":2942056312}]},"public_addr":"172.21.15.143:6801/2942056312","cluster_addr":"172.21.15.143:6803/2942056312","heartbeat_back_addr":"172.21.15.143:6807/2942056312","heartbeat_front_addr":"172.21.15.143:6805/2942056312","state":["exists","up"]},{"osd":5,"uuid":"9af1efb5-c416-4808-b5ef-de0679ab9705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6809","nonce":1910222887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6811","nonce":1910222887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6815","nonce":1910222887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6813","nonce":1910222887}]},"public_addr":"172.21.15.143:6809/1910222887","cluster_addr":"172.21.15.143:6811/1910222887","heartbeat_back_addr":"172.21.15.143:6815/1910222887","heartbeat_front_addr":"172.21.15.143:6813/1910222887","state":["exists","up"]},{"osd":6,"uuid":"d7138615-8838-45ff-9072-2fd0683362f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6817","nonce":1082239825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6819","nonce":1082239825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6823","nonce":1082239825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6821","nonce":1082239825}]},"public_addr":"172.21.15.143:6817/1082239825","cluster_addr":"172.21.15.143:6819/1082239825","heartbeat_back_addr":"172.21.15.143:6823/1082239825","heartbeat_front_addr":"172.21.15.143:6821/1082239825","state":["exists","up"]},{"osd":7,"uuid":"0c27172b-35c4-49ec-ba0b-0137b8ff0010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6825","nonce":3295508495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6827","nonce":3295508495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6831","nonce":3295508495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6829","nonce":3295508495}]},"public_addr":"172.21.15.143:6825/3295508495","cluster_addr":"172.21.15.143:6827/3295508495","heartbeat_back_addr":"172.21.15.143:6831/3295508495","heartbeat_front_addr":"172.21.15.143:6829/3295508495","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.326627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.396119+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.433915+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.414179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.216947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.329272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.503073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.436382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.39","mappings":[{"from":0,"to":7}]},{"pgid":"4.6","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:57:19.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.501+0000 7f051ae00640 1 -- 172.21.15.138:0/2247472574 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f04f4068380 msgr2=0x7f04f406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:19.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.501+0000 7f051ae00640 1 --2- 172.21.15.138:0/2247472574 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f04f4068380 0x7f04f406a840 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0508007a60 tx=0x7f0508008040 comp rx=0 tx=0).stop 2024-04-26T20:57:19.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.501+0000 7f051ae00640 1 -- 172.21.15.138:0/2247472574 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f051415f210 msgr2=0x7f05140c88b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:19.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.501+0000 7f051ae00640 1 --2- 172.21.15.138:0/2247472574 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f051415f210 0x7f05140c88b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f050c0af040 tx=0x7f050c0197d0 comp rx=0 tx=0).stop 2024-04-26T20:57:19.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.501+0000 7f051ae00640 1 -- 172.21.15.138:0/2247472574 shutdown_connections 2024-04-26T20:57:19.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.501+0000 7f051ae00640 1 --2- 172.21.15.138:0/2247472574 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f04f4068380 0x7f04f406a840 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:19.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.501+0000 7f051ae00640 1 --2- 172.21.15.138:0/2247472574 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f051415f210 0x7f05140c88b0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:19.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.501+0000 7f051ae00640 1 --2- 172.21.15.138:0/2247472574 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f051415ed90 0x7f05141503d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:19.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.501+0000 7f051ae00640 1 --2- 172.21.15.138:0/2247472574 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f05140b4030 0x7f05140c6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:19.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.501+0000 7f051ae00640 1 -- 172.21.15.138:0/2247472574 >> 172.21.15.138:0/2247472574 conn(0x7f05140d2be0 msgr2=0x7f051406ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:19.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.501+0000 7f051ae00640 1 -- 172.21.15.138:0/2247472574 shutdown_connections 2024-04-26T20:57:19.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.501+0000 7f051ae00640 1 -- 172.21.15.138:0/2247472574 wait complete. 2024-04-26T20:57:19.525 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:56:27.265834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T20:56:37.394398+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T20:56:38.544369+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T20:56:42.240243+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T20:57:19.525 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T20:57:19.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.661+0000 7fba4aa00640 1 Processor -- start 2024-04-26T20:57:19.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.661+0000 7fba4aa00640 1 -- start start 2024-04-26T20:57:19.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.661+0000 7fba4aa00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fba440cd6d0 0x7fba4406c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:19.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.661+0000 7fba4aa00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba440cbab0 con 0x7fba440cf950 2024-04-26T20:57:19.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.661+0000 7fba4aa00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba44163940 con 0x7fba4415efe0 2024-04-26T20:57:19.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.661+0000 7fba4aa00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fba440cbd30 con 0x7fba440cd6d0 2024-04-26T20:57:19.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.661+0000 7fba48a00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fba440cd6d0 0x7fba4406c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:19.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.661+0000 7fba43400640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fba440cf950 0x7fba440cc810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:42540/0 (socket says 172.21.15.138:42540) 2024-04-26T20:57:19.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.661+0000 7fba43400640 1 -- 172.21.15.138:0/3357654466 learned_addr learned my addr 172.21.15.138:0/3357654466 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:19.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.661+0000 7fba48a00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fba440cd6d0 0x7fba4406c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38346/0 (socket says 172.21.15.138:38346) 2024-04-26T20:57:19.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.661+0000 7fba48a00640 1 -- 172.21.15.138:0/3357654466 >> v1:172.21.15.143:6789/0 conn(0x7fba4415efe0 legacy=0x7fba440cf240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:19.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.661+0000 7fba48a00640 1 -- 172.21.15.138:0/3357654466 >> v1:172.21.15.138:6789/0 conn(0x7fba440cf950 legacy=0x7fba440cc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:19.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.661+0000 7fba48a00640 1 -- 172.21.15.138:0/3357654466 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba440cc010 con 0x7fba440cd6d0 2024-04-26T20:57:19.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.661+0000 7fba42a00640 1 -- 172.21.15.138:0/3357654466 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1379554776 0 0) 0x7fba30001120 con 0x7fba440cf950 2024-04-26T20:57:19.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.665+0000 7fba48a00640 1 --2- 172.21.15.138:0/3357654466 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba440cd6d0 0x7fba4406c300 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fba3c0097c0 tx=0x7fba3c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa74cca9aa81fa2f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:19.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.665+0000 7fba42a00640 1 -- 172.21.15.138:0/3357654466 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba3c0aa620 con 0x7fba440cd6d0 2024-04-26T20:57:19.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.665+0000 7fba42a00640 1 -- 172.21.15.138:0/3357654466 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba3c0af070 con 0x7fba440cd6d0 2024-04-26T20:57:19.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.665+0000 7fba42a00640 1 -- 172.21.15.138:0/3357654466 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba3c0aa9e0 con 0x7fba440cd6d0 2024-04-26T20:57:19.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.665+0000 7fba4aa00640 1 -- 172.21.15.138:0/3357654466 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba440cd6d0 msgr2=0x7fba4406c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:19.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.665+0000 7fba4aa00640 1 --2- 172.21.15.138:0/3357654466 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba440cd6d0 0x7fba4406c300 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fba3c0097c0 tx=0x7fba3c01c4a0 comp rx=0 tx=0).stop 2024-04-26T20:57:19.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.665+0000 7fba4aa00640 1 -- 172.21.15.138:0/3357654466 shutdown_connections 2024-04-26T20:57:19.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.665+0000 7fba4aa00640 1 --2- 172.21.15.138:0/3357654466 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba440cd6d0 0x7fba4406c300 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:19.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.665+0000 7fba4aa00640 1 -- 172.21.15.138:0/3357654466 >> 172.21.15.138:0/3357654466 conn(0x7fba440cdee0 msgr2=0x7fba440ce2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:19.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.665+0000 7fba4aa00640 1 -- 172.21.15.138:0/3357654466 shutdown_connections 2024-04-26T20:57:19.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.665+0000 7fba4aa00640 1 -- 172.21.15.138:0/3357654466 wait complete. 2024-04-26T20:57:19.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.669+0000 7fba4aa00640 1 Processor -- start 2024-04-26T20:57:19.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.669+0000 7fba4aa00640 1 -- start start 2024-04-26T20:57:19.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.669+0000 7fba4aa00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba440cd6d0 0x7fba44154080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:19.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.669+0000 7fba4aa00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba440cf950 0x7fba44161630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:19.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.669+0000 7fba4aa00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fba4415efe0 0x7fba4406ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:19.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.669+0000 7fba4aa00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fba440cd330 con 0x7fba440cf950 2024-04-26T20:57:19.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.669+0000 7fba4aa00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fba4415f3c0 con 0x7fba440cd6d0 2024-04-26T20:57:19.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.669+0000 7fba4aa00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fba440b5af0 con 0x7fba4415efe0 2024-04-26T20:57:19.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.669+0000 7fba43400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba440cf950 0x7fba44161630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:19.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.669+0000 7fba43400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba440cf950 0x7fba44161630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38362/0 (socket says 172.21.15.138:38362) 2024-04-26T20:57:19.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.669+0000 7fba43400640 1 -- 172.21.15.138:0/574328193 learned_addr learned my addr 172.21.15.138:0/574328193 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:19.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.669+0000 7fba43e00640 1 --2- 172.21.15.138:0/574328193 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba440cd6d0 0x7fba44154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:19.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.669+0000 7fba48a00640 1 --2- 172.21.15.138:0/574328193 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fba4415efe0 0x7fba4406ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:19.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.669+0000 7fba43400640 1 -- 172.21.15.138:0/574328193 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fba4415efe0 msgr2=0x7fba4406ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:19.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.669+0000 7fba43400640 1 --2- 172.21.15.138:0/574328193 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fba4415efe0 0x7fba4406ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:19.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.669+0000 7fba43400640 1 -- 172.21.15.138:0/574328193 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba440cd6d0 msgr2=0x7fba44154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:19.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.669+0000 7fba43400640 1 --2- 172.21.15.138:0/574328193 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba440cd6d0 0x7fba44154080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:19.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.669+0000 7fba43400640 1 -- 172.21.15.138:0/574328193 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba441545c0 con 0x7fba440cf950 2024-04-26T20:57:19.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.669+0000 7fba43400640 1 --2- 172.21.15.138:0/574328193 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba440cf950 0x7fba44161630 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fba3000c7b0 tx=0x7fba3000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:19.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.669+0000 7fba3be00640 1 -- 172.21.15.138:0/574328193 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba30018070 con 0x7fba440cf950 2024-04-26T20:57:19.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.669+0000 7fba3be00640 1 -- 172.21.15.138:0/574328193 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba300072d0 con 0x7fba440cf950 2024-04-26T20:57:19.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.669+0000 7fba4aa00640 1 -- 172.21.15.138:0/574328193 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba44161fa0 con 0x7fba440cf950 2024-04-26T20:57:19.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.669+0000 7fba3be00640 1 -- 172.21.15.138:0/574328193 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba300047f0 con 0x7fba440cf950 2024-04-26T20:57:19.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.669+0000 7fba4aa00640 1 -- 172.21.15.138:0/574328193 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba440b52f0 con 0x7fba440cf950 2024-04-26T20:57:19.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.669+0000 7fba4aa00640 1 -- 172.21.15.138:0/574328193 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba44069430 con 0x7fba440cf950 2024-04-26T20:57:19.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.673+0000 7fba3be00640 1 -- 172.21.15.138:0/574328193 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fba3001b070 con 0x7fba440cf950 2024-04-26T20:57:19.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.673+0000 7fba3be00640 1 --2- 172.21.15.138:0/574328193 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fba240683b0 0x7fba2406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:19.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.673+0000 7fba3be00640 1 -- 172.21.15.138:0/574328193 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6619+0+0 (secure 0 0 0) 0x7fba30085e80 con 0x7fba440cf950 2024-04-26T20:57:19.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.673+0000 7fba43e00640 1 --2- 172.21.15.138:0/574328193 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fba240683b0 0x7fba2406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:19.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.673+0000 7fba43e00640 1 --2- 172.21.15.138:0/574328193 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fba240683b0 0x7fba2406a870 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fba340012f0 tx=0x7fba34009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:19.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.677+0000 7fba3be00640 1 -- 172.21.15.138:0/574328193 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fba440cbab0 con 0x7fba440cf950 2024-04-26T20:57:19.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.833+0000 7fba4aa00640 1 -- 172.21.15.138:0/574328193 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fba44068690 con 0x7fba440cf950 2024-04-26T20:57:19.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.833+0000 7fba3be00640 1 -- 172.21.15.138:0/574328193 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) ==== 93+0+10 (secure 0 0 0) 0x7fba300076c0 con 0x7fba440cf950 2024-04-26T20:57:19.838 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 1 2024-04-26T20:57:19.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.837+0000 7fba4aa00640 1 -- 172.21.15.138:0/574328193 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fba240683b0 msgr2=0x7fba2406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:19.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.837+0000 7fba4aa00640 1 --2- 172.21.15.138:0/574328193 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fba240683b0 0x7fba2406a870 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fba340012f0 tx=0x7fba34009040 comp rx=0 tx=0).stop 2024-04-26T20:57:19.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.837+0000 7fba4aa00640 1 -- 172.21.15.138:0/574328193 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba440cf950 msgr2=0x7fba44161630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:19.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.837+0000 7fba4aa00640 1 --2- 172.21.15.138:0/574328193 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba440cf950 0x7fba44161630 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fba3000c7b0 tx=0x7fba3000cc70 comp rx=0 tx=0).stop 2024-04-26T20:57:19.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.837+0000 7fba4aa00640 1 -- 172.21.15.138:0/574328193 shutdown_connections 2024-04-26T20:57:19.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.837+0000 7fba4aa00640 1 --2- 172.21.15.138:0/574328193 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fba240683b0 0x7fba2406a870 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:19.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.837+0000 7fba4aa00640 1 --2- 172.21.15.138:0/574328193 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fba4415efe0 0x7fba4406ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:19.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.837+0000 7fba4aa00640 1 --2- 172.21.15.138:0/574328193 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba440cf950 0x7fba44161630 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:19.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.837+0000 7fba4aa00640 1 --2- 172.21.15.138:0/574328193 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba440cd6d0 0x7fba44154080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:19.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.837+0000 7fba4aa00640 1 -- 172.21.15.138:0/574328193 >> 172.21.15.138:0/574328193 conn(0x7fba440cdee0 msgr2=0x7fba4406c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:19.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.837+0000 7fba4aa00640 1 -- 172.21.15.138:0/574328193 shutdown_connections 2024-04-26T20:57:19.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.837+0000 7fba4aa00640 1 -- 172.21.15.138:0/574328193 wait complete. 2024-04-26T20:57:19.859 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T20:57:19.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.993+0000 7faa2fa00640 1 Processor -- start 2024-04-26T20:57:19.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.993+0000 7faa2fa00640 1 -- start start 2024-04-26T20:57:19.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.993+0000 7faa2fa00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7faa280cf950 0x7faa2806c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:19.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.993+0000 7faa2fa00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7faa280cd6d0 0x7faa280c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:19.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.993+0000 7faa2fa00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa280cbab0 con 0x7faa2815efe0 2024-04-26T20:57:19.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.993+0000 7faa2fa00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7faa28163940 con 0x7faa280cf950 2024-04-26T20:57:19.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.993+0000 7faa2fa00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7faa280cbd30 con 0x7faa280cd6d0 2024-04-26T20:57:19.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.993+0000 7faa27e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7faa280cf950 0x7faa2806c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:19.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.993+0000 7faa2d000640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7faa2815efe0 0x7faa280cf240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:42550/0 (socket says 172.21.15.138:42550) 2024-04-26T20:57:19.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.993+0000 7faa2d000640 1 -- 172.21.15.138:0/2845629047 learned_addr learned my addr 172.21.15.138:0/2845629047 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:19.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.993+0000 7faa2da00640 1 --2- 172.21.15.138:0/2845629047 >> v2:172.21.15.143:3300/0 conn(0x7faa280cd6d0 0x7faa280c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:19.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.993+0000 7faa27e00640 1 -- 172.21.15.138:0/2845629047 >> v2:172.21.15.143:3300/0 conn(0x7faa280cd6d0 msgr2=0x7faa280c7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:19.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.993+0000 7faa27e00640 1 --2- 172.21.15.138:0/2845629047 >> v2:172.21.15.143:3300/0 conn(0x7faa280cd6d0 0x7faa280c7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:19.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.993+0000 7faa27e00640 1 -- 172.21.15.138:0/2845629047 >> v1:172.21.15.138:6789/0 conn(0x7faa2815efe0 legacy=0x7faa280cf240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:19.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.993+0000 7faa27e00640 1 -- 172.21.15.138:0/2845629047 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa280cc010 con 0x7faa280cf950 2024-04-26T20:57:19.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.993+0000 7faa27400640 1 -- 172.21.15.138:0/2845629047 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 704438366 0 0) 0x7faa18001120 con 0x7faa2815efe0 2024-04-26T20:57:20.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.997+0000 7faa27e00640 1 --2- 172.21.15.138:0/2845629047 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faa280cf950 0x7faa2806c300 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7faa280d0c20 tx=0x7faa1401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e99854f9f9884003 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:20.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.997+0000 7faa27400640 1 -- 172.21.15.138:0/2845629047 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa140b1070 con 0x7faa280cf950 2024-04-26T20:57:20.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.997+0000 7faa27400640 1 -- 172.21.15.138:0/2845629047 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa140ac5f0 con 0x7faa280cf950 2024-04-26T20:57:20.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.997+0000 7faa27400640 1 -- 172.21.15.138:0/2845629047 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa140ac9c0 con 0x7faa280cf950 2024-04-26T20:57:20.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.997+0000 7faa2fa00640 1 -- 172.21.15.138:0/2845629047 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faa280cf950 msgr2=0x7faa2806c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:20.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.997+0000 7faa2fa00640 1 --2- 172.21.15.138:0/2845629047 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faa280cf950 0x7faa2806c300 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7faa280d0c20 tx=0x7faa1401c480 comp rx=0 tx=0).stop 2024-04-26T20:57:20.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.997+0000 7faa2fa00640 1 -- 172.21.15.138:0/2845629047 shutdown_connections 2024-04-26T20:57:20.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.997+0000 7faa2fa00640 1 --2- 172.21.15.138:0/2845629047 >> v2:172.21.15.143:3300/0 conn(0x7faa280cd6d0 0x7faa280c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:20.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.997+0000 7faa2fa00640 1 --2- 172.21.15.138:0/2845629047 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faa280cf950 0x7faa2806c300 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:20.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.997+0000 7faa2fa00640 1 -- 172.21.15.138:0/2845629047 >> 172.21.15.138:0/2845629047 conn(0x7faa280cdee0 msgr2=0x7faa280ce2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:20.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.997+0000 7faa2fa00640 1 -- 172.21.15.138:0/2845629047 shutdown_connections 2024-04-26T20:57:20.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:19.997+0000 7faa2fa00640 1 -- 172.21.15.138:0/2845629047 wait complete. 2024-04-26T20:57:20.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.001+0000 7faa2fa00640 1 Processor -- start 2024-04-26T20:57:20.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.001+0000 7faa2fa00640 1 -- start start 2024-04-26T20:57:20.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.001+0000 7faa2fa00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faa280cd6d0 0x7faa2806c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:20.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.001+0000 7faa2fa00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faa280cf950 0x7faa2806f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:20.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.001+0000 7faa2fa00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faa2815efe0 0x7faa2806fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:20.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.001+0000 7faa2fa00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7faa280cd020 con 0x7faa280cf950 2024-04-26T20:57:20.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.001+0000 7faa2fa00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7faa2815f5d0 con 0x7faa2815efe0 2024-04-26T20:57:20.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.001+0000 7faa2fa00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7faa280cd1a0 con 0x7faa280cd6d0 2024-04-26T20:57:20.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.001+0000 7faa27e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faa280cf950 0x7faa2806f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:20.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.001+0000 7faa27e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faa280cf950 0x7faa2806f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38394/0 (socket says 172.21.15.138:38394) 2024-04-26T20:57:20.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.001+0000 7faa27e00640 1 -- 172.21.15.138:0/3520078717 learned_addr learned my addr 172.21.15.138:0/3520078717 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:20.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.001+0000 7faa2d000640 1 --2- 172.21.15.138:0/3520078717 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faa280cd6d0 0x7faa2806c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:20.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.001+0000 7faa2da00640 1 --2- 172.21.15.138:0/3520078717 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faa2815efe0 0x7faa2806fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:20.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.001+0000 7faa27e00640 1 -- 172.21.15.138:0/3520078717 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faa280cd6d0 msgr2=0x7faa2806c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:20.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.001+0000 7faa27e00640 1 --2- 172.21.15.138:0/3520078717 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faa280cd6d0 0x7faa2806c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:20.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.001+0000 7faa27e00640 1 -- 172.21.15.138:0/3520078717 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faa2815efe0 msgr2=0x7faa2806fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:20.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.001+0000 7faa27e00640 1 --2- 172.21.15.138:0/3520078717 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faa2815efe0 0x7faa2806fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:20.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.001+0000 7faa27e00640 1 -- 172.21.15.138:0/3520078717 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa2806cdd0 con 0x7faa280cf950 2024-04-26T20:57:20.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.001+0000 7faa27e00640 1 --2- 172.21.15.138:0/3520078717 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faa280cf950 0x7faa2806f8d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7faa140af040 tx=0x7faa14019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:20.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.001+0000 7faa24c00640 1 -- 172.21.15.138:0/3520078717 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa140b1040 con 0x7faa280cf950 2024-04-26T20:57:20.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.001+0000 7faa24c00640 1 -- 172.21.15.138:0/3520078717 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa140bb070 con 0x7faa280cf950 2024-04-26T20:57:20.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.001+0000 7faa2fa00640 1 -- 172.21.15.138:0/3520078717 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa2815c3e0 con 0x7faa280cf950 2024-04-26T20:57:20.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.001+0000 7faa24c00640 1 -- 172.21.15.138:0/3520078717 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa140b5630 con 0x7faa280cf950 2024-04-26T20:57:20.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.001+0000 7faa2fa00640 1 -- 172.21.15.138:0/3520078717 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa2815c9a0 con 0x7faa280cf950 2024-04-26T20:57:20.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.005+0000 7faa2fa00640 1 -- 172.21.15.138:0/3520078717 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa28069430 con 0x7faa280cf950 2024-04-26T20:57:20.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.005+0000 7faa24c00640 1 -- 172.21.15.138:0/3520078717 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7faa140b57d0 con 0x7faa280cf950 2024-04-26T20:57:20.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.005+0000 7faa24c00640 1 --2- 172.21.15.138:0/3520078717 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7faa080683b0 0x7faa0806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:20.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.005+0000 7faa24c00640 1 -- 172.21.15.138:0/3520078717 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6619+0+0 (secure 0 0 0) 0x7faa14120830 con 0x7faa280cf950 2024-04-26T20:57:20.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.005+0000 7faa2d000640 1 --2- 172.21.15.138:0/3520078717 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7faa080683b0 0x7faa0806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:20.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.005+0000 7faa2d000640 1 --2- 172.21.15.138:0/3520078717 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7faa080683b0 0x7faa0806a870 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7faa18000f70 tx=0x7faa18007df0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:20.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.009+0000 7faa24c00640 1 -- 172.21.15.138:0/3520078717 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7faa140a9070 con 0x7faa280cf950 2024-04-26T20:57:20.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.165+0000 7faa2fa00640 1 -- 172.21.15.138:0/3520078717 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7faa28068690 con 0x7faa280cf950 2024-04-26T20:57:20.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.165+0000 7faa24c00640 1 -- 172.21.15.138:0/3520078717 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) ==== 104+0+11 (secure 0 0 0) 0x7faa14016070 con 0x7faa280cf950 2024-04-26T20:57:20.170 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 32 2024-04-26T20:57:20.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.169+0000 7faa2fa00640 1 -- 172.21.15.138:0/3520078717 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7faa080683b0 msgr2=0x7faa0806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:20.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.169+0000 7faa2fa00640 1 --2- 172.21.15.138:0/3520078717 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7faa080683b0 0x7faa0806a870 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7faa18000f70 tx=0x7faa18007df0 comp rx=0 tx=0).stop 2024-04-26T20:57:20.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.169+0000 7faa2fa00640 1 -- 172.21.15.138:0/3520078717 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faa280cf950 msgr2=0x7faa2806f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:20.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.169+0000 7faa2fa00640 1 --2- 172.21.15.138:0/3520078717 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faa280cf950 0x7faa2806f8d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7faa140af040 tx=0x7faa14019220 comp rx=0 tx=0).stop 2024-04-26T20:57:20.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.169+0000 7faa2fa00640 1 -- 172.21.15.138:0/3520078717 shutdown_connections 2024-04-26T20:57:20.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.169+0000 7faa2fa00640 1 --2- 172.21.15.138:0/3520078717 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7faa080683b0 0x7faa0806a870 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:20.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.169+0000 7faa2fa00640 1 --2- 172.21.15.138:0/3520078717 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faa2815efe0 0x7faa2806fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:20.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.169+0000 7faa2fa00640 1 --2- 172.21.15.138:0/3520078717 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faa280cf950 0x7faa2806f8d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:20.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.169+0000 7faa2fa00640 1 --2- 172.21.15.138:0/3520078717 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faa280cd6d0 0x7faa2806c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:20.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.169+0000 7faa2fa00640 1 -- 172.21.15.138:0/3520078717 >> 172.21.15.138:0/3520078717 conn(0x7faa280cdee0 msgr2=0x7faa280b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:20.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.169+0000 7faa2fa00640 1 -- 172.21.15.138:0/3520078717 shutdown_connections 2024-04-26T20:57:20.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.169+0000 7faa2fa00640 1 -- 172.21.15.138:0/3520078717 wait complete. 2024-04-26T20:57:20.191 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T20:57:20.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.329+0000 7f7feb400640 1 Processor -- start 2024-04-26T20:57:20.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.329+0000 7f7feb400640 1 -- start start 2024-04-26T20:57:20.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.329+0000 7f7feb400640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7fe4073d70 0x7f7fe4160040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:20.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.329+0000 7f7feb400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f7fe406f880 0x7f7fe40ce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:20.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.329+0000 7f7feb400640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fe406dee0 con 0x7f7fe415bdc0 2024-04-26T20:57:20.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.329+0000 7f7feb400640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f7fe415c1a0 con 0x7f7fe406f880 2024-04-26T20:57:20.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.329+0000 7f7feb400640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f7fe406e180 con 0x7f7fe4073d70 2024-04-26T20:57:20.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.329+0000 7f7fe9400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f7fe406f880 0x7f7fe40ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:20.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.329+0000 7f7fe9400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f7fe406f880 0x7f7fe40ce780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38400/0 (socket says 172.21.15.138:38400) 2024-04-26T20:57:20.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.329+0000 7f7fe9400640 1 -- 172.21.15.138:0/3368887628 learned_addr learned my addr 172.21.15.138:0/3368887628 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:20.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.329+0000 7f7fe8a00640 1 --1- 172.21.15.138:0/3368887628 >> v1:172.21.15.138:6789/0 conn(0x7f7fe415bdc0 0x7f7fe415f930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:42554/0 (socket says 172.21.15.138:42554) 2024-04-26T20:57:20.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.329+0000 7f7fe3e00640 1 --2- 172.21.15.138:0/3368887628 >> v2:172.21.15.143:3300/0 conn(0x7f7fe4073d70 0x7f7fe4160040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:20.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.329+0000 7f7fe9400640 1 -- 172.21.15.138:0/3368887628 >> v2:172.21.15.143:3300/0 conn(0x7f7fe4073d70 msgr2=0x7f7fe4160040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:20.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.329+0000 7f7fe9400640 1 --2- 172.21.15.138:0/3368887628 >> v2:172.21.15.143:3300/0 conn(0x7f7fe4073d70 0x7f7fe4160040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:20.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.329+0000 7f7fe9400640 1 -- 172.21.15.138:0/3368887628 >> v1:172.21.15.138:6789/0 conn(0x7f7fe415bdc0 legacy=0x7f7fe415f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:20.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.329+0000 7f7fe3400640 1 -- 172.21.15.138:0/3368887628 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2202298137 0 0) 0x7f7fe406dee0 con 0x7f7fe415bdc0 2024-04-26T20:57:20.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.329+0000 7f7fe9400640 1 -- 172.21.15.138:0/3368887628 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fe406e460 con 0x7f7fe406f880 2024-04-26T20:57:20.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.329+0000 7f7fe3e00640 1 --2- 172.21.15.138:0/3368887628 >> v2:172.21.15.143:3300/0 conn(0x7f7fe4073d70 0x7f7fe4160040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:57:20.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.333+0000 7f7fe9400640 1 --2- 172.21.15.138:0/3368887628 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7fe406f880 0x7f7fe40ce780 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4074b90 tx=0x7f7fdc01ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a758e6cbddcf922b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:20.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.333+0000 7f7fe3400640 1 -- 172.21.15.138:0/3368887628 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc0b4070 con 0x7f7fe406f880 2024-04-26T20:57:20.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.333+0000 7f7fe3400640 1 -- 172.21.15.138:0/3368887628 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fdc0a7a90 con 0x7f7fe406f880 2024-04-26T20:57:20.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.333+0000 7f7fe3400640 1 -- 172.21.15.138:0/3368887628 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc0a7e60 con 0x7f7fe406f880 2024-04-26T20:57:20.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.333+0000 7f7feb400640 1 -- 172.21.15.138:0/3368887628 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7fe406f880 msgr2=0x7f7fe40ce780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:20.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.333+0000 7f7feb400640 1 --2- 172.21.15.138:0/3368887628 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7fe406f880 0x7f7fe40ce780 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4074b90 tx=0x7f7fdc01ead0 comp rx=0 tx=0).stop 2024-04-26T20:57:20.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.333+0000 7f7feb400640 1 -- 172.21.15.138:0/3368887628 shutdown_connections 2024-04-26T20:57:20.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.333+0000 7f7feb400640 1 --2- 172.21.15.138:0/3368887628 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7fe406f880 0x7f7fe40ce780 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:20.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.333+0000 7f7feb400640 1 --2- 172.21.15.138:0/3368887628 >> v2:172.21.15.143:3300/0 conn(0x7f7fe4073d70 0x7f7fe4160040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:20.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.333+0000 7f7feb400640 1 -- 172.21.15.138:0/3368887628 >> 172.21.15.138:0/3368887628 conn(0x7f7fe40d0bb0 msgr2=0x7f7fe40d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:20.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.333+0000 7f7feb400640 1 -- 172.21.15.138:0/3368887628 shutdown_connections 2024-04-26T20:57:20.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.333+0000 7f7feb400640 1 -- 172.21.15.138:0/3368887628 wait complete. 2024-04-26T20:57:20.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.337+0000 7f7feb400640 1 Processor -- start 2024-04-26T20:57:20.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.337+0000 7f7feb400640 1 -- start start 2024-04-26T20:57:20.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.337+0000 7f7feb400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7fe406f880 0x7f7fe4157350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:20.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.337+0000 7f7feb400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7fe4073d70 0x7f7fe415ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:20.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.337+0000 7f7feb400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7fe415bdc0 0x7f7fe40c4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:20.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.337+0000 7f7feb400640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe406e770 con 0x7f7fe4073d70 2024-04-26T20:57:20.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.337+0000 7f7feb400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe4160790 con 0x7f7fe415bdc0 2024-04-26T20:57:20.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.337+0000 7f7feb400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f7fe406e8f0 con 0x7f7fe406f880 2024-04-26T20:57:20.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.337+0000 7f7fe3e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7fe4073d70 0x7f7fe415ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:20.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.337+0000 7f7fe3e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7fe4073d70 0x7f7fe415ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38406/0 (socket says 172.21.15.138:38406) 2024-04-26T20:57:20.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.337+0000 7f7fe3e00640 1 -- 172.21.15.138:0/4278270539 learned_addr learned my addr 172.21.15.138:0/4278270539 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:20.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.337+0000 7f7fe8a00640 1 --2- 172.21.15.138:0/4278270539 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7fe406f880 0x7f7fe4157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:20.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.337+0000 7f7fe9400640 1 --2- 172.21.15.138:0/4278270539 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7fe415bdc0 0x7f7fe40c4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:20.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.337+0000 7f7fe3e00640 1 -- 172.21.15.138:0/4278270539 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7fe406f880 msgr2=0x7f7fe4157350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:20.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.337+0000 7f7fe3e00640 1 --2- 172.21.15.138:0/4278270539 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7fe406f880 0x7f7fe4157350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:20.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.337+0000 7f7fe3e00640 1 -- 172.21.15.138:0/4278270539 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7fe415bdc0 msgr2=0x7f7fe40c4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:20.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.337+0000 7f7fe3e00640 1 --2- 172.21.15.138:0/4278270539 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7fe415bdc0 0x7f7fe40c4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:20.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.337+0000 7f7fe3e00640 1 -- 172.21.15.138:0/4278270539 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fe4157890 con 0x7f7fe4073d70 2024-04-26T20:57:20.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.337+0000 7f7fe3e00640 1 --2- 172.21.15.138:0/4278270539 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7fe4073d70 0x7f7fe415ab80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7fd000c7f0 tx=0x7f7fd000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:20.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.337+0000 7f7fe0c00640 1 -- 172.21.15.138:0/4278270539 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd0015070 con 0x7f7fe4073d70 2024-04-26T20:57:20.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.337+0000 7f7fe0c00640 1 -- 172.21.15.138:0/4278270539 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fd0007a30 con 0x7f7fe4073d70 2024-04-26T20:57:20.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.337+0000 7f7fe0c00640 1 -- 172.21.15.138:0/4278270539 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd0007e00 con 0x7f7fe4073d70 2024-04-26T20:57:20.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.337+0000 7f7feb400640 1 -- 172.21.15.138:0/4278270539 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fe41562b0 con 0x7f7fe4073d70 2024-04-26T20:57:20.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.337+0000 7f7feb400640 1 -- 172.21.15.138:0/4278270539 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fe4156870 con 0x7f7fe4073d70 2024-04-26T20:57:20.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.341+0000 7f7feb400640 1 -- 172.21.15.138:0/4278270539 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fe4069430 con 0x7f7fe4073d70 2024-04-26T20:57:20.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.341+0000 7f7fe0c00640 1 -- 172.21.15.138:0/4278270539 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7fd0018070 con 0x7f7fe4073d70 2024-04-26T20:57:20.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.341+0000 7f7fe0c00640 1 --2- 172.21.15.138:0/4278270539 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7fc4068380 0x7f7fc406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:20.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.341+0000 7f7fe0c00640 1 -- 172.21.15.138:0/4278270539 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6619+0+0 (secure 0 0 0) 0x7f7fd0086c50 con 0x7f7fe4073d70 2024-04-26T20:57:20.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.341+0000 7f7fe8a00640 1 --2- 172.21.15.138:0/4278270539 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7fc4068380 0x7f7fc406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:20.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.341+0000 7f7fe8a00640 1 --2- 172.21.15.138:0/4278270539 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7fc4068380 0x7f7fc406a840 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7fd40012f0 tx=0x7f7fd4001690 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:20.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.345+0000 7f7fe0c00640 1 -- 172.21.15.138:0/4278270539 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7fd0056790 con 0x7f7fe4073d70 2024-04-26T20:57:20.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.505+0000 7f7feb400640 1 -- 172.21.15.138:0/4278270539 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f7fe40d1270 con 0x7f7fe4073d70 2024-04-26T20:57:20.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.505+0000 7f7fe0c00640 1 -- 172.21.15.138:0/4278270539 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7f7fd005aa90 con 0x7f7fe4073d70 2024-04-26T20:57:20.511 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 64 2024-04-26T20:57:20.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.509+0000 7f7feb400640 1 -- 172.21.15.138:0/4278270539 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7fc4068380 msgr2=0x7f7fc406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:20.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.509+0000 7f7feb400640 1 --2- 172.21.15.138:0/4278270539 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7fc4068380 0x7f7fc406a840 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7fd40012f0 tx=0x7f7fd4001690 comp rx=0 tx=0).stop 2024-04-26T20:57:20.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.509+0000 7f7feb400640 1 -- 172.21.15.138:0/4278270539 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7fe4073d70 msgr2=0x7f7fe415ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:20.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.509+0000 7f7feb400640 1 --2- 172.21.15.138:0/4278270539 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7fe4073d70 0x7f7fe415ab80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7fd000c7f0 tx=0x7f7fd000ccb0 comp rx=0 tx=0).stop 2024-04-26T20:57:20.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.509+0000 7f7feb400640 1 -- 172.21.15.138:0/4278270539 shutdown_connections 2024-04-26T20:57:20.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.509+0000 7f7feb400640 1 --2- 172.21.15.138:0/4278270539 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7fc4068380 0x7f7fc406a840 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:20.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.509+0000 7f7feb400640 1 --2- 172.21.15.138:0/4278270539 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7fe415bdc0 0x7f7fe40c4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:20.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.509+0000 7f7feb400640 1 --2- 172.21.15.138:0/4278270539 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7fe4073d70 0x7f7fe415ab80 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:20.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.509+0000 7f7feb400640 1 --2- 172.21.15.138:0/4278270539 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7fe406f880 0x7f7fe4157350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:20.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.509+0000 7f7feb400640 1 -- 172.21.15.138:0/4278270539 >> 172.21.15.138:0/4278270539 conn(0x7f7fe40d0bb0 msgr2=0x7f7fe40ca560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:20.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.509+0000 7f7feb400640 1 -- 172.21.15.138:0/4278270539 shutdown_connections 2024-04-26T20:57:20.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.509+0000 7f7feb400640 1 -- 172.21.15.138:0/4278270539 wait complete. 2024-04-26T20:57:20.532 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T20:57:20.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.665+0000 7f2562600640 1 Processor -- start 2024-04-26T20:57:20.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.665+0000 7f2562600640 1 -- start start 2024-04-26T20:57:20.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.669+0000 7f2562600640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f255c15e180 0x7f255c0cb200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:20.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.669+0000 7f2562600640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f255c0cb740 0x7f255c0b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:20.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.669+0000 7f2562600640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f255c0cd210 con 0x7f255c15aa60 2024-04-26T20:57:20.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.669+0000 7f2562600640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f255c15d6a0 con 0x7f255c0cb740 2024-04-26T20:57:20.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.669+0000 7f2562600640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f255c15d980 con 0x7f255c15e180 2024-04-26T20:57:20.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.669+0000 7f255be00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f255c0cb740 0x7f255c0b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:20.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.669+0000 7f255be00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f255c0cb740 0x7f255c0b5aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38420/0 (socket says 172.21.15.138:38420) 2024-04-26T20:57:20.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.669+0000 7f255be00640 1 -- 172.21.15.138:0/923052629 learned_addr learned my addr 172.21.15.138:0/923052629 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:20.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.669+0000 7f255aa00640 1 --2- 172.21.15.138:0/923052629 >> v2:172.21.15.143:3300/0 conn(0x7f255c15e180 0x7f255c0cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:20.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.669+0000 7f255be00640 1 -- 172.21.15.138:0/923052629 >> v2:172.21.15.143:3300/0 conn(0x7f255c15e180 msgr2=0x7f255c0cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:20.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.669+0000 7f255be00640 1 --2- 172.21.15.138:0/923052629 >> v2:172.21.15.143:3300/0 conn(0x7f255c15e180 0x7f255c0cb200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:20.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.669+0000 7f255be00640 1 -- 172.21.15.138:0/923052629 >> v1:172.21.15.143:6789/0 conn(0x7f255c15aa60 legacy=0x7f255c0cc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:20.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.669+0000 7f255be00640 1 -- 172.21.15.138:0/923052629 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f255c15dc60 con 0x7f255c0cb740 2024-04-26T20:57:20.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.673+0000 7f255be00640 1 --2- 172.21.15.138:0/923052629 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f255c0cb740 0x7f255c0b5aa0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f255c074b90 tx=0x7f255401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=300a9c43510a363 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:20.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.673+0000 7f255a000640 1 -- 172.21.15.138:0/923052629 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25540b0070 con 0x7f255c0cb740 2024-04-26T20:57:20.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.673+0000 7f255a000640 1 -- 172.21.15.138:0/923052629 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25540ab600 con 0x7f255c0cb740 2024-04-26T20:57:20.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.673+0000 7f255a000640 1 -- 172.21.15.138:0/923052629 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25540ab9d0 con 0x7f255c0cb740 2024-04-26T20:57:20.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.673+0000 7f2562600640 1 -- 172.21.15.138:0/923052629 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f255c0cb740 msgr2=0x7f255c0b5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:20.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.673+0000 7f2562600640 1 --2- 172.21.15.138:0/923052629 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f255c0cb740 0x7f255c0b5aa0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f255c074b90 tx=0x7f255401c4e0 comp rx=0 tx=0).stop 2024-04-26T20:57:20.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.673+0000 7f2562600640 1 -- 172.21.15.138:0/923052629 shutdown_connections 2024-04-26T20:57:20.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.673+0000 7f2562600640 1 --2- 172.21.15.138:0/923052629 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f255c0cb740 0x7f255c0b5aa0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:20.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.673+0000 7f2562600640 1 --2- 172.21.15.138:0/923052629 >> v2:172.21.15.143:3300/0 conn(0x7f255c15e180 0x7f255c0cb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:20.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.673+0000 7f2562600640 1 -- 172.21.15.138:0/923052629 >> 172.21.15.138:0/923052629 conn(0x7f255c0d0bb0 msgr2=0x7f255c0d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:20.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.673+0000 7f2562600640 1 -- 172.21.15.138:0/923052629 shutdown_connections 2024-04-26T20:57:20.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.673+0000 7f2562600640 1 -- 172.21.15.138:0/923052629 wait complete. 2024-04-26T20:57:20.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.673+0000 7f2562600640 1 Processor -- start 2024-04-26T20:57:20.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.673+0000 7f2562600640 1 -- start start 2024-04-26T20:57:20.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.677+0000 7f2562600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f255c0cb740 0x7f255c15fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:20.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.677+0000 7f2562600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f255c15aa60 0x7f255c0b0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:20.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.677+0000 7f2562600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f255c15e180 0x7f255c156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:20.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.677+0000 7f2562600640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f255c06dee0 con 0x7f255c15e180 2024-04-26T20:57:20.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.677+0000 7f2562600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f255c072240 con 0x7f255c0cb740 2024-04-26T20:57:20.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.677+0000 7f2562600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f255c06e060 con 0x7f255c15aa60 2024-04-26T20:57:20.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.677+0000 7f255be00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f255c15e180 0x7f255c156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:20.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.677+0000 7f255be00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f255c15e180 0x7f255c156bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38432/0 (socket says 172.21.15.138:38432) 2024-04-26T20:57:20.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.677+0000 7f255be00640 1 -- 172.21.15.138:0/878319306 learned_addr learned my addr 172.21.15.138:0/878319306 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:20.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.677+0000 7f255b400640 1 --2- 172.21.15.138:0/878319306 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f255c0cb740 0x7f255c15fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:20.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.677+0000 7f255aa00640 1 --2- 172.21.15.138:0/878319306 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f255c15aa60 0x7f255c0b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:20.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.677+0000 7f255be00640 1 -- 172.21.15.138:0/878319306 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f255c15aa60 msgr2=0x7f255c0b0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:20.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.677+0000 7f255be00640 1 --2- 172.21.15.138:0/878319306 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f255c15aa60 0x7f255c0b0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:20.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.677+0000 7f255be00640 1 -- 172.21.15.138:0/878319306 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f255c0cb740 msgr2=0x7f255c15fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:20.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.677+0000 7f255be00640 1 --2- 172.21.15.138:0/878319306 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f255c0cb740 0x7f255c15fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:20.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.677+0000 7f255be00640 1 -- 172.21.15.138:0/878319306 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f255c15f730 con 0x7f255c15e180 2024-04-26T20:57:20.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.677+0000 7f255aa00640 1 --2- 172.21.15.138:0/878319306 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f255c15aa60 0x7f255c0b0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:20.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.677+0000 7f255be00640 1 --2- 172.21.15.138:0/878319306 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f255c15e180 0x7f255c156bc0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f255401a110 tx=0x7f2554019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:20.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.677+0000 7f2553400640 1 -- 172.21.15.138:0/878319306 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25540ba070 con 0x7f255c15e180 2024-04-26T20:57:20.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.677+0000 7f2553400640 1 -- 172.21.15.138:0/878319306 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25540b4420 con 0x7f255c15e180 2024-04-26T20:57:20.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.677+0000 7f2553400640 1 -- 172.21.15.138:0/878319306 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25540b0040 con 0x7f255c15e180 2024-04-26T20:57:20.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.677+0000 7f2562600640 1 -- 172.21.15.138:0/878319306 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f255c0b3990 con 0x7f255c15e180 2024-04-26T20:57:20.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.677+0000 7f2562600640 1 -- 172.21.15.138:0/878319306 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f255c0d03d0 con 0x7f255c15e180 2024-04-26T20:57:20.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.677+0000 7f2562600640 1 -- 172.21.15.138:0/878319306 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f255c069430 con 0x7f255c15e180 2024-04-26T20:57:20.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.677+0000 7f2553400640 1 -- 172.21.15.138:0/878319306 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f25540bd070 con 0x7f255c15e180 2024-04-26T20:57:20.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.681+0000 7f2553400640 1 --2- 172.21.15.138:0/878319306 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f253c068380 0x7f253c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:20.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.681+0000 7f2553400640 1 -- 172.21.15.138:0/878319306 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7f2554120130 con 0x7f255c15e180 2024-04-26T20:57:20.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.681+0000 7f255b400640 1 --2- 172.21.15.138:0/878319306 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f253c068380 0x7f253c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:20.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.681+0000 7f255b400640 1 --2- 172.21.15.138:0/878319306 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f253c068380 0x7f253c06a840 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f255c0b5d40 tx=0x7f254c003dd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:20.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.685+0000 7f2553400640 1 -- 172.21.15.138:0/878319306 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f25540160d0 con 0x7f255c15e180 2024-04-26T20:57:20.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.841+0000 7f2562600640 1 -- 172.21.15.138:0/878319306 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f255c160400 con 0x7f255c15e180 2024-04-26T20:57:20.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.841+0000 7f2553400640 1 -- 172.21.15.138:0/878319306 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7f25540efc70 con 0x7f255c15e180 2024-04-26T20:57:20.845 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 32 2024-04-26T20:57:20.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.841+0000 7f2562600640 1 -- 172.21.15.138:0/878319306 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f253c068380 msgr2=0x7f253c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:20.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.841+0000 7f2562600640 1 --2- 172.21.15.138:0/878319306 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f253c068380 0x7f253c06a840 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f255c0b5d40 tx=0x7f254c003dd0 comp rx=0 tx=0).stop 2024-04-26T20:57:20.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.841+0000 7f2562600640 1 -- 172.21.15.138:0/878319306 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f255c15e180 msgr2=0x7f255c156bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:20.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.841+0000 7f2562600640 1 --2- 172.21.15.138:0/878319306 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f255c15e180 0x7f255c156bc0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f255401a110 tx=0x7f2554019280 comp rx=0 tx=0).stop 2024-04-26T20:57:20.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.841+0000 7f2562600640 1 -- 172.21.15.138:0/878319306 shutdown_connections 2024-04-26T20:57:20.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.841+0000 7f2562600640 1 --2- 172.21.15.138:0/878319306 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f253c068380 0x7f253c06a840 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:20.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.841+0000 7f2562600640 1 --2- 172.21.15.138:0/878319306 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f255c15e180 0x7f255c156bc0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:20.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.841+0000 7f2562600640 1 --2- 172.21.15.138:0/878319306 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f255c15aa60 0x7f255c0b0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:20.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.841+0000 7f2562600640 1 --2- 172.21.15.138:0/878319306 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f255c0cb740 0x7f255c15fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:20.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.841+0000 7f2562600640 1 -- 172.21.15.138:0/878319306 >> 172.21.15.138:0/878319306 conn(0x7f255c0d0bb0 msgr2=0x7f255c0cbec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:20.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.841+0000 7f2562600640 1 -- 172.21.15.138:0/878319306 shutdown_connections 2024-04-26T20:57:20.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.841+0000 7f2562600640 1 -- 172.21.15.138:0/878319306 wait complete. 2024-04-26T20:57:20.867 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:57:21.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.997+0000 7ff24a800640 1 Processor -- start 2024-04-26T20:57:21.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:20.997+0000 7ff24a800640 1 -- start start 2024-04-26T20:57:21.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.001+0000 7ff24a800640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff2440cba90 0x7ff24415bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:21.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.001+0000 7ff24a800640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff244072130 con 0x7ff24415c0a0 2024-04-26T20:57:21.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.001+0000 7ff24a800640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff24415cae0 con 0x7ff244159250 2024-04-26T20:57:21.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.001+0000 7ff24a800640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7ff24415f4e0 con 0x7ff2440cba90 2024-04-26T20:57:21.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.001+0000 7ff243e00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7ff24415c0a0 0x7ff244072bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:42566/0 (socket says 172.21.15.138:42566) 2024-04-26T20:57:21.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.001+0000 7ff243e00640 1 -- 172.21.15.138:0/1451510631 learned_addr learned my addr 172.21.15.138:0/1451510631 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:21.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.001+0000 7ff23aa00640 1 --2- 172.21.15.138:0/1451510631 >> v2:172.21.15.143:3300/0 conn(0x7ff2440cba90 0x7ff24415bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:21.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.001+0000 7ff242a00640 1 -- 172.21.15.138:0/1451510631 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3355009166 0 0) 0x7ff244072130 con 0x7ff24415c0a0 2024-04-26T20:57:21.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.001+0000 7ff242a00640 1 -- 172.21.15.138:0/1451510631 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff228004640 con 0x7ff24415c0a0 2024-04-26T20:57:21.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.001+0000 7ff242a00640 1 -- 172.21.15.138:0/1451510631 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1356650267 0 0) 0x7ff24415cae0 con 0x7ff244159250 2024-04-26T20:57:21.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.001+0000 7ff242a00640 1 -- 172.21.15.138:0/1451510631 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff244072130 con 0x7ff244159250 2024-04-26T20:57:21.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.001+0000 7ff23aa00640 1 -- 172.21.15.138:0/1451510631 >> v1:172.21.15.143:6789/0 conn(0x7ff244159250 legacy=0x7ff2440cb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:21.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.001+0000 7ff23aa00640 1 -- 172.21.15.138:0/1451510631 >> v1:172.21.15.138:6789/0 conn(0x7ff24415c0a0 legacy=0x7ff244072bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:21.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.001+0000 7ff23aa00640 1 -- 172.21.15.138:0/1451510631 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff24415c800 con 0x7ff2440cba90 2024-04-26T20:57:21.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.005+0000 7ff23aa00640 1 --2- 172.21.15.138:0/1451510631 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff2440cba90 0x7ff24415bb60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff22c0097c0 tx=0x7ff22c01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc252e8e099580f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:21.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.005+0000 7ff242a00640 1 -- 172.21.15.138:0/1451510631 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff22c0b0070 con 0x7ff2440cba90 2024-04-26T20:57:21.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.005+0000 7ff242a00640 1 -- 172.21.15.138:0/1451510631 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff22c0ab600 con 0x7ff2440cba90 2024-04-26T20:57:21.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.005+0000 7ff242a00640 1 -- 172.21.15.138:0/1451510631 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff22c0ab9b0 con 0x7ff2440cba90 2024-04-26T20:57:21.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.005+0000 7ff24a800640 1 -- 172.21.15.138:0/1451510631 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff2440cba90 msgr2=0x7ff24415bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:21.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.005+0000 7ff24a800640 1 --2- 172.21.15.138:0/1451510631 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff2440cba90 0x7ff24415bb60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff22c0097c0 tx=0x7ff22c01c4a0 comp rx=0 tx=0).stop 2024-04-26T20:57:21.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.005+0000 7ff24a800640 1 -- 172.21.15.138:0/1451510631 shutdown_connections 2024-04-26T20:57:21.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.005+0000 7ff24a800640 1 --2- 172.21.15.138:0/1451510631 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff2440cba90 0x7ff24415bb60 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:21.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.005+0000 7ff24a800640 1 -- 172.21.15.138:0/1451510631 >> 172.21.15.138:0/1451510631 conn(0x7ff2440d0b20 msgr2=0x7ff2440d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:21.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.005+0000 7ff24a800640 1 -- 172.21.15.138:0/1451510631 shutdown_connections 2024-04-26T20:57:21.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.005+0000 7ff24a800640 1 -- 172.21.15.138:0/1451510631 wait complete. 2024-04-26T20:57:21.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.005+0000 7ff24a800640 1 Processor -- start 2024-04-26T20:57:21.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.005+0000 7ff24a800640 1 -- start start 2024-04-26T20:57:21.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.005+0000 7ff24a800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff2440cba90 0x7ff2440cff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:21.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.005+0000 7ff24a800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff244159250 0x7ff244149f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:21.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.005+0000 7ff24a800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff24415c0a0 0x7ff244148880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:21.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.005+0000 7ff24a800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff244073670 con 0x7ff244159250 2024-04-26T20:57:21.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.005+0000 7ff24a800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ff2440734f0 con 0x7ff24415c0a0 2024-04-26T20:57:21.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.005+0000 7ff24a800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ff2440737f0 con 0x7ff2440cba90 2024-04-26T20:57:21.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.005+0000 7ff23aa00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff244159250 0x7ff244149f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:21.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.005+0000 7ff23aa00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff244159250 0x7ff244149f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38442/0 (socket says 172.21.15.138:38442) 2024-04-26T20:57:21.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.005+0000 7ff23aa00640 1 -- 172.21.15.138:0/490151074 learned_addr learned my addr 172.21.15.138:0/490151074 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:21.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.009+0000 7ff243e00640 1 --2- 172.21.15.138:0/490151074 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff24415c0a0 0x7ff244148880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:21.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.009+0000 7ff243400640 1 --2- 172.21.15.138:0/490151074 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff2440cba90 0x7ff2440cff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:21.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.009+0000 7ff23aa00640 1 -- 172.21.15.138:0/490151074 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff2440cba90 msgr2=0x7ff2440cff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:21.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.009+0000 7ff23aa00640 1 --2- 172.21.15.138:0/490151074 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff2440cba90 0x7ff2440cff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:21.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.009+0000 7ff23aa00640 1 -- 172.21.15.138:0/490151074 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff24415c0a0 msgr2=0x7ff244148880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:21.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.009+0000 7ff23aa00640 1 --2- 172.21.15.138:0/490151074 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff24415c0a0 0x7ff244148880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:21.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.009+0000 7ff23aa00640 1 -- 172.21.15.138:0/490151074 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff244153d10 con 0x7ff244159250 2024-04-26T20:57:21.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.009+0000 7ff243400640 1 --2- 172.21.15.138:0/490151074 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff2440cba90 0x7ff2440cff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:57:21.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.009+0000 7ff243e00640 1 --2- 172.21.15.138:0/490151074 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff24415c0a0 0x7ff244148880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:57:21.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.009+0000 7ff23aa00640 1 --2- 172.21.15.138:0/490151074 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff244159250 0x7ff244149f50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff22c0ae040 tx=0x7ff22c019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:21.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.009+0000 7ff23be00640 1 -- 172.21.15.138:0/490151074 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff22c0b0040 con 0x7ff244159250 2024-04-26T20:57:21.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.009+0000 7ff23be00640 1 -- 172.21.15.138:0/490151074 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff22c0ab400 con 0x7ff244159250 2024-04-26T20:57:21.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.009+0000 7ff23be00640 1 -- 172.21.15.138:0/490151074 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff22c0b4630 con 0x7ff244159250 2024-04-26T20:57:21.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.009+0000 7ff24a800640 1 -- 172.21.15.138:0/490151074 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff244149190 con 0x7ff244159250 2024-04-26T20:57:21.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.009+0000 7ff24a800640 1 -- 172.21.15.138:0/490151074 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff244149750 con 0x7ff244159250 2024-04-26T20:57:21.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.009+0000 7ff24a800640 1 -- 172.21.15.138:0/490151074 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff244069510 con 0x7ff244159250 2024-04-26T20:57:21.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.009+0000 7ff23be00640 1 -- 172.21.15.138:0/490151074 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff22c0bb030 con 0x7ff244159250 2024-04-26T20:57:21.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.009+0000 7ff23be00640 1 --2- 172.21.15.138:0/490151074 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff2200683b0 0x7ff22006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:21.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.009+0000 7ff23be00640 1 -- 172.21.15.138:0/490151074 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7ff22c120110 con 0x7ff244159250 2024-04-26T20:57:21.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.009+0000 7ff243400640 1 --2- 172.21.15.138:0/490151074 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff2200683b0 0x7ff22006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:21.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.013+0000 7ff243400640 1 --2- 172.21.15.138:0/490151074 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff2200683b0 0x7ff22006a870 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff2340011f0 tx=0x7ff234009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:21.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.013+0000 7ff23be00640 1 -- 172.21.15.138:0/490151074 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff22c0c2060 con 0x7ff244159250 2024-04-26T20:57:21.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.177+0000 7ff24a800640 1 -- 172.21.15.138:0/490151074 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff2440741a0 con 0x7ff244159250 2024-04-26T20:57:21.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.177+0000 7ff23be00640 1 -- 172.21.15.138:0/490151074 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18719 (secure 0 0 0) 0x7ff22c016090 con 0x7ff244159250 2024-04-26T20:57:21.181 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:57:21.181 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":29,"fsid":"c22b4730-12cc-4558-8535-b965384398c0","created":"2024-04-26T20:56:14.182475+0000","modified":"2024-04-26T20:57:20.395184+0000","last_up_change":"2024-04-26T20:56:26.013243+0000","last_in_change":"2024-04-26T20:56:16.714055+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:56:27.265834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:56:37.394398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:56:38.544369+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:56:42.240243+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3f9a2e34-3199-466f-a6cf-57927318121e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6801","nonce":3534772245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6803","nonce":3534772245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6807","nonce":3534772245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6805","nonce":3534772245}]},"public_addr":"172.21.15.138:6801/3534772245","cluster_addr":"172.21.15.138:6803/3534772245","heartbeat_back_addr":"172.21.15.138:6807/3534772245","heartbeat_front_addr":"172.21.15.138:6805/3534772245","state":["exists","up"]},{"osd":1,"uuid":"e881fcf6-3248-4696-a2ef-95d206d77712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6817","nonce":1427635773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6819","nonce":1427635773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6823","nonce":1427635773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6821","nonce":1427635773}]},"public_addr":"172.21.15.138:6817/1427635773","cluster_addr":"172.21.15.138:6819/1427635773","heartbeat_back_addr":"172.21.15.138:6823/1427635773","heartbeat_front_addr":"172.21.15.138:6821/1427635773","state":["exists","up"]},{"osd":2,"uuid":"f7d1db33-7672-4699-ae47-9f1e0a8e4222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6809","nonce":4273721573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6811","nonce":4273721573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6815","nonce":4273721573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6813","nonce":4273721573}]},"public_addr":"172.21.15.138:6809/4273721573","cluster_addr":"172.21.15.138:6811/4273721573","heartbeat_back_addr":"172.21.15.138:6815/4273721573","heartbeat_front_addr":"172.21.15.138:6813/4273721573","state":["exists","up"]},{"osd":3,"uuid":"2f4e0a9a-b8f6-4468-844a-a4501cd85054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6825","nonce":3098242154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6827","nonce":3098242154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6831","nonce":3098242154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6829","nonce":3098242154}]},"public_addr":"172.21.15.138:6825/3098242154","cluster_addr":"172.21.15.138:6827/3098242154","heartbeat_back_addr":"172.21.15.138:6831/3098242154","heartbeat_front_addr":"172.21.15.138:6829/3098242154","state":["exists","up"]},{"osd":4,"uuid":"c85df99b-3624-410e-866b-86830af2cfe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6801","nonce":2942056312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6803","nonce":2942056312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6807","nonce":2942056312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6805","nonce":2942056312}]},"public_addr":"172.21.15.143:6801/2942056312","cluster_addr":"172.21.15.143:6803/2942056312","heartbeat_back_addr":"172.21.15.143:6807/2942056312","heartbeat_front_addr":"172.21.15.143:6805/2942056312","state":["exists","up"]},{"osd":5,"uuid":"9af1efb5-c416-4808-b5ef-de0679ab9705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6809","nonce":1910222887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6811","nonce":1910222887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6815","nonce":1910222887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6813","nonce":1910222887}]},"public_addr":"172.21.15.143:6809/1910222887","cluster_addr":"172.21.15.143:6811/1910222887","heartbeat_back_addr":"172.21.15.143:6815/1910222887","heartbeat_front_addr":"172.21.15.143:6813/1910222887","state":["exists","up"]},{"osd":6,"uuid":"d7138615-8838-45ff-9072-2fd0683362f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6817","nonce":1082239825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6819","nonce":1082239825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6823","nonce":1082239825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6821","nonce":1082239825}]},"public_addr":"172.21.15.143:6817/1082239825","cluster_addr":"172.21.15.143:6819/1082239825","heartbeat_back_addr":"172.21.15.143:6823/1082239825","heartbeat_front_addr":"172.21.15.143:6821/1082239825","state":["exists","up"]},{"osd":7,"uuid":"0c27172b-35c4-49ec-ba0b-0137b8ff0010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6825","nonce":3295508495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6827","nonce":3295508495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6831","nonce":3295508495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6829","nonce":3295508495}]},"public_addr":"172.21.15.143:6825/3295508495","cluster_addr":"172.21.15.143:6827/3295508495","heartbeat_back_addr":"172.21.15.143:6831/3295508495","heartbeat_front_addr":"172.21.15.143:6829/3295508495","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.326627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.396119+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.433915+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.414179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.216947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.329272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.503073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.436382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.39","mappings":[{"from":0,"to":7}]},{"pgid":"4.6","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:57:21.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.177+0000 7ff24a800640 1 -- 172.21.15.138:0/490151074 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff2200683b0 msgr2=0x7ff22006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:21.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.177+0000 7ff24a800640 1 --2- 172.21.15.138:0/490151074 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff2200683b0 0x7ff22006a870 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff2340011f0 tx=0x7ff234009040 comp rx=0 tx=0).stop 2024-04-26T20:57:21.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.177+0000 7ff24a800640 1 -- 172.21.15.138:0/490151074 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff244159250 msgr2=0x7ff244149f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:21.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.177+0000 7ff24a800640 1 --2- 172.21.15.138:0/490151074 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff244159250 0x7ff244149f50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff22c0ae040 tx=0x7ff22c019240 comp rx=0 tx=0).stop 2024-04-26T20:57:21.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.177+0000 7ff24a800640 1 -- 172.21.15.138:0/490151074 shutdown_connections 2024-04-26T20:57:21.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.177+0000 7ff24a800640 1 --2- 172.21.15.138:0/490151074 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff2200683b0 0x7ff22006a870 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:21.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.177+0000 7ff24a800640 1 --2- 172.21.15.138:0/490151074 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff24415c0a0 0x7ff244148880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:21.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.177+0000 7ff24a800640 1 --2- 172.21.15.138:0/490151074 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff244159250 0x7ff244149f50 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:21.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.177+0000 7ff24a800640 1 --2- 172.21.15.138:0/490151074 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff2440cba90 0x7ff2440cff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:21.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.177+0000 7ff24a800640 1 -- 172.21.15.138:0/490151074 >> 172.21.15.138:0/490151074 conn(0x7ff2440d0b20 msgr2=0x7ff244072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:21.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.177+0000 7ff24a800640 1 -- 172.21.15.138:0/490151074 shutdown_connections 2024-04-26T20:57:21.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.177+0000 7ff24a800640 1 -- 172.21.15.138:0/490151074 wait complete. 2024-04-26T20:57:21.203 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:56:27.265834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T20:56:37.394398+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T20:56:38.544369+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T20:56:42.240243+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T20:57:21.203 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T20:57:21.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.337+0000 7f7abfe00640 1 Processor -- start 2024-04-26T20:57:21.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.337+0000 7f7abfe00640 1 -- start start 2024-04-26T20:57:21.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.341+0000 7f7abfe00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f7ac015f600 0x7f7ac006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:21.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.341+0000 7f7abfe00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ac00d1e50 con 0x7f7ac015f220 2024-04-26T20:57:21.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.341+0000 7f7abfe00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ac00d2130 con 0x7f7ac006e4a0 2024-04-26T20:57:21.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.341+0000 7f7abfe00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f7ac006dbf0 con 0x7f7ac015f600 2024-04-26T20:57:21.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.341+0000 7f7ab6000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f7ac015f600 0x7f7ac006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:21.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.341+0000 7f7ab6000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f7ac015f600 0x7f7ac006d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38444/0 (socket says 172.21.15.138:38444) 2024-04-26T20:57:21.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.341+0000 7f7ab6000640 1 -- 172.21.15.138:0/1989775662 learned_addr learned my addr 172.21.15.138:0/1989775662 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:21.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.341+0000 7f7ab6000640 1 -- 172.21.15.138:0/1989775662 >> v1:172.21.15.143:6789/0 conn(0x7f7ac006e4a0 legacy=0x7f7ac00cdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:21.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.341+0000 7f7ab6000640 1 -- 172.21.15.138:0/1989775662 >> v1:172.21.15.138:6789/0 conn(0x7f7ac015f220 legacy=0x7f7ac006dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:21.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.341+0000 7f7ab6000640 1 -- 172.21.15.138:0/1989775662 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ac00cd530 con 0x7f7ac015f600 2024-04-26T20:57:21.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.341+0000 7f7ab6000640 1 --2- 172.21.15.138:0/1989775662 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ac015f600 0x7f7ac006d6b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7aa8009870 tx=0x7f7aa801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b94ed791e91cd179 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:21.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.341+0000 7f7abe000640 1 -- 172.21.15.138:0/1989775662 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa80b0070 con 0x7f7ac015f600 2024-04-26T20:57:21.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.345+0000 7f7abe000640 1 -- 172.21.15.138:0/1989775662 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7aa80ab600 con 0x7f7ac015f600 2024-04-26T20:57:21.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.345+0000 7f7abe000640 1 -- 172.21.15.138:0/1989775662 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa80ab9d0 con 0x7f7ac015f600 2024-04-26T20:57:21.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.345+0000 7f7abfe00640 1 -- 172.21.15.138:0/1989775662 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ac015f600 msgr2=0x7f7ac006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:21.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.345+0000 7f7abfe00640 1 --2- 172.21.15.138:0/1989775662 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ac015f600 0x7f7ac006d6b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7aa8009870 tx=0x7f7aa801c520 comp rx=0 tx=0).stop 2024-04-26T20:57:21.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.345+0000 7f7abfe00640 1 -- 172.21.15.138:0/1989775662 shutdown_connections 2024-04-26T20:57:21.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.345+0000 7f7abfe00640 1 --2- 172.21.15.138:0/1989775662 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ac015f600 0x7f7ac006d6b0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:21.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.345+0000 7f7abfe00640 1 -- 172.21.15.138:0/1989775662 >> 172.21.15.138:0/1989775662 conn(0x7f7ac00d2d40 msgr2=0x7f7ac00d3150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:21.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.345+0000 7f7abfe00640 1 -- 172.21.15.138:0/1989775662 shutdown_connections 2024-04-26T20:57:21.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.345+0000 7f7abfe00640 1 -- 172.21.15.138:0/1989775662 wait complete. 2024-04-26T20:57:21.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.345+0000 7f7abfe00640 1 Processor -- start 2024-04-26T20:57:21.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.345+0000 7f7abfe00640 1 -- start start 2024-04-26T20:57:21.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.345+0000 7f7abfe00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7ac006e4a0 0x7f7ac015d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:21.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.345+0000 7f7abfe00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ac015f220 0x7f7ac01fb820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:21.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.345+0000 7f7abfe00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ac015f600 0x7f7ac01fbd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:21.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.345+0000 7f7abfe00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac00cf060 con 0x7f7ac015f600 2024-04-26T20:57:21.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.345+0000 7f7abfe00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac00ceee0 con 0x7f7ac015f220 2024-04-26T20:57:21.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.345+0000 7f7abfe00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f7ac016cf60 con 0x7f7ac006e4a0 2024-04-26T20:57:21.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.345+0000 7f7abf400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ac015f600 0x7f7ac01fbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:21.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.345+0000 7f7abf400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ac015f600 0x7f7ac01fbd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38454/0 (socket says 172.21.15.138:38454) 2024-04-26T20:57:21.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.345+0000 7f7abf400640 1 -- 172.21.15.138:0/1294655671 learned_addr learned my addr 172.21.15.138:0/1294655671 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:21.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.345+0000 7f7abea00640 1 --2- 172.21.15.138:0/1294655671 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7ac006e4a0 0x7f7ac015d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:21.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.345+0000 7f7ab6000640 1 --2- 172.21.15.138:0/1294655671 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ac015f220 0x7f7ac01fb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:21.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.349+0000 7f7abf400640 1 -- 172.21.15.138:0/1294655671 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7ac006e4a0 msgr2=0x7f7ac015d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:21.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.349+0000 7f7abf400640 1 --2- 172.21.15.138:0/1294655671 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7ac006e4a0 0x7f7ac015d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:21.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.349+0000 7f7abf400640 1 -- 172.21.15.138:0/1294655671 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ac015f220 msgr2=0x7f7ac01fb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:21.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.349+0000 7f7abf400640 1 --2- 172.21.15.138:0/1294655671 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ac015f220 0x7f7ac01fb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:21.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.349+0000 7f7abf400640 1 -- 172.21.15.138:0/1294655671 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ac00ca8c0 con 0x7f7ac015f600 2024-04-26T20:57:21.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.349+0000 7f7abf400640 1 --2- 172.21.15.138:0/1294655671 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ac015f600 0x7f7ac01fbd60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7ab800b410 tx=0x7f7ab800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:21.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.349+0000 7f7ab7400640 1 -- 172.21.15.138:0/1294655671 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab8015030 con 0x7f7ac015f600 2024-04-26T20:57:21.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.349+0000 7f7ab7400640 1 -- 172.21.15.138:0/1294655671 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ab8004020 con 0x7f7ac015f600 2024-04-26T20:57:21.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.349+0000 7f7ab7400640 1 -- 172.21.15.138:0/1294655671 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab8004410 con 0x7f7ac015f600 2024-04-26T20:57:21.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.349+0000 7f7abfe00640 1 -- 172.21.15.138:0/1294655671 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ac00caba0 con 0x7f7ac015f600 2024-04-26T20:57:21.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.349+0000 7f7abfe00640 1 -- 172.21.15.138:0/1294655671 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ac00cb160 con 0x7f7ac015f600 2024-04-26T20:57:21.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.349+0000 7f7abfe00640 1 -- 172.21.15.138:0/1294655671 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ac0069430 con 0x7f7ac015f600 2024-04-26T20:57:21.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.349+0000 7f7ab7400640 1 -- 172.21.15.138:0/1294655671 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7ab8018070 con 0x7f7ac015f600 2024-04-26T20:57:21.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.349+0000 7f7ab7400640 1 --2- 172.21.15.138:0/1294655671 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7a9c068380 0x7f7a9c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:21.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.349+0000 7f7ab7400640 1 -- 172.21.15.138:0/1294655671 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7f7ab8086700 con 0x7f7ac015f600 2024-04-26T20:57:21.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.349+0000 7f7abea00640 1 --2- 172.21.15.138:0/1294655671 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7a9c068380 0x7f7a9c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:21.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.353+0000 7f7abea00640 1 --2- 172.21.15.138:0/1294655671 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7a9c068380 0x7f7a9c06a840 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7ab0001ea0 tx=0x7f7ab0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:21.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.353+0000 7f7ab7400640 1 -- 172.21.15.138:0/1294655671 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7ab8056240 con 0x7f7ac015f600 2024-04-26T20:57:21.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.513+0000 7f7abfe00640 1 -- 172.21.15.138:0/1294655671 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7ac015b080 con 0x7f7ac015f600 2024-04-26T20:57:21.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.517+0000 7f7ab7400640 1 -- 172.21.15.138:0/1294655671 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f7ab805a540 con 0x7f7ac015f600 2024-04-26T20:57:21.520 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 1 2024-04-26T20:57:21.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.517+0000 7f7abfe00640 1 -- 172.21.15.138:0/1294655671 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7a9c068380 msgr2=0x7f7a9c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:21.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.517+0000 7f7abfe00640 1 --2- 172.21.15.138:0/1294655671 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7a9c068380 0x7f7a9c06a840 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7ab0001ea0 tx=0x7f7ab0009040 comp rx=0 tx=0).stop 2024-04-26T20:57:21.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.517+0000 7f7abfe00640 1 -- 172.21.15.138:0/1294655671 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ac015f600 msgr2=0x7f7ac01fbd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:21.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.517+0000 7f7abfe00640 1 --2- 172.21.15.138:0/1294655671 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ac015f600 0x7f7ac01fbd60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7ab800b410 tx=0x7f7ab800b8d0 comp rx=0 tx=0).stop 2024-04-26T20:57:21.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.517+0000 7f7abfe00640 1 -- 172.21.15.138:0/1294655671 shutdown_connections 2024-04-26T20:57:21.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.517+0000 7f7abfe00640 1 --2- 172.21.15.138:0/1294655671 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7a9c068380 0x7f7a9c06a840 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:21.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.517+0000 7f7abfe00640 1 --2- 172.21.15.138:0/1294655671 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ac015f600 0x7f7ac01fbd60 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:21.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.517+0000 7f7abfe00640 1 --2- 172.21.15.138:0/1294655671 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ac015f220 0x7f7ac01fb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:21.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.517+0000 7f7abfe00640 1 --2- 172.21.15.138:0/1294655671 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7ac006e4a0 0x7f7ac015d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:21.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.517+0000 7f7abfe00640 1 -- 172.21.15.138:0/1294655671 >> 172.21.15.138:0/1294655671 conn(0x7f7ac00d2d40 msgr2=0x7f7ac00d3120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:21.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.517+0000 7f7abfe00640 1 -- 172.21.15.138:0/1294655671 shutdown_connections 2024-04-26T20:57:21.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.517+0000 7f7abfe00640 1 -- 172.21.15.138:0/1294655671 wait complete. 2024-04-26T20:57:21.541 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T20:57:21.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.673+0000 7eff15000640 1 Processor -- start 2024-04-26T20:57:21.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.673+0000 7eff15000640 1 -- start start 2024-04-26T20:57:21.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.677+0000 7eff15000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7eff1006e4a0 0x7eff1006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:21.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.677+0000 7eff15000640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff100d1e50 con 0x7eff1015f220 2024-04-26T20:57:21.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.677+0000 7eff15000640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff100d2130 con 0x7eff1015f600 2024-04-26T20:57:21.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.677+0000 7eff15000640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7eff1006dbf0 con 0x7eff1006e4a0 2024-04-26T20:57:21.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.677+0000 7eff0fe00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7eff1006e4a0 0x7eff1006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:21.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.677+0000 7eff0f400640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7eff1015f220 0x7eff1006dd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:42582/0 (socket says 172.21.15.138:42582) 2024-04-26T20:57:21.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.677+0000 7eff0f400640 1 -- 172.21.15.138:0/4240571945 learned_addr learned my addr 172.21.15.138:0/4240571945 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:21.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.677+0000 7eff0fe00640 1 -- 172.21.15.138:0/4240571945 >> v1:172.21.15.143:6789/0 conn(0x7eff1015f600 legacy=0x7eff100cdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:21.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.677+0000 7eff0fe00640 1 -- 172.21.15.138:0/4240571945 >> v1:172.21.15.138:6789/0 conn(0x7eff1015f220 legacy=0x7eff1006dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:21.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.677+0000 7eff0e000640 1 -- 172.21.15.138:0/4240571945 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2970364957 0 0) 0x7eff100d1e50 con 0x7eff1015f220 2024-04-26T20:57:21.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.677+0000 7eff0fe00640 1 -- 172.21.15.138:0/4240571945 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff100cd530 con 0x7eff1006e4a0 2024-04-26T20:57:21.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.681+0000 7eff0fe00640 1 --2- 172.21.15.138:0/4240571945 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff1006e4a0 0x7eff1006d6b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7eff080097c0 tx=0x7eff0801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9499198c4c56ac15 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:21.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.681+0000 7eff0e000640 1 -- 172.21.15.138:0/4240571945 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff080b0070 con 0x7eff1006e4a0 2024-04-26T20:57:21.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.681+0000 7eff0e000640 1 -- 172.21.15.138:0/4240571945 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff080ab600 con 0x7eff1006e4a0 2024-04-26T20:57:21.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.681+0000 7eff0e000640 1 -- 172.21.15.138:0/4240571945 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff080ab9d0 con 0x7eff1006e4a0 2024-04-26T20:57:21.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.681+0000 7eff15000640 1 -- 172.21.15.138:0/4240571945 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff1006e4a0 msgr2=0x7eff1006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:21.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.681+0000 7eff15000640 1 --2- 172.21.15.138:0/4240571945 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff1006e4a0 0x7eff1006d6b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7eff080097c0 tx=0x7eff0801c4a0 comp rx=0 tx=0).stop 2024-04-26T20:57:21.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.681+0000 7eff15000640 1 -- 172.21.15.138:0/4240571945 shutdown_connections 2024-04-26T20:57:21.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.681+0000 7eff15000640 1 --2- 172.21.15.138:0/4240571945 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff1006e4a0 0x7eff1006d6b0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:21.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.681+0000 7eff15000640 1 -- 172.21.15.138:0/4240571945 >> 172.21.15.138:0/4240571945 conn(0x7eff100d2d40 msgr2=0x7eff100d3150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:21.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.681+0000 7eff15000640 1 -- 172.21.15.138:0/4240571945 shutdown_connections 2024-04-26T20:57:21.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.681+0000 7eff15000640 1 -- 172.21.15.138:0/4240571945 wait complete. 2024-04-26T20:57:21.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.681+0000 7eff15000640 1 Processor -- start 2024-04-26T20:57:21.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.681+0000 7eff15000640 1 -- start start 2024-04-26T20:57:21.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.681+0000 7eff15000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff1006e4a0 0x7eff1009cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:21.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.681+0000 7eff15000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7eff1015f220 0x7eff10143440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:21.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.681+0000 7eff15000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7eff1015f600 0x7eff10142680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:21.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.681+0000 7eff15000640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7eff100cf020 con 0x7eff1006e4a0 2024-04-26T20:57:21.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.681+0000 7eff15000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7eff100ceea0 con 0x7eff1015f600 2024-04-26T20:57:21.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.681+0000 7eff15000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7eff1016cf60 con 0x7eff1015f220 2024-04-26T20:57:21.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.681+0000 7eff0f400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff1006e4a0 0x7eff1009cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:21.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.681+0000 7eff0f400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff1006e4a0 0x7eff1009cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38460/0 (socket says 172.21.15.138:38460) 2024-04-26T20:57:21.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.681+0000 7eff0f400640 1 -- 172.21.15.138:0/1033552059 learned_addr learned my addr 172.21.15.138:0/1033552059 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:21.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.685+0000 7eff0fe00640 1 --2- 172.21.15.138:0/1033552059 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7eff1015f600 0x7eff10142680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:21.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.685+0000 7eff0ea00640 1 --2- 172.21.15.138:0/1033552059 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7eff1015f220 0x7eff10143440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:21.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.685+0000 7eff0f400640 1 -- 172.21.15.138:0/1033552059 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7eff1015f220 msgr2=0x7eff10143440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:21.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.685+0000 7eff0f400640 1 --2- 172.21.15.138:0/1033552059 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7eff1015f220 0x7eff10143440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:21.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.685+0000 7eff0f400640 1 -- 172.21.15.138:0/1033552059 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7eff1015f600 msgr2=0x7eff10142680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:21.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.685+0000 7eff0f400640 1 --2- 172.21.15.138:0/1033552059 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7eff1015f600 0x7eff10142680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:21.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.685+0000 7eff0f400640 1 -- 172.21.15.138:0/1033552059 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff101415e0 con 0x7eff1006e4a0 2024-04-26T20:57:21.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.685+0000 7eff0ea00640 1 --2- 172.21.15.138:0/1033552059 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7eff1015f220 0x7eff10143440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:57:21.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.685+0000 7eff0f400640 1 --2- 172.21.15.138:0/1033552059 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff1006e4a0 0x7eff1009cb60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7eff0000c8c0 tx=0x7eff0000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:21.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.685+0000 7eff07400640 1 -- 172.21.15.138:0/1033552059 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff00018070 con 0x7eff1006e4a0 2024-04-26T20:57:21.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.685+0000 7eff07400640 1 -- 172.21.15.138:0/1033552059 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff0000a640 con 0x7eff1006e4a0 2024-04-26T20:57:21.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.685+0000 7eff07400640 1 -- 172.21.15.138:0/1033552059 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff0000aa30 con 0x7eff1006e4a0 2024-04-26T20:57:21.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.685+0000 7eff15000640 1 -- 172.21.15.138:0/1033552059 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff101418c0 con 0x7eff1006e4a0 2024-04-26T20:57:21.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.685+0000 7eff15000640 1 -- 172.21.15.138:0/1033552059 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff10141e80 con 0x7eff1006e4a0 2024-04-26T20:57:21.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.685+0000 7eff15000640 1 -- 172.21.15.138:0/1033552059 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff10069430 con 0x7eff1006e4a0 2024-04-26T20:57:21.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.685+0000 7eff07400640 1 -- 172.21.15.138:0/1033552059 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7eff0000abd0 con 0x7eff1006e4a0 2024-04-26T20:57:21.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.689+0000 7eff07400640 1 --2- 172.21.15.138:0/1033552059 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7efef0068380 0x7efef006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:21.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.689+0000 7eff07400640 1 -- 172.21.15.138:0/1033552059 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7eff00086390 con 0x7eff1006e4a0 2024-04-26T20:57:21.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.689+0000 7eff0ea00640 1 --2- 172.21.15.138:0/1033552059 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7efef0068380 0x7efef006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:21.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.689+0000 7eff0ea00640 1 --2- 172.21.15.138:0/1033552059 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7efef0068380 0x7efef006a840 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7efefc000f70 tx=0x7efefc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:21.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.693+0000 7eff07400640 1 -- 172.21.15.138:0/1033552059 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7eff00056650 con 0x7eff1006e4a0 2024-04-26T20:57:21.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.849+0000 7eff15000640 1 -- 172.21.15.138:0/1033552059 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7eff100d31c0 con 0x7eff1006e4a0 2024-04-26T20:57:21.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.849+0000 7eff07400640 1 -- 172.21.15.138:0/1033552059 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7eff00055f50 con 0x7eff1006e4a0 2024-04-26T20:57:21.852 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 32 2024-04-26T20:57:21.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.849+0000 7eff15000640 1 -- 172.21.15.138:0/1033552059 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7efef0068380 msgr2=0x7efef006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:21.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.849+0000 7eff15000640 1 --2- 172.21.15.138:0/1033552059 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7efef0068380 0x7efef006a840 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7efefc000f70 tx=0x7efefc009040 comp rx=0 tx=0).stop 2024-04-26T20:57:21.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.849+0000 7eff15000640 1 -- 172.21.15.138:0/1033552059 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff1006e4a0 msgr2=0x7eff1009cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:21.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.849+0000 7eff15000640 1 --2- 172.21.15.138:0/1033552059 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff1006e4a0 0x7eff1009cb60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7eff0000c8c0 tx=0x7eff0000cd80 comp rx=0 tx=0).stop 2024-04-26T20:57:21.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.849+0000 7eff15000640 1 -- 172.21.15.138:0/1033552059 shutdown_connections 2024-04-26T20:57:21.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.849+0000 7eff15000640 1 --2- 172.21.15.138:0/1033552059 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7efef0068380 0x7efef006a840 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:21.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.849+0000 7eff15000640 1 --2- 172.21.15.138:0/1033552059 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7eff1015f600 0x7eff10142680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:21.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.849+0000 7eff15000640 1 --2- 172.21.15.138:0/1033552059 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7eff1015f220 0x7eff10143440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:21.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.849+0000 7eff15000640 1 --2- 172.21.15.138:0/1033552059 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff1006e4a0 0x7eff1009cb60 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:21.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.849+0000 7eff15000640 1 -- 172.21.15.138:0/1033552059 >> 172.21.15.138:0/1033552059 conn(0x7eff100d2d40 msgr2=0x7eff1015f9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:21.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.849+0000 7eff15000640 1 -- 172.21.15.138:0/1033552059 shutdown_connections 2024-04-26T20:57:21.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:21.849+0000 7eff15000640 1 -- 172.21.15.138:0/1033552059 wait complete. 2024-04-26T20:57:21.873 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T20:57:22.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.005+0000 7fb03b800640 1 Processor -- start 2024-04-26T20:57:22.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.005+0000 7fb03b800640 1 -- start start 2024-04-26T20:57:22.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.009+0000 7fb03b800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb03415b730 0x7fb034073e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:22.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.009+0000 7fb03b800640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb0340738e0 0x7fb03415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:22.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.009+0000 7fb03b800640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0340cbe40 con 0x7fb03415f640 2024-04-26T20:57:22.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.009+0000 7fb03b800640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fb0340cbbf0 con 0x7fb0340738e0 2024-04-26T20:57:22.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.009+0000 7fb03b800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb0340731c0 con 0x7fb03415b730 2024-04-26T20:57:22.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.009+0000 7fb039800640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fb03415f640 0x7fb03406dee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:42590/0 (socket says 172.21.15.138:42590) 2024-04-26T20:57:22.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.009+0000 7fb039800640 1 -- 172.21.15.138:0/4253789100 learned_addr learned my addr 172.21.15.138:0/4253789100 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:22.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.009+0000 7fb02be00640 1 --2- 172.21.15.138:0/4253789100 >> v2:172.21.15.143:3300/0 conn(0x7fb0340738e0 0x7fb03415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:22.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.009+0000 7fb038e00640 1 --2- 172.21.15.138:0/4253789100 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb03415b730 0x7fb034073e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:22.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.009+0000 7fb033e00640 1 -- 172.21.15.138:0/4253789100 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1944599975 0 0) 0x7fb0340cbe40 con 0x7fb03415f640 2024-04-26T20:57:22.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.009+0000 7fb033e00640 1 -- 172.21.15.138:0/4253789100 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb018003530 con 0x7fb03415f640 2024-04-26T20:57:22.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.009+0000 7fb033e00640 1 -- 172.21.15.138:0/4253789100 <== mon.0 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 789330239 0 0) 0x7fb018003530 con 0x7fb03415f640 2024-04-26T20:57:22.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.009+0000 7fb033e00640 1 -- 172.21.15.138:0/4253789100 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb03415b730 msgr2=0x7fb034073e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:22.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.009+0000 7fb033e00640 1 --2- 172.21.15.138:0/4253789100 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb03415b730 0x7fb034073e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:22.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.009+0000 7fb033e00640 1 -- 172.21.15.138:0/4253789100 >> v2:172.21.15.143:3300/0 conn(0x7fb0340738e0 msgr2=0x7fb03415f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:22.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.009+0000 7fb033e00640 1 --2- 172.21.15.138:0/4253789100 >> v2:172.21.15.143:3300/0 conn(0x7fb0340738e0 0x7fb03415f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:22.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.009+0000 7fb033e00640 1 -- 172.21.15.138:0/4253789100 --> v1:172.21.15.138:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0340cc120 con 0x7fb03415f640 2024-04-26T20:57:22.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.009+0000 7fb033e00640 1 -- 172.21.15.138:0/4253789100 <== mon.0 v1:172.21.15.138:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2715389689 0 0) 0x7fb02c001a00 con 0x7fb03415f640 2024-04-26T20:57:22.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.009+0000 7fb033e00640 1 -- 172.21.15.138:0/4253789100 >> v1:172.21.15.138:6789/0 conn(0x7fb03415f640 legacy=0x7fb03406dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:22.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.009+0000 7fb033e00640 1 --2- 172.21.15.138:0/4253789100 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb018003a30 0x7fb018003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:22.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.009+0000 7fb033e00640 1 --2- 172.21.15.138:0/4253789100 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb03415b730 0x7fb018004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:22.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.009+0000 7fb033e00640 1 --2- 172.21.15.138:0/4253789100 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb018004d50 0x7fb0180051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:22.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.009+0000 7fb033e00640 1 -- 172.21.15.138:0/4253789100 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fb0340cbbf0 con 0x7fb018003a30 2024-04-26T20:57:22.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.009+0000 7fb033e00640 1 -- 172.21.15.138:0/4253789100 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fb0340731c0 con 0x7fb018004d50 2024-04-26T20:57:22.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.009+0000 7fb033e00640 1 -- 172.21.15.138:0/4253789100 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb01800b9d0 con 0x7fb03415b730 2024-04-26T20:57:22.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.009+0000 7fb02be00640 1 --2- 172.21.15.138:0/4253789100 >> v2:172.21.15.143:3300/0 conn(0x7fb0340738e0 0x7fb03415f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:57:22.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.009+0000 7fb038e00640 1 --2- 172.21.15.138:0/4253789100 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb018003a30 0x7fb018003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:22.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.009+0000 7fb039800640 1 --2- 172.21.15.138:0/4253789100 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb018004d50 0x7fb0180051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:22.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.009+0000 7fb02be00640 1 --2- 172.21.15.138:0/4253789100 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb03415b730 0x7fb018004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:22.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.009+0000 7fb038e00640 1 -- 172.21.15.138:0/4253789100 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb03415b730 msgr2=0x7fb018004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:22.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.009+0000 7fb038e00640 1 --2- 172.21.15.138:0/4253789100 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb03415b730 0x7fb018004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:22.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.009+0000 7fb038e00640 1 -- 172.21.15.138:0/4253789100 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb018004d50 msgr2=0x7fb0180051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:22.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.009+0000 7fb038e00640 1 --2- 172.21.15.138:0/4253789100 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb018004d50 0x7fb0180051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:22.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.009+0000 7fb038e00640 1 -- 172.21.15.138:0/4253789100 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb018003530 con 0x7fb018003a30 2024-04-26T20:57:22.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.013+0000 7fb038e00640 1 --2- 172.21.15.138:0/4253789100 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb018003a30 0x7fb018003e50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb024009ae0 tx=0x7fb02401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc57aeb9cfc584be server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:22.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.013+0000 7fb033e00640 1 -- 172.21.15.138:0/4253789100 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0240096b0 con 0x7fb018003a30 2024-04-26T20:57:22.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.013+0000 7fb033e00640 1 -- 172.21.15.138:0/4253789100 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0240a6450 con 0x7fb018003a30 2024-04-26T20:57:22.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.013+0000 7fb033e00640 1 -- 172.21.15.138:0/4253789100 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0240a6840 con 0x7fb018003a30 2024-04-26T20:57:22.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.013+0000 7fb03b800640 1 -- 172.21.15.138:0/4253789100 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb018003a30 msgr2=0x7fb018003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:22.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.013+0000 7fb03b800640 1 --2- 172.21.15.138:0/4253789100 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb018003a30 0x7fb018003e50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb024009ae0 tx=0x7fb02401ca70 comp rx=0 tx=0).stop 2024-04-26T20:57:22.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.013+0000 7fb039800640 1 -- 172.21.15.138:0/4253789100 reap_dead start 2024-04-26T20:57:22.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.013+0000 7fb03b800640 1 -- 172.21.15.138:0/4253789100 shutdown_connections 2024-04-26T20:57:22.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.013+0000 7fb03b800640 1 -- 172.21.15.138:0/4253789100 >> 172.21.15.138:0/4253789100 conn(0x7fb0340d0bb0 msgr2=0x7fb0340d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:22.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.013+0000 7fb03b800640 1 -- 172.21.15.138:0/4253789100 shutdown_connections 2024-04-26T20:57:22.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.013+0000 7fb03b800640 1 -- 172.21.15.138:0/4253789100 wait complete. 2024-04-26T20:57:22.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.017+0000 7fb03b800640 1 Processor -- start 2024-04-26T20:57:22.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.017+0000 7fb03b800640 1 -- start start 2024-04-26T20:57:22.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.017+0000 7fb03b800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb018003a30 0x7fb0340b4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:22.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.017+0000 7fb03b800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb034158330 0x7fb0341598b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:22.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.017+0000 7fb03b800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0341f7da0 0x7fb03415cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:22.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.017+0000 7fb03b800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fb03406ee00 con 0x7fb018003a30 2024-04-26T20:57:22.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.017+0000 7fb03b800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fb03415fe60 con 0x7fb0341f7da0 2024-04-26T20:57:22.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.017+0000 7fb03b800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb03406ef80 con 0x7fb034158330 2024-04-26T20:57:22.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.017+0000 7fb038e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb018003a30 0x7fb0340b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:22.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.017+0000 7fb038e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb018003a30 0x7fb0340b4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38482/0 (socket says 172.21.15.138:38482) 2024-04-26T20:57:22.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.017+0000 7fb038e00640 1 -- 172.21.15.138:0/833130352 learned_addr learned my addr 172.21.15.138:0/833130352 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:22.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.017+0000 7fb02be00640 1 --2- 172.21.15.138:0/833130352 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb034158330 0x7fb0341598b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:22.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.017+0000 7fb039800640 1 --2- 172.21.15.138:0/833130352 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0341f7da0 0x7fb03415cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:22.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.017+0000 7fb038e00640 1 -- 172.21.15.138:0/833130352 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb034158330 msgr2=0x7fb0341598b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:22.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.017+0000 7fb038e00640 1 --2- 172.21.15.138:0/833130352 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb034158330 0x7fb0341598b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:22.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.017+0000 7fb038e00640 1 -- 172.21.15.138:0/833130352 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0341f7da0 msgr2=0x7fb03415cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:22.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.017+0000 7fb038e00640 1 --2- 172.21.15.138:0/833130352 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0341f7da0 0x7fb03415cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:22.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.017+0000 7fb038e00640 1 -- 172.21.15.138:0/833130352 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb034158810 con 0x7fb018003a30 2024-04-26T20:57:22.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.017+0000 7fb02be00640 1 --2- 172.21.15.138:0/833130352 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb034158330 0x7fb0341598b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:22.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.017+0000 7fb039800640 1 --2- 172.21.15.138:0/833130352 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0341f7da0 0x7fb03415cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:22.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.017+0000 7fb038e00640 1 --2- 172.21.15.138:0/833130352 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb018003a30 0x7fb0340b4750 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb024009ae0 tx=0x7fb024019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:22.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.017+0000 7fb031600640 1 -- 172.21.15.138:0/833130352 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0240a6c00 con 0x7fb018003a30 2024-04-26T20:57:22.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.017+0000 7fb031600640 1 -- 172.21.15.138:0/833130352 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0240a6da0 con 0x7fb018003a30 2024-04-26T20:57:22.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.017+0000 7fb031600640 1 -- 172.21.15.138:0/833130352 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb024004260 con 0x7fb018003a30 2024-04-26T20:57:22.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.017+0000 7fb03b800640 1 -- 172.21.15.138:0/833130352 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb034158af0 con 0x7fb018003a30 2024-04-26T20:57:22.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.017+0000 7fb03b800640 1 -- 172.21.15.138:0/833130352 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0341590b0 con 0x7fb018003a30 2024-04-26T20:57:22.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.017+0000 7fb03b800640 1 -- 172.21.15.138:0/833130352 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb034069430 con 0x7fb018003a30 2024-04-26T20:57:22.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.021+0000 7fb031600640 1 -- 172.21.15.138:0/833130352 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb024003620 con 0x7fb018003a30 2024-04-26T20:57:22.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.021+0000 7fb031600640 1 --2- 172.21.15.138:0/833130352 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb0100683b0 0x7fb01006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:22.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.021+0000 7fb031600640 1 -- 172.21.15.138:0/833130352 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7fb024120aa0 con 0x7fb018003a30 2024-04-26T20:57:22.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.021+0000 7fb02be00640 1 --2- 172.21.15.138:0/833130352 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb0100683b0 0x7fb01006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:22.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.021+0000 7fb02be00640 1 --2- 172.21.15.138:0/833130352 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb0100683b0 0x7fb01006a870 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb0340b6ba0 tx=0x7fb01c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:22.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.025+0000 7fb031600640 1 -- 172.21.15.138:0/833130352 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb0240b5070 con 0x7fb018003a30 2024-04-26T20:57:22.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.181+0000 7fb03b800640 1 -- 172.21.15.138:0/833130352 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb0340d19c0 con 0x7fb018003a30 2024-04-26T20:57:22.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.181+0000 7fb031600640 1 -- 172.21.15.138:0/833130352 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7fb0240ac020 con 0x7fb018003a30 2024-04-26T20:57:22.186 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 64 2024-04-26T20:57:22.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.181+0000 7fb03b800640 1 -- 172.21.15.138:0/833130352 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb0100683b0 msgr2=0x7fb01006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:22.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.181+0000 7fb03b800640 1 --2- 172.21.15.138:0/833130352 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb0100683b0 0x7fb01006a870 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb0340b6ba0 tx=0x7fb01c008040 comp rx=0 tx=0).stop 2024-04-26T20:57:22.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.181+0000 7fb03b800640 1 -- 172.21.15.138:0/833130352 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb018003a30 msgr2=0x7fb0340b4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:22.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.181+0000 7fb03b800640 1 --2- 172.21.15.138:0/833130352 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb018003a30 0x7fb0340b4750 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb024009ae0 tx=0x7fb024019810 comp rx=0 tx=0).stop 2024-04-26T20:57:22.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.181+0000 7fb03b800640 1 -- 172.21.15.138:0/833130352 shutdown_connections 2024-04-26T20:57:22.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.181+0000 7fb03b800640 1 --2- 172.21.15.138:0/833130352 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb0100683b0 0x7fb01006a870 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:22.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.181+0000 7fb03b800640 1 --2- 172.21.15.138:0/833130352 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0341f7da0 0x7fb03415cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:22.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.181+0000 7fb03b800640 1 --2- 172.21.15.138:0/833130352 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb034158330 0x7fb0341598b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:22.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.181+0000 7fb03b800640 1 --2- 172.21.15.138:0/833130352 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb018003a30 0x7fb0340b4750 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:22.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.181+0000 7fb03b800640 1 -- 172.21.15.138:0/833130352 >> 172.21.15.138:0/833130352 conn(0x7fb0340d0bb0 msgr2=0x7fb03415e770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:22.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.185+0000 7fb03b800640 1 -- 172.21.15.138:0/833130352 shutdown_connections 2024-04-26T20:57:22.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.185+0000 7fb03b800640 1 -- 172.21.15.138:0/833130352 wait complete. 2024-04-26T20:57:22.207 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T20:57:22.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.341+0000 7fa682800640 1 Processor -- start 2024-04-26T20:57:22.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.341+0000 7fa682800640 1 -- start start 2024-04-26T20:57:22.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.341+0000 7fa682800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa67c15bdc0 0x7fa67c15f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:22.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.341+0000 7fa682800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa67c06f880 0x7fa67c0ce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:22.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.341+0000 7fa682800640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa67c06dee0 con 0x7fa67c073d70 2024-04-26T20:57:22.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.341+0000 7fa682800640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fa67c15c1a0 con 0x7fa67c06f880 2024-04-26T20:57:22.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.341+0000 7fa682800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fa67c06e180 con 0x7fa67c15bdc0 2024-04-26T20:57:22.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.341+0000 7fa67be00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa67c06f880 0x7fa67c0ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:22.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.341+0000 7fa67be00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa67c06f880 0x7fa67c0ce780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38488/0 (socket says 172.21.15.138:38488) 2024-04-26T20:57:22.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.341+0000 7fa67be00640 1 -- 172.21.15.138:0/494326196 learned_addr learned my addr 172.21.15.138:0/494326196 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:22.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.341+0000 7fa67b400640 1 --2- 172.21.15.138:0/494326196 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa67c15bdc0 0x7fa67c15f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:22.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.341+0000 7fa67be00640 1 -- 172.21.15.138:0/494326196 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa67c15bdc0 msgr2=0x7fa67c15f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:22.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.341+0000 7fa67be00640 1 --2- 172.21.15.138:0/494326196 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa67c15bdc0 0x7fa67c15f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:22.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.341+0000 7fa67be00640 1 -- 172.21.15.138:0/494326196 >> v1:172.21.15.143:6789/0 conn(0x7fa67c073d70 legacy=0x7fa67c15fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:22.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.341+0000 7fa67be00640 1 -- 172.21.15.138:0/494326196 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa67c06e460 con 0x7fa67c06f880 2024-04-26T20:57:22.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.345+0000 7fa67be00640 1 --2- 172.21.15.138:0/494326196 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa67c06f880 0x7fa67c0ce780 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa674009e50 tx=0x7fa67401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ee29c25e36b0381 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:22.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.345+0000 7fa67aa00640 1 -- 172.21.15.138:0/494326196 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6740a5750 con 0x7fa67c06f880 2024-04-26T20:57:22.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.345+0000 7fa67aa00640 1 -- 172.21.15.138:0/494326196 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6740a58f0 con 0x7fa67c06f880 2024-04-26T20:57:22.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.345+0000 7fa67aa00640 1 -- 172.21.15.138:0/494326196 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6740a5cc0 con 0x7fa67c06f880 2024-04-26T20:57:22.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.345+0000 7fa682800640 1 -- 172.21.15.138:0/494326196 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa67c06f880 msgr2=0x7fa67c0ce780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:22.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.345+0000 7fa682800640 1 --2- 172.21.15.138:0/494326196 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa67c06f880 0x7fa67c0ce780 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa674009e50 tx=0x7fa67401c9a0 comp rx=0 tx=0).stop 2024-04-26T20:57:22.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.345+0000 7fa682800640 1 -- 172.21.15.138:0/494326196 shutdown_connections 2024-04-26T20:57:22.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.345+0000 7fa682800640 1 --2- 172.21.15.138:0/494326196 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa67c06f880 0x7fa67c0ce780 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:22.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.345+0000 7fa682800640 1 --2- 172.21.15.138:0/494326196 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa67c15bdc0 0x7fa67c15f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:22.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.345+0000 7fa682800640 1 -- 172.21.15.138:0/494326196 >> 172.21.15.138:0/494326196 conn(0x7fa67c0d0bb0 msgr2=0x7fa67c0d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:22.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.345+0000 7fa682800640 1 -- 172.21.15.138:0/494326196 shutdown_connections 2024-04-26T20:57:22.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.345+0000 7fa682800640 1 -- 172.21.15.138:0/494326196 wait complete. 2024-04-26T20:57:22.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.349+0000 7fa682800640 1 Processor -- start 2024-04-26T20:57:22.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.349+0000 7fa682800640 1 -- start start 2024-04-26T20:57:22.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.349+0000 7fa682800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa67c06f880 0x7fa67c0c9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:22.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.349+0000 7fa682800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa67c073d70 0x7fa67c1661f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:22.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.349+0000 7fa682800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa67c15bdc0 0x7fa67c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:22.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.349+0000 7fa682800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fa67c168cd0 con 0x7fa67c073d70 2024-04-26T20:57:22.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.349+0000 7fa682800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fa67c160790 con 0x7fa67c15bdc0 2024-04-26T20:57:22.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.349+0000 7fa682800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fa67c168e50 con 0x7fa67c06f880 2024-04-26T20:57:22.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.349+0000 7fa672a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa67c073d70 0x7fa67c1661f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:22.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.349+0000 7fa672a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa67c073d70 0x7fa67c1661f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38496/0 (socket says 172.21.15.138:38496) 2024-04-26T20:57:22.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.349+0000 7fa672a00640 1 -- 172.21.15.138:0/186432727 learned_addr learned my addr 172.21.15.138:0/186432727 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:22.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.349+0000 7fa67be00640 1 --2- 172.21.15.138:0/186432727 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa67c15bdc0 0x7fa67c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:22.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.349+0000 7fa67b400640 1 --2- 172.21.15.138:0/186432727 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa67c06f880 0x7fa67c0c9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:22.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.349+0000 7fa672a00640 1 -- 172.21.15.138:0/186432727 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa67c06f880 msgr2=0x7fa67c0c9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:22.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.349+0000 7fa672a00640 1 --2- 172.21.15.138:0/186432727 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa67c06f880 0x7fa67c0c9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:22.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.349+0000 7fa672a00640 1 -- 172.21.15.138:0/186432727 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa67c15bdc0 msgr2=0x7fa67c06e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:22.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.349+0000 7fa672a00640 1 --2- 172.21.15.138:0/186432727 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa67c15bdc0 0x7fa67c06e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:22.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.349+0000 7fa672a00640 1 -- 172.21.15.138:0/186432727 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa67c1570b0 con 0x7fa67c073d70 2024-04-26T20:57:22.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.349+0000 7fa67be00640 1 --2- 172.21.15.138:0/186432727 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa67c15bdc0 0x7fa67c06e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:22.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.349+0000 7fa672a00640 1 --2- 172.21.15.138:0/186432727 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa67c073d70 0x7fa67c1661f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa66400c430 tx=0x7fa66400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:22.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.349+0000 7fa673e00640 1 -- 172.21.15.138:0/186432727 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6640052d0 con 0x7fa67c073d70 2024-04-26T20:57:22.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.349+0000 7fa673e00640 1 -- 172.21.15.138:0/186432727 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa664005470 con 0x7fa67c073d70 2024-04-26T20:57:22.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.349+0000 7fa673e00640 1 -- 172.21.15.138:0/186432727 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa664007260 con 0x7fa67c073d70 2024-04-26T20:57:22.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.349+0000 7fa682800640 1 -- 172.21.15.138:0/186432727 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa67c150c20 con 0x7fa67c073d70 2024-04-26T20:57:22.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.349+0000 7fa682800640 1 -- 172.21.15.138:0/186432727 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa67c157350 con 0x7fa67c073d70 2024-04-26T20:57:22.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.349+0000 7fa682800640 1 -- 172.21.15.138:0/186432727 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa67c069430 con 0x7fa67c073d70 2024-04-26T20:57:22.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.353+0000 7fa673e00640 1 -- 172.21.15.138:0/186432727 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa664007400 con 0x7fa67c073d70 2024-04-26T20:57:22.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.353+0000 7fa673e00640 1 --2- 172.21.15.138:0/186432727 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fa658068380 0x7fa65806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:22.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.353+0000 7fa673e00640 1 -- 172.21.15.138:0/186432727 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7fa6640862a0 con 0x7fa67c073d70 2024-04-26T20:57:22.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.353+0000 7fa67b400640 1 --2- 172.21.15.138:0/186432727 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fa658068380 0x7fa65806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:22.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.353+0000 7fa67b400640 1 --2- 172.21.15.138:0/186432727 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fa658068380 0x7fa65806a840 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa66c00b930 tx=0x7fa66c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:22.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.357+0000 7fa673e00640 1 -- 172.21.15.138:0/186432727 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa6640564d0 con 0x7fa67c073d70 2024-04-26T20:57:22.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.513+0000 7fa682800640 1 -- 172.21.15.138:0/186432727 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fa67c0cfb50 con 0x7fa67c073d70 2024-04-26T20:57:22.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.513+0000 7fa673e00640 1 -- 172.21.15.138:0/186432727 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7fa6640860c0 con 0x7fa67c073d70 2024-04-26T20:57:22.519 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 32 2024-04-26T20:57:22.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.517+0000 7fa682800640 1 -- 172.21.15.138:0/186432727 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fa658068380 msgr2=0x7fa65806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:22.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.517+0000 7fa682800640 1 --2- 172.21.15.138:0/186432727 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fa658068380 0x7fa65806a840 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa66c00b930 tx=0x7fa66c008040 comp rx=0 tx=0).stop 2024-04-26T20:57:22.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.517+0000 7fa682800640 1 -- 172.21.15.138:0/186432727 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa67c073d70 msgr2=0x7fa67c1661f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:22.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.517+0000 7fa682800640 1 --2- 172.21.15.138:0/186432727 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa67c073d70 0x7fa67c1661f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa66400c430 tx=0x7fa66400c8f0 comp rx=0 tx=0).stop 2024-04-26T20:57:22.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.517+0000 7fa682800640 1 -- 172.21.15.138:0/186432727 shutdown_connections 2024-04-26T20:57:22.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.517+0000 7fa682800640 1 --2- 172.21.15.138:0/186432727 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fa658068380 0x7fa65806a840 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:22.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.517+0000 7fa682800640 1 --2- 172.21.15.138:0/186432727 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa67c15bdc0 0x7fa67c06e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:22.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.517+0000 7fa682800640 1 --2- 172.21.15.138:0/186432727 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa67c073d70 0x7fa67c1661f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:22.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.517+0000 7fa682800640 1 --2- 172.21.15.138:0/186432727 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa67c06f880 0x7fa67c0c9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:22.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.517+0000 7fa682800640 1 -- 172.21.15.138:0/186432727 >> 172.21.15.138:0/186432727 conn(0x7fa67c0d0bb0 msgr2=0x7fa67c0cddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:22.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.517+0000 7fa682800640 1 -- 172.21.15.138:0/186432727 shutdown_connections 2024-04-26T20:57:22.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.517+0000 7fa682800640 1 -- 172.21.15.138:0/186432727 wait complete. 2024-04-26T20:57:22.540 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:57:22.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.669+0000 7f6474000640 1 Processor -- start 2024-04-26T20:57:22.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.669+0000 7f6474000640 1 -- start start 2024-04-26T20:57:22.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.673+0000 7f6474000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f646c0cbe00 0x7f646c06de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:22.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.673+0000 7f6474000640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f646c0727f0 con 0x7f646c15cf80 2024-04-26T20:57:22.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.673+0000 7f6474000640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f646c072a70 con 0x7f646c0cc1e0 2024-04-26T20:57:22.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.673+0000 7f6474000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f646c074220 con 0x7f646c0cbe00 2024-04-26T20:57:22.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.673+0000 7f6472000640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f646c15cf80 0x7f646c0ce6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:42604/0 (socket says 172.21.15.138:42604) 2024-04-26T20:57:22.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.673+0000 7f6472000640 1 -- 172.21.15.138:0/3750627267 learned_addr learned my addr 172.21.15.138:0/3750627267 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:22.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.673+0000 7f6471600640 1 --2- 172.21.15.138:0/3750627267 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f646c0cbe00 0x7f646c06de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:22.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.673+0000 7f646be00640 1 -- 172.21.15.138:0/3750627267 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2893403119 0 0) 0x7f64640014a0 con 0x7f646c15cf80 2024-04-26T20:57:22.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.673+0000 7f646be00640 1 -- 172.21.15.138:0/3750627267 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6454005740 con 0x7f646c15cf80 2024-04-26T20:57:22.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.673+0000 7f6471600640 1 -- 172.21.15.138:0/3750627267 >> v1:172.21.15.143:6789/0 conn(0x7f646c0cc1e0 legacy=0x7f646c073b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:22.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.673+0000 7f646be00640 1 -- 172.21.15.138:0/3750627267 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3435953114 0 0) 0x7f646c072a70 con 0x7f646c0cc1e0 2024-04-26T20:57:22.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.673+0000 7f6471600640 1 -- 172.21.15.138:0/3750627267 >> v1:172.21.15.138:6789/0 conn(0x7f646c15cf80 legacy=0x7f646c0ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:22.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.673+0000 7f6471600640 1 -- 172.21.15.138:0/3750627267 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f646c072d50 con 0x7f646c0cbe00 2024-04-26T20:57:22.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.677+0000 7f6471600640 1 --2- 172.21.15.138:0/3750627267 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f646c0cbe00 0x7f646c06de70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f64600097f0 tx=0x7f646001c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7077ab043f1c7869 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:22.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.677+0000 7f646be00640 1 -- 172.21.15.138:0/3750627267 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64600b0070 con 0x7f646c0cbe00 2024-04-26T20:57:22.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.677+0000 7f646be00640 1 -- 172.21.15.138:0/3750627267 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64600ab600 con 0x7f646c0cbe00 2024-04-26T20:57:22.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.677+0000 7f646be00640 1 -- 172.21.15.138:0/3750627267 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64600ab9d0 con 0x7f646c0cbe00 2024-04-26T20:57:22.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.677+0000 7f6474000640 1 -- 172.21.15.138:0/3750627267 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f646c0cbe00 msgr2=0x7f646c06de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:22.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.677+0000 7f6474000640 1 --2- 172.21.15.138:0/3750627267 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f646c0cbe00 0x7f646c06de70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f64600097f0 tx=0x7f646001c4e0 comp rx=0 tx=0).stop 2024-04-26T20:57:22.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.677+0000 7f6474000640 1 -- 172.21.15.138:0/3750627267 shutdown_connections 2024-04-26T20:57:22.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.677+0000 7f6474000640 1 --2- 172.21.15.138:0/3750627267 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f646c0cbe00 0x7f646c06de70 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:22.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.677+0000 7f6474000640 1 -- 172.21.15.138:0/3750627267 >> 172.21.15.138:0/3750627267 conn(0x7f646c0d0b20 msgr2=0x7f646c0d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:22.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.677+0000 7f6474000640 1 -- 172.21.15.138:0/3750627267 shutdown_connections 2024-04-26T20:57:22.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.677+0000 7f6474000640 1 -- 172.21.15.138:0/3750627267 wait complete. 2024-04-26T20:57:22.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.677+0000 7f6474000640 1 Processor -- start 2024-04-26T20:57:22.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.677+0000 7f6474000640 1 -- start start 2024-04-26T20:57:22.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.677+0000 7f6474000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f646c0cbe00 0x7f646c0ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:22.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.677+0000 7f6474000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f646c0cc1e0 0x7f646c1fb800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:22.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.677+0000 7f6474000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f646c15cf80 0x7f646c1fbd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:22.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.677+0000 7f6474000640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f646c0d0780 con 0x7f646c15cf80 2024-04-26T20:57:22.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.677+0000 7f6474000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f646c073680 con 0x7f646c0cbe00 2024-04-26T20:57:22.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.677+0000 7f6474000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f646c0d0900 con 0x7f646c0cc1e0 2024-04-26T20:57:22.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.681+0000 7f6472000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f646c15cf80 0x7f646c1fbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:22.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.681+0000 7f6472000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f646c15cf80 0x7f646c1fbd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38500/0 (socket says 172.21.15.138:38500) 2024-04-26T20:57:22.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.681+0000 7f6472000640 1 -- 172.21.15.138:0/2536032342 learned_addr learned my addr 172.21.15.138:0/2536032342 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:22.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.681+0000 7f6470c00640 1 --2- 172.21.15.138:0/2536032342 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f646c0cc1e0 0x7f646c1fb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:22.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.681+0000 7f6471600640 1 --2- 172.21.15.138:0/2536032342 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f646c0cbe00 0x7f646c0ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:22.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.681+0000 7f6472000640 1 -- 172.21.15.138:0/2536032342 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f646c0cc1e0 msgr2=0x7f646c1fb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:22.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.681+0000 7f6472000640 1 --2- 172.21.15.138:0/2536032342 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f646c0cc1e0 0x7f646c1fb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:22.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.681+0000 7f6472000640 1 -- 172.21.15.138:0/2536032342 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f646c0cbe00 msgr2=0x7f646c0ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:22.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.681+0000 7f6472000640 1 --2- 172.21.15.138:0/2536032342 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f646c0cbe00 0x7f646c0ca4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:22.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.681+0000 7f6472000640 1 -- 172.21.15.138:0/2536032342 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f646c147f10 con 0x7f646c15cf80 2024-04-26T20:57:22.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.681+0000 7f6472000640 1 --2- 172.21.15.138:0/2536032342 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f646c15cf80 0x7f646c1fbd40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f646400ca70 tx=0x7f646400cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:22.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.681+0000 7f6469600640 1 -- 172.21.15.138:0/2536032342 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6464017070 con 0x7f646c15cf80 2024-04-26T20:57:22.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.681+0000 7f6469600640 1 -- 172.21.15.138:0/2536032342 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f646400abd0 con 0x7f646c15cf80 2024-04-26T20:57:22.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.681+0000 7f6469600640 1 -- 172.21.15.138:0/2536032342 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6464012400 con 0x7f646c15cf80 2024-04-26T20:57:22.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.681+0000 7f6474000640 1 -- 172.21.15.138:0/2536032342 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f646c1481f0 con 0x7f646c15cf80 2024-04-26T20:57:22.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.681+0000 7f6474000640 1 -- 172.21.15.138:0/2536032342 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f646c1487b0 con 0x7f646c15cf80 2024-04-26T20:57:22.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.681+0000 7f6474000640 1 -- 172.21.15.138:0/2536032342 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f646c069510 con 0x7f646c15cf80 2024-04-26T20:57:22.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.681+0000 7f6469600640 1 -- 172.21.15.138:0/2536032342 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f646401a070 con 0x7f646c15cf80 2024-04-26T20:57:22.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.685+0000 7f6469600640 1 --2- 172.21.15.138:0/2536032342 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f644c068380 0x7f644c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:22.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.685+0000 7f6469600640 1 -- 172.21.15.138:0/2536032342 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7f6464086a10 con 0x7f646c15cf80 2024-04-26T20:57:22.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.685+0000 7f6471600640 1 --2- 172.21.15.138:0/2536032342 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f644c068380 0x7f644c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:22.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.685+0000 7f6471600640 1 --2- 172.21.15.138:0/2536032342 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f644c068380 0x7f644c06a840 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f64600ad000 tx=0x7f64600a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:22.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.689+0000 7f6469600640 1 -- 172.21.15.138:0/2536032342 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f646c0727f0 con 0x7f646c15cf80 2024-04-26T20:57:22.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.845+0000 7f6474000640 1 -- 172.21.15.138:0/2536032342 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f646c15a400 con 0x7f646c15cf80 2024-04-26T20:57:22.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.849+0000 7f6469600640 1 -- 172.21.15.138:0/2536032342 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18719 (secure 0 0 0) 0x7f64640565d0 con 0x7f646c15cf80 2024-04-26T20:57:22.852 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:57:22.852 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":29,"fsid":"c22b4730-12cc-4558-8535-b965384398c0","created":"2024-04-26T20:56:14.182475+0000","modified":"2024-04-26T20:57:20.395184+0000","last_up_change":"2024-04-26T20:56:26.013243+0000","last_in_change":"2024-04-26T20:56:16.714055+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:56:27.265834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:56:37.394398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:56:38.544369+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:56:42.240243+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3f9a2e34-3199-466f-a6cf-57927318121e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6801","nonce":3534772245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6803","nonce":3534772245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6807","nonce":3534772245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6805","nonce":3534772245}]},"public_addr":"172.21.15.138:6801/3534772245","cluster_addr":"172.21.15.138:6803/3534772245","heartbeat_back_addr":"172.21.15.138:6807/3534772245","heartbeat_front_addr":"172.21.15.138:6805/3534772245","state":["exists","up"]},{"osd":1,"uuid":"e881fcf6-3248-4696-a2ef-95d206d77712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6817","nonce":1427635773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6819","nonce":1427635773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6823","nonce":1427635773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6821","nonce":1427635773}]},"public_addr":"172.21.15.138:6817/1427635773","cluster_addr":"172.21.15.138:6819/1427635773","heartbeat_back_addr":"172.21.15.138:6823/1427635773","heartbeat_front_addr":"172.21.15.138:6821/1427635773","state":["exists","up"]},{"osd":2,"uuid":"f7d1db33-7672-4699-ae47-9f1e0a8e4222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6809","nonce":4273721573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6811","nonce":4273721573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6815","nonce":4273721573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6813","nonce":4273721573}]},"public_addr":"172.21.15.138:6809/4273721573","cluster_addr":"172.21.15.138:6811/4273721573","heartbeat_back_addr":"172.21.15.138:6815/4273721573","heartbeat_front_addr":"172.21.15.138:6813/4273721573","state":["exists","up"]},{"osd":3,"uuid":"2f4e0a9a-b8f6-4468-844a-a4501cd85054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6825","nonce":3098242154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6827","nonce":3098242154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6831","nonce":3098242154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6829","nonce":3098242154}]},"public_addr":"172.21.15.138:6825/3098242154","cluster_addr":"172.21.15.138:6827/3098242154","heartbeat_back_addr":"172.21.15.138:6831/3098242154","heartbeat_front_addr":"172.21.15.138:6829/3098242154","state":["exists","up"]},{"osd":4,"uuid":"c85df99b-3624-410e-866b-86830af2cfe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6801","nonce":2942056312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6803","nonce":2942056312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6807","nonce":2942056312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6805","nonce":2942056312}]},"public_addr":"172.21.15.143:6801/2942056312","cluster_addr":"172.21.15.143:6803/2942056312","heartbeat_back_addr":"172.21.15.143:6807/2942056312","heartbeat_front_addr":"172.21.15.143:6805/2942056312","state":["exists","up"]},{"osd":5,"uuid":"9af1efb5-c416-4808-b5ef-de0679ab9705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6809","nonce":1910222887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6811","nonce":1910222887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6815","nonce":1910222887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6813","nonce":1910222887}]},"public_addr":"172.21.15.143:6809/1910222887","cluster_addr":"172.21.15.143:6811/1910222887","heartbeat_back_addr":"172.21.15.143:6815/1910222887","heartbeat_front_addr":"172.21.15.143:6813/1910222887","state":["exists","up"]},{"osd":6,"uuid":"d7138615-8838-45ff-9072-2fd0683362f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6817","nonce":1082239825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6819","nonce":1082239825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6823","nonce":1082239825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6821","nonce":1082239825}]},"public_addr":"172.21.15.143:6817/1082239825","cluster_addr":"172.21.15.143:6819/1082239825","heartbeat_back_addr":"172.21.15.143:6823/1082239825","heartbeat_front_addr":"172.21.15.143:6821/1082239825","state":["exists","up"]},{"osd":7,"uuid":"0c27172b-35c4-49ec-ba0b-0137b8ff0010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6825","nonce":3295508495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6827","nonce":3295508495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6831","nonce":3295508495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6829","nonce":3295508495}]},"public_addr":"172.21.15.143:6825/3295508495","cluster_addr":"172.21.15.143:6827/3295508495","heartbeat_back_addr":"172.21.15.143:6831/3295508495","heartbeat_front_addr":"172.21.15.143:6829/3295508495","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.326627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.396119+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.433915+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.414179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.216947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.329272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.503073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.436382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.39","mappings":[{"from":0,"to":7}]},{"pgid":"4.6","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:57:22.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.849+0000 7f6474000640 1 -- 172.21.15.138:0/2536032342 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f644c068380 msgr2=0x7f644c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:22.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.849+0000 7f6474000640 1 --2- 172.21.15.138:0/2536032342 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f644c068380 0x7f644c06a840 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f64600ad000 tx=0x7f64600a6000 comp rx=0 tx=0).stop 2024-04-26T20:57:22.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.849+0000 7f6474000640 1 -- 172.21.15.138:0/2536032342 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f646c15cf80 msgr2=0x7f646c1fbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:22.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.849+0000 7f6474000640 1 --2- 172.21.15.138:0/2536032342 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f646c15cf80 0x7f646c1fbd40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f646400ca70 tx=0x7f646400cf30 comp rx=0 tx=0).stop 2024-04-26T20:57:22.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.849+0000 7f6474000640 1 -- 172.21.15.138:0/2536032342 shutdown_connections 2024-04-26T20:57:22.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.849+0000 7f6474000640 1 --2- 172.21.15.138:0/2536032342 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f644c068380 0x7f644c06a840 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:22.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.849+0000 7f6474000640 1 --2- 172.21.15.138:0/2536032342 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f646c15cf80 0x7f646c1fbd40 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:22.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.849+0000 7f6474000640 1 --2- 172.21.15.138:0/2536032342 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f646c0cc1e0 0x7f646c1fb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:22.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.849+0000 7f6474000640 1 --2- 172.21.15.138:0/2536032342 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f646c0cbe00 0x7f646c0ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:22.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.849+0000 7f6474000640 1 -- 172.21.15.138:0/2536032342 >> 172.21.15.138:0/2536032342 conn(0x7f646c0d0b20 msgr2=0x7f646c158da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:22.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.849+0000 7f6474000640 1 -- 172.21.15.138:0/2536032342 shutdown_connections 2024-04-26T20:57:22.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:22.849+0000 7f6474000640 1 -- 172.21.15.138:0/2536032342 wait complete. 2024-04-26T20:57:22.873 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:56:27.265834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T20:56:37.394398+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T20:56:38.544369+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T20:56:42.240243+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T20:57:22.873 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T20:57:23.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.005+0000 7f603c800640 1 Processor -- start 2024-04-26T20:57:23.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.009+0000 7f603c800640 1 -- start start 2024-04-26T20:57:23.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.009+0000 7f603c800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60340cf950 0x7f603406c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:23.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.009+0000 7f603c800640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f60340cd6d0 0x7f60340c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:23.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.009+0000 7f603c800640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60340cbab0 con 0x7f603415efe0 2024-04-26T20:57:23.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.009+0000 7f603c800640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f6034163940 con 0x7f60340cd6d0 2024-04-26T20:57:23.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.009+0000 7f603c800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f60340cbd30 con 0x7f60340cf950 2024-04-26T20:57:23.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.009+0000 7f6039e00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f603415efe0 0x7f60340cf240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:42614/0 (socket says 172.21.15.138:42614) 2024-04-26T20:57:23.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.009+0000 7f6039e00640 1 -- 172.21.15.138:0/3512570243 learned_addr learned my addr 172.21.15.138:0/3512570243 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:23.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.009+0000 7f603a800640 1 --2- 172.21.15.138:0/3512570243 >> v2:172.21.15.143:3300/0 conn(0x7f60340cd6d0 0x7f60340c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:23.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.009+0000 7f6039400640 1 --2- 172.21.15.138:0/3512570243 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60340cf950 0x7f603406c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:23.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.009+0000 7f6038a00640 1 -- 172.21.15.138:0/3512570243 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3506320128 0 0) 0x7f6028001120 con 0x7f603415efe0 2024-04-26T20:57:23.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.009+0000 7f6038a00640 1 -- 172.21.15.138:0/3512570243 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f601c003530 con 0x7f603415efe0 2024-04-26T20:57:23.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.009+0000 7f6038a00640 1 -- 172.21.15.138:0/3512570243 <== mon.0 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1518306016 0 0) 0x7f601c003530 con 0x7f603415efe0 2024-04-26T20:57:23.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.009+0000 7f6038a00640 1 -- 172.21.15.138:0/3512570243 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60340cf950 msgr2=0x7f603406c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:23.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.009+0000 7f6038a00640 1 --2- 172.21.15.138:0/3512570243 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60340cf950 0x7f603406c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:23.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.009+0000 7f6038a00640 1 -- 172.21.15.138:0/3512570243 >> v2:172.21.15.143:3300/0 conn(0x7f60340cd6d0 msgr2=0x7f60340c7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:23.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.009+0000 7f6038a00640 1 --2- 172.21.15.138:0/3512570243 >> v2:172.21.15.143:3300/0 conn(0x7f60340cd6d0 0x7f60340c7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:23.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.009+0000 7f6038a00640 1 -- 172.21.15.138:0/3512570243 --> v1:172.21.15.138:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60340cc010 con 0x7f603415efe0 2024-04-26T20:57:23.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.009+0000 7f6038a00640 1 -- 172.21.15.138:0/3512570243 <== mon.0 v1:172.21.15.138:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2715389689 0 0) 0x7f6028001850 con 0x7f603415efe0 2024-04-26T20:57:23.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.009+0000 7f6038a00640 1 -- 172.21.15.138:0/3512570243 >> v1:172.21.15.138:6789/0 conn(0x7f603415efe0 legacy=0x7f60340cf240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:23.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.009+0000 7f6038a00640 1 --2- 172.21.15.138:0/3512570243 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f601c003a30 0x7f601c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:23.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.009+0000 7f6038a00640 1 --2- 172.21.15.138:0/3512570243 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60340cf950 0x7f601c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:23.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.009+0000 7f6038a00640 1 --2- 172.21.15.138:0/3512570243 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f601c004d50 0x7f601c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:23.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.009+0000 7f6038a00640 1 -- 172.21.15.138:0/3512570243 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f6034163940 con 0x7f601c004d50 2024-04-26T20:57:23.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.009+0000 7f6038a00640 1 -- 172.21.15.138:0/3512570243 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f60340cbd30 con 0x7f601c003a30 2024-04-26T20:57:23.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.009+0000 7f6038a00640 1 -- 172.21.15.138:0/3512570243 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f601c00b9d0 con 0x7f60340cf950 2024-04-26T20:57:23.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.009+0000 7f603a800640 1 --2- 172.21.15.138:0/3512570243 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f601c004d50 0x7f601c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:23.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.009+0000 7f6039e00640 1 --2- 172.21.15.138:0/3512570243 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f601c003a30 0x7f601c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:23.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.009+0000 7f6039400640 1 --2- 172.21.15.138:0/3512570243 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60340cf950 0x7f601c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:23.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.009+0000 7f603a800640 1 -- 172.21.15.138:0/3512570243 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60340cf950 msgr2=0x7f601c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:23.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.009+0000 7f603a800640 1 --2- 172.21.15.138:0/3512570243 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60340cf950 0x7f601c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:23.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.009+0000 7f603a800640 1 -- 172.21.15.138:0/3512570243 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f601c003a30 msgr2=0x7f601c003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:23.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.009+0000 7f603a800640 1 --2- 172.21.15.138:0/3512570243 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f601c003a30 0x7f601c003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:23.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.009+0000 7f603a800640 1 -- 172.21.15.138:0/3512570243 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f601c003530 con 0x7f601c004d50 2024-04-26T20:57:23.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.009+0000 7f6039400640 1 --2- 172.21.15.138:0/3512570243 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60340cf950 0x7f601c004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:23.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.013+0000 7f603a800640 1 --2- 172.21.15.138:0/3512570243 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f601c004d50 0x7f601c0051d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6030009fc0 tx=0x7f603001ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef995560b906d74c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:23.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.013+0000 7f6038a00640 1 -- 172.21.15.138:0/3512570243 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60300b2070 con 0x7f601c004d50 2024-04-26T20:57:23.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.013+0000 7f6038a00640 1 -- 172.21.15.138:0/3512570243 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60300a5cd0 con 0x7f601c004d50 2024-04-26T20:57:23.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.013+0000 7f6038a00640 1 -- 172.21.15.138:0/3512570243 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6030009c10 con 0x7f601c004d50 2024-04-26T20:57:23.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.013+0000 7f603c800640 1 -- 172.21.15.138:0/3512570243 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f601c004d50 msgr2=0x7f601c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:23.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.013+0000 7f603c800640 1 --2- 172.21.15.138:0/3512570243 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f601c004d50 0x7f601c0051d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6030009fc0 tx=0x7f603001ccc0 comp rx=0 tx=0).stop 2024-04-26T20:57:23.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.013+0000 7f603a800640 1 -- 172.21.15.138:0/3512570243 reap_dead start 2024-04-26T20:57:23.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.013+0000 7f603c800640 1 -- 172.21.15.138:0/3512570243 shutdown_connections 2024-04-26T20:57:23.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.013+0000 7f603c800640 1 -- 172.21.15.138:0/3512570243 >> 172.21.15.138:0/3512570243 conn(0x7f60340cdee0 msgr2=0x7f60340ce2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:23.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.013+0000 7f603c800640 1 -- 172.21.15.138:0/3512570243 shutdown_connections 2024-04-26T20:57:23.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.013+0000 7f603c800640 1 -- 172.21.15.138:0/3512570243 wait complete. 2024-04-26T20:57:23.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.017+0000 7f603c800640 1 Processor -- start 2024-04-26T20:57:23.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.017+0000 7f603c800640 1 -- start start 2024-04-26T20:57:23.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.017+0000 7f603c800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f601c004d50 0x7f60341f4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:23.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.017+0000 7f603c800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60340c9a70 0x7f60340c9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:23.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.017+0000 7f603c800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6034145750 0x7f6034145c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:23.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.017+0000 7f603c800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f603415f3c0 con 0x7f601c004d50 2024-04-26T20:57:23.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.017+0000 7f603c800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f6034163630 con 0x7f60340c9a70 2024-04-26T20:57:23.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.017+0000 7f603c800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f603415f540 con 0x7f6034145750 2024-04-26T20:57:23.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.017+0000 7f6039e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f601c004d50 0x7f60341f4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:23.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.017+0000 7f6039e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f601c004d50 0x7f60341f4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38504/0 (socket says 172.21.15.138:38504) 2024-04-26T20:57:23.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.017+0000 7f6039e00640 1 -- 172.21.15.138:0/1848170233 learned_addr learned my addr 172.21.15.138:0/1848170233 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:23.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.017+0000 7f603a800640 1 --2- 172.21.15.138:0/1848170233 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6034145750 0x7f6034145c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:23.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.017+0000 7f6039400640 1 --2- 172.21.15.138:0/1848170233 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60340c9a70 0x7f60340c9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:23.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.017+0000 7f6039e00640 1 -- 172.21.15.138:0/1848170233 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6034145750 msgr2=0x7f6034145c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:23.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.017+0000 7f6039e00640 1 --2- 172.21.15.138:0/1848170233 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6034145750 0x7f6034145c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:23.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.017+0000 7f6039e00640 1 -- 172.21.15.138:0/1848170233 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60340c9a70 msgr2=0x7f60340c9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:23.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.017+0000 7f6039e00640 1 --2- 172.21.15.138:0/1848170233 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60340c9a70 0x7f60340c9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:23.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.017+0000 7f6039e00640 1 -- 172.21.15.138:0/1848170233 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60340ca5f0 con 0x7f601c004d50 2024-04-26T20:57:23.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.017+0000 7f6039e00640 1 --2- 172.21.15.138:0/1848170233 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f601c004d50 0x7f60341f4fa0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f602800e730 tx=0x7f602800ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:23.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.017+0000 7f602e000640 1 -- 172.21.15.138:0/1848170233 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f602800ee40 con 0x7f601c004d50 2024-04-26T20:57:23.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.017+0000 7f602e000640 1 -- 172.21.15.138:0/1848170233 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6028018070 con 0x7f601c004d50 2024-04-26T20:57:23.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.017+0000 7f602e000640 1 -- 172.21.15.138:0/1848170233 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f602800ca90 con 0x7f601c004d50 2024-04-26T20:57:23.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.017+0000 7f603c800640 1 -- 172.21.15.138:0/1848170233 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60340ca8d0 con 0x7f601c004d50 2024-04-26T20:57:23.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.017+0000 7f603c800640 1 -- 172.21.15.138:0/1848170233 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60340cae90 con 0x7f601c004d50 2024-04-26T20:57:23.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.017+0000 7f603c800640 1 -- 172.21.15.138:0/1848170233 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6034069430 con 0x7f601c004d50 2024-04-26T20:57:23.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.021+0000 7f602e000640 1 -- 172.21.15.138:0/1848170233 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f602800cc30 con 0x7f601c004d50 2024-04-26T20:57:23.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.021+0000 7f602e000640 1 --2- 172.21.15.138:0/1848170233 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f60180683b0 0x7f601806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:23.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.021+0000 7f602e000640 1 -- 172.21.15.138:0/1848170233 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7f6028086950 con 0x7f601c004d50 2024-04-26T20:57:23.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.021+0000 7f6039400640 1 --2- 172.21.15.138:0/1848170233 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f60180683b0 0x7f601806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:23.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.021+0000 7f6039400640 1 --2- 172.21.15.138:0/1848170233 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f60180683b0 0x7f601806a870 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6034071280 tx=0x7f6024008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:23.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.025+0000 7f602e000640 1 -- 172.21.15.138:0/1848170233 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f60340cbab0 con 0x7f601c004d50 2024-04-26T20:57:23.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.181+0000 7f603c800640 1 -- 172.21.15.138:0/1848170233 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6034068690 con 0x7f601c004d50 2024-04-26T20:57:23.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.181+0000 7f602e000640 1 -- 172.21.15.138:0/1848170233 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f6028056ae0 con 0x7f601c004d50 2024-04-26T20:57:23.186 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 1 2024-04-26T20:57:23.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.185+0000 7f603c800640 1 -- 172.21.15.138:0/1848170233 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f60180683b0 msgr2=0x7f601806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:23.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.185+0000 7f603c800640 1 --2- 172.21.15.138:0/1848170233 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f60180683b0 0x7f601806a870 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6034071280 tx=0x7f6024008040 comp rx=0 tx=0).stop 2024-04-26T20:57:23.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.185+0000 7f603c800640 1 -- 172.21.15.138:0/1848170233 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f601c004d50 msgr2=0x7f60341f4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:23.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.185+0000 7f603c800640 1 --2- 172.21.15.138:0/1848170233 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f601c004d50 0x7f60341f4fa0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f602800e730 tx=0x7f602800ebf0 comp rx=0 tx=0).stop 2024-04-26T20:57:23.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.185+0000 7f603c800640 1 -- 172.21.15.138:0/1848170233 shutdown_connections 2024-04-26T20:57:23.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.185+0000 7f603c800640 1 --2- 172.21.15.138:0/1848170233 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f60180683b0 0x7f601806a870 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:23.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.185+0000 7f603c800640 1 --2- 172.21.15.138:0/1848170233 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6034145750 0x7f6034145c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:23.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.185+0000 7f603c800640 1 --2- 172.21.15.138:0/1848170233 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60340c9a70 0x7f60340c9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:23.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.185+0000 7f603c800640 1 --2- 172.21.15.138:0/1848170233 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f601c004d50 0x7f60341f4fa0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:23.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.185+0000 7f603c800640 1 -- 172.21.15.138:0/1848170233 >> 172.21.15.138:0/1848170233 conn(0x7f60340cdee0 msgr2=0x7f60340cea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:23.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.185+0000 7f603c800640 1 -- 172.21.15.138:0/1848170233 shutdown_connections 2024-04-26T20:57:23.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.185+0000 7f603c800640 1 -- 172.21.15.138:0/1848170233 wait complete. 2024-04-26T20:57:23.207 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T20:57:23.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.341+0000 7fe516000640 1 Processor -- start 2024-04-26T20:57:23.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.341+0000 7fe516000640 1 -- start start 2024-04-26T20:57:23.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.341+0000 7fe516000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe51015b730 0x7fe510073e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:23.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.345+0000 7fe516000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe5100738e0 0x7fe51006e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:23.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.345+0000 7fe516000640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5100cbe40 con 0x7fe51006ecb0 2024-04-26T20:57:23.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.345+0000 7fe516000640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fe5100cbbf0 con 0x7fe51015b730 2024-04-26T20:57:23.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.345+0000 7fe516000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fe5100731c0 con 0x7fe5100738e0 2024-04-26T20:57:23.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.345+0000 7fe50f400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe51015b730 0x7fe510073e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:23.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.345+0000 7fe50f400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe51015b730 0x7fe510073e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38520/0 (socket says 172.21.15.138:38520) 2024-04-26T20:57:23.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.345+0000 7fe50f400640 1 -- 172.21.15.138:0/524879962 learned_addr learned my addr 172.21.15.138:0/524879962 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:23.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.345+0000 7fe506a00640 1 --2- 172.21.15.138:0/524879962 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe5100738e0 0x7fe51006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:23.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.345+0000 7fe50f400640 1 -- 172.21.15.138:0/524879962 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe5100738e0 msgr2=0x7fe51006e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:23.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.345+0000 7fe50f400640 1 --2- 172.21.15.138:0/524879962 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe5100738e0 0x7fe51006e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:23.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.345+0000 7fe50f400640 1 -- 172.21.15.138:0/524879962 >> v1:172.21.15.143:6789/0 conn(0x7fe51006ecb0 legacy=0x7fe51015f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:23.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.345+0000 7fe50f400640 1 -- 172.21.15.138:0/524879962 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5100cc120 con 0x7fe51015b730 2024-04-26T20:57:23.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.345+0000 7fe50f400640 1 --2- 172.21.15.138:0/524879962 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe51015b730 0x7fe510073e10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe500009870 tx=0x7fe50001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48222464527f017e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:23.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.345+0000 7fe50ea00640 1 -- 172.21.15.138:0/524879962 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5000b0070 con 0x7fe51015b730 2024-04-26T20:57:23.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.345+0000 7fe50ea00640 1 -- 172.21.15.138:0/524879962 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5000ab600 con 0x7fe51015b730 2024-04-26T20:57:23.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.345+0000 7fe50ea00640 1 -- 172.21.15.138:0/524879962 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5000ab9d0 con 0x7fe51015b730 2024-04-26T20:57:23.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.349+0000 7fe516000640 1 -- 172.21.15.138:0/524879962 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe51015b730 msgr2=0x7fe510073e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:23.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.349+0000 7fe516000640 1 --2- 172.21.15.138:0/524879962 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe51015b730 0x7fe510073e10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe500009870 tx=0x7fe50001c560 comp rx=0 tx=0).stop 2024-04-26T20:57:23.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.349+0000 7fe516000640 1 -- 172.21.15.138:0/524879962 shutdown_connections 2024-04-26T20:57:23.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.349+0000 7fe516000640 1 --2- 172.21.15.138:0/524879962 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe5100738e0 0x7fe51006e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:23.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.349+0000 7fe516000640 1 --2- 172.21.15.138:0/524879962 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe51015b730 0x7fe510073e10 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:23.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.349+0000 7fe516000640 1 -- 172.21.15.138:0/524879962 >> 172.21.15.138:0/524879962 conn(0x7fe5100d0bb0 msgr2=0x7fe5100d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:23.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.349+0000 7fe516000640 1 -- 172.21.15.138:0/524879962 shutdown_connections 2024-04-26T20:57:23.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.349+0000 7fe516000640 1 -- 172.21.15.138:0/524879962 wait complete. 2024-04-26T20:57:23.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.349+0000 7fe516000640 1 Processor -- start 2024-04-26T20:57:23.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.349+0000 7fe516000640 1 -- start start 2024-04-26T20:57:23.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.349+0000 7fe516000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe51006ecb0 0x7fe5101496f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:23.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.349+0000 7fe516000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe5100738e0 0x7fe5100b5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:23.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.349+0000 7fe516000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe51015b730 0x7fe5100b1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:23.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.349+0000 7fe516000640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe51015f810 con 0x7fe51015b730 2024-04-26T20:57:23.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.349+0000 7fe516000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fe510073650 con 0x7fe51006ecb0 2024-04-26T20:57:23.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.349+0000 7fe516000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fe51015f990 con 0x7fe5100738e0 2024-04-26T20:57:23.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.349+0000 7fe50fe00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe51015b730 0x7fe5100b1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:23.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.349+0000 7fe50fe00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe51015b730 0x7fe5100b1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38528/0 (socket says 172.21.15.138:38528) 2024-04-26T20:57:23.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.349+0000 7fe50fe00640 1 -- 172.21.15.138:0/2148082588 learned_addr learned my addr 172.21.15.138:0/2148082588 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:23.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.353+0000 7fe506a00640 1 --2- 172.21.15.138:0/2148082588 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe5100738e0 0x7fe5100b5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:23.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.353+0000 7fe50f400640 1 --2- 172.21.15.138:0/2148082588 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe51006ecb0 0x7fe5101496f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:23.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.353+0000 7fe50fe00640 1 -- 172.21.15.138:0/2148082588 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe5100738e0 msgr2=0x7fe5100b5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:23.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.353+0000 7fe50fe00640 1 --2- 172.21.15.138:0/2148082588 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe5100738e0 0x7fe5100b5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:23.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.353+0000 7fe50fe00640 1 -- 172.21.15.138:0/2148082588 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe51006ecb0 msgr2=0x7fe5101496f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:23.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.353+0000 7fe50fe00640 1 --2- 172.21.15.138:0/2148082588 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe51006ecb0 0x7fe5101496f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:23.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.353+0000 7fe50fe00640 1 -- 172.21.15.138:0/2148082588 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe510169e50 con 0x7fe51015b730 2024-04-26T20:57:23.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.353+0000 7fe50fe00640 1 --2- 172.21.15.138:0/2148082588 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe51015b730 0x7fe5100b1b00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe50800c770 tx=0x7fe50800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:23.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.353+0000 7fe507e00640 1 -- 172.21.15.138:0/2148082588 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe508003b80 con 0x7fe51015b730 2024-04-26T20:57:23.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.353+0000 7fe507e00640 1 -- 172.21.15.138:0/2148082588 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe508003d20 con 0x7fe51015b730 2024-04-26T20:57:23.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.353+0000 7fe507e00640 1 -- 172.21.15.138:0/2148082588 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe50800aa90 con 0x7fe51015b730 2024-04-26T20:57:23.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.353+0000 7fe516000640 1 -- 172.21.15.138:0/2148082588 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5100b5b80 con 0x7fe51015b730 2024-04-26T20:57:23.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.353+0000 7fe516000640 1 -- 172.21.15.138:0/2148082588 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5100b6140 con 0x7fe51015b730 2024-04-26T20:57:23.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.353+0000 7fe516000640 1 -- 172.21.15.138:0/2148082588 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe510069430 con 0x7fe51015b730 2024-04-26T20:57:23.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.353+0000 7fe507e00640 1 -- 172.21.15.138:0/2148082588 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe50800ac30 con 0x7fe51015b730 2024-04-26T20:57:23.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.357+0000 7fe507e00640 1 --2- 172.21.15.138:0/2148082588 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe4ec068380 0x7fe4ec06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:23.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.357+0000 7fe507e00640 1 -- 172.21.15.138:0/2148082588 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7fe508086c90 con 0x7fe51015b730 2024-04-26T20:57:23.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.357+0000 7fe50f400640 1 --2- 172.21.15.138:0/2148082588 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe4ec068380 0x7fe4ec06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:23.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.357+0000 7fe50f400640 1 --2- 172.21.15.138:0/2148082588 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe4ec068380 0x7fe4ec06a840 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe5000ad000 tx=0x7fe5000a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:23.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.361+0000 7fe507e00640 1 -- 172.21.15.138:0/2148082588 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe508056eb0 con 0x7fe51015b730 2024-04-26T20:57:23.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.517+0000 7fe516000640 1 -- 172.21.15.138:0/2148082588 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe5100c7090 con 0x7fe51015b730 2024-04-26T20:57:23.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.517+0000 7fe507e00640 1 -- 172.21.15.138:0/2148082588 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7fe508086020 con 0x7fe51015b730 2024-04-26T20:57:23.523 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 32 2024-04-26T20:57:23.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.521+0000 7fe516000640 1 -- 172.21.15.138:0/2148082588 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe4ec068380 msgr2=0x7fe4ec06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:23.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.521+0000 7fe516000640 1 --2- 172.21.15.138:0/2148082588 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe4ec068380 0x7fe4ec06a840 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe5000ad000 tx=0x7fe5000a6000 comp rx=0 tx=0).stop 2024-04-26T20:57:23.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.521+0000 7fe516000640 1 -- 172.21.15.138:0/2148082588 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe51015b730 msgr2=0x7fe5100b1b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:23.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.521+0000 7fe516000640 1 --2- 172.21.15.138:0/2148082588 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe51015b730 0x7fe5100b1b00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe50800c770 tx=0x7fe50800cc30 comp rx=0 tx=0).stop 2024-04-26T20:57:23.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.521+0000 7fe516000640 1 -- 172.21.15.138:0/2148082588 shutdown_connections 2024-04-26T20:57:23.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.521+0000 7fe516000640 1 --2- 172.21.15.138:0/2148082588 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe4ec068380 0x7fe4ec06a840 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:23.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.521+0000 7fe516000640 1 --2- 172.21.15.138:0/2148082588 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe51015b730 0x7fe5100b1b00 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:23.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.521+0000 7fe516000640 1 --2- 172.21.15.138:0/2148082588 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe5100738e0 0x7fe5100b5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:23.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.521+0000 7fe516000640 1 --2- 172.21.15.138:0/2148082588 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe51006ecb0 0x7fe5101496f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:23.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.521+0000 7fe516000640 1 -- 172.21.15.138:0/2148082588 >> 172.21.15.138:0/2148082588 conn(0x7fe5100d0bb0 msgr2=0x7fe5100b06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:23.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.521+0000 7fe516000640 1 -- 172.21.15.138:0/2148082588 shutdown_connections 2024-04-26T20:57:23.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.521+0000 7fe516000640 1 -- 172.21.15.138:0/2148082588 wait complete. 2024-04-26T20:57:23.543 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T20:57:23.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.677+0000 7f9f7b000640 1 Processor -- start 2024-04-26T20:57:23.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.677+0000 7f9f7b000640 1 -- start start 2024-04-26T20:57:23.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.677+0000 7f9f7b000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f9f7415aa60 0x7f9f740cc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:23.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.677+0000 7f9f7b000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9f740ccd20 0x7f9f740cb200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:23.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.677+0000 7f9f7b000640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9f7415e180 0x7f9f740cb740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:23.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.677+0000 7f9f7b000640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f9f740cd210 con 0x7f9f7415aa60 2024-04-26T20:57:23.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.677+0000 7f9f7b000640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f9f7415d6a0 con 0x7f9f7415e180 2024-04-26T20:57:23.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.677+0000 7f9f7b000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f9f7415d980 con 0x7f9f740ccd20 2024-04-26T20:57:23.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.677+0000 7f9f73e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f9f7415aa60 0x7f9f740cc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:23.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.677+0000 7f9f73e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f9f7415aa60 0x7f9f740cc7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40474/0 (socket says 172.21.15.138:40474) 2024-04-26T20:57:23.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.677+0000 7f9f73e00640 1 -- 172.21.15.138:0/2915517746 learned_addr learned my addr 172.21.15.138:0/2915517746 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:23.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.677+0000 7f9f79000640 1 --2- 172.21.15.138:0/2915517746 >> v2:172.21.15.143:3300/0 conn(0x7f9f7415e180 0x7f9f740cb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:23.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.677+0000 7f9f6b400640 1 --2- 172.21.15.138:0/2915517746 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9f740ccd20 0x7f9f740cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:23.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.681+0000 7f9f73e00640 1 -- 172.21.15.138:0/2915517746 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9f740ccd20 msgr2=0x7f9f740cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:23.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.681+0000 7f9f73e00640 1 --2- 172.21.15.138:0/2915517746 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9f740ccd20 0x7f9f740cb200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:23.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.681+0000 7f9f73e00640 1 -- 172.21.15.138:0/2915517746 >> v2:172.21.15.143:3300/0 conn(0x7f9f7415e180 msgr2=0x7f9f740cb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:23.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.681+0000 7f9f73e00640 1 --2- 172.21.15.138:0/2915517746 >> v2:172.21.15.143:3300/0 conn(0x7f9f7415e180 0x7f9f740cb740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:23.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.681+0000 7f9f73e00640 1 -- 172.21.15.138:0/2915517746 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f7415dc60 con 0x7f9f7415aa60 2024-04-26T20:57:23.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.681+0000 7f9f73e00640 1 --2- 172.21.15.138:0/2915517746 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f7415aa60 0x7f9f740cc7e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9f740b6d20 tx=0x7f9f6401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aca3b080aaa584eb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:23.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.681+0000 7f9f73400640 1 -- 172.21.15.138:0/2915517746 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f640b0070 con 0x7f9f7415aa60 2024-04-26T20:57:23.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.681+0000 7f9f73400640 1 -- 172.21.15.138:0/2915517746 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f640ab600 con 0x7f9f7415aa60 2024-04-26T20:57:23.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.681+0000 7f9f73400640 1 -- 172.21.15.138:0/2915517746 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f640ab9d0 con 0x7f9f7415aa60 2024-04-26T20:57:23.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.681+0000 7f9f7b000640 1 -- 172.21.15.138:0/2915517746 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f7415aa60 msgr2=0x7f9f740cc7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:23.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.681+0000 7f9f7b000640 1 --2- 172.21.15.138:0/2915517746 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f7415aa60 0x7f9f740cc7e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9f740b6d20 tx=0x7f9f6401c520 comp rx=0 tx=0).stop 2024-04-26T20:57:23.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.681+0000 7f9f7b000640 1 -- 172.21.15.138:0/2915517746 shutdown_connections 2024-04-26T20:57:23.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.681+0000 7f9f7b000640 1 --2- 172.21.15.138:0/2915517746 >> v2:172.21.15.143:3300/0 conn(0x7f9f7415e180 0x7f9f740cb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:23.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.681+0000 7f9f7b000640 1 --2- 172.21.15.138:0/2915517746 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9f740ccd20 0x7f9f740cb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:23.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.681+0000 7f9f7b000640 1 --2- 172.21.15.138:0/2915517746 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f7415aa60 0x7f9f740cc7e0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:23.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.681+0000 7f9f7b000640 1 -- 172.21.15.138:0/2915517746 >> 172.21.15.138:0/2915517746 conn(0x7f9f740d0bb0 msgr2=0x7f9f740d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:23.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.685+0000 7f9f7b000640 1 -- 172.21.15.138:0/2915517746 shutdown_connections 2024-04-26T20:57:23.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.685+0000 7f9f7b000640 1 -- 172.21.15.138:0/2915517746 wait complete. 2024-04-26T20:57:23.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.685+0000 7f9f7b000640 1 Processor -- start 2024-04-26T20:57:23.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.685+0000 7f9f7b000640 1 -- start start 2024-04-26T20:57:23.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.685+0000 7f9f7b000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f740ccd20 0x7f9f74150b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:23.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.685+0000 7f9f7b000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9f7415aa60 0x7f9f740aec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:23.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.685+0000 7f9f7b000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9f7415e180 0x7f9f740af5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:23.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.685+0000 7f9f7b000640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f9f740b64c0 con 0x7f9f740ccd20 2024-04-26T20:57:23.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.685+0000 7f9f7b000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f9f74072240 con 0x7f9f7415e180 2024-04-26T20:57:23.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.685+0000 7f9f7b000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f9f740b6640 con 0x7f9f7415aa60 2024-04-26T20:57:23.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.685+0000 7f9f73e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f740ccd20 0x7f9f74150b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:23.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.685+0000 7f9f73e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f740ccd20 0x7f9f74150b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40488/0 (socket says 172.21.15.138:40488) 2024-04-26T20:57:23.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.685+0000 7f9f73e00640 1 -- 172.21.15.138:0/2787509194 learned_addr learned my addr 172.21.15.138:0/2787509194 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:23.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.685+0000 7f9f73e00640 1 -- 172.21.15.138:0/2787509194 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9f7415aa60 msgr2=0x7f9f740aec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:23.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.685+0000 7f9f6b400640 1 --2- 172.21.15.138:0/2787509194 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9f7415aa60 0x7f9f740aec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:23.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.685+0000 7f9f73e00640 1 --2- 172.21.15.138:0/2787509194 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9f7415aa60 0x7f9f740aec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:23.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.685+0000 7f9f73e00640 1 -- 172.21.15.138:0/2787509194 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9f7415e180 msgr2=0x7f9f740af5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:23.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.685+0000 7f9f73e00640 1 --2- 172.21.15.138:0/2787509194 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9f7415e180 0x7f9f740af5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:23.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.685+0000 7f9f73e00640 1 -- 172.21.15.138:0/2787509194 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f740cebb0 con 0x7f9f740ccd20 2024-04-26T20:57:23.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.685+0000 7f9f73e00640 1 --2- 172.21.15.138:0/2787509194 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f740ccd20 0x7f9f74150b60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9f6401cdc0 tx=0x7f9f6401ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:23.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.685+0000 7f9f70c00640 1 -- 172.21.15.138:0/2787509194 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f640b0040 con 0x7f9f740ccd20 2024-04-26T20:57:23.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.685+0000 7f9f70c00640 1 -- 172.21.15.138:0/2787509194 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f640bc070 con 0x7f9f740ccd20 2024-04-26T20:57:23.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.685+0000 7f9f70c00640 1 -- 172.21.15.138:0/2787509194 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f640b6420 con 0x7f9f740ccd20 2024-04-26T20:57:23.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.685+0000 7f9f7b000640 1 -- 172.21.15.138:0/2787509194 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f740cee90 con 0x7f9f740ccd20 2024-04-26T20:57:23.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.685+0000 7f9f7b000640 1 -- 172.21.15.138:0/2787509194 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f740cf450 con 0x7f9f740ccd20 2024-04-26T20:57:23.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.689+0000 7f9f7b000640 1 -- 172.21.15.138:0/2787509194 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f74069430 con 0x7f9f740ccd20 2024-04-26T20:57:23.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.689+0000 7f9f70c00640 1 -- 172.21.15.138:0/2787509194 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9f640b65c0 con 0x7f9f740ccd20 2024-04-26T20:57:23.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.689+0000 7f9f70c00640 1 --2- 172.21.15.138:0/2787509194 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9f50068380 0x7f9f5006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:23.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.689+0000 7f9f70c00640 1 -- 172.21.15.138:0/2787509194 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7f9f64121010 con 0x7f9f740ccd20 2024-04-26T20:57:23.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.689+0000 7f9f6b400640 1 --2- 172.21.15.138:0/2787509194 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9f50068380 0x7f9f5006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:23.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.689+0000 7f9f6b400640 1 --2- 172.21.15.138:0/2787509194 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9f50068380 0x7f9f5006a840 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9f740b0600 tx=0x7f9f5c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:23.698 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.693+0000 7f9f70c00640 1 -- 172.21.15.138:0/2787509194 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9f64016110 con 0x7f9f740ccd20 2024-04-26T20:57:23.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.853+0000 7f9f7b000640 1 -- 172.21.15.138:0/2787509194 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f9f74073870 con 0x7f9f740ccd20 2024-04-26T20:57:23.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.853+0000 7f9f70c00640 1 -- 172.21.15.138:0/2787509194 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7f9f640f11a0 con 0x7f9f740ccd20 2024-04-26T20:57:23.856 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 64 2024-04-26T20:57:23.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.853+0000 7f9f7b000640 1 -- 172.21.15.138:0/2787509194 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9f50068380 msgr2=0x7f9f5006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:23.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.853+0000 7f9f7b000640 1 --2- 172.21.15.138:0/2787509194 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9f50068380 0x7f9f5006a840 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9f740b0600 tx=0x7f9f5c008040 comp rx=0 tx=0).stop 2024-04-26T20:57:23.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.853+0000 7f9f7b000640 1 -- 172.21.15.138:0/2787509194 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f740ccd20 msgr2=0x7f9f74150b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:23.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.853+0000 7f9f7b000640 1 --2- 172.21.15.138:0/2787509194 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f740ccd20 0x7f9f74150b60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9f6401cdc0 tx=0x7f9f6401ad60 comp rx=0 tx=0).stop 2024-04-26T20:57:23.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.853+0000 7f9f7b000640 1 -- 172.21.15.138:0/2787509194 shutdown_connections 2024-04-26T20:57:23.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.853+0000 7f9f7b000640 1 --2- 172.21.15.138:0/2787509194 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9f50068380 0x7f9f5006a840 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:23.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.853+0000 7f9f7b000640 1 --2- 172.21.15.138:0/2787509194 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9f7415e180 0x7f9f740af5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:23.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.853+0000 7f9f7b000640 1 --2- 172.21.15.138:0/2787509194 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9f7415aa60 0x7f9f740aec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:23.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.853+0000 7f9f7b000640 1 --2- 172.21.15.138:0/2787509194 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f740ccd20 0x7f9f74150b60 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:23.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.853+0000 7f9f7b000640 1 -- 172.21.15.138:0/2787509194 >> 172.21.15.138:0/2787509194 conn(0x7f9f740d0bb0 msgr2=0x7f9f740b13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:23.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.853+0000 7f9f7b000640 1 -- 172.21.15.138:0/2787509194 shutdown_connections 2024-04-26T20:57:23.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:23.853+0000 7f9f7b000640 1 -- 172.21.15.138:0/2787509194 wait complete. 2024-04-26T20:57:23.877 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T20:57:24.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.009+0000 7fd5e2a00640 1 Processor -- start 2024-04-26T20:57:24.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.009+0000 7fd5e2a00640 1 -- start start 2024-04-26T20:57:24.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.013+0000 7fd5e2a00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd5dc0b34f0 0x7fd5dc0cf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:24.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.013+0000 7fd5e2a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd5dc0d1490 0x7fd5dc0d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:24.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.013+0000 7fd5e2a00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5dc06e790 con 0x7fd5dc0b3b00 2024-04-26T20:57:24.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.013+0000 7fd5e2a00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fd5dc0d3da0 con 0x7fd5dc0b34f0 2024-04-26T20:57:24.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.013+0000 7fd5e2a00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fd5dc0d0fb0 con 0x7fd5dc0d1490 2024-04-26T20:57:24.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.013+0000 7fd5dbe00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd5dc0b34f0 0x7fd5dc0cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:24.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.013+0000 7fd5dbe00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd5dc0b34f0 0x7fd5dc0cf680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40498/0 (socket says 172.21.15.138:40498) 2024-04-26T20:57:24.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.013+0000 7fd5dbe00640 1 -- 172.21.15.138:0/3010300805 learned_addr learned my addr 172.21.15.138:0/3010300805 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:24.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.013+0000 7fd5e0a00640 1 --2- 172.21.15.138:0/3010300805 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd5dc0d1490 0x7fd5dc0d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:24.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.013+0000 7fd5dbe00640 1 -- 172.21.15.138:0/3010300805 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd5dc0d1490 msgr2=0x7fd5dc0d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:24.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.013+0000 7fd5dbe00640 1 --2- 172.21.15.138:0/3010300805 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd5dc0d1490 0x7fd5dc0d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:24.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.013+0000 7fd5dbe00640 1 -- 172.21.15.138:0/3010300805 >> v1:172.21.15.143:6789/0 conn(0x7fd5dc0b3b00 legacy=0x7fd5dc0cfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:24.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.013+0000 7fd5dbe00640 1 -- 172.21.15.138:0/3010300805 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5dc0b38d0 con 0x7fd5dc0b34f0 2024-04-26T20:57:24.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.017+0000 7fd5dbe00640 1 --2- 172.21.15.138:0/3010300805 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd5dc0b34f0 0x7fd5dc0cf680 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc009870 tx=0x7fd5cc01ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87dc30caf2a05295 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:24.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.017+0000 7fd5db400640 1 -- 172.21.15.138:0/3010300805 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc0b5070 con 0x7fd5dc0b34f0 2024-04-26T20:57:24.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.017+0000 7fd5db400640 1 -- 172.21.15.138:0/3010300805 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5cc0a8a50 con 0x7fd5dc0b34f0 2024-04-26T20:57:24.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.017+0000 7fd5db400640 1 -- 172.21.15.138:0/3010300805 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc0a8e20 con 0x7fd5dc0b34f0 2024-04-26T20:57:24.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.017+0000 7fd5e2a00640 1 -- 172.21.15.138:0/3010300805 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd5dc0b34f0 msgr2=0x7fd5dc0cf680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:24.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.017+0000 7fd5e2a00640 1 --2- 172.21.15.138:0/3010300805 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd5dc0b34f0 0x7fd5dc0cf680 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc009870 tx=0x7fd5cc01ed50 comp rx=0 tx=0).stop 2024-04-26T20:57:24.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.017+0000 7fd5e2a00640 1 -- 172.21.15.138:0/3010300805 shutdown_connections 2024-04-26T20:57:24.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.017+0000 7fd5e2a00640 1 --2- 172.21.15.138:0/3010300805 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd5dc0d1490 0x7fd5dc0d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:24.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.017+0000 7fd5e2a00640 1 --2- 172.21.15.138:0/3010300805 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd5dc0b34f0 0x7fd5dc0cf680 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:24.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.017+0000 7fd5e2a00640 1 -- 172.21.15.138:0/3010300805 >> 172.21.15.138:0/3010300805 conn(0x7fd5dc0d2e00 msgr2=0x7fd5dc0d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:24.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.017+0000 7fd5e2a00640 1 -- 172.21.15.138:0/3010300805 shutdown_connections 2024-04-26T20:57:24.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.017+0000 7fd5e2a00640 1 -- 172.21.15.138:0/3010300805 wait complete. 2024-04-26T20:57:24.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.017+0000 7fd5e2a00640 1 Processor -- start 2024-04-26T20:57:24.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.017+0000 7fd5e2a00640 1 -- start start 2024-04-26T20:57:24.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.021+0000 7fd5e2a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd5dc0b34f0 0x7fd5dc0ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:24.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.021+0000 7fd5e2a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd5dc0b3b00 0x7fd5dc0c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:24.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.021+0000 7fd5e2a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5dc0d1490 0x7fd5dc15de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:24.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.021+0000 7fd5e2a00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd5dc06e4b0 con 0x7fd5dc0b3b00 2024-04-26T20:57:24.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.021+0000 7fd5e2a00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fd5dc06e1d0 con 0x7fd5dc0d1490 2024-04-26T20:57:24.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.021+0000 7fd5e2a00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fd5dc0cd450 con 0x7fd5dc0b34f0 2024-04-26T20:57:24.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.021+0000 7fd5d3400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd5dc0b3b00 0x7fd5dc0c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:24.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.021+0000 7fd5d3400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd5dc0b3b00 0x7fd5dc0c87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40510/0 (socket says 172.21.15.138:40510) 2024-04-26T20:57:24.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.021+0000 7fd5d3400640 1 -- 172.21.15.138:0/1382059497 learned_addr learned my addr 172.21.15.138:0/1382059497 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:24.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.021+0000 7fd5dbe00640 1 --2- 172.21.15.138:0/1382059497 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd5dc0b34f0 0x7fd5dc0ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:24.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.021+0000 7fd5e0a00640 1 --2- 172.21.15.138:0/1382059497 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5dc0d1490 0x7fd5dc15de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:24.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.021+0000 7fd5d3400640 1 -- 172.21.15.138:0/1382059497 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd5dc0b34f0 msgr2=0x7fd5dc0ca8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:24.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.021+0000 7fd5d3400640 1 --2- 172.21.15.138:0/1382059497 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd5dc0b34f0 0x7fd5dc0ca8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:24.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.021+0000 7fd5d3400640 1 -- 172.21.15.138:0/1382059497 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5dc0d1490 msgr2=0x7fd5dc15de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:24.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.021+0000 7fd5d3400640 1 --2- 172.21.15.138:0/1382059497 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5dc0d1490 0x7fd5dc15de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:24.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.021+0000 7fd5d3400640 1 -- 172.21.15.138:0/1382059497 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5dc0c8d00 con 0x7fd5dc0b3b00 2024-04-26T20:57:24.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.021+0000 7fd5e0a00640 1 --2- 172.21.15.138:0/1382059497 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5dc0d1490 0x7fd5dc15de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:24.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.021+0000 7fd5d3400640 1 --2- 172.21.15.138:0/1382059497 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd5dc0b3b00 0x7fd5dc0c87c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd5c400c420 tx=0x7fd5c400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:24.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.021+0000 7fd5d8c00640 1 -- 172.21.15.138:0/1382059497 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c40052d0 con 0x7fd5dc0b3b00 2024-04-26T20:57:24.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.021+0000 7fd5d8c00640 1 -- 172.21.15.138:0/1382059497 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5c4005470 con 0x7fd5dc0b3b00 2024-04-26T20:57:24.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.021+0000 7fd5d8c00640 1 -- 172.21.15.138:0/1382059497 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c4007260 con 0x7fd5dc0b3b00 2024-04-26T20:57:24.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.021+0000 7fd5e2a00640 1 -- 172.21.15.138:0/1382059497 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5dc0caee0 con 0x7fd5dc0b3b00 2024-04-26T20:57:24.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.021+0000 7fd5e2a00640 1 -- 172.21.15.138:0/1382059497 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5dc0cb4a0 con 0x7fd5dc0b3b00 2024-04-26T20:57:24.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.021+0000 7fd5e2a00640 1 -- 172.21.15.138:0/1382059497 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5dc069430 con 0x7fd5dc0b3b00 2024-04-26T20:57:24.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.021+0000 7fd5d8c00640 1 -- 172.21.15.138:0/1382059497 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd5c4007400 con 0x7fd5dc0b3b00 2024-04-26T20:57:24.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.025+0000 7fd5d8c00640 1 --2- 172.21.15.138:0/1382059497 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd5b80683b0 0x7fd5b806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:24.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.025+0000 7fd5d8c00640 1 -- 172.21.15.138:0/1382059497 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7fd5c4086200 con 0x7fd5dc0b3b00 2024-04-26T20:57:24.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.025+0000 7fd5dbe00640 1 --2- 172.21.15.138:0/1382059497 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd5b80683b0 0x7fd5b806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:24.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.025+0000 7fd5dbe00640 1 --2- 172.21.15.138:0/1382059497 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd5b80683b0 0x7fd5b806a870 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc0b2000 tx=0x7fd5cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:24.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.029+0000 7fd5d8c00640 1 -- 172.21.15.138:0/1382059497 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd5c4055d40 con 0x7fd5dc0b3b00 2024-04-26T20:57:24.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.185+0000 7fd5e2a00640 1 -- 172.21.15.138:0/1382059497 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fd5dc0b8d80 con 0x7fd5dc0b3b00 2024-04-26T20:57:24.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.185+0000 7fd5d8c00640 1 -- 172.21.15.138:0/1382059497 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7fd5c405a040 con 0x7fd5dc0b3b00 2024-04-26T20:57:24.189 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 32 2024-04-26T20:57:24.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.185+0000 7fd5e2a00640 1 -- 172.21.15.138:0/1382059497 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd5b80683b0 msgr2=0x7fd5b806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:24.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.185+0000 7fd5e2a00640 1 --2- 172.21.15.138:0/1382059497 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd5b80683b0 0x7fd5b806a870 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc0b2000 tx=0x7fd5cc009040 comp rx=0 tx=0).stop 2024-04-26T20:57:24.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.185+0000 7fd5e2a00640 1 -- 172.21.15.138:0/1382059497 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd5dc0b3b00 msgr2=0x7fd5dc0c87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:24.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.185+0000 7fd5e2a00640 1 --2- 172.21.15.138:0/1382059497 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd5dc0b3b00 0x7fd5dc0c87c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd5c400c420 tx=0x7fd5c400c8e0 comp rx=0 tx=0).stop 2024-04-26T20:57:24.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.185+0000 7fd5e2a00640 1 -- 172.21.15.138:0/1382059497 shutdown_connections 2024-04-26T20:57:24.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.185+0000 7fd5e2a00640 1 --2- 172.21.15.138:0/1382059497 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd5b80683b0 0x7fd5b806a870 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:24.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.185+0000 7fd5e2a00640 1 --2- 172.21.15.138:0/1382059497 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5dc0d1490 0x7fd5dc15de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:24.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.185+0000 7fd5e2a00640 1 --2- 172.21.15.138:0/1382059497 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd5dc0b3b00 0x7fd5dc0c87c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:24.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.185+0000 7fd5e2a00640 1 --2- 172.21.15.138:0/1382059497 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd5dc0b34f0 0x7fd5dc0ca8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:24.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.185+0000 7fd5e2a00640 1 -- 172.21.15.138:0/1382059497 >> 172.21.15.138:0/1382059497 conn(0x7fd5dc0d2e00 msgr2=0x7fd5dc162880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:24.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.185+0000 7fd5e2a00640 1 -- 172.21.15.138:0/1382059497 shutdown_connections 2024-04-26T20:57:24.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.185+0000 7fd5e2a00640 1 -- 172.21.15.138:0/1382059497 wait complete. 2024-04-26T20:57:24.226 INFO:tasks.cephfs_test_runner:Starting test: test_rebuild_simple (tasks.cephfs.test_recovery_pool.TestRecoveryPool) 2024-04-26T20:57:24.227 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:57:24.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.361+0000 7f63e4800640 1 Processor -- start 2024-04-26T20:57:24.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.361+0000 7f63e4800640 1 -- start start 2024-04-26T20:57:24.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.361+0000 7f63e4800640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f63dc0cbe00 0x7f63dc06de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:24.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.365+0000 7f63e4800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f63dc0cc1e0 0x7f63dc073b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:24.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.365+0000 7f63e4800640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63dc0727f0 con 0x7f63dc0ce6f0 2024-04-26T20:57:24.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.365+0000 7f63e4800640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f63dc073680 con 0x7f63dc0cbe00 2024-04-26T20:57:24.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.365+0000 7f63e4800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f63dc072a70 con 0x7f63dc0cc1e0 2024-04-26T20:57:24.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.365+0000 7f63e1400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f63dc0cc1e0 0x7f63dc073b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:24.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.365+0000 7f63e2800640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f63dc0ce6f0 0x7f63dc0ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.138:44920/0 (socket says 172.21.15.138:44920) 2024-04-26T20:57:24.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.365+0000 7f63e2800640 1 -- 172.21.15.138:0/1797570807 learned_addr learned my addr 172.21.15.138:0/1797570807 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:24.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.365+0000 7f63e1e00640 1 --2- 172.21.15.138:0/1797570807 >> v2:172.21.15.143:3300/0 conn(0x7f63dc0cbe00 0x7f63dc06de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:24.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.365+0000 7f63e0a00640 1 -- 172.21.15.138:0/1797570807 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3782594248 0 0) 0x7f63d80014a0 con 0x7f63dc0ce6f0 2024-04-26T20:57:24.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.365+0000 7f63e0a00640 1 -- 172.21.15.138:0/1797570807 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63c4005740 con 0x7f63dc0ce6f0 2024-04-26T20:57:24.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.365+0000 7f63e1e00640 1 -- 172.21.15.138:0/1797570807 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f63dc0cc1e0 msgr2=0x7f63dc073b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:24.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.365+0000 7f63e1e00640 1 --2- 172.21.15.138:0/1797570807 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f63dc0cc1e0 0x7f63dc073b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:24.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.365+0000 7f63e1e00640 1 -- 172.21.15.138:0/1797570807 >> v1:172.21.15.143:6789/0 conn(0x7f63dc0ce6f0 legacy=0x7f63dc0ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:24.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.365+0000 7f63e1e00640 1 -- 172.21.15.138:0/1797570807 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63dc072d50 con 0x7f63dc0cbe00 2024-04-26T20:57:24.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.365+0000 7f63e1400640 1 --2- 172.21.15.138:0/1797570807 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f63dc0cc1e0 0x7f63dc073b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:57:24.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.369+0000 7f63e1e00640 1 --2- 172.21.15.138:0/1797570807 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f63dc0cbe00 0x7f63dc06de70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f63d00097c0 tx=0x7f63d001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10d294009e9ef3b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:24.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.369+0000 7f63e0a00640 1 -- 172.21.15.138:0/1797570807 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d00b0070 con 0x7f63dc0cbe00 2024-04-26T20:57:24.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.369+0000 7f63e0a00640 1 -- 172.21.15.138:0/1797570807 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63d00ab600 con 0x7f63dc0cbe00 2024-04-26T20:57:24.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.369+0000 7f63e0a00640 1 -- 172.21.15.138:0/1797570807 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d00ab9b0 con 0x7f63dc0cbe00 2024-04-26T20:57:24.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.369+0000 7f63e4800640 1 -- 172.21.15.138:0/1797570807 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f63dc0cbe00 msgr2=0x7f63dc06de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:24.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.369+0000 7f63e4800640 1 --2- 172.21.15.138:0/1797570807 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f63dc0cbe00 0x7f63dc06de70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f63d00097c0 tx=0x7f63d001c4a0 comp rx=0 tx=0).stop 2024-04-26T20:57:24.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.369+0000 7f63e4800640 1 -- 172.21.15.138:0/1797570807 shutdown_connections 2024-04-26T20:57:24.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.369+0000 7f63e4800640 1 --2- 172.21.15.138:0/1797570807 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f63dc0cc1e0 0x7f63dc073b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:24.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.369+0000 7f63e4800640 1 --2- 172.21.15.138:0/1797570807 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f63dc0cbe00 0x7f63dc06de70 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:24.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.369+0000 7f63e4800640 1 -- 172.21.15.138:0/1797570807 >> 172.21.15.138:0/1797570807 conn(0x7f63dc0d0b20 msgr2=0x7f63dc0d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:24.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.369+0000 7f63e4800640 1 -- 172.21.15.138:0/1797570807 shutdown_connections 2024-04-26T20:57:24.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.369+0000 7f63e4800640 1 -- 172.21.15.138:0/1797570807 wait complete. 2024-04-26T20:57:24.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.369+0000 7f63e4800640 1 Processor -- start 2024-04-26T20:57:24.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.369+0000 7f63e4800640 1 -- start start 2024-04-26T20:57:24.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.369+0000 7f63e4800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f63dc0cbe00 0x7f63dc147f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:24.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.369+0000 7f63e4800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f63dc0cc1e0 0x7f63dc0b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:24.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.373+0000 7f63e4800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f63dc0ce6f0 0x7f63dc0b1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:24.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.373+0000 7f63e4800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f63dc0741d0 con 0x7f63dc0cc1e0 2024-04-26T20:57:24.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.373+0000 7f63e4800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f63dc074050 con 0x7f63dc0ce6f0 2024-04-26T20:57:24.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.373+0000 7f63e4800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f63dc0d0780 con 0x7f63dc0cbe00 2024-04-26T20:57:24.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.373+0000 7f63e1400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f63dc0cc1e0 0x7f63dc0b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:24.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.373+0000 7f63e1400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f63dc0cc1e0 0x7f63dc0b3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40514/0 (socket says 172.21.15.138:40514) 2024-04-26T20:57:24.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.373+0000 7f63e1400640 1 -- 172.21.15.138:0/565288466 learned_addr learned my addr 172.21.15.138:0/565288466 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:24.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.373+0000 7f63e1e00640 1 --2- 172.21.15.138:0/565288466 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f63dc0cbe00 0x7f63dc147f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:24.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.373+0000 7f63e2800640 1 --2- 172.21.15.138:0/565288466 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f63dc0ce6f0 0x7f63dc0b1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:24.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.373+0000 7f63e1400640 1 -- 172.21.15.138:0/565288466 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f63dc0cbe00 msgr2=0x7f63dc147f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:24.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.373+0000 7f63e1400640 1 --2- 172.21.15.138:0/565288466 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f63dc0cbe00 0x7f63dc147f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:24.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.373+0000 7f63e1400640 1 -- 172.21.15.138:0/565288466 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f63dc0ce6f0 msgr2=0x7f63dc0b1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:24.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.373+0000 7f63e1400640 1 --2- 172.21.15.138:0/565288466 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f63dc0ce6f0 0x7f63dc0b1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:24.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.373+0000 7f63e1400640 1 -- 172.21.15.138:0/565288466 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63dc0b0b10 con 0x7f63dc0cc1e0 2024-04-26T20:57:24.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.373+0000 7f63e2800640 1 --2- 172.21.15.138:0/565288466 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f63dc0ce6f0 0x7f63dc0b1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:57:24.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.373+0000 7f63e1400640 1 --2- 172.21.15.138:0/565288466 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f63dc0cc1e0 0x7f63dc0b3fd0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f63cc00ebe0 tx=0x7f63cc00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:24.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.373+0000 7f63d6000640 1 -- 172.21.15.138:0/565288466 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63cc017070 con 0x7f63dc0cc1e0 2024-04-26T20:57:24.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.373+0000 7f63d6000640 1 -- 172.21.15.138:0/565288466 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63cc00cc30 con 0x7f63dc0cc1e0 2024-04-26T20:57:24.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.373+0000 7f63d6000640 1 -- 172.21.15.138:0/565288466 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63cc013470 con 0x7f63dc0cc1e0 2024-04-26T20:57:24.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.373+0000 7f63e4800640 1 -- 172.21.15.138:0/565288466 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63dc0b0df0 con 0x7f63dc0cc1e0 2024-04-26T20:57:24.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.373+0000 7f63e4800640 1 -- 172.21.15.138:0/565288466 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63dc0b13b0 con 0x7f63dc0cc1e0 2024-04-26T20:57:24.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.373+0000 7f63e4800640 1 -- 172.21.15.138:0/565288466 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63dc069510 con 0x7f63dc0cc1e0 2024-04-26T20:57:24.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.373+0000 7f63d6000640 1 -- 172.21.15.138:0/565288466 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f63cc01a070 con 0x7f63dc0cc1e0 2024-04-26T20:57:24.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.377+0000 7f63d6000640 1 --2- 172.21.15.138:0/565288466 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f63c00683b0 0x7f63c006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:24.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.377+0000 7f63d6000640 1 -- 172.21.15.138:0/565288466 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7f63cc086fd0 con 0x7f63dc0cc1e0 2024-04-26T20:57:24.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.377+0000 7f63e1e00640 1 --2- 172.21.15.138:0/565288466 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f63c00683b0 0x7f63c006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:24.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.377+0000 7f63e1e00640 1 --2- 172.21.15.138:0/565288466 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f63c00683b0 0x7f63c006a870 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f63d00ad000 tx=0x7f63d00a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:24.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.381+0000 7f63d6000640 1 -- 172.21.15.138:0/565288466 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f63cc057290 con 0x7f63dc0cc1e0 2024-04-26T20:57:24.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.537+0000 7f63e4800640 1 -- 172.21.15.138:0/565288466 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f63dc0c5690 con 0x7f63dc0cc1e0 2024-04-26T20:57:24.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.541+0000 7f63d6000640 1 -- 172.21.15.138:0/565288466 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18719 (secure 0 0 0) 0x7f63cc056b90 con 0x7f63dc0cc1e0 2024-04-26T20:57:24.544 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:57:24.545 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":29,"fsid":"c22b4730-12cc-4558-8535-b965384398c0","created":"2024-04-26T20:56:14.182475+0000","modified":"2024-04-26T20:57:20.395184+0000","last_up_change":"2024-04-26T20:56:26.013243+0000","last_in_change":"2024-04-26T20:56:16.714055+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:56:27.265834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:56:37.394398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:56:38.544369+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:56:42.240243+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3f9a2e34-3199-466f-a6cf-57927318121e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6801","nonce":3534772245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6803","nonce":3534772245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6807","nonce":3534772245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6805","nonce":3534772245}]},"public_addr":"172.21.15.138:6801/3534772245","cluster_addr":"172.21.15.138:6803/3534772245","heartbeat_back_addr":"172.21.15.138:6807/3534772245","heartbeat_front_addr":"172.21.15.138:6805/3534772245","state":["exists","up"]},{"osd":1,"uuid":"e881fcf6-3248-4696-a2ef-95d206d77712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6817","nonce":1427635773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6819","nonce":1427635773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6823","nonce":1427635773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6821","nonce":1427635773}]},"public_addr":"172.21.15.138:6817/1427635773","cluster_addr":"172.21.15.138:6819/1427635773","heartbeat_back_addr":"172.21.15.138:6823/1427635773","heartbeat_front_addr":"172.21.15.138:6821/1427635773","state":["exists","up"]},{"osd":2,"uuid":"f7d1db33-7672-4699-ae47-9f1e0a8e4222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6809","nonce":4273721573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6811","nonce":4273721573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6815","nonce":4273721573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6813","nonce":4273721573}]},"public_addr":"172.21.15.138:6809/4273721573","cluster_addr":"172.21.15.138:6811/4273721573","heartbeat_back_addr":"172.21.15.138:6815/4273721573","heartbeat_front_addr":"172.21.15.138:6813/4273721573","state":["exists","up"]},{"osd":3,"uuid":"2f4e0a9a-b8f6-4468-844a-a4501cd85054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6825","nonce":3098242154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6827","nonce":3098242154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6831","nonce":3098242154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6829","nonce":3098242154}]},"public_addr":"172.21.15.138:6825/3098242154","cluster_addr":"172.21.15.138:6827/3098242154","heartbeat_back_addr":"172.21.15.138:6831/3098242154","heartbeat_front_addr":"172.21.15.138:6829/3098242154","state":["exists","up"]},{"osd":4,"uuid":"c85df99b-3624-410e-866b-86830af2cfe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6801","nonce":2942056312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6803","nonce":2942056312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6807","nonce":2942056312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6805","nonce":2942056312}]},"public_addr":"172.21.15.143:6801/2942056312","cluster_addr":"172.21.15.143:6803/2942056312","heartbeat_back_addr":"172.21.15.143:6807/2942056312","heartbeat_front_addr":"172.21.15.143:6805/2942056312","state":["exists","up"]},{"osd":5,"uuid":"9af1efb5-c416-4808-b5ef-de0679ab9705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6809","nonce":1910222887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6811","nonce":1910222887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6815","nonce":1910222887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6813","nonce":1910222887}]},"public_addr":"172.21.15.143:6809/1910222887","cluster_addr":"172.21.15.143:6811/1910222887","heartbeat_back_addr":"172.21.15.143:6815/1910222887","heartbeat_front_addr":"172.21.15.143:6813/1910222887","state":["exists","up"]},{"osd":6,"uuid":"d7138615-8838-45ff-9072-2fd0683362f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6817","nonce":1082239825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6819","nonce":1082239825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6823","nonce":1082239825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6821","nonce":1082239825}]},"public_addr":"172.21.15.143:6817/1082239825","cluster_addr":"172.21.15.143:6819/1082239825","heartbeat_back_addr":"172.21.15.143:6823/1082239825","heartbeat_front_addr":"172.21.15.143:6821/1082239825","state":["exists","up"]},{"osd":7,"uuid":"0c27172b-35c4-49ec-ba0b-0137b8ff0010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6825","nonce":3295508495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6827","nonce":3295508495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6831","nonce":3295508495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6829","nonce":3295508495}]},"public_addr":"172.21.15.143:6825/3295508495","cluster_addr":"172.21.15.143:6827/3295508495","heartbeat_back_addr":"172.21.15.143:6831/3295508495","heartbeat_front_addr":"172.21.15.143:6829/3295508495","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.326627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.396119+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.433915+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.414179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.216947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.329272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.503073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.436382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.39","mappings":[{"from":0,"to":7}]},{"pgid":"4.6","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:57:24.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.541+0000 7f63e4800640 1 -- 172.21.15.138:0/565288466 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f63c00683b0 msgr2=0x7f63c006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:24.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.541+0000 7f63e4800640 1 --2- 172.21.15.138:0/565288466 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f63c00683b0 0x7f63c006a870 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f63d00ad000 tx=0x7f63d00a6000 comp rx=0 tx=0).stop 2024-04-26T20:57:24.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.541+0000 7f63e4800640 1 -- 172.21.15.138:0/565288466 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f63dc0cc1e0 msgr2=0x7f63dc0b3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:24.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.541+0000 7f63e4800640 1 --2- 172.21.15.138:0/565288466 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f63dc0cc1e0 0x7f63dc0b3fd0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f63cc00ebe0 tx=0x7f63cc00c520 comp rx=0 tx=0).stop 2024-04-26T20:57:24.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.541+0000 7f63e4800640 1 -- 172.21.15.138:0/565288466 shutdown_connections 2024-04-26T20:57:24.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.541+0000 7f63e4800640 1 --2- 172.21.15.138:0/565288466 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f63c00683b0 0x7f63c006a870 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:24.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.541+0000 7f63e4800640 1 --2- 172.21.15.138:0/565288466 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f63dc0ce6f0 0x7f63dc0b1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:24.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.541+0000 7f63e4800640 1 --2- 172.21.15.138:0/565288466 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f63dc0cc1e0 0x7f63dc0b3fd0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:24.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.541+0000 7f63e4800640 1 --2- 172.21.15.138:0/565288466 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f63dc0cbe00 0x7f63dc147f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:24.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.541+0000 7f63e4800640 1 -- 172.21.15.138:0/565288466 >> 172.21.15.138:0/565288466 conn(0x7f63dc0d0b20 msgr2=0x7f63dc15ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:24.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.541+0000 7f63e4800640 1 -- 172.21.15.138:0/565288466 shutdown_connections 2024-04-26T20:57:24.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.541+0000 7f63e4800640 1 -- 172.21.15.138:0/565288466 wait complete. 2024-04-26T20:57:24.566 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:56:27.265834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T20:56:37.394398+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T20:56:38.544369+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T20:56:42.240243+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T20:57:24.567 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T20:57:24.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.701+0000 7f3f7ce00640 1 Processor -- start 2024-04-26T20:57:24.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.701+0000 7f3f7ce00640 1 -- start start 2024-04-26T20:57:24.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.701+0000 7f3f7ce00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f3f78073d70 0x7f3f78160040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:24.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.701+0000 7f3f7ce00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f7806dee0 con 0x7f3f7806f880 2024-04-26T20:57:24.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.701+0000 7f3f7ce00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f7815c1a0 con 0x7f3f7815bdc0 2024-04-26T20:57:24.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.701+0000 7f3f7ce00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f3f7806e180 con 0x7f3f78073d70 2024-04-26T20:57:24.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.701+0000 7f3f75400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f3f78073d70 0x7f3f78160040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:24.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.701+0000 7f3f76800640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f3f7806f880 0x7f3f780ce780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:58100/0 (socket says 172.21.15.138:58100) 2024-04-26T20:57:24.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.701+0000 7f3f75400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f3f78073d70 0x7f3f78160040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40524/0 (socket says 172.21.15.138:40524) 2024-04-26T20:57:24.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.701+0000 7f3f76800640 1 -- 172.21.15.138:0/107900568 learned_addr learned my addr 172.21.15.138:0/107900568 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:24.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.701+0000 7f3f75400640 1 -- 172.21.15.138:0/107900568 >> v1:172.21.15.143:6789/0 conn(0x7f3f7815bdc0 legacy=0x7f3f7815f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:24.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.701+0000 7f3f75400640 1 -- 172.21.15.138:0/107900568 >> v1:172.21.15.138:6789/0 conn(0x7f3f7806f880 legacy=0x7f3f780ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:24.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.701+0000 7f3f75400640 1 -- 172.21.15.138:0/107900568 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f7806e460 con 0x7f3f78073d70 2024-04-26T20:57:24.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.701+0000 7f3f74a00640 1 -- 172.21.15.138:0/107900568 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3583750197 0 0) 0x7f3f7806dee0 con 0x7f3f7806f880 2024-04-26T20:57:24.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.705+0000 7f3f75400640 1 --2- 172.21.15.138:0/107900568 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3f78073d70 0x7f3f78160040 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3f640097c0 tx=0x7f3f6401c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33513259623d124f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:24.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.705+0000 7f3f74a00640 1 -- 172.21.15.138:0/107900568 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f640b0070 con 0x7f3f78073d70 2024-04-26T20:57:24.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.705+0000 7f3f74a00640 1 -- 172.21.15.138:0/107900568 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f640ab600 con 0x7f3f78073d70 2024-04-26T20:57:24.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.705+0000 7f3f74a00640 1 -- 172.21.15.138:0/107900568 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f640ab9d0 con 0x7f3f78073d70 2024-04-26T20:57:24.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.705+0000 7f3f7ce00640 1 -- 172.21.15.138:0/107900568 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3f78073d70 msgr2=0x7f3f78160040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:24.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.705+0000 7f3f7ce00640 1 --2- 172.21.15.138:0/107900568 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3f78073d70 0x7f3f78160040 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3f640097c0 tx=0x7f3f6401c380 comp rx=0 tx=0).stop 2024-04-26T20:57:24.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.705+0000 7f3f7ce00640 1 -- 172.21.15.138:0/107900568 shutdown_connections 2024-04-26T20:57:24.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.705+0000 7f3f7ce00640 1 --2- 172.21.15.138:0/107900568 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3f78073d70 0x7f3f78160040 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:24.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.705+0000 7f3f7ce00640 1 -- 172.21.15.138:0/107900568 >> 172.21.15.138:0/107900568 conn(0x7f3f780d0bb0 msgr2=0x7f3f780d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:24.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.705+0000 7f3f7ce00640 1 -- 172.21.15.138:0/107900568 shutdown_connections 2024-04-26T20:57:24.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.705+0000 7f3f7ce00640 1 -- 172.21.15.138:0/107900568 wait complete. 2024-04-26T20:57:24.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.705+0000 7f3f7ce00640 1 Processor -- start 2024-04-26T20:57:24.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.705+0000 7f3f7ce00640 1 -- start start 2024-04-26T20:57:24.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.709+0000 7f3f7ce00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f7806f880 0x7f3f780c6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:24.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.709+0000 7f3f7ce00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3f78073d70 0x7f3f78156e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:24.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.709+0000 7f3f7ce00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3f7815bdc0 0x7f3f78148bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:24.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.709+0000 7f3f7ce00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f3f78169ce0 con 0x7f3f7815bdc0 2024-04-26T20:57:24.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.709+0000 7f3f7ce00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f3f78160790 con 0x7f3f7806f880 2024-04-26T20:57:24.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.709+0000 7f3f7ce00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f3f78169e60 con 0x7f3f78073d70 2024-04-26T20:57:24.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.709+0000 7f3f76800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3f7815bdc0 0x7f3f78148bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:24.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.709+0000 7f3f76800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3f7815bdc0 0x7f3f78148bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40526/0 (socket says 172.21.15.138:40526) 2024-04-26T20:57:24.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.709+0000 7f3f76800640 1 -- 172.21.15.138:0/1440189481 learned_addr learned my addr 172.21.15.138:0/1440189481 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:24.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.709+0000 7f3f75e00640 1 --2- 172.21.15.138:0/1440189481 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f7806f880 0x7f3f780c6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:24.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.709+0000 7f3f75400640 1 --2- 172.21.15.138:0/1440189481 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3f78073d70 0x7f3f78156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:24.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.709+0000 7f3f76800640 1 -- 172.21.15.138:0/1440189481 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3f78073d70 msgr2=0x7f3f78156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:24.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.709+0000 7f3f76800640 1 --2- 172.21.15.138:0/1440189481 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3f78073d70 0x7f3f78156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:24.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.709+0000 7f3f76800640 1 -- 172.21.15.138:0/1440189481 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f7806f880 msgr2=0x7f3f780c6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:24.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.709+0000 7f3f76800640 1 --2- 172.21.15.138:0/1440189481 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f7806f880 0x7f3f780c6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:24.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.709+0000 7f3f76800640 1 -- 172.21.15.138:0/1440189481 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f780b5a40 con 0x7f3f7815bdc0 2024-04-26T20:57:24.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.709+0000 7f3f75e00640 1 --2- 172.21.15.138:0/1440189481 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f7806f880 0x7f3f780c6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:24.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.709+0000 7f3f75400640 1 --2- 172.21.15.138:0/1440189481 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3f78073d70 0x7f3f78156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:24.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.709+0000 7f3f76800640 1 --2- 172.21.15.138:0/1440189481 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3f7815bdc0 0x7f3f78148bc0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3f7000c7a0 tx=0x7f3f7000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:24.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.709+0000 7f3f6e000640 1 -- 172.21.15.138:0/1440189481 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f70018070 con 0x7f3f7815bdc0 2024-04-26T20:57:24.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.709+0000 7f3f6e000640 1 -- 172.21.15.138:0/1440189481 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f7000a640 con 0x7f3f7815bdc0 2024-04-26T20:57:24.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.709+0000 7f3f7ce00640 1 -- 172.21.15.138:0/1440189481 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f780b5d20 con 0x7f3f7815bdc0 2024-04-26T20:57:24.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.709+0000 7f3f6e000640 1 -- 172.21.15.138:0/1440189481 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f7000aa70 con 0x7f3f7815bdc0 2024-04-26T20:57:24.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.709+0000 7f3f7ce00640 1 -- 172.21.15.138:0/1440189481 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f780b62e0 con 0x7f3f7815bdc0 2024-04-26T20:57:24.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.709+0000 7f3f7ce00640 1 -- 172.21.15.138:0/1440189481 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f780c44f0 con 0x7f3f7815bdc0 2024-04-26T20:57:24.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.713+0000 7f3f6e000640 1 -- 172.21.15.138:0/1440189481 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3f7001b070 con 0x7f3f7815bdc0 2024-04-26T20:57:24.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.713+0000 7f3f6e000640 1 --2- 172.21.15.138:0/1440189481 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f3f58068380 0x7f3f5806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:24.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.713+0000 7f3f6e000640 1 -- 172.21.15.138:0/1440189481 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7f3f70086370 con 0x7f3f7815bdc0 2024-04-26T20:57:24.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.713+0000 7f3f75e00640 1 --2- 172.21.15.138:0/1440189481 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f3f58068380 0x7f3f5806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:24.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.713+0000 7f3f75e00640 1 --2- 172.21.15.138:0/1440189481 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f3f58068380 0x7f3f5806a840 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3f68000f70 tx=0x7f3f68009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:24.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.717+0000 7f3f6e000640 1 -- 172.21.15.138:0/1440189481 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3f780c44f0 con 0x7f3f7815bdc0 2024-04-26T20:57:24.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.873+0000 7f3f7ce00640 1 -- 172.21.15.138:0/1440189481 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3f780b6930 con 0x7f3f7815bdc0 2024-04-26T20:57:24.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.873+0000 7f3f6e000640 1 -- 172.21.15.138:0/1440189481 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f3f700565a0 con 0x7f3f7815bdc0 2024-04-26T20:57:24.877 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 1 2024-04-26T20:57:24.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.873+0000 7f3f7ce00640 1 -- 172.21.15.138:0/1440189481 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f3f58068380 msgr2=0x7f3f5806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:24.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.873+0000 7f3f7ce00640 1 --2- 172.21.15.138:0/1440189481 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f3f58068380 0x7f3f5806a840 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3f68000f70 tx=0x7f3f68009040 comp rx=0 tx=0).stop 2024-04-26T20:57:24.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.873+0000 7f3f7ce00640 1 -- 172.21.15.138:0/1440189481 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3f7815bdc0 msgr2=0x7f3f78148bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:24.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.873+0000 7f3f7ce00640 1 --2- 172.21.15.138:0/1440189481 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3f7815bdc0 0x7f3f78148bc0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3f7000c7a0 tx=0x7f3f7000cc60 comp rx=0 tx=0).stop 2024-04-26T20:57:24.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.873+0000 7f3f7ce00640 1 -- 172.21.15.138:0/1440189481 shutdown_connections 2024-04-26T20:57:24.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.873+0000 7f3f7ce00640 1 --2- 172.21.15.138:0/1440189481 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f3f58068380 0x7f3f5806a840 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:24.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.873+0000 7f3f7ce00640 1 --2- 172.21.15.138:0/1440189481 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3f7815bdc0 0x7f3f78148bc0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:24.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.873+0000 7f3f7ce00640 1 --2- 172.21.15.138:0/1440189481 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3f78073d70 0x7f3f78156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:24.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.873+0000 7f3f7ce00640 1 --2- 172.21.15.138:0/1440189481 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f7806f880 0x7f3f780c6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:24.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.873+0000 7f3f7ce00640 1 -- 172.21.15.138:0/1440189481 >> 172.21.15.138:0/1440189481 conn(0x7f3f780d0bb0 msgr2=0x7f3f78166750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:24.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.877+0000 7f3f7ce00640 1 -- 172.21.15.138:0/1440189481 shutdown_connections 2024-04-26T20:57:24.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:24.877+0000 7f3f7ce00640 1 -- 172.21.15.138:0/1440189481 wait complete. 2024-04-26T20:57:24.899 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T20:57:25.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.033+0000 7fae13200640 1 Processor -- start 2024-04-26T20:57:25.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.033+0000 7fae13200640 1 -- start start 2024-04-26T20:57:25.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.033+0000 7fae13200640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fae1415bfe0 0x7fae140b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:25.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.033+0000 7fae13200640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fae1406f6e0 0x7fae1406fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:25.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.033+0000 7fae13200640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae140707a0 con 0x7fae140b38c0 2024-04-26T20:57:25.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.033+0000 7fae13200640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fae14070060 con 0x7fae1415bfe0 2024-04-26T20:57:25.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.033+0000 7fae13200640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fae1415c3c0 con 0x7fae1406f6e0 2024-04-26T20:57:25.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.033+0000 7fae11e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fae1415bfe0 0x7fae140b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:25.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.033+0000 7fae11e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fae1415bfe0 0x7fae140b4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40536/0 (socket says 172.21.15.138:40536) 2024-04-26T20:57:25.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.033+0000 7fae11e00640 1 -- 172.21.15.138:0/2563135390 learned_addr learned my addr 172.21.15.138:0/2563135390 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:25.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.037+0000 7fae09400640 1 --2- 172.21.15.138:0/2563135390 >> v2:172.21.15.143:3300/0 conn(0x7fae1406f6e0 0x7fae1406fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:25.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.037+0000 7fae11e00640 1 -- 172.21.15.138:0/2563135390 >> v2:172.21.15.143:3300/0 conn(0x7fae1406f6e0 msgr2=0x7fae1406fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:25.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.037+0000 7fae11e00640 1 --2- 172.21.15.138:0/2563135390 >> v2:172.21.15.143:3300/0 conn(0x7fae1406f6e0 0x7fae1406fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:25.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.037+0000 7fae11e00640 1 -- 172.21.15.138:0/2563135390 >> v1:172.21.15.143:6789/0 conn(0x7fae140b38c0 legacy=0x7fae140b3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:25.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.037+0000 7fae11e00640 1 -- 172.21.15.138:0/2563135390 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae140727c0 con 0x7fae1415bfe0 2024-04-26T20:57:25.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.037+0000 7fae11e00640 1 --2- 172.21.15.138:0/2563135390 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fae1415bfe0 0x7fae140b4ea0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fae140d1ac0 tx=0x7fae0401f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bf83c01dc7825fc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:25.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.037+0000 7fae11400640 1 -- 172.21.15.138:0/2563135390 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae040b4070 con 0x7fae1415bfe0 2024-04-26T20:57:25.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.037+0000 7fae11400640 1 -- 172.21.15.138:0/2563135390 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae040af400 con 0x7fae1415bfe0 2024-04-26T20:57:25.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.037+0000 7fae11400640 1 -- 172.21.15.138:0/2563135390 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae040af7d0 con 0x7fae1415bfe0 2024-04-26T20:57:25.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.037+0000 7fae13200640 1 -- 172.21.15.138:0/2563135390 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fae1415bfe0 msgr2=0x7fae140b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:25.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.037+0000 7fae13200640 1 --2- 172.21.15.138:0/2563135390 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fae1415bfe0 0x7fae140b4ea0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fae140d1ac0 tx=0x7fae0401f1e0 comp rx=0 tx=0).stop 2024-04-26T20:57:25.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.037+0000 7fae13200640 1 -- 172.21.15.138:0/2563135390 shutdown_connections 2024-04-26T20:57:25.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.041+0000 7fae13200640 1 --2- 172.21.15.138:0/2563135390 >> v2:172.21.15.143:3300/0 conn(0x7fae1406f6e0 0x7fae1406fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:25.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.041+0000 7fae13200640 1 --2- 172.21.15.138:0/2563135390 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fae1415bfe0 0x7fae140b4ea0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:25.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.041+0000 7fae13200640 1 -- 172.21.15.138:0/2563135390 >> 172.21.15.138:0/2563135390 conn(0x7fae140b25c0 msgr2=0x7fae140b29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:25.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.041+0000 7fae13200640 1 -- 172.21.15.138:0/2563135390 shutdown_connections 2024-04-26T20:57:25.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.041+0000 7fae13200640 1 -- 172.21.15.138:0/2563135390 wait complete. 2024-04-26T20:57:25.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.041+0000 7fae13200640 1 Processor -- start 2024-04-26T20:57:25.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.041+0000 7fae13200640 1 -- start start 2024-04-26T20:57:25.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.041+0000 7fae13200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fae1406f6e0 0x7fae14148050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:25.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.041+0000 7fae13200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fae140b38c0 0x7fae1414fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:25.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.041+0000 7fae13200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fae1415bfe0 0x7fae14150160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:25.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.041+0000 7fae13200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fae14073020 con 0x7fae1415bfe0 2024-04-26T20:57:25.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.041+0000 7fae13200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fae14072d40 con 0x7fae140b38c0 2024-04-26T20:57:25.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.041+0000 7fae13200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fae14073300 con 0x7fae1406f6e0 2024-04-26T20:57:25.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.041+0000 7fae12800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fae1415bfe0 0x7fae14150160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:25.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.041+0000 7fae12800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fae1415bfe0 0x7fae14150160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40544/0 (socket says 172.21.15.138:40544) 2024-04-26T20:57:25.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.041+0000 7fae12800640 1 -- 172.21.15.138:0/3986507719 learned_addr learned my addr 172.21.15.138:0/3986507719 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:25.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.041+0000 7fae11e00640 1 --2- 172.21.15.138:0/3986507719 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fae1406f6e0 0x7fae14148050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:25.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.041+0000 7fae09400640 1 --2- 172.21.15.138:0/3986507719 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fae140b38c0 0x7fae1414fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:25.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.041+0000 7fae12800640 1 -- 172.21.15.138:0/3986507719 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fae1406f6e0 msgr2=0x7fae14148050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:25.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.041+0000 7fae12800640 1 --2- 172.21.15.138:0/3986507719 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fae1406f6e0 0x7fae14148050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:25.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.041+0000 7fae12800640 1 -- 172.21.15.138:0/3986507719 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fae140b38c0 msgr2=0x7fae1414fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:25.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.041+0000 7fae12800640 1 --2- 172.21.15.138:0/3986507719 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fae140b38c0 0x7fae1414fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:25.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.041+0000 7fae12800640 1 -- 172.21.15.138:0/3986507719 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae14156140 con 0x7fae1415bfe0 2024-04-26T20:57:25.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.041+0000 7fae09400640 1 --2- 172.21.15.138:0/3986507719 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fae140b38c0 0x7fae1414fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:25.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.041+0000 7fae12800640 1 --2- 172.21.15.138:0/3986507719 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fae1415bfe0 0x7fae14150160 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fae0c00c430 tx=0x7fae0c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:25.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.041+0000 7fae0aa00640 1 -- 172.21.15.138:0/3986507719 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0c005220 con 0x7fae1415bfe0 2024-04-26T20:57:25.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.041+0000 7fae0aa00640 1 -- 172.21.15.138:0/3986507719 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae0c0053c0 con 0x7fae1415bfe0 2024-04-26T20:57:25.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.041+0000 7fae13200640 1 -- 172.21.15.138:0/3986507719 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae141558a0 con 0x7fae1415bfe0 2024-04-26T20:57:25.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.041+0000 7fae0aa00640 1 -- 172.21.15.138:0/3986507719 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0c007270 con 0x7fae1415bfe0 2024-04-26T20:57:25.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.041+0000 7fae13200640 1 -- 172.21.15.138:0/3986507719 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae14155e60 con 0x7fae1415bfe0 2024-04-26T20:57:25.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.045+0000 7fae13200640 1 -- 172.21.15.138:0/3986507719 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae14069430 con 0x7fae1415bfe0 2024-04-26T20:57:25.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.045+0000 7fae0aa00640 1 -- 172.21.15.138:0/3986507719 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fae0c019020 con 0x7fae1415bfe0 2024-04-26T20:57:25.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.045+0000 7fae0aa00640 1 --2- 172.21.15.138:0/3986507719 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fadf0068380 0x7fadf006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:25.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.045+0000 7fae0aa00640 1 -- 172.21.15.138:0/3986507719 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7fae0c086070 con 0x7fae1415bfe0 2024-04-26T20:57:25.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.045+0000 7fae11e00640 1 --2- 172.21.15.138:0/3986507719 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fadf0068380 0x7fadf006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:25.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.045+0000 7fae11e00640 1 --2- 172.21.15.138:0/3986507719 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fadf0068380 0x7fadf006a840 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fae040b1000 tx=0x7fae040aa000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:25.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.049+0000 7fae0aa00640 1 -- 172.21.15.138:0/3986507719 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fae0c056290 con 0x7fae1415bfe0 2024-04-26T20:57:25.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.209+0000 7fae13200640 1 -- 172.21.15.138:0/3986507719 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fae140ce950 con 0x7fae1415bfe0 2024-04-26T20:57:25.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.209+0000 7fae0aa00640 1 -- 172.21.15.138:0/3986507719 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7fae0c055b90 con 0x7fae1415bfe0 2024-04-26T20:57:25.212 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 32 2024-04-26T20:57:25.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.209+0000 7fae13200640 1 -- 172.21.15.138:0/3986507719 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fadf0068380 msgr2=0x7fadf006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:25.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.209+0000 7fae13200640 1 --2- 172.21.15.138:0/3986507719 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fadf0068380 0x7fadf006a840 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fae040b1000 tx=0x7fae040aa000 comp rx=0 tx=0).stop 2024-04-26T20:57:25.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.209+0000 7fae13200640 1 -- 172.21.15.138:0/3986507719 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fae1415bfe0 msgr2=0x7fae14150160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:25.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.209+0000 7fae13200640 1 --2- 172.21.15.138:0/3986507719 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fae1415bfe0 0x7fae14150160 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fae0c00c430 tx=0x7fae0c00c8f0 comp rx=0 tx=0).stop 2024-04-26T20:57:25.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.209+0000 7fae13200640 1 -- 172.21.15.138:0/3986507719 shutdown_connections 2024-04-26T20:57:25.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.209+0000 7fae13200640 1 --2- 172.21.15.138:0/3986507719 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fadf0068380 0x7fadf006a840 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:25.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.209+0000 7fae13200640 1 --2- 172.21.15.138:0/3986507719 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fae1415bfe0 0x7fae14150160 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:25.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.209+0000 7fae13200640 1 --2- 172.21.15.138:0/3986507719 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fae140b38c0 0x7fae1414fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:25.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.209+0000 7fae13200640 1 --2- 172.21.15.138:0/3986507719 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fae1406f6e0 0x7fae14148050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:25.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.209+0000 7fae13200640 1 -- 172.21.15.138:0/3986507719 >> 172.21.15.138:0/3986507719 conn(0x7fae140b25c0 msgr2=0x7fae140b3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:25.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.209+0000 7fae13200640 1 -- 172.21.15.138:0/3986507719 shutdown_connections 2024-04-26T20:57:25.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.209+0000 7fae13200640 1 -- 172.21.15.138:0/3986507719 wait complete. 2024-04-26T20:57:25.233 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T20:57:25.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.369+0000 7f4f0a800640 1 Processor -- start 2024-04-26T20:57:25.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.369+0000 7f4f0a800640 1 -- start start 2024-04-26T20:57:25.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.369+0000 7f4f0a800640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4f0415aa60 0x7f4f040cc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:25.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.369+0000 7f4f0a800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4f040ccd20 0x7f4f040cb200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:25.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.369+0000 7f4f0a800640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f040cd210 con 0x7f4f0415e180 2024-04-26T20:57:25.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.369+0000 7f4f0a800640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f4f0415d6a0 con 0x7f4f0415aa60 2024-04-26T20:57:25.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.369+0000 7f4f0a800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f4f0415d980 con 0x7f4f040ccd20 2024-04-26T20:57:25.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.369+0000 7f4f03e00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f4f0415e180 0x7f4f040b5aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:58114/0 (socket says 172.21.15.138:58114) 2024-04-26T20:57:25.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.369+0000 7f4f03e00640 1 -- 172.21.15.138:0/3396497927 learned_addr learned my addr 172.21.15.138:0/3396497927 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:25.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.369+0000 7f4f03400640 1 --2- 172.21.15.138:0/3396497927 >> v2:172.21.15.143:3300/0 conn(0x7f4f0415aa60 0x7f4f040cc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:25.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.369+0000 7f4efaa00640 1 --2- 172.21.15.138:0/3396497927 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4f040ccd20 0x7f4f040cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:25.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.369+0000 7f4f02a00640 1 -- 172.21.15.138:0/3396497927 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2335745234 0 0) 0x7f4f040cd210 con 0x7f4f0415e180 2024-04-26T20:57:25.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.369+0000 7f4f02a00640 1 -- 172.21.15.138:0/3396497927 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ee8003530 con 0x7f4f0415e180 2024-04-26T20:57:25.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.369+0000 7f4f02a00640 1 -- 172.21.15.138:0/3396497927 <== mon.0 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3039462302 0 0) 0x7f4ee8003530 con 0x7f4f0415e180 2024-04-26T20:57:25.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.369+0000 7f4f02a00640 1 -- 172.21.15.138:0/3396497927 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4f040ccd20 msgr2=0x7f4f040cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:25.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.369+0000 7f4f02a00640 1 --2- 172.21.15.138:0/3396497927 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4f040ccd20 0x7f4f040cb200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:25.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.369+0000 7f4f02a00640 1 -- 172.21.15.138:0/3396497927 >> v2:172.21.15.143:3300/0 conn(0x7f4f0415aa60 msgr2=0x7f4f040cc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:25.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.369+0000 7f4f02a00640 1 --2- 172.21.15.138:0/3396497927 >> v2:172.21.15.143:3300/0 conn(0x7f4f0415aa60 0x7f4f040cc7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:25.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.369+0000 7f4f02a00640 1 -- 172.21.15.138:0/3396497927 --> v1:172.21.15.138:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f0415dc60 con 0x7f4f0415e180 2024-04-26T20:57:25.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.369+0000 7f4f02a00640 1 -- 172.21.15.138:0/3396497927 <== mon.0 v1:172.21.15.138:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2715389689 0 0) 0x7f4efc001a00 con 0x7f4f0415e180 2024-04-26T20:57:25.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.369+0000 7f4f02a00640 1 -- 172.21.15.138:0/3396497927 >> v1:172.21.15.138:6789/0 conn(0x7f4f0415e180 legacy=0x7f4f040b5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:25.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.369+0000 7f4f02a00640 1 --2- 172.21.15.138:0/3396497927 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ee8003a30 0x7f4ee8003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:25.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.369+0000 7f4f02a00640 1 --2- 172.21.15.138:0/3396497927 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4f040ccd20 0x7f4ee8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:25.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.369+0000 7f4f02a00640 1 --2- 172.21.15.138:0/3396497927 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ee8004d50 0x7f4ee80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:25.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.369+0000 7f4f02a00640 1 -- 172.21.15.138:0/3396497927 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f4f0415d6a0 con 0x7f4ee8004d50 2024-04-26T20:57:25.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.369+0000 7f4f02a00640 1 -- 172.21.15.138:0/3396497927 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f4f0415d980 con 0x7f4ee8003a30 2024-04-26T20:57:25.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.369+0000 7f4f02a00640 1 -- 172.21.15.138:0/3396497927 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f4ee800b9d0 con 0x7f4f040ccd20 2024-04-26T20:57:25.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.369+0000 7f4f03e00640 1 --2- 172.21.15.138:0/3396497927 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ee8004d50 0x7f4ee80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:25.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.369+0000 7f4f03400640 1 --2- 172.21.15.138:0/3396497927 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ee8003a30 0x7f4ee8003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:25.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.369+0000 7f4efaa00640 1 --2- 172.21.15.138:0/3396497927 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4f040ccd20 0x7f4ee8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:25.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.369+0000 7f4f03e00640 1 -- 172.21.15.138:0/3396497927 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4f040ccd20 msgr2=0x7f4ee8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:25.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.369+0000 7f4f03e00640 1 --2- 172.21.15.138:0/3396497927 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4f040ccd20 0x7f4ee8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:25.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.369+0000 7f4f03e00640 1 -- 172.21.15.138:0/3396497927 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ee8003a30 msgr2=0x7f4ee8003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:25.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.369+0000 7f4f03e00640 1 --2- 172.21.15.138:0/3396497927 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ee8003a30 0x7f4ee8003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:25.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.369+0000 7f4f03e00640 1 -- 172.21.15.138:0/3396497927 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ee8003530 con 0x7f4ee8004d50 2024-04-26T20:57:25.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.369+0000 7f4f03400640 1 --2- 172.21.15.138:0/3396497927 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ee8003a30 0x7f4ee8003e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:57:25.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.373+0000 7f4f03e00640 1 --2- 172.21.15.138:0/3396497927 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ee8004d50 0x7f4ee80051d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4efc00ed40 tx=0x7f4efc021750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74fa28c1d32cce50 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:25.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.373+0000 7f4f02a00640 1 -- 172.21.15.138:0/3396497927 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4efc0af070 con 0x7f4ee8004d50 2024-04-26T20:57:25.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.373+0000 7f4f02a00640 1 -- 172.21.15.138:0/3396497927 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4efc0ab4e0 con 0x7f4ee8004d50 2024-04-26T20:57:25.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.373+0000 7f4f02a00640 1 -- 172.21.15.138:0/3396497927 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4efc00e960 con 0x7f4ee8004d50 2024-04-26T20:57:25.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.373+0000 7f4f0a800640 1 -- 172.21.15.138:0/3396497927 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ee8004d50 msgr2=0x7f4ee80051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:25.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.373+0000 7f4f0a800640 1 --2- 172.21.15.138:0/3396497927 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ee8004d50 0x7f4ee80051d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4efc00ed40 tx=0x7f4efc021750 comp rx=0 tx=0).stop 2024-04-26T20:57:25.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.373+0000 7f4f03e00640 1 -- 172.21.15.138:0/3396497927 reap_dead start 2024-04-26T20:57:25.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.373+0000 7f4f0a800640 1 -- 172.21.15.138:0/3396497927 shutdown_connections 2024-04-26T20:57:25.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.373+0000 7f4f0a800640 1 -- 172.21.15.138:0/3396497927 >> 172.21.15.138:0/3396497927 conn(0x7f4f040d0bb0 msgr2=0x7f4f040d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:25.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.373+0000 7f4f0a800640 1 -- 172.21.15.138:0/3396497927 shutdown_connections 2024-04-26T20:57:25.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.373+0000 7f4f0a800640 1 -- 172.21.15.138:0/3396497927 wait complete. 2024-04-26T20:57:25.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.377+0000 7f4f0a800640 1 Processor -- start 2024-04-26T20:57:25.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.377+0000 7f4f0a800640 1 -- start start 2024-04-26T20:57:25.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.377+0000 7f4f0a800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ee8004d50 0x7f4f040c68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:25.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.377+0000 7f4f0a800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4f040cf3a0 0x7f4f040cf820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:25.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.377+0000 7f4f0a800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4f040b06f0 0x7f4f040b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:25.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.377+0000 7f4f0a800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f4f040721b0 con 0x7f4ee8004d50 2024-04-26T20:57:25.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.377+0000 7f4f0a800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f4f04072030 con 0x7f4f040b06f0 2024-04-26T20:57:25.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.377+0000 7f4f0a800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f4f040b61b0 con 0x7f4f040cf3a0 2024-04-26T20:57:25.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.377+0000 7f4f03400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ee8004d50 0x7f4f040c68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:25.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.377+0000 7f4f03400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ee8004d50 0x7f4f040c68d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40560/0 (socket says 172.21.15.138:40560) 2024-04-26T20:57:25.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.377+0000 7f4f03400640 1 -- 172.21.15.138:0/951713564 learned_addr learned my addr 172.21.15.138:0/951713564 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:25.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.377+0000 7f4efaa00640 1 --2- 172.21.15.138:0/951713564 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4f040cf3a0 0x7f4f040cf820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:25.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.377+0000 7f4f03e00640 1 --2- 172.21.15.138:0/951713564 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4f040b06f0 0x7f4f040b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:25.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.377+0000 7f4f03400640 1 -- 172.21.15.138:0/951713564 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4f040cf3a0 msgr2=0x7f4f040cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:25.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.377+0000 7f4f03400640 1 --2- 172.21.15.138:0/951713564 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4f040cf3a0 0x7f4f040cf820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:25.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.377+0000 7f4f03400640 1 -- 172.21.15.138:0/951713564 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4f040b06f0 msgr2=0x7f4f040b0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:25.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.377+0000 7f4f03400640 1 --2- 172.21.15.138:0/951713564 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4f040b06f0 0x7f4f040b0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:25.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.377+0000 7f4f03400640 1 -- 172.21.15.138:0/951713564 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f040d0140 con 0x7f4ee8004d50 2024-04-26T20:57:25.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.377+0000 7f4f03400640 1 --2- 172.21.15.138:0/951713564 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ee8004d50 0x7f4f040c68d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4ef4011ca0 tx=0x7f4ef400f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:25.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.377+0000 7f4efbe00640 1 -- 172.21.15.138:0/951713564 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef4011e50 con 0x7f4ee8004d50 2024-04-26T20:57:25.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.377+0000 7f4efbe00640 1 -- 172.21.15.138:0/951713564 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ef4004020 con 0x7f4ee8004d50 2024-04-26T20:57:25.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.377+0000 7f4f0a800640 1 -- 172.21.15.138:0/951713564 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f040cfe60 con 0x7f4ee8004d50 2024-04-26T20:57:25.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.377+0000 7f4efbe00640 1 -- 172.21.15.138:0/951713564 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef4004410 con 0x7f4ee8004d50 2024-04-26T20:57:25.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.377+0000 7f4f0a800640 1 -- 172.21.15.138:0/951713564 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f040b3cc0 con 0x7f4ee8004d50 2024-04-26T20:57:25.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.381+0000 7f4f0a800640 1 -- 172.21.15.138:0/951713564 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f04069430 con 0x7f4ee8004d50 2024-04-26T20:57:25.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.381+0000 7f4efbe00640 1 -- 172.21.15.138:0/951713564 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4ef4012040 con 0x7f4ee8004d50 2024-04-26T20:57:25.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.381+0000 7f4efbe00640 1 --2- 172.21.15.138:0/951713564 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4ee00683b0 0x7f4ee006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:25.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.381+0000 7f4efbe00640 1 -- 172.21.15.138:0/951713564 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7f4ef4087430 con 0x7f4ee8004d50 2024-04-26T20:57:25.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.381+0000 7f4efaa00640 1 --2- 172.21.15.138:0/951713564 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4ee00683b0 0x7f4ee006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:25.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.381+0000 7f4efaa00640 1 --2- 172.21.15.138:0/951713564 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4ee00683b0 0x7f4ee006a870 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4f040b5e60 tx=0x7f4eec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:25.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.385+0000 7f4efbe00640 1 -- 172.21.15.138:0/951713564 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4ef4019030 con 0x7f4ee8004d50 2024-04-26T20:57:25.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.541+0000 7f4f0a800640 1 -- 172.21.15.138:0/951713564 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4f0406fbd0 con 0x7f4ee8004d50 2024-04-26T20:57:25.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.545+0000 7f4efbe00640 1 -- 172.21.15.138:0/951713564 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7f4ef4057530 con 0x7f4ee8004d50 2024-04-26T20:57:25.548 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 64 2024-04-26T20:57:25.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.545+0000 7f4f0a800640 1 -- 172.21.15.138:0/951713564 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4ee00683b0 msgr2=0x7f4ee006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:25.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.545+0000 7f4f0a800640 1 --2- 172.21.15.138:0/951713564 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4ee00683b0 0x7f4ee006a870 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4f040b5e60 tx=0x7f4eec008040 comp rx=0 tx=0).stop 2024-04-26T20:57:25.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.545+0000 7f4f0a800640 1 -- 172.21.15.138:0/951713564 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ee8004d50 msgr2=0x7f4f040c68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:25.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.545+0000 7f4f0a800640 1 --2- 172.21.15.138:0/951713564 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ee8004d50 0x7f4f040c68d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4ef4011ca0 tx=0x7f4ef400f610 comp rx=0 tx=0).stop 2024-04-26T20:57:25.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.545+0000 7f4f0a800640 1 -- 172.21.15.138:0/951713564 shutdown_connections 2024-04-26T20:57:25.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.545+0000 7f4f0a800640 1 --2- 172.21.15.138:0/951713564 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4ee00683b0 0x7f4ee006a870 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:25.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.545+0000 7f4f0a800640 1 --2- 172.21.15.138:0/951713564 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4f040b06f0 0x7f4f040b0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:25.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.545+0000 7f4f0a800640 1 --2- 172.21.15.138:0/951713564 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4f040cf3a0 0x7f4f040cf820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:25.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.545+0000 7f4f0a800640 1 --2- 172.21.15.138:0/951713564 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ee8004d50 0x7f4f040c68d0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:25.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.545+0000 7f4f0a800640 1 -- 172.21.15.138:0/951713564 >> 172.21.15.138:0/951713564 conn(0x7f4f040d0bb0 msgr2=0x7f4f0415a060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:25.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.545+0000 7f4f0a800640 1 -- 172.21.15.138:0/951713564 shutdown_connections 2024-04-26T20:57:25.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.545+0000 7f4f0a800640 1 -- 172.21.15.138:0/951713564 wait complete. 2024-04-26T20:57:25.570 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T20:57:25.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.705+0000 7fea62400640 1 Processor -- start 2024-04-26T20:57:25.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.705+0000 7fea62400640 1 -- start start 2024-04-26T20:57:25.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.705+0000 7fea62400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fea5c0ce9e0 0x7fea5c0afc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:25.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.705+0000 7fea62400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fea5c06fad0 0x7fea5c15ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:25.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.705+0000 7fea62400640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fea5c162d20 0x7fea5c15f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:25.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.705+0000 7fea62400640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fea5c0ae8c0 con 0x7fea5c06fad0 2024-04-26T20:57:25.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.705+0000 7fea62400640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fea5c0aeba0 con 0x7fea5c162d20 2024-04-26T20:57:25.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.705+0000 7fea62400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fea5c0aee80 con 0x7fea5c0ce9e0 2024-04-26T20:57:25.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.705+0000 7fea5aa00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fea5c06fad0 0x7fea5c15ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:25.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.705+0000 7fea5aa00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fea5c06fad0 0x7fea5c15ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40566/0 (socket says 172.21.15.138:40566) 2024-04-26T20:57:25.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.705+0000 7fea5aa00640 1 -- 172.21.15.138:0/2111598256 learned_addr learned my addr 172.21.15.138:0/2111598256 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:25.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.705+0000 7fea5b400640 1 --2- 172.21.15.138:0/2111598256 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fea5c0ce9e0 0x7fea5c0afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:25.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.705+0000 7fea5be00640 1 --2- 172.21.15.138:0/2111598256 >> v2:172.21.15.143:3300/0 conn(0x7fea5c162d20 0x7fea5c15f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:25.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.705+0000 7fea5aa00640 1 -- 172.21.15.138:0/2111598256 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fea5c0ce9e0 msgr2=0x7fea5c0afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:25.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.705+0000 7fea5aa00640 1 --2- 172.21.15.138:0/2111598256 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fea5c0ce9e0 0x7fea5c0afc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:25.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.705+0000 7fea5aa00640 1 -- 172.21.15.138:0/2111598256 >> v2:172.21.15.143:3300/0 conn(0x7fea5c162d20 msgr2=0x7fea5c15f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:25.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.705+0000 7fea5aa00640 1 --2- 172.21.15.138:0/2111598256 >> v2:172.21.15.143:3300/0 conn(0x7fea5c162d20 0x7fea5c15f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:25.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.705+0000 7fea5aa00640 1 -- 172.21.15.138:0/2111598256 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea5c0af160 con 0x7fea5c06fad0 2024-04-26T20:57:25.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.705+0000 7fea5be00640 1 --2- 172.21.15.138:0/2111598256 >> v2:172.21.15.143:3300/0 conn(0x7fea5c162d20 0x7fea5c15f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:57:25.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.705+0000 7fea5b400640 1 --2- 172.21.15.138:0/2111598256 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fea5c0ce9e0 0x7fea5c0afc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:57:25.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.709+0000 7fea5aa00640 1 --2- 172.21.15.138:0/2111598256 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea5c06fad0 0x7fea5c15ec50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fea5c0cf680 tx=0x7fea4801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=742aeacc8a904404 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:25.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.709+0000 7fea5a000640 1 -- 172.21.15.138:0/2111598256 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea480ab5f0 con 0x7fea5c06fad0 2024-04-26T20:57:25.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.709+0000 7fea5a000640 1 -- 172.21.15.138:0/2111598256 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea480b0070 con 0x7fea5c06fad0 2024-04-26T20:57:25.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.709+0000 7fea5a000640 1 -- 172.21.15.138:0/2111598256 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea480ab9b0 con 0x7fea5c06fad0 2024-04-26T20:57:25.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.709+0000 7fea62400640 1 -- 172.21.15.138:0/2111598256 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea5c06fad0 msgr2=0x7fea5c15ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:25.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.709+0000 7fea62400640 1 --2- 172.21.15.138:0/2111598256 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea5c06fad0 0x7fea5c15ec50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fea5c0cf680 tx=0x7fea4801c520 comp rx=0 tx=0).stop 2024-04-26T20:57:25.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.709+0000 7fea62400640 1 -- 172.21.15.138:0/2111598256 shutdown_connections 2024-04-26T20:57:25.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.709+0000 7fea62400640 1 --2- 172.21.15.138:0/2111598256 >> v2:172.21.15.143:3300/0 conn(0x7fea5c162d20 0x7fea5c15f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:25.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.709+0000 7fea62400640 1 --2- 172.21.15.138:0/2111598256 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea5c06fad0 0x7fea5c15ec50 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:25.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.709+0000 7fea62400640 1 --2- 172.21.15.138:0/2111598256 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fea5c0ce9e0 0x7fea5c0afc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:25.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.709+0000 7fea62400640 1 -- 172.21.15.138:0/2111598256 >> 172.21.15.138:0/2111598256 conn(0x7fea5c0d0bb0 msgr2=0x7fea5c0d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:25.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.709+0000 7fea62400640 1 -- 172.21.15.138:0/2111598256 shutdown_connections 2024-04-26T20:57:25.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.709+0000 7fea62400640 1 -- 172.21.15.138:0/2111598256 wait complete. 2024-04-26T20:57:25.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.709+0000 7fea62400640 1 Processor -- start 2024-04-26T20:57:25.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.709+0000 7fea62400640 1 -- start start 2024-04-26T20:57:25.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.713+0000 7fea62400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea5c06fad0 0x7fea5c0b3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:25.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.713+0000 7fea62400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fea5c0ce9e0 0x7fea5c0b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:25.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.713+0000 7fea62400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fea5c162d20 0x7fea5c0c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:25.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.713+0000 7fea62400640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fea5c0cbb90 con 0x7fea5c06fad0 2024-04-26T20:57:25.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.713+0000 7fea62400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fea5c0cba10 con 0x7fea5c0ce9e0 2024-04-26T20:57:25.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.713+0000 7fea62400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fea5c06e3f0 con 0x7fea5c162d20 2024-04-26T20:57:25.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.713+0000 7fea5b400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea5c06fad0 0x7fea5c0b3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:25.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.713+0000 7fea5b400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea5c06fad0 0x7fea5c0b3840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40570/0 (socket says 172.21.15.138:40570) 2024-04-26T20:57:25.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.713+0000 7fea5b400640 1 -- 172.21.15.138:0/2808779773 learned_addr learned my addr 172.21.15.138:0/2808779773 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:25.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.713+0000 7fea5aa00640 1 --2- 172.21.15.138:0/2808779773 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fea5c0ce9e0 0x7fea5c0b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:25.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.713+0000 7fea5be00640 1 --2- 172.21.15.138:0/2808779773 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fea5c162d20 0x7fea5c0c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:25.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.713+0000 7fea5b400640 1 -- 172.21.15.138:0/2808779773 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fea5c162d20 msgr2=0x7fea5c0c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:25.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.713+0000 7fea5b400640 1 --2- 172.21.15.138:0/2808779773 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fea5c162d20 0x7fea5c0c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:25.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.713+0000 7fea5b400640 1 -- 172.21.15.138:0/2808779773 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fea5c0ce9e0 msgr2=0x7fea5c0b61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:25.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.713+0000 7fea5b400640 1 --2- 172.21.15.138:0/2808779773 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fea5c0ce9e0 0x7fea5c0b61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:25.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.713+0000 7fea5b400640 1 -- 172.21.15.138:0/2808779773 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea5c0b3d80 con 0x7fea5c06fad0 2024-04-26T20:57:25.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.713+0000 7fea5aa00640 1 --2- 172.21.15.138:0/2808779773 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fea5c0ce9e0 0x7fea5c0b61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:25.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.713+0000 7fea5b400640 1 --2- 172.21.15.138:0/2808779773 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea5c06fad0 0x7fea5c0b3840 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fea4c00c7c0 tx=0x7fea4c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:25.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.713+0000 7fea53400640 1 -- 172.21.15.138:0/2808779773 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea4c015070 con 0x7fea5c06fad0 2024-04-26T20:57:25.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.713+0000 7fea53400640 1 -- 172.21.15.138:0/2808779773 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea4c007a30 con 0x7fea5c06fad0 2024-04-26T20:57:25.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.713+0000 7fea62400640 1 -- 172.21.15.138:0/2808779773 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea5c0b4020 con 0x7fea5c06fad0 2024-04-26T20:57:25.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.713+0000 7fea53400640 1 -- 172.21.15.138:0/2808779773 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea4c007e00 con 0x7fea5c06fad0 2024-04-26T20:57:25.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.713+0000 7fea62400640 1 -- 172.21.15.138:0/2808779773 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea5c154460 con 0x7fea5c06fad0 2024-04-26T20:57:25.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.713+0000 7fea62400640 1 -- 172.21.15.138:0/2808779773 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea5c069430 con 0x7fea5c06fad0 2024-04-26T20:57:25.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.717+0000 7fea53400640 1 -- 172.21.15.138:0/2808779773 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fea4c018070 con 0x7fea5c06fad0 2024-04-26T20:57:25.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.717+0000 7fea53400640 1 --2- 172.21.15.138:0/2808779773 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fea3c068380 0x7fea3c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:25.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.717+0000 7fea53400640 1 -- 172.21.15.138:0/2808779773 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7fea4c086c80 con 0x7fea5c06fad0 2024-04-26T20:57:25.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.717+0000 7fea5aa00640 1 --2- 172.21.15.138:0/2808779773 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fea3c068380 0x7fea3c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:25.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.717+0000 7fea5aa00640 1 --2- 172.21.15.138:0/2808779773 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fea3c068380 0x7fea3c06a840 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fea480af000 tx=0x7fea480a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:25.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.721+0000 7fea53400640 1 -- 172.21.15.138:0/2808779773 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fea4c056e20 con 0x7fea5c06fad0 2024-04-26T20:57:25.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.877+0000 7fea62400640 1 -- 172.21.15.138:0/2808779773 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fea5c0d1810 con 0x7fea5c06fad0 2024-04-26T20:57:25.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.877+0000 7fea53400640 1 -- 172.21.15.138:0/2808779773 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7fea4c056720 con 0x7fea5c06fad0 2024-04-26T20:57:25.883 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 32 2024-04-26T20:57:25.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.881+0000 7fea62400640 1 -- 172.21.15.138:0/2808779773 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fea3c068380 msgr2=0x7fea3c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:25.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.881+0000 7fea62400640 1 --2- 172.21.15.138:0/2808779773 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fea3c068380 0x7fea3c06a840 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fea480af000 tx=0x7fea480a7000 comp rx=0 tx=0).stop 2024-04-26T20:57:25.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.881+0000 7fea62400640 1 -- 172.21.15.138:0/2808779773 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea5c06fad0 msgr2=0x7fea5c0b3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:25.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.881+0000 7fea62400640 1 --2- 172.21.15.138:0/2808779773 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea5c06fad0 0x7fea5c0b3840 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fea4c00c7c0 tx=0x7fea4c00cc80 comp rx=0 tx=0).stop 2024-04-26T20:57:25.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.881+0000 7fea62400640 1 -- 172.21.15.138:0/2808779773 shutdown_connections 2024-04-26T20:57:25.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.881+0000 7fea62400640 1 --2- 172.21.15.138:0/2808779773 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fea3c068380 0x7fea3c06a840 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:25.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.881+0000 7fea62400640 1 --2- 172.21.15.138:0/2808779773 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fea5c162d20 0x7fea5c0c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:25.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.881+0000 7fea62400640 1 --2- 172.21.15.138:0/2808779773 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fea5c0ce9e0 0x7fea5c0b61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:25.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.881+0000 7fea62400640 1 --2- 172.21.15.138:0/2808779773 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea5c06fad0 0x7fea5c0b3840 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:25.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.881+0000 7fea62400640 1 -- 172.21.15.138:0/2808779773 >> 172.21.15.138:0/2808779773 conn(0x7fea5c0d0bb0 msgr2=0x7fea5c15e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:25.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.881+0000 7fea62400640 1 -- 172.21.15.138:0/2808779773 shutdown_connections 2024-04-26T20:57:25.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:25.881+0000 7fea62400640 1 -- 172.21.15.138:0/2808779773 wait complete. 2024-04-26T20:57:25.904 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_recovery_pool.TestRecoveryPool.test_rebuild_simple' 2024-04-26T20:57:26.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.033+0000 7f0972000640 1 Processor -- start 2024-04-26T20:57:26.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.033+0000 7f0972000640 1 -- start start 2024-04-26T20:57:26.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.037+0000 7f0972000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f096c0cba90 0x7f096c15bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:26.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.037+0000 7f0972000640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f096c072130 con 0x7f096c159250 2024-04-26T20:57:26.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.037+0000 7f0972000640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f096c15cae0 con 0x7f096c15c0a0 2024-04-26T20:57:26.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.037+0000 7f0972000640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f096c15f4e0 con 0x7f096c0cba90 2024-04-26T20:57:26.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.037+0000 7f096aa00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f096c0cba90 0x7f096c15bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:26.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.037+0000 7f096aa00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f096c0cba90 0x7f096c15bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40580/0 (socket says 172.21.15.138:40580) 2024-04-26T20:57:26.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.037+0000 7f096b400640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f096c159250 0x7f096c0cb380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:58116/0 (socket says 172.21.15.138:58116) 2024-04-26T20:57:26.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.037+0000 7f096aa00640 1 -- 172.21.15.138:0/391098310 learned_addr learned my addr 172.21.15.138:0/391098310 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:26.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.037+0000 7f096aa00640 1 -- 172.21.15.138:0/391098310 >> v1:172.21.15.143:6789/0 conn(0x7f096c15c0a0 legacy=0x7f096c072bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:26.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.037+0000 7f096aa00640 1 -- 172.21.15.138:0/391098310 >> v1:172.21.15.138:6789/0 conn(0x7f096c159250 legacy=0x7f096c0cb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:26.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.037+0000 7f096aa00640 1 -- 172.21.15.138:0/391098310 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f096c15c800 con 0x7f096c0cba90 2024-04-26T20:57:26.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.037+0000 7f096a000640 1 -- 172.21.15.138:0/391098310 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1601167148 0 0) 0x7f096c072130 con 0x7f096c159250 2024-04-26T20:57:26.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.041+0000 7f096aa00640 1 --2- 172.21.15.138:0/391098310 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f096c0cba90 0x7f096c15bb60 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0958009870 tx=0x7f095801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3df52b8ede298730 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:26.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.041+0000 7f096a000640 1 -- 172.21.15.138:0/391098310 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09580b0070 con 0x7f096c0cba90 2024-04-26T20:57:26.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.041+0000 7f096a000640 1 -- 172.21.15.138:0/391098310 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09580ab600 con 0x7f096c0cba90 2024-04-26T20:57:26.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.041+0000 7f096a000640 1 -- 172.21.15.138:0/391098310 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09580ab9d0 con 0x7f096c0cba90 2024-04-26T20:57:26.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.041+0000 7f0972000640 1 -- 172.21.15.138:0/391098310 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f096c0cba90 msgr2=0x7f096c15bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:26.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.041+0000 7f0972000640 1 --2- 172.21.15.138:0/391098310 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f096c0cba90 0x7f096c15bb60 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0958009870 tx=0x7f095801c520 comp rx=0 tx=0).stop 2024-04-26T20:57:26.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.041+0000 7f0972000640 1 -- 172.21.15.138:0/391098310 shutdown_connections 2024-04-26T20:57:26.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.041+0000 7f0972000640 1 --2- 172.21.15.138:0/391098310 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f096c0cba90 0x7f096c15bb60 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:26.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.041+0000 7f0972000640 1 -- 172.21.15.138:0/391098310 >> 172.21.15.138:0/391098310 conn(0x7f096c0d0b20 msgr2=0x7f096c0d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:26.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.041+0000 7f0972000640 1 -- 172.21.15.138:0/391098310 shutdown_connections 2024-04-26T20:57:26.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.041+0000 7f0972000640 1 -- 172.21.15.138:0/391098310 wait complete. 2024-04-26T20:57:26.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.041+0000 7f0972000640 1 Processor -- start 2024-04-26T20:57:26.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.041+0000 7f0972000640 1 -- start start 2024-04-26T20:57:26.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.041+0000 7f0972000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f096c0cba90 0x7f096c1f87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:26.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.041+0000 7f0972000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f096c159250 0x7f096c155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:26.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.041+0000 7f0972000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f096c15c0a0 0x7f096c1669b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:26.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.041+0000 7f0972000640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f096c073670 con 0x7f096c15c0a0 2024-04-26T20:57:26.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.041+0000 7f0972000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f096c0734f0 con 0x7f096c159250 2024-04-26T20:57:26.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.041+0000 7f0972000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f096c0737f0 con 0x7f096c0cba90 2024-04-26T20:57:26.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.041+0000 7f096be00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f096c15c0a0 0x7f096c1669b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:26.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.041+0000 7f096be00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f096c15c0a0 0x7f096c1669b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40586/0 (socket says 172.21.15.138:40586) 2024-04-26T20:57:26.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.041+0000 7f096be00640 1 -- 172.21.15.138:0/1630920159 learned_addr learned my addr 172.21.15.138:0/1630920159 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:26.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.045+0000 7f096b400640 1 --2- 172.21.15.138:0/1630920159 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f096c0cba90 0x7f096c1f87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:26.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.045+0000 7f096aa00640 1 --2- 172.21.15.138:0/1630920159 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f096c159250 0x7f096c155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:26.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.045+0000 7f096be00640 1 -- 172.21.15.138:0/1630920159 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f096c0cba90 msgr2=0x7f096c1f87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:26.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.045+0000 7f096be00640 1 --2- 172.21.15.138:0/1630920159 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f096c0cba90 0x7f096c1f87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:26.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.045+0000 7f096be00640 1 -- 172.21.15.138:0/1630920159 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f096c159250 msgr2=0x7f096c155410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:26.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.045+0000 7f096be00640 1 --2- 172.21.15.138:0/1630920159 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f096c159250 0x7f096c155410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:26.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.045+0000 7f096be00640 1 -- 172.21.15.138:0/1630920159 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f096c1f8d20 con 0x7f096c15c0a0 2024-04-26T20:57:26.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.045+0000 7f096aa00640 1 --2- 172.21.15.138:0/1630920159 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f096c159250 0x7f096c155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:26.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.045+0000 7f096be00640 1 --2- 172.21.15.138:0/1630920159 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f096c15c0a0 0x7f096c1669b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f096400b440 tx=0x7f096400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:26.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.045+0000 7f0963400640 1 -- 172.21.15.138:0/1630920159 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0964015020 con 0x7f096c15c0a0 2024-04-26T20:57:26.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.045+0000 7f0963400640 1 -- 172.21.15.138:0/1630920159 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0964011850 con 0x7f096c15c0a0 2024-04-26T20:57:26.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.045+0000 7f0972000640 1 -- 172.21.15.138:0/1630920159 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f096c165910 con 0x7f096c15c0a0 2024-04-26T20:57:26.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.045+0000 7f0963400640 1 -- 172.21.15.138:0/1630920159 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0964011c40 con 0x7f096c15c0a0 2024-04-26T20:57:26.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.045+0000 7f0972000640 1 -- 172.21.15.138:0/1630920159 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f096c165ed0 con 0x7f096c15c0a0 2024-04-26T20:57:26.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.045+0000 7f0972000640 1 -- 172.21.15.138:0/1630920159 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f096c0741a0 con 0x7f096c15c0a0 2024-04-26T20:57:26.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.045+0000 7f0963400640 1 -- 172.21.15.138:0/1630920159 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0964018020 con 0x7f096c15c0a0 2024-04-26T20:57:26.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.045+0000 7f0963400640 1 --2- 172.21.15.138:0/1630920159 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f094c068380 0x7f094c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:26.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.045+0000 7f0963400640 1 -- 172.21.15.138:0/1630920159 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7f0964086c30 con 0x7f096c15c0a0 2024-04-26T20:57:26.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.045+0000 7f096b400640 1 --2- 172.21.15.138:0/1630920159 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f094c068380 0x7f094c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:26.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.049+0000 7f096b400640 1 --2- 172.21.15.138:0/1630920159 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f094c068380 0x7f094c06a840 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f095c007fd0 tx=0x7f095c007f20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:26.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.049+0000 7f0963400640 1 -- 172.21.15.138:0/1630920159 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f096401f020 con 0x7f096c15c0a0 2024-04-26T20:57:26.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.261+0000 7f0972000640 1 -- 172.21.15.138:0/1630920159 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_recovery_pool.TestRecoveryPool.test_rebuild_simple"]} v 0) -- 0x7f096c0d1880 con 0x7f096c15c0a0 2024-04-26T20:57:26.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.425+0000 7f0963400640 1 -- 172.21.15.138:0/1630920159 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_recovery_pool.TestRecoveryPool.test_rebuild_simple"]}]=0 v64) ==== 150+0+0 (secure 0 0 0) 0x7f096c1f8d20 con 0x7f096c15c0a0 2024-04-26T20:57:26.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.425+0000 7f0972000640 1 -- 172.21.15.138:0/1630920159 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f094c068380 msgr2=0x7f094c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:26.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.425+0000 7f0972000640 1 --2- 172.21.15.138:0/1630920159 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f094c068380 0x7f094c06a840 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f095c007fd0 tx=0x7f095c007f20 comp rx=0 tx=0).stop 2024-04-26T20:57:26.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.425+0000 7f0972000640 1 -- 172.21.15.138:0/1630920159 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f096c15c0a0 msgr2=0x7f096c1669b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:26.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.425+0000 7f0972000640 1 --2- 172.21.15.138:0/1630920159 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f096c15c0a0 0x7f096c1669b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f096400b440 tx=0x7f096400b900 comp rx=0 tx=0).stop 2024-04-26T20:57:26.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.425+0000 7f0972000640 1 -- 172.21.15.138:0/1630920159 shutdown_connections 2024-04-26T20:57:26.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.425+0000 7f0972000640 1 --2- 172.21.15.138:0/1630920159 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f094c068380 0x7f094c06a840 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:26.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.425+0000 7f0972000640 1 --2- 172.21.15.138:0/1630920159 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f096c15c0a0 0x7f096c1669b0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:26.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.425+0000 7f0972000640 1 --2- 172.21.15.138:0/1630920159 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f096c159250 0x7f096c155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:26.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.425+0000 7f0972000640 1 --2- 172.21.15.138:0/1630920159 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f096c0cba90 0x7f096c1f87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:26.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.425+0000 7f0972000640 1 -- 172.21.15.138:0/1630920159 >> 172.21.15.138:0/1630920159 conn(0x7f096c0d0b20 msgr2=0x7f096c15e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:26.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.425+0000 7f0972000640 1 -- 172.21.15.138:0/1630920159 shutdown_connections 2024-04-26T20:57:26.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.425+0000 7f0972000640 1 -- 172.21.15.138:0/1630920159 wait complete. 2024-04-26T20:57:26.450 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-26T20:57:26.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.585+0000 7fe376200640 1 Processor -- start 2024-04-26T20:57:26.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.585+0000 7fe376200640 1 -- start start 2024-04-26T20:57:26.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.585+0000 7fe376200640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe37015bdc0 0x7fe37015f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:26.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.585+0000 7fe376200640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe370073d70 0x7fe37015fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:26.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.585+0000 7fe376200640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe37006dee0 con 0x7fe37006f880 2024-04-26T20:57:26.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.585+0000 7fe376200640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fe37015c1a0 con 0x7fe370073d70 2024-04-26T20:57:26.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.585+0000 7fe376200640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fe37006e180 con 0x7fe37015bdc0 2024-04-26T20:57:26.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.585+0000 7fe36ea00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe370073d70 0x7fe37015fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:26.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.585+0000 7fe36ea00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe370073d70 0x7fe37015fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40596/0 (socket says 172.21.15.138:40596) 2024-04-26T20:57:26.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.585+0000 7fe36ea00640 1 -- 172.21.15.138:0/2515121267 learned_addr learned my addr 172.21.15.138:0/2515121267 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:26.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.585+0000 7fe36f400640 1 --2- 172.21.15.138:0/2515121267 >> v2:172.21.15.143:3300/0 conn(0x7fe37015bdc0 0x7fe37015f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:26.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.589+0000 7fe36ea00640 1 -- 172.21.15.138:0/2515121267 >> v2:172.21.15.143:3300/0 conn(0x7fe37015bdc0 msgr2=0x7fe37015f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:26.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.589+0000 7fe36ea00640 1 --2- 172.21.15.138:0/2515121267 >> v2:172.21.15.143:3300/0 conn(0x7fe37015bdc0 0x7fe37015f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:26.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.589+0000 7fe36ea00640 1 -- 172.21.15.138:0/2515121267 >> v1:172.21.15.143:6789/0 conn(0x7fe37006f880 legacy=0x7fe3700cb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:26.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.589+0000 7fe36ea00640 1 -- 172.21.15.138:0/2515121267 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe37006e460 con 0x7fe370073d70 2024-04-26T20:57:26.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.589+0000 7fe36ea00640 1 --2- 172.21.15.138:0/2515121267 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe370073d70 0x7fe37015fe70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe37015c380 tx=0x7fe36001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd69a8209196f025 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:26.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.589+0000 7fe36e000640 1 -- 172.21.15.138:0/2515121267 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3600b0070 con 0x7fe370073d70 2024-04-26T20:57:26.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.589+0000 7fe36e000640 1 -- 172.21.15.138:0/2515121267 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3600ab600 con 0x7fe370073d70 2024-04-26T20:57:26.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.589+0000 7fe36e000640 1 -- 172.21.15.138:0/2515121267 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3600ab9d0 con 0x7fe370073d70 2024-04-26T20:57:26.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.589+0000 7fe376200640 1 -- 172.21.15.138:0/2515121267 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe370073d70 msgr2=0x7fe37015fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:26.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.589+0000 7fe376200640 1 --2- 172.21.15.138:0/2515121267 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe370073d70 0x7fe37015fe70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe37015c380 tx=0x7fe36001c400 comp rx=0 tx=0).stop 2024-04-26T20:57:26.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.589+0000 7fe376200640 1 -- 172.21.15.138:0/2515121267 shutdown_connections 2024-04-26T20:57:26.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.589+0000 7fe376200640 1 --2- 172.21.15.138:0/2515121267 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe370073d70 0x7fe37015fe70 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:26.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.589+0000 7fe376200640 1 --2- 172.21.15.138:0/2515121267 >> v2:172.21.15.143:3300/0 conn(0x7fe37015bdc0 0x7fe37015f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:26.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.589+0000 7fe376200640 1 -- 172.21.15.138:0/2515121267 >> 172.21.15.138:0/2515121267 conn(0x7fe3700d0bb0 msgr2=0x7fe3700d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:26.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.589+0000 7fe376200640 1 -- 172.21.15.138:0/2515121267 shutdown_connections 2024-04-26T20:57:26.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.589+0000 7fe376200640 1 -- 172.21.15.138:0/2515121267 wait complete. 2024-04-26T20:57:26.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.593+0000 7fe376200640 1 Processor -- start 2024-04-26T20:57:26.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.593+0000 7fe376200640 1 -- start start 2024-04-26T20:57:26.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.593+0000 7fe376200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe37006f880 0x7fe37015ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:26.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.593+0000 7fe376200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe370073d70 0x7fe3700c4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:26.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.593+0000 7fe376200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe37015bdc0 0x7fe370145e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:26.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.593+0000 7fe376200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe370169060 con 0x7fe370073d70 2024-04-26T20:57:26.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.593+0000 7fe376200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fe370168ee0 con 0x7fe37015bdc0 2024-04-26T20:57:26.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.593+0000 7fe376200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fe3701691e0 con 0x7fe37006f880 2024-04-26T20:57:26.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.593+0000 7fe36ea00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe370073d70 0x7fe3700c4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:26.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.593+0000 7fe36ea00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe370073d70 0x7fe3700c4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40610/0 (socket says 172.21.15.138:40610) 2024-04-26T20:57:26.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.593+0000 7fe36ea00640 1 -- 172.21.15.138:0/95131870 learned_addr learned my addr 172.21.15.138:0/95131870 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:26.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.593+0000 7fe36f400640 1 --2- 172.21.15.138:0/95131870 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe37006f880 0x7fe37015ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:26.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.593+0000 7fe36fe00640 1 --2- 172.21.15.138:0/95131870 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe37015bdc0 0x7fe370145e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:26.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.593+0000 7fe36ea00640 1 -- 172.21.15.138:0/95131870 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe37006f880 msgr2=0x7fe37015ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:26.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.593+0000 7fe36ea00640 1 --2- 172.21.15.138:0/95131870 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe37006f880 0x7fe37015ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:26.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.593+0000 7fe36ea00640 1 -- 172.21.15.138:0/95131870 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe37015bdc0 msgr2=0x7fe370145e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:26.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.593+0000 7fe36ea00640 1 --2- 172.21.15.138:0/95131870 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe37015bdc0 0x7fe370145e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:26.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.593+0000 7fe36ea00640 1 -- 172.21.15.138:0/95131870 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3700c4af0 con 0x7fe370073d70 2024-04-26T20:57:26.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.593+0000 7fe36ea00640 1 --2- 172.21.15.138:0/95131870 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe370073d70 0x7fe3700c4380 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe3600ae040 tx=0x7fe3600191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:26.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.593+0000 7fe367400640 1 -- 172.21.15.138:0/95131870 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3600b0040 con 0x7fe370073d70 2024-04-26T20:57:26.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.593+0000 7fe367400640 1 -- 172.21.15.138:0/95131870 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3600b4420 con 0x7fe370073d70 2024-04-26T20:57:26.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.593+0000 7fe376200640 1 -- 172.21.15.138:0/95131870 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3700c6c30 con 0x7fe370073d70 2024-04-26T20:57:26.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.593+0000 7fe367400640 1 -- 172.21.15.138:0/95131870 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3600b47f0 con 0x7fe370073d70 2024-04-26T20:57:26.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.593+0000 7fe376200640 1 -- 172.21.15.138:0/95131870 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3700c71f0 con 0x7fe370073d70 2024-04-26T20:57:26.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.597+0000 7fe376200640 1 -- 172.21.15.138:0/95131870 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe370069430 con 0x7fe370073d70 2024-04-26T20:57:26.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.597+0000 7fe367400640 1 -- 172.21.15.138:0/95131870 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe3600b4990 con 0x7fe370073d70 2024-04-26T20:57:26.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.597+0000 7fe367400640 1 --2- 172.21.15.138:0/95131870 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe34c068380 0x7fe34c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:26.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.597+0000 7fe367400640 1 -- 172.21.15.138:0/95131870 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7fe360120730 con 0x7fe370073d70 2024-04-26T20:57:26.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.597+0000 7fe36f400640 1 --2- 172.21.15.138:0/95131870 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe34c068380 0x7fe34c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:26.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.597+0000 7fe36f400640 1 --2- 172.21.15.138:0/95131870 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe34c068380 0x7fe34c06a840 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe358009ac0 tx=0x7fe358009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:26.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.601+0000 7fe367400640 1 -- 172.21.15.138:0/95131870 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe360016110 con 0x7fe370073d70 2024-04-26T20:57:26.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.757+0000 7fe376200640 1 -- 172.21.15.138:0/95131870 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fe3700ceeb0 con 0x7fe370073d70 2024-04-26T20:57:26.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.765+0000 7fe367400640 1 -- 172.21.15.138:0/95131870 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7fe3600f0420 con 0x7fe370073d70 2024-04-26T20:57:26.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.765+0000 7fe376200640 1 -- 172.21.15.138:0/95131870 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe34c068380 msgr2=0x7fe34c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:26.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.765+0000 7fe376200640 1 --2- 172.21.15.138:0/95131870 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe34c068380 0x7fe34c06a840 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe358009ac0 tx=0x7fe358009190 comp rx=0 tx=0).stop 2024-04-26T20:57:26.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.765+0000 7fe376200640 1 -- 172.21.15.138:0/95131870 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe370073d70 msgr2=0x7fe3700c4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:26.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.765+0000 7fe376200640 1 --2- 172.21.15.138:0/95131870 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe370073d70 0x7fe3700c4380 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe3600ae040 tx=0x7fe3600191a0 comp rx=0 tx=0).stop 2024-04-26T20:57:26.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.765+0000 7fe376200640 1 -- 172.21.15.138:0/95131870 shutdown_connections 2024-04-26T20:57:26.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.765+0000 7fe376200640 1 --2- 172.21.15.138:0/95131870 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe34c068380 0x7fe34c06a840 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:26.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.765+0000 7fe376200640 1 --2- 172.21.15.138:0/95131870 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe37015bdc0 0x7fe370145e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:26.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.765+0000 7fe376200640 1 --2- 172.21.15.138:0/95131870 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe370073d70 0x7fe3700c4380 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:26.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.765+0000 7fe376200640 1 --2- 172.21.15.138:0/95131870 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe37006f880 0x7fe37015ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:26.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.765+0000 7fe376200640 1 -- 172.21.15.138:0/95131870 >> 172.21.15.138:0/95131870 conn(0x7fe3700d0bb0 msgr2=0x7fe37015fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:26.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.765+0000 7fe376200640 1 -- 172.21.15.138:0/95131870 shutdown_connections 2024-04-26T20:57:26.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:26.765+0000 7fe376200640 1 -- 172.21.15.138:0/95131870 wait complete. 2024-04-26T20:57:26.789 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-26T20:57:26.789 DEBUG:teuthology.orchestra.run.smithi138:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T20:57:26.878 DEBUG:teuthology.orchestra.run.smithi143:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T20:57:26.985 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-26T20:57:26.985 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-26T20:57:26.985 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T20:57:26.994 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-26T20:57:26.994 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T20:57:27.043 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-26T20:57:27.043 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T20:57:27.095 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:57:27.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.273+0000 7f622be00640 1 Processor -- start 2024-04-26T20:57:27.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.273+0000 7f622be00640 1 -- start start 2024-04-26T20:57:27.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.273+0000 7f622be00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f622415d0f0 0x7f62240d1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:27.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.273+0000 7f622be00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62240b2280 0x7f62240d1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:27.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.273+0000 7f622be00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62240ce540 con 0x7f62240d0950 2024-04-26T20:57:27.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.273+0000 7f622be00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f62240d0e50 con 0x7f622415d0f0 2024-04-26T20:57:27.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.273+0000 7f622be00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f62240b26e0 con 0x7f62240b2280 2024-04-26T20:57:27.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.273+0000 7f6229400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f622415d0f0 0x7f62240d1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:27.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.273+0000 7f6229400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f622415d0f0 0x7f62240d1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40618/0 (socket says 172.21.15.138:40618) 2024-04-26T20:57:27.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.273+0000 7f6229400640 1 -- 172.21.15.138:0/1285150198 learned_addr learned my addr 172.21.15.138:0/1285150198 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:27.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.273+0000 7f6229e00640 1 --1- 172.21.15.138:0/1285150198 >> v1:172.21.15.138:6789/0 conn(0x7f62240d0950 0x7f62240cf750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:58124/0 (socket says 172.21.15.138:58124) 2024-04-26T20:57:27.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.273+0000 7f6228a00640 1 --2- 172.21.15.138:0/1285150198 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62240b2280 0x7f62240d1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:27.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.273+0000 7f6229400640 1 -- 172.21.15.138:0/1285150198 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62240b2280 msgr2=0x7f62240d1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:27.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.273+0000 7f6229400640 1 --2- 172.21.15.138:0/1285150198 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62240b2280 0x7f62240d1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:27.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.273+0000 7f6229400640 1 -- 172.21.15.138:0/1285150198 >> v1:172.21.15.138:6789/0 conn(0x7f62240d0950 legacy=0x7f62240cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:27.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.273+0000 7f6229400640 1 -- 172.21.15.138:0/1285150198 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62240ce820 con 0x7f622415d0f0 2024-04-26T20:57:27.281 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.277+0000 7f6229400640 1 --2- 172.21.15.138:0/1285150198 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f622415d0f0 0x7f62240d1010 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6218009870 tx=0x7f621801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52574b9878ec3ea4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:27.281 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.277+0000 7f6223e00640 1 -- 172.21.15.138:0/1285150198 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62180ab5f0 con 0x7f622415d0f0 2024-04-26T20:57:27.281 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.277+0000 7f6223e00640 1 -- 172.21.15.138:0/1285150198 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62180b0070 con 0x7f622415d0f0 2024-04-26T20:57:27.281 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.277+0000 7f6223e00640 1 -- 172.21.15.138:0/1285150198 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62180ab9b0 con 0x7f622415d0f0 2024-04-26T20:57:27.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.277+0000 7f622be00640 1 -- 172.21.15.138:0/1285150198 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f622415d0f0 msgr2=0x7f62240d1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:27.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.277+0000 7f622be00640 1 --2- 172.21.15.138:0/1285150198 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f622415d0f0 0x7f62240d1010 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6218009870 tx=0x7f621801c560 comp rx=0 tx=0).stop 2024-04-26T20:57:27.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.277+0000 7f622be00640 1 -- 172.21.15.138:0/1285150198 shutdown_connections 2024-04-26T20:57:27.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.277+0000 7f622be00640 1 --2- 172.21.15.138:0/1285150198 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62240b2280 0x7f62240d1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:27.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.277+0000 7f622be00640 1 --2- 172.21.15.138:0/1285150198 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f622415d0f0 0x7f62240d1010 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:27.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.277+0000 7f622be00640 1 -- 172.21.15.138:0/1285150198 >> 172.21.15.138:0/1285150198 conn(0x7f62240d2d80 msgr2=0x7f62240d3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:27.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.277+0000 7f622be00640 1 -- 172.21.15.138:0/1285150198 shutdown_connections 2024-04-26T20:57:27.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.277+0000 7f622be00640 1 -- 172.21.15.138:0/1285150198 wait complete. 2024-04-26T20:57:27.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.281+0000 7f622be00640 1 Processor -- start 2024-04-26T20:57:27.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.281+0000 7f622be00640 1 -- start start 2024-04-26T20:57:27.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.281+0000 7f622be00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f62240b2280 0x7f6224153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:27.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.281+0000 7f622be00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62240d0950 0x7f62240ca900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:27.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.281+0000 7f622be00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f622415d0f0 0x7f62240cae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:27.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.281+0000 7f622be00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f622416a040 con 0x7f622415d0f0 2024-04-26T20:57:27.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.281+0000 7f622be00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f6224169ec0 con 0x7f62240b2280 2024-04-26T20:57:27.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.281+0000 7f622be00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f622416a1c0 con 0x7f62240d0950 2024-04-26T20:57:27.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.281+0000 7f6229e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f622415d0f0 0x7f62240cae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:27.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.281+0000 7f6229e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f622415d0f0 0x7f62240cae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40622/0 (socket says 172.21.15.138:40622) 2024-04-26T20:57:27.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.281+0000 7f6229e00640 1 -- 172.21.15.138:0/1874211044 learned_addr learned my addr 172.21.15.138:0/1874211044 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:27.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.281+0000 7f6228a00640 1 --2- 172.21.15.138:0/1874211044 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62240d0950 0x7f62240ca900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:27.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.281+0000 7f6229400640 1 --2- 172.21.15.138:0/1874211044 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f62240b2280 0x7f6224153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:27.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.281+0000 7f6229e00640 1 -- 172.21.15.138:0/1874211044 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62240d0950 msgr2=0x7f62240ca900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:27.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.281+0000 7f6229e00640 1 --2- 172.21.15.138:0/1874211044 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62240d0950 0x7f62240ca900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:27.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.281+0000 7f6229e00640 1 -- 172.21.15.138:0/1874211044 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f62240b2280 msgr2=0x7f6224153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:27.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.281+0000 7f6229e00640 1 --2- 172.21.15.138:0/1874211044 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f62240b2280 0x7f6224153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:27.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.281+0000 7f6229e00640 1 -- 172.21.15.138:0/1874211044 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6224154310 con 0x7f622415d0f0 2024-04-26T20:57:27.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.281+0000 7f6229400640 1 --2- 172.21.15.138:0/1874211044 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f62240b2280 0x7f6224153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:27.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.281+0000 7f6229e00640 1 --2- 172.21.15.138:0/1874211044 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f622415d0f0 0x7f62240cae40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f621c00c7a0 tx=0x7f621c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:27.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.281+0000 7f6221600640 1 -- 172.21.15.138:0/1874211044 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f621c017070 con 0x7f622415d0f0 2024-04-26T20:57:27.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.281+0000 7f6221600640 1 -- 172.21.15.138:0/1874211044 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f621c00a640 con 0x7f622415d0f0 2024-04-26T20:57:27.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.281+0000 7f6221600640 1 -- 172.21.15.138:0/1874211044 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f621c00a9f0 con 0x7f622415d0f0 2024-04-26T20:57:27.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.281+0000 7f622be00640 1 -- 172.21.15.138:0/1874211044 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f622415aae0 con 0x7f622415d0f0 2024-04-26T20:57:27.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.281+0000 7f622be00640 1 -- 172.21.15.138:0/1874211044 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f622406e2a0 con 0x7f622415d0f0 2024-04-26T20:57:27.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.281+0000 7f622be00640 1 -- 172.21.15.138:0/1874211044 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6224069510 con 0x7f622415d0f0 2024-04-26T20:57:27.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.285+0000 7f6221600640 1 -- 172.21.15.138:0/1874211044 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f621c01a070 con 0x7f622415d0f0 2024-04-26T20:57:27.289 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.285+0000 7f6221600640 1 --2- 172.21.15.138:0/1874211044 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6204068380 0x7f620406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:27.289 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.285+0000 7f6221600640 1 -- 172.21.15.138:0/1874211044 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7f621c086290 con 0x7f622415d0f0 2024-04-26T20:57:27.289 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.285+0000 7f6229400640 1 --2- 172.21.15.138:0/1874211044 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6204068380 0x7f620406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:27.290 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.285+0000 7f6229400640 1 --2- 172.21.15.138:0/1874211044 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6204068380 0x7f620406a840 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f62180af000 tx=0x7f62180a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:27.293 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.289+0000 7f6221600640 1 -- 172.21.15.138:0/1874211044 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6224154310 con 0x7f622415d0f0 2024-04-26T20:57:27.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.449+0000 7f622be00640 1 -- 172.21.15.138:0/1874211044 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f62240d1790 con 0x7f622415d0f0 2024-04-26T20:57:27.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.449+0000 7f6221600640 1 -- 172.21.15.138:0/1874211044 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18719 (secure 0 0 0) 0x7f621c055e70 con 0x7f622415d0f0 2024-04-26T20:57:27.454 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:57:27.455 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":29,"fsid":"c22b4730-12cc-4558-8535-b965384398c0","created":"2024-04-26T20:56:14.182475+0000","modified":"2024-04-26T20:57:20.395184+0000","last_up_change":"2024-04-26T20:56:26.013243+0000","last_in_change":"2024-04-26T20:56:16.714055+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:56:27.265834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:56:37.394398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:56:38.544369+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:56:42.240243+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3f9a2e34-3199-466f-a6cf-57927318121e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6801","nonce":3534772245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6803","nonce":3534772245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6807","nonce":3534772245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6805","nonce":3534772245}]},"public_addr":"172.21.15.138:6801/3534772245","cluster_addr":"172.21.15.138:6803/3534772245","heartbeat_back_addr":"172.21.15.138:6807/3534772245","heartbeat_front_addr":"172.21.15.138:6805/3534772245","state":["exists","up"]},{"osd":1,"uuid":"e881fcf6-3248-4696-a2ef-95d206d77712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6817","nonce":1427635773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6819","nonce":1427635773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6823","nonce":1427635773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6821","nonce":1427635773}]},"public_addr":"172.21.15.138:6817/1427635773","cluster_addr":"172.21.15.138:6819/1427635773","heartbeat_back_addr":"172.21.15.138:6823/1427635773","heartbeat_front_addr":"172.21.15.138:6821/1427635773","state":["exists","up"]},{"osd":2,"uuid":"f7d1db33-7672-4699-ae47-9f1e0a8e4222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6809","nonce":4273721573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6811","nonce":4273721573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6815","nonce":4273721573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6813","nonce":4273721573}]},"public_addr":"172.21.15.138:6809/4273721573","cluster_addr":"172.21.15.138:6811/4273721573","heartbeat_back_addr":"172.21.15.138:6815/4273721573","heartbeat_front_addr":"172.21.15.138:6813/4273721573","state":["exists","up"]},{"osd":3,"uuid":"2f4e0a9a-b8f6-4468-844a-a4501cd85054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6825","nonce":3098242154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6827","nonce":3098242154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6831","nonce":3098242154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6829","nonce":3098242154}]},"public_addr":"172.21.15.138:6825/3098242154","cluster_addr":"172.21.15.138:6827/3098242154","heartbeat_back_addr":"172.21.15.138:6831/3098242154","heartbeat_front_addr":"172.21.15.138:6829/3098242154","state":["exists","up"]},{"osd":4,"uuid":"c85df99b-3624-410e-866b-86830af2cfe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6801","nonce":2942056312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6803","nonce":2942056312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6807","nonce":2942056312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6805","nonce":2942056312}]},"public_addr":"172.21.15.143:6801/2942056312","cluster_addr":"172.21.15.143:6803/2942056312","heartbeat_back_addr":"172.21.15.143:6807/2942056312","heartbeat_front_addr":"172.21.15.143:6805/2942056312","state":["exists","up"]},{"osd":5,"uuid":"9af1efb5-c416-4808-b5ef-de0679ab9705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6809","nonce":1910222887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6811","nonce":1910222887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6815","nonce":1910222887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6813","nonce":1910222887}]},"public_addr":"172.21.15.143:6809/1910222887","cluster_addr":"172.21.15.143:6811/1910222887","heartbeat_back_addr":"172.21.15.143:6815/1910222887","heartbeat_front_addr":"172.21.15.143:6813/1910222887","state":["exists","up"]},{"osd":6,"uuid":"d7138615-8838-45ff-9072-2fd0683362f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6817","nonce":1082239825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6819","nonce":1082239825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6823","nonce":1082239825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6821","nonce":1082239825}]},"public_addr":"172.21.15.143:6817/1082239825","cluster_addr":"172.21.15.143:6819/1082239825","heartbeat_back_addr":"172.21.15.143:6823/1082239825","heartbeat_front_addr":"172.21.15.143:6821/1082239825","state":["exists","up"]},{"osd":7,"uuid":"0c27172b-35c4-49ec-ba0b-0137b8ff0010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6825","nonce":3295508495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6827","nonce":3295508495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6831","nonce":3295508495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6829","nonce":3295508495}]},"public_addr":"172.21.15.143:6825/3295508495","cluster_addr":"172.21.15.143:6827/3295508495","heartbeat_back_addr":"172.21.15.143:6831/3295508495","heartbeat_front_addr":"172.21.15.143:6829/3295508495","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.326627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.396119+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.433915+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.414179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.216947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.329272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.503073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.436382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.39","mappings":[{"from":0,"to":7}]},{"pgid":"4.6","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:57:27.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.453+0000 7f622be00640 1 -- 172.21.15.138:0/1874211044 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6204068380 msgr2=0x7f620406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:27.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.453+0000 7f622be00640 1 --2- 172.21.15.138:0/1874211044 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6204068380 0x7f620406a840 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f62180af000 tx=0x7f62180a7000 comp rx=0 tx=0).stop 2024-04-26T20:57:27.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.453+0000 7f622be00640 1 -- 172.21.15.138:0/1874211044 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f622415d0f0 msgr2=0x7f62240cae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:27.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.453+0000 7f622be00640 1 --2- 172.21.15.138:0/1874211044 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f622415d0f0 0x7f62240cae40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f621c00c7a0 tx=0x7f621c00cc60 comp rx=0 tx=0).stop 2024-04-26T20:57:27.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.453+0000 7f622be00640 1 -- 172.21.15.138:0/1874211044 shutdown_connections 2024-04-26T20:57:27.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.453+0000 7f622be00640 1 --2- 172.21.15.138:0/1874211044 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6204068380 0x7f620406a840 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:27.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.453+0000 7f622be00640 1 --2- 172.21.15.138:0/1874211044 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f622415d0f0 0x7f62240cae40 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:27.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.453+0000 7f622be00640 1 --2- 172.21.15.138:0/1874211044 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62240d0950 0x7f62240ca900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:27.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.453+0000 7f622be00640 1 --2- 172.21.15.138:0/1874211044 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f62240b2280 0x7f6224153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:27.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.453+0000 7f622be00640 1 -- 172.21.15.138:0/1874211044 >> 172.21.15.138:0/1874211044 conn(0x7f62240d2d80 msgr2=0x7f6224159050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:27.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.453+0000 7f622be00640 1 -- 172.21.15.138:0/1874211044 shutdown_connections 2024-04-26T20:57:27.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.453+0000 7f622be00640 1 -- 172.21.15.138:0/1874211044 wait complete. 2024-04-26T20:57:27.478 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:56:27.265834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T20:56:37.394398+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T20:56:38.544369+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T20:56:42.240243+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T20:57:27.479 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T20:57:27.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.613+0000 7f2abb200640 1 Processor -- start 2024-04-26T20:57:27.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.613+0000 7f2abb200640 1 -- start start 2024-04-26T20:57:27.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.613+0000 7f2abb200640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2ab415aa60 0x7f2ab40cc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:27.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.613+0000 7f2abb200640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f2ab40cb910 0x7f2ab40b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:27.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.613+0000 7f2abb200640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ab40cd210 con 0x7f2ab40ccd20 2024-04-26T20:57:27.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.613+0000 7f2abb200640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f2ab415d6a0 con 0x7f2ab415aa60 2024-04-26T20:57:27.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.613+0000 7f2abb200640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f2ab415d980 con 0x7f2ab40cb910 2024-04-26T20:57:27.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.613+0000 7f2ab3e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2ab415aa60 0x7f2ab40cc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:27.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.613+0000 7f2aab400640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f2ab40ccd20 0x7f2ab40cb200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:58126/0 (socket says 172.21.15.138:58126) 2024-04-26T20:57:27.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.613+0000 7f2aab400640 1 -- 172.21.15.138:0/2278308499 learned_addr learned my addr 172.21.15.138:0/2278308499 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:27.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.613+0000 7f2ab3e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2ab415aa60 0x7f2ab40cc7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40638/0 (socket says 172.21.15.138:40638) 2024-04-26T20:57:27.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.617+0000 7f2ab9200640 1 --2- 172.21.15.138:0/2278308499 >> v2:172.21.15.143:3300/0 conn(0x7f2ab40cb910 0x7f2ab40b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:27.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.617+0000 7f2ab3e00640 1 -- 172.21.15.138:0/2278308499 >> v2:172.21.15.143:3300/0 conn(0x7f2ab40cb910 msgr2=0x7f2ab40b5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:27.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.617+0000 7f2ab3e00640 1 --2- 172.21.15.138:0/2278308499 >> v2:172.21.15.143:3300/0 conn(0x7f2ab40cb910 0x7f2ab40b5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:27.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.617+0000 7f2ab3e00640 1 -- 172.21.15.138:0/2278308499 >> v1:172.21.15.138:6789/0 conn(0x7f2ab40ccd20 legacy=0x7f2ab40cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:27.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.617+0000 7f2ab3400640 1 -- 172.21.15.138:0/2278308499 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2834717946 0 0) 0x7f2ab40cd210 con 0x7f2ab40ccd20 2024-04-26T20:57:27.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.617+0000 7f2ab3e00640 1 -- 172.21.15.138:0/2278308499 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ab415dc60 con 0x7f2ab415aa60 2024-04-26T20:57:27.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.617+0000 7f2ab9200640 1 --2- 172.21.15.138:0/2278308499 >> v2:172.21.15.143:3300/0 conn(0x7f2ab40cb910 0x7f2ab40b5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:57:27.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.617+0000 7f2ab3e00640 1 --2- 172.21.15.138:0/2278308499 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ab415aa60 0x7f2ab40cc7e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2ab4071bd0 tx=0x7f2aa401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a666ca8cb35f29fd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:27.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.617+0000 7f2ab3400640 1 -- 172.21.15.138:0/2278308499 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa40b0070 con 0x7f2ab415aa60 2024-04-26T20:57:27.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.617+0000 7f2ab3400640 1 -- 172.21.15.138:0/2278308499 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2aa40ab600 con 0x7f2ab415aa60 2024-04-26T20:57:27.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.617+0000 7f2ab3400640 1 -- 172.21.15.138:0/2278308499 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa40ab9d0 con 0x7f2ab415aa60 2024-04-26T20:57:27.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.617+0000 7f2abb200640 1 -- 172.21.15.138:0/2278308499 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ab415aa60 msgr2=0x7f2ab40cc7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:27.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.617+0000 7f2abb200640 1 --2- 172.21.15.138:0/2278308499 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ab415aa60 0x7f2ab40cc7e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2ab4071bd0 tx=0x7f2aa401c480 comp rx=0 tx=0).stop 2024-04-26T20:57:27.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.617+0000 7f2abb200640 1 -- 172.21.15.138:0/2278308499 shutdown_connections 2024-04-26T20:57:27.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.617+0000 7f2abb200640 1 --2- 172.21.15.138:0/2278308499 >> v2:172.21.15.143:3300/0 conn(0x7f2ab40cb910 0x7f2ab40b5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:27.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.617+0000 7f2abb200640 1 --2- 172.21.15.138:0/2278308499 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ab415aa60 0x7f2ab40cc7e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:27.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.617+0000 7f2abb200640 1 -- 172.21.15.138:0/2278308499 >> 172.21.15.138:0/2278308499 conn(0x7f2ab40d0bb0 msgr2=0x7f2ab40d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:27.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.617+0000 7f2abb200640 1 -- 172.21.15.138:0/2278308499 shutdown_connections 2024-04-26T20:57:27.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.617+0000 7f2abb200640 1 -- 172.21.15.138:0/2278308499 wait complete. 2024-04-26T20:57:27.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.621+0000 7f2abb200640 1 Processor -- start 2024-04-26T20:57:27.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.621+0000 7f2abb200640 1 -- start start 2024-04-26T20:57:27.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.621+0000 7f2abb200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ab40cb910 0x7f2ab4152050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:27.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.621+0000 7f2abb200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2ab40ccd20 0x7f2ab40cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:27.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.621+0000 7f2abb200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2ab415aa60 0x7f2ab41535a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:27.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.621+0000 7f2abb200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab406e0f0 con 0x7f2ab40cb910 2024-04-26T20:57:27.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.621+0000 7f2abb200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab4072240 con 0x7f2ab40ccd20 2024-04-26T20:57:27.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.621+0000 7f2abb200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f2ab406e270 con 0x7f2ab415aa60 2024-04-26T20:57:27.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.621+0000 7f2ab3e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ab40cb910 0x7f2ab4152050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:27.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.621+0000 7f2ab3e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ab40cb910 0x7f2ab4152050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40640/0 (socket says 172.21.15.138:40640) 2024-04-26T20:57:27.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.621+0000 7f2ab3e00640 1 -- 172.21.15.138:0/1220330430 learned_addr learned my addr 172.21.15.138:0/1220330430 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:27.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.621+0000 7f2ab3e00640 1 -- 172.21.15.138:0/1220330430 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2ab415aa60 msgr2=0x7f2ab41535a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:27.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.621+0000 7f2ab3e00640 1 --2- 172.21.15.138:0/1220330430 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2ab415aa60 0x7f2ab41535a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:27.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.621+0000 7f2ab3e00640 1 -- 172.21.15.138:0/1220330430 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2ab40ccd20 msgr2=0x7f2ab40cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:27.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.621+0000 7f2ab3e00640 1 --2- 172.21.15.138:0/1220330430 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2ab40ccd20 0x7f2ab40cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:27.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.621+0000 7f2ab3e00640 1 -- 172.21.15.138:0/1220330430 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ab40ce780 con 0x7f2ab40cb910 2024-04-26T20:57:27.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.621+0000 7f2ab3e00640 1 --2- 172.21.15.138:0/1220330430 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ab40cb910 0x7f2ab4152050 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2aa40ae040 tx=0x7f2aa401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:27.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.621+0000 7f2ab0c00640 1 -- 172.21.15.138:0/1220330430 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa40b0050 con 0x7f2ab40cb910 2024-04-26T20:57:27.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.621+0000 7f2ab0c00640 1 -- 172.21.15.138:0/1220330430 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2aa40bc070 con 0x7f2ab40cb910 2024-04-26T20:57:27.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.621+0000 7f2abb200640 1 -- 172.21.15.138:0/1220330430 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ab40cea60 con 0x7f2ab40cb910 2024-04-26T20:57:27.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.621+0000 7f2ab0c00640 1 -- 172.21.15.138:0/1220330430 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa40b5a50 con 0x7f2ab40cb910 2024-04-26T20:57:27.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.621+0000 7f2abb200640 1 -- 172.21.15.138:0/1220330430 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ab40cf020 con 0x7f2ab40cb910 2024-04-26T20:57:27.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.625+0000 7f2abb200640 1 -- 172.21.15.138:0/1220330430 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ab4069430 con 0x7f2ab40cb910 2024-04-26T20:57:27.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.625+0000 7f2ab0c00640 1 -- 172.21.15.138:0/1220330430 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2aa40ab4c0 con 0x7f2ab40cb910 2024-04-26T20:57:27.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.625+0000 7f2ab0c00640 1 --2- 172.21.15.138:0/1220330430 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f2a90068380 0x7f2a9006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:27.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.625+0000 7f2ab0c00640 1 -- 172.21.15.138:0/1220330430 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7f2aa41216c0 con 0x7f2ab40cb910 2024-04-26T20:57:27.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.625+0000 7f2aab400640 1 --2- 172.21.15.138:0/1220330430 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f2a90068380 0x7f2a9006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:27.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.625+0000 7f2aab400640 1 --2- 172.21.15.138:0/1220330430 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f2a90068380 0x7f2a9006a840 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c000c10 tx=0x7f2a9c007910 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:27.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.629+0000 7f2ab0c00640 1 -- 172.21.15.138:0/1220330430 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2aa4016070 con 0x7f2ab40cb910 2024-04-26T20:57:27.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.789+0000 7f2abb200640 1 -- 172.21.15.138:0/1220330430 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2ab406fbd0 con 0x7f2ab40cb910 2024-04-26T20:57:27.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.789+0000 7f2ab0c00640 1 -- 172.21.15.138:0/1220330430 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f2aa40f1850 con 0x7f2ab40cb910 2024-04-26T20:57:27.794 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 1 2024-04-26T20:57:27.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.789+0000 7f2abb200640 1 -- 172.21.15.138:0/1220330430 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f2a90068380 msgr2=0x7f2a9006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:27.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.793+0000 7f2abb200640 1 --2- 172.21.15.138:0/1220330430 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f2a90068380 0x7f2a9006a840 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c000c10 tx=0x7f2a9c007910 comp rx=0 tx=0).stop 2024-04-26T20:57:27.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.793+0000 7f2abb200640 1 -- 172.21.15.138:0/1220330430 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ab40cb910 msgr2=0x7f2ab4152050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:27.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.793+0000 7f2abb200640 1 --2- 172.21.15.138:0/1220330430 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ab40cb910 0x7f2ab4152050 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2aa40ae040 tx=0x7f2aa401acc0 comp rx=0 tx=0).stop 2024-04-26T20:57:27.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.793+0000 7f2abb200640 1 -- 172.21.15.138:0/1220330430 shutdown_connections 2024-04-26T20:57:27.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.793+0000 7f2abb200640 1 --2- 172.21.15.138:0/1220330430 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f2a90068380 0x7f2a9006a840 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:27.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.793+0000 7f2abb200640 1 --2- 172.21.15.138:0/1220330430 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2ab415aa60 0x7f2ab41535a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:27.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.793+0000 7f2abb200640 1 --2- 172.21.15.138:0/1220330430 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2ab40ccd20 0x7f2ab40cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:27.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.793+0000 7f2abb200640 1 --2- 172.21.15.138:0/1220330430 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ab40cb910 0x7f2ab4152050 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:27.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.793+0000 7f2abb200640 1 -- 172.21.15.138:0/1220330430 >> 172.21.15.138:0/1220330430 conn(0x7f2ab40d0bb0 msgr2=0x7f2ab406e600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:27.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.793+0000 7f2abb200640 1 -- 172.21.15.138:0/1220330430 shutdown_connections 2024-04-26T20:57:27.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.793+0000 7f2abb200640 1 -- 172.21.15.138:0/1220330430 wait complete. 2024-04-26T20:57:27.815 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T20:57:27.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.949+0000 7fd581600640 1 Processor -- start 2024-04-26T20:57:27.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.949+0000 7fd581600640 1 -- start start 2024-04-26T20:57:27.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.949+0000 7fd581600640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd57c162a20 0x7fd57c0afb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:27.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.949+0000 7fd581600640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd57c0d1b60 con 0x7fd57c0b0070 2024-04-26T20:57:27.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.949+0000 7fd581600640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd57c0b3230 con 0x7fd57c06eac0 2024-04-26T20:57:27.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.949+0000 7fd581600640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fd57c0d1e40 con 0x7fd57c162a20 2024-04-26T20:57:27.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.949+0000 7fd57aa00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd57c162a20 0x7fd57c0afb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:27.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.949+0000 7fd57aa00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd57c162a20 0x7fd57c0afb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40644/0 (socket says 172.21.15.138:40644) 2024-04-26T20:57:27.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.949+0000 7fd57aa00640 1 -- 172.21.15.138:0/2916850309 learned_addr learned my addr 172.21.15.138:0/2916850309 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:27.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.949+0000 7fd57aa00640 1 -- 172.21.15.138:0/2916850309 >> v1:172.21.15.143:6789/0 conn(0x7fd57c06eac0 legacy=0x7fd57c0d0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:27.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.949+0000 7fd57aa00640 1 -- 172.21.15.138:0/2916850309 >> v1:172.21.15.138:6789/0 conn(0x7fd57c0b0070 legacy=0x7fd57c0b3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:27.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.949+0000 7fd57aa00640 1 -- 172.21.15.138:0/2916850309 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd57c0b3510 con 0x7fd57c162a20 2024-04-26T20:57:27.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.953+0000 7fd57aa00640 1 --2- 172.21.15.138:0/2916850309 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd57c162a20 0x7fd57c0afb30 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd56c009e50 tx=0x7fd56c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=babd70d5eb82ec99 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:27.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.953+0000 7fd579600640 1 -- 172.21.15.138:0/2916850309 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd56c0a56c0 con 0x7fd57c162a20 2024-04-26T20:57:27.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.953+0000 7fd579600640 1 -- 172.21.15.138:0/2916850309 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd56c0a5860 con 0x7fd57c162a20 2024-04-26T20:57:27.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.953+0000 7fd579600640 1 -- 172.21.15.138:0/2916850309 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd56c0a5c30 con 0x7fd57c162a20 2024-04-26T20:57:27.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.953+0000 7fd581600640 1 -- 172.21.15.138:0/2916850309 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd57c162a20 msgr2=0x7fd57c0afb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:27.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.953+0000 7fd581600640 1 --2- 172.21.15.138:0/2916850309 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd57c162a20 0x7fd57c0afb30 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd56c009e50 tx=0x7fd56c01c9f0 comp rx=0 tx=0).stop 2024-04-26T20:57:27.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.953+0000 7fd581600640 1 -- 172.21.15.138:0/2916850309 shutdown_connections 2024-04-26T20:57:27.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.953+0000 7fd581600640 1 --2- 172.21.15.138:0/2916850309 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd57c162a20 0x7fd57c0afb30 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:27.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.953+0000 7fd581600640 1 -- 172.21.15.138:0/2916850309 >> 172.21.15.138:0/2916850309 conn(0x7fd57c0d2dc0 msgr2=0x7fd57c0d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:27.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.953+0000 7fd581600640 1 -- 172.21.15.138:0/2916850309 shutdown_connections 2024-04-26T20:57:27.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.953+0000 7fd581600640 1 -- 172.21.15.138:0/2916850309 wait complete. 2024-04-26T20:57:27.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.957+0000 7fd581600640 1 Processor -- start 2024-04-26T20:57:27.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.957+0000 7fd581600640 1 -- start start 2024-04-26T20:57:27.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.957+0000 7fd581600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd57c06eac0 0x7fd57c15ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:27.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.957+0000 7fd581600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd57c0b0070 0x7fd57c15c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:27.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.957+0000 7fd581600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd57c162a20 0x7fd57c15dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:27.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.957+0000 7fd581600640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd57c16d9c0 con 0x7fd57c0b0070 2024-04-26T20:57:27.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.957+0000 7fd581600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fd57c0b3880 con 0x7fd57c06eac0 2024-04-26T20:57:27.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.957+0000 7fd581600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fd57c16db40 con 0x7fd57c162a20 2024-04-26T20:57:27.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.957+0000 7fd57a000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd57c0b0070 0x7fd57c15c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:27.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.957+0000 7fd57a000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd57c0b0070 0x7fd57c15c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40660/0 (socket says 172.21.15.138:40660) 2024-04-26T20:57:27.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.957+0000 7fd57a000640 1 -- 172.21.15.138:0/2180590520 learned_addr learned my addr 172.21.15.138:0/2180590520 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:27.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.957+0000 7fd57b400640 1 --2- 172.21.15.138:0/2180590520 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd57c162a20 0x7fd57c15dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:27.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.957+0000 7fd57aa00640 1 --2- 172.21.15.138:0/2180590520 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd57c06eac0 0x7fd57c15ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:27.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.957+0000 7fd57a000640 1 -- 172.21.15.138:0/2180590520 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd57c162a20 msgr2=0x7fd57c15dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:27.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.957+0000 7fd57a000640 1 --2- 172.21.15.138:0/2180590520 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd57c162a20 0x7fd57c15dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:27.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.957+0000 7fd57a000640 1 -- 172.21.15.138:0/2180590520 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd57c06eac0 msgr2=0x7fd57c15ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:27.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.957+0000 7fd57a000640 1 --2- 172.21.15.138:0/2180590520 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd57c06eac0 0x7fd57c15ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:27.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.957+0000 7fd57a000640 1 -- 172.21.15.138:0/2180590520 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd57c0d26f0 con 0x7fd57c0b0070 2024-04-26T20:57:27.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.957+0000 7fd57a000640 1 --2- 172.21.15.138:0/2180590520 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd57c0b0070 0x7fd57c15c310 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd56800c3a0 tx=0x7fd56800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:27.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.957+0000 7fd572a00640 1 -- 172.21.15.138:0/2180590520 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5680052d0 con 0x7fd57c0b0070 2024-04-26T20:57:27.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.957+0000 7fd572a00640 1 -- 172.21.15.138:0/2180590520 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd568005470 con 0x7fd57c0b0070 2024-04-26T20:57:27.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.957+0000 7fd581600640 1 -- 172.21.15.138:0/2180590520 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd57c15ca10 con 0x7fd57c0b0070 2024-04-26T20:57:27.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.957+0000 7fd572a00640 1 -- 172.21.15.138:0/2180590520 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd568007260 con 0x7fd57c0b0070 2024-04-26T20:57:27.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.957+0000 7fd581600640 1 -- 172.21.15.138:0/2180590520 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd57c15cfd0 con 0x7fd57c0b0070 2024-04-26T20:57:27.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.957+0000 7fd581600640 1 -- 172.21.15.138:0/2180590520 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd57c069430 con 0x7fd57c0b0070 2024-04-26T20:57:27.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.961+0000 7fd572a00640 1 -- 172.21.15.138:0/2180590520 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd568007400 con 0x7fd57c0b0070 2024-04-26T20:57:27.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.961+0000 7fd572a00640 1 --2- 172.21.15.138:0/2180590520 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd55c068380 0x7fd55c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:27.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.961+0000 7fd572a00640 1 -- 172.21.15.138:0/2180590520 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7fd5680861f0 con 0x7fd57c0b0070 2024-04-26T20:57:27.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.961+0000 7fd57aa00640 1 --2- 172.21.15.138:0/2180590520 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd55c068380 0x7fd55c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:27.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.961+0000 7fd57aa00640 1 --2- 172.21.15.138:0/2180590520 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd55c068380 0x7fd55c06a840 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd56c0ae000 tx=0x7fd56c0a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:27.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:27.965+0000 7fd572a00640 1 -- 172.21.15.138:0/2180590520 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd568055d30 con 0x7fd57c0b0070 2024-04-26T20:57:28.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.125+0000 7fd581600640 1 -- 172.21.15.138:0/2180590520 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd57c0afc60 con 0x7fd57c0b0070 2024-04-26T20:57:28.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.125+0000 7fd572a00640 1 -- 172.21.15.138:0/2180590520 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7fd56805a030 con 0x7fd57c0b0070 2024-04-26T20:57:28.130 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 32 2024-04-26T20:57:28.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.129+0000 7fd581600640 1 -- 172.21.15.138:0/2180590520 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd55c068380 msgr2=0x7fd55c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:28.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.129+0000 7fd581600640 1 --2- 172.21.15.138:0/2180590520 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd55c068380 0x7fd55c06a840 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd56c0ae000 tx=0x7fd56c0a7070 comp rx=0 tx=0).stop 2024-04-26T20:57:28.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.129+0000 7fd581600640 1 -- 172.21.15.138:0/2180590520 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd57c0b0070 msgr2=0x7fd57c15c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:28.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.129+0000 7fd581600640 1 --2- 172.21.15.138:0/2180590520 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd57c0b0070 0x7fd57c15c310 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd56800c3a0 tx=0x7fd56800c860 comp rx=0 tx=0).stop 2024-04-26T20:57:28.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.129+0000 7fd581600640 1 -- 172.21.15.138:0/2180590520 shutdown_connections 2024-04-26T20:57:28.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.129+0000 7fd581600640 1 --2- 172.21.15.138:0/2180590520 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd55c068380 0x7fd55c06a840 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:28.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.129+0000 7fd581600640 1 --2- 172.21.15.138:0/2180590520 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd57c162a20 0x7fd57c15dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:28.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.129+0000 7fd581600640 1 --2- 172.21.15.138:0/2180590520 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd57c0b0070 0x7fd57c15c310 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:28.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.129+0000 7fd581600640 1 --2- 172.21.15.138:0/2180590520 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd57c06eac0 0x7fd57c15ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:28.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.129+0000 7fd581600640 1 -- 172.21.15.138:0/2180590520 >> 172.21.15.138:0/2180590520 conn(0x7fd57c0d2dc0 msgr2=0x7fd57c160170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:28.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.129+0000 7fd581600640 1 -- 172.21.15.138:0/2180590520 shutdown_connections 2024-04-26T20:57:28.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.129+0000 7fd581600640 1 -- 172.21.15.138:0/2180590520 wait complete. 2024-04-26T20:57:28.151 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T20:57:28.295 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.289+0000 7f7ad4800640 1 Processor -- start 2024-04-26T20:57:28.295 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.289+0000 7f7ad4800640 1 -- start start 2024-04-26T20:57:28.295 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.289+0000 7f7ad4800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f7acc06e2f0 0x7f7acc0d1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:28.295 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.289+0000 7f7ad4800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7acc0d2130 0x7f7acc0ce120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:28.295 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.289+0000 7f7ad4800640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7acc0cd380 con 0x7f7acc15f2f0 2024-04-26T20:57:28.295 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.289+0000 7f7ad4800640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f7acc06eb60 con 0x7f7acc06e2f0 2024-04-26T20:57:28.295 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.289+0000 7f7ad4800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f7acc0d28e0 con 0x7f7acc0d2130 2024-04-26T20:57:28.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.289+0000 7f7ad1400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f7acc06e2f0 0x7f7acc0d1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:28.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.289+0000 7f7ad1400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f7acc06e2f0 0x7f7acc0d1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40662/0 (socket says 172.21.15.138:40662) 2024-04-26T20:57:28.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.289+0000 7f7ad1400640 1 -- 172.21.15.138:0/2110758287 learned_addr learned my addr 172.21.15.138:0/2110758287 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:28.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.289+0000 7f7ad2800640 1 --2- 172.21.15.138:0/2110758287 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7acc0d2130 0x7f7acc0ce120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:28.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.289+0000 7f7ad1400640 1 -- 172.21.15.138:0/2110758287 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7acc0d2130 msgr2=0x7f7acc0ce120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:28.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.289+0000 7f7ad1400640 1 --2- 172.21.15.138:0/2110758287 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7acc0d2130 0x7f7acc0ce120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:28.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.289+0000 7f7ad1400640 1 -- 172.21.15.138:0/2110758287 >> v1:172.21.15.143:6789/0 conn(0x7f7acc15f2f0 legacy=0x7f7acc06dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:28.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.289+0000 7f7ad1400640 1 -- 172.21.15.138:0/2110758287 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7acc0cd640 con 0x7f7acc06e2f0 2024-04-26T20:57:28.298 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.293+0000 7f7ad1400640 1 --2- 172.21.15.138:0/2110758287 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7acc06e2f0 0x7f7acc0d1bf0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7abc009870 tx=0x7f7abc01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=107d56b0e797f4bb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:28.298 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.293+0000 7f7ad0a00640 1 -- 172.21.15.138:0/2110758287 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7abc0a95f0 con 0x7f7acc06e2f0 2024-04-26T20:57:28.298 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.293+0000 7f7ad0a00640 1 -- 172.21.15.138:0/2110758287 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7abc0a9790 con 0x7f7acc06e2f0 2024-04-26T20:57:28.298 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.293+0000 7f7ad0a00640 1 -- 172.21.15.138:0/2110758287 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7abc0a9b60 con 0x7f7acc06e2f0 2024-04-26T20:57:28.299 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.293+0000 7f7ad4800640 1 -- 172.21.15.138:0/2110758287 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7acc06e2f0 msgr2=0x7f7acc0d1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:28.299 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.293+0000 7f7ad4800640 1 --2- 172.21.15.138:0/2110758287 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7acc06e2f0 0x7f7acc0d1bf0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7abc009870 tx=0x7f7abc01c530 comp rx=0 tx=0).stop 2024-04-26T20:57:28.299 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.293+0000 7f7ad4800640 1 -- 172.21.15.138:0/2110758287 shutdown_connections 2024-04-26T20:57:28.299 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.293+0000 7f7ad4800640 1 --2- 172.21.15.138:0/2110758287 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7acc0d2130 0x7f7acc0ce120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:28.299 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.293+0000 7f7ad4800640 1 --2- 172.21.15.138:0/2110758287 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7acc06e2f0 0x7f7acc0d1bf0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:28.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.293+0000 7f7ad4800640 1 -- 172.21.15.138:0/2110758287 >> 172.21.15.138:0/2110758287 conn(0x7f7acc0d2d30 msgr2=0x7f7acc0d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:28.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.293+0000 7f7ad4800640 1 -- 172.21.15.138:0/2110758287 shutdown_connections 2024-04-26T20:57:28.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.293+0000 7f7ad4800640 1 -- 172.21.15.138:0/2110758287 wait complete. 2024-04-26T20:57:28.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.297+0000 7f7ad4800640 1 Processor -- start 2024-04-26T20:57:28.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.297+0000 7f7ad4800640 1 -- start start 2024-04-26T20:57:28.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.297+0000 7f7ad4800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7acc06e2f0 0x7f7acc0b6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:28.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.297+0000 7f7ad4800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7acc0d2130 0x7f7acc0b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:28.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.297+0000 7f7ad4800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7acc15f2f0 0x7f7acc0b6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:28.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.297+0000 7f7ad4800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f7acc15f6d0 con 0x7f7acc15f2f0 2024-04-26T20:57:28.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.297+0000 7f7ad4800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f7acc0d2560 con 0x7f7acc0d2130 2024-04-26T20:57:28.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.297+0000 7f7ad4800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f7acc15f850 con 0x7f7acc06e2f0 2024-04-26T20:57:28.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.297+0000 7f7ad2800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7acc15f2f0 0x7f7acc0b6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:28.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.297+0000 7f7ad2800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7acc15f2f0 0x7f7acc0b6ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40670/0 (socket says 172.21.15.138:40670) 2024-04-26T20:57:28.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.297+0000 7f7ad2800640 1 -- 172.21.15.138:0/553310870 learned_addr learned my addr 172.21.15.138:0/553310870 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:28.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.297+0000 7f7ad1400640 1 --2- 172.21.15.138:0/553310870 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7acc0d2130 0x7f7acc0b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:28.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.297+0000 7f7ad1e00640 1 --2- 172.21.15.138:0/553310870 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7acc06e2f0 0x7f7acc0b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:28.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.297+0000 7f7ad2800640 1 -- 172.21.15.138:0/553310870 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7acc06e2f0 msgr2=0x7f7acc0b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:28.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.297+0000 7f7ad2800640 1 --2- 172.21.15.138:0/553310870 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7acc06e2f0 0x7f7acc0b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:28.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.297+0000 7f7ad2800640 1 -- 172.21.15.138:0/553310870 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7acc0d2130 msgr2=0x7f7acc0b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:28.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.297+0000 7f7ad2800640 1 --2- 172.21.15.138:0/553310870 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7acc0d2130 0x7f7acc0b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:28.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.297+0000 7f7ad2800640 1 -- 172.21.15.138:0/553310870 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7acc0cc430 con 0x7f7acc15f2f0 2024-04-26T20:57:28.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.297+0000 7f7ad2800640 1 --2- 172.21.15.138:0/553310870 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7acc15f2f0 0x7f7acc0b6ce0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8007e90 tx=0x7f7ac800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:28.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.297+0000 7f7ac6000640 1 -- 172.21.15.138:0/553310870 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac8014420 con 0x7f7acc15f2f0 2024-04-26T20:57:28.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.297+0000 7f7ac6000640 1 -- 172.21.15.138:0/553310870 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ac8019070 con 0x7f7acc15f2f0 2024-04-26T20:57:28.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.297+0000 7f7ac6000640 1 -- 172.21.15.138:0/553310870 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac8014800 con 0x7f7acc15f2f0 2024-04-26T20:57:28.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.297+0000 7f7ad4800640 1 -- 172.21.15.138:0/553310870 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7acc160580 con 0x7f7acc15f2f0 2024-04-26T20:57:28.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.297+0000 7f7ad4800640 1 -- 172.21.15.138:0/553310870 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7acc160b40 con 0x7f7acc15f2f0 2024-04-26T20:57:28.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.301+0000 7f7ad4800640 1 -- 172.21.15.138:0/553310870 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7acc160d40 con 0x7f7acc15f2f0 2024-04-26T20:57:28.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.301+0000 7f7ac6000640 1 -- 172.21.15.138:0/553310870 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7ac80149a0 con 0x7f7acc15f2f0 2024-04-26T20:57:28.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.301+0000 7f7ac6000640 1 --2- 172.21.15.138:0/553310870 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7ab0068380 0x7f7ab006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:28.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.301+0000 7f7ac6000640 1 -- 172.21.15.138:0/553310870 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7f7ac80873c0 con 0x7f7acc15f2f0 2024-04-26T20:57:28.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.301+0000 7f7ad1e00640 1 --2- 172.21.15.138:0/553310870 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7ab0068380 0x7f7ab006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:28.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.301+0000 7f7ad1e00640 1 --2- 172.21.15.138:0/553310870 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7ab0068380 0x7f7ab006a840 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7acc1624b0 tx=0x7f7ac0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:28.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.305+0000 7f7ac6000640 1 -- 172.21.15.138:0/553310870 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7acc160d40 con 0x7f7acc15f2f0 2024-04-26T20:57:28.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.465+0000 7f7ad4800640 1 -- 172.21.15.138:0/553310870 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f7acc069430 con 0x7f7acc15f2f0 2024-04-26T20:57:28.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.465+0000 7f7ac6000640 1 -- 172.21.15.138:0/553310870 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7f7ac8056f90 con 0x7f7acc15f2f0 2024-04-26T20:57:28.469 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 64 2024-04-26T20:57:28.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.465+0000 7f7ad4800640 1 -- 172.21.15.138:0/553310870 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7ab0068380 msgr2=0x7f7ab006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:28.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.465+0000 7f7ad4800640 1 --2- 172.21.15.138:0/553310870 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7ab0068380 0x7f7ab006a840 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7acc1624b0 tx=0x7f7ac0009040 comp rx=0 tx=0).stop 2024-04-26T20:57:28.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.465+0000 7f7ad4800640 1 -- 172.21.15.138:0/553310870 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7acc15f2f0 msgr2=0x7f7acc0b6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:28.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.465+0000 7f7ad4800640 1 --2- 172.21.15.138:0/553310870 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7acc15f2f0 0x7f7acc0b6ce0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8007e90 tx=0x7f7ac800e4b0 comp rx=0 tx=0).stop 2024-04-26T20:57:28.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.465+0000 7f7ad4800640 1 -- 172.21.15.138:0/553310870 shutdown_connections 2024-04-26T20:57:28.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.465+0000 7f7ad4800640 1 --2- 172.21.15.138:0/553310870 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7ab0068380 0x7f7ab006a840 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:28.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.465+0000 7f7ad4800640 1 --2- 172.21.15.138:0/553310870 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7acc15f2f0 0x7f7acc0b6ce0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:28.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.465+0000 7f7ad4800640 1 --2- 172.21.15.138:0/553310870 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7acc0d2130 0x7f7acc0b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:28.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.465+0000 7f7ad4800640 1 --2- 172.21.15.138:0/553310870 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7acc06e2f0 0x7f7acc0b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:28.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.465+0000 7f7ad4800640 1 -- 172.21.15.138:0/553310870 >> 172.21.15.138:0/553310870 conn(0x7f7acc0d2d30 msgr2=0x7f7acc075b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:28.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.465+0000 7f7ad4800640 1 -- 172.21.15.138:0/553310870 shutdown_connections 2024-04-26T20:57:28.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.465+0000 7f7ad4800640 1 -- 172.21.15.138:0/553310870 wait complete. 2024-04-26T20:57:28.491 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T20:57:28.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.625+0000 7f6de0c00640 1 Processor -- start 2024-04-26T20:57:28.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.625+0000 7f6de0c00640 1 -- start start 2024-04-26T20:57:28.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.625+0000 7f6de0c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ddc0cb200 0x7f6ddc0cf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:28.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.625+0000 7f6de0c00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ddc06e080 con 0x7f6ddc15b270 2024-04-26T20:57:28.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.625+0000 7f6de0c00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ddc06e360 con 0x7f6ddc0ce780 2024-04-26T20:57:28.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.625+0000 7f6de0c00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f6ddc06e640 con 0x7f6ddc0cb200 2024-04-26T20:57:28.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.625+0000 7f6dd1400640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f6ddc15b270 0x7f6ddc0cb5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:58140/0 (socket says 172.21.15.138:58140) 2024-04-26T20:57:28.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.625+0000 7f6dd1400640 1 -- 172.21.15.138:0/4160601108 learned_addr learned my addr 172.21.15.138:0/4160601108 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:28.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.625+0000 7f6dd9e00640 1 --2- 172.21.15.138:0/4160601108 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ddc0cb200 0x7f6ddc0cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:28.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.629+0000 7f6dd9400640 1 -- 172.21.15.138:0/4160601108 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4155128387 0 0) 0x7f6ddc06e080 con 0x7f6ddc15b270 2024-04-26T20:57:28.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.629+0000 7f6dd9400640 1 -- 172.21.15.138:0/4160601108 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6dc0003530 con 0x7f6ddc15b270 2024-04-26T20:57:28.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.629+0000 7f6dd9400640 1 -- 172.21.15.138:0/4160601108 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1588438313 0 0) 0x7f6ddc06e360 con 0x7f6ddc0ce780 2024-04-26T20:57:28.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.629+0000 7f6dd9400640 1 -- 172.21.15.138:0/4160601108 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ddc06e080 con 0x7f6ddc0ce780 2024-04-26T20:57:28.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.629+0000 7f6dd9400640 1 -- 172.21.15.138:0/4160601108 <== mon.0 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4218168666 0 0) 0x7f6dc0003530 con 0x7f6ddc15b270 2024-04-26T20:57:28.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.629+0000 7f6dd9400640 1 -- 172.21.15.138:0/4160601108 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ddc0cb200 msgr2=0x7f6ddc0cf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:28.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.629+0000 7f6dd9400640 1 --2- 172.21.15.138:0/4160601108 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ddc0cb200 0x7f6ddc0cf670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:28.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.629+0000 7f6dd9400640 1 -- 172.21.15.138:0/4160601108 >> v1:172.21.15.143:6789/0 conn(0x7f6ddc0ce780 legacy=0x7f6ddc06f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:28.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.629+0000 7f6dd9400640 1 -- 172.21.15.138:0/4160601108 --> v1:172.21.15.138:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ddc06e920 con 0x7f6ddc15b270 2024-04-26T20:57:28.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.629+0000 7f6dd9400640 1 -- 172.21.15.138:0/4160601108 <== mon.0 v1:172.21.15.138:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2715389689 0 0) 0x7f6dc4001a00 con 0x7f6ddc15b270 2024-04-26T20:57:28.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.629+0000 7f6dd9e00640 1 --2- 172.21.15.138:0/4160601108 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ddc0cb200 0x7f6ddc0cf670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:57:28.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.629+0000 7f6dd9400640 1 -- 172.21.15.138:0/4160601108 >> v1:172.21.15.138:6789/0 conn(0x7f6ddc15b270 legacy=0x7f6ddc0cb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:28.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.629+0000 7f6dd9400640 1 --2- 172.21.15.138:0/4160601108 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ddc0cb200 0x7f6dc0003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:28.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.629+0000 7f6dd9400640 1 --2- 172.21.15.138:0/4160601108 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6dc0004130 0x7f6dc0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:28.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.629+0000 7f6dd9400640 1 --2- 172.21.15.138:0/4160601108 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6dc0004d50 0x7f6dc00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:28.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.629+0000 7f6dd9400640 1 -- 172.21.15.138:0/4160601108 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f6ddc06e640 con 0x7f6dc0004d50 2024-04-26T20:57:28.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.629+0000 7f6dd9400640 1 -- 172.21.15.138:0/4160601108 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc0005bb0 con 0x7f6dc0004130 2024-04-26T20:57:28.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.629+0000 7f6dd9400640 1 -- 172.21.15.138:0/4160601108 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f6dc0005db0 con 0x7f6ddc0cb200 2024-04-26T20:57:28.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.629+0000 7f6dda800640 1 --2- 172.21.15.138:0/4160601108 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6dc0004d50 0x7f6dc00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:28.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.629+0000 7f6dd9e00640 1 --2- 172.21.15.138:0/4160601108 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ddc0cb200 0x7f6dc0003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:28.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.629+0000 7f6dd1400640 1 --2- 172.21.15.138:0/4160601108 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6dc0004130 0x7f6dc0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:28.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.629+0000 7f6dda800640 1 -- 172.21.15.138:0/4160601108 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ddc0cb200 msgr2=0x7f6dc0003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:28.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.629+0000 7f6dda800640 1 --2- 172.21.15.138:0/4160601108 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ddc0cb200 0x7f6dc0003bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:28.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.629+0000 7f6dda800640 1 -- 172.21.15.138:0/4160601108 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6dc0004130 msgr2=0x7f6dc0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:28.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.629+0000 7f6dda800640 1 --2- 172.21.15.138:0/4160601108 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6dc0004130 0x7f6dc0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:28.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.629+0000 7f6dda800640 1 -- 172.21.15.138:0/4160601108 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dc0003530 con 0x7f6dc0004d50 2024-04-26T20:57:28.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.629+0000 7f6dd9e00640 1 --2- 172.21.15.138:0/4160601108 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ddc0cb200 0x7f6dc0003bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:57:28.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.633+0000 7f6dda800640 1 --2- 172.21.15.138:0/4160601108 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6dc0004d50 0x7f6dc00051d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6dd40018d0 tx=0x7f6dd401c580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84f375840384d813 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:28.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.633+0000 7f6dd9400640 1 -- 172.21.15.138:0/4160601108 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd40af070 con 0x7f6dc0004d50 2024-04-26T20:57:28.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.633+0000 7f6dd9400640 1 -- 172.21.15.138:0/4160601108 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dd40052f0 con 0x7f6dc0004d50 2024-04-26T20:57:28.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.633+0000 7f6dd9400640 1 -- 172.21.15.138:0/4160601108 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd4001520 con 0x7f6dc0004d50 2024-04-26T20:57:28.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.633+0000 7f6de0c00640 1 -- 172.21.15.138:0/4160601108 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6dc0004d50 msgr2=0x7f6dc00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:28.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.633+0000 7f6de0c00640 1 --2- 172.21.15.138:0/4160601108 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6dc0004d50 0x7f6dc00051d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6dd40018d0 tx=0x7f6dd401c580 comp rx=0 tx=0).stop 2024-04-26T20:57:28.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.633+0000 7f6dda800640 1 -- 172.21.15.138:0/4160601108 reap_dead start 2024-04-26T20:57:28.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.633+0000 7f6de0c00640 1 -- 172.21.15.138:0/4160601108 shutdown_connections 2024-04-26T20:57:28.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.633+0000 7f6de0c00640 1 -- 172.21.15.138:0/4160601108 >> 172.21.15.138:0/4160601108 conn(0x7f6ddc0d0bb0 msgr2=0x7f6ddc0d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:28.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.633+0000 7f6de0c00640 1 -- 172.21.15.138:0/4160601108 shutdown_connections 2024-04-26T20:57:28.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.633+0000 7f6de0c00640 1 -- 172.21.15.138:0/4160601108 wait complete. 2024-04-26T20:57:28.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.633+0000 7f6de0c00640 1 Processor -- start 2024-04-26T20:57:28.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.633+0000 7f6de0c00640 1 -- start start 2024-04-26T20:57:28.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.637+0000 7f6de0c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6ddc0c7180 0x7f6ddc1563e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:28.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.637+0000 7f6de0c00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ddc14f790 0x7f6ddc1f54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:28.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.637+0000 7f6de0c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ddc1e5a60 0x7f6ddc1e5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:28.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.637+0000 7f6de0c00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f6ddc070150 con 0x7f6ddc14f790 2024-04-26T20:57:28.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.637+0000 7f6de0c00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f6ddc06ffd0 con 0x7f6ddc0c7180 2024-04-26T20:57:28.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.637+0000 7f6de0c00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f6ddc0cf670 con 0x7f6ddc1e5a60 2024-04-26T20:57:28.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.637+0000 7f6dd1400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ddc14f790 0x7f6ddc1f54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:28.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.637+0000 7f6dd1400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ddc14f790 0x7f6ddc1f54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40688/0 (socket says 172.21.15.138:40688) 2024-04-26T20:57:28.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.637+0000 7f6dd1400640 1 -- 172.21.15.138:0/1531007558 learned_addr learned my addr 172.21.15.138:0/1531007558 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:28.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.637+0000 7f6dd9e00640 1 --2- 172.21.15.138:0/1531007558 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6ddc0c7180 0x7f6ddc1563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:28.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.637+0000 7f6dda800640 1 --2- 172.21.15.138:0/1531007558 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ddc1e5a60 0x7f6ddc1e5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:28.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.637+0000 7f6dd1400640 1 -- 172.21.15.138:0/1531007558 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ddc1e5a60 msgr2=0x7f6ddc1e5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:28.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.637+0000 7f6dd1400640 1 --2- 172.21.15.138:0/1531007558 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ddc1e5a60 0x7f6ddc1e5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:28.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.637+0000 7f6dd1400640 1 -- 172.21.15.138:0/1531007558 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6ddc0c7180 msgr2=0x7f6ddc1563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:28.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.637+0000 7f6dd1400640 1 --2- 172.21.15.138:0/1531007558 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6ddc0c7180 0x7f6ddc1563e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:28.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.637+0000 7f6dd1400640 1 -- 172.21.15.138:0/1531007558 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ddc1538b0 con 0x7f6ddc14f790 2024-04-26T20:57:28.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.637+0000 7f6dda800640 1 --2- 172.21.15.138:0/1531007558 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ddc1e5a60 0x7f6ddc1e5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:28.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.637+0000 7f6dd1400640 1 --2- 172.21.15.138:0/1531007558 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ddc14f790 0x7f6ddc1f54c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4012330 tx=0x7f6dc40127f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:28.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.637+0000 7f6dd2a00640 1 -- 172.21.15.138:0/1531007558 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc4016440 con 0x7f6ddc14f790 2024-04-26T20:57:28.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.637+0000 7f6dd2a00640 1 -- 172.21.15.138:0/1531007558 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dc40165e0 con 0x7f6ddc14f790 2024-04-26T20:57:28.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.637+0000 7f6dd2a00640 1 -- 172.21.15.138:0/1531007558 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc40169d0 con 0x7f6ddc14f790 2024-04-26T20:57:28.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.637+0000 7f6de0c00640 1 -- 172.21.15.138:0/1531007558 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ddc1e86e0 con 0x7f6ddc14f790 2024-04-26T20:57:28.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.637+0000 7f6de0c00640 1 -- 172.21.15.138:0/1531007558 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ddc1e8ca0 con 0x7f6ddc14f790 2024-04-26T20:57:28.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.637+0000 7f6de0c00640 1 -- 172.21.15.138:0/1531007558 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ddc069430 con 0x7f6ddc14f790 2024-04-26T20:57:28.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.637+0000 7f6dd2a00640 1 -- 172.21.15.138:0/1531007558 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6dc401e020 con 0x7f6ddc14f790 2024-04-26T20:57:28.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.641+0000 7f6dd2a00640 1 --2- 172.21.15.138:0/1531007558 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6db8068380 0x7f6db806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:28.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.641+0000 7f6dd2a00640 1 -- 172.21.15.138:0/1531007558 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7f6dc408a920 con 0x7f6ddc14f790 2024-04-26T20:57:28.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.641+0000 7f6dd9e00640 1 --2- 172.21.15.138:0/1531007558 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6db8068380 0x7f6db806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:28.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.641+0000 7f6dd9e00640 1 --2- 172.21.15.138:0/1531007558 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6db8068380 0x7f6db806a840 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc009d70 tx=0x7f6dcc009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:28.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.645+0000 7f6dd2a00640 1 -- 172.21.15.138:0/1531007558 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6dc405a4f0 con 0x7f6ddc14f790 2024-04-26T20:57:28.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.801+0000 7f6de0c00640 1 -- 172.21.15.138:0/1531007558 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f6ddc0d1840 con 0x7f6ddc14f790 2024-04-26T20:57:28.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.801+0000 7f6dd2a00640 1 -- 172.21.15.138:0/1531007558 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7f6dc405e7f0 con 0x7f6ddc14f790 2024-04-26T20:57:28.806 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 32 2024-04-26T20:57:28.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.805+0000 7f6de0c00640 1 -- 172.21.15.138:0/1531007558 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6db8068380 msgr2=0x7f6db806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:28.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.805+0000 7f6de0c00640 1 --2- 172.21.15.138:0/1531007558 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6db8068380 0x7f6db806a840 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc009d70 tx=0x7f6dcc009190 comp rx=0 tx=0).stop 2024-04-26T20:57:28.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.805+0000 7f6de0c00640 1 -- 172.21.15.138:0/1531007558 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ddc14f790 msgr2=0x7f6ddc1f54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:28.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.805+0000 7f6de0c00640 1 --2- 172.21.15.138:0/1531007558 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ddc14f790 0x7f6ddc1f54c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4012330 tx=0x7f6dc40127f0 comp rx=0 tx=0).stop 2024-04-26T20:57:28.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.805+0000 7f6de0c00640 1 -- 172.21.15.138:0/1531007558 shutdown_connections 2024-04-26T20:57:28.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.805+0000 7f6de0c00640 1 --2- 172.21.15.138:0/1531007558 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6db8068380 0x7f6db806a840 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:28.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.805+0000 7f6de0c00640 1 --2- 172.21.15.138:0/1531007558 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ddc1e5a60 0x7f6ddc1e5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:28.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.805+0000 7f6de0c00640 1 --2- 172.21.15.138:0/1531007558 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ddc14f790 0x7f6ddc1f54c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:28.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.805+0000 7f6de0c00640 1 --2- 172.21.15.138:0/1531007558 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6ddc0c7180 0x7f6ddc1563e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:28.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.805+0000 7f6de0c00640 1 -- 172.21.15.138:0/1531007558 >> 172.21.15.138:0/1531007558 conn(0x7f6ddc0d0bb0 msgr2=0x7f6ddc0cb5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:28.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.805+0000 7f6de0c00640 1 -- 172.21.15.138:0/1531007558 shutdown_connections 2024-04-26T20:57:28.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.805+0000 7f6de0c00640 1 -- 172.21.15.138:0/1531007558 wait complete. 2024-04-26T20:57:28.828 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T20:57:28.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.957+0000 7fc0d9200640 1 Processor -- start 2024-04-26T20:57:28.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.961+0000 7fc0d9200640 1 -- start start 2024-04-26T20:57:28.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.961+0000 7fc0d9200640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc0d4160140 0x7fc0d40b4470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:28.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.961+0000 7fc0d9200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc0d40b49b0 0x7fc0d4072950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:28.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.961+0000 7fc0d9200640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0d40b4f10 con 0x7fc0d406cf60 2024-04-26T20:57:28.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.961+0000 7fc0d9200640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fc0d406c480 con 0x7fc0d4160140 2024-04-26T20:57:28.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.961+0000 7fc0d9200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fc0d406c760 con 0x7fc0d40b49b0 2024-04-26T20:57:28.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.961+0000 7fc0d2800640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fc0d406cf60 0x7fc0d406e7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:58144/0 (socket says 172.21.15.138:58144) 2024-04-26T20:57:28.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.961+0000 7fc0d2800640 1 -- 172.21.15.138:0/2808054087 learned_addr learned my addr 172.21.15.138:0/2808054087 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:28.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.961+0000 7fc0d1e00640 1 --2- 172.21.15.138:0/2808054087 >> v2:172.21.15.143:3300/0 conn(0x7fc0d4160140 0x7fc0d40b4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:28.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.961+0000 7fc0d1400640 1 --2- 172.21.15.138:0/2808054087 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc0d40b49b0 0x7fc0d4072950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:28.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.961+0000 7fc0d0a00640 1 -- 172.21.15.138:0/2808054087 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 687305273 0 0) 0x7fc0d40b4f10 con 0x7fc0d406cf60 2024-04-26T20:57:28.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.961+0000 7fc0d0a00640 1 -- 172.21.15.138:0/2808054087 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0b8003530 con 0x7fc0d406cf60 2024-04-26T20:57:28.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.961+0000 7fc0d0a00640 1 -- 172.21.15.138:0/2808054087 <== mon.0 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2573689353 0 0) 0x7fc0b8003530 con 0x7fc0d406cf60 2024-04-26T20:57:28.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.961+0000 7fc0d0a00640 1 -- 172.21.15.138:0/2808054087 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc0d40b49b0 msgr2=0x7fc0d4072950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:28.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.961+0000 7fc0d0a00640 1 --2- 172.21.15.138:0/2808054087 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc0d40b49b0 0x7fc0d4072950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:28.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.961+0000 7fc0d0a00640 1 -- 172.21.15.138:0/2808054087 >> v2:172.21.15.143:3300/0 conn(0x7fc0d4160140 msgr2=0x7fc0d40b4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:28.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.961+0000 7fc0d0a00640 1 --2- 172.21.15.138:0/2808054087 >> v2:172.21.15.143:3300/0 conn(0x7fc0d4160140 0x7fc0d40b4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:28.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.961+0000 7fc0d0a00640 1 -- 172.21.15.138:0/2808054087 --> v1:172.21.15.138:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0d406ca40 con 0x7fc0d406cf60 2024-04-26T20:57:28.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.961+0000 7fc0d0a00640 1 -- 172.21.15.138:0/2808054087 <== mon.0 v1:172.21.15.138:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2715389689 0 0) 0x7fc0cc001a00 con 0x7fc0d406cf60 2024-04-26T20:57:28.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.961+0000 7fc0d0a00640 1 -- 172.21.15.138:0/2808054087 >> v1:172.21.15.138:6789/0 conn(0x7fc0d406cf60 legacy=0x7fc0d406e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:28.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.961+0000 7fc0d0a00640 1 --2- 172.21.15.138:0/2808054087 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0b80039c0 0x7fc0b8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:28.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.961+0000 7fc0d0a00640 1 --2- 172.21.15.138:0/2808054087 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc0b8004810 0x7fc0b8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:28.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.961+0000 7fc0d0a00640 1 --2- 172.21.15.138:0/2808054087 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc0b80051d0 0x7fc0b800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:28.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.961+0000 7fc0d0a00640 1 -- 172.21.15.138:0/2808054087 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d406c480 con 0x7fc0b80039c0 2024-04-26T20:57:28.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.961+0000 7fc0d0a00640 1 -- 172.21.15.138:0/2808054087 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d406c760 con 0x7fc0b8004810 2024-04-26T20:57:28.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.961+0000 7fc0d0a00640 1 -- 172.21.15.138:0/2808054087 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fc0b800bf40 con 0x7fc0b80051d0 2024-04-26T20:57:28.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.961+0000 7fc0d1400640 1 --2- 172.21.15.138:0/2808054087 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc0d40b49b0 0x7fc0d4072950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:57:28.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.961+0000 7fc0d1e00640 1 --2- 172.21.15.138:0/2808054087 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0b80039c0 0x7fc0b8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:28.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.961+0000 7fc0d2800640 1 --2- 172.21.15.138:0/2808054087 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc0b80051d0 0x7fc0b800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:28.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.961+0000 7fc0d1400640 1 --2- 172.21.15.138:0/2808054087 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc0b8004810 0x7fc0b8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:28.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.961+0000 7fc0d1e00640 1 -- 172.21.15.138:0/2808054087 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc0b80051d0 msgr2=0x7fc0b800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:28.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.961+0000 7fc0d1e00640 1 --2- 172.21.15.138:0/2808054087 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc0b80051d0 0x7fc0b800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:28.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.961+0000 7fc0d1e00640 1 -- 172.21.15.138:0/2808054087 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc0b8004810 msgr2=0x7fc0b8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:28.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.961+0000 7fc0d1e00640 1 --2- 172.21.15.138:0/2808054087 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc0b8004810 0x7fc0b8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:28.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.961+0000 7fc0d1e00640 1 -- 172.21.15.138:0/2808054087 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0b8003530 con 0x7fc0b80039c0 2024-04-26T20:57:28.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.965+0000 7fc0d1e00640 1 --2- 172.21.15.138:0/2808054087 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0b80039c0 0x7fc0b8003de0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc0c4009ae0 tx=0x7fc0c401c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8385e3848822e441 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:28.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.965+0000 7fc0d0a00640 1 -- 172.21.15.138:0/2808054087 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c40b1070 con 0x7fc0b80039c0 2024-04-26T20:57:28.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.965+0000 7fc0d0a00640 1 -- 172.21.15.138:0/2808054087 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0c40a4ae0 con 0x7fc0b80039c0 2024-04-26T20:57:28.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.965+0000 7fc0d0a00640 1 -- 172.21.15.138:0/2808054087 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c40096b0 con 0x7fc0b80039c0 2024-04-26T20:57:28.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.965+0000 7fc0d9200640 1 -- 172.21.15.138:0/2808054087 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0b80039c0 msgr2=0x7fc0b8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:28.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.965+0000 7fc0d9200640 1 --2- 172.21.15.138:0/2808054087 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0b80039c0 0x7fc0b8003de0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc0c4009ae0 tx=0x7fc0c401c730 comp rx=0 tx=0).stop 2024-04-26T20:57:28.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.965+0000 7fc0d2800640 1 -- 172.21.15.138:0/2808054087 reap_dead start 2024-04-26T20:57:28.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.965+0000 7fc0d9200640 1 -- 172.21.15.138:0/2808054087 shutdown_connections 2024-04-26T20:57:28.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.965+0000 7fc0d9200640 1 -- 172.21.15.138:0/2808054087 >> 172.21.15.138:0/2808054087 conn(0x7fc0d40b3570 msgr2=0x7fc0d40b3980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:28.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.965+0000 7fc0d9200640 1 -- 172.21.15.138:0/2808054087 shutdown_connections 2024-04-26T20:57:28.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.965+0000 7fc0d9200640 1 -- 172.21.15.138:0/2808054087 wait complete. 2024-04-26T20:57:28.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.969+0000 7fc0d9200640 1 Processor -- start 2024-04-26T20:57:28.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.969+0000 7fc0d9200640 1 -- start start 2024-04-26T20:57:28.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.969+0000 7fc0d9200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc0b80039c0 0x7fc0d4155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:28.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.969+0000 7fc0d9200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0d4165130 0x7fc0d415e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:28.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.969+0000 7fc0d9200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc0d4165590 0x7fc0d415e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:28.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.969+0000 7fc0d9200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d416a1d0 con 0x7fc0d4165130 2024-04-26T20:57:28.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.969+0000 7fc0d9200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d416a050 con 0x7fc0d4165590 2024-04-26T20:57:28.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.969+0000 7fc0d9200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fc0d416a350 con 0x7fc0b80039c0 2024-04-26T20:57:28.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.969+0000 7fc0d1400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0d4165130 0x7fc0d415e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:28.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.969+0000 7fc0d1400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0d4165130 0x7fc0d415e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40704/0 (socket says 172.21.15.138:40704) 2024-04-26T20:57:28.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.969+0000 7fc0d1400640 1 -- 172.21.15.138:0/3944153026 learned_addr learned my addr 172.21.15.138:0/3944153026 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:28.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.969+0000 7fc0d2800640 1 --2- 172.21.15.138:0/3944153026 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc0d4165590 0x7fc0d415e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:28.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.969+0000 7fc0d1e00640 1 --2- 172.21.15.138:0/3944153026 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc0b80039c0 0x7fc0d4155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:28.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.969+0000 7fc0d1400640 1 -- 172.21.15.138:0/3944153026 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc0b80039c0 msgr2=0x7fc0d4155cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:28.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.969+0000 7fc0d1400640 1 --2- 172.21.15.138:0/3944153026 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc0b80039c0 0x7fc0d4155cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:28.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.969+0000 7fc0d1400640 1 -- 172.21.15.138:0/3944153026 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc0d4165590 msgr2=0x7fc0d415e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:28.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.969+0000 7fc0d1400640 1 --2- 172.21.15.138:0/3944153026 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc0d4165590 0x7fc0d415e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:28.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.969+0000 7fc0d1400640 1 -- 172.21.15.138:0/3944153026 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0d4159d90 con 0x7fc0d4165130 2024-04-26T20:57:28.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.969+0000 7fc0d1400640 1 --2- 172.21.15.138:0/3944153026 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0d4165130 0x7fc0d415e470 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc0c00119d0 tx=0x7fc0c0011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:28.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.969+0000 7fc0ca000640 1 -- 172.21.15.138:0/3944153026 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c000faf0 con 0x7fc0d4165130 2024-04-26T20:57:28.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.969+0000 7fc0ca000640 1 -- 172.21.15.138:0/3944153026 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0c000fc90 con 0x7fc0d4165130 2024-04-26T20:57:28.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.969+0000 7fc0d9200640 1 -- 172.21.15.138:0/3944153026 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0d415a070 con 0x7fc0d4165130 2024-04-26T20:57:28.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.969+0000 7fc0ca000640 1 -- 172.21.15.138:0/3944153026 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c0014440 con 0x7fc0d4165130 2024-04-26T20:57:28.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.969+0000 7fc0d9200640 1 -- 172.21.15.138:0/3944153026 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0d415a630 con 0x7fc0d4165130 2024-04-26T20:57:28.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.973+0000 7fc0d9200640 1 -- 172.21.15.138:0/3944153026 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0d4069510 con 0x7fc0d4165130 2024-04-26T20:57:28.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.973+0000 7fc0ca000640 1 -- 172.21.15.138:0/3944153026 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc0c0012040 con 0x7fc0d4165130 2024-04-26T20:57:28.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.973+0000 7fc0ca000640 1 --2- 172.21.15.138:0/3944153026 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc0b40683b0 0x7fc0b406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:28.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.973+0000 7fc0ca000640 1 -- 172.21.15.138:0/3944153026 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7fc0c0087410 con 0x7fc0d4165130 2024-04-26T20:57:28.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.973+0000 7fc0d1e00640 1 --2- 172.21.15.138:0/3944153026 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc0b40683b0 0x7fc0b406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:28.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.973+0000 7fc0d1e00640 1 --2- 172.21.15.138:0/3944153026 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc0b40683b0 0x7fc0b406a870 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc0c40ae000 tx=0x7fc0c40046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:28.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:28.977+0000 7fc0ca000640 1 -- 172.21.15.138:0/3944153026 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc0c0019030 con 0x7fc0d4165130 2024-04-26T20:57:29.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.145+0000 7fc0d9200640 1 -- 172.21.15.138:0/3944153026 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc0d406d720 con 0x7fc0d4165130 2024-04-26T20:57:29.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.145+0000 7fc0ca000640 1 -- 172.21.15.138:0/3944153026 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7fc0c00575a0 con 0x7fc0d4165130 2024-04-26T20:57:29.149 INFO:teuthology.orchestra.run.smithi138.stderr:listed 0 entries 2024-04-26T20:57:29.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.145+0000 7fc0d9200640 1 -- 172.21.15.138:0/3944153026 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc0b40683b0 msgr2=0x7fc0b406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:29.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.145+0000 7fc0d9200640 1 --2- 172.21.15.138:0/3944153026 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc0b40683b0 0x7fc0b406a870 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc0c40ae000 tx=0x7fc0c40046d0 comp rx=0 tx=0).stop 2024-04-26T20:57:29.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.145+0000 7fc0d9200640 1 -- 172.21.15.138:0/3944153026 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0d4165130 msgr2=0x7fc0d415e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:29.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.145+0000 7fc0d9200640 1 --2- 172.21.15.138:0/3944153026 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0d4165130 0x7fc0d415e470 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc0c00119d0 tx=0x7fc0c0011dd0 comp rx=0 tx=0).stop 2024-04-26T20:57:29.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.145+0000 7fc0d9200640 1 -- 172.21.15.138:0/3944153026 shutdown_connections 2024-04-26T20:57:29.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.145+0000 7fc0d9200640 1 --2- 172.21.15.138:0/3944153026 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc0b40683b0 0x7fc0b406a870 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:29.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.145+0000 7fc0d9200640 1 --2- 172.21.15.138:0/3944153026 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc0d4165590 0x7fc0d415e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:29.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.145+0000 7fc0d9200640 1 --2- 172.21.15.138:0/3944153026 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0d4165130 0x7fc0d415e470 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:29.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.145+0000 7fc0d9200640 1 --2- 172.21.15.138:0/3944153026 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc0b80039c0 0x7fc0d4155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:29.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.145+0000 7fc0d9200640 1 -- 172.21.15.138:0/3944153026 >> 172.21.15.138:0/3944153026 conn(0x7fc0d40b3570 msgr2=0x7fc0d40b27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:29.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.145+0000 7fc0d9200640 1 -- 172.21.15.138:0/3944153026 shutdown_connections 2024-04-26T20:57:29.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.145+0000 7fc0d9200640 1 -- 172.21.15.138:0/3944153026 wait complete. 2024-04-26T20:57:29.170 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-26T20:57:29.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:57:29.171 DEBUG:teuthology.orchestra.run.smithi138:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-04-26T20:57:29.206 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi138.front.sepia.ceph.com 2024-04-26T20:57:29.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:57:29.206 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T20:57:29.260 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T20:57:29.260 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T20:57:29.270 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T20:57:29.270 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T20:57:29.323 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T20:57:29.323 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T20:57:29.374 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:57:29.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.505+0000 7f5961800640 1 Processor -- start 2024-04-26T20:57:29.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.505+0000 7f5961800640 1 -- start start 2024-04-26T20:57:29.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.505+0000 7f5961800640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f595c0cc1e0 0x7f595c0ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:29.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.505+0000 7f5961800640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f595c0727f0 con 0x7f595c0cbe00 2024-04-26T20:57:29.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.505+0000 7f5961800640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f595c072a70 con 0x7f595c15cf80 2024-04-26T20:57:29.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.505+0000 7f5961800640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f595c074220 con 0x7f595c0cc1e0 2024-04-26T20:57:29.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.505+0000 7f595aa00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f595c0cbe00 0x7f595c06de70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:58156/0 (socket says 172.21.15.138:58156) 2024-04-26T20:57:29.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.505+0000 7f595aa00640 1 -- 172.21.15.138:0/234362691 learned_addr learned my addr 172.21.15.138:0/234362691 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:29.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.505+0000 7f595b400640 1 --2- 172.21.15.138:0/234362691 >> v2:172.21.15.143:3300/0 conn(0x7f595c0cc1e0 0x7f595c0ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:29.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.505+0000 7f595a000640 1 -- 172.21.15.138:0/234362691 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3656654005 0 0) 0x7f594c001120 con 0x7f595c0cbe00 2024-04-26T20:57:29.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.509+0000 7f595a000640 1 -- 172.21.15.138:0/234362691 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5940005740 con 0x7f595c0cbe00 2024-04-26T20:57:29.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.509+0000 7f595a000640 1 -- 172.21.15.138:0/234362691 <== mon.0 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 309548718 0 0) 0x7f5940005740 con 0x7f595c0cbe00 2024-04-26T20:57:29.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.509+0000 7f595a000640 1 -- 172.21.15.138:0/234362691 >> v2:172.21.15.143:3300/0 conn(0x7f595c0cc1e0 msgr2=0x7f595c0ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:29.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.509+0000 7f595a000640 1 --2- 172.21.15.138:0/234362691 >> v2:172.21.15.143:3300/0 conn(0x7f595c0cc1e0 0x7f595c0ce6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:29.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.509+0000 7f595a000640 1 -- 172.21.15.138:0/234362691 >> v1:172.21.15.143:6789/0 conn(0x7f595c15cf80 legacy=0x7f595c073b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:29.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.509+0000 7f595a000640 1 -- 172.21.15.138:0/234362691 --> v1:172.21.15.138:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f595c072d50 con 0x7f595c0cbe00 2024-04-26T20:57:29.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.509+0000 7f595a000640 1 -- 172.21.15.138:0/234362691 <== mon.0 v1:172.21.15.138:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2715389689 0 0) 0x7f594c001850 con 0x7f595c0cbe00 2024-04-26T20:57:29.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.509+0000 7f595a000640 1 -- 172.21.15.138:0/234362691 >> v1:172.21.15.138:6789/0 conn(0x7f595c0cbe00 legacy=0x7f595c06de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:29.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.509+0000 7f595a000640 1 --2- 172.21.15.138:0/234362691 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5940005bd0 0x7f5940005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:29.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.509+0000 7f595a000640 1 --2- 172.21.15.138:0/234362691 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5940006a20 0x7f5940006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:29.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.509+0000 7f595a000640 1 --2- 172.21.15.138:0/234362691 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f59400073e0 0x7f594000dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:29.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.509+0000 7f595a000640 1 -- 172.21.15.138:0/234362691 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f595c074220 con 0x7f5940005bd0 2024-04-26T20:57:29.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.509+0000 7f595a000640 1 -- 172.21.15.138:0/234362691 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f594000e280 con 0x7f5940006a20 2024-04-26T20:57:29.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.509+0000 7f595a000640 1 -- 172.21.15.138:0/234362691 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f594000e480 con 0x7f59400073e0 2024-04-26T20:57:29.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.509+0000 7f595aa00640 1 --2- 172.21.15.138:0/234362691 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5940005bd0 0x7f5940005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:29.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.509+0000 7f5952000640 1 --2- 172.21.15.138:0/234362691 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5940006a20 0x7f5940006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:29.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.509+0000 7f595b400640 1 --2- 172.21.15.138:0/234362691 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f59400073e0 0x7f594000dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:29.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.509+0000 7f595aa00640 1 -- 172.21.15.138:0/234362691 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f59400073e0 msgr2=0x7f594000dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:29.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.509+0000 7f595aa00640 1 --2- 172.21.15.138:0/234362691 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f59400073e0 0x7f594000dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:29.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.509+0000 7f595aa00640 1 -- 172.21.15.138:0/234362691 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5940006a20 msgr2=0x7f5940006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:29.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.509+0000 7f595aa00640 1 --2- 172.21.15.138:0/234362691 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5940006a20 0x7f5940006ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:29.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.509+0000 7f595aa00640 1 -- 172.21.15.138:0/234362691 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5940005740 con 0x7f5940005bd0 2024-04-26T20:57:29.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.509+0000 7f595b400640 1 -- 172.21.15.138:0/234362691 reap_dead start 2024-04-26T20:57:29.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.509+0000 7f595aa00640 1 --2- 172.21.15.138:0/234362691 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5940005bd0 0x7f5940005ff0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f594c00c4c0 tx=0x7f594c01cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5930730a12e0c0f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:29.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.513+0000 7f595a000640 1 -- 172.21.15.138:0/234362691 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f594c00c0e0 con 0x7f5940005bd0 2024-04-26T20:57:29.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.513+0000 7f595a000640 1 -- 172.21.15.138:0/234362691 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f594c0a9070 con 0x7f5940005bd0 2024-04-26T20:57:29.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.513+0000 7f595a000640 1 -- 172.21.15.138:0/234362691 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f594c005d80 con 0x7f5940005bd0 2024-04-26T20:57:29.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.513+0000 7f5961800640 1 -- 172.21.15.138:0/234362691 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5940005bd0 msgr2=0x7f5940005ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:29.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.513+0000 7f5961800640 1 --2- 172.21.15.138:0/234362691 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5940005bd0 0x7f5940005ff0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f594c00c4c0 tx=0x7f594c01cc20 comp rx=0 tx=0).stop 2024-04-26T20:57:29.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.513+0000 7f5961800640 1 -- 172.21.15.138:0/234362691 shutdown_connections 2024-04-26T20:57:29.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.513+0000 7f5961800640 1 --2- 172.21.15.138:0/234362691 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5940005bd0 0x7f5940005ff0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:29.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.513+0000 7f5961800640 1 -- 172.21.15.138:0/234362691 >> 172.21.15.138:0/234362691 conn(0x7f595c0d0b20 msgr2=0x7f595c0d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:29.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.513+0000 7f5961800640 1 -- 172.21.15.138:0/234362691 shutdown_connections 2024-04-26T20:57:29.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.513+0000 7f5961800640 1 -- 172.21.15.138:0/234362691 wait complete. 2024-04-26T20:57:29.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.513+0000 7f5961800640 1 Processor -- start 2024-04-26T20:57:29.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.513+0000 7f5961800640 1 -- start start 2024-04-26T20:57:29.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.513+0000 7f5961800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5940005bd0 0x7f595c150fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:29.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.513+0000 7f5961800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f595c154cf0 0x7f595c15fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:29.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.513+0000 7f5961800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f595c157460 0x7f595c1578e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:29.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.513+0000 7f5961800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f595c0d0900 con 0x7f5940005bd0 2024-04-26T20:57:29.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.513+0000 7f5961800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f595c0d0780 con 0x7f595c154cf0 2024-04-26T20:57:29.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.513+0000 7f5961800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f595c0ce6f0 con 0x7f595c157460 2024-04-26T20:57:29.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.513+0000 7f595aa00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5940005bd0 0x7f595c150fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:29.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.513+0000 7f595aa00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5940005bd0 0x7f595c150fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40716/0 (socket says 172.21.15.138:40716) 2024-04-26T20:57:29.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.513+0000 7f595aa00640 1 -- 172.21.15.138:0/3909882310 learned_addr learned my addr 172.21.15.138:0/3909882310 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:29.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.513+0000 7f595b400640 1 --2- 172.21.15.138:0/3909882310 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f595c157460 0x7f595c1578e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:29.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.513+0000 7f5952000640 1 --2- 172.21.15.138:0/3909882310 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f595c154cf0 0x7f595c15fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:29.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.517+0000 7f595aa00640 1 -- 172.21.15.138:0/3909882310 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f595c157460 msgr2=0x7f595c1578e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:29.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.517+0000 7f595aa00640 1 --2- 172.21.15.138:0/3909882310 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f595c157460 0x7f595c1578e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:29.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.517+0000 7f595aa00640 1 -- 172.21.15.138:0/3909882310 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f595c154cf0 msgr2=0x7f595c15fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:29.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.517+0000 7f595aa00640 1 --2- 172.21.15.138:0/3909882310 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f595c154cf0 0x7f595c15fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:29.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.517+0000 7f595aa00640 1 -- 172.21.15.138:0/3909882310 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f595c160740 con 0x7f5940005bd0 2024-04-26T20:57:29.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.517+0000 7f595aa00640 1 --2- 172.21.15.138:0/3909882310 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5940005bd0 0x7f595c150fb0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f594c01ca50 tx=0x7f5940007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:29.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.517+0000 7f5953400640 1 -- 172.21.15.138:0/3909882310 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f594c001120 con 0x7f5940005bd0 2024-04-26T20:57:29.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.517+0000 7f5953400640 1 -- 172.21.15.138:0/3909882310 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f594c007180 con 0x7f5940005bd0 2024-04-26T20:57:29.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.517+0000 7f5953400640 1 -- 172.21.15.138:0/3909882310 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f594c007570 con 0x7f5940005bd0 2024-04-26T20:57:29.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.517+0000 7f5961800640 1 -- 172.21.15.138:0/3909882310 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f595c1566a0 con 0x7f5940005bd0 2024-04-26T20:57:29.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.517+0000 7f5961800640 1 -- 172.21.15.138:0/3909882310 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f595c156c60 con 0x7f5940005bd0 2024-04-26T20:57:29.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.517+0000 7f5961800640 1 -- 172.21.15.138:0/3909882310 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f595c069510 con 0x7f5940005bd0 2024-04-26T20:57:29.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.517+0000 7f5953400640 1 -- 172.21.15.138:0/3909882310 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f594c0047f0 con 0x7f5940005bd0 2024-04-26T20:57:29.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.517+0000 7f5953400640 1 --2- 172.21.15.138:0/3909882310 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f59380683b0 0x7f593806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:29.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.517+0000 7f5953400640 1 -- 172.21.15.138:0/3909882310 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7f594c120130 con 0x7f5940005bd0 2024-04-26T20:57:29.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.517+0000 7f5952000640 1 --2- 172.21.15.138:0/3909882310 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f59380683b0 0x7f593806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:29.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.521+0000 7f5952000640 1 --2- 172.21.15.138:0/3909882310 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f59380683b0 0x7f593806a870 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f595c0cf760 tx=0x7f5944009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:29.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.521+0000 7f5953400640 1 -- 172.21.15.138:0/3909882310 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f595c0727f0 con 0x7f5940005bd0 2024-04-26T20:57:29.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.681+0000 7f5961800640 1 -- 172.21.15.138:0/3909882310 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f595c0cfe40 con 0x7f5940005bd0 2024-04-26T20:57:29.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.681+0000 7f5953400640 1 -- 172.21.15.138:0/3909882310 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18719 (secure 0 0 0) 0x7f594c0f03f0 con 0x7f5940005bd0 2024-04-26T20:57:29.686 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:57:29.686 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":29,"fsid":"c22b4730-12cc-4558-8535-b965384398c0","created":"2024-04-26T20:56:14.182475+0000","modified":"2024-04-26T20:57:20.395184+0000","last_up_change":"2024-04-26T20:56:26.013243+0000","last_in_change":"2024-04-26T20:56:16.714055+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:56:27.265834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:56:37.394398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:56:38.544369+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:56:42.240243+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3f9a2e34-3199-466f-a6cf-57927318121e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6801","nonce":3534772245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6803","nonce":3534772245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6807","nonce":3534772245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6805","nonce":3534772245}]},"public_addr":"172.21.15.138:6801/3534772245","cluster_addr":"172.21.15.138:6803/3534772245","heartbeat_back_addr":"172.21.15.138:6807/3534772245","heartbeat_front_addr":"172.21.15.138:6805/3534772245","state":["exists","up"]},{"osd":1,"uuid":"e881fcf6-3248-4696-a2ef-95d206d77712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6817","nonce":1427635773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6819","nonce":1427635773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6823","nonce":1427635773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6821","nonce":1427635773}]},"public_addr":"172.21.15.138:6817/1427635773","cluster_addr":"172.21.15.138:6819/1427635773","heartbeat_back_addr":"172.21.15.138:6823/1427635773","heartbeat_front_addr":"172.21.15.138:6821/1427635773","state":["exists","up"]},{"osd":2,"uuid":"f7d1db33-7672-4699-ae47-9f1e0a8e4222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6809","nonce":4273721573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6811","nonce":4273721573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6815","nonce":4273721573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6813","nonce":4273721573}]},"public_addr":"172.21.15.138:6809/4273721573","cluster_addr":"172.21.15.138:6811/4273721573","heartbeat_back_addr":"172.21.15.138:6815/4273721573","heartbeat_front_addr":"172.21.15.138:6813/4273721573","state":["exists","up"]},{"osd":3,"uuid":"2f4e0a9a-b8f6-4468-844a-a4501cd85054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6825","nonce":3098242154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6827","nonce":3098242154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6831","nonce":3098242154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6829","nonce":3098242154}]},"public_addr":"172.21.15.138:6825/3098242154","cluster_addr":"172.21.15.138:6827/3098242154","heartbeat_back_addr":"172.21.15.138:6831/3098242154","heartbeat_front_addr":"172.21.15.138:6829/3098242154","state":["exists","up"]},{"osd":4,"uuid":"c85df99b-3624-410e-866b-86830af2cfe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6801","nonce":2942056312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6803","nonce":2942056312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6807","nonce":2942056312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6805","nonce":2942056312}]},"public_addr":"172.21.15.143:6801/2942056312","cluster_addr":"172.21.15.143:6803/2942056312","heartbeat_back_addr":"172.21.15.143:6807/2942056312","heartbeat_front_addr":"172.21.15.143:6805/2942056312","state":["exists","up"]},{"osd":5,"uuid":"9af1efb5-c416-4808-b5ef-de0679ab9705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6809","nonce":1910222887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6811","nonce":1910222887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6815","nonce":1910222887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6813","nonce":1910222887}]},"public_addr":"172.21.15.143:6809/1910222887","cluster_addr":"172.21.15.143:6811/1910222887","heartbeat_back_addr":"172.21.15.143:6815/1910222887","heartbeat_front_addr":"172.21.15.143:6813/1910222887","state":["exists","up"]},{"osd":6,"uuid":"d7138615-8838-45ff-9072-2fd0683362f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6817","nonce":1082239825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6819","nonce":1082239825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6823","nonce":1082239825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6821","nonce":1082239825}]},"public_addr":"172.21.15.143:6817/1082239825","cluster_addr":"172.21.15.143:6819/1082239825","heartbeat_back_addr":"172.21.15.143:6823/1082239825","heartbeat_front_addr":"172.21.15.143:6821/1082239825","state":["exists","up"]},{"osd":7,"uuid":"0c27172b-35c4-49ec-ba0b-0137b8ff0010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6825","nonce":3295508495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6827","nonce":3295508495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6831","nonce":3295508495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6829","nonce":3295508495}]},"public_addr":"172.21.15.143:6825/3295508495","cluster_addr":"172.21.15.143:6827/3295508495","heartbeat_back_addr":"172.21.15.143:6831/3295508495","heartbeat_front_addr":"172.21.15.143:6829/3295508495","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.326627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.396119+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.433915+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.414179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.216947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.329272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.503073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.436382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.39","mappings":[{"from":0,"to":7}]},{"pgid":"4.6","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:57:29.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.685+0000 7f5961800640 1 -- 172.21.15.138:0/3909882310 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f59380683b0 msgr2=0x7f593806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:29.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.685+0000 7f5961800640 1 --2- 172.21.15.138:0/3909882310 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f59380683b0 0x7f593806a870 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f595c0cf760 tx=0x7f5944009040 comp rx=0 tx=0).stop 2024-04-26T20:57:29.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.685+0000 7f5961800640 1 -- 172.21.15.138:0/3909882310 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5940005bd0 msgr2=0x7f595c150fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:29.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.685+0000 7f5961800640 1 --2- 172.21.15.138:0/3909882310 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5940005bd0 0x7f595c150fb0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f594c01ca50 tx=0x7f5940007a50 comp rx=0 tx=0).stop 2024-04-26T20:57:29.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.685+0000 7f5961800640 1 -- 172.21.15.138:0/3909882310 shutdown_connections 2024-04-26T20:57:29.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.685+0000 7f5961800640 1 --2- 172.21.15.138:0/3909882310 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f59380683b0 0x7f593806a870 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:29.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.685+0000 7f5961800640 1 --2- 172.21.15.138:0/3909882310 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f595c157460 0x7f595c1578e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:29.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.685+0000 7f5961800640 1 --2- 172.21.15.138:0/3909882310 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f595c154cf0 0x7f595c15fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:29.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.685+0000 7f5961800640 1 --2- 172.21.15.138:0/3909882310 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5940005bd0 0x7f595c150fb0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:29.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.685+0000 7f5961800640 1 -- 172.21.15.138:0/3909882310 >> 172.21.15.138:0/3909882310 conn(0x7f595c0d0b20 msgr2=0x7f595c15b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:29.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.685+0000 7f5961800640 1 -- 172.21.15.138:0/3909882310 shutdown_connections 2024-04-26T20:57:29.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.685+0000 7f5961800640 1 -- 172.21.15.138:0/3909882310 wait complete. 2024-04-26T20:57:29.707 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:56:27.265834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T20:56:37.394398+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T20:56:38.544369+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T20:56:42.240243+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T20:57:29.707 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T20:57:29.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.841+0000 7f6c30600640 1 Processor -- start 2024-04-26T20:57:29.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.841+0000 7f6c30600640 1 -- start start 2024-04-26T20:57:29.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.841+0000 7f6c30600640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f6c2806f880 0x7f6c28166cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:29.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.841+0000 7f6c30600640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c28160750 con 0x7f6c2815bdc0 2024-04-26T20:57:29.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.841+0000 7f6c30600640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c2806dee0 con 0x7f6c28073d70 2024-04-26T20:57:29.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.841+0000 7f6c30600640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f6c2815c1a0 con 0x7f6c2806f880 2024-04-26T20:57:29.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.841+0000 7f6c2e600640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f6c2806f880 0x7f6c28166cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:29.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.841+0000 7f6c2dc00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f6c2815bdc0 0x7f6c2815f930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:58162/0 (socket says 172.21.15.138:58162) 2024-04-26T20:57:29.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.841+0000 7f6c2dc00640 1 -- 172.21.15.138:0/1949422905 learned_addr learned my addr 172.21.15.138:0/1949422905 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:29.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.841+0000 7f6c2e600640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f6c2806f880 0x7f6c28166cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40726/0 (socket says 172.21.15.138:40726) 2024-04-26T20:57:29.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.841+0000 7f6c2e600640 1 -- 172.21.15.138:0/1949422905 >> v1:172.21.15.143:6789/0 conn(0x7f6c28073d70 legacy=0x7f6c28160040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:29.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.841+0000 7f6c2e600640 1 -- 172.21.15.138:0/1949422905 >> v1:172.21.15.138:6789/0 conn(0x7f6c2815bdc0 legacy=0x7f6c2815f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:29.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.841+0000 7f6c2e600640 1 -- 172.21.15.138:0/1949422905 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c2806e180 con 0x7f6c2806f880 2024-04-26T20:57:29.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.845+0000 7f6c2e600640 1 --2- 172.21.15.138:0/1949422905 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c2806f880 0x7f6c28166cc0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6c200097c0 tx=0x7f6c2001c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dbb8ab710325fb2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:29.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.845+0000 7f6c27e00640 1 -- 172.21.15.138:0/1949422905 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c200b0070 con 0x7f6c2806f880 2024-04-26T20:57:29.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.845+0000 7f6c27e00640 1 -- 172.21.15.138:0/1949422905 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c200ab600 con 0x7f6c2806f880 2024-04-26T20:57:29.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.845+0000 7f6c27e00640 1 -- 172.21.15.138:0/1949422905 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c200ab9d0 con 0x7f6c2806f880 2024-04-26T20:57:29.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.845+0000 7f6c30600640 1 -- 172.21.15.138:0/1949422905 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c2806f880 msgr2=0x7f6c28166cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:29.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.845+0000 7f6c30600640 1 --2- 172.21.15.138:0/1949422905 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c2806f880 0x7f6c28166cc0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6c200097c0 tx=0x7f6c2001c340 comp rx=0 tx=0).stop 2024-04-26T20:57:29.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.845+0000 7f6c30600640 1 -- 172.21.15.138:0/1949422905 shutdown_connections 2024-04-26T20:57:29.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.845+0000 7f6c30600640 1 --2- 172.21.15.138:0/1949422905 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c2806f880 0x7f6c28166cc0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:29.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.845+0000 7f6c30600640 1 -- 172.21.15.138:0/1949422905 >> 172.21.15.138:0/1949422905 conn(0x7f6c280d0bb0 msgr2=0x7f6c280d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:29.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.845+0000 7f6c30600640 1 -- 172.21.15.138:0/1949422905 shutdown_connections 2024-04-26T20:57:29.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.845+0000 7f6c30600640 1 -- 172.21.15.138:0/1949422905 wait complete. 2024-04-26T20:57:29.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.849+0000 7f6c30600640 1 Processor -- start 2024-04-26T20:57:29.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.849+0000 7f6c30600640 1 -- start start 2024-04-26T20:57:29.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.849+0000 7f6c30600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c2806f880 0x7f6c28152c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:29.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.849+0000 7f6c30600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6c28073d70 0x7f6c280af3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:29.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.849+0000 7f6c30600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c2815bdc0 0x7f6c2806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:29.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.849+0000 7f6c30600640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f6c28169ba0 con 0x7f6c2815bdc0 2024-04-26T20:57:29.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.849+0000 7f6c30600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f6c28169a20 con 0x7f6c2806f880 2024-04-26T20:57:29.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.849+0000 7f6c30600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f6c28169d20 con 0x7f6c28073d70 2024-04-26T20:57:29.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.849+0000 7f6c2e600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c2815bdc0 0x7f6c2806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:29.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.849+0000 7f6c2e600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c2815bdc0 0x7f6c2806e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40736/0 (socket says 172.21.15.138:40736) 2024-04-26T20:57:29.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.849+0000 7f6c2e600640 1 -- 172.21.15.138:0/1603803109 learned_addr learned my addr 172.21.15.138:0/1603803109 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:29.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.849+0000 7f6c2dc00640 1 --2- 172.21.15.138:0/1603803109 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c2806f880 0x7f6c28152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:29.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.849+0000 7f6c2d200640 1 --2- 172.21.15.138:0/1603803109 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6c28073d70 0x7f6c280af3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:29.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.849+0000 7f6c2e600640 1 -- 172.21.15.138:0/1603803109 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6c28073d70 msgr2=0x7f6c280af3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:29.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.849+0000 7f6c2e600640 1 --2- 172.21.15.138:0/1603803109 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6c28073d70 0x7f6c280af3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:29.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.849+0000 7f6c2e600640 1 -- 172.21.15.138:0/1603803109 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c2806f880 msgr2=0x7f6c28152c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:29.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.849+0000 7f6c2e600640 1 --2- 172.21.15.138:0/1603803109 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c2806f880 0x7f6c28152c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:29.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.849+0000 7f6c2e600640 1 -- 172.21.15.138:0/1603803109 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c28155260 con 0x7f6c2815bdc0 2024-04-26T20:57:29.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.849+0000 7f6c2d200640 1 --2- 172.21.15.138:0/1603803109 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6c28073d70 0x7f6c280af3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:57:29.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.849+0000 7f6c2e600640 1 --2- 172.21.15.138:0/1603803109 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c2815bdc0 0x7f6c2806e770 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6c200ae040 tx=0x7f6c200190e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:29.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.849+0000 7f6c25600640 1 -- 172.21.15.138:0/1603803109 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c200b8020 con 0x7f6c2815bdc0 2024-04-26T20:57:29.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.849+0000 7f6c25600640 1 -- 172.21.15.138:0/1603803109 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c200b4410 con 0x7f6c2815bdc0 2024-04-26T20:57:29.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.849+0000 7f6c25600640 1 -- 172.21.15.138:0/1603803109 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c200b0040 con 0x7f6c2815bdc0 2024-04-26T20:57:29.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.849+0000 7f6c30600640 1 -- 172.21.15.138:0/1603803109 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c28155540 con 0x7f6c2815bdc0 2024-04-26T20:57:29.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.849+0000 7f6c30600640 1 -- 172.21.15.138:0/1603803109 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c28155b00 con 0x7f6c2815bdc0 2024-04-26T20:57:29.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.853+0000 7f6c30600640 1 -- 172.21.15.138:0/1603803109 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c28069430 con 0x7f6c2815bdc0 2024-04-26T20:57:29.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.853+0000 7f6c25600640 1 -- 172.21.15.138:0/1603803109 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6c200bb020 con 0x7f6c2815bdc0 2024-04-26T20:57:29.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.853+0000 7f6c25600640 1 --2- 172.21.15.138:0/1603803109 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6c080683b0 0x7f6c0806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:29.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.853+0000 7f6c25600640 1 -- 172.21.15.138:0/1603803109 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7f6c20120ad0 con 0x7f6c2815bdc0 2024-04-26T20:57:29.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.853+0000 7f6c2dc00640 1 --2- 172.21.15.138:0/1603803109 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6c080683b0 0x7f6c0806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:29.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.853+0000 7f6c2dc00640 1 --2- 172.21.15.138:0/1603803109 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6c080683b0 0x7f6c0806a870 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c0012f0 tx=0x7f6c1c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:29.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:29.857+0000 7f6c25600640 1 -- 172.21.15.138:0/1603803109 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6c200c2030 con 0x7f6c2815bdc0 2024-04-26T20:57:30.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.013+0000 7f6c30600640 1 -- 172.21.15.138:0/1603803109 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6c280ccbb0 con 0x7f6c2815bdc0 2024-04-26T20:57:30.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.013+0000 7f6c25600640 1 -- 172.21.15.138:0/1603803109 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f6c20016050 con 0x7f6c2815bdc0 2024-04-26T20:57:30.017 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 1 2024-04-26T20:57:30.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.013+0000 7f6c30600640 1 -- 172.21.15.138:0/1603803109 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6c080683b0 msgr2=0x7f6c0806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:30.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.013+0000 7f6c30600640 1 --2- 172.21.15.138:0/1603803109 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6c080683b0 0x7f6c0806a870 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c0012f0 tx=0x7f6c1c009040 comp rx=0 tx=0).stop 2024-04-26T20:57:30.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.013+0000 7f6c30600640 1 -- 172.21.15.138:0/1603803109 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c2815bdc0 msgr2=0x7f6c2806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:30.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.013+0000 7f6c30600640 1 --2- 172.21.15.138:0/1603803109 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c2815bdc0 0x7f6c2806e770 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6c200ae040 tx=0x7f6c200190e0 comp rx=0 tx=0).stop 2024-04-26T20:57:30.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.013+0000 7f6c30600640 1 -- 172.21.15.138:0/1603803109 shutdown_connections 2024-04-26T20:57:30.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.013+0000 7f6c30600640 1 --2- 172.21.15.138:0/1603803109 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6c080683b0 0x7f6c0806a870 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:30.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.013+0000 7f6c30600640 1 --2- 172.21.15.138:0/1603803109 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c2815bdc0 0x7f6c2806e770 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:30.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.013+0000 7f6c30600640 1 --2- 172.21.15.138:0/1603803109 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6c28073d70 0x7f6c280af3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:30.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.013+0000 7f6c30600640 1 --2- 172.21.15.138:0/1603803109 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c2806f880 0x7f6c28152c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:30.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.013+0000 7f6c30600640 1 -- 172.21.15.138:0/1603803109 >> 172.21.15.138:0/1603803109 conn(0x7f6c280d0bb0 msgr2=0x7f6c280d0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:30.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.013+0000 7f6c30600640 1 -- 172.21.15.138:0/1603803109 shutdown_connections 2024-04-26T20:57:30.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.013+0000 7f6c30600640 1 -- 172.21.15.138:0/1603803109 wait complete. 2024-04-26T20:57:30.038 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T20:57:30.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.172+0000 7f0a5b600640 1 Processor -- start 2024-04-26T20:57:30.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.172+0000 7f0a5b600640 1 -- start start 2024-04-26T20:57:30.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.172+0000 7f0a5b600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0a5415aa60 0x7f0a540cc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:30.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.172+0000 7f0a5b600640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a540cd210 con 0x7f0a540ccd20 2024-04-26T20:57:30.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.172+0000 7f0a5b600640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a5415d6a0 con 0x7f0a540cb910 2024-04-26T20:57:30.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.172+0000 7f0a5b600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f0a5415d980 con 0x7f0a5415aa60 2024-04-26T20:57:30.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.172+0000 7f0a53e00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f0a540ccd20 0x7f0a540cb200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:58176/0 (socket says 172.21.15.138:58176) 2024-04-26T20:57:30.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.172+0000 7f0a53e00640 1 -- 172.21.15.138:0/3842178607 learned_addr learned my addr 172.21.15.138:0/3842178607 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:30.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.172+0000 7f0a58c00640 1 --2- 172.21.15.138:0/3842178607 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0a5415aa60 0x7f0a540cc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:30.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.176+0000 7f0a53400640 1 -- 172.21.15.138:0/3842178607 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3213215350 0 0) 0x7f0a540cd210 con 0x7f0a540ccd20 2024-04-26T20:57:30.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.176+0000 7f0a53400640 1 -- 172.21.15.138:0/3842178607 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a3c003530 con 0x7f0a540ccd20 2024-04-26T20:57:30.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.176+0000 7f0a53400640 1 -- 172.21.15.138:0/3842178607 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3409875691 0 0) 0x7f0a5415d6a0 con 0x7f0a540cb910 2024-04-26T20:57:30.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.176+0000 7f0a58c00640 1 -- 172.21.15.138:0/3842178607 >> v1:172.21.15.143:6789/0 conn(0x7f0a540cb910 legacy=0x7f0a540b5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:30.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.176+0000 7f0a58c00640 1 -- 172.21.15.138:0/3842178607 >> v1:172.21.15.138:6789/0 conn(0x7f0a540ccd20 legacy=0x7f0a540cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:30.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.176+0000 7f0a58c00640 1 -- 172.21.15.138:0/3842178607 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a5415dc60 con 0x7f0a5415aa60 2024-04-26T20:57:30.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.176+0000 7f0a58c00640 1 --2- 172.21.15.138:0/3842178607 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0a5415aa60 0x7f0a540cc7e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0a480097f0 tx=0x7f0a4801c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9df145761e773a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:30.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.176+0000 7f0a53400640 1 -- 172.21.15.138:0/3842178607 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a480b0070 con 0x7f0a5415aa60 2024-04-26T20:57:30.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.176+0000 7f0a53400640 1 -- 172.21.15.138:0/3842178607 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a480ab600 con 0x7f0a5415aa60 2024-04-26T20:57:30.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.176+0000 7f0a53400640 1 -- 172.21.15.138:0/3842178607 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a480ab9d0 con 0x7f0a5415aa60 2024-04-26T20:57:30.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.180+0000 7f0a5b600640 1 -- 172.21.15.138:0/3842178607 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0a5415aa60 msgr2=0x7f0a540cc7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:30.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.180+0000 7f0a5b600640 1 --2- 172.21.15.138:0/3842178607 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0a5415aa60 0x7f0a540cc7e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0a480097f0 tx=0x7f0a4801c4e0 comp rx=0 tx=0).stop 2024-04-26T20:57:30.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.180+0000 7f0a5b600640 1 -- 172.21.15.138:0/3842178607 shutdown_connections 2024-04-26T20:57:30.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.180+0000 7f0a5b600640 1 --2- 172.21.15.138:0/3842178607 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0a5415aa60 0x7f0a540cc7e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:30.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.180+0000 7f0a5b600640 1 -- 172.21.15.138:0/3842178607 >> 172.21.15.138:0/3842178607 conn(0x7f0a540d0bb0 msgr2=0x7f0a540d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:30.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.180+0000 7f0a5b600640 1 -- 172.21.15.138:0/3842178607 shutdown_connections 2024-04-26T20:57:30.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.180+0000 7f0a5b600640 1 -- 172.21.15.138:0/3842178607 wait complete. 2024-04-26T20:57:30.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.180+0000 7f0a5b600640 1 Processor -- start 2024-04-26T20:57:30.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.180+0000 7f0a5b600640 1 -- start start 2024-04-26T20:57:30.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.180+0000 7f0a5b600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0a540cb910 0x7f0a54153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:30.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.180+0000 7f0a5b600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0a540ccd20 0x7f0a54159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:30.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.180+0000 7f0a5b600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0a5415aa60 0x7f0a54155760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:30.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.180+0000 7f0a5b600640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f0a5416b640 con 0x7f0a540cb910 2024-04-26T20:57:30.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.180+0000 7f0a5b600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f0a54072240 con 0x7f0a540ccd20 2024-04-26T20:57:30.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.180+0000 7f0a5b600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f0a5416b7c0 con 0x7f0a5415aa60 2024-04-26T20:57:30.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.180+0000 7f0a58c00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0a540cb910 0x7f0a54153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:30.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.180+0000 7f0a58c00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0a540cb910 0x7f0a54153520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40740/0 (socket says 172.21.15.138:40740) 2024-04-26T20:57:30.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.180+0000 7f0a58c00640 1 -- 172.21.15.138:0/442027471 learned_addr learned my addr 172.21.15.138:0/442027471 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:30.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.180+0000 7f0a58c00640 1 -- 172.21.15.138:0/442027471 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0a5415aa60 msgr2=0x7f0a54155760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:30.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.180+0000 7f0a59600640 1 --2- 172.21.15.138:0/442027471 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0a5415aa60 0x7f0a54155760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:30.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.180+0000 7f0a58c00640 1 --2- 172.21.15.138:0/442027471 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0a5415aa60 0x7f0a54155760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:30.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.180+0000 7f0a53e00640 1 --2- 172.21.15.138:0/442027471 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0a540ccd20 0x7f0a54159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:30.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.180+0000 7f0a58c00640 1 -- 172.21.15.138:0/442027471 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0a540ccd20 msgr2=0x7f0a54159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:30.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.180+0000 7f0a58c00640 1 --2- 172.21.15.138:0/442027471 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0a540ccd20 0x7f0a54159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:30.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.180+0000 7f0a58c00640 1 -- 172.21.15.138:0/442027471 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a54156ae0 con 0x7f0a540cb910 2024-04-26T20:57:30.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.180+0000 7f0a59600640 1 --2- 172.21.15.138:0/442027471 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0a5415aa60 0x7f0a54155760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:57:30.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.180+0000 7f0a53e00640 1 --2- 172.21.15.138:0/442027471 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0a540ccd20 0x7f0a54159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:57:30.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.184+0000 7f0a58c00640 1 --2- 172.21.15.138:0/442027471 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0a540cb910 0x7f0a54153520 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0a48009740 tx=0x7f0a4801ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:30.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.184+0000 7f0a50c00640 1 -- 172.21.15.138:0/442027471 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a480bb020 con 0x7f0a540cb910 2024-04-26T20:57:30.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.184+0000 7f0a50c00640 1 -- 172.21.15.138:0/442027471 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a480b1040 con 0x7f0a540cb910 2024-04-26T20:57:30.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.184+0000 7f0a50c00640 1 -- 172.21.15.138:0/442027471 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a480b0050 con 0x7f0a540cb910 2024-04-26T20:57:30.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.184+0000 7f0a5b600640 1 -- 172.21.15.138:0/442027471 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a54156dc0 con 0x7f0a540cb910 2024-04-26T20:57:30.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.184+0000 7f0a5b600640 1 -- 172.21.15.138:0/442027471 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a54154f60 con 0x7f0a540cb910 2024-04-26T20:57:30.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.184+0000 7f0a5b600640 1 -- 172.21.15.138:0/442027471 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a54069430 con 0x7f0a540cb910 2024-04-26T20:57:30.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.184+0000 7f0a50c00640 1 -- 172.21.15.138:0/442027471 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0a480be070 con 0x7f0a540cb910 2024-04-26T20:57:30.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.184+0000 7f0a50c00640 1 --2- 172.21.15.138:0/442027471 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0a340683b0 0x7f0a3406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:30.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.184+0000 7f0a50c00640 1 -- 172.21.15.138:0/442027471 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7f0a48120410 con 0x7f0a540cb910 2024-04-26T20:57:30.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.184+0000 7f0a53e00640 1 --2- 172.21.15.138:0/442027471 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0a340683b0 0x7f0a3406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:30.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.188+0000 7f0a53e00640 1 --2- 172.21.15.138:0/442027471 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0a340683b0 0x7f0a3406a870 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0a541f9aa0 tx=0x7f0a40009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:30.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.188+0000 7f0a50c00640 1 -- 172.21.15.138:0/442027471 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0a480160d0 con 0x7f0a540cb910 2024-04-26T20:57:30.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.344+0000 7f0a5b600640 1 -- 172.21.15.138:0/442027471 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f0a54161640 con 0x7f0a540cb910 2024-04-26T20:57:30.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.344+0000 7f0a50c00640 1 -- 172.21.15.138:0/442027471 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7f0a480f05a0 con 0x7f0a540cb910 2024-04-26T20:57:30.350 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 32 2024-04-26T20:57:30.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.348+0000 7f0a5b600640 1 -- 172.21.15.138:0/442027471 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0a340683b0 msgr2=0x7f0a3406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:30.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.348+0000 7f0a5b600640 1 --2- 172.21.15.138:0/442027471 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0a340683b0 0x7f0a3406a870 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0a541f9aa0 tx=0x7f0a40009040 comp rx=0 tx=0).stop 2024-04-26T20:57:30.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.348+0000 7f0a5b600640 1 -- 172.21.15.138:0/442027471 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0a540cb910 msgr2=0x7f0a54153520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:30.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.348+0000 7f0a5b600640 1 --2- 172.21.15.138:0/442027471 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0a540cb910 0x7f0a54153520 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0a48009740 tx=0x7f0a4801ad20 comp rx=0 tx=0).stop 2024-04-26T20:57:30.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.348+0000 7f0a5b600640 1 -- 172.21.15.138:0/442027471 shutdown_connections 2024-04-26T20:57:30.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.348+0000 7f0a5b600640 1 --2- 172.21.15.138:0/442027471 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0a340683b0 0x7f0a3406a870 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:30.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.348+0000 7f0a5b600640 1 --2- 172.21.15.138:0/442027471 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0a5415aa60 0x7f0a54155760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:30.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.348+0000 7f0a5b600640 1 --2- 172.21.15.138:0/442027471 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0a540ccd20 0x7f0a54159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:30.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.348+0000 7f0a5b600640 1 --2- 172.21.15.138:0/442027471 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0a540cb910 0x7f0a54153520 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:30.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.348+0000 7f0a5b600640 1 -- 172.21.15.138:0/442027471 >> 172.21.15.138:0/442027471 conn(0x7f0a540d0bb0 msgr2=0x7f0a540b06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:30.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.348+0000 7f0a5b600640 1 -- 172.21.15.138:0/442027471 shutdown_connections 2024-04-26T20:57:30.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.348+0000 7f0a5b600640 1 -- 172.21.15.138:0/442027471 wait complete. 2024-04-26T20:57:30.371 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T20:57:30.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.504+0000 7f9dd6e00640 1 Processor -- start 2024-04-26T20:57:30.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.504+0000 7f9dd6e00640 1 -- start start 2024-04-26T20:57:30.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.504+0000 7f9dd6e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9dd015bdc0 0x7f9dd015f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:30.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.504+0000 7f9dd6e00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9dd006f880 0x7f9dd00ce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:30.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.504+0000 7f9dd6e00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dd006dee0 con 0x7f9dd0073d70 2024-04-26T20:57:30.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.504+0000 7f9dd6e00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f9dd015c1a0 con 0x7f9dd006f880 2024-04-26T20:57:30.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.504+0000 7f9dd6e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f9dd006e180 con 0x7f9dd015bdc0 2024-04-26T20:57:30.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.508+0000 7f9dcf400640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f9dd0073d70 0x7f9dd015fe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.138:45046/0 (socket says 172.21.15.138:45046) 2024-04-26T20:57:30.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.508+0000 7f9dcf400640 1 -- 172.21.15.138:0/2564853264 learned_addr learned my addr 172.21.15.138:0/2564853264 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:30.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.508+0000 7f9dd4e00640 1 --2- 172.21.15.138:0/2564853264 >> v2:172.21.15.143:3300/0 conn(0x7f9dd006f880 0x7f9dd00ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:30.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.508+0000 7f9dcfe00640 1 --2- 172.21.15.138:0/2564853264 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9dd015bdc0 0x7f9dd015f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:30.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.508+0000 7f9dd4e00640 1 -- 172.21.15.138:0/2564853264 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9dd015bdc0 msgr2=0x7f9dd015f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:30.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.508+0000 7f9dd4e00640 1 --2- 172.21.15.138:0/2564853264 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9dd015bdc0 0x7f9dd015f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:30.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.508+0000 7f9dd4e00640 1 -- 172.21.15.138:0/2564853264 >> v1:172.21.15.143:6789/0 conn(0x7f9dd0073d70 legacy=0x7f9dd015fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:30.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.508+0000 7f9dd4e00640 1 -- 172.21.15.138:0/2564853264 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd006e460 con 0x7f9dd006f880 2024-04-26T20:57:30.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.512+0000 7f9dd4e00640 1 --2- 172.21.15.138:0/2564853264 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9dd006f880 0x7f9dd00ce780 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9dc8009d90 tx=0x7f9dc801c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfb9b287f20c052a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:30.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.512+0000 7f9dcea00640 1 -- 172.21.15.138:0/2564853264 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc80b2070 con 0x7f9dd006f880 2024-04-26T20:57:30.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.512+0000 7f9dcea00640 1 -- 172.21.15.138:0/2564853264 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dc80a5890 con 0x7f9dd006f880 2024-04-26T20:57:30.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.512+0000 7f9dcea00640 1 -- 172.21.15.138:0/2564853264 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc80a5c60 con 0x7f9dd006f880 2024-04-26T20:57:30.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.512+0000 7f9dd6e00640 1 -- 172.21.15.138:0/2564853264 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9dd006f880 msgr2=0x7f9dd00ce780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:30.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.512+0000 7f9dd6e00640 1 --2- 172.21.15.138:0/2564853264 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9dd006f880 0x7f9dd00ce780 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9dc8009d90 tx=0x7f9dc801c8e0 comp rx=0 tx=0).stop 2024-04-26T20:57:30.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.512+0000 7f9dd6e00640 1 -- 172.21.15.138:0/2564853264 shutdown_connections 2024-04-26T20:57:30.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.512+0000 7f9dd6e00640 1 --2- 172.21.15.138:0/2564853264 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9dd006f880 0x7f9dd00ce780 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:30.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.512+0000 7f9dd6e00640 1 --2- 172.21.15.138:0/2564853264 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9dd015bdc0 0x7f9dd015f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:30.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.512+0000 7f9dd6e00640 1 -- 172.21.15.138:0/2564853264 >> 172.21.15.138:0/2564853264 conn(0x7f9dd00d0bb0 msgr2=0x7f9dd00d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:30.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.512+0000 7f9dd6e00640 1 -- 172.21.15.138:0/2564853264 shutdown_connections 2024-04-26T20:57:30.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.512+0000 7f9dd6e00640 1 -- 172.21.15.138:0/2564853264 wait complete. 2024-04-26T20:57:30.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.512+0000 7f9dd6e00640 1 Processor -- start 2024-04-26T20:57:30.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.512+0000 7f9dd6e00640 1 -- start start 2024-04-26T20:57:30.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.512+0000 7f9dd6e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9dd006f880 0x7f9dd015fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:30.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.512+0000 7f9dd6e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9dd0073d70 0x7f9dd0144bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:30.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.512+0000 7f9dd6e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9dd015bdc0 0x7f9dd0157e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:30.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.512+0000 7f9dd6e00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd0168cd0 con 0x7f9dd015bdc0 2024-04-26T20:57:30.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.512+0000 7f9dd6e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd0160790 con 0x7f9dd006f880 2024-04-26T20:57:30.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.512+0000 7f9dd6e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f9dd0168e50 con 0x7f9dd0073d70 2024-04-26T20:57:30.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.512+0000 7f9dd4e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9dd015bdc0 0x7f9dd0157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:30.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.512+0000 7f9dd4e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9dd015bdc0 0x7f9dd0157e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40750/0 (socket says 172.21.15.138:40750) 2024-04-26T20:57:30.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.512+0000 7f9dd4e00640 1 -- 172.21.15.138:0/1371093934 learned_addr learned my addr 172.21.15.138:0/1371093934 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:30.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.516+0000 7f9dcfe00640 1 --2- 172.21.15.138:0/1371093934 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9dd006f880 0x7f9dd015fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:30.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.516+0000 7f9dcf400640 1 --2- 172.21.15.138:0/1371093934 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9dd0073d70 0x7f9dd0144bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:30.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.516+0000 7f9dd4e00640 1 -- 172.21.15.138:0/1371093934 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9dd0073d70 msgr2=0x7f9dd0144bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:30.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.516+0000 7f9dd4e00640 1 --2- 172.21.15.138:0/1371093934 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9dd0073d70 0x7f9dd0144bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:30.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.516+0000 7f9dd4e00640 1 -- 172.21.15.138:0/1371093934 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9dd006f880 msgr2=0x7f9dd015fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:30.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.516+0000 7f9dd4e00640 1 --2- 172.21.15.138:0/1371093934 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9dd006f880 0x7f9dd015fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:30.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.516+0000 7f9dd4e00640 1 -- 172.21.15.138:0/1371093934 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd0145670 con 0x7f9dd015bdc0 2024-04-26T20:57:30.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.516+0000 7f9dd4e00640 1 --2- 172.21.15.138:0/1371093934 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9dd015bdc0 0x7f9dd0157e20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9dc80b0040 tx=0x7f9dc8019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:30.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.516+0000 7f9dc7e00640 1 -- 172.21.15.138:0/1371093934 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc80b2050 con 0x7f9dd015bdc0 2024-04-26T20:57:30.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.516+0000 7f9dc7e00640 1 -- 172.21.15.138:0/1371093934 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dc80be070 con 0x7f9dd015bdc0 2024-04-26T20:57:30.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.516+0000 7f9dc7e00640 1 -- 172.21.15.138:0/1371093934 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc80ada70 con 0x7f9dd015bdc0 2024-04-26T20:57:30.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.516+0000 7f9dd6e00640 1 -- 172.21.15.138:0/1371093934 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dd0145950 con 0x7f9dd015bdc0 2024-04-26T20:57:30.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.516+0000 7f9dd6e00640 1 -- 172.21.15.138:0/1371093934 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dd0143090 con 0x7f9dd015bdc0 2024-04-26T20:57:30.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.516+0000 7f9dd6e00640 1 -- 172.21.15.138:0/1371093934 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dd0069430 con 0x7f9dd015bdc0 2024-04-26T20:57:30.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.516+0000 7f9dc7e00640 1 -- 172.21.15.138:0/1371093934 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9dc80a5710 con 0x7f9dd015bdc0 2024-04-26T20:57:30.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.520+0000 7f9dc7e00640 1 --2- 172.21.15.138:0/1371093934 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9db00683b0 0x7f9db006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:30.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.520+0000 7f9dc7e00640 1 -- 172.21.15.138:0/1371093934 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7f9dc8121c50 con 0x7f9dd015bdc0 2024-04-26T20:57:30.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.520+0000 7f9dcfe00640 1 --2- 172.21.15.138:0/1371093934 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9db00683b0 0x7f9db006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:30.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.520+0000 7f9dcfe00640 1 --2- 172.21.15.138:0/1371093934 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9db00683b0 0x7f9db006a870 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0009ac0 tx=0x7f9dc0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:30.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.524+0000 7f9dc7e00640 1 -- 172.21.15.138:0/1371093934 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9dc8127020 con 0x7f9dd015bdc0 2024-04-26T20:57:30.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.680+0000 7f9dd6e00640 1 -- 172.21.15.138:0/1371093934 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f9dd00d19c0 con 0x7f9dd015bdc0 2024-04-26T20:57:30.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.680+0000 7f9dc7e00640 1 -- 172.21.15.138:0/1371093934 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7f9dc8016560 con 0x7f9dd015bdc0 2024-04-26T20:57:30.684 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 64 2024-04-26T20:57:30.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.680+0000 7f9dd6e00640 1 -- 172.21.15.138:0/1371093934 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9db00683b0 msgr2=0x7f9db006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:30.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.680+0000 7f9dd6e00640 1 --2- 172.21.15.138:0/1371093934 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9db00683b0 0x7f9db006a870 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0009ac0 tx=0x7f9dc0009190 comp rx=0 tx=0).stop 2024-04-26T20:57:30.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.680+0000 7f9dd6e00640 1 -- 172.21.15.138:0/1371093934 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9dd015bdc0 msgr2=0x7f9dd0157e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:30.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.680+0000 7f9dd6e00640 1 --2- 172.21.15.138:0/1371093934 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9dd015bdc0 0x7f9dd0157e20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9dc80b0040 tx=0x7f9dc8019680 comp rx=0 tx=0).stop 2024-04-26T20:57:30.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.680+0000 7f9dd6e00640 1 -- 172.21.15.138:0/1371093934 shutdown_connections 2024-04-26T20:57:30.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.680+0000 7f9dd6e00640 1 --2- 172.21.15.138:0/1371093934 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9db00683b0 0x7f9db006a870 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:30.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.680+0000 7f9dd6e00640 1 --2- 172.21.15.138:0/1371093934 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9dd015bdc0 0x7f9dd0157e20 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:30.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.680+0000 7f9dd6e00640 1 --2- 172.21.15.138:0/1371093934 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9dd0073d70 0x7f9dd0144bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:30.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.680+0000 7f9dd6e00640 1 --2- 172.21.15.138:0/1371093934 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9dd006f880 0x7f9dd015fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:30.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.680+0000 7f9dd6e00640 1 -- 172.21.15.138:0/1371093934 >> 172.21.15.138:0/1371093934 conn(0x7f9dd00d0bb0 msgr2=0x7f9dd00d0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:30.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.680+0000 7f9dd6e00640 1 -- 172.21.15.138:0/1371093934 shutdown_connections 2024-04-26T20:57:30.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.680+0000 7f9dd6e00640 1 -- 172.21.15.138:0/1371093934 wait complete. 2024-04-26T20:57:30.705 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T20:57:30.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.836+0000 7fd4fa200640 1 Processor -- start 2024-04-26T20:57:30.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.836+0000 7fd4fa200640 1 -- start start 2024-04-26T20:57:30.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.836+0000 7fd4fa200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd4f415bdc0 0x7fd4f415f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:30.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.840+0000 7fd4fa200640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd4f406f880 0x7fd4f40ce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:30.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.840+0000 7fd4fa200640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4f406dee0 con 0x7fd4f4073d70 2024-04-26T20:57:30.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.840+0000 7fd4fa200640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fd4f415c1a0 con 0x7fd4f406f880 2024-04-26T20:57:30.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.840+0000 7fd4fa200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fd4f406e180 con 0x7fd4f415bdc0 2024-04-26T20:57:30.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.840+0000 7fd4f3e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd4f406f880 0x7fd4f40ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:30.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.840+0000 7fd4f3e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd4f406f880 0x7fd4f40ce780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40762/0 (socket says 172.21.15.138:40762) 2024-04-26T20:57:30.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.840+0000 7fd4f3e00640 1 -- 172.21.15.138:0/2016908579 learned_addr learned my addr 172.21.15.138:0/2016908579 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:30.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.840+0000 7fd4f3400640 1 --2- 172.21.15.138:0/2016908579 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd4f415bdc0 0x7fd4f415f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:30.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.840+0000 7fd4f3e00640 1 -- 172.21.15.138:0/2016908579 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd4f415bdc0 msgr2=0x7fd4f415f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:30.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.840+0000 7fd4f3e00640 1 --2- 172.21.15.138:0/2016908579 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd4f415bdc0 0x7fd4f415f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:30.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.840+0000 7fd4f3e00640 1 -- 172.21.15.138:0/2016908579 >> v1:172.21.15.143:6789/0 conn(0x7fd4f4073d70 legacy=0x7fd4f415fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:30.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.840+0000 7fd4f3e00640 1 -- 172.21.15.138:0/2016908579 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4f406e460 con 0x7fd4f406f880 2024-04-26T20:57:30.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.840+0000 7fd4f3e00640 1 --2- 172.21.15.138:0/2016908579 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd4f406f880 0x7fd4f40ce780 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec009870 tx=0x7fd4ec01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ca91c6a526d1556 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:30.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.840+0000 7fd4f2a00640 1 -- 172.21.15.138:0/2016908579 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec0b1070 con 0x7fd4f406f880 2024-04-26T20:57:30.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.840+0000 7fd4f2a00640 1 -- 172.21.15.138:0/2016908579 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4ec0ac620 con 0x7fd4f406f880 2024-04-26T20:57:30.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.840+0000 7fd4f2a00640 1 -- 172.21.15.138:0/2016908579 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec0ac9f0 con 0x7fd4f406f880 2024-04-26T20:57:30.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.844+0000 7fd4fa200640 1 -- 172.21.15.138:0/2016908579 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd4f406f880 msgr2=0x7fd4f40ce780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:30.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.844+0000 7fd4fa200640 1 --2- 172.21.15.138:0/2016908579 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd4f406f880 0x7fd4f40ce780 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec009870 tx=0x7fd4ec01c4d0 comp rx=0 tx=0).stop 2024-04-26T20:57:30.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.844+0000 7fd4fa200640 1 -- 172.21.15.138:0/2016908579 shutdown_connections 2024-04-26T20:57:30.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.844+0000 7fd4fa200640 1 --2- 172.21.15.138:0/2016908579 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd4f406f880 0x7fd4f40ce780 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:30.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.844+0000 7fd4fa200640 1 --2- 172.21.15.138:0/2016908579 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd4f415bdc0 0x7fd4f415f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:30.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.844+0000 7fd4fa200640 1 -- 172.21.15.138:0/2016908579 >> 172.21.15.138:0/2016908579 conn(0x7fd4f40d0bb0 msgr2=0x7fd4f40d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:30.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.844+0000 7fd4fa200640 1 -- 172.21.15.138:0/2016908579 shutdown_connections 2024-04-26T20:57:30.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.844+0000 7fd4fa200640 1 -- 172.21.15.138:0/2016908579 wait complete. 2024-04-26T20:57:30.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.844+0000 7fd4fa200640 1 Processor -- start 2024-04-26T20:57:30.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.844+0000 7fd4fa200640 1 -- start start 2024-04-26T20:57:30.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.844+0000 7fd4fa200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd4f406f880 0x7fd4f415faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:30.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.844+0000 7fd4fa200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd4f4073d70 0x7fd4f40c6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:30.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.844+0000 7fd4fa200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd4f415bdc0 0x7fd4f41443b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:30.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.844+0000 7fd4fa200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f4168cd0 con 0x7fd4f415bdc0 2024-04-26T20:57:30.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.844+0000 7fd4fa200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f4160790 con 0x7fd4f4073d70 2024-04-26T20:57:30.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.844+0000 7fd4fa200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fd4f4168e50 con 0x7fd4f406f880 2024-04-26T20:57:30.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.844+0000 7fd4f3e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd4f415bdc0 0x7fd4f41443b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:30.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.844+0000 7fd4f3e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd4f415bdc0 0x7fd4f41443b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40766/0 (socket says 172.21.15.138:40766) 2024-04-26T20:57:30.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.844+0000 7fd4f3e00640 1 -- 172.21.15.138:0/2399100888 learned_addr learned my addr 172.21.15.138:0/2399100888 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:30.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.844+0000 7fd4eaa00640 1 --2- 172.21.15.138:0/2399100888 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd4f4073d70 0x7fd4f40c6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:30.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.844+0000 7fd4f3400640 1 --2- 172.21.15.138:0/2399100888 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd4f406f880 0x7fd4f415faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:30.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.848+0000 7fd4f3e00640 1 -- 172.21.15.138:0/2399100888 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd4f406f880 msgr2=0x7fd4f415faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:30.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.848+0000 7fd4f3e00640 1 --2- 172.21.15.138:0/2399100888 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd4f406f880 0x7fd4f415faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:30.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.848+0000 7fd4f3e00640 1 -- 172.21.15.138:0/2399100888 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd4f4073d70 msgr2=0x7fd4f40c6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:30.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.848+0000 7fd4f3e00640 1 --2- 172.21.15.138:0/2399100888 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd4f4073d70 0x7fd4f40c6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:30.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.848+0000 7fd4f3e00640 1 -- 172.21.15.138:0/2399100888 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4f40c6ea0 con 0x7fd4f415bdc0 2024-04-26T20:57:30.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.848+0000 7fd4f3e00640 1 --2- 172.21.15.138:0/2399100888 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd4f415bdc0 0x7fd4f41443b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec0af040 tx=0x7fd4ec019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:30.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.848+0000 7fd4ebe00640 1 -- 172.21.15.138:0/2399100888 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec0b1040 con 0x7fd4f415bdc0 2024-04-26T20:57:30.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.848+0000 7fd4ebe00640 1 -- 172.21.15.138:0/2399100888 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4ec0ba070 con 0x7fd4f415bdc0 2024-04-26T20:57:30.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.848+0000 7fd4fa200640 1 -- 172.21.15.138:0/2399100888 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4f4160140 con 0x7fd4f415bdc0 2024-04-26T20:57:30.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.848+0000 7fd4ebe00640 1 -- 172.21.15.138:0/2399100888 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec0b5660 con 0x7fd4f415bdc0 2024-04-26T20:57:30.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.848+0000 7fd4fa200640 1 -- 172.21.15.138:0/2399100888 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4f4143bb0 con 0x7fd4f415bdc0 2024-04-26T20:57:30.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.848+0000 7fd4fa200640 1 -- 172.21.15.138:0/2399100888 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4f4069430 con 0x7fd4f415bdc0 2024-04-26T20:57:30.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.848+0000 7fd4ebe00640 1 -- 172.21.15.138:0/2399100888 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd4ec0b5800 con 0x7fd4f415bdc0 2024-04-26T20:57:30.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.848+0000 7fd4ebe00640 1 --2- 172.21.15.138:0/2399100888 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd4d0068380 0x7fd4d006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:30.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.852+0000 7fd4ebe00640 1 -- 172.21.15.138:0/2399100888 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7fd4ec120ba0 con 0x7fd4f415bdc0 2024-04-26T20:57:30.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.852+0000 7fd4f3400640 1 --2- 172.21.15.138:0/2399100888 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd4d0068380 0x7fd4d006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:30.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.852+0000 7fd4f3400640 1 --2- 172.21.15.138:0/2399100888 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd4d0068380 0x7fd4d006a840 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd4e4003fd0 tx=0x7fd4e40039c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:30.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:30.856+0000 7fd4ebe00640 1 -- 172.21.15.138:0/2399100888 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd4ec016150 con 0x7fd4f415bdc0 2024-04-26T20:57:31.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.012+0000 7fd4fa200640 1 -- 172.21.15.138:0/2399100888 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fd4f40d19c0 con 0x7fd4f415bdc0 2024-04-26T20:57:31.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.012+0000 7fd4ebe00640 1 -- 172.21.15.138:0/2399100888 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7fd4ec0f0dc0 con 0x7fd4f415bdc0 2024-04-26T20:57:31.018 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 32 2024-04-26T20:57:31.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.012+0000 7fd4fa200640 1 -- 172.21.15.138:0/2399100888 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd4d0068380 msgr2=0x7fd4d006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:31.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.012+0000 7fd4fa200640 1 --2- 172.21.15.138:0/2399100888 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd4d0068380 0x7fd4d006a840 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd4e4003fd0 tx=0x7fd4e40039c0 comp rx=0 tx=0).stop 2024-04-26T20:57:31.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.012+0000 7fd4fa200640 1 -- 172.21.15.138:0/2399100888 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd4f415bdc0 msgr2=0x7fd4f41443b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:31.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.012+0000 7fd4fa200640 1 --2- 172.21.15.138:0/2399100888 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd4f415bdc0 0x7fd4f41443b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec0af040 tx=0x7fd4ec019270 comp rx=0 tx=0).stop 2024-04-26T20:57:31.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.012+0000 7fd4fa200640 1 -- 172.21.15.138:0/2399100888 shutdown_connections 2024-04-26T20:57:31.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.012+0000 7fd4fa200640 1 --2- 172.21.15.138:0/2399100888 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd4d0068380 0x7fd4d006a840 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:31.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.012+0000 7fd4fa200640 1 --2- 172.21.15.138:0/2399100888 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd4f415bdc0 0x7fd4f41443b0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:31.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.012+0000 7fd4fa200640 1 --2- 172.21.15.138:0/2399100888 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd4f4073d70 0x7fd4f40c6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:31.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.012+0000 7fd4fa200640 1 --2- 172.21.15.138:0/2399100888 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd4f406f880 0x7fd4f415faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:31.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.012+0000 7fd4fa200640 1 -- 172.21.15.138:0/2399100888 >> 172.21.15.138:0/2399100888 conn(0x7fd4f40d0bb0 msgr2=0x7fd4f40b40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:31.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.016+0000 7fd4fa200640 1 -- 172.21.15.138:0/2399100888 shutdown_connections 2024-04-26T20:57:31.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.016+0000 7fd4fa200640 1 -- 172.21.15.138:0/2399100888 wait complete. 2024-04-26T20:57:31.038 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T20:57:31.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.168+0000 7f5d94e00640 1 Processor -- start 2024-04-26T20:57:31.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.168+0000 7f5d94e00640 1 -- start start 2024-04-26T20:57:31.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.168+0000 7f5d94e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f5d9015e0c0 0x7f5d90071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:31.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.168+0000 7f5d94e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5d900cca00 0x7f5d900cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:31.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.168+0000 7f5d94e00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d900cd360 con 0x7f5d9015ce20 2024-04-26T20:57:31.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.168+0000 7f5d94e00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f5d90073b70 con 0x7f5d9015e0c0 2024-04-26T20:57:31.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.168+0000 7f5d94e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f5d90073e10 con 0x7f5d900cca00 2024-04-26T20:57:31.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.168+0000 7f5d8d400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f5d9015e0c0 0x7f5d90071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:31.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.168+0000 7f5d8de00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f5d9015ce20 0x7f5d90161340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:58184/0 (socket says 172.21.15.138:58184) 2024-04-26T20:57:31.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.168+0000 7f5d8de00640 1 -- 172.21.15.138:0/3006195305 learned_addr learned my addr 172.21.15.138:0/3006195305 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:31.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.172+0000 7f5d8e800640 1 --2- 172.21.15.138:0/3006195305 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5d900cca00 0x7f5d900cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:31.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.172+0000 7f5d8d400640 1 -- 172.21.15.138:0/3006195305 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5d900cca00 msgr2=0x7f5d900cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:31.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.172+0000 7f5d8d400640 1 --2- 172.21.15.138:0/3006195305 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5d900cca00 0x7f5d900cce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:31.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.172+0000 7f5d8d400640 1 -- 172.21.15.138:0/3006195305 >> v1:172.21.15.138:6789/0 conn(0x7f5d9015ce20 legacy=0x7f5d90161340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:31.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.172+0000 7f5d8d400640 1 -- 172.21.15.138:0/3006195305 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d900740f0 con 0x7f5d9015e0c0 2024-04-26T20:57:31.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.172+0000 7f5d8d400640 1 --2- 172.21.15.138:0/3006195305 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d9015e0c0 0x7f5d90071ee0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c0097c0 tx=0x7f5d7c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dce8c1c4f6775f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:31.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.172+0000 7f5d8ca00640 1 -- 172.21.15.138:0/3006195305 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c0b2070 con 0x7f5d9015e0c0 2024-04-26T20:57:31.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.172+0000 7f5d8ca00640 1 -- 172.21.15.138:0/3006195305 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d7c0ad640 con 0x7f5d9015e0c0 2024-04-26T20:57:31.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.172+0000 7f5d8ca00640 1 -- 172.21.15.138:0/3006195305 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c0ada10 con 0x7f5d9015e0c0 2024-04-26T20:57:31.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.176+0000 7f5d94e00640 1 -- 172.21.15.138:0/3006195305 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d9015e0c0 msgr2=0x7f5d90071ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:31.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.176+0000 7f5d94e00640 1 --2- 172.21.15.138:0/3006195305 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d9015e0c0 0x7f5d90071ee0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c0097c0 tx=0x7f5d7c01c4a0 comp rx=0 tx=0).stop 2024-04-26T20:57:31.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.176+0000 7f5d94e00640 1 -- 172.21.15.138:0/3006195305 shutdown_connections 2024-04-26T20:57:31.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.176+0000 7f5d94e00640 1 --2- 172.21.15.138:0/3006195305 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5d900cca00 0x7f5d900cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:31.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.176+0000 7f5d94e00640 1 --2- 172.21.15.138:0/3006195305 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d9015e0c0 0x7f5d90071ee0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:31.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.176+0000 7f5d94e00640 1 -- 172.21.15.138:0/3006195305 >> 172.21.15.138:0/3006195305 conn(0x7f5d900d0b20 msgr2=0x7f5d900d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:31.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.176+0000 7f5d94e00640 1 -- 172.21.15.138:0/3006195305 shutdown_connections 2024-04-26T20:57:31.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.176+0000 7f5d94e00640 1 -- 172.21.15.138:0/3006195305 wait complete. 2024-04-26T20:57:31.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.176+0000 7f5d94e00640 1 Processor -- start 2024-04-26T20:57:31.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.176+0000 7f5d94e00640 1 -- start start 2024-04-26T20:57:31.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.176+0000 7f5d94e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5d900cca00 0x7f5d901fb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:31.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.176+0000 7f5d94e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5d9015ce20 0x7f5d900b6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:31.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.176+0000 7f5d94e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d9014dfa0 0x7f5d900b7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:31.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.176+0000 7f5d94e00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f5d9015d380 con 0x7f5d9014dfa0 2024-04-26T20:57:31.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.176+0000 7f5d94e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f5d9015d200 con 0x7f5d900cca00 2024-04-26T20:57:31.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.176+0000 7f5d94e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f5d9006e680 con 0x7f5d9015ce20 2024-04-26T20:57:31.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.176+0000 7f5d8e800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d9014dfa0 0x7f5d900b7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:31.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.176+0000 7f5d8e800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d9014dfa0 0x7f5d900b7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40774/0 (socket says 172.21.15.138:40774) 2024-04-26T20:57:31.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.176+0000 7f5d8e800640 1 -- 172.21.15.138:0/3707596014 learned_addr learned my addr 172.21.15.138:0/3707596014 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:31.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.176+0000 7f5d8de00640 1 --2- 172.21.15.138:0/3707596014 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5d900cca00 0x7f5d901fb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:31.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.176+0000 7f5d8d400640 1 --2- 172.21.15.138:0/3707596014 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5d9015ce20 0x7f5d900b6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:31.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.176+0000 7f5d8e800640 1 -- 172.21.15.138:0/3707596014 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5d9015ce20 msgr2=0x7f5d900b6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:31.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.176+0000 7f5d8e800640 1 --2- 172.21.15.138:0/3707596014 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5d9015ce20 0x7f5d900b6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:31.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.176+0000 7f5d8e800640 1 -- 172.21.15.138:0/3707596014 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5d900cca00 msgr2=0x7f5d901fb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:31.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.176+0000 7f5d8e800640 1 --2- 172.21.15.138:0/3707596014 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5d900cca00 0x7f5d901fb8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:31.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.176+0000 7f5d8e800640 1 -- 172.21.15.138:0/3707596014 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d90073060 con 0x7f5d9014dfa0 2024-04-26T20:57:31.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.180+0000 7f5d8e800640 1 --2- 172.21.15.138:0/3707596014 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d9014dfa0 0x7f5d900b7190 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5d8800d5c0 tx=0x7f5d8800da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:31.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.180+0000 7f5d86000640 1 -- 172.21.15.138:0/3707596014 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d880125f0 con 0x7f5d9014dfa0 2024-04-26T20:57:31.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.180+0000 7f5d86000640 1 -- 172.21.15.138:0/3707596014 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d88019070 con 0x7f5d9014dfa0 2024-04-26T20:57:31.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.180+0000 7f5d86000640 1 -- 172.21.15.138:0/3707596014 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d880129f0 con 0x7f5d9014dfa0 2024-04-26T20:57:31.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.180+0000 7f5d94e00640 1 -- 172.21.15.138:0/3707596014 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d900afe40 con 0x7f5d9014dfa0 2024-04-26T20:57:31.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.180+0000 7f5d94e00640 1 -- 172.21.15.138:0/3707596014 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d9015e5f0 con 0x7f5d9014dfa0 2024-04-26T20:57:31.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.180+0000 7f5d94e00640 1 -- 172.21.15.138:0/3707596014 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d90069510 con 0x7f5d9014dfa0 2024-04-26T20:57:31.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.180+0000 7f5d86000640 1 -- 172.21.15.138:0/3707596014 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5d88012b90 con 0x7f5d9014dfa0 2024-04-26T20:57:31.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.180+0000 7f5d86000640 1 --2- 172.21.15.138:0/3707596014 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5d700683b0 0x7f5d7006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:31.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.180+0000 7f5d86000640 1 -- 172.21.15.138:0/3707596014 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7f5d88086f50 con 0x7f5d9014dfa0 2024-04-26T20:57:31.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.184+0000 7f5d8de00640 1 --2- 172.21.15.138:0/3707596014 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5d700683b0 0x7f5d7006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:31.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.184+0000 7f5d8de00640 1 --2- 172.21.15.138:0/3707596014 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5d700683b0 0x7f5d7006a870 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5d800012f0 tx=0x7f5d80001a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:31.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.184+0000 7f5d86000640 1 -- 172.21.15.138:0/3707596014 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5d88056b20 con 0x7f5d9014dfa0 2024-04-26T20:57:31.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.356+0000 7f5d94e00640 1 -- 172.21.15.138:0/3707596014 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5d900b0ca0 con 0x7f5d9014dfa0 2024-04-26T20:57:31.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.356+0000 7f5d86000640 1 -- 172.21.15.138:0/3707596014 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7f5d8805ae20 con 0x7f5d9014dfa0 2024-04-26T20:57:31.362 INFO:teuthology.orchestra.run.smithi138.stderr:listed 0 entries 2024-04-26T20:57:31.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.356+0000 7f5d94e00640 1 -- 172.21.15.138:0/3707596014 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5d700683b0 msgr2=0x7f5d7006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:31.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.356+0000 7f5d94e00640 1 --2- 172.21.15.138:0/3707596014 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5d700683b0 0x7f5d7006a870 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5d800012f0 tx=0x7f5d80001a40 comp rx=0 tx=0).stop 2024-04-26T20:57:31.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.356+0000 7f5d94e00640 1 -- 172.21.15.138:0/3707596014 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d9014dfa0 msgr2=0x7f5d900b7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:31.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.356+0000 7f5d94e00640 1 --2- 172.21.15.138:0/3707596014 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d9014dfa0 0x7f5d900b7190 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5d8800d5c0 tx=0x7f5d8800da80 comp rx=0 tx=0).stop 2024-04-26T20:57:31.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.360+0000 7f5d94e00640 1 -- 172.21.15.138:0/3707596014 shutdown_connections 2024-04-26T20:57:31.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.360+0000 7f5d94e00640 1 --2- 172.21.15.138:0/3707596014 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5d700683b0 0x7f5d7006a870 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:31.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.360+0000 7f5d94e00640 1 --2- 172.21.15.138:0/3707596014 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d9014dfa0 0x7f5d900b7190 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:31.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.360+0000 7f5d94e00640 1 --2- 172.21.15.138:0/3707596014 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5d9015ce20 0x7f5d900b6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:31.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.360+0000 7f5d94e00640 1 --2- 172.21.15.138:0/3707596014 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5d900cca00 0x7f5d901fb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:31.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.360+0000 7f5d94e00640 1 -- 172.21.15.138:0/3707596014 >> 172.21.15.138:0/3707596014 conn(0x7f5d900d0b20 msgr2=0x7f5d9015d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:31.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.360+0000 7f5d94e00640 1 -- 172.21.15.138:0/3707596014 shutdown_connections 2024-04-26T20:57:31.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.360+0000 7f5d94e00640 1 -- 172.21.15.138:0/3707596014 wait complete. 2024-04-26T20:57:31.383 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-04-26T20:57:31.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:57:31.383 DEBUG:teuthology.orchestra.run.smithi143:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-04-26T20:57:31.423 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi143.front.sepia.ceph.com 2024-04-26T20:57:31.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:57:31.424 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-26T20:57:31.486 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-26T20:57:31.486 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T20:57:31.495 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-26T20:57:31.495 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T20:57:31.547 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-26T20:57:31.547 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T20:57:31.603 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:57:31.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.772+0000 7f6fe2200640 1 Processor -- start 2024-04-26T20:57:31.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.772+0000 7f6fe2200640 1 -- start start 2024-04-26T20:57:31.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.772+0000 7f6fe2200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6fdc15cf80 0x7f6fdc073b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:31.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.772+0000 7f6fe2200640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6fdc0cc1e0 0x7f6fdc0ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:31.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.772+0000 7f6fe2200640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fdc0727f0 con 0x7f6fdc0cbe00 2024-04-26T20:57:31.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.772+0000 7f6fe2200640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f6fdc073680 con 0x7f6fdc0cc1e0 2024-04-26T20:57:31.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.772+0000 7f6fe2200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f6fdc072a70 con 0x7f6fdc15cf80 2024-04-26T20:57:31.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.776+0000 7f6fdbe00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6fdc0cc1e0 0x7f6fdc0ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:31.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.776+0000 7f6fd2a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6fdc15cf80 0x7f6fdc073b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:31.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.776+0000 7f6fdb400640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f6fdc0cbe00 0x7f6fdc06de70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.138:45060/0 (socket says 172.21.15.138:45060) 2024-04-26T20:57:31.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.776+0000 7f6fdb400640 1 -- 172.21.15.138:0/872846152 learned_addr learned my addr 172.21.15.138:0/872846152 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:31.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.776+0000 7f6fd2a00640 1 -- 172.21.15.138:0/872846152 >> v2:172.21.15.143:3300/0 conn(0x7f6fdc0cc1e0 msgr2=0x7f6fdc0ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:31.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.776+0000 7f6fd2a00640 1 --2- 172.21.15.138:0/872846152 >> v2:172.21.15.143:3300/0 conn(0x7f6fdc0cc1e0 0x7f6fdc0ce6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:31.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.776+0000 7f6fd2a00640 1 -- 172.21.15.138:0/872846152 >> v1:172.21.15.143:6789/0 conn(0x7f6fdc0cbe00 legacy=0x7f6fdc06de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:31.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.776+0000 7f6fd2a00640 1 -- 172.21.15.138:0/872846152 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fdc072d50 con 0x7f6fdc15cf80 2024-04-26T20:57:31.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.776+0000 7f6fd2a00640 1 --2- 172.21.15.138:0/872846152 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6fdc15cf80 0x7f6fdc073b10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6fc40097c0 tx=0x7f6fc401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f68e0dd476278bf7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:31.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.776+0000 7f6fdaa00640 1 -- 172.21.15.138:0/872846152 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc40b0070 con 0x7f6fdc15cf80 2024-04-26T20:57:31.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.776+0000 7f6fdaa00640 1 -- 172.21.15.138:0/872846152 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fc40ab600 con 0x7f6fdc15cf80 2024-04-26T20:57:31.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.776+0000 7f6fdaa00640 1 -- 172.21.15.138:0/872846152 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc40ab9d0 con 0x7f6fdc15cf80 2024-04-26T20:57:31.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.780+0000 7f6fe2200640 1 -- 172.21.15.138:0/872846152 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6fdc15cf80 msgr2=0x7f6fdc073b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:31.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.780+0000 7f6fe2200640 1 --2- 172.21.15.138:0/872846152 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6fdc15cf80 0x7f6fdc073b10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6fc40097c0 tx=0x7f6fc401c4a0 comp rx=0 tx=0).stop 2024-04-26T20:57:31.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.780+0000 7f6fe2200640 1 -- 172.21.15.138:0/872846152 shutdown_connections 2024-04-26T20:57:31.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.780+0000 7f6fe2200640 1 --2- 172.21.15.138:0/872846152 >> v2:172.21.15.143:3300/0 conn(0x7f6fdc0cc1e0 0x7f6fdc0ce6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:31.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.780+0000 7f6fe2200640 1 --2- 172.21.15.138:0/872846152 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6fdc15cf80 0x7f6fdc073b10 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:31.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.780+0000 7f6fe2200640 1 -- 172.21.15.138:0/872846152 >> 172.21.15.138:0/872846152 conn(0x7f6fdc0d0b20 msgr2=0x7f6fdc0d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:31.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.780+0000 7f6fe2200640 1 -- 172.21.15.138:0/872846152 shutdown_connections 2024-04-26T20:57:31.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.780+0000 7f6fe2200640 1 -- 172.21.15.138:0/872846152 wait complete. 2024-04-26T20:57:31.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.780+0000 7f6fe2200640 1 Processor -- start 2024-04-26T20:57:31.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.780+0000 7f6fe2200640 1 -- start start 2024-04-26T20:57:31.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.780+0000 7f6fe2200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6fdc0cbe00 0x7f6fdc14d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:31.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.780+0000 7f6fe2200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6fdc0cc1e0 0x7f6fdc1549a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:31.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.780+0000 7f6fe2200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6fdc15cf80 0x7f6fdc154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:31.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.780+0000 7f6fe2200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f6fdc0741d0 con 0x7f6fdc15cf80 2024-04-26T20:57:31.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.780+0000 7f6fe2200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f6fdc074050 con 0x7f6fdc0cc1e0 2024-04-26T20:57:31.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.780+0000 7f6fe2200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f6fdc0d0780 con 0x7f6fdc0cbe00 2024-04-26T20:57:31.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.780+0000 7f6fdbe00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6fdc15cf80 0x7f6fdc154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:31.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.780+0000 7f6fdbe00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6fdc15cf80 0x7f6fdc154ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40788/0 (socket says 172.21.15.138:40788) 2024-04-26T20:57:31.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.780+0000 7f6fdbe00640 1 -- 172.21.15.138:0/1330189370 learned_addr learned my addr 172.21.15.138:0/1330189370 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:31.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.780+0000 7f6fd2a00640 1 --2- 172.21.15.138:0/1330189370 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6fdc0cc1e0 0x7f6fdc1549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:31.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.780+0000 7f6fdb400640 1 --2- 172.21.15.138:0/1330189370 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6fdc0cbe00 0x7f6fdc14d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:31.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.780+0000 7f6fdbe00640 1 -- 172.21.15.138:0/1330189370 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6fdc0cbe00 msgr2=0x7f6fdc14d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:31.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.780+0000 7f6fdbe00640 1 --2- 172.21.15.138:0/1330189370 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6fdc0cbe00 0x7f6fdc14d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:31.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.784+0000 7f6fdbe00640 1 -- 172.21.15.138:0/1330189370 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6fdc0cc1e0 msgr2=0x7f6fdc1549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:31.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.784+0000 7f6fdbe00640 1 --2- 172.21.15.138:0/1330189370 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6fdc0cc1e0 0x7f6fdc1549a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:31.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.784+0000 7f6fdbe00640 1 -- 172.21.15.138:0/1330189370 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fdc14e590 con 0x7f6fdc15cf80 2024-04-26T20:57:31.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.784+0000 7f6fd2a00640 1 --2- 172.21.15.138:0/1330189370 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6fdc0cc1e0 0x7f6fdc1549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:31.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.784+0000 7f6fdbe00640 1 --2- 172.21.15.138:0/1330189370 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6fdc15cf80 0x7f6fdc154ee0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6fd4009dd0 tx=0x7f6fd400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:31.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.784+0000 7f6fd3e00640 1 -- 172.21.15.138:0/1330189370 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fd4018020 con 0x7f6fdc15cf80 2024-04-26T20:57:31.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.784+0000 7f6fd3e00640 1 -- 172.21.15.138:0/1330189370 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fd4014480 con 0x7f6fdc15cf80 2024-04-26T20:57:31.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.784+0000 7f6fe2200640 1 -- 172.21.15.138:0/1330189370 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fdc14e870 con 0x7f6fdc15cf80 2024-04-26T20:57:31.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.784+0000 7f6fd3e00640 1 -- 172.21.15.138:0/1330189370 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fd4014870 con 0x7f6fdc15cf80 2024-04-26T20:57:31.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.784+0000 7f6fe2200640 1 -- 172.21.15.138:0/1330189370 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fdc14ee30 con 0x7f6fdc15cf80 2024-04-26T20:57:31.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.784+0000 7f6fe2200640 1 -- 172.21.15.138:0/1330189370 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fdc069510 con 0x7f6fdc15cf80 2024-04-26T20:57:31.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.784+0000 7f6fd3e00640 1 -- 172.21.15.138:0/1330189370 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6fd401b020 con 0x7f6fdc15cf80 2024-04-26T20:57:31.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.784+0000 7f6fd3e00640 1 --2- 172.21.15.138:0/1330189370 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6fb8068380 0x7f6fb806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:31.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.784+0000 7f6fd3e00640 1 -- 172.21.15.138:0/1330189370 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7f6fd4087960 con 0x7f6fdc15cf80 2024-04-26T20:57:31.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.784+0000 7f6fdb400640 1 --2- 172.21.15.138:0/1330189370 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6fb8068380 0x7f6fb806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:31.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.788+0000 7f6fdb400640 1 --2- 172.21.15.138:0/1330189370 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6fb8068380 0x7f6fb806a840 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc000f70 tx=0x7f6fcc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:31.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.788+0000 7f6fd3e00640 1 -- 172.21.15.138:0/1330189370 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6fd4022030 con 0x7f6fdc15cf80 2024-04-26T20:57:31.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.948+0000 7f6fe2200640 1 -- 172.21.15.138:0/1330189370 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6fdc0c7480 con 0x7f6fdc15cf80 2024-04-26T20:57:31.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.948+0000 7f6fd3e00640 1 -- 172.21.15.138:0/1330189370 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18719 (secure 0 0 0) 0x7f6fd4010040 con 0x7f6fdc15cf80 2024-04-26T20:57:31.953 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:57:31.953 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":29,"fsid":"c22b4730-12cc-4558-8535-b965384398c0","created":"2024-04-26T20:56:14.182475+0000","modified":"2024-04-26T20:57:20.395184+0000","last_up_change":"2024-04-26T20:56:26.013243+0000","last_in_change":"2024-04-26T20:56:16.714055+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:56:27.265834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:56:37.394398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:56:38.544369+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:56:42.240243+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3f9a2e34-3199-466f-a6cf-57927318121e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6801","nonce":3534772245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6803","nonce":3534772245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6807","nonce":3534772245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6805","nonce":3534772245}]},"public_addr":"172.21.15.138:6801/3534772245","cluster_addr":"172.21.15.138:6803/3534772245","heartbeat_back_addr":"172.21.15.138:6807/3534772245","heartbeat_front_addr":"172.21.15.138:6805/3534772245","state":["exists","up"]},{"osd":1,"uuid":"e881fcf6-3248-4696-a2ef-95d206d77712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6817","nonce":1427635773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6819","nonce":1427635773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6823","nonce":1427635773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6821","nonce":1427635773}]},"public_addr":"172.21.15.138:6817/1427635773","cluster_addr":"172.21.15.138:6819/1427635773","heartbeat_back_addr":"172.21.15.138:6823/1427635773","heartbeat_front_addr":"172.21.15.138:6821/1427635773","state":["exists","up"]},{"osd":2,"uuid":"f7d1db33-7672-4699-ae47-9f1e0a8e4222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6809","nonce":4273721573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6811","nonce":4273721573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6815","nonce":4273721573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6813","nonce":4273721573}]},"public_addr":"172.21.15.138:6809/4273721573","cluster_addr":"172.21.15.138:6811/4273721573","heartbeat_back_addr":"172.21.15.138:6815/4273721573","heartbeat_front_addr":"172.21.15.138:6813/4273721573","state":["exists","up"]},{"osd":3,"uuid":"2f4e0a9a-b8f6-4468-844a-a4501cd85054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6825","nonce":3098242154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6827","nonce":3098242154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6831","nonce":3098242154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6829","nonce":3098242154}]},"public_addr":"172.21.15.138:6825/3098242154","cluster_addr":"172.21.15.138:6827/3098242154","heartbeat_back_addr":"172.21.15.138:6831/3098242154","heartbeat_front_addr":"172.21.15.138:6829/3098242154","state":["exists","up"]},{"osd":4,"uuid":"c85df99b-3624-410e-866b-86830af2cfe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6801","nonce":2942056312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6803","nonce":2942056312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6807","nonce":2942056312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6805","nonce":2942056312}]},"public_addr":"172.21.15.143:6801/2942056312","cluster_addr":"172.21.15.143:6803/2942056312","heartbeat_back_addr":"172.21.15.143:6807/2942056312","heartbeat_front_addr":"172.21.15.143:6805/2942056312","state":["exists","up"]},{"osd":5,"uuid":"9af1efb5-c416-4808-b5ef-de0679ab9705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6809","nonce":1910222887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6811","nonce":1910222887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6815","nonce":1910222887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6813","nonce":1910222887}]},"public_addr":"172.21.15.143:6809/1910222887","cluster_addr":"172.21.15.143:6811/1910222887","heartbeat_back_addr":"172.21.15.143:6815/1910222887","heartbeat_front_addr":"172.21.15.143:6813/1910222887","state":["exists","up"]},{"osd":6,"uuid":"d7138615-8838-45ff-9072-2fd0683362f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6817","nonce":1082239825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6819","nonce":1082239825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6823","nonce":1082239825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6821","nonce":1082239825}]},"public_addr":"172.21.15.143:6817/1082239825","cluster_addr":"172.21.15.143:6819/1082239825","heartbeat_back_addr":"172.21.15.143:6823/1082239825","heartbeat_front_addr":"172.21.15.143:6821/1082239825","state":["exists","up"]},{"osd":7,"uuid":"0c27172b-35c4-49ec-ba0b-0137b8ff0010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6825","nonce":3295508495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6827","nonce":3295508495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6831","nonce":3295508495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6829","nonce":3295508495}]},"public_addr":"172.21.15.143:6825/3295508495","cluster_addr":"172.21.15.143:6827/3295508495","heartbeat_back_addr":"172.21.15.143:6831/3295508495","heartbeat_front_addr":"172.21.15.143:6829/3295508495","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.326627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.396119+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.433915+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.414179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.216947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.329272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.503073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.436382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.39","mappings":[{"from":0,"to":7}]},{"pgid":"4.6","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:57:31.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.948+0000 7f6fe2200640 1 -- 172.21.15.138:0/1330189370 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6fb8068380 msgr2=0x7f6fb806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:31.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.948+0000 7f6fe2200640 1 --2- 172.21.15.138:0/1330189370 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6fb8068380 0x7f6fb806a840 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc000f70 tx=0x7f6fcc009040 comp rx=0 tx=0).stop 2024-04-26T20:57:31.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.948+0000 7f6fe2200640 1 -- 172.21.15.138:0/1330189370 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6fdc15cf80 msgr2=0x7f6fdc154ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:31.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.948+0000 7f6fe2200640 1 --2- 172.21.15.138:0/1330189370 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6fdc15cf80 0x7f6fdc154ee0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6fd4009dd0 tx=0x7f6fd400c490 comp rx=0 tx=0).stop 2024-04-26T20:57:31.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.948+0000 7f6fe2200640 1 -- 172.21.15.138:0/1330189370 shutdown_connections 2024-04-26T20:57:31.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.948+0000 7f6fe2200640 1 --2- 172.21.15.138:0/1330189370 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6fb8068380 0x7f6fb806a840 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:31.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.948+0000 7f6fe2200640 1 --2- 172.21.15.138:0/1330189370 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6fdc15cf80 0x7f6fdc154ee0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:31.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.948+0000 7f6fe2200640 1 --2- 172.21.15.138:0/1330189370 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6fdc0cc1e0 0x7f6fdc1549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:31.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.948+0000 7f6fe2200640 1 --2- 172.21.15.138:0/1330189370 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6fdc0cbe00 0x7f6fdc14d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:31.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.948+0000 7f6fe2200640 1 -- 172.21.15.138:0/1330189370 >> 172.21.15.138:0/1330189370 conn(0x7f6fdc0d0b20 msgr2=0x7f6fdc0b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:31.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.948+0000 7f6fe2200640 1 -- 172.21.15.138:0/1330189370 shutdown_connections 2024-04-26T20:57:31.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:31.948+0000 7f6fe2200640 1 -- 172.21.15.138:0/1330189370 wait complete. 2024-04-26T20:57:31.977 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:56:27.265834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T20:56:37.394398+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T20:56:38.544369+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T20:56:42.240243+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T20:57:31.978 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T20:57:32.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.112+0000 7fc634200640 1 Processor -- start 2024-04-26T20:57:32.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.112+0000 7fc634200640 1 -- start start 2024-04-26T20:57:32.117 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.112+0000 7fc634200640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc62c15f2f0 0x7fc62c06dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:32.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.112+0000 7fc634200640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc62c06e120 0x7fc62c0d1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:32.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.112+0000 7fc634200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc62c0d2130 0x7fc62c0cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:32.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.112+0000 7fc634200640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fc62c06eb60 con 0x7fc62c06e120 2024-04-26T20:57:32.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.112+0000 7fc634200640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fc62c06e560 con 0x7fc62c15f2f0 2024-04-26T20:57:32.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.112+0000 7fc634200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fc62c0cd380 con 0x7fc62c0d2130 2024-04-26T20:57:32.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.112+0000 7fc630e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc62c06e120 0x7fc62c0d1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:32.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.112+0000 7fc630e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc62c06e120 0x7fc62c0d1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40792/0 (socket says 172.21.15.138:40792) 2024-04-26T20:57:32.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.112+0000 7fc630e00640 1 -- 172.21.15.138:0/3661585662 learned_addr learned my addr 172.21.15.138:0/3661585662 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:32.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.112+0000 7fc632200640 1 --2- 172.21.15.138:0/3661585662 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc62c0d2130 0x7fc62c0cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:32.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.112+0000 7fc631800640 1 --2- 172.21.15.138:0/3661585662 >> v2:172.21.15.143:3300/0 conn(0x7fc62c15f2f0 0x7fc62c06dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:32.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.112+0000 7fc630e00640 1 -- 172.21.15.138:0/3661585662 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc62c0d2130 msgr2=0x7fc62c0cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:32.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.112+0000 7fc630e00640 1 --2- 172.21.15.138:0/3661585662 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc62c0d2130 0x7fc62c0cf5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:32.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.112+0000 7fc630e00640 1 -- 172.21.15.138:0/3661585662 >> v2:172.21.15.143:3300/0 conn(0x7fc62c15f2f0 msgr2=0x7fc62c06dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:32.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.112+0000 7fc630e00640 1 --2- 172.21.15.138:0/3661585662 >> v2:172.21.15.143:3300/0 conn(0x7fc62c15f2f0 0x7fc62c06dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:32.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.112+0000 7fc630e00640 1 -- 172.21.15.138:0/3661585662 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc62c0d28e0 con 0x7fc62c06e120 2024-04-26T20:57:32.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.116+0000 7fc630e00640 1 --2- 172.21.15.138:0/3661585662 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc62c06e120 0x7fc62c0d1bf0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc62c0732d0 tx=0x7fc61801c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3650756adf5a7a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:32.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.116+0000 7fc62be00640 1 -- 172.21.15.138:0/3661585662 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6180b0070 con 0x7fc62c06e120 2024-04-26T20:57:32.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.116+0000 7fc62be00640 1 -- 172.21.15.138:0/3661585662 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6180ab600 con 0x7fc62c06e120 2024-04-26T20:57:32.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.116+0000 7fc62be00640 1 -- 172.21.15.138:0/3661585662 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6180ab9d0 con 0x7fc62c06e120 2024-04-26T20:57:32.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.116+0000 7fc634200640 1 -- 172.21.15.138:0/3661585662 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc62c06e120 msgr2=0x7fc62c0d1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:32.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.116+0000 7fc634200640 1 --2- 172.21.15.138:0/3661585662 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc62c06e120 0x7fc62c0d1bf0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc62c0732d0 tx=0x7fc61801c230 comp rx=0 tx=0).stop 2024-04-26T20:57:32.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.116+0000 7fc634200640 1 -- 172.21.15.138:0/3661585662 shutdown_connections 2024-04-26T20:57:32.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.116+0000 7fc634200640 1 --2- 172.21.15.138:0/3661585662 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc62c0d2130 0x7fc62c0cf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:32.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.116+0000 7fc634200640 1 --2- 172.21.15.138:0/3661585662 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc62c06e120 0x7fc62c0d1bf0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:32.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.116+0000 7fc634200640 1 --2- 172.21.15.138:0/3661585662 >> v2:172.21.15.143:3300/0 conn(0x7fc62c15f2f0 0x7fc62c06dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:32.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.116+0000 7fc634200640 1 -- 172.21.15.138:0/3661585662 >> 172.21.15.138:0/3661585662 conn(0x7fc62c0d2d30 msgr2=0x7fc62c0d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:32.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.116+0000 7fc634200640 1 -- 172.21.15.138:0/3661585662 shutdown_connections 2024-04-26T20:57:32.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.116+0000 7fc634200640 1 -- 172.21.15.138:0/3661585662 wait complete. 2024-04-26T20:57:32.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.116+0000 7fc634200640 1 Processor -- start 2024-04-26T20:57:32.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.116+0000 7fc634200640 1 -- start start 2024-04-26T20:57:32.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.120+0000 7fc634200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc62c06e120 0x7fc62c1553e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:32.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.120+0000 7fc634200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc62c0d2130 0x7fc62c15c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:32.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.120+0000 7fc634200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc62c15f2f0 0x7fc62c0ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:32.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.120+0000 7fc634200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc62c0d2540 con 0x7fc62c15f2f0 2024-04-26T20:57:32.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.120+0000 7fc634200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fc62c0b5b80 con 0x7fc62c06e120 2024-04-26T20:57:32.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.120+0000 7fc634200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fc62c0d26c0 con 0x7fc62c0d2130 2024-04-26T20:57:32.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.120+0000 7fc632200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc62c15f2f0 0x7fc62c0ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:32.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.120+0000 7fc632200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc62c15f2f0 0x7fc62c0ce4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40796/0 (socket says 172.21.15.138:40796) 2024-04-26T20:57:32.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.120+0000 7fc632200640 1 -- 172.21.15.138:0/1317283796 learned_addr learned my addr 172.21.15.138:0/1317283796 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:32.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.120+0000 7fc630e00640 1 --2- 172.21.15.138:0/1317283796 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc62c0d2130 0x7fc62c15c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:32.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.120+0000 7fc631800640 1 --2- 172.21.15.138:0/1317283796 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc62c06e120 0x7fc62c1553e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:32.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.120+0000 7fc632200640 1 -- 172.21.15.138:0/1317283796 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc62c0d2130 msgr2=0x7fc62c15c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:32.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.120+0000 7fc632200640 1 --2- 172.21.15.138:0/1317283796 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc62c0d2130 0x7fc62c15c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:32.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.120+0000 7fc632200640 1 -- 172.21.15.138:0/1317283796 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc62c06e120 msgr2=0x7fc62c1553e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:32.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.120+0000 7fc632200640 1 --2- 172.21.15.138:0/1317283796 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc62c06e120 0x7fc62c1553e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:32.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.120+0000 7fc632200640 1 -- 172.21.15.138:0/1317283796 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc62c15d470 con 0x7fc62c15f2f0 2024-04-26T20:57:32.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.120+0000 7fc632200640 1 --2- 172.21.15.138:0/1317283796 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc62c15f2f0 0x7fc62c0ce4a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc624007e60 tx=0x7fc62400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:32.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.120+0000 7fc629600640 1 -- 172.21.15.138:0/1317283796 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc624014420 con 0x7fc62c15f2f0 2024-04-26T20:57:32.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.120+0000 7fc629600640 1 -- 172.21.15.138:0/1317283796 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc624019070 con 0x7fc62c15f2f0 2024-04-26T20:57:32.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.120+0000 7fc634200640 1 -- 172.21.15.138:0/1317283796 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc62c155920 con 0x7fc62c15f2f0 2024-04-26T20:57:32.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.120+0000 7fc629600640 1 -- 172.21.15.138:0/1317283796 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc624014820 con 0x7fc62c15f2f0 2024-04-26T20:57:32.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.120+0000 7fc634200640 1 -- 172.21.15.138:0/1317283796 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc62c15ceb0 con 0x7fc62c15f2f0 2024-04-26T20:57:32.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.120+0000 7fc634200640 1 -- 172.21.15.138:0/1317283796 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc62c069430 con 0x7fc62c15f2f0 2024-04-26T20:57:32.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.120+0000 7fc629600640 1 -- 172.21.15.138:0/1317283796 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc6240149c0 con 0x7fc62c15f2f0 2024-04-26T20:57:32.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.124+0000 7fc629600640 1 --2- 172.21.15.138:0/1317283796 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc60c068380 0x7fc60c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:32.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.124+0000 7fc629600640 1 -- 172.21.15.138:0/1317283796 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7fc624087440 con 0x7fc62c15f2f0 2024-04-26T20:57:32.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.124+0000 7fc631800640 1 --2- 172.21.15.138:0/1317283796 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc60c068380 0x7fc60c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:32.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.124+0000 7fc631800640 1 --2- 172.21.15.138:0/1317283796 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc60c068380 0x7fc60c06a840 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc62c069d10 tx=0x7fc620008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:32.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.128+0000 7fc629600640 1 -- 172.21.15.138:0/1317283796 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc62c15d470 con 0x7fc62c15f2f0 2024-04-26T20:57:32.295 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.288+0000 7fc634200640 1 -- 172.21.15.138:0/1317283796 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc62c158860 con 0x7fc62c15f2f0 2024-04-26T20:57:32.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.292+0000 7fc629600640 1 -- 172.21.15.138:0/1317283796 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7fc624057010 con 0x7fc62c15f2f0 2024-04-26T20:57:32.296 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 1 2024-04-26T20:57:32.298 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.292+0000 7fc634200640 1 -- 172.21.15.138:0/1317283796 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc60c068380 msgr2=0x7fc60c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:32.298 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.292+0000 7fc634200640 1 --2- 172.21.15.138:0/1317283796 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc60c068380 0x7fc60c06a840 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc62c069d10 tx=0x7fc620008040 comp rx=0 tx=0).stop 2024-04-26T20:57:32.298 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.292+0000 7fc634200640 1 -- 172.21.15.138:0/1317283796 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc62c15f2f0 msgr2=0x7fc62c0ce4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:32.298 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.292+0000 7fc634200640 1 --2- 172.21.15.138:0/1317283796 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc62c15f2f0 0x7fc62c0ce4a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc624007e60 tx=0x7fc62400e4b0 comp rx=0 tx=0).stop 2024-04-26T20:57:32.298 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.292+0000 7fc634200640 1 -- 172.21.15.138:0/1317283796 shutdown_connections 2024-04-26T20:57:32.298 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.292+0000 7fc634200640 1 --2- 172.21.15.138:0/1317283796 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc60c068380 0x7fc60c06a840 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:32.298 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.292+0000 7fc634200640 1 --2- 172.21.15.138:0/1317283796 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc62c15f2f0 0x7fc62c0ce4a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:32.298 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.292+0000 7fc634200640 1 --2- 172.21.15.138:0/1317283796 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc62c0d2130 0x7fc62c15c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:32.298 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.292+0000 7fc634200640 1 --2- 172.21.15.138:0/1317283796 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc62c06e120 0x7fc62c1553e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:32.299 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.292+0000 7fc634200640 1 -- 172.21.15.138:0/1317283796 >> 172.21.15.138:0/1317283796 conn(0x7fc62c0d2d30 msgr2=0x7fc62c071420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:32.299 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.292+0000 7fc634200640 1 -- 172.21.15.138:0/1317283796 shutdown_connections 2024-04-26T20:57:32.299 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.292+0000 7fc634200640 1 -- 172.21.15.138:0/1317283796 wait complete. 2024-04-26T20:57:32.317 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T20:57:32.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.452+0000 7f4a45c00640 1 Processor -- start 2024-04-26T20:57:32.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.452+0000 7f4a45c00640 1 -- start start 2024-04-26T20:57:32.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.452+0000 7f4a45c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4a400d1a50 0x7f4a400d0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:32.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.452+0000 7f4a45c00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4a400cfd40 0x7f4a400b2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:32.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.452+0000 7f4a45c00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a400cedf0 con 0x7f4a4015d0d0 2024-04-26T20:57:32.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.452+0000 7f4a45c00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f4a400d3920 con 0x7f4a400cfd40 2024-04-26T20:57:32.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.452+0000 7f4a45c00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f4a400d3c00 con 0x7f4a400d1a50 2024-04-26T20:57:32.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.452+0000 7f4a3f400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4a400cfd40 0x7f4a400b2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:32.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.452+0000 7f4a3f400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4a400cfd40 0x7f4a400b2ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40806/0 (socket says 172.21.15.138:40806) 2024-04-26T20:57:32.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.452+0000 7f4a3f400640 1 -- 172.21.15.138:0/1081199976 learned_addr learned my addr 172.21.15.138:0/1081199976 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:32.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.452+0000 7f4a3f400640 1 -- 172.21.15.138:0/1081199976 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4a400d1a50 msgr2=0x7f4a400d0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:32.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.452+0000 7f4a3e000640 1 --2- 172.21.15.138:0/1081199976 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4a400d1a50 0x7f4a400d0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:32.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.452+0000 7f4a3f400640 1 --2- 172.21.15.138:0/1081199976 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4a400d1a50 0x7f4a400d0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:32.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.452+0000 7f4a3f400640 1 -- 172.21.15.138:0/1081199976 >> v1:172.21.15.143:6789/0 conn(0x7f4a4015d0d0 legacy=0x7f4a400d1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:32.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.452+0000 7f4a3f400640 1 -- 172.21.15.138:0/1081199976 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a400b22f0 con 0x7f4a400cfd40 2024-04-26T20:57:32.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.452+0000 7f4a3e000640 1 --2- 172.21.15.138:0/1081199976 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4a400d1a50 0x7f4a400d0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:57:32.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.456+0000 7f4a3f400640 1 --2- 172.21.15.138:0/1081199976 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4a400cfd40 0x7f4a400b2ad0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4a38009e50 tx=0x7f4a3801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61c87c0ddb70710 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:32.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.456+0000 7f4a3d600640 1 -- 172.21.15.138:0/1081199976 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a380a5780 con 0x7f4a400cfd40 2024-04-26T20:57:32.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.456+0000 7f4a3d600640 1 -- 172.21.15.138:0/1081199976 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a380a5920 con 0x7f4a400cfd40 2024-04-26T20:57:32.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.456+0000 7f4a3d600640 1 -- 172.21.15.138:0/1081199976 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a380a5cf0 con 0x7f4a400cfd40 2024-04-26T20:57:32.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.456+0000 7f4a45c00640 1 -- 172.21.15.138:0/1081199976 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4a400cfd40 msgr2=0x7f4a400b2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:32.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.456+0000 7f4a45c00640 1 --2- 172.21.15.138:0/1081199976 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4a400cfd40 0x7f4a400b2ad0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4a38009e50 tx=0x7f4a3801c9f0 comp rx=0 tx=0).stop 2024-04-26T20:57:32.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.456+0000 7f4a45c00640 1 -- 172.21.15.138:0/1081199976 shutdown_connections 2024-04-26T20:57:32.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.456+0000 7f4a45c00640 1 --2- 172.21.15.138:0/1081199976 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4a400cfd40 0x7f4a400b2ad0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:32.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.456+0000 7f4a45c00640 1 --2- 172.21.15.138:0/1081199976 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4a400d1a50 0x7f4a400d0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:32.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.456+0000 7f4a45c00640 1 -- 172.21.15.138:0/1081199976 >> 172.21.15.138:0/1081199976 conn(0x7f4a400d2d60 msgr2=0x7f4a400d3170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:32.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.456+0000 7f4a45c00640 1 -- 172.21.15.138:0/1081199976 shutdown_connections 2024-04-26T20:57:32.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.456+0000 7f4a45c00640 1 -- 172.21.15.138:0/1081199976 wait complete. 2024-04-26T20:57:32.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.460+0000 7f4a45c00640 1 Processor -- start 2024-04-26T20:57:32.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.460+0000 7f4a45c00640 1 -- start start 2024-04-26T20:57:32.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.460+0000 7f4a45c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a400cfd40 0x7f4a40142d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:32.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.460+0000 7f4a45c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4a400d1a50 0x7f4a4015f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:32.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.460+0000 7f4a45c00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4a4015d0d0 0x7f4a40156d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:32.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.460+0000 7f4a45c00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f4a400b3820 con 0x7f4a4015d0d0 2024-04-26T20:57:32.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.460+0000 7f4a45c00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f4a400cebd0 con 0x7f4a400cfd40 2024-04-26T20:57:32.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.460+0000 7f4a45c00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f4a400b39a0 con 0x7f4a400d1a50 2024-04-26T20:57:32.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.460+0000 7f4a3f400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4a4015d0d0 0x7f4a40156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:32.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.460+0000 7f4a3f400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4a4015d0d0 0x7f4a40156d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40822/0 (socket says 172.21.15.138:40822) 2024-04-26T20:57:32.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.460+0000 7f4a3f400640 1 -- 172.21.15.138:0/1956537243 learned_addr learned my addr 172.21.15.138:0/1956537243 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:32.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.460+0000 7f4a3ea00640 1 --2- 172.21.15.138:0/1956537243 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a400cfd40 0x7f4a40142d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:32.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.460+0000 7f4a3e000640 1 --2- 172.21.15.138:0/1956537243 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4a400d1a50 0x7f4a4015f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:32.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.460+0000 7f4a3f400640 1 -- 172.21.15.138:0/1956537243 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4a400d1a50 msgr2=0x7f4a4015f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:32.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.460+0000 7f4a3f400640 1 --2- 172.21.15.138:0/1956537243 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4a400d1a50 0x7f4a4015f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:32.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.460+0000 7f4a3f400640 1 -- 172.21.15.138:0/1956537243 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a400cfd40 msgr2=0x7f4a40142d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:32.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.460+0000 7f4a3f400640 1 --2- 172.21.15.138:0/1956537243 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a400cfd40 0x7f4a40142d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:32.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.460+0000 7f4a3f400640 1 -- 172.21.15.138:0/1956537243 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a4015fe70 con 0x7f4a4015d0d0 2024-04-26T20:57:32.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.460+0000 7f4a3f400640 1 --2- 172.21.15.138:0/1956537243 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4a4015d0d0 0x7f4a40156d90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4a38009e50 tx=0x7f4a38019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:32.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.460+0000 7f4a36a00640 1 -- 172.21.15.138:0/1956537243 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a380b8670 con 0x7f4a4015d0d0 2024-04-26T20:57:32.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.460+0000 7f4a36a00640 1 -- 172.21.15.138:0/1956537243 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a380be070 con 0x7f4a4015d0d0 2024-04-26T20:57:32.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.460+0000 7f4a36a00640 1 -- 172.21.15.138:0/1956537243 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a380b8a70 con 0x7f4a4015d0d0 2024-04-26T20:57:32.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.460+0000 7f4a45c00640 1 -- 172.21.15.138:0/1956537243 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a40160150 con 0x7f4a4015d0d0 2024-04-26T20:57:32.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.460+0000 7f4a45c00640 1 -- 172.21.15.138:0/1956537243 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a40160710 con 0x7f4a4015d0d0 2024-04-26T20:57:32.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.464+0000 7f4a45c00640 1 -- 172.21.15.138:0/1956537243 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a40069430 con 0x7f4a4015d0d0 2024-04-26T20:57:32.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.464+0000 7f4a36a00640 1 -- 172.21.15.138:0/1956537243 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4a380b8c10 con 0x7f4a4015d0d0 2024-04-26T20:57:32.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.464+0000 7f4a36a00640 1 --2- 172.21.15.138:0/1956537243 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4a20068380 0x7f4a2006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:32.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.464+0000 7f4a36a00640 1 -- 172.21.15.138:0/1956537243 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7f4a38121fd0 con 0x7f4a4015d0d0 2024-04-26T20:57:32.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.464+0000 7f4a3ea00640 1 --2- 172.21.15.138:0/1956537243 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4a20068380 0x7f4a2006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:32.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.464+0000 7f4a3ea00640 1 --2- 172.21.15.138:0/1956537243 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4a20068380 0x7f4a2006a840 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4a300098e0 tx=0x7f4a30009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:32.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.468+0000 7f4a36a00640 1 -- 172.21.15.138:0/1956537243 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4a380165e0 con 0x7f4a4015d0d0 2024-04-26T20:57:32.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.624+0000 7f4a45c00640 1 -- 172.21.15.138:0/1956537243 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f4a400d15e0 con 0x7f4a4015d0d0 2024-04-26T20:57:32.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.624+0000 7f4a36a00640 1 -- 172.21.15.138:0/1956537243 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7f4a380f1b10 con 0x7f4a4015d0d0 2024-04-26T20:57:32.631 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 32 2024-04-26T20:57:32.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.628+0000 7f4a45c00640 1 -- 172.21.15.138:0/1956537243 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4a20068380 msgr2=0x7f4a2006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:32.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.628+0000 7f4a45c00640 1 --2- 172.21.15.138:0/1956537243 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4a20068380 0x7f4a2006a840 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4a300098e0 tx=0x7f4a30009060 comp rx=0 tx=0).stop 2024-04-26T20:57:32.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.628+0000 7f4a45c00640 1 -- 172.21.15.138:0/1956537243 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4a4015d0d0 msgr2=0x7f4a40156d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:32.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.628+0000 7f4a45c00640 1 --2- 172.21.15.138:0/1956537243 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4a4015d0d0 0x7f4a40156d90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4a38009e50 tx=0x7f4a38019790 comp rx=0 tx=0).stop 2024-04-26T20:57:32.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.628+0000 7f4a45c00640 1 -- 172.21.15.138:0/1956537243 shutdown_connections 2024-04-26T20:57:32.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.628+0000 7f4a45c00640 1 --2- 172.21.15.138:0/1956537243 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4a20068380 0x7f4a2006a840 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:32.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.628+0000 7f4a45c00640 1 --2- 172.21.15.138:0/1956537243 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4a4015d0d0 0x7f4a40156d90 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:32.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.628+0000 7f4a45c00640 1 --2- 172.21.15.138:0/1956537243 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4a400d1a50 0x7f4a4015f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:32.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.628+0000 7f4a45c00640 1 --2- 172.21.15.138:0/1956537243 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a400cfd40 0x7f4a40142d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:32.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.628+0000 7f4a45c00640 1 -- 172.21.15.138:0/1956537243 >> 172.21.15.138:0/1956537243 conn(0x7f4a400d2d60 msgr2=0x7f4a400b8330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:32.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.628+0000 7f4a45c00640 1 -- 172.21.15.138:0/1956537243 shutdown_connections 2024-04-26T20:57:32.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.628+0000 7f4a45c00640 1 -- 172.21.15.138:0/1956537243 wait complete. 2024-04-26T20:57:32.652 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T20:57:32.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.784+0000 7f244ca00640 1 Processor -- start 2024-04-26T20:57:32.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.784+0000 7f244ca00640 1 -- start start 2024-04-26T20:57:32.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.788+0000 7f244ca00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f244815f3b0 0x7f2448068420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:32.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.788+0000 7f244ca00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f24480b6610 0x7f2448073a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:32.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.788+0000 7f244ca00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24480b6ac0 con 0x7f2448073f80 2024-04-26T20:57:32.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.788+0000 7f244ca00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f24480c81a0 con 0x7f24480b6610 2024-04-26T20:57:32.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.788+0000 7f244ca00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f24480b6330 con 0x7f244815f3b0 2024-04-26T20:57:32.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.788+0000 7f2446a00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f24480b6610 0x7f2448073a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:32.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.788+0000 7f2446a00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f24480b6610 0x7f2448073a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40836/0 (socket says 172.21.15.138:40836) 2024-04-26T20:57:32.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.788+0000 7f2446a00640 1 -- 172.21.15.138:0/2980289193 learned_addr learned my addr 172.21.15.138:0/2980289193 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:32.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.788+0000 7f2447400640 1 --2- 172.21.15.138:0/2980289193 >> v2:172.21.15.143:3300/0 conn(0x7f244815f3b0 0x7f2448068420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:32.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.788+0000 7f2446a00640 1 -- 172.21.15.138:0/2980289193 >> v2:172.21.15.143:3300/0 conn(0x7f244815f3b0 msgr2=0x7f2448068420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:32.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.788+0000 7f2446a00640 1 --2- 172.21.15.138:0/2980289193 >> v2:172.21.15.143:3300/0 conn(0x7f244815f3b0 0x7f2448068420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:32.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.788+0000 7f2446a00640 1 -- 172.21.15.138:0/2980289193 >> v1:172.21.15.143:6789/0 conn(0x7f2448073f80 legacy=0x7f24480cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:32.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.788+0000 7f2446a00640 1 -- 172.21.15.138:0/2980289193 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24480b6e60 con 0x7f24480b6610 2024-04-26T20:57:32.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.788+0000 7f2447400640 1 --2- 172.21.15.138:0/2980289193 >> v2:172.21.15.143:3300/0 conn(0x7f244815f3b0 0x7f2448068420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:32.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.788+0000 7f2446a00640 1 --2- 172.21.15.138:0/2980289193 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24480b6610 0x7f2448073a40 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2448074b40 tx=0x7f243001c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64817f54d198bb43 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:32.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.792+0000 7f2446000640 1 -- 172.21.15.138:0/2980289193 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24300b2070 con 0x7f24480b6610 2024-04-26T20:57:32.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.792+0000 7f2446000640 1 -- 172.21.15.138:0/2980289193 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24300a9070 con 0x7f24480b6610 2024-04-26T20:57:32.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.792+0000 7f2446000640 1 -- 172.21.15.138:0/2980289193 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24300ad880 con 0x7f24480b6610 2024-04-26T20:57:32.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.792+0000 7f244ca00640 1 -- 172.21.15.138:0/2980289193 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24480b6610 msgr2=0x7f2448073a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:32.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.792+0000 7f244ca00640 1 --2- 172.21.15.138:0/2980289193 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24480b6610 0x7f2448073a40 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2448074b40 tx=0x7f243001c340 comp rx=0 tx=0).stop 2024-04-26T20:57:32.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.792+0000 7f244ca00640 1 -- 172.21.15.138:0/2980289193 shutdown_connections 2024-04-26T20:57:32.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.792+0000 7f244ca00640 1 --2- 172.21.15.138:0/2980289193 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24480b6610 0x7f2448073a40 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:32.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.792+0000 7f244ca00640 1 --2- 172.21.15.138:0/2980289193 >> v2:172.21.15.143:3300/0 conn(0x7f244815f3b0 0x7f2448068420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:32.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.792+0000 7f244ca00640 1 -- 172.21.15.138:0/2980289193 >> 172.21.15.138:0/2980289193 conn(0x7f24480b2e60 msgr2=0x7f24480b3240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:32.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.792+0000 7f244ca00640 1 -- 172.21.15.138:0/2980289193 shutdown_connections 2024-04-26T20:57:32.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.792+0000 7f244ca00640 1 -- 172.21.15.138:0/2980289193 wait complete. 2024-04-26T20:57:32.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.792+0000 7f244ca00640 1 Processor -- start 2024-04-26T20:57:32.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.792+0000 7f244ca00640 1 -- start start 2024-04-26T20:57:32.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.792+0000 7f244ca00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2448073f80 0x7f24481577d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:32.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.792+0000 7f244ca00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f24480b6610 0x7f24480c8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:32.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.792+0000 7f244ca00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f244815f3b0 0x7f24480c55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:32.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.792+0000 7f244ca00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f24480b3ad0 con 0x7f2448073f80 2024-04-26T20:57:32.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.792+0000 7f244ca00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f24480b3950 con 0x7f244815f3b0 2024-04-26T20:57:32.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.792+0000 7f244ca00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f244816c010 con 0x7f24480b6610 2024-04-26T20:57:32.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.792+0000 7f2447400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2448073f80 0x7f24481577d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:32.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.792+0000 7f2447400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2448073f80 0x7f24481577d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40850/0 (socket says 172.21.15.138:40850) 2024-04-26T20:57:32.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.792+0000 7f2447400640 1 -- 172.21.15.138:0/1383676541 learned_addr learned my addr 172.21.15.138:0/1383676541 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:32.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.792+0000 7f2446a00640 1 --2- 172.21.15.138:0/1383676541 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f24480b6610 0x7f24480c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:32.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.792+0000 7f2447e00640 1 --2- 172.21.15.138:0/1383676541 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f244815f3b0 0x7f24480c55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:32.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.796+0000 7f2447400640 1 -- 172.21.15.138:0/1383676541 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f24480b6610 msgr2=0x7f24480c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:32.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.796+0000 7f2447400640 1 --2- 172.21.15.138:0/1383676541 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f24480b6610 0x7f24480c8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:32.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.796+0000 7f2447400640 1 -- 172.21.15.138:0/1383676541 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f244815f3b0 msgr2=0x7f24480c55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:32.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.796+0000 7f2447400640 1 --2- 172.21.15.138:0/1383676541 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f244815f3b0 0x7f24480c55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:32.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.796+0000 7f2447400640 1 -- 172.21.15.138:0/1383676541 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f244815ec30 con 0x7f2448073f80 2024-04-26T20:57:32.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.796+0000 7f2447400640 1 --2- 172.21.15.138:0/1383676541 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2448073f80 0x7f24481577d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f243800d830 tx=0x7f243800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:32.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.796+0000 7f243f400640 1 -- 172.21.15.138:0/1383676541 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2438018020 con 0x7f2448073f80 2024-04-26T20:57:32.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.796+0000 7f243f400640 1 -- 172.21.15.138:0/1383676541 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24380096c0 con 0x7f2448073f80 2024-04-26T20:57:32.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.796+0000 7f244ca00640 1 -- 172.21.15.138:0/1383676541 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24480c8d00 con 0x7f2448073f80 2024-04-26T20:57:32.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.796+0000 7f243f400640 1 -- 172.21.15.138:0/1383676541 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2438009ab0 con 0x7f2448073f80 2024-04-26T20:57:32.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.796+0000 7f244ca00640 1 -- 172.21.15.138:0/1383676541 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24480c92c0 con 0x7f2448073f80 2024-04-26T20:57:32.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.796+0000 7f244ca00640 1 -- 172.21.15.138:0/1383676541 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2448069430 con 0x7f2448073f80 2024-04-26T20:57:32.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.796+0000 7f243f400640 1 -- 172.21.15.138:0/1383676541 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f243801b020 con 0x7f2448073f80 2024-04-26T20:57:32.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.796+0000 7f243f400640 1 --2- 172.21.15.138:0/1383676541 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f24240683b0 0x7f242406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:32.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.796+0000 7f243f400640 1 -- 172.21.15.138:0/1383676541 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7f2438087580 con 0x7f2448073f80 2024-04-26T20:57:32.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.796+0000 7f2446a00640 1 --2- 172.21.15.138:0/1383676541 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f24240683b0 0x7f242406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:32.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.800+0000 7f2446a00640 1 --2- 172.21.15.138:0/1383676541 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f24240683b0 0x7f242406a870 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f24300af000 tx=0x7f2430008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:32.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.800+0000 7f243f400640 1 -- 172.21.15.138:0/1383676541 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2438022020 con 0x7f2448073f80 2024-04-26T20:57:32.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.960+0000 7f244ca00640 1 -- 172.21.15.138:0/1383676541 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f24480689d0 con 0x7f2448073f80 2024-04-26T20:57:32.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.960+0000 7f243f400640 1 -- 172.21.15.138:0/1383676541 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7f2438057680 con 0x7f2448073f80 2024-04-26T20:57:32.967 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 64 2024-04-26T20:57:32.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.964+0000 7f244ca00640 1 -- 172.21.15.138:0/1383676541 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f24240683b0 msgr2=0x7f242406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:32.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.964+0000 7f244ca00640 1 --2- 172.21.15.138:0/1383676541 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f24240683b0 0x7f242406a870 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f24300af000 tx=0x7f2430008040 comp rx=0 tx=0).stop 2024-04-26T20:57:32.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.964+0000 7f244ca00640 1 -- 172.21.15.138:0/1383676541 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2448073f80 msgr2=0x7f24481577d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:32.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.964+0000 7f244ca00640 1 --2- 172.21.15.138:0/1383676541 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2448073f80 0x7f24481577d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f243800d830 tx=0x7f243800dcf0 comp rx=0 tx=0).stop 2024-04-26T20:57:32.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.964+0000 7f244ca00640 1 -- 172.21.15.138:0/1383676541 shutdown_connections 2024-04-26T20:57:32.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.964+0000 7f244ca00640 1 --2- 172.21.15.138:0/1383676541 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f24240683b0 0x7f242406a870 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:32.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.964+0000 7f244ca00640 1 --2- 172.21.15.138:0/1383676541 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f244815f3b0 0x7f24480c55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:32.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.964+0000 7f244ca00640 1 --2- 172.21.15.138:0/1383676541 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f24480b6610 0x7f24480c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:32.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.964+0000 7f244ca00640 1 --2- 172.21.15.138:0/1383676541 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2448073f80 0x7f24481577d0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:32.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.964+0000 7f244ca00640 1 -- 172.21.15.138:0/1383676541 >> 172.21.15.138:0/1383676541 conn(0x7f24480b2e60 msgr2=0x7f24480b0150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:32.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.964+0000 7f244ca00640 1 -- 172.21.15.138:0/1383676541 shutdown_connections 2024-04-26T20:57:32.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:32.964+0000 7f244ca00640 1 -- 172.21.15.138:0/1383676541 wait complete. 2024-04-26T20:57:32.988 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T20:57:33.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.120+0000 7f5723800640 1 Processor -- start 2024-04-26T20:57:33.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.120+0000 7f5723800640 1 -- start start 2024-04-26T20:57:33.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.120+0000 7f5723800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f571c15b730 0x7f571c073e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:33.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.120+0000 7f5723800640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f571c0cbe40 con 0x7f571c0738e0 2024-04-26T20:57:33.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.120+0000 7f5723800640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f571c0cc120 con 0x7f571c06ee80 2024-04-26T20:57:33.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.120+0000 7f5723800640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f571c0cbbf0 con 0x7f571c15b730 2024-04-26T20:57:33.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.124+0000 7f5720e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f571c15b730 0x7f571c073e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:33.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.124+0000 7f5713e00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f571c0738e0 0x7f571c06e770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:58190/0 (socket says 172.21.15.138:58190) 2024-04-26T20:57:33.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.124+0000 7f5713e00640 1 -- 172.21.15.138:0/807230944 learned_addr learned my addr 172.21.15.138:0/807230944 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:33.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.124+0000 7f5720e00640 1 -- 172.21.15.138:0/807230944 >> v1:172.21.15.143:6789/0 conn(0x7f571c06ee80 legacy=0x7f571c0ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:33.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.124+0000 7f5720e00640 1 -- 172.21.15.138:0/807230944 >> v1:172.21.15.138:6789/0 conn(0x7f571c0738e0 legacy=0x7f571c06e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:33.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.124+0000 7f5720e00640 1 -- 172.21.15.138:0/807230944 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f571c072b70 con 0x7f571c15b730 2024-04-26T20:57:33.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.124+0000 7f571be00640 1 -- 172.21.15.138:0/807230944 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3806623430 0 0) 0x7f571c0cbe40 con 0x7f571c0738e0 2024-04-26T20:57:33.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.124+0000 7f5720e00640 1 --2- 172.21.15.138:0/807230944 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f571c15b730 0x7f571c073e10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f570c0097c0 tx=0x7f570c01d5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff48b72c00c389d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:33.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.124+0000 7f571be00640 1 -- 172.21.15.138:0/807230944 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570c0ac5f0 con 0x7f571c15b730 2024-04-26T20:57:33.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.124+0000 7f571be00640 1 -- 172.21.15.138:0/807230944 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f570c0b1070 con 0x7f571c15b730 2024-04-26T20:57:33.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.124+0000 7f571be00640 1 -- 172.21.15.138:0/807230944 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570c0ac9b0 con 0x7f571c15b730 2024-04-26T20:57:33.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.128+0000 7f5723800640 1 -- 172.21.15.138:0/807230944 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f571c15b730 msgr2=0x7f571c073e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:33.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.128+0000 7f5723800640 1 --2- 172.21.15.138:0/807230944 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f571c15b730 0x7f571c073e10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f570c0097c0 tx=0x7f570c01d5b0 comp rx=0 tx=0).stop 2024-04-26T20:57:33.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.128+0000 7f5723800640 1 -- 172.21.15.138:0/807230944 shutdown_connections 2024-04-26T20:57:33.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.128+0000 7f5723800640 1 --2- 172.21.15.138:0/807230944 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f571c15b730 0x7f571c073e10 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:33.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.128+0000 7f5723800640 1 -- 172.21.15.138:0/807230944 >> 172.21.15.138:0/807230944 conn(0x7f571c0d0bb0 msgr2=0x7f571c0d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:33.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.128+0000 7f5723800640 1 -- 172.21.15.138:0/807230944 shutdown_connections 2024-04-26T20:57:33.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.128+0000 7f5723800640 1 -- 172.21.15.138:0/807230944 wait complete. 2024-04-26T20:57:33.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.128+0000 7f5723800640 1 Processor -- start 2024-04-26T20:57:33.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.128+0000 7f5723800640 1 -- start start 2024-04-26T20:57:33.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.128+0000 7f5723800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f571c06ee80 0x7f571c15cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:33.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.128+0000 7f5723800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f571c0738e0 0x7f571c153290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:33.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.128+0000 7f5723800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f571c15b730 0x7f571c0c70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:33.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.128+0000 7f5723800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f571c0cf220 con 0x7f571c15b730 2024-04-26T20:57:33.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.128+0000 7f5723800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f571c0cf0a0 con 0x7f571c0738e0 2024-04-26T20:57:33.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.128+0000 7f5723800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f571c0cf3a0 con 0x7f571c06ee80 2024-04-26T20:57:33.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.128+0000 7f5721800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f571c15b730 0x7f571c0c70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:33.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.128+0000 7f5720e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f571c06ee80 0x7f571c15cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:33.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.128+0000 7f5721800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f571c15b730 0x7f571c0c70a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40862/0 (socket says 172.21.15.138:40862) 2024-04-26T20:57:33.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.128+0000 7f5721800640 1 -- 172.21.15.138:0/414122878 learned_addr learned my addr 172.21.15.138:0/414122878 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:33.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.128+0000 7f5713e00640 1 --2- 172.21.15.138:0/414122878 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f571c0738e0 0x7f571c153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:33.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.128+0000 7f5721800640 1 -- 172.21.15.138:0/414122878 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f571c06ee80 msgr2=0x7f571c15cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:33.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.128+0000 7f5721800640 1 --2- 172.21.15.138:0/414122878 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f571c06ee80 0x7f571c15cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:33.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.128+0000 7f5721800640 1 -- 172.21.15.138:0/414122878 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f571c0738e0 msgr2=0x7f571c153290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:33.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.128+0000 7f5721800640 1 --2- 172.21.15.138:0/414122878 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f571c0738e0 0x7f571c153290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:33.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.128+0000 7f5721800640 1 -- 172.21.15.138:0/414122878 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f571c15d580 con 0x7f571c15b730 2024-04-26T20:57:33.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.132+0000 7f5721800640 1 --2- 172.21.15.138:0/414122878 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f571c15b730 0x7f571c0c70a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f571400c7a0 tx=0x7f571400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:33.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.132+0000 7f5719600640 1 -- 172.21.15.138:0/414122878 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5714003b80 con 0x7f571c15b730 2024-04-26T20:57:33.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.132+0000 7f5719600640 1 -- 172.21.15.138:0/414122878 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5714003d20 con 0x7f571c15b730 2024-04-26T20:57:33.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.132+0000 7f5719600640 1 -- 172.21.15.138:0/414122878 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f571400aa30 con 0x7f571c15b730 2024-04-26T20:57:33.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.132+0000 7f5723800640 1 -- 172.21.15.138:0/414122878 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f571c15d860 con 0x7f571c15b730 2024-04-26T20:57:33.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.132+0000 7f5723800640 1 -- 172.21.15.138:0/414122878 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f571c15de20 con 0x7f571c15b730 2024-04-26T20:57:33.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.132+0000 7f5723800640 1 -- 172.21.15.138:0/414122878 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f571c069430 con 0x7f571c15b730 2024-04-26T20:57:33.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.132+0000 7f5719600640 1 -- 172.21.15.138:0/414122878 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f571400abd0 con 0x7f571c15b730 2024-04-26T20:57:33.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.132+0000 7f5719600640 1 --2- 172.21.15.138:0/414122878 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f56f8068380 0x7f56f806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:33.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.132+0000 7f5719600640 1 -- 172.21.15.138:0/414122878 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7f5714086b80 con 0x7f571c15b730 2024-04-26T20:57:33.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.132+0000 7f5720e00640 1 --2- 172.21.15.138:0/414122878 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f56f8068380 0x7f56f806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:33.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.136+0000 7f5720e00640 1 --2- 172.21.15.138:0/414122878 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f56f8068380 0x7f56f806a840 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f570c0b0000 tx=0x7f570c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:33.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.136+0000 7f5719600640 1 -- 172.21.15.138:0/414122878 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f57140566c0 con 0x7f571c15b730 2024-04-26T20:57:33.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.296+0000 7f5723800640 1 -- 172.21.15.138:0/414122878 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f571c0d19c0 con 0x7f571c15b730 2024-04-26T20:57:33.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.300+0000 7f5719600640 1 -- 172.21.15.138:0/414122878 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7f571405a9c0 con 0x7f571c15b730 2024-04-26T20:57:33.304 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 32 2024-04-26T20:57:33.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.300+0000 7f5723800640 1 -- 172.21.15.138:0/414122878 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f56f8068380 msgr2=0x7f56f806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:33.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.300+0000 7f5723800640 1 --2- 172.21.15.138:0/414122878 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f56f8068380 0x7f56f806a840 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f570c0b0000 tx=0x7f570c008040 comp rx=0 tx=0).stop 2024-04-26T20:57:33.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.300+0000 7f5723800640 1 -- 172.21.15.138:0/414122878 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f571c15b730 msgr2=0x7f571c0c70a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:33.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.300+0000 7f5723800640 1 --2- 172.21.15.138:0/414122878 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f571c15b730 0x7f571c0c70a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f571400c7a0 tx=0x7f571400cc60 comp rx=0 tx=0).stop 2024-04-26T20:57:33.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.300+0000 7f5723800640 1 -- 172.21.15.138:0/414122878 shutdown_connections 2024-04-26T20:57:33.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.300+0000 7f5723800640 1 --2- 172.21.15.138:0/414122878 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f56f8068380 0x7f56f806a840 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:33.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.300+0000 7f5723800640 1 --2- 172.21.15.138:0/414122878 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f571c15b730 0x7f571c0c70a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:33.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.300+0000 7f5723800640 1 --2- 172.21.15.138:0/414122878 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f571c0738e0 0x7f571c153290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:33.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.300+0000 7f5723800640 1 --2- 172.21.15.138:0/414122878 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f571c06ee80 0x7f571c15cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:33.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.300+0000 7f5723800640 1 -- 172.21.15.138:0/414122878 >> 172.21.15.138:0/414122878 conn(0x7f571c0d0bb0 msgr2=0x7f571c0d0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:33.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.300+0000 7f5723800640 1 -- 172.21.15.138:0/414122878 shutdown_connections 2024-04-26T20:57:33.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.300+0000 7f5723800640 1 -- 172.21.15.138:0/414122878 wait complete. 2024-04-26T20:57:33.325 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T20:57:33.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.456+0000 7f4fd9800640 1 Processor -- start 2024-04-26T20:57:33.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.456+0000 7f4fd9800640 1 -- start start 2024-04-26T20:57:33.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.456+0000 7f4fd9800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4fd40b8890 0x7f4fd415e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:33.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.456+0000 7f4fd9800640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4fd415eea0 0x7f4fd415f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:33.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.456+0000 7f4fd9800640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fd40cdd50 con 0x7f4fd40d0fc0 2024-04-26T20:57:33.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.456+0000 7f4fd9800640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f4fd40cec40 con 0x7f4fd40b8890 2024-04-26T20:57:33.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.456+0000 7f4fd9800640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f4fd40d00e0 con 0x7f4fd415eea0 2024-04-26T20:57:33.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.456+0000 7f4fd2a00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4fd40b8890 0x7f4fd415e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:33.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.460+0000 7f4fd2a00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4fd40b8890 0x7f4fd415e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40868/0 (socket says 172.21.15.138:40868) 2024-04-26T20:57:33.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.460+0000 7f4fd2a00640 1 -- 172.21.15.138:0/2017041778 learned_addr learned my addr 172.21.15.138:0/2017041778 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:33.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.460+0000 7f4fd2000640 1 --2- 172.21.15.138:0/2017041778 >> v2:172.21.15.143:3300/0 conn(0x7f4fd415eea0 0x7f4fd415f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:33.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.460+0000 7f4fd2a00640 1 -- 172.21.15.138:0/2017041778 >> v2:172.21.15.143:3300/0 conn(0x7f4fd415eea0 msgr2=0x7f4fd415f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:33.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.460+0000 7f4fd2a00640 1 --2- 172.21.15.138:0/2017041778 >> v2:172.21.15.143:3300/0 conn(0x7f4fd415eea0 0x7f4fd415f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:33.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.460+0000 7f4fd2a00640 1 -- 172.21.15.138:0/2017041778 >> v1:172.21.15.143:6789/0 conn(0x7f4fd40d0fc0 legacy=0x7f4fd40d1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:33.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.460+0000 7f4fd2a00640 1 -- 172.21.15.138:0/2017041778 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fd40ce030 con 0x7f4fd40b8890 2024-04-26T20:57:33.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.460+0000 7f4fd2a00640 1 --2- 172.21.15.138:0/2017041778 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4fd40b8890 0x7f4fd415e960 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4162e10 tx=0x7f4fc401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95e7d737782801da server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:33.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.460+0000 7f4fd1600640 1 -- 172.21.15.138:0/2017041778 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc40b0070 con 0x7f4fd40b8890 2024-04-26T20:57:33.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.460+0000 7f4fd1600640 1 -- 172.21.15.138:0/2017041778 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fc40ab600 con 0x7f4fd40b8890 2024-04-26T20:57:33.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.460+0000 7f4fd1600640 1 -- 172.21.15.138:0/2017041778 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc40ab9d0 con 0x7f4fd40b8890 2024-04-26T20:57:33.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.464+0000 7f4fd9800640 1 -- 172.21.15.138:0/2017041778 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4fd40b8890 msgr2=0x7f4fd415e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:33.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.464+0000 7f4fd9800640 1 --2- 172.21.15.138:0/2017041778 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4fd40b8890 0x7f4fd415e960 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4162e10 tx=0x7f4fc401c4e0 comp rx=0 tx=0).stop 2024-04-26T20:57:33.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.464+0000 7f4fd9800640 1 -- 172.21.15.138:0/2017041778 shutdown_connections 2024-04-26T20:57:33.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.464+0000 7f4fd9800640 1 --2- 172.21.15.138:0/2017041778 >> v2:172.21.15.143:3300/0 conn(0x7f4fd415eea0 0x7f4fd415f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:33.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.464+0000 7f4fd9800640 1 --2- 172.21.15.138:0/2017041778 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4fd40b8890 0x7f4fd415e960 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:33.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.464+0000 7f4fd9800640 1 -- 172.21.15.138:0/2017041778 >> 172.21.15.138:0/2017041778 conn(0x7f4fd40d2cf0 msgr2=0x7f4fd40d3100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:33.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.464+0000 7f4fd9800640 1 -- 172.21.15.138:0/2017041778 shutdown_connections 2024-04-26T20:57:33.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.464+0000 7f4fd9800640 1 -- 172.21.15.138:0/2017041778 wait complete. 2024-04-26T20:57:33.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.464+0000 7f4fd9800640 1 Processor -- start 2024-04-26T20:57:33.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.464+0000 7f4fd9800640 1 -- start start 2024-04-26T20:57:33.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.464+0000 7f4fd9800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4fd40b8890 0x7f4fd414ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:33.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.464+0000 7f4fd9800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4fd40d0fc0 0x7f4fd40c86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:33.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.464+0000 7f4fd9800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4fd415eea0 0x7f4fd415e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:33.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.464+0000 7f4fd9800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd40d3a40 con 0x7f4fd415eea0 2024-04-26T20:57:33.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.464+0000 7f4fd9800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd40b5b40 con 0x7f4fd40d0fc0 2024-04-26T20:57:33.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.464+0000 7f4fd9800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f4fd40c9160 con 0x7f4fd40b8890 2024-04-26T20:57:33.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.464+0000 7f4fd3400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4fd415eea0 0x7f4fd415e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:33.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.464+0000 7f4fd3400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4fd415eea0 0x7f4fd415e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40882/0 (socket says 172.21.15.138:40882) 2024-04-26T20:57:33.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.464+0000 7f4fd3400640 1 -- 172.21.15.138:0/27704164 learned_addr learned my addr 172.21.15.138:0/27704164 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:33.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.464+0000 7f4fd2000640 1 --2- 172.21.15.138:0/27704164 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4fd40d0fc0 0x7f4fd40c86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:33.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.464+0000 7f4fd2a00640 1 --2- 172.21.15.138:0/27704164 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4fd40b8890 0x7f4fd414ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:33.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.464+0000 7f4fd3400640 1 -- 172.21.15.138:0/27704164 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4fd40b8890 msgr2=0x7f4fd414ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:33.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.464+0000 7f4fd3400640 1 --2- 172.21.15.138:0/27704164 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4fd40b8890 0x7f4fd414ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:33.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.464+0000 7f4fd3400640 1 -- 172.21.15.138:0/27704164 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4fd40d0fc0 msgr2=0x7f4fd40c86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:33.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.464+0000 7f4fd3400640 1 --2- 172.21.15.138:0/27704164 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4fd40d0fc0 0x7f4fd40c86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:33.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.464+0000 7f4fd3400640 1 -- 172.21.15.138:0/27704164 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fd40c9440 con 0x7f4fd415eea0 2024-04-26T20:57:33.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.464+0000 7f4fd3400640 1 --2- 172.21.15.138:0/27704164 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4fd415eea0 0x7f4fd415e050 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc00c7b0 tx=0x7f4fcc00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:33.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.464+0000 7f4fcaa00640 1 -- 172.21.15.138:0/27704164 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc004b70 con 0x7f4fd415eea0 2024-04-26T20:57:33.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.464+0000 7f4fcaa00640 1 -- 172.21.15.138:0/27704164 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fcc004d10 con 0x7f4fd415eea0 2024-04-26T20:57:33.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.468+0000 7f4fd9800640 1 -- 172.21.15.138:0/27704164 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fd4156500 con 0x7f4fd415eea0 2024-04-26T20:57:33.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.468+0000 7f4fcaa00640 1 -- 172.21.15.138:0/27704164 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc00aa90 con 0x7f4fd415eea0 2024-04-26T20:57:33.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.468+0000 7f4fd9800640 1 -- 172.21.15.138:0/27704164 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fd414f350 con 0x7f4fd415eea0 2024-04-26T20:57:33.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.468+0000 7f4fd9800640 1 -- 172.21.15.138:0/27704164 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fd4069510 con 0x7f4fd415eea0 2024-04-26T20:57:33.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.468+0000 7f4fcaa00640 1 -- 172.21.15.138:0/27704164 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4fcc00ac30 con 0x7f4fd415eea0 2024-04-26T20:57:33.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.468+0000 7f4fcaa00640 1 --2- 172.21.15.138:0/27704164 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4fb4068380 0x7f4fb406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:33.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.468+0000 7f4fcaa00640 1 -- 172.21.15.138:0/27704164 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7f4fcc086fb0 con 0x7f4fd415eea0 2024-04-26T20:57:33.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.468+0000 7f4fd2a00640 1 --2- 172.21.15.138:0/27704164 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4fb4068380 0x7f4fb406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:33.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.472+0000 7f4fd2a00640 1 --2- 172.21.15.138:0/27704164 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4fb4068380 0x7f4fb406a840 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4fc40ad000 tx=0x7f4fc40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:33.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.472+0000 7f4fcaa00640 1 -- 172.21.15.138:0/27704164 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4fcc020070 con 0x7f4fd415eea0 2024-04-26T20:57:33.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.640+0000 7f4fd9800640 1 -- 172.21.15.138:0/27704164 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4fd4069d90 con 0x7f4fd415eea0 2024-04-26T20:57:33.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.640+0000 7f4fcaa00640 1 -- 172.21.15.138:0/27704164 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7f4fcc057250 con 0x7f4fd415eea0 2024-04-26T20:57:33.646 INFO:teuthology.orchestra.run.smithi138.stderr:listed 0 entries 2024-04-26T20:57:33.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.644+0000 7f4fd9800640 1 -- 172.21.15.138:0/27704164 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4fb4068380 msgr2=0x7f4fb406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:33.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.644+0000 7f4fd9800640 1 --2- 172.21.15.138:0/27704164 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4fb4068380 0x7f4fb406a840 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4fc40ad000 tx=0x7f4fc40a6000 comp rx=0 tx=0).stop 2024-04-26T20:57:33.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.644+0000 7f4fd9800640 1 -- 172.21.15.138:0/27704164 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4fd415eea0 msgr2=0x7f4fd415e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:33.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.644+0000 7f4fd9800640 1 --2- 172.21.15.138:0/27704164 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4fd415eea0 0x7f4fd415e050 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc00c7b0 tx=0x7f4fcc00cc70 comp rx=0 tx=0).stop 2024-04-26T20:57:33.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.644+0000 7f4fd9800640 1 -- 172.21.15.138:0/27704164 shutdown_connections 2024-04-26T20:57:33.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.644+0000 7f4fd9800640 1 --2- 172.21.15.138:0/27704164 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4fb4068380 0x7f4fb406a840 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:33.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.644+0000 7f4fd9800640 1 --2- 172.21.15.138:0/27704164 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4fd415eea0 0x7f4fd415e050 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:33.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.644+0000 7f4fd9800640 1 --2- 172.21.15.138:0/27704164 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4fd40d0fc0 0x7f4fd40c86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:33.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.644+0000 7f4fd9800640 1 --2- 172.21.15.138:0/27704164 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4fd40b8890 0x7f4fd414ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:33.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.644+0000 7f4fd9800640 1 -- 172.21.15.138:0/27704164 >> 172.21.15.138:0/27704164 conn(0x7f4fd40d2cf0 msgr2=0x7f4fd40b5030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:33.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.644+0000 7f4fd9800640 1 -- 172.21.15.138:0/27704164 shutdown_connections 2024-04-26T20:57:33.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.644+0000 7f4fd9800640 1 -- 172.21.15.138:0/27704164 wait complete. 2024-04-26T20:57:33.668 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-04-26T20:57:33.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:57:33.668 DEBUG:teuthology.orchestra.run.smithi138:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-04-26T20:57:33.692 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi138.front.sepia.ceph.com 2024-04-26T20:57:33.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:57:33.692 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-04-26T20:57:33.748 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T20:57:33.748 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T20:57:33.758 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T20:57:33.758 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T20:57:33.813 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T20:57:33.814 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T20:57:33.865 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:57:34.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.996+0000 7ff6d6c00640 1 Processor -- start 2024-04-26T20:57:34.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.996+0000 7ff6d6c00640 1 -- start start 2024-04-26T20:57:34.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.996+0000 7ff6d6c00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff6d015cf80 0x7ff6d0073b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:34.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.996+0000 7ff6d6c00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6d00727f0 con 0x7ff6d00cbe00 2024-04-26T20:57:34.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.996+0000 7ff6d6c00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6d0072a70 con 0x7ff6d00cc1e0 2024-04-26T20:57:34.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.996+0000 7ff6d6c00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7ff6d0073680 con 0x7ff6d015cf80 2024-04-26T20:57:34.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.996+0000 7ff6cfe00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7ff6d00cbe00 0x7ff6d006de70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:35494/0 (socket says 172.21.15.138:35494) 2024-04-26T20:57:34.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.996+0000 7ff6cfe00640 1 -- 172.21.15.138:0/3851155521 learned_addr learned my addr 172.21.15.138:0/3851155521 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:34.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.996+0000 7ff6c7400640 1 --2- 172.21.15.138:0/3851155521 >> v2:172.21.15.138:3300/0 conn(0x7ff6d015cf80 0x7ff6d0073b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:34.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.996+0000 7ff6c7400640 1 -- 172.21.15.138:0/3851155521 >> v1:172.21.15.143:6789/0 conn(0x7ff6d00cc1e0 legacy=0x7ff6d00ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:34.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.996+0000 7ff6c7400640 1 -- 172.21.15.138:0/3851155521 >> v1:172.21.15.138:6789/0 conn(0x7ff6d00cbe00 legacy=0x7ff6d006de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:34.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.000+0000 7ff6c7400640 1 -- 172.21.15.138:0/3851155521 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6d0072d50 con 0x7ff6d015cf80 2024-04-26T20:57:34.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:33.996+0000 7ff6cf400640 1 -- 172.21.15.138:0/3851155521 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 216190906 0 0) 0x7ff6c0001120 con 0x7ff6d00cbe00 2024-04-26T20:57:34.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.000+0000 7ff6c7400640 1 --2- 172.21.15.138:0/3851155521 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6d015cf80 0x7ff6d0073b10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff6b80097c0 tx=0x7ff6b801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1d77dce0dae8157 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:34.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.000+0000 7ff6cf400640 1 -- 172.21.15.138:0/3851155521 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b80b1070 con 0x7ff6d015cf80 2024-04-26T20:57:34.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.000+0000 7ff6cf400640 1 -- 172.21.15.138:0/3851155521 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6b80ac410 con 0x7ff6d015cf80 2024-04-26T20:57:34.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.000+0000 7ff6cf400640 1 -- 172.21.15.138:0/3851155521 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b80ac7e0 con 0x7ff6d015cf80 2024-04-26T20:57:34.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.000+0000 7ff6d6c00640 1 -- 172.21.15.138:0/3851155521 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6d015cf80 msgr2=0x7ff6d0073b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:34.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.000+0000 7ff6d6c00640 1 --2- 172.21.15.138:0/3851155521 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6d015cf80 0x7ff6d0073b10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff6b80097c0 tx=0x7ff6b801c4a0 comp rx=0 tx=0).stop 2024-04-26T20:57:34.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.000+0000 7ff6d6c00640 1 -- 172.21.15.138:0/3851155521 shutdown_connections 2024-04-26T20:57:34.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.000+0000 7ff6d6c00640 1 --2- 172.21.15.138:0/3851155521 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6d015cf80 0x7ff6d0073b10 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:34.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.000+0000 7ff6d6c00640 1 -- 172.21.15.138:0/3851155521 >> 172.21.15.138:0/3851155521 conn(0x7ff6d00d0b20 msgr2=0x7ff6d00d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:34.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.000+0000 7ff6d6c00640 1 -- 172.21.15.138:0/3851155521 shutdown_connections 2024-04-26T20:57:34.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.000+0000 7ff6d6c00640 1 -- 172.21.15.138:0/3851155521 wait complete. 2024-04-26T20:57:34.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.004+0000 7ff6d6c00640 1 Processor -- start 2024-04-26T20:57:34.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.004+0000 7ff6d6c00640 1 -- start start 2024-04-26T20:57:34.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.004+0000 7ff6d6c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff6d00cbe00 0x7ff6d00cb340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:34.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.004+0000 7ff6d6c00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6d00cc1e0 0x7ff6d01556c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:34.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.004+0000 7ff6d6c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6d015cf80 0x7ff6d015b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:34.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.004+0000 7ff6d6c00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d00d0900 con 0x7ff6d00cc1e0 2024-04-26T20:57:34.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.004+0000 7ff6d6c00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d00d0780 con 0x7ff6d015cf80 2024-04-26T20:57:34.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.004+0000 7ff6d6c00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ff6d016a5f0 con 0x7ff6d00cbe00 2024-04-26T20:57:34.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.004+0000 7ff6c7400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6d00cc1e0 0x7ff6d01556c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:34.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.004+0000 7ff6c7400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6d00cc1e0 0x7ff6d01556c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:45020/0 (socket says 172.21.15.138:45020) 2024-04-26T20:57:34.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.004+0000 7ff6c7400640 1 -- 172.21.15.138:0/2627539612 learned_addr learned my addr 172.21.15.138:0/2627539612 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:34.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.004+0000 7ff6cfe00640 1 --2- 172.21.15.138:0/2627539612 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff6d00cbe00 0x7ff6d00cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:34.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.004+0000 7ff6d4c00640 1 --2- 172.21.15.138:0/2627539612 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6d015cf80 0x7ff6d015b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:34.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.004+0000 7ff6c7400640 1 -- 172.21.15.138:0/2627539612 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff6d00cbe00 msgr2=0x7ff6d00cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:34.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.004+0000 7ff6c7400640 1 --2- 172.21.15.138:0/2627539612 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff6d00cbe00 0x7ff6d00cb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:34.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.004+0000 7ff6c7400640 1 -- 172.21.15.138:0/2627539612 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6d015cf80 msgr2=0x7ff6d015b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:34.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.004+0000 7ff6c7400640 1 --2- 172.21.15.138:0/2627539612 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6d015cf80 0x7ff6d015b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:34.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.004+0000 7ff6c7400640 1 -- 172.21.15.138:0/2627539612 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6d014b6e0 con 0x7ff6d00cc1e0 2024-04-26T20:57:34.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.004+0000 7ff6cfe00640 1 --2- 172.21.15.138:0/2627539612 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff6d00cbe00 0x7ff6d00cb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:34.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.004+0000 7ff6d4c00640 1 --2- 172.21.15.138:0/2627539612 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6d015cf80 0x7ff6d015b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:34.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.004+0000 7ff6c7400640 1 --2- 172.21.15.138:0/2627539612 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6d00cc1e0 0x7ff6d01556c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff6b80190b0 tx=0x7ff6b8019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:34.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.004+0000 7ff6ccc00640 1 -- 172.21.15.138:0/2627539612 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b80b1040 con 0x7ff6d00cc1e0 2024-04-26T20:57:34.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.004+0000 7ff6ccc00640 1 -- 172.21.15.138:0/2627539612 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6b80be070 con 0x7ff6d00cc1e0 2024-04-26T20:57:34.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.004+0000 7ff6d6c00640 1 -- 172.21.15.138:0/2627539612 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6d014b9c0 con 0x7ff6d00cc1e0 2024-04-26T20:57:34.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.004+0000 7ff6ccc00640 1 -- 172.21.15.138:0/2627539612 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b80b6680 con 0x7ff6d00cc1e0 2024-04-26T20:57:34.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.004+0000 7ff6d6c00640 1 -- 172.21.15.138:0/2627539612 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6d014bf80 con 0x7ff6d00cc1e0 2024-04-26T20:57:34.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.008+0000 7ff6d6c00640 1 -- 172.21.15.138:0/2627539612 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6d0069510 con 0x7ff6d00cc1e0 2024-04-26T20:57:34.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.008+0000 7ff6ccc00640 1 -- 172.21.15.138:0/2627539612 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff6b80b4070 con 0x7ff6d00cc1e0 2024-04-26T20:57:34.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.008+0000 7ff6ccc00640 1 --2- 172.21.15.138:0/2627539612 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff6ac068380 0x7ff6ac06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:34.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.008+0000 7ff6ccc00640 1 -- 172.21.15.138:0/2627539612 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7ff6b8120cc0 con 0x7ff6d00cc1e0 2024-04-26T20:57:34.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.008+0000 7ff6cfe00640 1 --2- 172.21.15.138:0/2627539612 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff6ac068380 0x7ff6ac06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:34.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.008+0000 7ff6cfe00640 1 --2- 172.21.15.138:0/2627539612 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff6ac068380 0x7ff6ac06a840 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0007fd0 tx=0x7ff6c0007a20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:34.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.012+0000 7ff6ccc00640 1 -- 172.21.15.138:0/2627539612 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff6b8016090 con 0x7ff6d00cc1e0 2024-04-26T20:57:34.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.168+0000 7ff6d6c00640 1 -- 172.21.15.138:0/2627539612 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff6d015cb30 con 0x7ff6d00cc1e0 2024-04-26T20:57:34.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.172+0000 7ff6ccc00640 1 -- 172.21.15.138:0/2627539612 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18719 (secure 0 0 0) 0x7ff6b80f0e50 con 0x7ff6d00cc1e0 2024-04-26T20:57:34.176 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:57:34.176 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":29,"fsid":"c22b4730-12cc-4558-8535-b965384398c0","created":"2024-04-26T20:56:14.182475+0000","modified":"2024-04-26T20:57:20.395184+0000","last_up_change":"2024-04-26T20:56:26.013243+0000","last_in_change":"2024-04-26T20:56:16.714055+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:56:27.265834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:56:37.394398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:56:38.544369+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:56:42.240243+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3f9a2e34-3199-466f-a6cf-57927318121e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6801","nonce":3534772245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6803","nonce":3534772245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6807","nonce":3534772245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6805","nonce":3534772245}]},"public_addr":"172.21.15.138:6801/3534772245","cluster_addr":"172.21.15.138:6803/3534772245","heartbeat_back_addr":"172.21.15.138:6807/3534772245","heartbeat_front_addr":"172.21.15.138:6805/3534772245","state":["exists","up"]},{"osd":1,"uuid":"e881fcf6-3248-4696-a2ef-95d206d77712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6817","nonce":1427635773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6819","nonce":1427635773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6823","nonce":1427635773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6821","nonce":1427635773}]},"public_addr":"172.21.15.138:6817/1427635773","cluster_addr":"172.21.15.138:6819/1427635773","heartbeat_back_addr":"172.21.15.138:6823/1427635773","heartbeat_front_addr":"172.21.15.138:6821/1427635773","state":["exists","up"]},{"osd":2,"uuid":"f7d1db33-7672-4699-ae47-9f1e0a8e4222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6809","nonce":4273721573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6811","nonce":4273721573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6815","nonce":4273721573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6813","nonce":4273721573}]},"public_addr":"172.21.15.138:6809/4273721573","cluster_addr":"172.21.15.138:6811/4273721573","heartbeat_back_addr":"172.21.15.138:6815/4273721573","heartbeat_front_addr":"172.21.15.138:6813/4273721573","state":["exists","up"]},{"osd":3,"uuid":"2f4e0a9a-b8f6-4468-844a-a4501cd85054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6825","nonce":3098242154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6827","nonce":3098242154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6831","nonce":3098242154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6829","nonce":3098242154}]},"public_addr":"172.21.15.138:6825/3098242154","cluster_addr":"172.21.15.138:6827/3098242154","heartbeat_back_addr":"172.21.15.138:6831/3098242154","heartbeat_front_addr":"172.21.15.138:6829/3098242154","state":["exists","up"]},{"osd":4,"uuid":"c85df99b-3624-410e-866b-86830af2cfe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6801","nonce":2942056312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6803","nonce":2942056312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6807","nonce":2942056312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6805","nonce":2942056312}]},"public_addr":"172.21.15.143:6801/2942056312","cluster_addr":"172.21.15.143:6803/2942056312","heartbeat_back_addr":"172.21.15.143:6807/2942056312","heartbeat_front_addr":"172.21.15.143:6805/2942056312","state":["exists","up"]},{"osd":5,"uuid":"9af1efb5-c416-4808-b5ef-de0679ab9705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6809","nonce":1910222887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6811","nonce":1910222887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6815","nonce":1910222887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6813","nonce":1910222887}]},"public_addr":"172.21.15.143:6809/1910222887","cluster_addr":"172.21.15.143:6811/1910222887","heartbeat_back_addr":"172.21.15.143:6815/1910222887","heartbeat_front_addr":"172.21.15.143:6813/1910222887","state":["exists","up"]},{"osd":6,"uuid":"d7138615-8838-45ff-9072-2fd0683362f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6817","nonce":1082239825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6819","nonce":1082239825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6823","nonce":1082239825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6821","nonce":1082239825}]},"public_addr":"172.21.15.143:6817/1082239825","cluster_addr":"172.21.15.143:6819/1082239825","heartbeat_back_addr":"172.21.15.143:6823/1082239825","heartbeat_front_addr":"172.21.15.143:6821/1082239825","state":["exists","up"]},{"osd":7,"uuid":"0c27172b-35c4-49ec-ba0b-0137b8ff0010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6825","nonce":3295508495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6827","nonce":3295508495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6831","nonce":3295508495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6829","nonce":3295508495}]},"public_addr":"172.21.15.143:6825/3295508495","cluster_addr":"172.21.15.143:6827/3295508495","heartbeat_back_addr":"172.21.15.143:6831/3295508495","heartbeat_front_addr":"172.21.15.143:6829/3295508495","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.326627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.396119+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.433915+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.414179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.216947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.329272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.503073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.436382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.39","mappings":[{"from":0,"to":7}]},{"pgid":"4.6","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:57:34.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.172+0000 7ff6d6c00640 1 -- 172.21.15.138:0/2627539612 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff6ac068380 msgr2=0x7ff6ac06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:34.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.172+0000 7ff6d6c00640 1 --2- 172.21.15.138:0/2627539612 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff6ac068380 0x7ff6ac06a840 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0007fd0 tx=0x7ff6c0007a20 comp rx=0 tx=0).stop 2024-04-26T20:57:34.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.172+0000 7ff6d6c00640 1 -- 172.21.15.138:0/2627539612 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6d00cc1e0 msgr2=0x7ff6d01556c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:34.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.172+0000 7ff6d6c00640 1 --2- 172.21.15.138:0/2627539612 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6d00cc1e0 0x7ff6d01556c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff6b80190b0 tx=0x7ff6b8019240 comp rx=0 tx=0).stop 2024-04-26T20:57:34.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.172+0000 7ff6d6c00640 1 -- 172.21.15.138:0/2627539612 shutdown_connections 2024-04-26T20:57:34.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.172+0000 7ff6d6c00640 1 --2- 172.21.15.138:0/2627539612 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff6ac068380 0x7ff6ac06a840 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:34.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.172+0000 7ff6d6c00640 1 --2- 172.21.15.138:0/2627539612 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6d015cf80 0x7ff6d015b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:34.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.172+0000 7ff6d6c00640 1 --2- 172.21.15.138:0/2627539612 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6d00cc1e0 0x7ff6d01556c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:34.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.172+0000 7ff6d6c00640 1 --2- 172.21.15.138:0/2627539612 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff6d00cbe00 0x7ff6d00cb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:34.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.172+0000 7ff6d6c00640 1 -- 172.21.15.138:0/2627539612 >> 172.21.15.138:0/2627539612 conn(0x7ff6d00d0b20 msgr2=0x7ff6d015bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:34.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.172+0000 7ff6d6c00640 1 -- 172.21.15.138:0/2627539612 shutdown_connections 2024-04-26T20:57:34.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.172+0000 7ff6d6c00640 1 -- 172.21.15.138:0/2627539612 wait complete. 2024-04-26T20:57:34.197 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:56:27.265834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T20:56:37.394398+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T20:56:38.544369+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T20:56:42.240243+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T20:57:34.197 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T20:57:34.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.332+0000 7f413f800640 1 Processor -- start 2024-04-26T20:57:34.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.332+0000 7f413f800640 1 -- start start 2024-04-26T20:57:34.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.332+0000 7f413f800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f413815aa60 0x7f41380cc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:34.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.332+0000 7f413f800640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f41380cb910 0x7f41380b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:34.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.332+0000 7f413f800640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41380cd210 con 0x7f41380ccd20 2024-04-26T20:57:34.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.332+0000 7f413f800640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f413815d6a0 con 0x7f413815aa60 2024-04-26T20:57:34.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.332+0000 7f413f800640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f413815d980 con 0x7f41380cb910 2024-04-26T20:57:34.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.332+0000 7f413ce00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f413815aa60 0x7f41380cc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:34.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.332+0000 7f412fe00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f41380ccd20 0x7f41380cb200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:35504/0 (socket says 172.21.15.138:35504) 2024-04-26T20:57:34.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.332+0000 7f412fe00640 1 -- 172.21.15.138:0/1042349027 learned_addr learned my addr 172.21.15.138:0/1042349027 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:34.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.332+0000 7f413d800640 1 --2- 172.21.15.138:0/1042349027 >> v2:172.21.15.143:3300/0 conn(0x7f41380cb910 0x7f41380b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:34.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.332+0000 7f413ce00640 1 -- 172.21.15.138:0/1042349027 >> v2:172.21.15.143:3300/0 conn(0x7f41380cb910 msgr2=0x7f41380b5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:34.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.332+0000 7f413ce00640 1 --2- 172.21.15.138:0/1042349027 >> v2:172.21.15.143:3300/0 conn(0x7f41380cb910 0x7f41380b5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:34.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.332+0000 7f413ce00640 1 -- 172.21.15.138:0/1042349027 >> v1:172.21.15.138:6789/0 conn(0x7f41380ccd20 legacy=0x7f41380cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:34.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.332+0000 7f413ce00640 1 -- 172.21.15.138:0/1042349027 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f413815dc60 con 0x7f413815aa60 2024-04-26T20:57:34.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.332+0000 7f4137e00640 1 -- 172.21.15.138:0/1042349027 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2015993486 0 0) 0x7f41380cd210 con 0x7f41380ccd20 2024-04-26T20:57:34.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.336+0000 7f413ce00640 1 --2- 172.21.15.138:0/1042349027 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f413815aa60 0x7f41380cc7e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4138071bd0 tx=0x7f412801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ddf78039d032ddd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:34.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.336+0000 7f4137e00640 1 -- 172.21.15.138:0/1042349027 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41280b0070 con 0x7f413815aa60 2024-04-26T20:57:34.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.336+0000 7f4137e00640 1 -- 172.21.15.138:0/1042349027 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41280ab600 con 0x7f413815aa60 2024-04-26T20:57:34.341 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.336+0000 7f4137e00640 1 -- 172.21.15.138:0/1042349027 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41280ab9d0 con 0x7f413815aa60 2024-04-26T20:57:34.341 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.336+0000 7f413f800640 1 -- 172.21.15.138:0/1042349027 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f413815aa60 msgr2=0x7f41380cc7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:34.341 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.336+0000 7f413f800640 1 --2- 172.21.15.138:0/1042349027 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f413815aa60 0x7f41380cc7e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4138071bd0 tx=0x7f412801c480 comp rx=0 tx=0).stop 2024-04-26T20:57:34.341 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.336+0000 7f413f800640 1 -- 172.21.15.138:0/1042349027 shutdown_connections 2024-04-26T20:57:34.341 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.336+0000 7f413f800640 1 --2- 172.21.15.138:0/1042349027 >> v2:172.21.15.143:3300/0 conn(0x7f41380cb910 0x7f41380b5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:34.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.336+0000 7f413f800640 1 --2- 172.21.15.138:0/1042349027 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f413815aa60 0x7f41380cc7e0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:34.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.336+0000 7f413f800640 1 -- 172.21.15.138:0/1042349027 >> 172.21.15.138:0/1042349027 conn(0x7f41380d0bb0 msgr2=0x7f41380d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:34.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.336+0000 7f413f800640 1 -- 172.21.15.138:0/1042349027 shutdown_connections 2024-04-26T20:57:34.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.336+0000 7f413f800640 1 -- 172.21.15.138:0/1042349027 wait complete. 2024-04-26T20:57:34.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.336+0000 7f413f800640 1 Processor -- start 2024-04-26T20:57:34.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.336+0000 7f413f800640 1 -- start start 2024-04-26T20:57:34.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.340+0000 7f413f800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f41380cb910 0x7f41380d0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:34.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.340+0000 7f413f800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f41380ccd20 0x7f413815e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:34.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.340+0000 7f413f800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f413815aa60 0x7f4138153020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:34.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.340+0000 7f413f800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f413806e0f0 con 0x7f41380cb910 2024-04-26T20:57:34.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.340+0000 7f413f800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f4138072240 con 0x7f41380ccd20 2024-04-26T20:57:34.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.340+0000 7f413f800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f413806e270 con 0x7f413815aa60 2024-04-26T20:57:34.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.340+0000 7f413ce00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f41380cb910 0x7f41380d0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:34.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.340+0000 7f413ce00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f41380cb910 0x7f41380d0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:45050/0 (socket says 172.21.15.138:45050) 2024-04-26T20:57:34.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.340+0000 7f413ce00640 1 -- 172.21.15.138:0/111528619 learned_addr learned my addr 172.21.15.138:0/111528619 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:34.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.340+0000 7f413d800640 1 --2- 172.21.15.138:0/111528619 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f413815aa60 0x7f4138153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:34.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.340+0000 7f412fe00640 1 --2- 172.21.15.138:0/111528619 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f41380ccd20 0x7f413815e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:34.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.340+0000 7f413ce00640 1 -- 172.21.15.138:0/111528619 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f413815aa60 msgr2=0x7f4138153020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:34.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.340+0000 7f413ce00640 1 --2- 172.21.15.138:0/111528619 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f413815aa60 0x7f4138153020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:34.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.340+0000 7f413ce00640 1 -- 172.21.15.138:0/111528619 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f41380ccd20 msgr2=0x7f413815e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:34.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.340+0000 7f413ce00640 1 --2- 172.21.15.138:0/111528619 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f41380ccd20 0x7f413815e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:34.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.340+0000 7f413ce00640 1 -- 172.21.15.138:0/111528619 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f413815ead0 con 0x7f41380cb910 2024-04-26T20:57:34.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.340+0000 7f413ce00640 1 --2- 172.21.15.138:0/111528619 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f41380cb910 0x7f41380d0420 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f41280ae040 tx=0x7f412801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:34.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.340+0000 7f4135600640 1 -- 172.21.15.138:0/111528619 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41280b0040 con 0x7f41380cb910 2024-04-26T20:57:34.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.340+0000 7f4135600640 1 -- 172.21.15.138:0/111528619 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4128004030 con 0x7f41380cb910 2024-04-26T20:57:34.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.340+0000 7f4135600640 1 -- 172.21.15.138:0/111528619 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41280043e0 con 0x7f41380cb910 2024-04-26T20:57:34.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.340+0000 7f413f800640 1 -- 172.21.15.138:0/111528619 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f413815be80 con 0x7f41380cb910 2024-04-26T20:57:34.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.340+0000 7f413f800640 1 -- 172.21.15.138:0/111528619 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f413815c440 con 0x7f41380cb910 2024-04-26T20:57:34.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.340+0000 7f413f800640 1 -- 172.21.15.138:0/111528619 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4138069430 con 0x7f41380cb910 2024-04-26T20:57:34.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.340+0000 7f4135600640 1 -- 172.21.15.138:0/111528619 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4128003620 con 0x7f41380cb910 2024-04-26T20:57:34.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.344+0000 7f4135600640 1 --2- 172.21.15.138:0/111528619 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f41140683b0 0x7f411406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:34.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.344+0000 7f4135600640 1 -- 172.21.15.138:0/111528619 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7f4128121320 con 0x7f41380cb910 2024-04-26T20:57:34.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.344+0000 7f412fe00640 1 --2- 172.21.15.138:0/111528619 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f41140683b0 0x7f411406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:34.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.344+0000 7f412fe00640 1 --2- 172.21.15.138:0/111528619 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f41140683b0 0x7f411406a870 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4138153cb0 tx=0x7f4120007d60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:34.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.348+0000 7f4135600640 1 -- 172.21.15.138:0/111528619 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4128016070 con 0x7f41380cb910 2024-04-26T20:57:34.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.504+0000 7f413f800640 1 -- 172.21.15.138:0/111528619 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f413806fbd0 con 0x7f41380cb910 2024-04-26T20:57:34.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.504+0000 7f4135600640 1 -- 172.21.15.138:0/111528619 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f41280f1010 con 0x7f41380cb910 2024-04-26T20:57:34.511 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 1 2024-04-26T20:57:34.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.508+0000 7f413f800640 1 -- 172.21.15.138:0/111528619 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f41140683b0 msgr2=0x7f411406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:34.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.508+0000 7f413f800640 1 --2- 172.21.15.138:0/111528619 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f41140683b0 0x7f411406a870 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4138153cb0 tx=0x7f4120007d60 comp rx=0 tx=0).stop 2024-04-26T20:57:34.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.508+0000 7f413f800640 1 -- 172.21.15.138:0/111528619 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f41380cb910 msgr2=0x7f41380d0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:34.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.508+0000 7f413f800640 1 --2- 172.21.15.138:0/111528619 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f41380cb910 0x7f41380d0420 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f41280ae040 tx=0x7f412801acc0 comp rx=0 tx=0).stop 2024-04-26T20:57:34.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.508+0000 7f413f800640 1 -- 172.21.15.138:0/111528619 shutdown_connections 2024-04-26T20:57:34.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.508+0000 7f413f800640 1 --2- 172.21.15.138:0/111528619 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f41140683b0 0x7f411406a870 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:34.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.508+0000 7f413f800640 1 --2- 172.21.15.138:0/111528619 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f413815aa60 0x7f4138153020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:34.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.508+0000 7f413f800640 1 --2- 172.21.15.138:0/111528619 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f41380ccd20 0x7f413815e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:34.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.508+0000 7f413f800640 1 --2- 172.21.15.138:0/111528619 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f41380cb910 0x7f41380d0420 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:34.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.508+0000 7f413f800640 1 -- 172.21.15.138:0/111528619 >> 172.21.15.138:0/111528619 conn(0x7f41380d0bb0 msgr2=0x7f4138156030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:34.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.508+0000 7f413f800640 1 -- 172.21.15.138:0/111528619 shutdown_connections 2024-04-26T20:57:34.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.508+0000 7f413f800640 1 -- 172.21.15.138:0/111528619 wait complete. 2024-04-26T20:57:34.531 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T20:57:34.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.664+0000 7fd375800640 1 Processor -- start 2024-04-26T20:57:34.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.664+0000 7fd375800640 1 -- start start 2024-04-26T20:57:34.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.664+0000 7fd375800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd3700cd6d0 0x7fd37006c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:34.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.664+0000 7fd375800640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3700cbab0 con 0x7fd37015efe0 2024-04-26T20:57:34.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.664+0000 7fd375800640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd370163940 con 0x7fd3700cf950 2024-04-26T20:57:34.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.664+0000 7fd375800640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fd3700cbd30 con 0x7fd3700cd6d0 2024-04-26T20:57:34.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.664+0000 7fd36f400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd3700cd6d0 0x7fd37006c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:34.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.664+0000 7fd36ea00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fd37015efe0 0x7fd3700cf240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:35508/0 (socket says 172.21.15.138:35508) 2024-04-26T20:57:34.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.664+0000 7fd36ea00640 1 -- 172.21.15.138:0/1174436013 learned_addr learned my addr 172.21.15.138:0/1174436013 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:34.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.668+0000 7fd36f400640 1 -- 172.21.15.138:0/1174436013 >> v1:172.21.15.143:6789/0 conn(0x7fd3700cf950 legacy=0x7fd3700cc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:34.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.668+0000 7fd36f400640 1 -- 172.21.15.138:0/1174436013 >> v1:172.21.15.138:6789/0 conn(0x7fd37015efe0 legacy=0x7fd3700cf240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:34.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.668+0000 7fd36e000640 1 -- 172.21.15.138:0/1174436013 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1403458331 0 0) 0x7fd360001120 con 0x7fd37015efe0 2024-04-26T20:57:34.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.668+0000 7fd36f400640 1 -- 172.21.15.138:0/1174436013 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3700cc010 con 0x7fd3700cd6d0 2024-04-26T20:57:34.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.668+0000 7fd36f400640 1 --2- 172.21.15.138:0/1174436013 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd3700cd6d0 0x7fd37006c300 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd368009d90 tx=0x7fd36801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa923958219f5797 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:34.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.668+0000 7fd36e000640 1 -- 172.21.15.138:0/1174436013 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3680b2070 con 0x7fd3700cd6d0 2024-04-26T20:57:34.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.668+0000 7fd36e000640 1 -- 172.21.15.138:0/1174436013 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3680a5a50 con 0x7fd3700cd6d0 2024-04-26T20:57:34.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.668+0000 7fd36e000640 1 -- 172.21.15.138:0/1174436013 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3680a5e20 con 0x7fd3700cd6d0 2024-04-26T20:57:34.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.668+0000 7fd375800640 1 -- 172.21.15.138:0/1174436013 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd3700cd6d0 msgr2=0x7fd37006c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:34.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.668+0000 7fd375800640 1 --2- 172.21.15.138:0/1174436013 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd3700cd6d0 0x7fd37006c300 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd368009d90 tx=0x7fd36801c970 comp rx=0 tx=0).stop 2024-04-26T20:57:34.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.672+0000 7fd375800640 1 -- 172.21.15.138:0/1174436013 shutdown_connections 2024-04-26T20:57:34.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.672+0000 7fd375800640 1 --2- 172.21.15.138:0/1174436013 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd3700cd6d0 0x7fd37006c300 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:34.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.672+0000 7fd375800640 1 -- 172.21.15.138:0/1174436013 >> 172.21.15.138:0/1174436013 conn(0x7fd3700cdee0 msgr2=0x7fd3700ce2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:34.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.672+0000 7fd375800640 1 -- 172.21.15.138:0/1174436013 shutdown_connections 2024-04-26T20:57:34.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.672+0000 7fd375800640 1 -- 172.21.15.138:0/1174436013 wait complete. 2024-04-26T20:57:34.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.672+0000 7fd375800640 1 Processor -- start 2024-04-26T20:57:34.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.672+0000 7fd375800640 1 -- start start 2024-04-26T20:57:34.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.672+0000 7fd375800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd3700cd6d0 0x7fd3700b5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:34.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.672+0000 7fd375800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd3700cf950 0x7fd3700c6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:34.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.672+0000 7fd375800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd37015efe0 0x7fd3700c6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:34.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.672+0000 7fd375800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd3700cd330 con 0x7fd37015efe0 2024-04-26T20:57:34.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.672+0000 7fd375800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fd37015f3c0 con 0x7fd3700cd6d0 2024-04-26T20:57:34.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.672+0000 7fd375800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fd3700aea50 con 0x7fd3700cf950 2024-04-26T20:57:34.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.672+0000 7fd36f400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd37015efe0 0x7fd3700c6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:34.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.672+0000 7fd36f400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd37015efe0 0x7fd3700c6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:45070/0 (socket says 172.21.15.138:45070) 2024-04-26T20:57:34.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.672+0000 7fd36f400640 1 -- 172.21.15.138:0/954045402 learned_addr learned my addr 172.21.15.138:0/954045402 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:34.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.672+0000 7fd36ea00640 1 --2- 172.21.15.138:0/954045402 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd3700cd6d0 0x7fd3700b5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:34.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.672+0000 7fd366000640 1 --2- 172.21.15.138:0/954045402 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd3700cf950 0x7fd3700c6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:34.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.672+0000 7fd36f400640 1 -- 172.21.15.138:0/954045402 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd3700cf950 msgr2=0x7fd3700c6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:34.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.672+0000 7fd36f400640 1 --2- 172.21.15.138:0/954045402 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd3700cf950 0x7fd3700c6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:34.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.672+0000 7fd36f400640 1 -- 172.21.15.138:0/954045402 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd3700cd6d0 msgr2=0x7fd3700b5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:34.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.672+0000 7fd36f400640 1 --2- 172.21.15.138:0/954045402 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd3700cd6d0 0x7fd3700b5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:34.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.672+0000 7fd36f400640 1 -- 172.21.15.138:0/954045402 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3700b70e0 con 0x7fd37015efe0 2024-04-26T20:57:34.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.672+0000 7fd36ea00640 1 --2- 172.21.15.138:0/954045402 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd3700cd6d0 0x7fd3700b5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:34.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.672+0000 7fd36f400640 1 --2- 172.21.15.138:0/954045402 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd37015efe0 0x7fd3700c6a50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd368009d90 tx=0x7fd368019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:34.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.672+0000 7fd367400640 1 -- 172.21.15.138:0/954045402 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3680bd020 con 0x7fd37015efe0 2024-04-26T20:57:34.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.672+0000 7fd367400640 1 -- 172.21.15.138:0/954045402 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3680adc00 con 0x7fd37015efe0 2024-04-26T20:57:34.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.672+0000 7fd367400640 1 -- 172.21.15.138:0/954045402 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3680b2040 con 0x7fd37015efe0 2024-04-26T20:57:34.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.672+0000 7fd375800640 1 -- 172.21.15.138:0/954045402 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3700b6840 con 0x7fd37015efe0 2024-04-26T20:57:34.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.676+0000 7fd375800640 1 -- 172.21.15.138:0/954045402 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3700b6e00 con 0x7fd37015efe0 2024-04-26T20:57:34.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.676+0000 7fd375800640 1 -- 172.21.15.138:0/954045402 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd370069430 con 0x7fd37015efe0 2024-04-26T20:57:34.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.676+0000 7fd367400640 1 -- 172.21.15.138:0/954045402 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd3680c0020 con 0x7fd37015efe0 2024-04-26T20:57:34.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.676+0000 7fd367400640 1 --2- 172.21.15.138:0/954045402 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd34c068380 0x7fd34c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:34.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.676+0000 7fd367400640 1 -- 172.21.15.138:0/954045402 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7fd368122350 con 0x7fd37015efe0 2024-04-26T20:57:34.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.676+0000 7fd36ea00640 1 --2- 172.21.15.138:0/954045402 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd34c068380 0x7fd34c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:34.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.680+0000 7fd36ea00640 1 --2- 172.21.15.138:0/954045402 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd34c068380 0x7fd34c06a840 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd360000f70 tx=0x7fd360007df0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:34.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.680+0000 7fd367400640 1 -- 172.21.15.138:0/954045402 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd3680c7030 con 0x7fd37015efe0 2024-04-26T20:57:34.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.836+0000 7fd375800640 1 -- 172.21.15.138:0/954045402 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd370068690 con 0x7fd37015efe0 2024-04-26T20:57:34.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.836+0000 7fd367400640 1 -- 172.21.15.138:0/954045402 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7fd368016560 con 0x7fd37015efe0 2024-04-26T20:57:34.843 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 32 2024-04-26T20:57:34.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.840+0000 7fd375800640 1 -- 172.21.15.138:0/954045402 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd34c068380 msgr2=0x7fd34c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:34.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.840+0000 7fd375800640 1 --2- 172.21.15.138:0/954045402 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd34c068380 0x7fd34c06a840 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd360000f70 tx=0x7fd360007df0 comp rx=0 tx=0).stop 2024-04-26T20:57:34.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.840+0000 7fd375800640 1 -- 172.21.15.138:0/954045402 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd37015efe0 msgr2=0x7fd3700c6a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:34.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.840+0000 7fd375800640 1 --2- 172.21.15.138:0/954045402 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd37015efe0 0x7fd3700c6a50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd368009d90 tx=0x7fd368019710 comp rx=0 tx=0).stop 2024-04-26T20:57:34.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.840+0000 7fd375800640 1 -- 172.21.15.138:0/954045402 shutdown_connections 2024-04-26T20:57:34.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.840+0000 7fd375800640 1 --2- 172.21.15.138:0/954045402 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd34c068380 0x7fd34c06a840 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:34.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.840+0000 7fd375800640 1 --2- 172.21.15.138:0/954045402 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd37015efe0 0x7fd3700c6a50 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:34.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.840+0000 7fd375800640 1 --2- 172.21.15.138:0/954045402 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd3700cf950 0x7fd3700c6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:34.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.840+0000 7fd375800640 1 --2- 172.21.15.138:0/954045402 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd3700cd6d0 0x7fd3700b5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:34.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.840+0000 7fd375800640 1 -- 172.21.15.138:0/954045402 >> 172.21.15.138:0/954045402 conn(0x7fd3700cdee0 msgr2=0x7fd3700b0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:34.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.840+0000 7fd375800640 1 -- 172.21.15.138:0/954045402 shutdown_connections 2024-04-26T20:57:34.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.840+0000 7fd375800640 1 -- 172.21.15.138:0/954045402 wait complete. 2024-04-26T20:57:34.864 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T20:57:35.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.996+0000 7ff0b6400640 1 Processor -- start 2024-04-26T20:57:35.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:34.996+0000 7ff0b6400640 1 -- start start 2024-04-26T20:57:35.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.000+0000 7ff0b6400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff0b015bdc0 0x7ff0b015f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:35.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.000+0000 7ff0b6400640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0b006dee0 con 0x7ff0b0073d70 2024-04-26T20:57:35.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.000+0000 7ff0b6400640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0b015c1a0 con 0x7ff0b006f880 2024-04-26T20:57:35.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.000+0000 7ff0b6400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ff0b006e180 con 0x7ff0b015bdc0 2024-04-26T20:57:35.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.000+0000 7ff0aea00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7ff0b0073d70 0x7ff0b015fe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:35516/0 (socket says 172.21.15.138:35516) 2024-04-26T20:57:35.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.000+0000 7ff0aea00640 1 -- 172.21.15.138:0/1076894748 learned_addr learned my addr 172.21.15.138:0/1076894748 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:35.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.000+0000 7ff0af400640 1 --2- 172.21.15.138:0/1076894748 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff0b015bdc0 0x7ff0b015f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:35.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.000+0000 7ff0ae000640 1 -- 172.21.15.138:0/1076894748 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3508815908 0 0) 0x7ff0b006dee0 con 0x7ff0b0073d70 2024-04-26T20:57:35.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.000+0000 7ff0ae000640 1 -- 172.21.15.138:0/1076894748 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff094003530 con 0x7ff0b0073d70 2024-04-26T20:57:35.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.000+0000 7ff0ae000640 1 -- 172.21.15.138:0/1076894748 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1054469376 0 0) 0x7ff0b015c1a0 con 0x7ff0b006f880 2024-04-26T20:57:35.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.000+0000 7ff0ae000640 1 -- 172.21.15.138:0/1076894748 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0b006dee0 con 0x7ff0b006f880 2024-04-26T20:57:35.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.000+0000 7ff0af400640 1 -- 172.21.15.138:0/1076894748 >> v1:172.21.15.143:6789/0 conn(0x7ff0b006f880 legacy=0x7ff0b00ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:35.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.000+0000 7ff0af400640 1 -- 172.21.15.138:0/1076894748 >> v1:172.21.15.138:6789/0 conn(0x7ff0b0073d70 legacy=0x7ff0b015fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:35.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.000+0000 7ff0ae000640 1 -- 172.21.15.138:0/1076894748 <== mon.0 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2547066514 0 0) 0x7ff094003530 con 0x7ff0b0073d70 2024-04-26T20:57:35.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.000+0000 7ff0af400640 1 -- 172.21.15.138:0/1076894748 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0b006e460 con 0x7ff0b015bdc0 2024-04-26T20:57:35.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.004+0000 7ff0af400640 1 --2- 172.21.15.138:0/1076894748 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff0b015bdc0 0x7ff0b015f930 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff0980097f0 tx=0x7ff09801c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24e8d5edd0c7cd5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:35.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.004+0000 7ff0ae000640 1 -- 172.21.15.138:0/1076894748 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0980b0070 con 0x7ff0b015bdc0 2024-04-26T20:57:35.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.004+0000 7ff0ae000640 1 -- 172.21.15.138:0/1076894748 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0980ab400 con 0x7ff0b015bdc0 2024-04-26T20:57:35.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.004+0000 7ff0ae000640 1 -- 172.21.15.138:0/1076894748 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a0001680 con 0x7ff0b015bdc0 2024-04-26T20:57:35.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.004+0000 7ff0b6400640 1 -- 172.21.15.138:0/1076894748 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff0b015bdc0 msgr2=0x7ff0b015f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:35.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.004+0000 7ff0b6400640 1 --2- 172.21.15.138:0/1076894748 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff0b015bdc0 0x7ff0b015f930 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff0980097f0 tx=0x7ff09801c370 comp rx=0 tx=0).stop 2024-04-26T20:57:35.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.004+0000 7ff0b6400640 1 -- 172.21.15.138:0/1076894748 shutdown_connections 2024-04-26T20:57:35.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.004+0000 7ff0b6400640 1 --2- 172.21.15.138:0/1076894748 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff0b015bdc0 0x7ff0b015f930 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:35.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.004+0000 7ff0b6400640 1 -- 172.21.15.138:0/1076894748 >> 172.21.15.138:0/1076894748 conn(0x7ff0b00d0bb0 msgr2=0x7ff0b00d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:35.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.004+0000 7ff0b6400640 1 -- 172.21.15.138:0/1076894748 shutdown_connections 2024-04-26T20:57:35.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.004+0000 7ff0b6400640 1 -- 172.21.15.138:0/1076894748 wait complete. 2024-04-26T20:57:35.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.004+0000 7ff0b6400640 1 Processor -- start 2024-04-26T20:57:35.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.004+0000 7ff0b6400640 1 -- start start 2024-04-26T20:57:35.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.004+0000 7ff0b6400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff0b006f880 0x7ff0b0158360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:35.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.004+0000 7ff0b6400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff0b0073d70 0x7ff0b01fb420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:35.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.004+0000 7ff0b6400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff0b015bdc0 0x7ff0b01fb960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:35.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.004+0000 7ff0b6400640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b0169e60 con 0x7ff0b015bdc0 2024-04-26T20:57:35.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.004+0000 7ff0b6400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b0169ce0 con 0x7ff0b006f880 2024-04-26T20:57:35.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.004+0000 7ff0b6400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ff0b0169fe0 con 0x7ff0b0073d70 2024-04-26T20:57:35.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.004+0000 7ff0afe00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff0b015bdc0 0x7ff0b01fb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:35.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.008+0000 7ff0afe00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff0b015bdc0 0x7ff0b01fb960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:45080/0 (socket says 172.21.15.138:45080) 2024-04-26T20:57:35.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.008+0000 7ff0afe00640 1 -- 172.21.15.138:0/975396965 learned_addr learned my addr 172.21.15.138:0/975396965 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:35.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.008+0000 7ff0aea00640 1 --2- 172.21.15.138:0/975396965 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff0b0073d70 0x7ff0b01fb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:35.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.008+0000 7ff0af400640 1 --2- 172.21.15.138:0/975396965 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff0b006f880 0x7ff0b0158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:35.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.008+0000 7ff0afe00640 1 -- 172.21.15.138:0/975396965 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff0b0073d70 msgr2=0x7ff0b01fb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:35.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.008+0000 7ff0afe00640 1 --2- 172.21.15.138:0/975396965 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff0b0073d70 0x7ff0b01fb420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:35.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.008+0000 7ff0afe00640 1 -- 172.21.15.138:0/975396965 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff0b006f880 msgr2=0x7ff0b0158360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:35.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.008+0000 7ff0afe00640 1 --2- 172.21.15.138:0/975396965 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff0b006f880 0x7ff0b0158360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:35.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.008+0000 7ff0afe00640 1 -- 172.21.15.138:0/975396965 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0b01588a0 con 0x7ff0b015bdc0 2024-04-26T20:57:35.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.008+0000 7ff0af400640 1 --2- 172.21.15.138:0/975396965 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff0b006f880 0x7ff0b0158360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:35.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.008+0000 7ff0aea00640 1 --2- 172.21.15.138:0/975396965 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff0b0073d70 0x7ff0b01fb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:35.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.008+0000 7ff0afe00640 1 --2- 172.21.15.138:0/975396965 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff0b015bdc0 0x7ff0b01fb960 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff0a800c790 tx=0x7ff0a800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:35.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.008+0000 7ff0a7400640 1 -- 172.21.15.138:0/975396965 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a8003b80 con 0x7ff0b015bdc0 2024-04-26T20:57:35.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.008+0000 7ff0a7400640 1 -- 172.21.15.138:0/975396965 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0a8003d20 con 0x7ff0b015bdc0 2024-04-26T20:57:35.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.008+0000 7ff0a7400640 1 -- 172.21.15.138:0/975396965 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a800aa50 con 0x7ff0b015bdc0 2024-04-26T20:57:35.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.008+0000 7ff0b6400640 1 -- 172.21.15.138:0/975396965 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0b00c9aa0 con 0x7ff0b015bdc0 2024-04-26T20:57:35.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.008+0000 7ff0b6400640 1 -- 172.21.15.138:0/975396965 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0b00ca060 con 0x7ff0b015bdc0 2024-04-26T20:57:35.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.008+0000 7ff0b6400640 1 -- 172.21.15.138:0/975396965 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0b0069430 con 0x7ff0b015bdc0 2024-04-26T20:57:35.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.008+0000 7ff0a7400640 1 -- 172.21.15.138:0/975396965 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff0a800abf0 con 0x7ff0b015bdc0 2024-04-26T20:57:35.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.008+0000 7ff0a7400640 1 --2- 172.21.15.138:0/975396965 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff08c068380 0x7ff08c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:35.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.008+0000 7ff0a7400640 1 -- 172.21.15.138:0/975396965 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7ff0a8086c90 con 0x7ff0b015bdc0 2024-04-26T20:57:35.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.012+0000 7ff0af400640 1 --2- 172.21.15.138:0/975396965 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff08c068380 0x7ff08c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:35.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.012+0000 7ff0af400640 1 --2- 172.21.15.138:0/975396965 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff08c068380 0x7ff08c06a840 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff0980ad000 tx=0x7ff0980a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:35.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.012+0000 7ff0a7400640 1 -- 172.21.15.138:0/975396965 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff0a8056f50 con 0x7ff0b015bdc0 2024-04-26T20:57:35.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.172+0000 7ff0b6400640 1 -- 172.21.15.138:0/975396965 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff0b015c440 con 0x7ff0b015bdc0 2024-04-26T20:57:35.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.172+0000 7ff0a7400640 1 -- 172.21.15.138:0/975396965 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7ff0a8056850 con 0x7ff0b015bdc0 2024-04-26T20:57:35.176 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 64 2024-04-26T20:57:35.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.172+0000 7ff0b6400640 1 -- 172.21.15.138:0/975396965 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff08c068380 msgr2=0x7ff08c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:35.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.172+0000 7ff0b6400640 1 --2- 172.21.15.138:0/975396965 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff08c068380 0x7ff08c06a840 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff0980ad000 tx=0x7ff0980a6000 comp rx=0 tx=0).stop 2024-04-26T20:57:35.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.172+0000 7ff0b6400640 1 -- 172.21.15.138:0/975396965 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff0b015bdc0 msgr2=0x7ff0b01fb960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:35.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.172+0000 7ff0b6400640 1 --2- 172.21.15.138:0/975396965 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff0b015bdc0 0x7ff0b01fb960 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff0a800c790 tx=0x7ff0a800cc50 comp rx=0 tx=0).stop 2024-04-26T20:57:35.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.172+0000 7ff0b6400640 1 -- 172.21.15.138:0/975396965 shutdown_connections 2024-04-26T20:57:35.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.172+0000 7ff0b6400640 1 --2- 172.21.15.138:0/975396965 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff08c068380 0x7ff08c06a840 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:35.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.172+0000 7ff0b6400640 1 --2- 172.21.15.138:0/975396965 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff0b015bdc0 0x7ff0b01fb960 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:35.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.172+0000 7ff0b6400640 1 --2- 172.21.15.138:0/975396965 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff0b0073d70 0x7ff0b01fb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:35.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.172+0000 7ff0b6400640 1 --2- 172.21.15.138:0/975396965 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff0b006f880 0x7ff0b0158360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:35.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.172+0000 7ff0b6400640 1 -- 172.21.15.138:0/975396965 >> 172.21.15.138:0/975396965 conn(0x7ff0b00d0bb0 msgr2=0x7ff0b0164e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:35.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.172+0000 7ff0b6400640 1 -- 172.21.15.138:0/975396965 shutdown_connections 2024-04-26T20:57:35.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.172+0000 7ff0b6400640 1 -- 172.21.15.138:0/975396965 wait complete. 2024-04-26T20:57:35.197 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T20:57:35.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.332+0000 7f514dc00640 1 Processor -- start 2024-04-26T20:57:35.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.332+0000 7f514dc00640 1 -- start start 2024-04-26T20:57:35.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.332+0000 7f514dc00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5148073d70 0x7f5148160040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:35.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.332+0000 7f514dc00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f514806f880 0x7f51480ce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:35.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.332+0000 7f514dc00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f514806dee0 con 0x7f514815bdc0 2024-04-26T20:57:35.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.332+0000 7f514dc00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f514815c1a0 con 0x7f514806f880 2024-04-26T20:57:35.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.332+0000 7f514dc00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f514806e180 con 0x7f5148073d70 2024-04-26T20:57:35.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.332+0000 7f5147400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f514806f880 0x7f51480ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:35.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.332+0000 7f5147400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f514806f880 0x7f51480ce780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:45096/0 (socket says 172.21.15.138:45096) 2024-04-26T20:57:35.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.332+0000 7f5147400640 1 -- 172.21.15.138:0/916558155 learned_addr learned my addr 172.21.15.138:0/916558155 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:35.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.332+0000 7f5146a00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f514815bdc0 0x7f514815f930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:35518/0 (socket says 172.21.15.138:35518) 2024-04-26T20:57:35.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.332+0000 7f513fe00640 1 --2- 172.21.15.138:0/916558155 >> v2:172.21.15.143:3300/0 conn(0x7f5148073d70 0x7f5148160040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:35.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.332+0000 7f5147400640 1 -- 172.21.15.138:0/916558155 >> v2:172.21.15.143:3300/0 conn(0x7f5148073d70 msgr2=0x7f5148160040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:35.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.332+0000 7f5147400640 1 --2- 172.21.15.138:0/916558155 >> v2:172.21.15.143:3300/0 conn(0x7f5148073d70 0x7f5148160040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:35.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.332+0000 7f5147400640 1 -- 172.21.15.138:0/916558155 >> v1:172.21.15.138:6789/0 conn(0x7f514815bdc0 legacy=0x7f514815f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:35.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.332+0000 7f5147400640 1 -- 172.21.15.138:0/916558155 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f514806e460 con 0x7f514806f880 2024-04-26T20:57:35.341 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.336+0000 7f5147400640 1 --2- 172.21.15.138:0/916558155 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f514806f880 0x7f51480ce780 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5148074b90 tx=0x7f514001c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=628d29d1b935f864 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:35.341 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.336+0000 7f5146000640 1 -- 172.21.15.138:0/916558155 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51400a5680 con 0x7f514806f880 2024-04-26T20:57:35.341 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.336+0000 7f5146000640 1 -- 172.21.15.138:0/916558155 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51400a5820 con 0x7f514806f880 2024-04-26T20:57:35.341 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.336+0000 7f5146000640 1 -- 172.21.15.138:0/916558155 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51400a5bf0 con 0x7f514806f880 2024-04-26T20:57:35.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.336+0000 7f514dc00640 1 -- 172.21.15.138:0/916558155 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f514806f880 msgr2=0x7f51480ce780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:35.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.336+0000 7f514dc00640 1 --2- 172.21.15.138:0/916558155 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f514806f880 0x7f51480ce780 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5148074b90 tx=0x7f514001c8d0 comp rx=0 tx=0).stop 2024-04-26T20:57:35.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.336+0000 7f514dc00640 1 -- 172.21.15.138:0/916558155 shutdown_connections 2024-04-26T20:57:35.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.336+0000 7f514dc00640 1 --2- 172.21.15.138:0/916558155 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f514806f880 0x7f51480ce780 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:35.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.336+0000 7f514dc00640 1 --2- 172.21.15.138:0/916558155 >> v2:172.21.15.143:3300/0 conn(0x7f5148073d70 0x7f5148160040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:35.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.336+0000 7f514dc00640 1 -- 172.21.15.138:0/916558155 >> 172.21.15.138:0/916558155 conn(0x7f51480d0bb0 msgr2=0x7f51480d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:35.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.336+0000 7f514dc00640 1 -- 172.21.15.138:0/916558155 shutdown_connections 2024-04-26T20:57:35.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.336+0000 7f514dc00640 1 -- 172.21.15.138:0/916558155 wait complete. 2024-04-26T20:57:35.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.340+0000 7f514dc00640 1 Processor -- start 2024-04-26T20:57:35.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.340+0000 7f514dc00640 1 -- start start 2024-04-26T20:57:35.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.340+0000 7f514dc00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f514806f880 0x7f5148166740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:35.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.340+0000 7f514dc00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5148073d70 0x7f51480c3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:35.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.340+0000 7f514dc00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f514815bdc0 0x7f51480c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:35.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.340+0000 7f514dc00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f5148168cd0 con 0x7f514806f880 2024-04-26T20:57:35.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.340+0000 7f514dc00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f5148160790 con 0x7f514815bdc0 2024-04-26T20:57:35.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.340+0000 7f514dc00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f5148168e50 con 0x7f5148073d70 2024-04-26T20:57:35.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.340+0000 7f5146a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f514806f880 0x7f5148166740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:35.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.340+0000 7f5146a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f514806f880 0x7f5148166740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:45106/0 (socket says 172.21.15.138:45106) 2024-04-26T20:57:35.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.340+0000 7f5146a00640 1 -- 172.21.15.138:0/1567712356 learned_addr learned my addr 172.21.15.138:0/1567712356 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:35.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.340+0000 7f513fe00640 1 --2- 172.21.15.138:0/1567712356 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5148073d70 0x7f51480c3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:35.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.340+0000 7f5147400640 1 --2- 172.21.15.138:0/1567712356 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f514815bdc0 0x7f51480c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:35.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.340+0000 7f5146a00640 1 -- 172.21.15.138:0/1567712356 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5148073d70 msgr2=0x7f51480c3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:35.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.340+0000 7f5146a00640 1 --2- 172.21.15.138:0/1567712356 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5148073d70 0x7f51480c3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:35.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.340+0000 7f5146a00640 1 -- 172.21.15.138:0/1567712356 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f514815bdc0 msgr2=0x7f51480c7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:35.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.340+0000 7f5146a00640 1 --2- 172.21.15.138:0/1567712356 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f514815bdc0 0x7f51480c7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:35.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.340+0000 7f5146a00640 1 -- 172.21.15.138:0/1567712356 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51480c3d70 con 0x7f514806f880 2024-04-26T20:57:35.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.340+0000 7f5147400640 1 --2- 172.21.15.138:0/1567712356 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f514815bdc0 0x7f51480c7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:35.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.340+0000 7f5146a00640 1 --2- 172.21.15.138:0/1567712356 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f514806f880 0x7f5148166740 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f513800c370 tx=0x7f513800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:35.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.340+0000 7f513ea00640 1 -- 172.21.15.138:0/1567712356 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51380074e0 con 0x7f514806f880 2024-04-26T20:57:35.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.340+0000 7f513ea00640 1 -- 172.21.15.138:0/1567712356 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5138007680 con 0x7f514806f880 2024-04-26T20:57:35.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.340+0000 7f513ea00640 1 -- 172.21.15.138:0/1567712356 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5138004a30 con 0x7f514806f880 2024-04-26T20:57:35.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.340+0000 7f514dc00640 1 -- 172.21.15.138:0/1567712356 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51481656a0 con 0x7f514806f880 2024-04-26T20:57:35.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.340+0000 7f514dc00640 1 -- 172.21.15.138:0/1567712356 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5148165c60 con 0x7f514806f880 2024-04-26T20:57:35.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.340+0000 7f514dc00640 1 -- 172.21.15.138:0/1567712356 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5148069430 con 0x7f514806f880 2024-04-26T20:57:35.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.344+0000 7f513ea00640 1 -- 172.21.15.138:0/1567712356 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f513801a020 con 0x7f514806f880 2024-04-26T20:57:35.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.344+0000 7f513ea00640 1 --2- 172.21.15.138:0/1567712356 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5124068380 0x7f512406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:35.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.344+0000 7f513ea00640 1 -- 172.21.15.138:0/1567712356 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7f5138086510 con 0x7f514806f880 2024-04-26T20:57:35.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.344+0000 7f513fe00640 1 --2- 172.21.15.138:0/1567712356 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5124068380 0x7f512406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:35.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.344+0000 7f513fe00640 1 --2- 172.21.15.138:0/1567712356 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5124068380 0x7f512406a840 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f51480ce420 tx=0x7f5130008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:35.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.348+0000 7f513ea00640 1 -- 172.21.15.138:0/1567712356 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f51380566a0 con 0x7f514806f880 2024-04-26T20:57:35.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.504+0000 7f514dc00640 1 -- 172.21.15.138:0/1567712356 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f51480b2530 con 0x7f514806f880 2024-04-26T20:57:35.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.504+0000 7f513ea00640 1 -- 172.21.15.138:0/1567712356 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7f5138055fa0 con 0x7f514806f880 2024-04-26T20:57:35.511 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 32 2024-04-26T20:57:35.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.508+0000 7f514dc00640 1 -- 172.21.15.138:0/1567712356 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5124068380 msgr2=0x7f512406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:35.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.508+0000 7f514dc00640 1 --2- 172.21.15.138:0/1567712356 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5124068380 0x7f512406a840 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f51480ce420 tx=0x7f5130008040 comp rx=0 tx=0).stop 2024-04-26T20:57:35.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.508+0000 7f514dc00640 1 -- 172.21.15.138:0/1567712356 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f514806f880 msgr2=0x7f5148166740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:35.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.508+0000 7f514dc00640 1 --2- 172.21.15.138:0/1567712356 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f514806f880 0x7f5148166740 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f513800c370 tx=0x7f513800c830 comp rx=0 tx=0).stop 2024-04-26T20:57:35.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.508+0000 7f514dc00640 1 -- 172.21.15.138:0/1567712356 shutdown_connections 2024-04-26T20:57:35.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.508+0000 7f514dc00640 1 --2- 172.21.15.138:0/1567712356 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5124068380 0x7f512406a840 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:35.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.508+0000 7f514dc00640 1 --2- 172.21.15.138:0/1567712356 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f514815bdc0 0x7f51480c7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:35.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.508+0000 7f514dc00640 1 --2- 172.21.15.138:0/1567712356 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5148073d70 0x7f51480c3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:35.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.508+0000 7f514dc00640 1 --2- 172.21.15.138:0/1567712356 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f514806f880 0x7f5148166740 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:35.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.508+0000 7f514dc00640 1 -- 172.21.15.138:0/1567712356 >> 172.21.15.138:0/1567712356 conn(0x7f51480d0bb0 msgr2=0x7f51480d0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:35.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.508+0000 7f514dc00640 1 -- 172.21.15.138:0/1567712356 shutdown_connections 2024-04-26T20:57:35.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.508+0000 7f514dc00640 1 -- 172.21.15.138:0/1567712356 wait complete. 2024-04-26T20:57:35.532 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T20:57:35.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.664+0000 7f47d0e00640 1 Processor -- start 2024-04-26T20:57:35.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.664+0000 7f47d0e00640 1 -- start start 2024-04-26T20:57:35.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.664+0000 7f47d0e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47cc15d0f0 0x7f47cc0d1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:35.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.664+0000 7f47d0e00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47cc0d0570 con 0x7f47cc0b2280 2024-04-26T20:57:35.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.664+0000 7f47d0e00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47cc0ce540 con 0x7f47cc0d0950 2024-04-26T20:57:35.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.664+0000 7f47d0e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f47cc0d0e50 con 0x7f47cc15d0f0 2024-04-26T20:57:35.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.664+0000 7f47c9400640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f47cc0b2280 0x7f47cc0cf750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:35524/0 (socket says 172.21.15.138:35524) 2024-04-26T20:57:35.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.664+0000 7f47c9400640 1 -- 172.21.15.138:0/2604594086 learned_addr learned my addr 172.21.15.138:0/2604594086 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:35.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.664+0000 7f47c9e00640 1 --2- 172.21.15.138:0/2604594086 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47cc15d0f0 0x7f47cc0d1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:35.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.664+0000 7f47c8a00640 1 -- 172.21.15.138:0/2604594086 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3216441448 0 0) 0x7f47cc0d0570 con 0x7f47cc0b2280 2024-04-26T20:57:35.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.664+0000 7f47c8a00640 1 -- 172.21.15.138:0/2604594086 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47b0003530 con 0x7f47cc0b2280 2024-04-26T20:57:35.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.664+0000 7f47c8a00640 1 -- 172.21.15.138:0/2604594086 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1558902261 0 0) 0x7f47cc0ce540 con 0x7f47cc0d0950 2024-04-26T20:57:35.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.664+0000 7f47c8a00640 1 -- 172.21.15.138:0/2604594086 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47cc0d0570 con 0x7f47cc0d0950 2024-04-26T20:57:35.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.664+0000 7f47c9e00640 1 -- 172.21.15.138:0/2604594086 >> v1:172.21.15.143:6789/0 conn(0x7f47cc0d0950 legacy=0x7f47cc0cfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:35.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.664+0000 7f47c9e00640 1 -- 172.21.15.138:0/2604594086 >> v1:172.21.15.138:6789/0 conn(0x7f47cc0b2280 legacy=0x7f47cc0cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:35.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.664+0000 7f47c8a00640 1 -- 172.21.15.138:0/2604594086 <== mon.0 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 146105815 0 0) 0x7f47b0003530 con 0x7f47cc0b2280 2024-04-26T20:57:35.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.664+0000 7f47c9e00640 1 -- 172.21.15.138:0/2604594086 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47cc0ce820 con 0x7f47cc15d0f0 2024-04-26T20:57:35.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.668+0000 7f47c9e00640 1 --2- 172.21.15.138:0/2604594086 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47cc15d0f0 0x7f47cc0d1010 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f47bc0097f0 tx=0x7f47bc01c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c791c7034923611 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:35.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.668+0000 7f47c8a00640 1 -- 172.21.15.138:0/2604594086 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47bc0b0070 con 0x7f47cc15d0f0 2024-04-26T20:57:35.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.668+0000 7f47c8a00640 1 -- 172.21.15.138:0/2604594086 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47bc0ab600 con 0x7f47cc15d0f0 2024-04-26T20:57:35.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.668+0000 7f47c8a00640 1 -- 172.21.15.138:0/2604594086 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47bc0ab9b0 con 0x7f47cc15d0f0 2024-04-26T20:57:35.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.668+0000 7f47d0e00640 1 -- 172.21.15.138:0/2604594086 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47cc15d0f0 msgr2=0x7f47cc0d1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:35.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.668+0000 7f47d0e00640 1 --2- 172.21.15.138:0/2604594086 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47cc15d0f0 0x7f47cc0d1010 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f47bc0097f0 tx=0x7f47bc01c4e0 comp rx=0 tx=0).stop 2024-04-26T20:57:35.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.668+0000 7f47d0e00640 1 -- 172.21.15.138:0/2604594086 shutdown_connections 2024-04-26T20:57:35.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.668+0000 7f47d0e00640 1 --2- 172.21.15.138:0/2604594086 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47cc15d0f0 0x7f47cc0d1010 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:35.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.668+0000 7f47d0e00640 1 -- 172.21.15.138:0/2604594086 >> 172.21.15.138:0/2604594086 conn(0x7f47cc0d2d80 msgr2=0x7f47cc0d3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:35.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.668+0000 7f47d0e00640 1 -- 172.21.15.138:0/2604594086 shutdown_connections 2024-04-26T20:57:35.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.668+0000 7f47d0e00640 1 -- 172.21.15.138:0/2604594086 wait complete. 2024-04-26T20:57:35.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.672+0000 7f47d0e00640 1 Processor -- start 2024-04-26T20:57:35.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.672+0000 7f47d0e00640 1 -- start start 2024-04-26T20:57:35.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.672+0000 7f47d0e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47cc0b2280 0x7f47cc15b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:35.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.672+0000 7f47d0e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47cc0d0950 0x7f47cc153530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:35.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.672+0000 7f47d0e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f47cc15d0f0 0x7f47cc0caf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:35.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.672+0000 7f47d0e00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f47cc0d18e0 con 0x7f47cc0b2280 2024-04-26T20:57:35.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.672+0000 7f47d0e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f47cc0d1760 con 0x7f47cc15d0f0 2024-04-26T20:57:35.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.672+0000 7f47d0e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f47cc16b4d0 con 0x7f47cc0d0950 2024-04-26T20:57:35.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.672+0000 7f47c9e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47cc0b2280 0x7f47cc15b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:35.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.672+0000 7f47c9e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47cc0b2280 0x7f47cc15b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:45122/0 (socket says 172.21.15.138:45122) 2024-04-26T20:57:35.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.672+0000 7f47c9e00640 1 -- 172.21.15.138:0/4259007392 learned_addr learned my addr 172.21.15.138:0/4259007392 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:35.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.672+0000 7f47c9e00640 1 -- 172.21.15.138:0/4259007392 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47cc0d0950 msgr2=0x7f47cc153530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:35.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.672+0000 7f47c9e00640 1 --2- 172.21.15.138:0/4259007392 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47cc0d0950 0x7f47cc153530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:35.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.672+0000 7f47c9e00640 1 -- 172.21.15.138:0/4259007392 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f47cc15d0f0 msgr2=0x7f47cc0caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:35.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.672+0000 7f47c9e00640 1 --2- 172.21.15.138:0/4259007392 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f47cc15d0f0 0x7f47cc0caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:35.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.672+0000 7f47c9e00640 1 -- 172.21.15.138:0/4259007392 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47cc15ad40 con 0x7f47cc0b2280 2024-04-26T20:57:35.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.672+0000 7f47c9e00640 1 --2- 172.21.15.138:0/4259007392 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47cc0b2280 0x7f47cc15b810 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f47bc000c10 tx=0x7f47bc01ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:35.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.672+0000 7f47c2000640 1 -- 172.21.15.138:0/4259007392 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47bc0b0050 con 0x7f47cc0b2280 2024-04-26T20:57:35.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.672+0000 7f47c2000640 1 -- 172.21.15.138:0/4259007392 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47bc0bc070 con 0x7f47cc0b2280 2024-04-26T20:57:35.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.672+0000 7f47d0e00640 1 -- 172.21.15.138:0/4259007392 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47cc15b020 con 0x7f47cc0b2280 2024-04-26T20:57:35.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.672+0000 7f47c2000640 1 -- 172.21.15.138:0/4259007392 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47bc006e20 con 0x7f47cc0b2280 2024-04-26T20:57:35.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.672+0000 7f47d0e00640 1 -- 172.21.15.138:0/4259007392 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47cc09d070 con 0x7f47cc0b2280 2024-04-26T20:57:35.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.672+0000 7f47d0e00640 1 -- 172.21.15.138:0/4259007392 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47cc069510 con 0x7f47cc0b2280 2024-04-26T20:57:35.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.676+0000 7f47c2000640 1 -- 172.21.15.138:0/4259007392 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f47bc0b5810 con 0x7f47cc0b2280 2024-04-26T20:57:35.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.676+0000 7f47c2000640 1 --2- 172.21.15.138:0/4259007392 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f47ac068380 0x7f47ac06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:35.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.676+0000 7f47c2000640 1 -- 172.21.15.138:0/4259007392 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7f47bc121380 con 0x7f47cc0b2280 2024-04-26T20:57:35.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.676+0000 7f47c9400640 1 --2- 172.21.15.138:0/4259007392 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f47ac068380 0x7f47ac06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:35.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.676+0000 7f47c9400640 1 --2- 172.21.15.138:0/4259007392 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f47ac068380 0x7f47ac06a840 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f47b8000fe0 tx=0x7f47b8001240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:35.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.680+0000 7f47c2000640 1 -- 172.21.15.138:0/4259007392 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f47bc0160d0 con 0x7f47cc0b2280 2024-04-26T20:57:35.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.848+0000 7f47d0e00640 1 -- 172.21.15.138:0/4259007392 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f47cc070cc0 con 0x7f47cc0b2280 2024-04-26T20:57:35.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.848+0000 7f47c2000640 1 -- 172.21.15.138:0/4259007392 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7f47bc0abe20 con 0x7f47cc0b2280 2024-04-26T20:57:35.855 INFO:teuthology.orchestra.run.smithi138.stderr:listed 0 entries 2024-04-26T20:57:35.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.852+0000 7f47d0e00640 1 -- 172.21.15.138:0/4259007392 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f47ac068380 msgr2=0x7f47ac06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:35.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.852+0000 7f47d0e00640 1 --2- 172.21.15.138:0/4259007392 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f47ac068380 0x7f47ac06a840 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f47b8000fe0 tx=0x7f47b8001240 comp rx=0 tx=0).stop 2024-04-26T20:57:35.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.852+0000 7f47d0e00640 1 -- 172.21.15.138:0/4259007392 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47cc0b2280 msgr2=0x7f47cc15b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:35.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.852+0000 7f47d0e00640 1 --2- 172.21.15.138:0/4259007392 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47cc0b2280 0x7f47cc15b810 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f47bc000c10 tx=0x7f47bc01ad20 comp rx=0 tx=0).stop 2024-04-26T20:57:35.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.852+0000 7f47d0e00640 1 -- 172.21.15.138:0/4259007392 shutdown_connections 2024-04-26T20:57:35.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.852+0000 7f47d0e00640 1 --2- 172.21.15.138:0/4259007392 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f47ac068380 0x7f47ac06a840 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:35.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.852+0000 7f47d0e00640 1 --2- 172.21.15.138:0/4259007392 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f47cc15d0f0 0x7f47cc0caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:35.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.852+0000 7f47d0e00640 1 --2- 172.21.15.138:0/4259007392 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47cc0d0950 0x7f47cc153530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:35.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.852+0000 7f47d0e00640 1 --2- 172.21.15.138:0/4259007392 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47cc0b2280 0x7f47cc15b810 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:35.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.852+0000 7f47d0e00640 1 -- 172.21.15.138:0/4259007392 >> 172.21.15.138:0/4259007392 conn(0x7f47cc0d2d80 msgr2=0x7f47cc0cc330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:35.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.852+0000 7f47d0e00640 1 -- 172.21.15.138:0/4259007392 shutdown_connections 2024-04-26T20:57:35.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:35.852+0000 7f47d0e00640 1 -- 172.21.15.138:0/4259007392 wait complete. 2024-04-26T20:57:35.876 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-04-26T20:57:35.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:57:35.876 DEBUG:teuthology.orchestra.run.smithi143:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-04-26T20:57:35.903 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi143.front.sepia.ceph.com 2024-04-26T20:57:35.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:57:35.903 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-04-26T20:57:35.954 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-26T20:57:35.954 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:57:36.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.084+0000 7fe1f4e00640 1 Processor -- start 2024-04-26T20:57:36.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.084+0000 7fe1f4e00640 1 -- start start 2024-04-26T20:57:36.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.084+0000 7fe1f4e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe1f015ce20 0x7fe1f0161340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:36.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.084+0000 7fe1f4e00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe1f015e0c0 0x7fe1f0071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:36.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.084+0000 7fe1f4e00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1f0073b70 con 0x7fe1f00cca00 2024-04-26T20:57:36.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.084+0000 7fe1f4e00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fe1f0073e10 con 0x7fe1f015ce20 2024-04-26T20:57:36.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.084+0000 7fe1f4e00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fe1f00740f0 con 0x7fe1f015e0c0 2024-04-26T20:57:36.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.084+0000 7fe1ede00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe1f015ce20 0x7fe1f0161340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:36.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.084+0000 7fe1ede00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe1f015ce20 0x7fe1f0161340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:45124/0 (socket says 172.21.15.138:45124) 2024-04-26T20:57:36.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.084+0000 7fe1ede00640 1 -- 172.21.15.138:0/245178789 learned_addr learned my addr 172.21.15.138:0/245178789 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:36.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.088+0000 7fe1e5400640 1 --2- 172.21.15.138:0/245178789 >> v2:172.21.15.143:3300/0 conn(0x7fe1f015e0c0 0x7fe1f0071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:36.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.088+0000 7fe1ede00640 1 -- 172.21.15.138:0/245178789 >> v2:172.21.15.143:3300/0 conn(0x7fe1f015e0c0 msgr2=0x7fe1f0071ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:36.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.088+0000 7fe1ede00640 1 --2- 172.21.15.138:0/245178789 >> v2:172.21.15.143:3300/0 conn(0x7fe1f015e0c0 0x7fe1f0071ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:36.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.088+0000 7fe1ede00640 1 -- 172.21.15.138:0/245178789 >> v1:172.21.15.143:6789/0 conn(0x7fe1f00cca00 legacy=0x7fe1f00cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:36.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.088+0000 7fe1ede00640 1 -- 172.21.15.138:0/245178789 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1f0160b40 con 0x7fe1f015ce20 2024-04-26T20:57:36.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.088+0000 7fe1ede00640 1 --2- 172.21.15.138:0/245178789 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe1f015ce20 0x7fe1f0161340 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0074390 tx=0x7fe1e001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20e2acd27ff65161 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:36.095 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.088+0000 7fe1ed400640 1 -- 172.21.15.138:0/245178789 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e00aa610 con 0x7fe1f015ce20 2024-04-26T20:57:36.095 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.088+0000 7fe1ed400640 1 -- 172.21.15.138:0/245178789 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1e00af070 con 0x7fe1f015ce20 2024-04-26T20:57:36.095 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.088+0000 7fe1ed400640 1 -- 172.21.15.138:0/245178789 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e00aa9d0 con 0x7fe1f015ce20 2024-04-26T20:57:36.096 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.088+0000 7fe1f4e00640 1 -- 172.21.15.138:0/245178789 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe1f015ce20 msgr2=0x7fe1f0161340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:36.096 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.088+0000 7fe1f4e00640 1 --2- 172.21.15.138:0/245178789 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe1f015ce20 0x7fe1f0161340 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0074390 tx=0x7fe1e001c490 comp rx=0 tx=0).stop 2024-04-26T20:57:36.096 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.092+0000 7fe1f4e00640 1 -- 172.21.15.138:0/245178789 shutdown_connections 2024-04-26T20:57:36.096 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.092+0000 7fe1f4e00640 1 --2- 172.21.15.138:0/245178789 >> v2:172.21.15.143:3300/0 conn(0x7fe1f015e0c0 0x7fe1f0071ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:36.096 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.092+0000 7fe1f4e00640 1 --2- 172.21.15.138:0/245178789 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe1f015ce20 0x7fe1f0161340 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:36.096 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.092+0000 7fe1f4e00640 1 -- 172.21.15.138:0/245178789 >> 172.21.15.138:0/245178789 conn(0x7fe1f00d0b20 msgr2=0x7fe1f00d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:36.096 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.092+0000 7fe1f4e00640 1 -- 172.21.15.138:0/245178789 shutdown_connections 2024-04-26T20:57:36.096 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.092+0000 7fe1f4e00640 1 -- 172.21.15.138:0/245178789 wait complete. 2024-04-26T20:57:36.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.092+0000 7fe1f4e00640 1 Processor -- start 2024-04-26T20:57:36.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.092+0000 7fe1f4e00640 1 -- start start 2024-04-26T20:57:36.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.092+0000 7fe1f4e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe1f00cca00 0x7fe1f0149f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:36.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.092+0000 7fe1f4e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe1f015ce20 0x7fe1f00c4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:36.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.092+0000 7fe1f4e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe1f015e0c0 0x7fe1f00ca180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:36.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.092+0000 7fe1f4e00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f015d380 con 0x7fe1f00cca00 2024-04-26T20:57:36.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.092+0000 7fe1f4e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f015d200 con 0x7fe1f015e0c0 2024-04-26T20:57:36.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.092+0000 7fe1f4e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fe1f006e680 con 0x7fe1f015ce20 2024-04-26T20:57:36.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.092+0000 7fe1ede00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe1f00cca00 0x7fe1f0149f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:36.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.092+0000 7fe1ede00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe1f00cca00 0x7fe1f0149f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:45128/0 (socket says 172.21.15.138:45128) 2024-04-26T20:57:36.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.092+0000 7fe1ede00640 1 -- 172.21.15.138:0/2843485541 learned_addr learned my addr 172.21.15.138:0/2843485541 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:36.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.092+0000 7fe1ee800640 1 --2- 172.21.15.138:0/2843485541 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe1f015e0c0 0x7fe1f00ca180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:36.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.092+0000 7fe1e5400640 1 --2- 172.21.15.138:0/2843485541 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe1f015ce20 0x7fe1f00c4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:36.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.092+0000 7fe1ede00640 1 -- 172.21.15.138:0/2843485541 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe1f015ce20 msgr2=0x7fe1f00c4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:36.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.092+0000 7fe1ede00640 1 --2- 172.21.15.138:0/2843485541 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe1f015ce20 0x7fe1f00c4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:36.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.092+0000 7fe1ede00640 1 -- 172.21.15.138:0/2843485541 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe1f015e0c0 msgr2=0x7fe1f00ca180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:36.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.092+0000 7fe1ede00640 1 --2- 172.21.15.138:0/2843485541 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe1f015e0c0 0x7fe1f00ca180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:36.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.092+0000 7fe1ede00640 1 -- 172.21.15.138:0/2843485541 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1f014a480 con 0x7fe1f00cca00 2024-04-26T20:57:36.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.092+0000 7fe1ee800640 1 --2- 172.21.15.138:0/2843485541 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe1f015e0c0 0x7fe1f00ca180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:36.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.092+0000 7fe1ede00640 1 --2- 172.21.15.138:0/2843485541 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe1f00cca00 0x7fe1f0149f40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe1e00ac040 tx=0x7fe1e001acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:36.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.092+0000 7fe1e6a00640 1 -- 172.21.15.138:0/2843485541 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e00bd5f0 con 0x7fe1f00cca00 2024-04-26T20:57:36.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.092+0000 7fe1e6a00640 1 -- 172.21.15.138:0/2843485541 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1e00bd7b0 con 0x7fe1f00cca00 2024-04-26T20:57:36.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.092+0000 7fe1e6a00640 1 -- 172.21.15.138:0/2843485541 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e00bdba0 con 0x7fe1f00cca00 2024-04-26T20:57:36.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.092+0000 7fe1f4e00640 1 -- 172.21.15.138:0/2843485541 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1f00ce770 con 0x7fe1f00cca00 2024-04-26T20:57:36.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.096+0000 7fe1f4e00640 1 -- 172.21.15.138:0/2843485541 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1f00ced30 con 0x7fe1f00cca00 2024-04-26T20:57:36.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.096+0000 7fe1f4e00640 1 -- 172.21.15.138:0/2843485541 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1f0069510 con 0x7fe1f00cca00 2024-04-26T20:57:36.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.096+0000 7fe1e6a00640 1 -- 172.21.15.138:0/2843485541 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe1e00b33f0 con 0x7fe1f00cca00 2024-04-26T20:57:36.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.096+0000 7fe1e6a00640 1 --2- 172.21.15.138:0/2843485541 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe1cc068380 0x7fe1cc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:36.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.096+0000 7fe1e6a00640 1 -- 172.21.15.138:0/2843485541 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7fe1e01216c0 con 0x7fe1f00cca00 2024-04-26T20:57:36.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.096+0000 7fe1e5400640 1 --2- 172.21.15.138:0/2843485541 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe1cc068380 0x7fe1cc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:36.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.096+0000 7fe1e5400640 1 --2- 172.21.15.138:0/2843485541 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe1cc068380 0x7fe1cc06a840 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe1f00b1d50 tx=0x7fe1d8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:36.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.100+0000 7fe1e6a00640 1 -- 172.21.15.138:0/2843485541 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe1e00a7070 con 0x7fe1f00cca00 2024-04-26T20:57:36.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.296+0000 7fe1f4e00640 1 -- 172.21.15.138:0/2843485541 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe1f00cd310 con 0x7fe1f00cca00 2024-04-26T20:57:36.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.300+0000 7fe1e6a00640 1 -- 172.21.15.138:0/2843485541 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5189 (secure 0 0 0) 0x7fe1e00160b0 con 0x7fe1f00cca00 2024-04-26T20:57:36.304 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:57:36.304 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/3495262740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3495262740},{"type":"v1","addr":"172.21.15.143:6837","nonce":3495262740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4273,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/1806638334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":1806638334},{"type":"v1","addr":"172.21.15.138:6834","nonce":1806638334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/3333703637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":3333703637},{"type":"v1","addr":"172.21.15.138:6835","nonce":3333703637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:56:39.581500+0000","modified":"2024-04-26T20:56:57.692718+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6836/3598364176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":3598364176},{"type":"v1","addr":"172.21.15.143:6836","nonce":3598364176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-04-26T20:57:36.304 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 9 2024-04-26T20:57:36.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.300+0000 7fe1f4e00640 1 -- 172.21.15.138:0/2843485541 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe1cc068380 msgr2=0x7fe1cc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:36.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.300+0000 7fe1f4e00640 1 --2- 172.21.15.138:0/2843485541 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe1cc068380 0x7fe1cc06a840 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe1f00b1d50 tx=0x7fe1d8008040 comp rx=0 tx=0).stop 2024-04-26T20:57:36.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.300+0000 7fe1f4e00640 1 -- 172.21.15.138:0/2843485541 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe1f00cca00 msgr2=0x7fe1f0149f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:36.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.300+0000 7fe1f4e00640 1 --2- 172.21.15.138:0/2843485541 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe1f00cca00 0x7fe1f0149f40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe1e00ac040 tx=0x7fe1e001acd0 comp rx=0 tx=0).stop 2024-04-26T20:57:36.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.300+0000 7fe1f4e00640 1 -- 172.21.15.138:0/2843485541 shutdown_connections 2024-04-26T20:57:36.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.300+0000 7fe1f4e00640 1 --2- 172.21.15.138:0/2843485541 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe1cc068380 0x7fe1cc06a840 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:36.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.300+0000 7fe1f4e00640 1 --2- 172.21.15.138:0/2843485541 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe1f015e0c0 0x7fe1f00ca180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:36.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.300+0000 7fe1f4e00640 1 --2- 172.21.15.138:0/2843485541 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe1f015ce20 0x7fe1f00c4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:36.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.300+0000 7fe1f4e00640 1 --2- 172.21.15.138:0/2843485541 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe1f00cca00 0x7fe1f0149f40 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:36.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.300+0000 7fe1f4e00640 1 -- 172.21.15.138:0/2843485541 >> 172.21.15.138:0/2843485541 conn(0x7fe1f00d0b20 msgr2=0x7fe1f00b1e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:36.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.300+0000 7fe1f4e00640 1 -- 172.21.15.138:0/2843485541 shutdown_connections 2024-04-26T20:57:36.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.300+0000 7fe1f4e00640 1 -- 172.21.15.138:0/2843485541 wait complete. 2024-04-26T20:57:36.325 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:57:36.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.456+0000 7f19cd800640 1 Processor -- start 2024-04-26T20:57:36.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.456+0000 7f19cd800640 1 -- start start 2024-04-26T20:57:36.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.456+0000 7f19cd800640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f19c815d0f0 0x7f19c80d1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:36.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.456+0000 7f19cd800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f19c80b2280 0x7f19c80d1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:36.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.456+0000 7f19cd800640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19c80ce540 con 0x7f19c80d0950 2024-04-26T20:57:36.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.456+0000 7f19cd800640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f19c80d0e50 con 0x7f19c80b2280 2024-04-26T20:57:36.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.456+0000 7f19cd800640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f19c80b26e0 con 0x7f19c815d0f0 2024-04-26T20:57:36.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.456+0000 7f19c6000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f19c80b2280 0x7f19c80d1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:36.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.456+0000 7f19c6000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f19c80b2280 0x7f19c80d1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:45136/0 (socket says 172.21.15.138:45136) 2024-04-26T20:57:36.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.456+0000 7f19c7400640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f19c80d0950 0x7f19c80cf750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:35526/0 (socket says 172.21.15.138:35526) 2024-04-26T20:57:36.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.456+0000 7f19c6000640 1 -- 172.21.15.138:0/4255154093 learned_addr learned my addr 172.21.15.138:0/4255154093 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:36.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.456+0000 7f19c6a00640 1 --2- 172.21.15.138:0/4255154093 >> v2:172.21.15.143:3300/0 conn(0x7f19c815d0f0 0x7f19c80d1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:36.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.456+0000 7f19c6000640 1 -- 172.21.15.138:0/4255154093 >> v2:172.21.15.143:3300/0 conn(0x7f19c815d0f0 msgr2=0x7f19c80d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:36.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.456+0000 7f19c6000640 1 --2- 172.21.15.138:0/4255154093 >> v2:172.21.15.143:3300/0 conn(0x7f19c815d0f0 0x7f19c80d1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:36.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.456+0000 7f19c6000640 1 -- 172.21.15.138:0/4255154093 >> v1:172.21.15.138:6789/0 conn(0x7f19c80d0950 legacy=0x7f19c80cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:36.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.456+0000 7f19c6000640 1 -- 172.21.15.138:0/4255154093 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19c80ce820 con 0x7f19c80b2280 2024-04-26T20:57:36.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.460+0000 7f19c6000640 1 --2- 172.21.15.138:0/4255154093 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19c80b2280 0x7f19c80d1550 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f19c8073320 tx=0x7f19b401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=defacae64a560f57 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:36.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.460+0000 7f19c5600640 1 -- 172.21.15.138:0/4255154093 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19b40b1070 con 0x7f19c80b2280 2024-04-26T20:57:36.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.460+0000 7f19c5600640 1 -- 172.21.15.138:0/4255154093 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19b40ac410 con 0x7f19c80b2280 2024-04-26T20:57:36.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.460+0000 7f19c5600640 1 -- 172.21.15.138:0/4255154093 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19b40ac7e0 con 0x7f19c80b2280 2024-04-26T20:57:36.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.460+0000 7f19cd800640 1 -- 172.21.15.138:0/4255154093 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19c80b2280 msgr2=0x7f19c80d1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:36.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.460+0000 7f19cd800640 1 --2- 172.21.15.138:0/4255154093 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19c80b2280 0x7f19c80d1550 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f19c8073320 tx=0x7f19b401c520 comp rx=0 tx=0).stop 2024-04-26T20:57:36.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.464+0000 7f19cd800640 1 -- 172.21.15.138:0/4255154093 shutdown_connections 2024-04-26T20:57:36.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.464+0000 7f19cd800640 1 --2- 172.21.15.138:0/4255154093 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19c80b2280 0x7f19c80d1550 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:36.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.464+0000 7f19cd800640 1 --2- 172.21.15.138:0/4255154093 >> v2:172.21.15.143:3300/0 conn(0x7f19c815d0f0 0x7f19c80d1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:36.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.464+0000 7f19cd800640 1 -- 172.21.15.138:0/4255154093 >> 172.21.15.138:0/4255154093 conn(0x7f19c80d2d80 msgr2=0x7f19c80d3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:36.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.464+0000 7f19cd800640 1 -- 172.21.15.138:0/4255154093 shutdown_connections 2024-04-26T20:57:36.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.464+0000 7f19cd800640 1 -- 172.21.15.138:0/4255154093 wait complete. 2024-04-26T20:57:36.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.464+0000 7f19cd800640 1 Processor -- start 2024-04-26T20:57:36.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.464+0000 7f19cd800640 1 -- start start 2024-04-26T20:57:36.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.464+0000 7f19cd800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19c80b2280 0x7f19c8150b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:36.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.464+0000 7f19cd800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f19c80d0950 0x7f19c80afc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:36.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.464+0000 7f19cd800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f19c815d0f0 0x7f19c80b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:36.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.464+0000 7f19cd800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f19c816a040 con 0x7f19c80b2280 2024-04-26T20:57:36.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.464+0000 7f19cd800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f19c8169ec0 con 0x7f19c80d0950 2024-04-26T20:57:36.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.464+0000 7f19cd800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f19c816a1c0 con 0x7f19c815d0f0 2024-04-26T20:57:36.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.464+0000 7f19c6a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19c80b2280 0x7f19c8150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:36.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.464+0000 7f19c6a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19c80b2280 0x7f19c8150b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:45152/0 (socket says 172.21.15.138:45152) 2024-04-26T20:57:36.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.464+0000 7f19c6a00640 1 -- 172.21.15.138:0/64972066 learned_addr learned my addr 172.21.15.138:0/64972066 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:36.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.464+0000 7f19c6000640 1 --2- 172.21.15.138:0/64972066 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f19c80d0950 0x7f19c80afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:36.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.464+0000 7f19c7400640 1 --2- 172.21.15.138:0/64972066 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f19c815d0f0 0x7f19c80b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:36.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.464+0000 7f19c6a00640 1 -- 172.21.15.138:0/64972066 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f19c815d0f0 msgr2=0x7f19c80b01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:36.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.464+0000 7f19c6a00640 1 --2- 172.21.15.138:0/64972066 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f19c815d0f0 0x7f19c80b01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:36.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.464+0000 7f19c6a00640 1 -- 172.21.15.138:0/64972066 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f19c80d0950 msgr2=0x7f19c80afc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:36.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.464+0000 7f19c6a00640 1 --2- 172.21.15.138:0/64972066 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f19c80d0950 0x7f19c80afc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:36.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.464+0000 7f19c6a00640 1 -- 172.21.15.138:0/64972066 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19c8153b10 con 0x7f19c80b2280 2024-04-26T20:57:36.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.464+0000 7f19c6000640 1 --2- 172.21.15.138:0/64972066 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f19c80d0950 0x7f19c80afc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:57:36.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.464+0000 7f19c6a00640 1 --2- 172.21.15.138:0/64972066 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19c80b2280 0x7f19c8150b50 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f19b800e8a0 tx=0x7f19b800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:36.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.464+0000 7f19bea00640 1 -- 172.21.15.138:0/64972066 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19b8017070 con 0x7f19c80b2280 2024-04-26T20:57:36.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.464+0000 7f19bea00640 1 -- 172.21.15.138:0/64972066 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19b800c940 con 0x7f19c80b2280 2024-04-26T20:57:36.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.464+0000 7f19bea00640 1 -- 172.21.15.138:0/64972066 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19b800ccf0 con 0x7f19c80b2280 2024-04-26T20:57:36.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.464+0000 7f19cd800640 1 -- 172.21.15.138:0/64972066 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19c8153db0 con 0x7f19c80b2280 2024-04-26T20:57:36.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.468+0000 7f19cd800640 1 -- 172.21.15.138:0/64972066 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19c8154370 con 0x7f19c80b2280 2024-04-26T20:57:36.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.468+0000 7f19cd800640 1 -- 172.21.15.138:0/64972066 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19c8069510 con 0x7f19c80b2280 2024-04-26T20:57:36.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.468+0000 7f19bea00640 1 -- 172.21.15.138:0/64972066 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f19b801a070 con 0x7f19c80b2280 2024-04-26T20:57:36.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.468+0000 7f19bea00640 1 --2- 172.21.15.138:0/64972066 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f19a8068380 0x7f19a806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:36.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.468+0000 7f19bea00640 1 -- 172.21.15.138:0/64972066 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7f19b8087060 con 0x7f19c80b2280 2024-04-26T20:57:36.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.468+0000 7f19c6000640 1 --2- 172.21.15.138:0/64972066 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f19a8068380 0x7f19a806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:36.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.472+0000 7f19c6000640 1 --2- 172.21.15.138:0/64972066 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f19a8068380 0x7f19a806a840 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f19b40ae000 tx=0x7f19b40a6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:36.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.472+0000 7f19bea00640 1 -- 172.21.15.138:0/64972066 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f19b80571f0 con 0x7f19c80b2280 2024-04-26T20:57:36.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.632+0000 7f19cd800640 1 -- 172.21.15.138:0/64972066 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f19c8075150 con 0x7f19c80b2280 2024-04-26T20:57:36.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.632+0000 7f19bea00640 1 -- 172.21.15.138:0/64972066 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18719 (secure 0 0 0) 0x7f19b8056af0 con 0x7f19c80b2280 2024-04-26T20:57:36.639 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:57:36.639 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":29,"fsid":"c22b4730-12cc-4558-8535-b965384398c0","created":"2024-04-26T20:56:14.182475+0000","modified":"2024-04-26T20:57:20.395184+0000","last_up_change":"2024-04-26T20:56:26.013243+0000","last_in_change":"2024-04-26T20:56:16.714055+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:56:27.265834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:56:37.394398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:56:38.544369+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:56:42.240243+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3f9a2e34-3199-466f-a6cf-57927318121e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6801","nonce":3534772245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6803","nonce":3534772245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6807","nonce":3534772245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6805","nonce":3534772245}]},"public_addr":"172.21.15.138:6801/3534772245","cluster_addr":"172.21.15.138:6803/3534772245","heartbeat_back_addr":"172.21.15.138:6807/3534772245","heartbeat_front_addr":"172.21.15.138:6805/3534772245","state":["exists","up"]},{"osd":1,"uuid":"e881fcf6-3248-4696-a2ef-95d206d77712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6817","nonce":1427635773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6819","nonce":1427635773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6823","nonce":1427635773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6821","nonce":1427635773}]},"public_addr":"172.21.15.138:6817/1427635773","cluster_addr":"172.21.15.138:6819/1427635773","heartbeat_back_addr":"172.21.15.138:6823/1427635773","heartbeat_front_addr":"172.21.15.138:6821/1427635773","state":["exists","up"]},{"osd":2,"uuid":"f7d1db33-7672-4699-ae47-9f1e0a8e4222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6809","nonce":4273721573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6811","nonce":4273721573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6815","nonce":4273721573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6813","nonce":4273721573}]},"public_addr":"172.21.15.138:6809/4273721573","cluster_addr":"172.21.15.138:6811/4273721573","heartbeat_back_addr":"172.21.15.138:6815/4273721573","heartbeat_front_addr":"172.21.15.138:6813/4273721573","state":["exists","up"]},{"osd":3,"uuid":"2f4e0a9a-b8f6-4468-844a-a4501cd85054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6825","nonce":3098242154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6827","nonce":3098242154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6831","nonce":3098242154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6829","nonce":3098242154}]},"public_addr":"172.21.15.138:6825/3098242154","cluster_addr":"172.21.15.138:6827/3098242154","heartbeat_back_addr":"172.21.15.138:6831/3098242154","heartbeat_front_addr":"172.21.15.138:6829/3098242154","state":["exists","up"]},{"osd":4,"uuid":"c85df99b-3624-410e-866b-86830af2cfe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6801","nonce":2942056312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6803","nonce":2942056312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6807","nonce":2942056312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6805","nonce":2942056312}]},"public_addr":"172.21.15.143:6801/2942056312","cluster_addr":"172.21.15.143:6803/2942056312","heartbeat_back_addr":"172.21.15.143:6807/2942056312","heartbeat_front_addr":"172.21.15.143:6805/2942056312","state":["exists","up"]},{"osd":5,"uuid":"9af1efb5-c416-4808-b5ef-de0679ab9705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6809","nonce":1910222887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6811","nonce":1910222887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6815","nonce":1910222887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6813","nonce":1910222887}]},"public_addr":"172.21.15.143:6809/1910222887","cluster_addr":"172.21.15.143:6811/1910222887","heartbeat_back_addr":"172.21.15.143:6815/1910222887","heartbeat_front_addr":"172.21.15.143:6813/1910222887","state":["exists","up"]},{"osd":6,"uuid":"d7138615-8838-45ff-9072-2fd0683362f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6817","nonce":1082239825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6819","nonce":1082239825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6823","nonce":1082239825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6821","nonce":1082239825}]},"public_addr":"172.21.15.143:6817/1082239825","cluster_addr":"172.21.15.143:6819/1082239825","heartbeat_back_addr":"172.21.15.143:6823/1082239825","heartbeat_front_addr":"172.21.15.143:6821/1082239825","state":["exists","up"]},{"osd":7,"uuid":"0c27172b-35c4-49ec-ba0b-0137b8ff0010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6825","nonce":3295508495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6827","nonce":3295508495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6831","nonce":3295508495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6829","nonce":3295508495}]},"public_addr":"172.21.15.143:6825/3295508495","cluster_addr":"172.21.15.143:6827/3295508495","heartbeat_back_addr":"172.21.15.143:6831/3295508495","heartbeat_front_addr":"172.21.15.143:6829/3295508495","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.326627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.396119+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.433915+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.414179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.216947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.329272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.503073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.436382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.39","mappings":[{"from":0,"to":7}]},{"pgid":"4.6","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:57:36.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.636+0000 7f19cd800640 1 -- 172.21.15.138:0/64972066 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f19a8068380 msgr2=0x7f19a806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:36.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.636+0000 7f19cd800640 1 --2- 172.21.15.138:0/64972066 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f19a8068380 0x7f19a806a840 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f19b40ae000 tx=0x7f19b40a6040 comp rx=0 tx=0).stop 2024-04-26T20:57:36.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.636+0000 7f19cd800640 1 -- 172.21.15.138:0/64972066 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19c80b2280 msgr2=0x7f19c8150b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:36.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.636+0000 7f19cd800640 1 --2- 172.21.15.138:0/64972066 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19c80b2280 0x7f19c8150b50 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f19b800e8a0 tx=0x7f19b800eca0 comp rx=0 tx=0).stop 2024-04-26T20:57:36.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.636+0000 7f19cd800640 1 -- 172.21.15.138:0/64972066 shutdown_connections 2024-04-26T20:57:36.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.636+0000 7f19cd800640 1 --2- 172.21.15.138:0/64972066 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f19a8068380 0x7f19a806a840 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:36.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.636+0000 7f19cd800640 1 --2- 172.21.15.138:0/64972066 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f19c815d0f0 0x7f19c80b01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:36.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.636+0000 7f19cd800640 1 --2- 172.21.15.138:0/64972066 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f19c80d0950 0x7f19c80afc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:36.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.636+0000 7f19cd800640 1 --2- 172.21.15.138:0/64972066 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19c80b2280 0x7f19c8150b50 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:36.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.636+0000 7f19cd800640 1 -- 172.21.15.138:0/64972066 >> 172.21.15.138:0/64972066 conn(0x7f19c80d2d80 msgr2=0x7f19c8070180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:36.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.636+0000 7f19cd800640 1 -- 172.21.15.138:0/64972066 shutdown_connections 2024-04-26T20:57:36.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.636+0000 7f19cd800640 1 -- 172.21.15.138:0/64972066 wait complete. 2024-04-26T20:57:36.659 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:56:27.265834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T20:56:37.394398+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T20:56:38.544369+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T20:56:42.240243+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T20:57:36.660 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T20:57:36.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.792+0000 7ff81fe00640 1 Processor -- start 2024-04-26T20:57:36.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.792+0000 7ff81fe00640 1 -- start start 2024-04-26T20:57:36.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.796+0000 7ff81fe00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff820160a50 0x7ff82006f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:36.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.796+0000 7ff81fe00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff820072210 0x7ff820160e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:36.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.796+0000 7ff81fe00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8200707a0 con 0x7ff820071d90 2024-04-26T20:57:36.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.796+0000 7ff81fe00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7ff8200cf030 con 0x7ff820160a50 2024-04-26T20:57:36.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.796+0000 7ff81fe00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ff82006e750 con 0x7ff820072210 2024-04-26T20:57:36.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.796+0000 7ff81ea00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff820160a50 0x7ff82006f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:36.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.796+0000 7ff81e000640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7ff820071d90 0x7ff8200cfa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:35530/0 (socket says 172.21.15.138:35530) 2024-04-26T20:57:36.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.796+0000 7ff81e000640 1 -- 172.21.15.138:0/2324923736 learned_addr learned my addr 172.21.15.138:0/2324923736 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:36.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.796+0000 7ff81f400640 1 --2- 172.21.15.138:0/2324923736 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff820072210 0x7ff820160e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:36.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.796+0000 7ff81ea00640 1 -- 172.21.15.138:0/2324923736 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff820072210 msgr2=0x7ff820160e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:36.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.796+0000 7ff81ea00640 1 --2- 172.21.15.138:0/2324923736 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff820072210 0x7ff820160e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:36.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.796+0000 7ff81ea00640 1 -- 172.21.15.138:0/2324923736 >> v1:172.21.15.138:6789/0 conn(0x7ff820071d90 legacy=0x7ff8200cfa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:36.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.796+0000 7ff81ea00640 1 -- 172.21.15.138:0/2324923736 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff82006ecd0 con 0x7ff820160a50 2024-04-26T20:57:36.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.796+0000 7ff81d600640 1 -- 172.21.15.138:0/2324923736 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3821127638 0 0) 0x7ff8200707a0 con 0x7ff820071d90 2024-04-26T20:57:36.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.796+0000 7ff81f400640 1 --2- 172.21.15.138:0/2324923736 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff820072210 0x7ff820160e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:57:36.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.796+0000 7ff81ea00640 1 --2- 172.21.15.138:0/2324923736 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff820160a50 0x7ff82006f5b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff810009d90 tx=0x7ff81001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fe8fc58b27b4195 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:36.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.796+0000 7ff81d600640 1 -- 172.21.15.138:0/2324923736 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8100b2070 con 0x7ff820160a50 2024-04-26T20:57:36.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.800+0000 7ff81d600640 1 -- 172.21.15.138:0/2324923736 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8100a5830 con 0x7ff820160a50 2024-04-26T20:57:36.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.800+0000 7ff81d600640 1 -- 172.21.15.138:0/2324923736 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8100a5c00 con 0x7ff820160a50 2024-04-26T20:57:36.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.800+0000 7ff81fe00640 1 -- 172.21.15.138:0/2324923736 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff820160a50 msgr2=0x7ff82006f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:36.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.800+0000 7ff81fe00640 1 --2- 172.21.15.138:0/2324923736 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff820160a50 0x7ff82006f5b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff810009d90 tx=0x7ff81001c970 comp rx=0 tx=0).stop 2024-04-26T20:57:36.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.800+0000 7ff81fe00640 1 -- 172.21.15.138:0/2324923736 shutdown_connections 2024-04-26T20:57:36.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.800+0000 7ff81fe00640 1 --2- 172.21.15.138:0/2324923736 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff820072210 0x7ff820160e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:36.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.800+0000 7ff81fe00640 1 --2- 172.21.15.138:0/2324923736 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff820160a50 0x7ff82006f5b0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:36.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.800+0000 7ff81fe00640 1 -- 172.21.15.138:0/2324923736 >> 172.21.15.138:0/2324923736 conn(0x7ff8200b25c0 msgr2=0x7ff8200b29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:36.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.800+0000 7ff81fe00640 1 -- 172.21.15.138:0/2324923736 shutdown_connections 2024-04-26T20:57:36.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.800+0000 7ff81fe00640 1 -- 172.21.15.138:0/2324923736 wait complete. 2024-04-26T20:57:36.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.800+0000 7ff81fe00640 1 Processor -- start 2024-04-26T20:57:36.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.800+0000 7ff81fe00640 1 -- start start 2024-04-26T20:57:36.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.800+0000 7ff81fe00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff820071d90 0x7ff820161b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:36.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.800+0000 7ff81fe00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff820072210 0x7ff820159480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:36.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.800+0000 7ff81fe00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff820160a50 0x7ff820163370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:36.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.800+0000 7ff81fe00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff820169be0 con 0x7ff820160a50 2024-04-26T20:57:36.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.800+0000 7ff81fe00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ff82015ada0 con 0x7ff820072210 2024-04-26T20:57:36.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.800+0000 7ff81fe00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ff820169d60 con 0x7ff820071d90 2024-04-26T20:57:36.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.800+0000 7ff81f400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff820160a50 0x7ff820163370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:36.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.800+0000 7ff81f400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff820160a50 0x7ff820163370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:45164/0 (socket says 172.21.15.138:45164) 2024-04-26T20:57:36.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.800+0000 7ff81f400640 1 -- 172.21.15.138:0/2640212262 learned_addr learned my addr 172.21.15.138:0/2640212262 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:36.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.800+0000 7ff81ea00640 1 --2- 172.21.15.138:0/2640212262 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff820071d90 0x7ff820161b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:36.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.800+0000 7ff81e000640 1 --2- 172.21.15.138:0/2640212262 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff820072210 0x7ff820159480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:36.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.800+0000 7ff81f400640 1 -- 172.21.15.138:0/2640212262 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff820071d90 msgr2=0x7ff820161b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:36.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.800+0000 7ff81f400640 1 --2- 172.21.15.138:0/2640212262 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff820071d90 0x7ff820161b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:36.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.800+0000 7ff81f400640 1 -- 172.21.15.138:0/2640212262 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff820072210 msgr2=0x7ff820159480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:36.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.800+0000 7ff81f400640 1 --2- 172.21.15.138:0/2640212262 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff820072210 0x7ff820159480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:36.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.800+0000 7ff81f400640 1 -- 172.21.15.138:0/2640212262 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8201622d0 con 0x7ff820160a50 2024-04-26T20:57:36.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.804+0000 7ff81f400640 1 --2- 172.21.15.138:0/2640212262 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff820160a50 0x7ff820163370 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff81800c820 tx=0x7ff81800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:36.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.804+0000 7ff816a00640 1 -- 172.21.15.138:0/2640212262 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff818015070 con 0x7ff820160a50 2024-04-26T20:57:36.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.804+0000 7ff816a00640 1 -- 172.21.15.138:0/2640212262 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff818004240 con 0x7ff820160a50 2024-04-26T20:57:36.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.804+0000 7ff816a00640 1 -- 172.21.15.138:0/2640212262 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff81800ce10 con 0x7ff820160a50 2024-04-26T20:57:36.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.804+0000 7ff81fe00640 1 -- 172.21.15.138:0/2640212262 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8201625b0 con 0x7ff820160a50 2024-04-26T20:57:36.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.804+0000 7ff81fe00640 1 -- 172.21.15.138:0/2640212262 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff820162b70 con 0x7ff820160a50 2024-04-26T20:57:36.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.804+0000 7ff81fe00640 1 -- 172.21.15.138:0/2640212262 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff820069430 con 0x7ff820160a50 2024-04-26T20:57:36.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.804+0000 7ff816a00640 1 -- 172.21.15.138:0/2640212262 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff818007830 con 0x7ff820160a50 2024-04-26T20:57:36.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.804+0000 7ff816a00640 1 --2- 172.21.15.138:0/2640212262 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff800068380 0x7ff80006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:36.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.804+0000 7ff816a00640 1 -- 172.21.15.138:0/2640212262 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7ff818086ca0 con 0x7ff820160a50 2024-04-26T20:57:36.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.804+0000 7ff81ea00640 1 --2- 172.21.15.138:0/2640212262 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff800068380 0x7ff80006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:36.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.808+0000 7ff81ea00640 1 --2- 172.21.15.138:0/2640212262 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff800068380 0x7ff80006a840 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff8100af000 tx=0x7ff8100a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:36.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.808+0000 7ff816a00640 1 -- 172.21.15.138:0/2640212262 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff818056e30 con 0x7ff820160a50 2024-04-26T20:57:36.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.968+0000 7ff81fe00640 1 -- 172.21.15.138:0/2640212262 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff820075140 con 0x7ff820160a50 2024-04-26T20:57:36.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.968+0000 7ff816a00640 1 -- 172.21.15.138:0/2640212262 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7ff818056730 con 0x7ff820160a50 2024-04-26T20:57:36.972 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 1 2024-04-26T20:57:36.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.968+0000 7ff81fe00640 1 -- 172.21.15.138:0/2640212262 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff800068380 msgr2=0x7ff80006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:36.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.968+0000 7ff81fe00640 1 --2- 172.21.15.138:0/2640212262 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff800068380 0x7ff80006a840 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff8100af000 tx=0x7ff8100a7070 comp rx=0 tx=0).stop 2024-04-26T20:57:36.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.968+0000 7ff81fe00640 1 -- 172.21.15.138:0/2640212262 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff820160a50 msgr2=0x7ff820163370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:36.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.968+0000 7ff81fe00640 1 --2- 172.21.15.138:0/2640212262 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff820160a50 0x7ff820163370 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff81800c820 tx=0x7ff81800cce0 comp rx=0 tx=0).stop 2024-04-26T20:57:36.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.968+0000 7ff81fe00640 1 -- 172.21.15.138:0/2640212262 shutdown_connections 2024-04-26T20:57:36.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.968+0000 7ff81fe00640 1 --2- 172.21.15.138:0/2640212262 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff800068380 0x7ff80006a840 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:36.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.968+0000 7ff81fe00640 1 --2- 172.21.15.138:0/2640212262 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff820160a50 0x7ff820163370 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:36.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.968+0000 7ff81fe00640 1 --2- 172.21.15.138:0/2640212262 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff820072210 0x7ff820159480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:36.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.968+0000 7ff81fe00640 1 --2- 172.21.15.138:0/2640212262 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff820071d90 0x7ff820161b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:36.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.968+0000 7ff81fe00640 1 -- 172.21.15.138:0/2640212262 >> 172.21.15.138:0/2640212262 conn(0x7ff8200b25c0 msgr2=0x7ff82015af20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:36.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.968+0000 7ff81fe00640 1 -- 172.21.15.138:0/2640212262 shutdown_connections 2024-04-26T20:57:36.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:36.968+0000 7ff81fe00640 1 -- 172.21.15.138:0/2640212262 wait complete. 2024-04-26T20:57:36.994 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T20:57:37.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.128+0000 7f8a14800640 1 Processor -- start 2024-04-26T20:57:37.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.128+0000 7f8a14800640 1 -- start start 2024-04-26T20:57:37.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.128+0000 7f8a14800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f8a0c15bdc0 0x7f8a0c15f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:37.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.128+0000 7f8a14800640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8a0c073d70 0x7f8a0c15fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:37.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.128+0000 7f8a14800640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a0c06dee0 con 0x7f8a0c06f880 2024-04-26T20:57:37.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.128+0000 7f8a14800640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f8a0c15c1a0 con 0x7f8a0c15bdc0 2024-04-26T20:57:37.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.128+0000 7f8a14800640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f8a0c06e180 con 0x7f8a0c073d70 2024-04-26T20:57:37.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.128+0000 7f8a11e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f8a0c15bdc0 0x7f8a0c15f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:37.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.128+0000 7f8a11e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f8a0c15bdc0 0x7f8a0c15f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:45178/0 (socket says 172.21.15.138:45178) 2024-04-26T20:57:37.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.128+0000 7f8a11e00640 1 -- 172.21.15.138:0/4039408133 learned_addr learned my addr 172.21.15.138:0/4039408133 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:37.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.128+0000 7f8a11400640 1 --2- 172.21.15.138:0/4039408133 >> v2:172.21.15.143:3300/0 conn(0x7f8a0c073d70 0x7f8a0c15fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:37.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.128+0000 7f8a11e00640 1 -- 172.21.15.138:0/4039408133 >> v2:172.21.15.143:3300/0 conn(0x7f8a0c073d70 msgr2=0x7f8a0c15fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:37.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.128+0000 7f8a11e00640 1 --2- 172.21.15.138:0/4039408133 >> v2:172.21.15.143:3300/0 conn(0x7f8a0c073d70 0x7f8a0c15fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:37.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.128+0000 7f8a11e00640 1 -- 172.21.15.138:0/4039408133 >> v1:172.21.15.143:6789/0 conn(0x7f8a0c06f880 legacy=0x7f8a0c0cb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:37.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.128+0000 7f8a11e00640 1 -- 172.21.15.138:0/4039408133 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a0c06e460 con 0x7f8a0c15bdc0 2024-04-26T20:57:37.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.132+0000 7f8a11e00640 1 --2- 172.21.15.138:0/4039408133 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8a0c15bdc0 0x7f8a0c15f930 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c15c380 tx=0x7f8a0001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d26cd1388287cc2a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:37.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.132+0000 7f8a10a00640 1 -- 172.21.15.138:0/4039408133 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a000b0070 con 0x7f8a0c15bdc0 2024-04-26T20:57:37.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.132+0000 7f8a10a00640 1 -- 172.21.15.138:0/4039408133 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a000ab600 con 0x7f8a0c15bdc0 2024-04-26T20:57:37.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.132+0000 7f8a10a00640 1 -- 172.21.15.138:0/4039408133 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a000ab9d0 con 0x7f8a0c15bdc0 2024-04-26T20:57:37.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.132+0000 7f8a14800640 1 -- 172.21.15.138:0/4039408133 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8a0c15bdc0 msgr2=0x7f8a0c15f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:37.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.132+0000 7f8a14800640 1 --2- 172.21.15.138:0/4039408133 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8a0c15bdc0 0x7f8a0c15f930 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c15c380 tx=0x7f8a0001c400 comp rx=0 tx=0).stop 2024-04-26T20:57:37.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.132+0000 7f8a14800640 1 -- 172.21.15.138:0/4039408133 shutdown_connections 2024-04-26T20:57:37.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.132+0000 7f8a14800640 1 --2- 172.21.15.138:0/4039408133 >> v2:172.21.15.143:3300/0 conn(0x7f8a0c073d70 0x7f8a0c15fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:37.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.132+0000 7f8a14800640 1 --2- 172.21.15.138:0/4039408133 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8a0c15bdc0 0x7f8a0c15f930 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:37.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.132+0000 7f8a14800640 1 -- 172.21.15.138:0/4039408133 >> 172.21.15.138:0/4039408133 conn(0x7f8a0c0d0bb0 msgr2=0x7f8a0c0d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:37.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.132+0000 7f8a14800640 1 -- 172.21.15.138:0/4039408133 shutdown_connections 2024-04-26T20:57:37.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.132+0000 7f8a14800640 1 -- 172.21.15.138:0/4039408133 wait complete. 2024-04-26T20:57:37.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.136+0000 7f8a14800640 1 Processor -- start 2024-04-26T20:57:37.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.136+0000 7f8a14800640 1 -- start start 2024-04-26T20:57:37.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.136+0000 7f8a14800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a0c06f880 0x7f8a0c15cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:37.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.136+0000 7f8a14800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8a0c073d70 0x7f8a0c149030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:37.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.136+0000 7f8a14800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a0c15bdc0 0x7f8a0c0c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:37.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.136+0000 7f8a14800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0c167050 con 0x7f8a0c073d70 2024-04-26T20:57:37.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.136+0000 7f8a14800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0c166ed0 con 0x7f8a0c15bdc0 2024-04-26T20:57:37.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.136+0000 7f8a14800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f8a0c1671d0 con 0x7f8a0c06f880 2024-04-26T20:57:37.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.136+0000 7f8a11400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8a0c073d70 0x7f8a0c149030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:37.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.136+0000 7f8a11400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8a0c073d70 0x7f8a0c149030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:45186/0 (socket says 172.21.15.138:45186) 2024-04-26T20:57:37.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.136+0000 7f8a11400640 1 -- 172.21.15.138:0/1697116260 learned_addr learned my addr 172.21.15.138:0/1697116260 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:37.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.136+0000 7f8a11e00640 1 --2- 172.21.15.138:0/1697116260 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a0c06f880 0x7f8a0c15cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:37.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.136+0000 7f8a12800640 1 --2- 172.21.15.138:0/1697116260 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a0c15bdc0 0x7f8a0c0c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:37.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.136+0000 7f8a11400640 1 -- 172.21.15.138:0/1697116260 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a0c06f880 msgr2=0x7f8a0c15cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:37.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.136+0000 7f8a11400640 1 --2- 172.21.15.138:0/1697116260 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a0c06f880 0x7f8a0c15cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:37.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.136+0000 7f8a11400640 1 -- 172.21.15.138:0/1697116260 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a0c15bdc0 msgr2=0x7f8a0c0c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:37.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.136+0000 7f8a11400640 1 --2- 172.21.15.138:0/1697116260 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a0c15bdc0 0x7f8a0c0c6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:37.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.136+0000 7f8a11400640 1 -- 172.21.15.138:0/1697116260 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a0c0c4380 con 0x7f8a0c073d70 2024-04-26T20:57:37.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.136+0000 7f8a11400640 1 --2- 172.21.15.138:0/1697116260 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8a0c073d70 0x7f8a0c149030 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f89fc00e930 tx=0x7f89fc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:37.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.136+0000 7f8a06000640 1 -- 172.21.15.138:0/1697116260 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89fc017070 con 0x7f8a0c073d70 2024-04-26T20:57:37.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.136+0000 7f8a06000640 1 -- 172.21.15.138:0/1697116260 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89fc00ca00 con 0x7f8a0c073d70 2024-04-26T20:57:37.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.136+0000 7f8a06000640 1 -- 172.21.15.138:0/1697116260 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89fc00cdd0 con 0x7f8a0c073d70 2024-04-26T20:57:37.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.136+0000 7f8a14800640 1 -- 172.21.15.138:0/1697116260 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a0c15d400 con 0x7f8a0c073d70 2024-04-26T20:57:37.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.136+0000 7f8a14800640 1 -- 172.21.15.138:0/1697116260 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a0c15d9c0 con 0x7f8a0c073d70 2024-04-26T20:57:37.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.136+0000 7f8a14800640 1 -- 172.21.15.138:0/1697116260 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a0c069430 con 0x7f8a0c073d70 2024-04-26T20:57:37.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.140+0000 7f8a06000640 1 -- 172.21.15.138:0/1697116260 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f89fc01a070 con 0x7f8a0c073d70 2024-04-26T20:57:37.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.140+0000 7f8a06000640 1 --2- 172.21.15.138:0/1697116260 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f89f00683b0 0x7f89f006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:37.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.140+0000 7f8a06000640 1 -- 172.21.15.138:0/1697116260 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7f89fc086e60 con 0x7f8a0c073d70 2024-04-26T20:57:37.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.140+0000 7f8a11e00640 1 --2- 172.21.15.138:0/1697116260 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f89f00683b0 0x7f89f006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:37.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.140+0000 7f8a11e00640 1 --2- 172.21.15.138:0/1697116260 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f89f00683b0 0x7f89f006a870 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8a000ad000 tx=0x7f8a000a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:37.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.144+0000 7f8a06000640 1 -- 172.21.15.138:0/1697116260 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f89fc0569d0 con 0x7f8a0c073d70 2024-04-26T20:57:37.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.300+0000 7f8a14800640 1 -- 172.21.15.138:0/1697116260 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f8a0c0d19c0 con 0x7f8a0c073d70 2024-04-26T20:57:37.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.304+0000 7f8a06000640 1 -- 172.21.15.138:0/1697116260 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7f89fc05acd0 con 0x7f8a0c073d70 2024-04-26T20:57:37.308 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 32 2024-04-26T20:57:37.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.304+0000 7f8a14800640 1 -- 172.21.15.138:0/1697116260 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f89f00683b0 msgr2=0x7f89f006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:37.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.304+0000 7f8a14800640 1 --2- 172.21.15.138:0/1697116260 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f89f00683b0 0x7f89f006a870 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8a000ad000 tx=0x7f8a000a6000 comp rx=0 tx=0).stop 2024-04-26T20:57:37.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.304+0000 7f8a14800640 1 -- 172.21.15.138:0/1697116260 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8a0c073d70 msgr2=0x7f8a0c149030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:37.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.304+0000 7f8a14800640 1 --2- 172.21.15.138:0/1697116260 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8a0c073d70 0x7f8a0c149030 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f89fc00e930 tx=0x7f89fc00edf0 comp rx=0 tx=0).stop 2024-04-26T20:57:37.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.304+0000 7f8a14800640 1 -- 172.21.15.138:0/1697116260 shutdown_connections 2024-04-26T20:57:37.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.304+0000 7f8a14800640 1 --2- 172.21.15.138:0/1697116260 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f89f00683b0 0x7f89f006a870 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:37.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.304+0000 7f8a14800640 1 --2- 172.21.15.138:0/1697116260 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a0c15bdc0 0x7f8a0c0c6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:37.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.304+0000 7f8a14800640 1 --2- 172.21.15.138:0/1697116260 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8a0c073d70 0x7f8a0c149030 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:37.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.304+0000 7f8a14800640 1 --2- 172.21.15.138:0/1697116260 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a0c06f880 0x7f8a0c15cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:37.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.304+0000 7f8a14800640 1 -- 172.21.15.138:0/1697116260 >> 172.21.15.138:0/1697116260 conn(0x7f8a0c0d0bb0 msgr2=0x7f8a0c165ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:37.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.304+0000 7f8a14800640 1 -- 172.21.15.138:0/1697116260 shutdown_connections 2024-04-26T20:57:37.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.304+0000 7f8a14800640 1 -- 172.21.15.138:0/1697116260 wait complete. 2024-04-26T20:57:37.329 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T20:57:37.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.460+0000 7f34c7e00640 1 Processor -- start 2024-04-26T20:57:37.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.464+0000 7f34c7e00640 1 -- start start 2024-04-26T20:57:37.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.464+0000 7f34c7e00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f34c80d26c0 0x7f34c80d0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:37.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.464+0000 7f34c7e00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34c80d13d0 con 0x7f34c8071600 2024-04-26T20:57:37.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.464+0000 7f34c7e00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34c80b4c30 con 0x7f34c806c300 2024-04-26T20:57:37.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.464+0000 7f34c7e00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f34c80d1640 con 0x7f34c80d26c0 2024-04-26T20:57:37.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.464+0000 7f34c6000640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f34c8071600 0x7f34c80cfd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:35546/0 (socket says 172.21.15.138:35546) 2024-04-26T20:57:37.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.464+0000 7f34c6000640 1 -- 172.21.15.138:0/1459799412 learned_addr learned my addr 172.21.15.138:0/1459799412 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:37.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.464+0000 7f34c7400640 1 --2- 172.21.15.138:0/1459799412 >> v2:172.21.15.143:3300/0 conn(0x7f34c80d26c0 0x7f34c80d0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:37.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.464+0000 7f34c5600640 1 -- 172.21.15.138:0/1459799412 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1663916016 0 0) 0x7f34c80d13d0 con 0x7f34c8071600 2024-04-26T20:57:37.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.464+0000 7f34c5600640 1 -- 172.21.15.138:0/1459799412 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34ac003530 con 0x7f34c8071600 2024-04-26T20:57:37.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.464+0000 7f34c7400640 1 -- 172.21.15.138:0/1459799412 >> v1:172.21.15.143:6789/0 conn(0x7f34c806c300 legacy=0x7f34c806c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:37.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.464+0000 7f34c7400640 1 -- 172.21.15.138:0/1459799412 >> v1:172.21.15.138:6789/0 conn(0x7f34c8071600 legacy=0x7f34c80cfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:37.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.464+0000 7f34c7400640 1 -- 172.21.15.138:0/1459799412 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34c80d1920 con 0x7f34c80d26c0 2024-04-26T20:57:37.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.468+0000 7f34c7400640 1 --2- 172.21.15.138:0/1459799412 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f34c80d26c0 0x7f34c80d0450 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f34c0009d90 tx=0x7f34c001c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d767a6004e0dc66 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:37.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.468+0000 7f34c5600640 1 -- 172.21.15.138:0/1459799412 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c00b2070 con 0x7f34c80d26c0 2024-04-26T20:57:37.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.468+0000 7f34c5600640 1 -- 172.21.15.138:0/1459799412 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34c00a59c0 con 0x7f34c80d26c0 2024-04-26T20:57:37.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.468+0000 7f34c5600640 1 -- 172.21.15.138:0/1459799412 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c00a5d90 con 0x7f34c80d26c0 2024-04-26T20:57:37.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.468+0000 7f34c7e00640 1 -- 172.21.15.138:0/1459799412 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f34c80d26c0 msgr2=0x7f34c80d0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:37.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.468+0000 7f34c7e00640 1 --2- 172.21.15.138:0/1459799412 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f34c80d26c0 0x7f34c80d0450 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f34c0009d90 tx=0x7f34c001c8e0 comp rx=0 tx=0).stop 2024-04-26T20:57:37.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.468+0000 7f34c7e00640 1 -- 172.21.15.138:0/1459799412 shutdown_connections 2024-04-26T20:57:37.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.468+0000 7f34c7e00640 1 --2- 172.21.15.138:0/1459799412 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f34c80d26c0 0x7f34c80d0450 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:37.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.468+0000 7f34c7e00640 1 -- 172.21.15.138:0/1459799412 >> 172.21.15.138:0/1459799412 conn(0x7f34c80d1ba0 msgr2=0x7f34c80d1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:37.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.468+0000 7f34c7e00640 1 -- 172.21.15.138:0/1459799412 shutdown_connections 2024-04-26T20:57:37.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.468+0000 7f34c7e00640 1 -- 172.21.15.138:0/1459799412 wait complete. 2024-04-26T20:57:37.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.468+0000 7f34c7e00640 1 Processor -- start 2024-04-26T20:57:37.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.468+0000 7f34c7e00640 1 -- start start 2024-04-26T20:57:37.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.472+0000 7f34c7e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34c806c300 0x7f34c814a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:37.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.472+0000 7f34c7e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f34c8071600 0x7f34c80b27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:37.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.472+0000 7f34c7e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f34c80d26c0 0x7f34c81500f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:37.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.472+0000 7f34c7e00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f34c816cee0 con 0x7f34c806c300 2024-04-26T20:57:37.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.472+0000 7f34c7e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f34c80d0ba0 con 0x7f34c8071600 2024-04-26T20:57:37.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.472+0000 7f34c7e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f34c816d060 con 0x7f34c80d26c0 2024-04-26T20:57:37.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.472+0000 7f34c6a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34c806c300 0x7f34c814a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:37.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.472+0000 7f34c6a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34c806c300 0x7f34c814a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:45192/0 (socket says 172.21.15.138:45192) 2024-04-26T20:57:37.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.472+0000 7f34c6a00640 1 -- 172.21.15.138:0/3292456242 learned_addr learned my addr 172.21.15.138:0/3292456242 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:37.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.472+0000 7f34c6000640 1 --2- 172.21.15.138:0/3292456242 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f34c8071600 0x7f34c80b27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:37.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.472+0000 7f34c7400640 1 --2- 172.21.15.138:0/3292456242 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f34c80d26c0 0x7f34c81500f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:37.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.472+0000 7f34c6a00640 1 -- 172.21.15.138:0/3292456242 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f34c80d26c0 msgr2=0x7f34c81500f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:37.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.472+0000 7f34c6a00640 1 --2- 172.21.15.138:0/3292456242 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f34c80d26c0 0x7f34c81500f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:37.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.472+0000 7f34c6a00640 1 -- 172.21.15.138:0/3292456242 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f34c8071600 msgr2=0x7f34c80b27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:37.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.472+0000 7f34c6a00640 1 --2- 172.21.15.138:0/3292456242 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f34c8071600 0x7f34c80b27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:37.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.472+0000 7f34c6a00640 1 -- 172.21.15.138:0/3292456242 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34c80b30f0 con 0x7f34c806c300 2024-04-26T20:57:37.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.472+0000 7f34c6000640 1 --2- 172.21.15.138:0/3292456242 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f34c8071600 0x7f34c80b27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:37.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.472+0000 7f34c6a00640 1 --2- 172.21.15.138:0/3292456242 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34c806c300 0x7f34c814a6d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f34b800c370 tx=0x7f34b800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:37.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.472+0000 7f34bea00640 1 -- 172.21.15.138:0/3292456242 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b80052d0 con 0x7f34c806c300 2024-04-26T20:57:37.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.472+0000 7f34bea00640 1 -- 172.21.15.138:0/3292456242 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34b8005470 con 0x7f34c806c300 2024-04-26T20:57:37.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.472+0000 7f34c7e00640 1 -- 172.21.15.138:0/3292456242 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34c80b33d0 con 0x7f34c806c300 2024-04-26T20:57:37.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.472+0000 7f34bea00640 1 -- 172.21.15.138:0/3292456242 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b8007260 con 0x7f34c806c300 2024-04-26T20:57:37.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.472+0000 7f34c7e00640 1 -- 172.21.15.138:0/3292456242 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34c814ac10 con 0x7f34c806c300 2024-04-26T20:57:37.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.472+0000 7f34c7e00640 1 -- 172.21.15.138:0/3292456242 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34c8069b40 con 0x7f34c806c300 2024-04-26T20:57:37.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.476+0000 7f34bea00640 1 -- 172.21.15.138:0/3292456242 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f34b8007400 con 0x7f34c806c300 2024-04-26T20:57:37.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.476+0000 7f34bea00640 1 --2- 172.21.15.138:0/3292456242 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f34a80683b0 0x7f34a806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:37.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.476+0000 7f34bea00640 1 -- 172.21.15.138:0/3292456242 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7f34b8086120 con 0x7f34c806c300 2024-04-26T20:57:37.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.476+0000 7f34c6000640 1 --2- 172.21.15.138:0/3292456242 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f34a80683b0 0x7f34a806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:37.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.476+0000 7f34c6000640 1 --2- 172.21.15.138:0/3292456242 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f34a80683b0 0x7f34a806a870 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f34c814d8e0 tx=0x7f34b4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:37.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.480+0000 7f34bea00640 1 -- 172.21.15.138:0/3292456242 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f34b80563e0 con 0x7f34c806c300 2024-04-26T20:57:37.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.636+0000 7f34c7e00640 1 -- 172.21.15.138:0/3292456242 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f34c80b35a0 con 0x7f34c806c300 2024-04-26T20:57:37.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.636+0000 7f34bea00640 1 -- 172.21.15.138:0/3292456242 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7f34b8055ce0 con 0x7f34c806c300 2024-04-26T20:57:37.642 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 64 2024-04-26T20:57:37.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.640+0000 7f34c7e00640 1 -- 172.21.15.138:0/3292456242 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f34a80683b0 msgr2=0x7f34a806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:37.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.640+0000 7f34c7e00640 1 --2- 172.21.15.138:0/3292456242 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f34a80683b0 0x7f34a806a870 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f34c814d8e0 tx=0x7f34b4009040 comp rx=0 tx=0).stop 2024-04-26T20:57:37.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.640+0000 7f34c7e00640 1 -- 172.21.15.138:0/3292456242 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34c806c300 msgr2=0x7f34c814a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:37.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.640+0000 7f34c7e00640 1 --2- 172.21.15.138:0/3292456242 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34c806c300 0x7f34c814a6d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f34b800c370 tx=0x7f34b800c830 comp rx=0 tx=0).stop 2024-04-26T20:57:37.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.640+0000 7f34c7e00640 1 -- 172.21.15.138:0/3292456242 shutdown_connections 2024-04-26T20:57:37.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.640+0000 7f34c7e00640 1 --2- 172.21.15.138:0/3292456242 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f34a80683b0 0x7f34a806a870 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:37.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.640+0000 7f34c7e00640 1 --2- 172.21.15.138:0/3292456242 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f34c80d26c0 0x7f34c81500f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:37.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.640+0000 7f34c7e00640 1 --2- 172.21.15.138:0/3292456242 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f34c8071600 0x7f34c80b27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:37.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.640+0000 7f34c7e00640 1 --2- 172.21.15.138:0/3292456242 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34c806c300 0x7f34c814a6d0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:37.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.640+0000 7f34c7e00640 1 -- 172.21.15.138:0/3292456242 >> 172.21.15.138:0/3292456242 conn(0x7f34c80d1ba0 msgr2=0x7f34c80af840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:37.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.640+0000 7f34c7e00640 1 -- 172.21.15.138:0/3292456242 shutdown_connections 2024-04-26T20:57:37.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.640+0000 7f34c7e00640 1 -- 172.21.15.138:0/3292456242 wait complete. 2024-04-26T20:57:37.663 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T20:57:37.733 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:57:37.736 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:57:37.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.796+0000 7fd017600640 1 Processor -- start 2024-04-26T20:57:37.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.796+0000 7fd017600640 1 -- start start 2024-04-26T20:57:37.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.800+0000 7fd017600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd01015bdc0 0x7fd01015f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:37.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.800+0000 7fd017600640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd010073d70 0x7fd01015fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:37.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.800+0000 7fd017600640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd01006dee0 con 0x7fd01006f880 2024-04-26T20:57:37.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.800+0000 7fd017600640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fd01015c1a0 con 0x7fd010073d70 2024-04-26T20:57:37.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.800+0000 7fd017600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fd01006e180 con 0x7fd01015bdc0 2024-04-26T20:57:37.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.800+0000 7fd00fe00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd010073d70 0x7fd01015fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:37.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.800+0000 7fd00fe00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd010073d70 0x7fd01015fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:45198/0 (socket says 172.21.15.138:45198) 2024-04-26T20:57:37.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.800+0000 7fd00fe00640 1 -- 172.21.15.138:0/3577593785 learned_addr learned my addr 172.21.15.138:0/3577593785 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:37.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.800+0000 7fd00fe00640 1 -- 172.21.15.138:0/3577593785 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd01015bdc0 msgr2=0x7fd01015f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:37.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.800+0000 7fd014c00640 1 --2- 172.21.15.138:0/3577593785 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd01015bdc0 0x7fd01015f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:37.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.800+0000 7fd00fe00640 1 --2- 172.21.15.138:0/3577593785 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd01015bdc0 0x7fd01015f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:37.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.800+0000 7fd00fe00640 1 -- 172.21.15.138:0/3577593785 >> v1:172.21.15.143:6789/0 conn(0x7fd01006f880 legacy=0x7fd0100cb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:37.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.800+0000 7fd00fe00640 1 -- 172.21.15.138:0/3577593785 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd01006e460 con 0x7fd010073d70 2024-04-26T20:57:37.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.800+0000 7fd014c00640 1 --2- 172.21.15.138:0/3577593785 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd01015bdc0 0x7fd01015f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:57:37.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.804+0000 7fd00fe00640 1 --2- 172.21.15.138:0/3577593785 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd010073d70 0x7fd01015fe70 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd000009870 tx=0x7fd00001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=706ddd75b816e008 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:37.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.804+0000 7fd00f400640 1 -- 172.21.15.138:0/3577593785 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0000b0070 con 0x7fd010073d70 2024-04-26T20:57:37.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.804+0000 7fd00f400640 1 -- 172.21.15.138:0/3577593785 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0000ab600 con 0x7fd010073d70 2024-04-26T20:57:37.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.804+0000 7fd00f400640 1 -- 172.21.15.138:0/3577593785 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0000ab9d0 con 0x7fd010073d70 2024-04-26T20:57:37.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.804+0000 7fd017600640 1 -- 172.21.15.138:0/3577593785 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd010073d70 msgr2=0x7fd01015fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:37.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.804+0000 7fd017600640 1 --2- 172.21.15.138:0/3577593785 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd010073d70 0x7fd01015fe70 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd000009870 tx=0x7fd00001c490 comp rx=0 tx=0).stop 2024-04-26T20:57:37.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.804+0000 7fd017600640 1 -- 172.21.15.138:0/3577593785 shutdown_connections 2024-04-26T20:57:37.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.804+0000 7fd017600640 1 --2- 172.21.15.138:0/3577593785 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd010073d70 0x7fd01015fe70 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:37.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.804+0000 7fd017600640 1 --2- 172.21.15.138:0/3577593785 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd01015bdc0 0x7fd01015f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:37.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.804+0000 7fd017600640 1 -- 172.21.15.138:0/3577593785 >> 172.21.15.138:0/3577593785 conn(0x7fd0100d0bb0 msgr2=0x7fd0100d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:37.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.804+0000 7fd017600640 1 -- 172.21.15.138:0/3577593785 shutdown_connections 2024-04-26T20:57:37.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.804+0000 7fd017600640 1 -- 172.21.15.138:0/3577593785 wait complete. 2024-04-26T20:57:37.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.804+0000 7fd017600640 1 Processor -- start 2024-04-26T20:57:37.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.804+0000 7fd017600640 1 -- start start 2024-04-26T20:57:37.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.804+0000 7fd017600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd01006f880 0x7fd01015a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:37.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.804+0000 7fd017600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd010073d70 0x7fd0100b5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:37.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.804+0000 7fd017600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd01015bdc0 0x7fd0100b5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:37.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.804+0000 7fd017600640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd010167050 con 0x7fd010073d70 2024-04-26T20:57:37.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.804+0000 7fd017600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fd010166ed0 con 0x7fd01006f880 2024-04-26T20:57:37.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.804+0000 7fd017600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fd0101671d0 con 0x7fd01015bdc0 2024-04-26T20:57:37.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.804+0000 7fd00fe00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd010073d70 0x7fd0100b5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:37.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.808+0000 7fd00fe00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd010073d70 0x7fd0100b5840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:45202/0 (socket says 172.21.15.138:45202) 2024-04-26T20:57:37.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.808+0000 7fd00fe00640 1 -- 172.21.15.138:0/1091326015 learned_addr learned my addr 172.21.15.138:0/1091326015 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:37.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.808+0000 7fd014c00640 1 --2- 172.21.15.138:0/1091326015 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd01006f880 0x7fd01015a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:37.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.808+0000 7fd015600640 1 --2- 172.21.15.138:0/1091326015 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd01015bdc0 0x7fd0100b5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:37.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.808+0000 7fd00fe00640 1 -- 172.21.15.138:0/1091326015 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd01015bdc0 msgr2=0x7fd0100b5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:37.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.808+0000 7fd00fe00640 1 --2- 172.21.15.138:0/1091326015 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd01015bdc0 0x7fd0100b5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:37.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.808+0000 7fd00fe00640 1 -- 172.21.15.138:0/1091326015 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd01006f880 msgr2=0x7fd01015a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:37.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.808+0000 7fd00fe00640 1 --2- 172.21.15.138:0/1091326015 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd01006f880 0x7fd01015a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:37.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.808+0000 7fd00fe00640 1 -- 172.21.15.138:0/1091326015 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0100b25b0 con 0x7fd010073d70 2024-04-26T20:57:37.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.808+0000 7fd00fe00640 1 --2- 172.21.15.138:0/1091326015 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd010073d70 0x7fd0100b5840 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd0000ae040 tx=0x7fd000019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:37.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.808+0000 7fd00cc00640 1 -- 172.21.15.138:0/1091326015 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0000b0040 con 0x7fd010073d70 2024-04-26T20:57:37.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.808+0000 7fd00cc00640 1 -- 172.21.15.138:0/1091326015 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0000b4640 con 0x7fd010073d70 2024-04-26T20:57:37.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.808+0000 7fd017600640 1 -- 172.21.15.138:0/1091326015 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0100cab80 con 0x7fd010073d70 2024-04-26T20:57:37.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.808+0000 7fd00cc00640 1 -- 172.21.15.138:0/1091326015 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0000b4a30 con 0x7fd010073d70 2024-04-26T20:57:37.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.808+0000 7fd017600640 1 -- 172.21.15.138:0/1091326015 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0100ca8a0 con 0x7fd010073d70 2024-04-26T20:57:37.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.808+0000 7fd017600640 1 -- 172.21.15.138:0/1091326015 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd010069430 con 0x7fd010073d70 2024-04-26T20:57:37.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.808+0000 7fd00cc00640 1 -- 172.21.15.138:0/1091326015 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd0000ab4c0 con 0x7fd010073d70 2024-04-26T20:57:37.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.812+0000 7fd00cc00640 1 --2- 172.21.15.138:0/1091326015 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fcfec068380 0x7fcfec06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:37.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.812+0000 7fd00cc00640 1 -- 172.21.15.138:0/1091326015 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7fd0001209c0 con 0x7fd010073d70 2024-04-26T20:57:37.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.812+0000 7fd014c00640 1 --2- 172.21.15.138:0/1091326015 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fcfec068380 0x7fcfec06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:37.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.812+0000 7fd014c00640 1 --2- 172.21.15.138:0/1091326015 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fcfec068380 0x7fcfec06a840 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcff8006fd0 tx=0x7fcff8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:37.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.816+0000 7fd00cc00640 1 -- 172.21.15.138:0/1091326015 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd000016110 con 0x7fd010073d70 2024-04-26T20:57:37.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.972+0000 7fd017600640 1 -- 172.21.15.138:0/1091326015 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fd0100d19c0 con 0x7fd010073d70 2024-04-26T20:57:37.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.972+0000 7fd00cc00640 1 -- 172.21.15.138:0/1091326015 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7fd0000f0d00 con 0x7fd010073d70 2024-04-26T20:57:37.976 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 32 2024-04-26T20:57:37.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.972+0000 7fd017600640 1 -- 172.21.15.138:0/1091326015 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fcfec068380 msgr2=0x7fcfec06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:37.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.972+0000 7fd017600640 1 --2- 172.21.15.138:0/1091326015 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fcfec068380 0x7fcfec06a840 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcff8006fd0 tx=0x7fcff8008040 comp rx=0 tx=0).stop 2024-04-26T20:57:37.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.972+0000 7fd017600640 1 -- 172.21.15.138:0/1091326015 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd010073d70 msgr2=0x7fd0100b5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:37.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.972+0000 7fd017600640 1 --2- 172.21.15.138:0/1091326015 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd010073d70 0x7fd0100b5840 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd0000ae040 tx=0x7fd000019230 comp rx=0 tx=0).stop 2024-04-26T20:57:37.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.972+0000 7fd017600640 1 -- 172.21.15.138:0/1091326015 shutdown_connections 2024-04-26T20:57:37.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.972+0000 7fd017600640 1 --2- 172.21.15.138:0/1091326015 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fcfec068380 0x7fcfec06a840 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:37.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.972+0000 7fd017600640 1 --2- 172.21.15.138:0/1091326015 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd01015bdc0 0x7fd0100b5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:37.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.972+0000 7fd017600640 1 --2- 172.21.15.138:0/1091326015 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd010073d70 0x7fd0100b5840 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:37.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.972+0000 7fd017600640 1 --2- 172.21.15.138:0/1091326015 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd01006f880 0x7fd01015a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:37.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.972+0000 7fd017600640 1 -- 172.21.15.138:0/1091326015 >> 172.21.15.138:0/1091326015 conn(0x7fd0100d0bb0 msgr2=0x7fd0100cb620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:37.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.972+0000 7fd017600640 1 -- 172.21.15.138:0/1091326015 shutdown_connections 2024-04-26T20:57:37.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:37.972+0000 7fd017600640 1 -- 172.21.15.138:0/1091326015 wait complete. 2024-04-26T20:57:37.997 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:57:38.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.172+0000 7f1c39a00640 1 Processor -- start 2024-04-26T20:57:38.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.172+0000 7f1c39a00640 1 -- start start 2024-04-26T20:57:38.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.172+0000 7f1c39a00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f1c3415cf80 0x7f1c34073b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:38.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.172+0000 7f1c39a00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c340727f0 con 0x7f1c340cc1e0 2024-04-26T20:57:38.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.172+0000 7f1c39a00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c34072a70 con 0x7f1c340cbe00 2024-04-26T20:57:38.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.172+0000 7f1c39a00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f1c34073680 con 0x7f1c3415cf80 2024-04-26T20:57:38.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.172+0000 7f1c2a000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f1c3415cf80 0x7f1c34073b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:38.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.172+0000 7f1c33400640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f1c340cc1e0 0x7f1c340ce6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:35560/0 (socket says 172.21.15.138:35560) 2024-04-26T20:57:38.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.172+0000 7f1c2a000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f1c3415cf80 0x7f1c34073b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:45208/0 (socket says 172.21.15.138:45208) 2024-04-26T20:57:38.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.172+0000 7f1c33400640 1 -- 172.21.15.138:0/1926068882 learned_addr learned my addr 172.21.15.138:0/1926068882 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:38.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.172+0000 7f1c2a000640 1 -- 172.21.15.138:0/1926068882 >> v1:172.21.15.143:6789/0 conn(0x7f1c340cbe00 legacy=0x7f1c3406de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:38.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.172+0000 7f1c2a000640 1 -- 172.21.15.138:0/1926068882 >> v1:172.21.15.138:6789/0 conn(0x7f1c340cc1e0 legacy=0x7f1c340ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:38.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.172+0000 7f1c2a000640 1 -- 172.21.15.138:0/1926068882 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c34072d50 con 0x7f1c3415cf80 2024-04-26T20:57:38.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.172+0000 7f1c32000640 1 -- 172.21.15.138:0/1926068882 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4153471460 0 0) 0x7f1c2c001120 con 0x7f1c340cc1e0 2024-04-26T20:57:38.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.176+0000 7f1c2a000640 1 --2- 172.21.15.138:0/1926068882 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c3415cf80 0x7f1c34073b10 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c00ba60 tx=0x7f1c1c01eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9101e423e2791be server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:38.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.176+0000 7f1c32000640 1 -- 172.21.15.138:0/1926068882 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c0b4070 con 0x7f1c3415cf80 2024-04-26T20:57:38.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.176+0000 7f1c32000640 1 -- 172.21.15.138:0/1926068882 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c1c0a7a50 con 0x7f1c3415cf80 2024-04-26T20:57:38.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.176+0000 7f1c32000640 1 -- 172.21.15.138:0/1926068882 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c0a7e20 con 0x7f1c3415cf80 2024-04-26T20:57:38.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.176+0000 7f1c39a00640 1 -- 172.21.15.138:0/1926068882 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c3415cf80 msgr2=0x7f1c34073b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:38.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.176+0000 7f1c39a00640 1 --2- 172.21.15.138:0/1926068882 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c3415cf80 0x7f1c34073b10 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c00ba60 tx=0x7f1c1c01eb70 comp rx=0 tx=0).stop 2024-04-26T20:57:38.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.176+0000 7f1c39a00640 1 -- 172.21.15.138:0/1926068882 shutdown_connections 2024-04-26T20:57:38.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.176+0000 7f1c39a00640 1 --2- 172.21.15.138:0/1926068882 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c3415cf80 0x7f1c34073b10 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:38.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.176+0000 7f1c39a00640 1 -- 172.21.15.138:0/1926068882 >> 172.21.15.138:0/1926068882 conn(0x7f1c340d0b20 msgr2=0x7f1c340d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:38.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.176+0000 7f1c39a00640 1 -- 172.21.15.138:0/1926068882 shutdown_connections 2024-04-26T20:57:38.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.176+0000 7f1c39a00640 1 -- 172.21.15.138:0/1926068882 wait complete. 2024-04-26T20:57:38.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.180+0000 7f1c39a00640 1 Processor -- start 2024-04-26T20:57:38.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.180+0000 7f1c39a00640 1 -- start start 2024-04-26T20:57:38.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.180+0000 7f1c39a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1c340cbe00 0x7f1c34156650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:38.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.180+0000 7f1c39a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c340cc1e0 0x7f1c341f8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:38.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.180+0000 7f1c39a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1c3415cf80 0x7f1c341584a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:38.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.180+0000 7f1c39a00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f1c340d0900 con 0x7f1c340cc1e0 2024-04-26T20:57:38.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.180+0000 7f1c39a00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f1c340d0780 con 0x7f1c3415cf80 2024-04-26T20:57:38.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.180+0000 7f1c39a00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f1c3406ef10 con 0x7f1c340cbe00 2024-04-26T20:57:38.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.180+0000 7f1c2a000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c340cc1e0 0x7f1c341f8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:38.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.180+0000 7f1c2a000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c340cc1e0 0x7f1c341f8060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:45220/0 (socket says 172.21.15.138:45220) 2024-04-26T20:57:38.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.180+0000 7f1c2a000640 1 -- 172.21.15.138:0/3955190055 learned_addr learned my addr 172.21.15.138:0/3955190055 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:38.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.180+0000 7f1c32a00640 1 --2- 172.21.15.138:0/3955190055 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1c340cbe00 0x7f1c34156650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:38.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.180+0000 7f1c33400640 1 --2- 172.21.15.138:0/3955190055 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1c3415cf80 0x7f1c341584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:38.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.180+0000 7f1c2a000640 1 -- 172.21.15.138:0/3955190055 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1c340cbe00 msgr2=0x7f1c34156650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:38.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.180+0000 7f1c2a000640 1 --2- 172.21.15.138:0/3955190055 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1c340cbe00 0x7f1c34156650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:38.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.180+0000 7f1c2a000640 1 -- 172.21.15.138:0/3955190055 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1c3415cf80 msgr2=0x7f1c341584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:38.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.180+0000 7f1c2a000640 1 --2- 172.21.15.138:0/3955190055 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1c3415cf80 0x7f1c341584a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:38.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.180+0000 7f1c2a000640 1 -- 172.21.15.138:0/3955190055 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c340c9950 con 0x7f1c340cc1e0 2024-04-26T20:57:38.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.180+0000 7f1c2a000640 1 --2- 172.21.15.138:0/3955190055 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c340cc1e0 0x7f1c341f8060 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c0b2040 tx=0x7f1c1c01b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:38.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.180+0000 7f1c2b400640 1 -- 172.21.15.138:0/3955190055 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c0bf070 con 0x7f1c340cc1e0 2024-04-26T20:57:38.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.180+0000 7f1c2b400640 1 -- 172.21.15.138:0/3955190055 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c1c0afde0 con 0x7f1c340cc1e0 2024-04-26T20:57:38.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.180+0000 7f1c39a00640 1 -- 172.21.15.138:0/3955190055 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c340aea60 con 0x7f1c340cc1e0 2024-04-26T20:57:38.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.180+0000 7f1c2b400640 1 -- 172.21.15.138:0/3955190055 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c0b4040 con 0x7f1c340cc1e0 2024-04-26T20:57:38.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.180+0000 7f1c39a00640 1 -- 172.21.15.138:0/3955190055 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c341f85a0 con 0x7f1c340cc1e0 2024-04-26T20:57:38.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.184+0000 7f1c39a00640 1 -- 172.21.15.138:0/3955190055 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c34069510 con 0x7f1c340cc1e0 2024-04-26T20:57:38.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.184+0000 7f1c2b400640 1 -- 172.21.15.138:0/3955190055 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1c1c0c2070 con 0x7f1c340cc1e0 2024-04-26T20:57:38.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.184+0000 7f1c2b400640 1 --2- 172.21.15.138:0/3955190055 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1c10068380 0x7f1c1006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:38.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.184+0000 7f1c2b400640 1 -- 172.21.15.138:0/3955190055 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7f1c1c121270 con 0x7f1c340cc1e0 2024-04-26T20:57:38.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.184+0000 7f1c32a00640 1 --2- 172.21.15.138:0/3955190055 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1c10068380 0x7f1c1006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:38.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.184+0000 7f1c32a00640 1 --2- 172.21.15.138:0/3955190055 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1c10068380 0x7f1c1006a840 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1c34159ce0 tx=0x7f1c24009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:38.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.188+0000 7f1c2b400640 1 -- 172.21.15.138:0/3955190055 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1c1c018760 con 0x7f1c340cc1e0 2024-04-26T20:57:38.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.376+0000 7f1c39a00640 1 -- 172.21.15.138:0/3955190055 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1c34075260 con 0x7f1c340cc1e0 2024-04-26T20:57:38.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.376+0000 7f1c2b400640 1 -- 172.21.15.138:0/3955190055 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5189 (secure 0 0 0) 0x7f1c1c0f1490 con 0x7f1c340cc1e0 2024-04-26T20:57:38.383 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:57:38.383 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/3495262740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3495262740},{"type":"v1","addr":"172.21.15.143:6837","nonce":3495262740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4273,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/1806638334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":1806638334},{"type":"v1","addr":"172.21.15.138:6834","nonce":1806638334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/3333703637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":3333703637},{"type":"v1","addr":"172.21.15.138:6835","nonce":3333703637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:56:39.581500+0000","modified":"2024-04-26T20:56:57.692718+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6836/3598364176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":3598364176},{"type":"v1","addr":"172.21.15.143:6836","nonce":3598364176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-04-26T20:57:38.383 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 9 2024-04-26T20:57:38.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.380+0000 7f1c39a00640 1 -- 172.21.15.138:0/3955190055 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1c10068380 msgr2=0x7f1c1006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:38.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.380+0000 7f1c39a00640 1 --2- 172.21.15.138:0/3955190055 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1c10068380 0x7f1c1006a840 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1c34159ce0 tx=0x7f1c24009040 comp rx=0 tx=0).stop 2024-04-26T20:57:38.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.380+0000 7f1c39a00640 1 -- 172.21.15.138:0/3955190055 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c340cc1e0 msgr2=0x7f1c341f8060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:38.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.380+0000 7f1c39a00640 1 --2- 172.21.15.138:0/3955190055 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c340cc1e0 0x7f1c341f8060 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c0b2040 tx=0x7f1c1c01b910 comp rx=0 tx=0).stop 2024-04-26T20:57:38.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.380+0000 7f1c39a00640 1 -- 172.21.15.138:0/3955190055 shutdown_connections 2024-04-26T20:57:38.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.380+0000 7f1c39a00640 1 --2- 172.21.15.138:0/3955190055 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1c10068380 0x7f1c1006a840 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:38.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.380+0000 7f1c39a00640 1 --2- 172.21.15.138:0/3955190055 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1c3415cf80 0x7f1c341584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:38.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.380+0000 7f1c39a00640 1 --2- 172.21.15.138:0/3955190055 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c340cc1e0 0x7f1c341f8060 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:38.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.380+0000 7f1c39a00640 1 --2- 172.21.15.138:0/3955190055 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1c340cbe00 0x7f1c34156650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:38.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.380+0000 7f1c39a00640 1 -- 172.21.15.138:0/3955190055 >> 172.21.15.138:0/3955190055 conn(0x7f1c340d0b20 msgr2=0x7f1c3415bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:38.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.380+0000 7f1c39a00640 1 -- 172.21.15.138:0/3955190055 shutdown_connections 2024-04-26T20:57:38.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.380+0000 7f1c39a00640 1 -- 172.21.15.138:0/3955190055 wait complete. 2024-04-26T20:57:38.403 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:57:38.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.532+0000 7faccb400640 1 Processor -- start 2024-04-26T20:57:38.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.532+0000 7faccb400640 1 -- start start 2024-04-26T20:57:38.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.536+0000 7faccb400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7facc4160140 0x7facc40b4470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:38.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.536+0000 7faccb400640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7facc40b49b0 0x7facc4072950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:38.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.536+0000 7faccb400640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facc40b4f10 con 0x7facc406cf60 2024-04-26T20:57:38.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.536+0000 7faccb400640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7facc406c480 con 0x7facc40b49b0 2024-04-26T20:57:38.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.536+0000 7faccb400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7facc406c760 con 0x7facc4160140 2024-04-26T20:57:38.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.536+0000 7facc8a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7facc4160140 0x7facc40b4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:38.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.536+0000 7facbbe00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7facc40b49b0 0x7facc4072950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:38.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.536+0000 7facc9400640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7facc406cf60 0x7facc406e7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.138:58016/0 (socket says 172.21.15.138:58016) 2024-04-26T20:57:38.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.536+0000 7facc9400640 1 -- 172.21.15.138:0/1399872266 learned_addr learned my addr 172.21.15.138:0/1399872266 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:38.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.536+0000 7facc8a00640 1 -- 172.21.15.138:0/1399872266 >> v2:172.21.15.143:3300/0 conn(0x7facc40b49b0 msgr2=0x7facc4072950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:38.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.536+0000 7facc8a00640 1 --2- 172.21.15.138:0/1399872266 >> v2:172.21.15.143:3300/0 conn(0x7facc40b49b0 0x7facc4072950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:38.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.536+0000 7facc8a00640 1 -- 172.21.15.138:0/1399872266 >> v1:172.21.15.143:6789/0 conn(0x7facc406cf60 legacy=0x7facc406e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:38.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.536+0000 7facc8a00640 1 -- 172.21.15.138:0/1399872266 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facc406ca40 con 0x7facc4160140 2024-04-26T20:57:38.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.536+0000 7facbbe00640 1 --2- 172.21.15.138:0/1399872266 >> v2:172.21.15.143:3300/0 conn(0x7facc40b49b0 0x7facc4072950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:57:38.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.536+0000 7facc3e00640 1 -- 172.21.15.138:0/1399872266 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3754976376 0 0) 0x7facc40b4f10 con 0x7facc406cf60 2024-04-26T20:57:38.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.540+0000 7facc8a00640 1 --2- 172.21.15.138:0/1399872266 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7facc4160140 0x7facc40b4470 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7facb40097c0 tx=0x7facb401c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb91004ceb144ad8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:38.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.540+0000 7facc3e00640 1 -- 172.21.15.138:0/1399872266 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb40b0070 con 0x7facc4160140 2024-04-26T20:57:38.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.540+0000 7facc3e00640 1 -- 172.21.15.138:0/1399872266 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facb40ab600 con 0x7facc4160140 2024-04-26T20:57:38.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.540+0000 7facc3e00640 1 -- 172.21.15.138:0/1399872266 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb40ab9d0 con 0x7facc4160140 2024-04-26T20:57:38.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.540+0000 7faccb400640 1 -- 172.21.15.138:0/1399872266 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7facc4160140 msgr2=0x7facc40b4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:38.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.540+0000 7faccb400640 1 --2- 172.21.15.138:0/1399872266 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7facc4160140 0x7facc40b4470 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7facb40097c0 tx=0x7facb401c410 comp rx=0 tx=0).stop 2024-04-26T20:57:38.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.540+0000 7faccb400640 1 -- 172.21.15.138:0/1399872266 shutdown_connections 2024-04-26T20:57:38.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.540+0000 7faccb400640 1 --2- 172.21.15.138:0/1399872266 >> v2:172.21.15.143:3300/0 conn(0x7facc40b49b0 0x7facc4072950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:38.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.540+0000 7faccb400640 1 --2- 172.21.15.138:0/1399872266 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7facc4160140 0x7facc40b4470 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:38.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.540+0000 7faccb400640 1 -- 172.21.15.138:0/1399872266 >> 172.21.15.138:0/1399872266 conn(0x7facc40b3570 msgr2=0x7facc40b3980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:38.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.540+0000 7faccb400640 1 -- 172.21.15.138:0/1399872266 shutdown_connections 2024-04-26T20:57:38.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.540+0000 7faccb400640 1 -- 172.21.15.138:0/1399872266 wait complete. 2024-04-26T20:57:38.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.540+0000 7faccb400640 1 Processor -- start 2024-04-26T20:57:38.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.540+0000 7faccb400640 1 -- start start 2024-04-26T20:57:38.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.544+0000 7faccb400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7facc406cf60 0x7facc4159460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:38.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.544+0000 7faccb400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7facc40b49b0 0x7facc415b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:38.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.544+0000 7faccb400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7facc4160140 0x7facc41413a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:38.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.544+0000 7faccb400640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7facc416c3f0 con 0x7facc406cf60 2024-04-26T20:57:38.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.544+0000 7faccb400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7facc416c270 con 0x7facc4160140 2024-04-26T20:57:38.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.544+0000 7faccb400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7facc416c570 con 0x7facc40b49b0 2024-04-26T20:57:38.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.544+0000 7facc8a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7facc406cf60 0x7facc4159460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:38.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.544+0000 7facc8a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7facc406cf60 0x7facc4159460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:45222/0 (socket says 172.21.15.138:45222) 2024-04-26T20:57:38.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.544+0000 7facc8a00640 1 -- 172.21.15.138:0/9334578 learned_addr learned my addr 172.21.15.138:0/9334578 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:38.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.544+0000 7facc9400640 1 --2- 172.21.15.138:0/9334578 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7facc4160140 0x7facc41413a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:38.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.544+0000 7facbbe00640 1 --2- 172.21.15.138:0/9334578 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7facc40b49b0 0x7facc415b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:38.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.544+0000 7facc8a00640 1 -- 172.21.15.138:0/9334578 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7facc40b49b0 msgr2=0x7facc415b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:38.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.544+0000 7facc8a00640 1 --2- 172.21.15.138:0/9334578 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7facc40b49b0 0x7facc415b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:38.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.544+0000 7facc8a00640 1 -- 172.21.15.138:0/9334578 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7facc4160140 msgr2=0x7facc41413a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:38.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.544+0000 7facc8a00640 1 --2- 172.21.15.138:0/9334578 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7facc4160140 0x7facc41413a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:38.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.544+0000 7facc8a00640 1 -- 172.21.15.138:0/9334578 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facc4157c40 con 0x7facc406cf60 2024-04-26T20:57:38.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.544+0000 7facc8a00640 1 --2- 172.21.15.138:0/9334578 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7facc406cf60 0x7facc4159460 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7facb40ae040 tx=0x7facb401ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:38.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.544+0000 7facc1600640 1 -- 172.21.15.138:0/9334578 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb40b0050 con 0x7facc406cf60 2024-04-26T20:57:38.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.544+0000 7facc1600640 1 -- 172.21.15.138:0/9334578 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facb40bc070 con 0x7facc406cf60 2024-04-26T20:57:38.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.544+0000 7facc1600640 1 -- 172.21.15.138:0/9334578 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb40b5a50 con 0x7facc406cf60 2024-04-26T20:57:38.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.544+0000 7faccb400640 1 -- 172.21.15.138:0/9334578 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facc41408c0 con 0x7facc406cf60 2024-04-26T20:57:38.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.544+0000 7faccb400640 1 -- 172.21.15.138:0/9334578 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facc4141ff0 con 0x7facc406cf60 2024-04-26T20:57:38.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.544+0000 7faccb400640 1 -- 172.21.15.138:0/9334578 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facc4069510 con 0x7facc406cf60 2024-04-26T20:57:38.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.544+0000 7facc1600640 1 -- 172.21.15.138:0/9334578 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7facb40b5bf0 con 0x7facc406cf60 2024-04-26T20:57:38.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.548+0000 7facc1600640 1 --2- 172.21.15.138:0/9334578 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7faca0068380 0x7faca006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:38.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.548+0000 7facc1600640 1 -- 172.21.15.138:0/9334578 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7facb41217a0 con 0x7facc406cf60 2024-04-26T20:57:38.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.548+0000 7facbbe00640 1 --2- 172.21.15.138:0/9334578 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7faca0068380 0x7faca006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:38.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.548+0000 7facbbe00640 1 --2- 172.21.15.138:0/9334578 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7faca0068380 0x7faca006a840 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7facc4155a20 tx=0x7facac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:38.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.552+0000 7facc1600640 1 -- 172.21.15.138:0/9334578 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7facb4016090 con 0x7facc406cf60 2024-04-26T20:57:38.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.712+0000 7faccb400640 1 -- 172.21.15.138:0/9334578 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7facc406d720 con 0x7facc406cf60 2024-04-26T20:57:38.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.712+0000 7facc1600640 1 -- 172.21.15.138:0/9334578 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18719 (secure 0 0 0) 0x7facb40f1930 con 0x7facc406cf60 2024-04-26T20:57:38.717 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:57:38.717 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":29,"fsid":"c22b4730-12cc-4558-8535-b965384398c0","created":"2024-04-26T20:56:14.182475+0000","modified":"2024-04-26T20:57:20.395184+0000","last_up_change":"2024-04-26T20:56:26.013243+0000","last_in_change":"2024-04-26T20:56:16.714055+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:56:27.265834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:56:37.394398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:56:38.544369+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:56:42.240243+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3f9a2e34-3199-466f-a6cf-57927318121e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6801","nonce":3534772245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6803","nonce":3534772245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6807","nonce":3534772245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6805","nonce":3534772245}]},"public_addr":"172.21.15.138:6801/3534772245","cluster_addr":"172.21.15.138:6803/3534772245","heartbeat_back_addr":"172.21.15.138:6807/3534772245","heartbeat_front_addr":"172.21.15.138:6805/3534772245","state":["exists","up"]},{"osd":1,"uuid":"e881fcf6-3248-4696-a2ef-95d206d77712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6817","nonce":1427635773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6819","nonce":1427635773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6823","nonce":1427635773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6821","nonce":1427635773}]},"public_addr":"172.21.15.138:6817/1427635773","cluster_addr":"172.21.15.138:6819/1427635773","heartbeat_back_addr":"172.21.15.138:6823/1427635773","heartbeat_front_addr":"172.21.15.138:6821/1427635773","state":["exists","up"]},{"osd":2,"uuid":"f7d1db33-7672-4699-ae47-9f1e0a8e4222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6809","nonce":4273721573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6811","nonce":4273721573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6815","nonce":4273721573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6813","nonce":4273721573}]},"public_addr":"172.21.15.138:6809/4273721573","cluster_addr":"172.21.15.138:6811/4273721573","heartbeat_back_addr":"172.21.15.138:6815/4273721573","heartbeat_front_addr":"172.21.15.138:6813/4273721573","state":["exists","up"]},{"osd":3,"uuid":"2f4e0a9a-b8f6-4468-844a-a4501cd85054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6825","nonce":3098242154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6827","nonce":3098242154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6831","nonce":3098242154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6829","nonce":3098242154}]},"public_addr":"172.21.15.138:6825/3098242154","cluster_addr":"172.21.15.138:6827/3098242154","heartbeat_back_addr":"172.21.15.138:6831/3098242154","heartbeat_front_addr":"172.21.15.138:6829/3098242154","state":["exists","up"]},{"osd":4,"uuid":"c85df99b-3624-410e-866b-86830af2cfe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6801","nonce":2942056312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6803","nonce":2942056312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6807","nonce":2942056312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6805","nonce":2942056312}]},"public_addr":"172.21.15.143:6801/2942056312","cluster_addr":"172.21.15.143:6803/2942056312","heartbeat_back_addr":"172.21.15.143:6807/2942056312","heartbeat_front_addr":"172.21.15.143:6805/2942056312","state":["exists","up"]},{"osd":5,"uuid":"9af1efb5-c416-4808-b5ef-de0679ab9705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6809","nonce":1910222887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6811","nonce":1910222887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6815","nonce":1910222887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6813","nonce":1910222887}]},"public_addr":"172.21.15.143:6809/1910222887","cluster_addr":"172.21.15.143:6811/1910222887","heartbeat_back_addr":"172.21.15.143:6815/1910222887","heartbeat_front_addr":"172.21.15.143:6813/1910222887","state":["exists","up"]},{"osd":6,"uuid":"d7138615-8838-45ff-9072-2fd0683362f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6817","nonce":1082239825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6819","nonce":1082239825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6823","nonce":1082239825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6821","nonce":1082239825}]},"public_addr":"172.21.15.143:6817/1082239825","cluster_addr":"172.21.15.143:6819/1082239825","heartbeat_back_addr":"172.21.15.143:6823/1082239825","heartbeat_front_addr":"172.21.15.143:6821/1082239825","state":["exists","up"]},{"osd":7,"uuid":"0c27172b-35c4-49ec-ba0b-0137b8ff0010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6825","nonce":3295508495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6827","nonce":3295508495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6831","nonce":3295508495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6829","nonce":3295508495}]},"public_addr":"172.21.15.143:6825/3295508495","cluster_addr":"172.21.15.143:6827/3295508495","heartbeat_back_addr":"172.21.15.143:6831/3295508495","heartbeat_front_addr":"172.21.15.143:6829/3295508495","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.326627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.396119+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.433915+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.414179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.216947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.329272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.503073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.436382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.39","mappings":[{"from":0,"to":7}]},{"pgid":"4.6","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:57:38.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.712+0000 7faccb400640 1 -- 172.21.15.138:0/9334578 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7faca0068380 msgr2=0x7faca006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:38.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.712+0000 7faccb400640 1 --2- 172.21.15.138:0/9334578 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7faca0068380 0x7faca006a840 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7facc4155a20 tx=0x7facac008040 comp rx=0 tx=0).stop 2024-04-26T20:57:38.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.712+0000 7faccb400640 1 -- 172.21.15.138:0/9334578 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7facc406cf60 msgr2=0x7facc4159460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:38.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.712+0000 7faccb400640 1 --2- 172.21.15.138:0/9334578 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7facc406cf60 0x7facc4159460 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7facb40ae040 tx=0x7facb401ac50 comp rx=0 tx=0).stop 2024-04-26T20:57:38.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.712+0000 7faccb400640 1 -- 172.21.15.138:0/9334578 shutdown_connections 2024-04-26T20:57:38.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.712+0000 7faccb400640 1 --2- 172.21.15.138:0/9334578 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7faca0068380 0x7faca006a840 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:38.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.712+0000 7faccb400640 1 --2- 172.21.15.138:0/9334578 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7facc4160140 0x7facc41413a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:38.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.712+0000 7faccb400640 1 --2- 172.21.15.138:0/9334578 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7facc40b49b0 0x7facc415b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:38.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.712+0000 7faccb400640 1 --2- 172.21.15.138:0/9334578 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7facc406cf60 0x7facc4159460 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:38.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.712+0000 7faccb400640 1 -- 172.21.15.138:0/9334578 >> 172.21.15.138:0/9334578 conn(0x7facc40b3570 msgr2=0x7facc40b3950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:38.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.712+0000 7faccb400640 1 -- 172.21.15.138:0/9334578 shutdown_connections 2024-04-26T20:57:38.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.712+0000 7faccb400640 1 -- 172.21.15.138:0/9334578 wait complete. 2024-04-26T20:57:38.739 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-26T20:57:38.739 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:57:38.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.868+0000 7fe0a5800640 1 Processor -- start 2024-04-26T20:57:38.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.868+0000 7fe0a5800640 1 -- start start 2024-04-26T20:57:38.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.868+0000 7fe0a5800640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe0a00cc1e0 0x7fe0a00ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:38.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.868+0000 7fe0a5800640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0a00727f0 con 0x7fe0a015cf80 2024-04-26T20:57:38.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.868+0000 7fe0a5800640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0a0072a70 con 0x7fe0a00cbe00 2024-04-26T20:57:38.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.868+0000 7fe0a5800640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fe0a0074220 con 0x7fe0a00cc1e0 2024-04-26T20:57:38.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.872+0000 7fe096000640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fe0a015cf80 0x7fe0a0073b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:35570/0 (socket says 172.21.15.138:35570) 2024-04-26T20:57:38.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.872+0000 7fe096000640 1 -- 172.21.15.138:0/1482798190 learned_addr learned my addr 172.21.15.138:0/1482798190 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:38.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.872+0000 7fe09f400640 1 --2- 172.21.15.138:0/1482798190 >> v2:172.21.15.143:3300/0 conn(0x7fe0a00cc1e0 0x7fe0a00ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:38.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.872+0000 7fe09e000640 1 -- 172.21.15.138:0/1482798190 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3889810971 0 0) 0x7fe088001120 con 0x7fe0a015cf80 2024-04-26T20:57:38.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.872+0000 7fe09e000640 1 -- 172.21.15.138:0/1482798190 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe084003530 con 0x7fe0a015cf80 2024-04-26T20:57:38.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.872+0000 7fe09e000640 1 -- 172.21.15.138:0/1482798190 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2298600308 0 0) 0x7fe0a0072a70 con 0x7fe0a00cbe00 2024-04-26T20:57:38.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.872+0000 7fe09e000640 1 -- 172.21.15.138:0/1482798190 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe088001120 con 0x7fe0a00cbe00 2024-04-26T20:57:38.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.872+0000 7fe09f400640 1 -- 172.21.15.138:0/1482798190 >> v1:172.21.15.143:6789/0 conn(0x7fe0a00cbe00 legacy=0x7fe0a006de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:38.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.872+0000 7fe09f400640 1 -- 172.21.15.138:0/1482798190 >> v1:172.21.15.138:6789/0 conn(0x7fe0a015cf80 legacy=0x7fe0a0073b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:38.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.872+0000 7fe09f400640 1 -- 172.21.15.138:0/1482798190 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0a0072d50 con 0x7fe0a00cc1e0 2024-04-26T20:57:38.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.872+0000 7fe09f400640 1 --2- 172.21.15.138:0/1482798190 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0a00cc1e0 0x7fe0a00ce6f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe098009d90 tx=0x7fe09801c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50260c862369898b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:38.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.872+0000 7fe09e000640 1 -- 172.21.15.138:0/1482798190 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0980b2070 con 0x7fe0a00cc1e0 2024-04-26T20:57:38.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.872+0000 7fe09e000640 1 -- 172.21.15.138:0/1482798190 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0980a5830 con 0x7fe0a00cc1e0 2024-04-26T20:57:38.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.872+0000 7fe09e000640 1 -- 172.21.15.138:0/1482798190 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0980a5be0 con 0x7fe0a00cc1e0 2024-04-26T20:57:38.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.876+0000 7fe0a5800640 1 -- 172.21.15.138:0/1482798190 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0a00cc1e0 msgr2=0x7fe0a00ce6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:38.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.876+0000 7fe0a5800640 1 --2- 172.21.15.138:0/1482798190 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0a00cc1e0 0x7fe0a00ce6f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe098009d90 tx=0x7fe09801c970 comp rx=0 tx=0).stop 2024-04-26T20:57:38.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.876+0000 7fe0a5800640 1 -- 172.21.15.138:0/1482798190 shutdown_connections 2024-04-26T20:57:38.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.876+0000 7fe0a5800640 1 --2- 172.21.15.138:0/1482798190 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0a00cc1e0 0x7fe0a00ce6f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:38.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.876+0000 7fe0a5800640 1 -- 172.21.15.138:0/1482798190 >> 172.21.15.138:0/1482798190 conn(0x7fe0a00d0b20 msgr2=0x7fe0a00d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:38.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.876+0000 7fe0a5800640 1 -- 172.21.15.138:0/1482798190 shutdown_connections 2024-04-26T20:57:38.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.876+0000 7fe0a5800640 1 -- 172.21.15.138:0/1482798190 wait complete. 2024-04-26T20:57:38.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.876+0000 7fe0a5800640 1 Processor -- start 2024-04-26T20:57:38.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.876+0000 7fe0a5800640 1 -- start start 2024-04-26T20:57:38.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.876+0000 7fe0a5800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0a00cbe00 0x7fe0a0157ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:38.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.876+0000 7fe0a5800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe0a00cc1e0 0x7fe0a01583e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:38.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.876+0000 7fe0a5800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0a015cf80 0x7fe0a00b57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:38.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.876+0000 7fe0a5800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a00d0780 con 0x7fe0a00cbe00 2024-04-26T20:57:38.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.876+0000 7fe0a5800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a0073680 con 0x7fe0a015cf80 2024-04-26T20:57:38.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.876+0000 7fe0a5800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fe0a00d0900 con 0x7fe0a00cc1e0 2024-04-26T20:57:38.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.876+0000 7fe09ea00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0a00cbe00 0x7fe0a0157ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:38.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.876+0000 7fe09ea00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0a00cbe00 0x7fe0a0157ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:45232/0 (socket says 172.21.15.138:45232) 2024-04-26T20:57:38.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.876+0000 7fe09ea00640 1 -- 172.21.15.138:0/3803370201 learned_addr learned my addr 172.21.15.138:0/3803370201 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:38.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.876+0000 7fe096000640 1 --2- 172.21.15.138:0/3803370201 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe0a00cc1e0 0x7fe0a01583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:38.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.876+0000 7fe09f400640 1 --2- 172.21.15.138:0/3803370201 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0a015cf80 0x7fe0a00b57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:38.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.876+0000 7fe09ea00640 1 -- 172.21.15.138:0/3803370201 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe0a00cc1e0 msgr2=0x7fe0a01583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:38.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.876+0000 7fe09ea00640 1 --2- 172.21.15.138:0/3803370201 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe0a00cc1e0 0x7fe0a01583e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:38.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.876+0000 7fe09ea00640 1 -- 172.21.15.138:0/3803370201 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0a015cf80 msgr2=0x7fe0a00b57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:38.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.876+0000 7fe09ea00640 1 --2- 172.21.15.138:0/3803370201 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0a015cf80 0x7fe0a00b57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:38.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.876+0000 7fe09ea00640 1 -- 172.21.15.138:0/3803370201 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0a00c9c90 con 0x7fe0a00cbe00 2024-04-26T20:57:38.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.880+0000 7fe09ea00640 1 --2- 172.21.15.138:0/3803370201 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0a00cbe00 0x7fe0a0157ea0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe09000c500 tx=0x7fe09000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:38.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.880+0000 7fe097400640 1 -- 172.21.15.138:0/3803370201 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0900052d0 con 0x7fe0a00cbe00 2024-04-26T20:57:38.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.880+0000 7fe097400640 1 -- 172.21.15.138:0/3803370201 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe090005490 con 0x7fe0a00cbe00 2024-04-26T20:57:38.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.880+0000 7fe0a5800640 1 -- 172.21.15.138:0/3803370201 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0a00afef0 con 0x7fe0a00cbe00 2024-04-26T20:57:38.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.880+0000 7fe097400640 1 -- 172.21.15.138:0/3803370201 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe090012850 con 0x7fe0a00cbe00 2024-04-26T20:57:38.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.880+0000 7fe0a5800640 1 -- 172.21.15.138:0/3803370201 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0a00b04b0 con 0x7fe0a00cbe00 2024-04-26T20:57:38.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.880+0000 7fe0a5800640 1 -- 172.21.15.138:0/3803370201 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0a0069510 con 0x7fe0a00cbe00 2024-04-26T20:57:38.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.880+0000 7fe097400640 1 -- 172.21.15.138:0/3803370201 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe0900129f0 con 0x7fe0a00cbe00 2024-04-26T20:57:38.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.880+0000 7fe097400640 1 --2- 172.21.15.138:0/3803370201 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe07c068380 0x7fe07c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:38.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.880+0000 7fe097400640 1 -- 172.21.15.138:0/3803370201 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7fe090086ad0 con 0x7fe0a00cbe00 2024-04-26T20:57:38.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.880+0000 7fe096000640 1 --2- 172.21.15.138:0/3803370201 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe07c068380 0x7fe07c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:38.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.884+0000 7fe096000640 1 --2- 172.21.15.138:0/3803370201 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe07c068380 0x7fe07c06a840 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe0a00b20d0 tx=0x7fe088009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:38.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:38.884+0000 7fe097400640 1 -- 172.21.15.138:0/3803370201 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe090056620 con 0x7fe0a00cbe00 2024-04-26T20:57:39.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.072+0000 7fe0a5800640 1 -- 172.21.15.138:0/3803370201 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe0a00c9f00 con 0x7fe0a00cbe00 2024-04-26T20:57:39.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.076+0000 7fe097400640 1 -- 172.21.15.138:0/3803370201 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5189 (secure 0 0 0) 0x7fe09005a920 con 0x7fe0a00cbe00 2024-04-26T20:57:39.080 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:57:39.080 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/3495262740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3495262740},{"type":"v1","addr":"172.21.15.143:6837","nonce":3495262740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4273,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/1806638334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":1806638334},{"type":"v1","addr":"172.21.15.138:6834","nonce":1806638334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/3333703637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":3333703637},{"type":"v1","addr":"172.21.15.138:6835","nonce":3333703637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:56:39.581500+0000","modified":"2024-04-26T20:56:57.692718+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6836/3598364176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":3598364176},{"type":"v1","addr":"172.21.15.143:6836","nonce":3598364176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-04-26T20:57:39.081 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 9 2024-04-26T20:57:39.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.076+0000 7fe0a5800640 1 -- 172.21.15.138:0/3803370201 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe07c068380 msgr2=0x7fe07c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:39.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.076+0000 7fe0a5800640 1 --2- 172.21.15.138:0/3803370201 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe07c068380 0x7fe07c06a840 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe0a00b20d0 tx=0x7fe088009040 comp rx=0 tx=0).stop 2024-04-26T20:57:39.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.076+0000 7fe0a5800640 1 -- 172.21.15.138:0/3803370201 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0a00cbe00 msgr2=0x7fe0a0157ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:39.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.076+0000 7fe0a5800640 1 --2- 172.21.15.138:0/3803370201 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0a00cbe00 0x7fe0a0157ea0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe09000c500 tx=0x7fe09000c9c0 comp rx=0 tx=0).stop 2024-04-26T20:57:39.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.076+0000 7fe0a5800640 1 -- 172.21.15.138:0/3803370201 shutdown_connections 2024-04-26T20:57:39.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.076+0000 7fe0a5800640 1 --2- 172.21.15.138:0/3803370201 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe07c068380 0x7fe07c06a840 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:39.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.076+0000 7fe0a5800640 1 --2- 172.21.15.138:0/3803370201 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0a015cf80 0x7fe0a00b57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:39.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.076+0000 7fe0a5800640 1 --2- 172.21.15.138:0/3803370201 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe0a00cc1e0 0x7fe0a01583e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:39.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.076+0000 7fe0a5800640 1 --2- 172.21.15.138:0/3803370201 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0a00cbe00 0x7fe0a0157ea0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:39.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.076+0000 7fe0a5800640 1 -- 172.21.15.138:0/3803370201 >> 172.21.15.138:0/3803370201 conn(0x7fe0a00d0b20 msgr2=0x7fe0a015a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:39.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.076+0000 7fe0a5800640 1 -- 172.21.15.138:0/3803370201 shutdown_connections 2024-04-26T20:57:39.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.076+0000 7fe0a5800640 1 -- 172.21.15.138:0/3803370201 wait complete. 2024-04-26T20:57:39.101 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:57:39.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.228+0000 7fba2fe00640 1 Processor -- start 2024-04-26T20:57:39.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.228+0000 7fba2fe00640 1 -- start start 2024-04-26T20:57:39.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.232+0000 7fba2fe00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fba280cbe00 0x7fba2806de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:39.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.232+0000 7fba2fe00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fba280cc1e0 0x7fba28073b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:39.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.232+0000 7fba2fe00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba280727f0 con 0x7fba280ce6f0 2024-04-26T20:57:39.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.232+0000 7fba2fe00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fba28073680 con 0x7fba280cc1e0 2024-04-26T20:57:39.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.232+0000 7fba2fe00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fba28072a70 con 0x7fba280cbe00 2024-04-26T20:57:39.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.232+0000 7fba2ca00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fba280cc1e0 0x7fba28073b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:39.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.232+0000 7fba2d400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fba280cbe00 0x7fba2806de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:39.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.232+0000 7fba2ca00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fba280cc1e0 0x7fba28073b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:45246/0 (socket says 172.21.15.138:45246) 2024-04-26T20:57:39.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.232+0000 7fba2ca00640 1 -- 172.21.15.138:0/3900265728 learned_addr learned my addr 172.21.15.138:0/3900265728 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:39.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.232+0000 7fba2ca00640 1 -- 172.21.15.138:0/3900265728 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fba280cbe00 msgr2=0x7fba2806de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:39.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.232+0000 7fba2ca00640 1 --2- 172.21.15.138:0/3900265728 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fba280cbe00 0x7fba2806de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:39.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.232+0000 7fba2ca00640 1 -- 172.21.15.138:0/3900265728 >> v1:172.21.15.143:6789/0 conn(0x7fba280ce6f0 legacy=0x7fba280ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:39.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.232+0000 7fba2ca00640 1 -- 172.21.15.138:0/3900265728 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba28072d50 con 0x7fba280cc1e0 2024-04-26T20:57:39.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.236+0000 7fba2ca00640 1 --2- 172.21.15.138:0/3900265728 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba280cc1e0 0x7fba28073b10 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fba14009870 tx=0x7fba1401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d1632fa44814b66 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:39.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.236+0000 7fba27e00640 1 -- 172.21.15.138:0/3900265728 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba140ab650 con 0x7fba280cc1e0 2024-04-26T20:57:39.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.236+0000 7fba27e00640 1 -- 172.21.15.138:0/3900265728 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba140b0070 con 0x7fba280cc1e0 2024-04-26T20:57:39.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.236+0000 7fba27e00640 1 -- 172.21.15.138:0/3900265728 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba140aba10 con 0x7fba280cc1e0 2024-04-26T20:57:39.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.236+0000 7fba2fe00640 1 -- 172.21.15.138:0/3900265728 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba280cc1e0 msgr2=0x7fba28073b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:39.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.236+0000 7fba2fe00640 1 --2- 172.21.15.138:0/3900265728 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba280cc1e0 0x7fba28073b10 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fba14009870 tx=0x7fba1401c560 comp rx=0 tx=0).stop 2024-04-26T20:57:39.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.236+0000 7fba2fe00640 1 -- 172.21.15.138:0/3900265728 shutdown_connections 2024-04-26T20:57:39.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.236+0000 7fba2fe00640 1 --2- 172.21.15.138:0/3900265728 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba280cc1e0 0x7fba28073b10 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:39.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.236+0000 7fba2fe00640 1 --2- 172.21.15.138:0/3900265728 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fba280cbe00 0x7fba2806de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:39.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.236+0000 7fba2fe00640 1 -- 172.21.15.138:0/3900265728 >> 172.21.15.138:0/3900265728 conn(0x7fba280d0b20 msgr2=0x7fba280d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:39.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.236+0000 7fba2fe00640 1 -- 172.21.15.138:0/3900265728 shutdown_connections 2024-04-26T20:57:39.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.236+0000 7fba2fe00640 1 -- 172.21.15.138:0/3900265728 wait complete. 2024-04-26T20:57:39.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.236+0000 7fba2fe00640 1 Processor -- start 2024-04-26T20:57:39.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.236+0000 7fba2fe00640 1 -- start start 2024-04-26T20:57:39.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.240+0000 7fba2fe00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba280cbe00 0x7fba280c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:39.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.240+0000 7fba2fe00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba280cc1e0 0x7fba280aaf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:39.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.240+0000 7fba2fe00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fba280ce6f0 0x7fba28153b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:39.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.240+0000 7fba2fe00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fba280741d0 con 0x7fba280cbe00 2024-04-26T20:57:39.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.240+0000 7fba2fe00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fba28074050 con 0x7fba280cc1e0 2024-04-26T20:57:39.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.240+0000 7fba2fe00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fba280d0780 con 0x7fba280ce6f0 2024-04-26T20:57:39.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.240+0000 7fba2d400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba280cbe00 0x7fba280c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:39.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.240+0000 7fba2d400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba280cbe00 0x7fba280c6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:45252/0 (socket says 172.21.15.138:45252) 2024-04-26T20:57:39.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.240+0000 7fba2d400640 1 -- 172.21.15.138:0/3832978855 learned_addr learned my addr 172.21.15.138:0/3832978855 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:39.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.240+0000 7fba2ca00640 1 --2- 172.21.15.138:0/3832978855 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba280cc1e0 0x7fba280aaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:39.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.240+0000 7fba2de00640 1 --2- 172.21.15.138:0/3832978855 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fba280ce6f0 0x7fba28153b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:39.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.240+0000 7fba2d400640 1 -- 172.21.15.138:0/3832978855 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fba280ce6f0 msgr2=0x7fba28153b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:39.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.240+0000 7fba2d400640 1 --2- 172.21.15.138:0/3832978855 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fba280ce6f0 0x7fba28153b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:39.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.240+0000 7fba2d400640 1 -- 172.21.15.138:0/3832978855 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba280cc1e0 msgr2=0x7fba280aaf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:39.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.240+0000 7fba2d400640 1 --2- 172.21.15.138:0/3832978855 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba280cc1e0 0x7fba280aaf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:39.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.240+0000 7fba2d400640 1 -- 172.21.15.138:0/3832978855 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba280c7180 con 0x7fba280cbe00 2024-04-26T20:57:39.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.240+0000 7fba2de00640 1 --2- 172.21.15.138:0/3832978855 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fba280ce6f0 0x7fba28153b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:39.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.240+0000 7fba2ca00640 1 --2- 172.21.15.138:0/3832978855 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba280cc1e0 0x7fba280aaf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:39.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.240+0000 7fba2d400640 1 --2- 172.21.15.138:0/3832978855 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba280cbe00 0x7fba280c6c40 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fba1c00e870 tx=0x7fba1c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:39.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.240+0000 7fba25600640 1 -- 172.21.15.138:0/3832978855 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba1c017070 con 0x7fba280cbe00 2024-04-26T20:57:39.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.240+0000 7fba25600640 1 -- 172.21.15.138:0/3832978855 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba1c00c940 con 0x7fba280cbe00 2024-04-26T20:57:39.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.240+0000 7fba25600640 1 -- 172.21.15.138:0/3832978855 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba1c00ccf0 con 0x7fba280cbe00 2024-04-26T20:57:39.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.240+0000 7fba2fe00640 1 -- 172.21.15.138:0/3832978855 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba280c9d20 con 0x7fba280cbe00 2024-04-26T20:57:39.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.240+0000 7fba2fe00640 1 -- 172.21.15.138:0/3832978855 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba280ca2e0 con 0x7fba280cbe00 2024-04-26T20:57:39.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.240+0000 7fba2fe00640 1 -- 172.21.15.138:0/3832978855 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba28069510 con 0x7fba280cbe00 2024-04-26T20:57:39.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.240+0000 7fba25600640 1 -- 172.21.15.138:0/3832978855 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fba1c01a070 con 0x7fba280cbe00 2024-04-26T20:57:39.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.244+0000 7fba25600640 1 --2- 172.21.15.138:0/3832978855 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fba08068380 0x7fba0806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:39.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.244+0000 7fba25600640 1 -- 172.21.15.138:0/3832978855 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7fba1c086cc0 con 0x7fba280cbe00 2024-04-26T20:57:39.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.244+0000 7fba2ca00640 1 --2- 172.21.15.138:0/3832978855 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fba08068380 0x7fba0806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:39.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.244+0000 7fba2ca00640 1 --2- 172.21.15.138:0/3832978855 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fba08068380 0x7fba0806a840 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fba140af000 tx=0x7fba140a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:39.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.248+0000 7fba25600640 1 -- 172.21.15.138:0/3832978855 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fba1c08d080 con 0x7fba280cbe00 2024-04-26T20:57:39.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.436+0000 7fba2fe00640 1 -- 172.21.15.138:0/3832978855 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fba2806e130 con 0x7fba280cbe00 2024-04-26T20:57:39.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.436+0000 7fba25600640 1 -- 172.21.15.138:0/3832978855 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5189 (secure 0 0 0) 0x7fba1c056e50 con 0x7fba280cbe00 2024-04-26T20:57:39.441 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:57:39.441 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/3495262740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3495262740},{"type":"v1","addr":"172.21.15.143:6837","nonce":3495262740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4273,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/1806638334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":1806638334},{"type":"v1","addr":"172.21.15.138:6834","nonce":1806638334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/3333703637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":3333703637},{"type":"v1","addr":"172.21.15.138:6835","nonce":3333703637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:56:39.581500+0000","modified":"2024-04-26T20:56:57.692718+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6836/3598364176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":3598364176},{"type":"v1","addr":"172.21.15.143:6836","nonce":3598364176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-04-26T20:57:39.441 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 9 2024-04-26T20:57:39.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.436+0000 7fba2fe00640 1 -- 172.21.15.138:0/3832978855 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fba08068380 msgr2=0x7fba0806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:39.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.436+0000 7fba2fe00640 1 --2- 172.21.15.138:0/3832978855 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fba08068380 0x7fba0806a840 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fba140af000 tx=0x7fba140a7000 comp rx=0 tx=0).stop 2024-04-26T20:57:39.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.436+0000 7fba2fe00640 1 -- 172.21.15.138:0/3832978855 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba280cbe00 msgr2=0x7fba280c6c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:39.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.436+0000 7fba2fe00640 1 --2- 172.21.15.138:0/3832978855 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba280cbe00 0x7fba280c6c40 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fba1c00e870 tx=0x7fba1c00ec70 comp rx=0 tx=0).stop 2024-04-26T20:57:39.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.436+0000 7fba2fe00640 1 -- 172.21.15.138:0/3832978855 shutdown_connections 2024-04-26T20:57:39.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.436+0000 7fba2fe00640 1 --2- 172.21.15.138:0/3832978855 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fba08068380 0x7fba0806a840 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:39.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.436+0000 7fba2fe00640 1 --2- 172.21.15.138:0/3832978855 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fba280ce6f0 0x7fba28153b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:39.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.436+0000 7fba2fe00640 1 --2- 172.21.15.138:0/3832978855 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba280cc1e0 0x7fba280aaf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:39.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.436+0000 7fba2fe00640 1 --2- 172.21.15.138:0/3832978855 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba280cbe00 0x7fba280c6c40 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:39.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.436+0000 7fba2fe00640 1 -- 172.21.15.138:0/3832978855 >> 172.21.15.138:0/3832978855 conn(0x7fba280d0b20 msgr2=0x7fba280c4750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:39.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.436+0000 7fba2fe00640 1 -- 172.21.15.138:0/3832978855 shutdown_connections 2024-04-26T20:57:39.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.436+0000 7fba2fe00640 1 -- 172.21.15.138:0/3832978855 wait complete. 2024-04-26T20:57:39.461 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:57:39.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.592+0000 7f0d04800640 1 Processor -- start 2024-04-26T20:57:39.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.592+0000 7f0d04800640 1 -- start start 2024-04-26T20:57:39.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.592+0000 7f0d04800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0cfc0cbe00 0x7f0cfc06de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:39.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.592+0000 7f0d04800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f0cfc15cf80 0x7f0cfc0ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:39.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.592+0000 7f0d04800640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cfc0727f0 con 0x7f0cfc0cc1e0 2024-04-26T20:57:39.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.592+0000 7f0d04800640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f0cfc074220 con 0x7f0cfc15cf80 2024-04-26T20:57:39.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.592+0000 7f0d04800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f0cfc073680 con 0x7f0cfc0cbe00 2024-04-26T20:57:39.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.592+0000 7f0d02800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f0cfc15cf80 0x7f0cfc0ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:39.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.592+0000 7f0d01400640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f0cfc0cc1e0 0x7f0cfc073b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:35586/0 (socket says 172.21.15.138:35586) 2024-04-26T20:57:39.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.592+0000 7f0d01400640 1 -- 172.21.15.138:0/1492141927 learned_addr learned my addr 172.21.15.138:0/1492141927 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:39.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.592+0000 7f0d01e00640 1 --2- 172.21.15.138:0/1492141927 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0cfc0cbe00 0x7f0cfc06de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:39.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.592+0000 7f0d02800640 1 -- 172.21.15.138:0/1492141927 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0cfc0cbe00 msgr2=0x7f0cfc06de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:39.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.592+0000 7f0d02800640 1 --2- 172.21.15.138:0/1492141927 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0cfc0cbe00 0x7f0cfc06de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:39.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.592+0000 7f0d02800640 1 -- 172.21.15.138:0/1492141927 >> v1:172.21.15.138:6789/0 conn(0x7f0cfc0cc1e0 legacy=0x7f0cfc073b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:39.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.592+0000 7f0d02800640 1 -- 172.21.15.138:0/1492141927 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cfc072a70 con 0x7f0cfc15cf80 2024-04-26T20:57:39.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.592+0000 7f0d00a00640 1 -- 172.21.15.138:0/1492141927 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2299541249 0 0) 0x7f0cec001120 con 0x7f0cfc0cc1e0 2024-04-26T20:57:39.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.596+0000 7f0d02800640 1 --2- 172.21.15.138:0/1492141927 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0cfc15cf80 0x7f0cfc0ce6f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8009d90 tx=0x7f0cf801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8155985d2fb7f217 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:39.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.596+0000 7f0d00a00640 1 -- 172.21.15.138:0/1492141927 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf80b2070 con 0x7f0cfc15cf80 2024-04-26T20:57:39.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.596+0000 7f0d00a00640 1 -- 172.21.15.138:0/1492141927 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cf80a5920 con 0x7f0cfc15cf80 2024-04-26T20:57:39.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.596+0000 7f0d00a00640 1 -- 172.21.15.138:0/1492141927 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf80a5cf0 con 0x7f0cfc15cf80 2024-04-26T20:57:39.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.596+0000 7f0d04800640 1 -- 172.21.15.138:0/1492141927 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0cfc15cf80 msgr2=0x7f0cfc0ce6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:39.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.596+0000 7f0d04800640 1 --2- 172.21.15.138:0/1492141927 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0cfc15cf80 0x7f0cfc0ce6f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8009d90 tx=0x7f0cf801c970 comp rx=0 tx=0).stop 2024-04-26T20:57:39.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.596+0000 7f0d04800640 1 -- 172.21.15.138:0/1492141927 shutdown_connections 2024-04-26T20:57:39.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.596+0000 7f0d04800640 1 --2- 172.21.15.138:0/1492141927 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0cfc15cf80 0x7f0cfc0ce6f0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:39.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.596+0000 7f0d04800640 1 --2- 172.21.15.138:0/1492141927 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0cfc0cbe00 0x7f0cfc06de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:39.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.596+0000 7f0d04800640 1 -- 172.21.15.138:0/1492141927 >> 172.21.15.138:0/1492141927 conn(0x7f0cfc0d0b20 msgr2=0x7f0cfc0d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:39.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.596+0000 7f0d04800640 1 -- 172.21.15.138:0/1492141927 shutdown_connections 2024-04-26T20:57:39.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.596+0000 7f0d04800640 1 -- 172.21.15.138:0/1492141927 wait complete. 2024-04-26T20:57:39.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.600+0000 7f0d04800640 1 Processor -- start 2024-04-26T20:57:39.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.600+0000 7f0d04800640 1 -- start start 2024-04-26T20:57:39.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.600+0000 7f0d04800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0cfc0cbe00 0x7f0cfc156110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:39.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.600+0000 7f0d04800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0cfc0cc1e0 0x7f0cfc149ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:39.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.600+0000 7f0d04800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0cfc15cf80 0x7f0cfc0b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:39.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.600+0000 7f0d04800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f0cfc06e3b0 con 0x7f0cfc15cf80 2024-04-26T20:57:39.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.600+0000 7f0d04800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f0cfc0cf040 con 0x7f0cfc0cc1e0 2024-04-26T20:57:39.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.600+0000 7f0d04800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f0cfc06e530 con 0x7f0cfc0cbe00 2024-04-26T20:57:39.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.600+0000 7f0d02800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0cfc15cf80 0x7f0cfc0b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:39.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.600+0000 7f0d02800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0cfc15cf80 0x7f0cfc0b4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:45282/0 (socket says 172.21.15.138:45282) 2024-04-26T20:57:39.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.600+0000 7f0d02800640 1 -- 172.21.15.138:0/3177750824 learned_addr learned my addr 172.21.15.138:0/3177750824 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:39.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.600+0000 7f0d02800640 1 -- 172.21.15.138:0/3177750824 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0cfc0cbe00 msgr2=0x7f0cfc156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:39.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.600+0000 7f0d02800640 1 --2- 172.21.15.138:0/3177750824 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0cfc0cbe00 0x7f0cfc156110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:39.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.600+0000 7f0d02800640 1 -- 172.21.15.138:0/3177750824 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0cfc0cc1e0 msgr2=0x7f0cfc149ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:39.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.600+0000 7f0d02800640 1 --2- 172.21.15.138:0/3177750824 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0cfc0cc1e0 0x7f0cfc149ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:39.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.600+0000 7f0d02800640 1 -- 172.21.15.138:0/3177750824 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cfc156650 con 0x7f0cfc15cf80 2024-04-26T20:57:39.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.600+0000 7f0d02800640 1 --2- 172.21.15.138:0/3177750824 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0cfc15cf80 0x7f0cfc0b4e20 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8009d90 tx=0x7f0cf8019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:39.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.600+0000 7f0cf6000640 1 -- 172.21.15.138:0/3177750824 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf80b2040 con 0x7f0cfc15cf80 2024-04-26T20:57:39.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.600+0000 7f0cf6000640 1 -- 172.21.15.138:0/3177750824 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cf80b8470 con 0x7f0cfc15cf80 2024-04-26T20:57:39.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.600+0000 7f0cf6000640 1 -- 172.21.15.138:0/3177750824 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf80b8860 con 0x7f0cfc15cf80 2024-04-26T20:57:39.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.600+0000 7f0d04800640 1 -- 172.21.15.138:0/3177750824 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cfc154b60 con 0x7f0cfc15cf80 2024-04-26T20:57:39.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.600+0000 7f0d04800640 1 -- 172.21.15.138:0/3177750824 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cfc155120 con 0x7f0cfc15cf80 2024-04-26T20:57:39.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.604+0000 7f0d04800640 1 -- 172.21.15.138:0/3177750824 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cfc069510 con 0x7f0cfc15cf80 2024-04-26T20:57:39.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.604+0000 7f0cf6000640 1 -- 172.21.15.138:0/3177750824 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0cf80c1020 con 0x7f0cfc15cf80 2024-04-26T20:57:39.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.604+0000 7f0cf6000640 1 --2- 172.21.15.138:0/3177750824 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0ce0068380 0x7f0ce006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:39.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.604+0000 7f0cf6000640 1 -- 172.21.15.138:0/3177750824 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7f0cf81217e0 con 0x7f0cfc15cf80 2024-04-26T20:57:39.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.604+0000 7f0d01e00640 1 --2- 172.21.15.138:0/3177750824 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0ce0068380 0x7f0ce006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:39.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.604+0000 7f0d01e00640 1 --2- 172.21.15.138:0/3177750824 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0ce0068380 0x7f0ce006a840 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0cf0006aa0 tx=0x7f0cf0006a30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:39.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.608+0000 7f0cf6000640 1 -- 172.21.15.138:0/3177750824 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0cf8016560 con 0x7f0cfc15cf80 2024-04-26T20:57:39.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.764+0000 7f0d04800640 1 -- 172.21.15.138:0/3177750824 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0cfc155770 con 0x7f0cfc15cf80 2024-04-26T20:57:39.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.768+0000 7f0cf6000640 1 -- 172.21.15.138:0/3177750824 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18719 (secure 0 0 0) 0x7f0cf80f1a90 con 0x7f0cfc15cf80 2024-04-26T20:57:39.772 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:57:39.772 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":29,"fsid":"c22b4730-12cc-4558-8535-b965384398c0","created":"2024-04-26T20:56:14.182475+0000","modified":"2024-04-26T20:57:20.395184+0000","last_up_change":"2024-04-26T20:56:26.013243+0000","last_in_change":"2024-04-26T20:56:16.714055+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:56:27.265834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:56:37.394398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:56:38.544369+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:56:42.240243+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3f9a2e34-3199-466f-a6cf-57927318121e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6801","nonce":3534772245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6803","nonce":3534772245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6807","nonce":3534772245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6805","nonce":3534772245}]},"public_addr":"172.21.15.138:6801/3534772245","cluster_addr":"172.21.15.138:6803/3534772245","heartbeat_back_addr":"172.21.15.138:6807/3534772245","heartbeat_front_addr":"172.21.15.138:6805/3534772245","state":["exists","up"]},{"osd":1,"uuid":"e881fcf6-3248-4696-a2ef-95d206d77712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6817","nonce":1427635773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6819","nonce":1427635773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6823","nonce":1427635773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6821","nonce":1427635773}]},"public_addr":"172.21.15.138:6817/1427635773","cluster_addr":"172.21.15.138:6819/1427635773","heartbeat_back_addr":"172.21.15.138:6823/1427635773","heartbeat_front_addr":"172.21.15.138:6821/1427635773","state":["exists","up"]},{"osd":2,"uuid":"f7d1db33-7672-4699-ae47-9f1e0a8e4222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6809","nonce":4273721573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6811","nonce":4273721573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6815","nonce":4273721573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6813","nonce":4273721573}]},"public_addr":"172.21.15.138:6809/4273721573","cluster_addr":"172.21.15.138:6811/4273721573","heartbeat_back_addr":"172.21.15.138:6815/4273721573","heartbeat_front_addr":"172.21.15.138:6813/4273721573","state":["exists","up"]},{"osd":3,"uuid":"2f4e0a9a-b8f6-4468-844a-a4501cd85054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6825","nonce":3098242154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6827","nonce":3098242154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6831","nonce":3098242154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6829","nonce":3098242154}]},"public_addr":"172.21.15.138:6825/3098242154","cluster_addr":"172.21.15.138:6827/3098242154","heartbeat_back_addr":"172.21.15.138:6831/3098242154","heartbeat_front_addr":"172.21.15.138:6829/3098242154","state":["exists","up"]},{"osd":4,"uuid":"c85df99b-3624-410e-866b-86830af2cfe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6801","nonce":2942056312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6803","nonce":2942056312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6807","nonce":2942056312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6805","nonce":2942056312}]},"public_addr":"172.21.15.143:6801/2942056312","cluster_addr":"172.21.15.143:6803/2942056312","heartbeat_back_addr":"172.21.15.143:6807/2942056312","heartbeat_front_addr":"172.21.15.143:6805/2942056312","state":["exists","up"]},{"osd":5,"uuid":"9af1efb5-c416-4808-b5ef-de0679ab9705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6809","nonce":1910222887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6811","nonce":1910222887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6815","nonce":1910222887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6813","nonce":1910222887}]},"public_addr":"172.21.15.143:6809/1910222887","cluster_addr":"172.21.15.143:6811/1910222887","heartbeat_back_addr":"172.21.15.143:6815/1910222887","heartbeat_front_addr":"172.21.15.143:6813/1910222887","state":["exists","up"]},{"osd":6,"uuid":"d7138615-8838-45ff-9072-2fd0683362f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6817","nonce":1082239825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6819","nonce":1082239825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6823","nonce":1082239825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6821","nonce":1082239825}]},"public_addr":"172.21.15.143:6817/1082239825","cluster_addr":"172.21.15.143:6819/1082239825","heartbeat_back_addr":"172.21.15.143:6823/1082239825","heartbeat_front_addr":"172.21.15.143:6821/1082239825","state":["exists","up"]},{"osd":7,"uuid":"0c27172b-35c4-49ec-ba0b-0137b8ff0010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6825","nonce":3295508495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6827","nonce":3295508495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6831","nonce":3295508495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6829","nonce":3295508495}]},"public_addr":"172.21.15.143:6825/3295508495","cluster_addr":"172.21.15.143:6827/3295508495","heartbeat_back_addr":"172.21.15.143:6831/3295508495","heartbeat_front_addr":"172.21.15.143:6829/3295508495","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.326627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.396119+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.433915+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.414179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.216947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.329272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.503073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.436382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.39","mappings":[{"from":0,"to":7}]},{"pgid":"4.6","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:57:39.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.768+0000 7f0d04800640 1 -- 172.21.15.138:0/3177750824 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0ce0068380 msgr2=0x7f0ce006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:39.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.768+0000 7f0d04800640 1 --2- 172.21.15.138:0/3177750824 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0ce0068380 0x7f0ce006a840 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0cf0006aa0 tx=0x7f0cf0006a30 comp rx=0 tx=0).stop 2024-04-26T20:57:39.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.768+0000 7f0d04800640 1 -- 172.21.15.138:0/3177750824 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0cfc15cf80 msgr2=0x7f0cfc0b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:39.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.768+0000 7f0d04800640 1 --2- 172.21.15.138:0/3177750824 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0cfc15cf80 0x7f0cfc0b4e20 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8009d90 tx=0x7f0cf8019710 comp rx=0 tx=0).stop 2024-04-26T20:57:39.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.768+0000 7f0d04800640 1 -- 172.21.15.138:0/3177750824 shutdown_connections 2024-04-26T20:57:39.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.768+0000 7f0d04800640 1 --2- 172.21.15.138:0/3177750824 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0ce0068380 0x7f0ce006a840 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:39.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.768+0000 7f0d04800640 1 --2- 172.21.15.138:0/3177750824 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0cfc15cf80 0x7f0cfc0b4e20 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:39.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.768+0000 7f0d04800640 1 --2- 172.21.15.138:0/3177750824 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0cfc0cc1e0 0x7f0cfc149ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:39.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.768+0000 7f0d04800640 1 --2- 172.21.15.138:0/3177750824 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0cfc0cbe00 0x7f0cfc156110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:39.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.768+0000 7f0d04800640 1 -- 172.21.15.138:0/3177750824 >> 172.21.15.138:0/3177750824 conn(0x7f0cfc0d0b20 msgr2=0x7f0cfc0d12c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:39.776 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.768+0000 7f0d04800640 1 -- 172.21.15.138:0/3177750824 shutdown_connections 2024-04-26T20:57:39.776 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.768+0000 7f0d04800640 1 -- 172.21.15.138:0/3177750824 wait complete. 2024-04-26T20:57:39.794 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-26T20:57:39.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.924+0000 7f5d27200640 1 Processor -- start 2024-04-26T20:57:39.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.924+0000 7f5d27200640 1 -- start start 2024-04-26T20:57:39.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.928+0000 7f5d27200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5d280cc390 0x7f5d2806df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:39.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.928+0000 7f5d27200640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f5d28073d20 0x7f5d280cb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:39.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.928+0000 7f5d27200640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d280cba30 con 0x7f5d2815c0b0 2024-04-26T20:57:39.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.928+0000 7f5d27200640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f5d28073890 con 0x7f5d28073d20 2024-04-26T20:57:39.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.928+0000 7f5d27200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f5d2806f6b0 con 0x7f5d280cc390 2024-04-26T20:57:39.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.928+0000 7f5d26800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f5d28073d20 0x7f5d280cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:39.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.928+0000 7f5d25e00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f5d2815c0b0 0x7f5d280cbc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:35598/0 (socket says 172.21.15.138:35598) 2024-04-26T20:57:39.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.928+0000 7f5d25e00640 1 -- 172.21.15.138:0/3636018150 learned_addr learned my addr 172.21.15.138:0/3636018150 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:39.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.928+0000 7f5d1d400640 1 --2- 172.21.15.138:0/3636018150 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5d280cc390 0x7f5d2806df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:39.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.928+0000 7f5d26800640 1 -- 172.21.15.138:0/3636018150 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5d280cc390 msgr2=0x7f5d2806df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:39.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.928+0000 7f5d26800640 1 --2- 172.21.15.138:0/3636018150 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5d280cc390 0x7f5d2806df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:39.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.928+0000 7f5d26800640 1 -- 172.21.15.138:0/3636018150 >> v1:172.21.15.138:6789/0 conn(0x7f5d2815c0b0 legacy=0x7f5d280cbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:39.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.928+0000 7f5d26800640 1 -- 172.21.15.138:0/3636018150 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d2806f990 con 0x7f5d28073d20 2024-04-26T20:57:39.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.928+0000 7f5d25400640 1 -- 172.21.15.138:0/3636018150 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1620790212 0 0) 0x7f5d18001120 con 0x7f5d2815c0b0 2024-04-26T20:57:39.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.928+0000 7f5d26800640 1 --2- 172.21.15.138:0/3636018150 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d28073d20 0x7f5d280cb150 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5d20009d90 tx=0x7f5d2001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4526493f148db6bd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:39.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.932+0000 7f5d25400640 1 -- 172.21.15.138:0/3636018150 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d200b2070 con 0x7f5d28073d20 2024-04-26T20:57:39.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.932+0000 7f5d25400640 1 -- 172.21.15.138:0/3636018150 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d200a58b0 con 0x7f5d28073d20 2024-04-26T20:57:39.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.932+0000 7f5d25400640 1 -- 172.21.15.138:0/3636018150 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d200a5c80 con 0x7f5d28073d20 2024-04-26T20:57:39.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.932+0000 7f5d27200640 1 -- 172.21.15.138:0/3636018150 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d28073d20 msgr2=0x7f5d280cb150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:39.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.932+0000 7f5d27200640 1 --2- 172.21.15.138:0/3636018150 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d28073d20 0x7f5d280cb150 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5d20009d90 tx=0x7f5d2001c8e0 comp rx=0 tx=0).stop 2024-04-26T20:57:39.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.932+0000 7f5d27200640 1 -- 172.21.15.138:0/3636018150 shutdown_connections 2024-04-26T20:57:39.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.932+0000 7f5d27200640 1 --2- 172.21.15.138:0/3636018150 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d28073d20 0x7f5d280cb150 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:39.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.932+0000 7f5d27200640 1 --2- 172.21.15.138:0/3636018150 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5d280cc390 0x7f5d2806df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:39.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.932+0000 7f5d27200640 1 -- 172.21.15.138:0/3636018150 >> 172.21.15.138:0/3636018150 conn(0x7f5d280d0a70 msgr2=0x7f5d280d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:39.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.932+0000 7f5d27200640 1 -- 172.21.15.138:0/3636018150 shutdown_connections 2024-04-26T20:57:39.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.932+0000 7f5d27200640 1 -- 172.21.15.138:0/3636018150 wait complete. 2024-04-26T20:57:39.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.932+0000 7f5d27200640 1 Processor -- start 2024-04-26T20:57:39.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.932+0000 7f5d27200640 1 -- start start 2024-04-26T20:57:39.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.932+0000 7f5d27200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5d28073d20 0x7f5d280c7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:39.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.932+0000 7f5d27200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d280cc390 0x7f5d2814fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:39.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.932+0000 7f5d27200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5d2815c0b0 0x7f5d2813fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:39.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.932+0000 7f5d27200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f5d280cf1e0 con 0x7f5d280cc390 2024-04-26T20:57:39.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.932+0000 7f5d27200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f5d280cf060 con 0x7f5d28073d20 2024-04-26T20:57:39.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.932+0000 7f5d27200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f5d280cf360 con 0x7f5d2815c0b0 2024-04-26T20:57:39.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.932+0000 7f5d1d400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d280cc390 0x7f5d2814fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:39.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.932+0000 7f5d1d400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d280cc390 0x7f5d2814fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:45300/0 (socket says 172.21.15.138:45300) 2024-04-26T20:57:39.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.932+0000 7f5d1d400640 1 -- 172.21.15.138:0/3637554738 learned_addr learned my addr 172.21.15.138:0/3637554738 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:39.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.932+0000 7f5d25e00640 1 --2- 172.21.15.138:0/3637554738 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5d28073d20 0x7f5d280c7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:39.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.932+0000 7f5d26800640 1 --2- 172.21.15.138:0/3637554738 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5d2815c0b0 0x7f5d2813fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:39.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.936+0000 7f5d1d400640 1 -- 172.21.15.138:0/3637554738 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5d2815c0b0 msgr2=0x7f5d2813fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:39.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.936+0000 7f5d1d400640 1 --2- 172.21.15.138:0/3637554738 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5d2815c0b0 0x7f5d2813fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:39.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.936+0000 7f5d1d400640 1 -- 172.21.15.138:0/3637554738 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5d28073d20 msgr2=0x7f5d280c7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:39.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.936+0000 7f5d1d400640 1 --2- 172.21.15.138:0/3637554738 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5d28073d20 0x7f5d280c7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:39.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.936+0000 7f5d1d400640 1 -- 172.21.15.138:0/3637554738 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d281598c0 con 0x7f5d280cc390 2024-04-26T20:57:39.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.936+0000 7f5d25e00640 1 --2- 172.21.15.138:0/3637554738 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5d28073d20 0x7f5d280c7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:39.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.936+0000 7f5d1d400640 1 --2- 172.21.15.138:0/3637554738 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d280cc390 0x7f5d2814fa80 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5d1000d830 tx=0x7f5d1000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:39.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.936+0000 7f5d1ea00640 1 -- 172.21.15.138:0/3637554738 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d1000b6c0 con 0x7f5d280cc390 2024-04-26T20:57:39.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.936+0000 7f5d1ea00640 1 -- 172.21.15.138:0/3637554738 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d10019070 con 0x7f5d280cc390 2024-04-26T20:57:39.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.936+0000 7f5d27200640 1 -- 172.21.15.138:0/3637554738 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d280c8080 con 0x7f5d280cc390 2024-04-26T20:57:39.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.936+0000 7f5d1ea00640 1 -- 172.21.15.138:0/3637554738 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d1000ba60 con 0x7f5d280cc390 2024-04-26T20:57:39.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.936+0000 7f5d27200640 1 -- 172.21.15.138:0/3637554738 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d28159e40 con 0x7f5d280cc390 2024-04-26T20:57:39.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.936+0000 7f5d27200640 1 -- 172.21.15.138:0/3637554738 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d28069430 con 0x7f5d280cc390 2024-04-26T20:57:39.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.936+0000 7f5d1ea00640 1 -- 172.21.15.138:0/3637554738 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5d1001e460 con 0x7f5d280cc390 2024-04-26T20:57:39.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.936+0000 7f5d1ea00640 1 --2- 172.21.15.138:0/3637554738 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5d04068380 0x7f5d0406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:39.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.936+0000 7f5d1ea00640 1 -- 172.21.15.138:0/3637554738 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6619+0+0 (secure 0 0 0) 0x7f5d100874b0 con 0x7f5d280cc390 2024-04-26T20:57:39.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.936+0000 7f5d25e00640 1 --2- 172.21.15.138:0/3637554738 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5d04068380 0x7f5d0406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:39.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.940+0000 7f5d25e00640 1 --2- 172.21.15.138:0/3637554738 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5d04068380 0x7f5d0406a840 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5d18000f70 tx=0x7f5d18007cb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:39.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:39.940+0000 7f5d1ea00640 1 -- 172.21.15.138:0/3637554738 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5d10057640 con 0x7f5d280cc390 2024-04-26T20:57:40.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.132+0000 7f5d27200640 1 -- 172.21.15.138:0/3637554738 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f5d280d1980 con 0x7f5d280cc390 2024-04-26T20:57:40.137 INFO:tasks.ceph.mon.a.smithi138.stderr:2024-04-26T20:57:40.132+0000 7f20de400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T20:57:40.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.136+0000 7f5d1ea00640 1 -- 172.21.15.138:0/3637554738 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) ==== 161+0+0 (secure 0 0 0) 0x7f5d10056f40 con 0x7f5d280cc390 2024-04-26T20:57:40.143 INFO:teuthology.orchestra.run.smithi138.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T20:57:40.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.136+0000 7f5d27200640 1 -- 172.21.15.138:0/3637554738 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5d04068380 msgr2=0x7f5d0406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:40.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.136+0000 7f5d27200640 1 --2- 172.21.15.138:0/3637554738 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5d04068380 0x7f5d0406a840 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5d18000f70 tx=0x7f5d18007cb0 comp rx=0 tx=0).stop 2024-04-26T20:57:40.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.136+0000 7f5d27200640 1 -- 172.21.15.138:0/3637554738 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d280cc390 msgr2=0x7f5d2814fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:40.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.136+0000 7f5d27200640 1 --2- 172.21.15.138:0/3637554738 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d280cc390 0x7f5d2814fa80 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5d1000d830 tx=0x7f5d1000dcf0 comp rx=0 tx=0).stop 2024-04-26T20:57:40.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.136+0000 7f5d27200640 1 -- 172.21.15.138:0/3637554738 shutdown_connections 2024-04-26T20:57:40.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.136+0000 7f5d27200640 1 --2- 172.21.15.138:0/3637554738 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5d04068380 0x7f5d0406a840 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:40.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.136+0000 7f5d27200640 1 --2- 172.21.15.138:0/3637554738 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5d2815c0b0 0x7f5d2813fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:40.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.136+0000 7f5d27200640 1 --2- 172.21.15.138:0/3637554738 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d280cc390 0x7f5d2814fa80 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:40.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.136+0000 7f5d27200640 1 --2- 172.21.15.138:0/3637554738 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5d28073d20 0x7f5d280c7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:40.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.136+0000 7f5d27200640 1 -- 172.21.15.138:0/3637554738 >> 172.21.15.138:0/3637554738 conn(0x7f5d280d0a70 msgr2=0x7f5d28160240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:40.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.136+0000 7f5d27200640 1 -- 172.21.15.138:0/3637554738 shutdown_connections 2024-04-26T20:57:40.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.136+0000 7f5d27200640 1 -- 172.21.15.138:0/3637554738 wait complete. 2024-04-26T20:57:40.153 INFO:tasks.ceph.mds.b.smithi143.stderr: -5457> 2024-04-26T20:56:43.759+0000 7f4d01600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T20:57:40.164 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-26T20:57:40.204 INFO:tasks.ceph.mds.b.smithi143.stdout:starting mds.b at 2024-04-26T20:57:40.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.300+0000 7f302e600640 1 Processor -- start 2024-04-26T20:57:40.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.300+0000 7f302e600640 1 -- start start 2024-04-26T20:57:40.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.300+0000 7f302e600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f302815f220 0x7f302806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:40.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.300+0000 7f302e600640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30280d1e50 con 0x7f302806e4a0 2024-04-26T20:57:40.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.300+0000 7f302e600640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30280d2130 con 0x7f302815f600 2024-04-26T20:57:40.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.300+0000 7f302e600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f302806dbf0 con 0x7f302815f220 2024-04-26T20:57:40.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.300+0000 7f302dc00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f302806e4a0 0x7f30280cdd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:35608/0 (socket says 172.21.15.138:35608) 2024-04-26T20:57:40.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.300+0000 7f302dc00640 1 -- 172.21.15.138:0/3096635052 learned_addr learned my addr 172.21.15.138:0/3096635052 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:40.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.300+0000 7f302d200640 1 --2- 172.21.15.138:0/3096635052 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f302815f220 0x7f302806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:40.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.300+0000 7f3027e00640 1 -- 172.21.15.138:0/3096635052 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 157601023 0 0) 0x7f30280d1e50 con 0x7f302806e4a0 2024-04-26T20:57:40.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.304+0000 7f3027e00640 1 -- 172.21.15.138:0/3096635052 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f300c003530 con 0x7f302806e4a0 2024-04-26T20:57:40.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.304+0000 7f3027e00640 1 -- 172.21.15.138:0/3096635052 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2147614935 0 0) 0x7f30280d2130 con 0x7f302815f600 2024-04-26T20:57:40.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.304+0000 7f3027e00640 1 -- 172.21.15.138:0/3096635052 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30280d1e50 con 0x7f302815f600 2024-04-26T20:57:40.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.304+0000 7f3027e00640 1 -- 172.21.15.138:0/3096635052 <== mon.0 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 123812545 0 0) 0x7f300c003530 con 0x7f302806e4a0 2024-04-26T20:57:40.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.304+0000 7f302d200640 1 -- 172.21.15.138:0/3096635052 >> v1:172.21.15.143:6789/0 conn(0x7f302815f600 legacy=0x7f302806dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:40.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.304+0000 7f302d200640 1 -- 172.21.15.138:0/3096635052 >> v1:172.21.15.138:6789/0 conn(0x7f302806e4a0 legacy=0x7f30280cdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:40.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.304+0000 7f302d200640 1 -- 172.21.15.138:0/3096635052 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30280cd530 con 0x7f302815f220 2024-04-26T20:57:40.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.304+0000 7f302d200640 1 --2- 172.21.15.138:0/3096635052 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f302815f220 0x7f302806d6b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f30180097f0 tx=0x7f301801c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f54fc162b91579 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:40.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.304+0000 7f3027e00640 1 -- 172.21.15.138:0/3096635052 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30180b0070 con 0x7f302815f220 2024-04-26T20:57:40.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.304+0000 7f3027e00640 1 -- 172.21.15.138:0/3096635052 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30180ab400 con 0x7f302815f220 2024-04-26T20:57:40.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.304+0000 7f3027e00640 1 -- 172.21.15.138:0/3096635052 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3020001a00 con 0x7f302815f220 2024-04-26T20:57:40.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.308+0000 7f302e600640 1 -- 172.21.15.138:0/3096635052 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f302815f220 msgr2=0x7f302806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:40.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.308+0000 7f302e600640 1 --2- 172.21.15.138:0/3096635052 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f302815f220 0x7f302806d6b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f30180097f0 tx=0x7f301801c400 comp rx=0 tx=0).stop 2024-04-26T20:57:40.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.308+0000 7f302e600640 1 -- 172.21.15.138:0/3096635052 shutdown_connections 2024-04-26T20:57:40.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.308+0000 7f302e600640 1 --2- 172.21.15.138:0/3096635052 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f302815f220 0x7f302806d6b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:40.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.308+0000 7f302e600640 1 -- 172.21.15.138:0/3096635052 >> 172.21.15.138:0/3096635052 conn(0x7f30280d2d40 msgr2=0x7f30280d3150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:40.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.308+0000 7f302e600640 1 -- 172.21.15.138:0/3096635052 shutdown_connections 2024-04-26T20:57:40.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.308+0000 7f302e600640 1 -- 172.21.15.138:0/3096635052 wait complete. 2024-04-26T20:57:40.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.308+0000 7f302e600640 1 Processor -- start 2024-04-26T20:57:40.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.308+0000 7f302e600640 1 -- start start 2024-04-26T20:57:40.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.308+0000 7f302e600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f302806e4a0 0x7f3028153e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:40.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.308+0000 7f302e600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f302815f220 0x7f3028155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:40.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.308+0000 7f302e600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f302815f600 0x7f302809fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:40.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.308+0000 7f302e600640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f30280cefe0 con 0x7f302806e4a0 2024-04-26T20:57:40.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.308+0000 7f302e600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f30280cee60 con 0x7f302815f220 2024-04-26T20:57:40.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.308+0000 7f302e600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f302816cf60 con 0x7f302815f600 2024-04-26T20:57:40.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.308+0000 7f302d200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f302806e4a0 0x7f3028153e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:40.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.308+0000 7f302d200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f302806e4a0 0x7f3028153e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:45304/0 (socket says 172.21.15.138:45304) 2024-04-26T20:57:40.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.308+0000 7f302d200640 1 -- 172.21.15.138:0/3550352125 learned_addr learned my addr 172.21.15.138:0/3550352125 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:40.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.308+0000 7f301fe00640 1 --2- 172.21.15.138:0/3550352125 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f302815f220 0x7f3028155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:40.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.308+0000 7f302dc00640 1 --2- 172.21.15.138:0/3550352125 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f302815f600 0x7f302809fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:40.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.308+0000 7f302d200640 1 -- 172.21.15.138:0/3550352125 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f302815f600 msgr2=0x7f302809fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:40.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.308+0000 7f302d200640 1 --2- 172.21.15.138:0/3550352125 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f302815f600 0x7f302809fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:40.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.308+0000 7f302d200640 1 -- 172.21.15.138:0/3550352125 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f302815f220 msgr2=0x7f3028155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:40.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.308+0000 7f302d200640 1 --2- 172.21.15.138:0/3550352125 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f302815f220 0x7f3028155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:40.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.308+0000 7f302d200640 1 -- 172.21.15.138:0/3550352125 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f302813fe60 con 0x7f302806e4a0 2024-04-26T20:57:40.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.308+0000 7f301fe00640 1 --2- 172.21.15.138:0/3550352125 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f302815f220 0x7f3028155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:40.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.308+0000 7f302d200640 1 --2- 172.21.15.138:0/3550352125 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f302806e4a0 0x7f3028153e60 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f30180097f0 tx=0x7f301801ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:40.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.312+0000 7f3025600640 1 -- 172.21.15.138:0/3550352125 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30180b0050 con 0x7f302806e4a0 2024-04-26T20:57:40.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.312+0000 7f3025600640 1 -- 172.21.15.138:0/3550352125 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30180bc070 con 0x7f302806e4a0 2024-04-26T20:57:40.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.312+0000 7f3025600640 1 -- 172.21.15.138:0/3550352125 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3018006e20 con 0x7f302806e4a0 2024-04-26T20:57:40.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.312+0000 7f302e600640 1 -- 172.21.15.138:0/3550352125 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3028140100 con 0x7f302806e4a0 2024-04-26T20:57:40.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.312+0000 7f302e600640 1 -- 172.21.15.138:0/3550352125 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30281406c0 con 0x7f302806e4a0 2024-04-26T20:57:40.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.312+0000 7f302e600640 1 -- 172.21.15.138:0/3550352125 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3028069430 con 0x7f302806e4a0 2024-04-26T20:57:40.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.312+0000 7f3025600640 1 -- 172.21.15.138:0/3550352125 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f30180b7850 con 0x7f302806e4a0 2024-04-26T20:57:40.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.312+0000 7f3025600640 1 --2- 172.21.15.138:0/3550352125 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f30040683d0 0x7f300406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:40.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.312+0000 7f3025600640 1 -- 172.21.15.138:0/3550352125 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6705+0+0 (secure 0 0 0) 0x7f3018121390 con 0x7f302806e4a0 2024-04-26T20:57:40.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.312+0000 7f301fe00640 1 --2- 172.21.15.138:0/3550352125 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f30040683d0 0x7f300406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:40.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.316+0000 7f301fe00640 1 --2- 172.21.15.138:0/3550352125 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f30040683d0 0x7f300406a890 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f302815e6a0 tx=0x7f3010009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:40.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.320+0000 7f3025600640 1 -- 172.21.15.138:0/3550352125 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3018015ff0 con 0x7f302806e4a0 2024-04-26T20:57:40.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:40.516+0000 7f302e600640 1 -- 172.21.15.138:0/3550352125 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f30280d14d0 con 0x7f302806e4a0 2024-04-26T20:57:41.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.136+0000 7f3025600640 1 -- 172.21.15.138:0/3550352125 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f30180f15d0 con 0x7f302806e4a0 2024-04-26T20:57:41.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.140+0000 7f302e600640 1 -- 172.21.15.138:0/3550352125 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f30040683d0 msgr2=0x7f300406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:41.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.140+0000 7f302e600640 1 --2- 172.21.15.138:0/3550352125 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f30040683d0 0x7f300406a890 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f302815e6a0 tx=0x7f3010009040 comp rx=0 tx=0).stop 2024-04-26T20:57:41.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.140+0000 7f302e600640 1 -- 172.21.15.138:0/3550352125 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f302806e4a0 msgr2=0x7f3028153e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:41.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.140+0000 7f302e600640 1 --2- 172.21.15.138:0/3550352125 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f302806e4a0 0x7f3028153e60 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f30180097f0 tx=0x7f301801ac40 comp rx=0 tx=0).stop 2024-04-26T20:57:41.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.140+0000 7f302e600640 1 -- 172.21.15.138:0/3550352125 shutdown_connections 2024-04-26T20:57:41.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.140+0000 7f302e600640 1 --2- 172.21.15.138:0/3550352125 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f30040683d0 0x7f300406a890 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:41.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.140+0000 7f302e600640 1 --2- 172.21.15.138:0/3550352125 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f302815f600 0x7f302809fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:41.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.140+0000 7f302e600640 1 --2- 172.21.15.138:0/3550352125 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f302815f220 0x7f3028155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:41.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.140+0000 7f302e600640 1 --2- 172.21.15.138:0/3550352125 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f302806e4a0 0x7f3028153e60 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:41.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.140+0000 7f302e600640 1 -- 172.21.15.138:0/3550352125 >> 172.21.15.138:0/3550352125 conn(0x7f30280d2d40 msgr2=0x7f30281607b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:41.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.140+0000 7f302e600640 1 -- 172.21.15.138:0/3550352125 shutdown_connections 2024-04-26T20:57:41.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.140+0000 7f302e600640 1 -- 172.21.15.138:0/3550352125 wait complete. 2024-04-26T20:57:41.165 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-26T20:57:41.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.300+0000 7f81fb600640 1 Processor -- start 2024-04-26T20:57:41.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.300+0000 7f81fb600640 1 -- start start 2024-04-26T20:57:41.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.304+0000 7f81fb600640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f81f415cd70 0x7f81f40cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:41.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.304+0000 7f81fb600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f81f4071ec0 0x7f81f40cb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:41.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.304+0000 7f81fb600640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81f40ccf20 con 0x7f81f40cbc20 2024-04-26T20:57:41.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.304+0000 7f81fb600640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f81f40cccd0 con 0x7f81f415cd70 2024-04-26T20:57:41.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.304+0000 7f81fb600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f81f40cd200 con 0x7f81f4071ec0 2024-04-26T20:57:41.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.304+0000 7f81ebe00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f81f4071ec0 0x7f81f40cb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:41.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.304+0000 7f81f8c00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f81f415cd70 0x7f81f40cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:41.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.304+0000 7f81f9600640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f81f40cbc20 0x7f81f4160a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.138:58048/0 (socket says 172.21.15.138:58048) 2024-04-26T20:57:41.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.304+0000 7f81f9600640 1 -- 172.21.15.138:0/1605126892 learned_addr learned my addr 172.21.15.138:0/1605126892 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:41.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.304+0000 7f81f8c00640 1 -- 172.21.15.138:0/1605126892 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f81f4071ec0 msgr2=0x7f81f40cb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:41.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.304+0000 7f81f8c00640 1 --2- 172.21.15.138:0/1605126892 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f81f4071ec0 0x7f81f40cb6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:41.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.304+0000 7f81f8c00640 1 -- 172.21.15.138:0/1605126892 >> v1:172.21.15.143:6789/0 conn(0x7f81f40cbc20 legacy=0x7f81f4160a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:41.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.304+0000 7f81f8c00640 1 -- 172.21.15.138:0/1605126892 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81f4073c90 con 0x7f81f415cd70 2024-04-26T20:57:41.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.308+0000 7f81f8c00640 1 --2- 172.21.15.138:0/1605126892 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f81f415cd70 0x7f81f40cb1a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f81e40097c0 tx=0x7f81e401c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8878e6b0d101580c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:41.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.308+0000 7f81f3e00640 1 -- 172.21.15.138:0/1605126892 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e40b0070 con 0x7f81f415cd70 2024-04-26T20:57:41.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.308+0000 7f81f3e00640 1 -- 172.21.15.138:0/1605126892 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81e4004230 con 0x7f81f415cd70 2024-04-26T20:57:41.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.308+0000 7f81f3e00640 1 -- 172.21.15.138:0/1605126892 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e4003620 con 0x7f81f415cd70 2024-04-26T20:57:41.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.308+0000 7f81fb600640 1 -- 172.21.15.138:0/1605126892 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f81f415cd70 msgr2=0x7f81f40cb1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:41.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.308+0000 7f81fb600640 1 --2- 172.21.15.138:0/1605126892 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f81f415cd70 0x7f81f40cb1a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f81e40097c0 tx=0x7f81e401c410 comp rx=0 tx=0).stop 2024-04-26T20:57:41.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.308+0000 7f81fb600640 1 -- 172.21.15.138:0/1605126892 shutdown_connections 2024-04-26T20:57:41.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.308+0000 7f81fb600640 1 --2- 172.21.15.138:0/1605126892 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f81f4071ec0 0x7f81f40cb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:41.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.308+0000 7f81fb600640 1 --2- 172.21.15.138:0/1605126892 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f81f415cd70 0x7f81f40cb1a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:41.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.308+0000 7f81fb600640 1 -- 172.21.15.138:0/1605126892 >> 172.21.15.138:0/1605126892 conn(0x7f81f40d0b50 msgr2=0x7f81f40d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:41.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.308+0000 7f81fb600640 1 -- 172.21.15.138:0/1605126892 shutdown_connections 2024-04-26T20:57:41.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.308+0000 7f81fb600640 1 -- 172.21.15.138:0/1605126892 wait complete. 2024-04-26T20:57:41.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.308+0000 7f81fb600640 1 Processor -- start 2024-04-26T20:57:41.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.308+0000 7f81fb600640 1 -- start start 2024-04-26T20:57:41.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.308+0000 7f81fb600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81f4071ec0 0x7f81f40c7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:41.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.308+0000 7f81fb600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f81f40cbc20 0x7f81f4152080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:41.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.312+0000 7f81fb600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f81f415cd70 0x7f81f41525c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:41.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.312+0000 7f81fb600640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f81f40b39a0 con 0x7f81f4071ec0 2024-04-26T20:57:41.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.312+0000 7f81fb600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f81f40cc030 con 0x7f81f415cd70 2024-04-26T20:57:41.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.312+0000 7f81fb600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f81f40b3b20 con 0x7f81f40cbc20 2024-04-26T20:57:41.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.312+0000 7f81ebe00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f81f40cbc20 0x7f81f4152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:41.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.312+0000 7f81f8c00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81f4071ec0 0x7f81f40c7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:41.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.312+0000 7f81ebe00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f81f40cbc20 0x7f81f4152080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.138:35088/0 (socket says 172.21.15.138:35088) 2024-04-26T20:57:41.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.312+0000 7f81ebe00640 1 -- 172.21.15.138:0/1846707881 learned_addr learned my addr 172.21.15.138:0/1846707881 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:41.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.312+0000 7f81f9600640 1 --2- 172.21.15.138:0/1846707881 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f81f415cd70 0x7f81f41525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:41.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.312+0000 7f81ebe00640 1 -- 172.21.15.138:0/1846707881 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f81f415cd70 msgr2=0x7f81f41525c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:41.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.312+0000 7f81ebe00640 1 --2- 172.21.15.138:0/1846707881 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f81f415cd70 0x7f81f41525c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:41.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.312+0000 7f81ebe00640 1 -- 172.21.15.138:0/1846707881 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81f4071ec0 msgr2=0x7f81f40c7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:41.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.312+0000 7f81ebe00640 1 --2- 172.21.15.138:0/1846707881 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81f4071ec0 0x7f81f40c7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:41.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.312+0000 7f81ebe00640 1 -- 172.21.15.138:0/1846707881 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81f4152c30 con 0x7f81f40cbc20 2024-04-26T20:57:41.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.312+0000 7f81ebe00640 1 --2- 172.21.15.138:0/1846707881 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f81f40cbc20 0x7f81f4152080 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f81dc00e840 tx=0x7f81dc00ec40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:41.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.312+0000 7f81f1600640 1 -- 172.21.15.138:0/1846707881 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81dc017070 con 0x7f81f40cbc20 2024-04-26T20:57:41.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.312+0000 7f81f1600640 1 -- 172.21.15.138:0/1846707881 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81dc00ee90 con 0x7f81f40cbc20 2024-04-26T20:57:41.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.312+0000 7f81f1600640 1 -- 172.21.15.138:0/1846707881 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81dc00cb60 con 0x7f81f40cbc20 2024-04-26T20:57:41.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.312+0000 7f81fb600640 1 -- 172.21.15.138:0/1846707881 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81f4152f10 con 0x7f81f40cbc20 2024-04-26T20:57:41.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.312+0000 7f81fb600640 1 -- 172.21.15.138:0/1846707881 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f81f40c9820 con 0x7f81f40cbc20 2024-04-26T20:57:41.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.312+0000 7f81fb600640 1 -- 172.21.15.138:0/1846707881 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81f41530e0 con 0x7f81f40cbc20 2024-04-26T20:57:41.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.312+0000 7f81f1600640 1 -- 172.21.15.138:0/1846707881 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f81dc01a070 con 0x7f81f40cbc20 2024-04-26T20:57:41.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.316+0000 7f81f1600640 1 --2- 172.21.15.138:0/1846707881 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f81d0068380 0x7f81d006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:41.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.316+0000 7f81f1600640 1 -- 172.21.15.138:0/1846707881 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(30..30 src has 1..30) ==== 6705+0+0 (secure 0 0 0) 0x7f81dc086f80 con 0x7f81f40cbc20 2024-04-26T20:57:41.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.316+0000 7f81f8c00640 1 --2- 172.21.15.138:0/1846707881 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f81d0068380 0x7f81d006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:41.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.316+0000 7f81f8c00640 1 --2- 172.21.15.138:0/1846707881 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f81d0068380 0x7f81d006a840 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f81e40ad000 tx=0x7f81e4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:41.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.320+0000 7f81f1600640 1 -- 172.21.15.138:0/1846707881 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f81dc056b70 con 0x7f81f40cbc20 2024-04-26T20:57:41.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:41.476+0000 7f81fb600640 1 -- 172.21.15.138:0/1846707881 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f81f4069510 con 0x7f81f40cbc20 2024-04-26T20:57:42.492 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.484+0000 7f81f1600640 1 -- 172.21.15.138:0/1846707881 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v31) ==== 181+0+0 (secure 0 0 0) 0x7f81dc0860d0 con 0x7f81f40cbc20 2024-04-26T20:57:42.497 INFO:teuthology.orchestra.run.smithi138.stderr:pool 'cephfs_metadata' removed 2024-04-26T20:57:42.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.492+0000 7f81fb600640 1 -- 172.21.15.138:0/1846707881 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f81d0068380 msgr2=0x7f81d006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:42.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.492+0000 7f81fb600640 1 --2- 172.21.15.138:0/1846707881 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f81d0068380 0x7f81d006a840 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f81e40ad000 tx=0x7f81e4008040 comp rx=0 tx=0).stop 2024-04-26T20:57:42.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.492+0000 7f81fb600640 1 -- 172.21.15.138:0/1846707881 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f81f40cbc20 msgr2=0x7f81f4152080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:42.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.492+0000 7f81fb600640 1 --2- 172.21.15.138:0/1846707881 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f81f40cbc20 0x7f81f4152080 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f81dc00e840 tx=0x7f81dc00ec40 comp rx=0 tx=0).stop 2024-04-26T20:57:42.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.492+0000 7f81fb600640 1 -- 172.21.15.138:0/1846707881 shutdown_connections 2024-04-26T20:57:42.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.492+0000 7f81fb600640 1 --2- 172.21.15.138:0/1846707881 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f81d0068380 0x7f81d006a840 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:42.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.492+0000 7f81fb600640 1 --2- 172.21.15.138:0/1846707881 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f81f415cd70 0x7f81f41525c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:42.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.492+0000 7f81fb600640 1 --2- 172.21.15.138:0/1846707881 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f81f40cbc20 0x7f81f4152080 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:42.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.492+0000 7f81fb600640 1 --2- 172.21.15.138:0/1846707881 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81f4071ec0 0x7f81f40c7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:42.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.492+0000 7f81fb600640 1 -- 172.21.15.138:0/1846707881 >> 172.21.15.138:0/1846707881 conn(0x7f81f40d0b50 msgr2=0x7f81f40cdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:42.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.492+0000 7f81fb600640 1 -- 172.21.15.138:0/1846707881 shutdown_connections 2024-04-26T20:57:42.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.496+0000 7f81fb600640 1 -- 172.21.15.138:0/1846707881 wait complete. 2024-04-26T20:57:42.527 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-26T20:57:42.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.664+0000 7f3c0a600640 1 Processor -- start 2024-04-26T20:57:42.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.664+0000 7f3c0a600640 1 -- start start 2024-04-26T20:57:42.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.664+0000 7f3c0a600640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f3c0415f2e0 0x7f3c041636e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:42.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.664+0000 7f3c0a600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3c040cee30 0x7f3c040ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:42.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.664+0000 7f3c0a600640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c0415fa80 con 0x7f3c0406f9d0 2024-04-26T20:57:42.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.664+0000 7f3c0a600640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f3c0415fd60 con 0x7f3c0415f2e0 2024-04-26T20:57:42.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.664+0000 7f3c0a600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f3c04160040 con 0x7f3c040cee30 2024-04-26T20:57:42.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.664+0000 7f3c03400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f3c0415f2e0 0x7f3c041636e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:42.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.664+0000 7f3c03400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f3c0415f2e0 0x7f3c041636e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:45316/0 (socket says 172.21.15.138:45316) 2024-04-26T20:57:42.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.664+0000 7f3c03400640 1 -- 172.21.15.138:0/1752723012 learned_addr learned my addr 172.21.15.138:0/1752723012 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:42.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.668+0000 7f3c03e00640 1 --2- 172.21.15.138:0/1752723012 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3c040cee30 0x7f3c040ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:42.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.668+0000 7f3c03400640 1 -- 172.21.15.138:0/1752723012 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3c040cee30 msgr2=0x7f3c040ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:42.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.668+0000 7f3c03400640 1 --2- 172.21.15.138:0/1752723012 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3c040cee30 0x7f3c040ae8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:42.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.668+0000 7f3c03400640 1 -- 172.21.15.138:0/1752723012 >> v1:172.21.15.138:6789/0 conn(0x7f3c0406f9d0 legacy=0x7f3c040ce720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:42.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.668+0000 7f3c03400640 1 -- 172.21.15.138:0/1752723012 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c04160320 con 0x7f3c0415f2e0 2024-04-26T20:57:42.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.668+0000 7f3c03400640 1 --2- 172.21.15.138:0/1752723012 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c0415f2e0 0x7f3c041636e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4009e50 tx=0x7f3bf401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47f77f62f3bbcc09 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:42.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.668+0000 7f3c02a00640 1 -- 172.21.15.138:0/1752723012 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf40a55e0 con 0x7f3c0415f2e0 2024-04-26T20:57:42.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.668+0000 7f3c02a00640 1 -- 172.21.15.138:0/1752723012 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bf40a5780 con 0x7f3c0415f2e0 2024-04-26T20:57:42.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.668+0000 7f3c02a00640 1 -- 172.21.15.138:0/1752723012 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf40a5b50 con 0x7f3c0415f2e0 2024-04-26T20:57:42.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.668+0000 7f3c0a600640 1 -- 172.21.15.138:0/1752723012 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c0415f2e0 msgr2=0x7f3c041636e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:42.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.668+0000 7f3c0a600640 1 --2- 172.21.15.138:0/1752723012 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c0415f2e0 0x7f3c041636e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4009e50 tx=0x7f3bf401c910 comp rx=0 tx=0).stop 2024-04-26T20:57:42.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.668+0000 7f3c0a600640 1 -- 172.21.15.138:0/1752723012 shutdown_connections 2024-04-26T20:57:42.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.668+0000 7f3c0a600640 1 --2- 172.21.15.138:0/1752723012 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3c040cee30 0x7f3c040ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:42.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.668+0000 7f3c0a600640 1 --2- 172.21.15.138:0/1752723012 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c0415f2e0 0x7f3c041636e0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:42.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.668+0000 7f3c0a600640 1 -- 172.21.15.138:0/1752723012 >> 172.21.15.138:0/1752723012 conn(0x7f3c040d0b50 msgr2=0x7f3c040d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:42.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.668+0000 7f3c0a600640 1 -- 172.21.15.138:0/1752723012 shutdown_connections 2024-04-26T20:57:42.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.668+0000 7f3c0a600640 1 -- 172.21.15.138:0/1752723012 wait complete. 2024-04-26T20:57:42.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.672+0000 7f3c0a600640 1 Processor -- start 2024-04-26T20:57:42.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.672+0000 7f3c0a600640 1 -- start start 2024-04-26T20:57:42.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.672+0000 7f3c0a600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3c0406f9d0 0x7f3c04151610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:42.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.672+0000 7f3c0a600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c040cee30 0x7f3c04158b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:42.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.672+0000 7f3c0a600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3c0415f2e0 0x7f3c0415cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:42.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.672+0000 7f3c0a600640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f3c040af9a0 con 0x7f3c040cee30 2024-04-26T20:57:42.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.672+0000 7f3c0a600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f3c040af820 con 0x7f3c0415f2e0 2024-04-26T20:57:42.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.672+0000 7f3c0a600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f3c040b6600 con 0x7f3c0406f9d0 2024-04-26T20:57:42.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.672+0000 7f3bfaa00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c040cee30 0x7f3c04158b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:42.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.672+0000 7f3bfaa00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c040cee30 0x7f3c04158b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:45320/0 (socket says 172.21.15.138:45320) 2024-04-26T20:57:42.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.672+0000 7f3bfaa00640 1 -- 172.21.15.138:0/3628599781 learned_addr learned my addr 172.21.15.138:0/3628599781 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:42.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.672+0000 7f3c03400640 1 --2- 172.21.15.138:0/3628599781 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3c0406f9d0 0x7f3c04151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:42.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.672+0000 7f3c03e00640 1 --2- 172.21.15.138:0/3628599781 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3c0415f2e0 0x7f3c0415cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:42.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.672+0000 7f3bfaa00640 1 -- 172.21.15.138:0/3628599781 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3c0406f9d0 msgr2=0x7f3c04151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:42.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.672+0000 7f3bfaa00640 1 --2- 172.21.15.138:0/3628599781 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3c0406f9d0 0x7f3c04151610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:42.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.672+0000 7f3bfaa00640 1 -- 172.21.15.138:0/3628599781 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3c0415f2e0 msgr2=0x7f3c0415cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:42.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.672+0000 7f3bfaa00640 1 --2- 172.21.15.138:0/3628599781 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3c0415f2e0 0x7f3c0415cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:42.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.672+0000 7f3bfaa00640 1 -- 172.21.15.138:0/3628599781 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c04072e50 con 0x7f3c040cee30 2024-04-26T20:57:42.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.672+0000 7f3bfaa00640 1 --2- 172.21.15.138:0/3628599781 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c040cee30 0x7f3c04158b40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3bec00c3a0 tx=0x7f3bec00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:42.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.672+0000 7f3bfbe00640 1 -- 172.21.15.138:0/3628599781 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bec0052d0 con 0x7f3c040cee30 2024-04-26T20:57:42.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.672+0000 7f3bfbe00640 1 -- 172.21.15.138:0/3628599781 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bec005470 con 0x7f3c040cee30 2024-04-26T20:57:42.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.672+0000 7f3bfbe00640 1 -- 172.21.15.138:0/3628599781 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bec007260 con 0x7f3c040cee30 2024-04-26T20:57:42.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.672+0000 7f3c0a600640 1 -- 172.21.15.138:0/3628599781 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c04073130 con 0x7f3c040cee30 2024-04-26T20:57:42.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.672+0000 7f3c0a600640 1 -- 172.21.15.138:0/3628599781 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c040b5e00 con 0x7f3c040cee30 2024-04-26T20:57:42.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.676+0000 7f3c0a600640 1 -- 172.21.15.138:0/3628599781 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c04069510 con 0x7f3c040cee30 2024-04-26T20:57:42.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.676+0000 7f3bfbe00640 1 -- 172.21.15.138:0/3628599781 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3bec007400 con 0x7f3c040cee30 2024-04-26T20:57:42.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.676+0000 7f3bfbe00640 1 --2- 172.21.15.138:0/3628599781 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f3be00683b0 0x7f3be006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:42.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.676+0000 7f3bfbe00640 1 -- 172.21.15.138:0/3628599781 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6267+0+0 (secure 0 0 0) 0x7f3bec086180 con 0x7f3c040cee30 2024-04-26T20:57:42.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.676+0000 7f3c03400640 1 --2- 172.21.15.138:0/3628599781 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f3be00683b0 0x7f3be006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:42.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.680+0000 7f3c03400640 1 --2- 172.21.15.138:0/3628599781 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f3be00683b0 0x7f3be006a870 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3bf40ae000 tx=0x7f3bf40a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:42.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.680+0000 7f3bfbe00640 1 -- 172.21.15.138:0/3628599781 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3bec0563e0 con 0x7f3c040cee30 2024-04-26T20:57:42.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:42.840+0000 7f3c0a600640 1 -- 172.21.15.138:0/3628599781 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f3c040d1850 con 0x7f3c040cee30 2024-04-26T20:57:43.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.488+0000 7f3bfbe00640 1 -- 172.21.15.138:0/3628599781 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v32) ==== 169+0+0 (secure 0 0 0) 0x7f3bec055ce0 con 0x7f3c040cee30 2024-04-26T20:57:43.493 INFO:teuthology.orchestra.run.smithi138.stderr:pool 'cephfs_data' removed 2024-04-26T20:57:43.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.492+0000 7f3c0a600640 1 -- 172.21.15.138:0/3628599781 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f3be00683b0 msgr2=0x7f3be006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:43.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.492+0000 7f3c0a600640 1 --2- 172.21.15.138:0/3628599781 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f3be00683b0 0x7f3be006a870 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3bf40ae000 tx=0x7f3bf40a7070 comp rx=0 tx=0).stop 2024-04-26T20:57:43.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.492+0000 7f3c0a600640 1 -- 172.21.15.138:0/3628599781 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c040cee30 msgr2=0x7f3c04158b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:43.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.492+0000 7f3c0a600640 1 --2- 172.21.15.138:0/3628599781 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c040cee30 0x7f3c04158b40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3bec00c3a0 tx=0x7f3bec00c860 comp rx=0 tx=0).stop 2024-04-26T20:57:43.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.496+0000 7f3c0a600640 1 -- 172.21.15.138:0/3628599781 shutdown_connections 2024-04-26T20:57:43.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.496+0000 7f3c0a600640 1 --2- 172.21.15.138:0/3628599781 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f3be00683b0 0x7f3be006a870 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:43.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.496+0000 7f3c0a600640 1 --2- 172.21.15.138:0/3628599781 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3c0415f2e0 0x7f3c0415cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:43.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.496+0000 7f3c0a600640 1 --2- 172.21.15.138:0/3628599781 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c040cee30 0x7f3c04158b40 secure :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3bec00c3a0 tx=0x7f3bec00c860 comp rx=0 tx=0).stop 2024-04-26T20:57:43.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.496+0000 7f3c0a600640 1 --2- 172.21.15.138:0/3628599781 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3c0406f9d0 0x7f3c04151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:43.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.496+0000 7f3c0a600640 1 -- 172.21.15.138:0/3628599781 >> 172.21.15.138:0/3628599781 conn(0x7f3c040d0b50 msgr2=0x7f3c04162cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:43.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.496+0000 7f3c0a600640 1 -- 172.21.15.138:0/3628599781 shutdown_connections 2024-04-26T20:57:43.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.496+0000 7f3c0a600640 1 -- 172.21.15.138:0/3628599781 wait complete. 2024-04-26T20:57:43.527 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-04-26T20:57:43.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.664+0000 7f3143200640 1 Processor -- start 2024-04-26T20:57:43.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.664+0000 7f3143200640 1 -- start start 2024-04-26T20:57:43.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.664+0000 7f3143200640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f313c15cd70 0x7f313c0cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:43.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.664+0000 7f3143200640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f313c071ec0 0x7f313c0cb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:43.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.664+0000 7f3143200640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f313c0ccf20 con 0x7f313c0cbc20 2024-04-26T20:57:43.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.664+0000 7f3143200640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f313c0cccd0 con 0x7f313c15cd70 2024-04-26T20:57:43.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.664+0000 7f3143200640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f313c0cd200 con 0x7f313c071ec0 2024-04-26T20:57:43.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.664+0000 7f313be00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f313c15cd70 0x7f313c0cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:43.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.664+0000 7f313be00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f313c15cd70 0x7f313c0cb1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40814/0 (socket says 172.21.15.138:40814) 2024-04-26T20:57:43.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.664+0000 7f313be00640 1 -- 172.21.15.138:0/4002599586 learned_addr learned my addr 172.21.15.138:0/4002599586 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:43.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.664+0000 7f3141200640 1 --1- 172.21.15.138:0/4002599586 >> v1:172.21.15.138:6789/0 conn(0x7f313c0cbc20 0x7f313c160a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:42978/0 (socket says 172.21.15.138:42978) 2024-04-26T20:57:43.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.664+0000 7f313b400640 1 --2- 172.21.15.138:0/4002599586 >> v2:172.21.15.143:3300/0 conn(0x7f313c071ec0 0x7f313c0cb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:43.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.664+0000 7f313aa00640 1 -- 172.21.15.138:0/4002599586 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3975535894 0 0) 0x7f313c0ccf20 con 0x7f313c0cbc20 2024-04-26T20:57:43.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.664+0000 7f313aa00640 1 -- 172.21.15.138:0/4002599586 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3120003530 con 0x7f313c0cbc20 2024-04-26T20:57:43.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.664+0000 7f313be00640 1 -- 172.21.15.138:0/4002599586 >> v2:172.21.15.143:3300/0 conn(0x7f313c071ec0 msgr2=0x7f313c0cb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:43.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.664+0000 7f313be00640 1 --2- 172.21.15.138:0/4002599586 >> v2:172.21.15.143:3300/0 conn(0x7f313c071ec0 0x7f313c0cb6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:43.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.664+0000 7f313be00640 1 -- 172.21.15.138:0/4002599586 >> v1:172.21.15.138:6789/0 conn(0x7f313c0cbc20 legacy=0x7f313c160a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:43.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.664+0000 7f313be00640 1 -- 172.21.15.138:0/4002599586 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f313c073c90 con 0x7f313c15cd70 2024-04-26T20:57:43.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.664+0000 7f313b400640 1 --2- 172.21.15.138:0/4002599586 >> v2:172.21.15.143:3300/0 conn(0x7f313c071ec0 0x7f313c0cb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:43.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.668+0000 7f313be00640 1 --2- 172.21.15.138:0/4002599586 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f313c15cd70 0x7f313c0cb1a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f313c0d09c0 tx=0x7f312c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8037b2c31095c46e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:43.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.668+0000 7f313aa00640 1 -- 172.21.15.138:0/4002599586 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f312c0b1070 con 0x7f313c15cd70 2024-04-26T20:57:43.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.668+0000 7f313aa00640 1 -- 172.21.15.138:0/4002599586 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f312c0ac630 con 0x7f313c15cd70 2024-04-26T20:57:43.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.668+0000 7f313aa00640 1 -- 172.21.15.138:0/4002599586 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f312c0a8050 con 0x7f313c15cd70 2024-04-26T20:57:43.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.668+0000 7f3143200640 1 -- 172.21.15.138:0/4002599586 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f313c15cd70 msgr2=0x7f313c0cb1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:43.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.668+0000 7f3143200640 1 --2- 172.21.15.138:0/4002599586 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f313c15cd70 0x7f313c0cb1a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f313c0d09c0 tx=0x7f312c01c490 comp rx=0 tx=0).stop 2024-04-26T20:57:43.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.668+0000 7f3143200640 1 -- 172.21.15.138:0/4002599586 shutdown_connections 2024-04-26T20:57:43.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.668+0000 7f3143200640 1 --2- 172.21.15.138:0/4002599586 >> v2:172.21.15.143:3300/0 conn(0x7f313c071ec0 0x7f313c0cb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:43.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.668+0000 7f3143200640 1 --2- 172.21.15.138:0/4002599586 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f313c15cd70 0x7f313c0cb1a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:43.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.668+0000 7f3143200640 1 -- 172.21.15.138:0/4002599586 >> 172.21.15.138:0/4002599586 conn(0x7f313c0d0b50 msgr2=0x7f313c0d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:43.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.668+0000 7f3143200640 1 -- 172.21.15.138:0/4002599586 shutdown_connections 2024-04-26T20:57:43.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.668+0000 7f3143200640 1 -- 172.21.15.138:0/4002599586 wait complete. 2024-04-26T20:57:43.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.668+0000 7f3143200640 1 Processor -- start 2024-04-26T20:57:43.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.672+0000 7f3143200640 1 -- start start 2024-04-26T20:57:43.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.672+0000 7f3143200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f313c071ec0 0x7f313c154cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:43.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.672+0000 7f3143200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f313c0cbc20 0x7f313c0b3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:43.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.672+0000 7f3143200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f313c15cd70 0x7f313c15bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:43.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.672+0000 7f3143200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f313c0b39a0 con 0x7f313c15cd70 2024-04-26T20:57:43.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.672+0000 7f3143200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f313c0cc000 con 0x7f313c071ec0 2024-04-26T20:57:43.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.672+0000 7f3143200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f313c0b3b20 con 0x7f313c0cbc20 2024-04-26T20:57:43.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.672+0000 7f3141200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f313c15cd70 0x7f313c15bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:43.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.672+0000 7f3141200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f313c15cd70 0x7f313c15bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40828/0 (socket says 172.21.15.138:40828) 2024-04-26T20:57:43.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.672+0000 7f3141200640 1 -- 172.21.15.138:0/3190254607 learned_addr learned my addr 172.21.15.138:0/3190254607 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:43.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.672+0000 7f313be00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f313c071ec0 0x7f313c154cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:43.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.672+0000 7f313b400640 1 --2- 172.21.15.138:0/3190254607 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f313c0cbc20 0x7f313c0b3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:43.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.672+0000 7f3141200640 1 -- 172.21.15.138:0/3190254607 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f313c0cbc20 msgr2=0x7f313c0b3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:43.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.672+0000 7f3141200640 1 --2- 172.21.15.138:0/3190254607 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f313c0cbc20 0x7f313c0b3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:43.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.672+0000 7f3141200640 1 -- 172.21.15.138:0/3190254607 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f313c071ec0 msgr2=0x7f313c154cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:43.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.672+0000 7f3141200640 1 --2- 172.21.15.138:0/3190254607 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f313c071ec0 0x7f313c154cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:43.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.672+0000 7f3141200640 1 -- 172.21.15.138:0/3190254607 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f313c155230 con 0x7f313c15cd70 2024-04-26T20:57:43.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.672+0000 7f3141200640 1 --2- 172.21.15.138:0/3190254607 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f313c15cd70 0x7f313c15bfc0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f313400c770 tx=0x7f313400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:43.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.672+0000 7f3133e00640 1 -- 172.21.15.138:0/3190254607 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3134017070 con 0x7f313c15cd70 2024-04-26T20:57:43.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.672+0000 7f3133e00640 1 -- 172.21.15.138:0/3190254607 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f313400a640 con 0x7f313c15cd70 2024-04-26T20:57:43.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.672+0000 7f3133e00640 1 -- 172.21.15.138:0/3190254607 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f313400a9f0 con 0x7f313c15cd70 2024-04-26T20:57:43.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.672+0000 7f3143200640 1 -- 172.21.15.138:0/3190254607 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f313c15af20 con 0x7f313c15cd70 2024-04-26T20:57:43.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.672+0000 7f3143200640 1 -- 172.21.15.138:0/3190254607 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f313c15b4e0 con 0x7f313c15cd70 2024-04-26T20:57:43.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.672+0000 7f3143200640 1 -- 172.21.15.138:0/3190254607 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f313c069510 con 0x7f313c15cd70 2024-04-26T20:57:43.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.676+0000 7f3133e00640 1 -- 172.21.15.138:0/3190254607 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f313401a070 con 0x7f313c15cd70 2024-04-26T20:57:43.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.676+0000 7f3133e00640 1 --2- 172.21.15.138:0/3190254607 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f311c068380 0x7f311c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:43.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.676+0000 7f3133e00640 1 -- 172.21.15.138:0/3190254607 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5795+0+0 (secure 0 0 0) 0x7f3134085f80 con 0x7f313c15cd70 2024-04-26T20:57:43.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.676+0000 7f313be00640 1 --2- 172.21.15.138:0/3190254607 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f311c068380 0x7f311c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:43.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.676+0000 7f313be00640 1 --2- 172.21.15.138:0/3190254607 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f311c068380 0x7f311c06a840 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f312c0ae000 tx=0x7f312c0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:43.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.680+0000 7f3133e00640 1 -- 172.21.15.138:0/3190254607 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3134055e00 con 0x7f313c15cd70 2024-04-26T20:57:43.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:43.840+0000 7f3143200640 1 -- 172.21.15.138:0/3190254607 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f313c15d620 con 0x7f313c15cd70 2024-04-26T20:57:44.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.488+0000 7f3133e00640 1 -- 172.21.15.138:0/3190254607 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v33) ==== 178+0+0 (secure 0 0 0) 0x7f313405a100 con 0x7f313c15cd70 2024-04-26T20:57:44.496 INFO:teuthology.orchestra.run.smithi138.stderr:pool 'cephfs_data_ec' removed 2024-04-26T20:57:44.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.492+0000 7f3143200640 1 -- 172.21.15.138:0/3190254607 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f311c068380 msgr2=0x7f311c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:44.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.492+0000 7f3143200640 1 --2- 172.21.15.138:0/3190254607 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f311c068380 0x7f311c06a840 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f312c0ae000 tx=0x7f312c0a7000 comp rx=0 tx=0).stop 2024-04-26T20:57:44.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.492+0000 7f3143200640 1 -- 172.21.15.138:0/3190254607 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f313c15cd70 msgr2=0x7f313c15bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:44.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.492+0000 7f3143200640 1 --2- 172.21.15.138:0/3190254607 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f313c15cd70 0x7f313c15bfc0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f313400c770 tx=0x7f313400cc30 comp rx=0 tx=0).stop 2024-04-26T20:57:44.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.496+0000 7f3143200640 1 -- 172.21.15.138:0/3190254607 shutdown_connections 2024-04-26T20:57:44.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.496+0000 7f3143200640 1 --2- 172.21.15.138:0/3190254607 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f311c068380 0x7f311c06a840 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:44.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.496+0000 7f3143200640 1 --2- 172.21.15.138:0/3190254607 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f313c15cd70 0x7f313c15bfc0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:44.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.496+0000 7f3143200640 1 --2- 172.21.15.138:0/3190254607 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f313c0cbc20 0x7f313c0b3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:44.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.496+0000 7f3143200640 1 --2- 172.21.15.138:0/3190254607 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f313c071ec0 0x7f313c154cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:44.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.496+0000 7f3143200640 1 -- 172.21.15.138:0/3190254607 >> 172.21.15.138:0/3190254607 conn(0x7f313c0d0b50 msgr2=0x7f313c158e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:44.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.496+0000 7f3143200640 1 -- 172.21.15.138:0/3190254607 shutdown_connections 2024-04-26T20:57:44.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.496+0000 7f3143200640 1 -- 172.21.15.138:0/3190254607 wait complete. 2024-04-26T20:57:44.530 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-26T20:57:44.530 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-26T20:57:44.531 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-26T20:57:44.531 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T20:57:44.531 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-26T20:57:44.531 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-26T20:57:44.531 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-26T20:57:44.531 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T20:57:44.532 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-26T20:57:44.532 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-26T20:57:44.532 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-26T20:57:44.532 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T20:57:44.532 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-26T20:57:44.532 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-26T20:57:44.532 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-26T20:57:44.533 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T20:57:44.544 INFO:tasks.ceph.mds.a:Stopped 2024-04-26T20:57:44.545 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-26T20:57:44.547 INFO:tasks.ceph.mds.c:Stopped 2024-04-26T20:57:44.547 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-26T20:57:44.548 INFO:tasks.ceph.mds.d:Stopped 2024-04-26T20:57:44.548 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-26T20:57:44.548 INFO:tasks.ceph.mds.b:Stopped 2024-04-26T20:57:44.549 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-26T20:57:44.592 INFO:tasks.ceph.mds.d:Started 2024-04-26T20:57:44.592 DEBUG:teuthology.parallel:result is None 2024-04-26T20:57:44.593 INFO:tasks.ceph.mds.a:Started 2024-04-26T20:57:44.594 DEBUG:teuthology.parallel:result is None 2024-04-26T20:57:44.594 INFO:tasks.ceph.mds.b:Started 2024-04-26T20:57:44.594 DEBUG:teuthology.parallel:result is None 2024-04-26T20:57:44.595 INFO:tasks.ceph.mds.c:Started 2024-04-26T20:57:44.596 DEBUG:teuthology.parallel:result is None 2024-04-26T20:57:44.596 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-26T20:57:44.682 INFO:tasks.ceph.mds.a.smithi138.stdout:starting mds.a at 2024-04-26T20:57:44.682 INFO:tasks.ceph.mds.c.smithi138.stdout:starting mds.c at 2024-04-26T20:57:44.684 INFO:tasks.ceph.mds.d.smithi143.stdout:starting mds.d at 2024-04-26T20:57:44.684 INFO:tasks.ceph.mds.b.smithi143.stdout:starting mds.b at 2024-04-26T20:57:44.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.736+0000 7fe681e00640 1 Processor -- start 2024-04-26T20:57:44.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.736+0000 7fe681e00640 1 -- start start 2024-04-26T20:57:44.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.736+0000 7fe681e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe67c160140 0x7fe67c0b4470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:44.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.736+0000 7fe681e00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe67c073060 0x7fe67c06e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:44.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.736+0000 7fe681e00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe67c0b4f10 con 0x7fe67c0b49b0 2024-04-26T20:57:44.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.736+0000 7fe681e00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fe67c06c480 con 0x7fe67c073060 2024-04-26T20:57:44.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.736+0000 7fe681e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fe67c06c760 con 0x7fe67c160140 2024-04-26T20:57:44.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.736+0000 7fe672000640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fe67c0b49b0 0x7fe67c072950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:42988/0 (socket says 172.21.15.138:42988) 2024-04-26T20:57:44.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.736+0000 7fe672000640 1 -- 172.21.15.138:0/1272889603 learned_addr learned my addr 172.21.15.138:0/1272889603 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:44.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.736+0000 7fe67aa00640 1 --2- 172.21.15.138:0/1272889603 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe67c160140 0x7fe67c0b4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:44.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.740+0000 7fe67b400640 1 --2- 172.21.15.138:0/1272889603 >> v2:172.21.15.143:3300/0 conn(0x7fe67c073060 0x7fe67c06e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:44.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.740+0000 7fe67a000640 1 -- 172.21.15.138:0/1272889603 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1133668181 0 0) 0x7fe67c0b4f10 con 0x7fe67c0b49b0 2024-04-26T20:57:44.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.740+0000 7fe67a000640 1 -- 172.21.15.138:0/1272889603 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe660003530 con 0x7fe67c0b49b0 2024-04-26T20:57:44.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.740+0000 7fe67a000640 1 -- 172.21.15.138:0/1272889603 <== mon.0 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4286090511 0 0) 0x7fe660003530 con 0x7fe67c0b49b0 2024-04-26T20:57:44.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.740+0000 7fe67a000640 1 -- 172.21.15.138:0/1272889603 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe67c160140 msgr2=0x7fe67c0b4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:44.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.740+0000 7fe67a000640 1 --2- 172.21.15.138:0/1272889603 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe67c160140 0x7fe67c0b4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:44.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.740+0000 7fe67a000640 1 -- 172.21.15.138:0/1272889603 >> v2:172.21.15.143:3300/0 conn(0x7fe67c073060 msgr2=0x7fe67c06e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:44.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.740+0000 7fe67a000640 1 --2- 172.21.15.138:0/1272889603 >> v2:172.21.15.143:3300/0 conn(0x7fe67c073060 0x7fe67c06e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:44.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.740+0000 7fe67a000640 1 -- 172.21.15.138:0/1272889603 --> v1:172.21.15.138:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe67c06ca40 con 0x7fe67c0b49b0 2024-04-26T20:57:44.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.740+0000 7fe67a000640 1 -- 172.21.15.138:0/1272889603 <== mon.0 v1:172.21.15.138:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2715389689 0 0) 0x7fe664001680 con 0x7fe67c0b49b0 2024-04-26T20:57:44.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.740+0000 7fe67a000640 1 -- 172.21.15.138:0/1272889603 >> v1:172.21.15.138:6789/0 conn(0x7fe67c0b49b0 legacy=0x7fe67c072950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:44.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.740+0000 7fe67a000640 1 --2- 172.21.15.138:0/1272889603 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe6600039c0 0x7fe660003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:44.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.740+0000 7fe67a000640 1 --2- 172.21.15.138:0/1272889603 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe660004810 0x7fe660004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:44.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.740+0000 7fe67a000640 1 --2- 172.21.15.138:0/1272889603 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe6600051d0 0x7fe66000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:44.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.740+0000 7fe67a000640 1 -- 172.21.15.138:0/1272889603 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe67c06c480 con 0x7fe6600051d0 2024-04-26T20:57:44.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.740+0000 7fe67a000640 1 -- 172.21.15.138:0/1272889603 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fe67c06c760 con 0x7fe6600039c0 2024-04-26T20:57:44.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.740+0000 7fe67a000640 1 -- 172.21.15.138:0/1272889603 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fe66000bf10 con 0x7fe660004810 2024-04-26T20:57:44.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.740+0000 7fe67aa00640 1 --2- 172.21.15.138:0/1272889603 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe67c160140 0x7fe67c0b4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:57:44.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.740+0000 7fe67b400640 1 --2- 172.21.15.138:0/1272889603 >> v2:172.21.15.143:3300/0 conn(0x7fe67c073060 0x7fe67c06e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:57:44.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.740+0000 7fe672000640 1 --2- 172.21.15.138:0/1272889603 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe660004810 0x7fe660004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:44.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.740+0000 7fe67b400640 1 --2- 172.21.15.138:0/1272889603 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe6600051d0 0x7fe66000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:44.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.740+0000 7fe67aa00640 1 --2- 172.21.15.138:0/1272889603 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe6600039c0 0x7fe660003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:44.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.740+0000 7fe672000640 1 -- 172.21.15.138:0/1272889603 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe6600039c0 msgr2=0x7fe660003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:44.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.740+0000 7fe672000640 1 --2- 172.21.15.138:0/1272889603 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe6600039c0 0x7fe660003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:44.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.740+0000 7fe672000640 1 -- 172.21.15.138:0/1272889603 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe6600051d0 msgr2=0x7fe66000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:44.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.740+0000 7fe672000640 1 --2- 172.21.15.138:0/1272889603 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe6600051d0 0x7fe66000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:44.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.740+0000 7fe672000640 1 -- 172.21.15.138:0/1272889603 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe660003530 con 0x7fe660004810 2024-04-26T20:57:44.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.744+0000 7fe672000640 1 --2- 172.21.15.138:0/1272889603 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe660004810 0x7fe660004c90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe66400c240 tx=0x7fe66401ccc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abb96b9d05ad2fb8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:44.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.744+0000 7fe67a000640 1 -- 172.21.15.138:0/1272889603 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe664007d60 con 0x7fe660004810 2024-04-26T20:57:44.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.744+0000 7fe67a000640 1 -- 172.21.15.138:0/1272889603 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6640a9020 con 0x7fe660004810 2024-04-26T20:57:44.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.744+0000 7fe67a000640 1 -- 172.21.15.138:0/1272889603 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6640a5bc0 con 0x7fe660004810 2024-04-26T20:57:44.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.744+0000 7fe681e00640 1 -- 172.21.15.138:0/1272889603 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe660004810 msgr2=0x7fe660004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:44.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.744+0000 7fe681e00640 1 --2- 172.21.15.138:0/1272889603 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe660004810 0x7fe660004c90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe66400c240 tx=0x7fe66401ccc0 comp rx=0 tx=0).stop 2024-04-26T20:57:44.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.744+0000 7fe67b400640 1 -- 172.21.15.138:0/1272889603 reap_dead start 2024-04-26T20:57:44.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.744+0000 7fe681e00640 1 -- 172.21.15.138:0/1272889603 shutdown_connections 2024-04-26T20:57:44.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.744+0000 7fe681e00640 1 -- 172.21.15.138:0/1272889603 >> 172.21.15.138:0/1272889603 conn(0x7fe67c0b3570 msgr2=0x7fe67c0b3980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:44.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.744+0000 7fe681e00640 1 -- 172.21.15.138:0/1272889603 shutdown_connections 2024-04-26T20:57:44.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.744+0000 7fe681e00640 1 -- 172.21.15.138:0/1272889603 wait complete. 2024-04-26T20:57:44.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.744+0000 7fe681e00640 1 Processor -- start 2024-04-26T20:57:44.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.744+0000 7fe681e00640 1 -- start start 2024-04-26T20:57:44.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.744+0000 7fe681e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe660004810 0x7fe67c144860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:44.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.744+0000 7fe681e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe67c144f40 0x7fe67c1f83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:44.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.744+0000 7fe681e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe67c15d440 0x7fe67c15d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:44.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.744+0000 7fe681e00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe67c06d0e0 con 0x7fe67c15d440 2024-04-26T20:57:44.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.744+0000 7fe681e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fe67c06cf60 con 0x7fe660004810 2024-04-26T20:57:44.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.744+0000 7fe681e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fe67c06d260 con 0x7fe67c144f40 2024-04-26T20:57:44.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.748+0000 7fe67b400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe67c15d440 0x7fe67c15d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:44.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.748+0000 7fe67b400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe67c15d440 0x7fe67c15d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40864/0 (socket says 172.21.15.138:40864) 2024-04-26T20:57:44.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.748+0000 7fe67b400640 1 -- 172.21.15.138:0/3946898018 learned_addr learned my addr 172.21.15.138:0/3946898018 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:44.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.748+0000 7fe67aa00640 1 --2- 172.21.15.138:0/3946898018 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe660004810 0x7fe67c144860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:44.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.748+0000 7fe672000640 1 --2- 172.21.15.138:0/3946898018 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe67c144f40 0x7fe67c1f83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:44.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.748+0000 7fe67b400640 1 -- 172.21.15.138:0/3946898018 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe67c144f40 msgr2=0x7fe67c1f83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:44.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.748+0000 7fe67b400640 1 --2- 172.21.15.138:0/3946898018 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe67c144f40 0x7fe67c1f83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:44.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.748+0000 7fe67b400640 1 -- 172.21.15.138:0/3946898018 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe660004810 msgr2=0x7fe67c144860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:44.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.748+0000 7fe67b400640 1 --2- 172.21.15.138:0/3946898018 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe660004810 0x7fe67c144860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:44.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.748+0000 7fe67b400640 1 -- 172.21.15.138:0/3946898018 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe67c0cf720 con 0x7fe67c15d440 2024-04-26T20:57:44.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.748+0000 7fe672000640 1 --2- 172.21.15.138:0/3946898018 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe67c144f40 0x7fe67c1f83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:57:44.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.748+0000 7fe67b400640 1 --2- 172.21.15.138:0/3946898018 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe67c15d440 0x7fe67c15d8c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fe67c068780 tx=0x7fe67400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:44.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.748+0000 7fe673e00640 1 -- 172.21.15.138:0/3946898018 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe674015430 con 0x7fe67c15d440 2024-04-26T20:57:44.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.748+0000 7fe673e00640 1 -- 172.21.15.138:0/3946898018 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe67401d070 con 0x7fe67c15d440 2024-04-26T20:57:44.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.748+0000 7fe681e00640 1 -- 172.21.15.138:0/3946898018 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe67c1f8920 con 0x7fe67c15d440 2024-04-26T20:57:44.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.748+0000 7fe673e00640 1 -- 172.21.15.138:0/3946898018 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6740157f0 con 0x7fe67c15d440 2024-04-26T20:57:44.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.748+0000 7fe681e00640 1 -- 172.21.15.138:0/3946898018 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe67c0cfcc0 con 0x7fe67c15d440 2024-04-26T20:57:44.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.748+0000 7fe681e00640 1 -- 172.21.15.138:0/3946898018 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe67c15de00 con 0x7fe67c15d440 2024-04-26T20:57:44.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.748+0000 7fe673e00640 1 -- 172.21.15.138:0/3946898018 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe674015990 con 0x7fe67c15d440 2024-04-26T20:57:44.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.748+0000 7fe673e00640 1 --2- 172.21.15.138:0/3946898018 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe6580683b0 0x7fe65806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:44.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.748+0000 7fe673e00640 1 -- 172.21.15.138:0/3946898018 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5335+0+0 (secure 0 0 0) 0x7fe674087400 con 0x7fe67c15d440 2024-04-26T20:57:44.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.752+0000 7fe67aa00640 1 --2- 172.21.15.138:0/3946898018 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe6580683b0 0x7fe65806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:44.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.752+0000 7fe67aa00640 1 --2- 172.21.15.138:0/3946898018 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe6580683b0 0x7fe65806a870 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe67c0b6b60 tx=0x7fe66c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:44.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.756+0000 7fe673e00640 1 -- 172.21.15.138:0/3946898018 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe674010040 con 0x7fe67c15d440 2024-04-26T20:57:44.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:44.924+0000 7fe681e00640 1 -- 172.21.15.138:0/3946898018 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fe67c069510 con 0x7fe67c15d440 2024-04-26T20:57:45.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.512+0000 7fe673e00640 1 -- 172.21.15.138:0/3946898018 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v35) ==== 97+0+0 (secure 0 0 0) 0x7fe67401f310 con 0x7fe67c15d440 2024-04-26T20:57:45.519 INFO:teuthology.orchestra.run.smithi138.stderr: removed all blocklist entries 2024-04-26T20:57:45.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.516+0000 7fe681e00640 1 -- 172.21.15.138:0/3946898018 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe6580683b0 msgr2=0x7fe65806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:45.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.516+0000 7fe681e00640 1 --2- 172.21.15.138:0/3946898018 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe6580683b0 0x7fe65806a870 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe67c0b6b60 tx=0x7fe66c008040 comp rx=0 tx=0).stop 2024-04-26T20:57:45.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.516+0000 7fe681e00640 1 -- 172.21.15.138:0/3946898018 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe67c15d440 msgr2=0x7fe67c15d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:45.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.516+0000 7fe681e00640 1 --2- 172.21.15.138:0/3946898018 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe67c15d440 0x7fe67c15d8c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fe67c068780 tx=0x7fe67400f580 comp rx=0 tx=0).stop 2024-04-26T20:57:45.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.516+0000 7fe681e00640 1 -- 172.21.15.138:0/3946898018 shutdown_connections 2024-04-26T20:57:45.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.516+0000 7fe681e00640 1 --2- 172.21.15.138:0/3946898018 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe6580683b0 0x7fe65806a870 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:45.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.516+0000 7fe681e00640 1 --2- 172.21.15.138:0/3946898018 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe67c15d440 0x7fe67c15d8c0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:45.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.516+0000 7fe681e00640 1 --2- 172.21.15.138:0/3946898018 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe67c144f40 0x7fe67c1f83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:45.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.516+0000 7fe681e00640 1 --2- 172.21.15.138:0/3946898018 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe660004810 0x7fe67c144860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:45.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.516+0000 7fe681e00640 1 -- 172.21.15.138:0/3946898018 >> 172.21.15.138:0/3946898018 conn(0x7fe67c0b3570 msgr2=0x7fe67c072920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:45.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.516+0000 7fe681e00640 1 -- 172.21.15.138:0/3946898018 shutdown_connections 2024-04-26T20:57:45.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.516+0000 7fe681e00640 1 -- 172.21.15.138:0/3946898018 wait complete. 2024-04-26T20:57:45.544 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-26T20:57:45.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.676+0000 7fa070600640 1 Processor -- start 2024-04-26T20:57:45.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.676+0000 7fa070600640 1 -- start start 2024-04-26T20:57:45.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.676+0000 7fa070600640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa06815f130 0x7fa0680cf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:45.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.676+0000 7fa070600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa06815f510 0x7fa0680cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:45.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.676+0000 7fa070600640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa0680d3870 0x7fa06806d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:45.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.676+0000 7fa070600640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fa0680d2180 con 0x7fa0680d3870 2024-04-26T20:57:45.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.676+0000 7fa070600640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fa0680cd570 con 0x7fa06815f130 2024-04-26T20:57:45.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.676+0000 7fa070600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fa0680cd850 con 0x7fa06815f510 2024-04-26T20:57:45.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.676+0000 7fa06e600640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa0680d3870 0x7fa06806d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:45.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.676+0000 7fa06e600640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa0680d3870 0x7fa06806d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40866/0 (socket says 172.21.15.138:40866) 2024-04-26T20:57:45.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.676+0000 7fa06e600640 1 -- 172.21.15.138:0/913314101 learned_addr learned my addr 172.21.15.138:0/913314101 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:45.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.676+0000 7fa06e600640 1 -- 172.21.15.138:0/913314101 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa06815f510 msgr2=0x7fa0680cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:45.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.676+0000 7fa06d200640 1 --2- 172.21.15.138:0/913314101 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa06815f510 0x7fa0680cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:45.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.676+0000 7fa06dc00640 1 --2- 172.21.15.138:0/913314101 >> v2:172.21.15.143:3300/0 conn(0x7fa06815f130 0x7fa0680cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:45.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.676+0000 7fa06e600640 1 --2- 172.21.15.138:0/913314101 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa06815f510 0x7fa0680cfb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:45.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.676+0000 7fa06e600640 1 -- 172.21.15.138:0/913314101 >> v2:172.21.15.143:3300/0 conn(0x7fa06815f130 msgr2=0x7fa0680cf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:45.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.676+0000 7fa06e600640 1 --2- 172.21.15.138:0/913314101 >> v2:172.21.15.143:3300/0 conn(0x7fa06815f130 0x7fa0680cf600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:45.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.676+0000 7fa06e600640 1 -- 172.21.15.138:0/913314101 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa06806e730 con 0x7fa0680d3870 2024-04-26T20:57:45.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.676+0000 7fa06dc00640 1 --2- 172.21.15.138:0/913314101 >> v2:172.21.15.143:3300/0 conn(0x7fa06815f130 0x7fa0680cf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:57:45.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.676+0000 7fa06d200640 1 --2- 172.21.15.138:0/913314101 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa06815f510 0x7fa0680cfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:57:45.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.680+0000 7fa06e600640 1 --2- 172.21.15.138:0/913314101 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa0680d3870 0x7fa06806d620 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa068073320 tx=0x7fa06001c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=552b1a27acd96586 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:45.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.680+0000 7fa067e00640 1 -- 172.21.15.138:0/913314101 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0600b0070 con 0x7fa0680d3870 2024-04-26T20:57:45.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.680+0000 7fa067e00640 1 -- 172.21.15.138:0/913314101 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0600ab600 con 0x7fa0680d3870 2024-04-26T20:57:45.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.680+0000 7fa067e00640 1 -- 172.21.15.138:0/913314101 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0600ab9d0 con 0x7fa0680d3870 2024-04-26T20:57:45.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.680+0000 7fa070600640 1 -- 172.21.15.138:0/913314101 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa0680d3870 msgr2=0x7fa06806d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:45.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.680+0000 7fa070600640 1 --2- 172.21.15.138:0/913314101 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa0680d3870 0x7fa06806d620 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa068073320 tx=0x7fa06001c260 comp rx=0 tx=0).stop 2024-04-26T20:57:45.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.680+0000 7fa070600640 1 -- 172.21.15.138:0/913314101 shutdown_connections 2024-04-26T20:57:45.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.680+0000 7fa070600640 1 --2- 172.21.15.138:0/913314101 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa0680d3870 0x7fa06806d620 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:45.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.680+0000 7fa070600640 1 --2- 172.21.15.138:0/913314101 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa06815f510 0x7fa0680cfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:45.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.680+0000 7fa070600640 1 --2- 172.21.15.138:0/913314101 >> v2:172.21.15.143:3300/0 conn(0x7fa06815f130 0x7fa0680cf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:45.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.680+0000 7fa070600640 1 -- 172.21.15.138:0/913314101 >> 172.21.15.138:0/913314101 conn(0x7fa0680d2d80 msgr2=0x7fa0680d3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:45.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.680+0000 7fa070600640 1 -- 172.21.15.138:0/913314101 shutdown_connections 2024-04-26T20:57:45.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.680+0000 7fa070600640 1 -- 172.21.15.138:0/913314101 wait complete. 2024-04-26T20:57:45.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.684+0000 7fa070600640 1 Processor -- start 2024-04-26T20:57:45.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.684+0000 7fa070600640 1 -- start start 2024-04-26T20:57:45.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.684+0000 7fa070600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa0680d3870 0x7fa068152420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:45.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.684+0000 7fa070600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa06815f130 0x7fa068160380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:45.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.684+0000 7fa070600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa06815f510 0x7fa0680c67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:45.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.684+0000 7fa070600640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fa0680ce140 con 0x7fa0680d3870 2024-04-26T20:57:45.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.684+0000 7fa070600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fa0680cdfc0 con 0x7fa06815f130 2024-04-26T20:57:45.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.684+0000 7fa070600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fa0680ce2c0 con 0x7fa06815f510 2024-04-26T20:57:45.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.684+0000 7fa06dc00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa0680d3870 0x7fa068152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:45.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.684+0000 7fa06dc00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa0680d3870 0x7fa068152420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40870/0 (socket says 172.21.15.138:40870) 2024-04-26T20:57:45.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.684+0000 7fa06dc00640 1 -- 172.21.15.138:0/3760081143 learned_addr learned my addr 172.21.15.138:0/3760081143 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:45.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.684+0000 7fa06e600640 1 --2- 172.21.15.138:0/3760081143 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa06815f510 0x7fa0680c67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:45.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.684+0000 7fa06d200640 1 --2- 172.21.15.138:0/3760081143 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa06815f130 0x7fa068160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:45.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.684+0000 7fa06dc00640 1 -- 172.21.15.138:0/3760081143 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa06815f510 msgr2=0x7fa0680c67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:45.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.684+0000 7fa06dc00640 1 --2- 172.21.15.138:0/3760081143 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa06815f510 0x7fa0680c67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:45.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.684+0000 7fa06dc00640 1 -- 172.21.15.138:0/3760081143 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa06815f130 msgr2=0x7fa068160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:45.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.684+0000 7fa06dc00640 1 --2- 172.21.15.138:0/3760081143 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa06815f130 0x7fa068160380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:45.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.684+0000 7fa06dc00640 1 -- 172.21.15.138:0/3760081143 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0680b5460 con 0x7fa0680d3870 2024-04-26T20:57:45.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.684+0000 7fa06e600640 1 --2- 172.21.15.138:0/3760081143 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa06815f510 0x7fa0680c67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:45.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.684+0000 7fa06d200640 1 --2- 172.21.15.138:0/3760081143 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa06815f130 0x7fa068160380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:45.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.684+0000 7fa06dc00640 1 --2- 172.21.15.138:0/3760081143 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa0680d3870 0x7fa068152420 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa05c00cf60 tx=0x7fa05c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:45.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.684+0000 7fa065600640 1 -- 172.21.15.138:0/3760081143 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05c01a070 con 0x7fa0680d3870 2024-04-26T20:57:45.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.684+0000 7fa065600640 1 -- 172.21.15.138:0/3760081143 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa05c00d840 con 0x7fa0680d3870 2024-04-26T20:57:45.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.684+0000 7fa070600640 1 -- 172.21.15.138:0/3760081143 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0681608c0 con 0x7fa0680d3870 2024-04-26T20:57:45.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.684+0000 7fa065600640 1 -- 172.21.15.138:0/3760081143 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05c00dc10 con 0x7fa0680d3870 2024-04-26T20:57:45.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.684+0000 7fa070600640 1 -- 172.21.15.138:0/3760081143 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa068158680 con 0x7fa0680d3870 2024-04-26T20:57:45.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.684+0000 7fa070600640 1 -- 172.21.15.138:0/3760081143 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa068069510 con 0x7fa0680d3870 2024-04-26T20:57:45.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.688+0000 7fa065600640 1 -- 172.21.15.138:0/3760081143 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa05c01d070 con 0x7fa0680d3870 2024-04-26T20:57:45.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.688+0000 7fa065600640 1 --2- 172.21.15.138:0/3760081143 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fa048068380 0x7fa04806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:45.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.688+0000 7fa065600640 1 -- 172.21.15.138:0/3760081143 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7fa05c086fd0 con 0x7fa0680d3870 2024-04-26T20:57:45.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.688+0000 7fa06d200640 1 --2- 172.21.15.138:0/3760081143 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fa048068380 0x7fa04806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:45.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.688+0000 7fa06d200640 1 --2- 172.21.15.138:0/3760081143 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fa048068380 0x7fa04806a840 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa0680c77c0 tx=0x7fa054008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:45.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.692+0000 7fa065600640 1 -- 172.21.15.138:0/3760081143 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa05c057060 con 0x7fa0680d3870 2024-04-26T20:57:45.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.900+0000 7fa070600640 1 -- 172.21.15.138:0/3760081143 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fa06806d6b0 con 0x7fa0680d3870 2024-04-26T20:57:45.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.900+0000 7fa065600640 1 -- 172.21.15.138:0/3760081143 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) ==== 80+0+6645 (secure 0 0 0) 0x7fa05c05b360 con 0x7fa0680d3870 2024-04-26T20:57:45.905 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:57:45.906 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-26T20:57:45.906 INFO:teuthology.orchestra.run.smithi138.stdout: "auth_dump": [ 2024-04-26T20:57:45.906 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-26T20:57:45.906 INFO:teuthology.orchestra.run.smithi138.stdout: "entity": "mds.a", 2024-04-26T20:57:45.906 INFO:teuthology.orchestra.run.smithi138.stdout: "key": "AQDLFCxmrJXZORAARSUhmN08gIRiapGLE37gjw==", 2024-04-26T20:57:45.906 INFO:teuthology.orchestra.run.smithi138.stdout: "caps": { 2024-04-26T20:57:45.906 INFO:teuthology.orchestra.run.smithi138.stdout: "mds": "allow", 2024-04-26T20:57:45.906 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr": "allow *", 2024-04-26T20:57:45.906 INFO:teuthology.orchestra.run.smithi138.stdout: "mon": "allow *", 2024-04-26T20:57:45.906 INFO:teuthology.orchestra.run.smithi138.stdout: "osd": "allow *" 2024-04-26T20:57:45.906 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-26T20:57:45.906 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-26T20:57:45.907 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-26T20:57:45.907 INFO:teuthology.orchestra.run.smithi138.stdout: "entity": "mds.b", 2024-04-26T20:57:45.907 INFO:teuthology.orchestra.run.smithi138.stdout: "key": "AQDMFCxmx/hwChAAyTzkas88xCkTCINNsLkRQw==", 2024-04-26T20:57:45.907 INFO:teuthology.orchestra.run.smithi138.stdout: "caps": { 2024-04-26T20:57:45.907 INFO:teuthology.orchestra.run.smithi138.stdout: "mds": "allow", 2024-04-26T20:57:45.907 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr": "allow *", 2024-04-26T20:57:45.907 INFO:teuthology.orchestra.run.smithi138.stdout: "mon": "allow *", 2024-04-26T20:57:45.907 INFO:teuthology.orchestra.run.smithi138.stdout: "osd": "allow *" 2024-04-26T20:57:45.907 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-26T20:57:45.907 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-26T20:57:45.907 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-26T20:57:45.907 INFO:teuthology.orchestra.run.smithi138.stdout: "entity": "mds.c", 2024-04-26T20:57:45.907 INFO:teuthology.orchestra.run.smithi138.stdout: "key": "AQDMFCxmiU2FBRAAOY06cfyEEKPfX1huoUL1QQ==", 2024-04-26T20:57:45.907 INFO:teuthology.orchestra.run.smithi138.stdout: "caps": { 2024-04-26T20:57:45.907 INFO:teuthology.orchestra.run.smithi138.stdout: "mds": "allow", 2024-04-26T20:57:45.908 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr": "allow *", 2024-04-26T20:57:45.908 INFO:teuthology.orchestra.run.smithi138.stdout: "mon": "allow *", 2024-04-26T20:57:45.908 INFO:teuthology.orchestra.run.smithi138.stdout: "osd": "allow *" 2024-04-26T20:57:45.908 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-26T20:57:45.908 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-26T20:57:45.908 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-26T20:57:45.908 INFO:teuthology.orchestra.run.smithi138.stdout: "entity": "mds.d", 2024-04-26T20:57:45.908 INFO:teuthology.orchestra.run.smithi138.stdout: "key": "AQDMFCxml8S1ERAAnCVWlnf6keN3XjgmQwZ92Q==", 2024-04-26T20:57:45.908 INFO:teuthology.orchestra.run.smithi138.stdout: "caps": { 2024-04-26T20:57:45.908 INFO:teuthology.orchestra.run.smithi138.stdout: "mds": "allow", 2024-04-26T20:57:45.908 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr": "allow *", 2024-04-26T20:57:45.908 INFO:teuthology.orchestra.run.smithi138.stdout: "mon": "allow *", 2024-04-26T20:57:45.908 INFO:teuthology.orchestra.run.smithi138.stdout: "osd": "allow *" 2024-04-26T20:57:45.908 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-26T20:57:45.908 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-26T20:57:45.908 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-26T20:57:45.909 INFO:teuthology.orchestra.run.smithi138.stdout: "entity": "osd.0", 2024-04-26T20:57:45.909 INFO:teuthology.orchestra.run.smithi138.stdout: "key": "AQDPFCxmTpwXFxAAQ6oQYPx1A3NitL7suYOEWw==", 2024-04-26T20:57:45.909 INFO:teuthology.orchestra.run.smithi138.stdout: "caps": { 2024-04-26T20:57:45.909 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr": "allow profile osd", 2024-04-26T20:57:45.909 INFO:teuthology.orchestra.run.smithi138.stdout: "mon": "allow profile osd", 2024-04-26T20:57:45.909 INFO:teuthology.orchestra.run.smithi138.stdout: "osd": "allow *" 2024-04-26T20:57:45.909 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-26T20:57:45.909 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-26T20:57:45.909 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-26T20:57:45.909 INFO:teuthology.orchestra.run.smithi138.stdout: "entity": "osd.1", 2024-04-26T20:57:45.909 INFO:teuthology.orchestra.run.smithi138.stdout: "key": "AQDSFCxmx+0+IRAA0olAep0l6XtNS6QJ9S75+w==", 2024-04-26T20:57:45.909 INFO:teuthology.orchestra.run.smithi138.stdout: "caps": { 2024-04-26T20:57:45.909 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr": "allow profile osd", 2024-04-26T20:57:45.909 INFO:teuthology.orchestra.run.smithi138.stdout: "mon": "allow profile osd", 2024-04-26T20:57:45.909 INFO:teuthology.orchestra.run.smithi138.stdout: "osd": "allow *" 2024-04-26T20:57:45.909 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-26T20:57:45.910 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-26T20:57:45.910 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-26T20:57:45.910 INFO:teuthology.orchestra.run.smithi138.stdout: "entity": "osd.2", 2024-04-26T20:57:45.910 INFO:teuthology.orchestra.run.smithi138.stdout: "key": "AQDVFCxmATOmKRAAxSBRQtLQq4KLYmyD+Voz4g==", 2024-04-26T20:57:45.910 INFO:teuthology.orchestra.run.smithi138.stdout: "caps": { 2024-04-26T20:57:45.910 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr": "allow profile osd", 2024-04-26T20:57:45.910 INFO:teuthology.orchestra.run.smithi138.stdout: "mon": "allow profile osd", 2024-04-26T20:57:45.910 INFO:teuthology.orchestra.run.smithi138.stdout: "osd": "allow *" 2024-04-26T20:57:45.910 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-26T20:57:45.910 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-26T20:57:45.910 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-26T20:57:45.910 INFO:teuthology.orchestra.run.smithi138.stdout: "entity": "osd.3", 2024-04-26T20:57:45.910 INFO:teuthology.orchestra.run.smithi138.stdout: "key": "AQDYFCxmxdJlMxAAQ4lv8aphlApKCcW63BAGPw==", 2024-04-26T20:57:45.911 INFO:teuthology.orchestra.run.smithi138.stdout: "caps": { 2024-04-26T20:57:45.911 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr": "allow profile osd", 2024-04-26T20:57:45.911 INFO:teuthology.orchestra.run.smithi138.stdout: "mon": "allow profile osd", 2024-04-26T20:57:45.911 INFO:teuthology.orchestra.run.smithi138.stdout: "osd": "allow *" 2024-04-26T20:57:45.911 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-26T20:57:45.911 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-26T20:57:45.911 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-26T20:57:45.911 INFO:teuthology.orchestra.run.smithi138.stdout: "entity": "osd.4", 2024-04-26T20:57:45.911 INFO:teuthology.orchestra.run.smithi138.stdout: "key": "AQDeFCxm1NhsKRAAbjGaVOy1yQMo2+I3byWC0w==", 2024-04-26T20:57:45.911 INFO:teuthology.orchestra.run.smithi138.stdout: "caps": { 2024-04-26T20:57:45.911 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr": "allow profile osd", 2024-04-26T20:57:45.911 INFO:teuthology.orchestra.run.smithi138.stdout: "mon": "allow profile osd", 2024-04-26T20:57:45.911 INFO:teuthology.orchestra.run.smithi138.stdout: "osd": "allow *" 2024-04-26T20:57:45.911 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-26T20:57:45.911 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-26T20:57:45.912 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-26T20:57:45.912 INFO:teuthology.orchestra.run.smithi138.stdout: "entity": "osd.5", 2024-04-26T20:57:45.912 INFO:teuthology.orchestra.run.smithi138.stdout: "key": "AQDhFCxmjKAKMxAAvHCiEx7RXBd23JlHUYZkeQ==", 2024-04-26T20:57:45.912 INFO:teuthology.orchestra.run.smithi138.stdout: "caps": { 2024-04-26T20:57:45.912 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr": "allow profile osd", 2024-04-26T20:57:45.912 INFO:teuthology.orchestra.run.smithi138.stdout: "mon": "allow profile osd", 2024-04-26T20:57:45.912 INFO:teuthology.orchestra.run.smithi138.stdout: "osd": "allow *" 2024-04-26T20:57:45.912 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-26T20:57:45.912 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-26T20:57:45.912 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-26T20:57:45.912 INFO:teuthology.orchestra.run.smithi138.stdout: "entity": "osd.6", 2024-04-26T20:57:45.912 INFO:teuthology.orchestra.run.smithi138.stdout: "key": "AQDlFCxmp8X7ABAAkhXysJolSCD3nlyOh905Lg==", 2024-04-26T20:57:45.912 INFO:teuthology.orchestra.run.smithi138.stdout: "caps": { 2024-04-26T20:57:45.912 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr": "allow profile osd", 2024-04-26T20:57:45.912 INFO:teuthology.orchestra.run.smithi138.stdout: "mon": "allow profile osd", 2024-04-26T20:57:45.912 INFO:teuthology.orchestra.run.smithi138.stdout: "osd": "allow *" 2024-04-26T20:57:45.913 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-26T20:57:45.913 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-26T20:57:45.913 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-26T20:57:45.913 INFO:teuthology.orchestra.run.smithi138.stdout: "entity": "osd.7", 2024-04-26T20:57:45.913 INFO:teuthology.orchestra.run.smithi138.stdout: "key": "AQDoFCxm8cnBCxAAkhwWtq2IlJcXTQY2rfLdLw==", 2024-04-26T20:57:45.913 INFO:teuthology.orchestra.run.smithi138.stdout: "caps": { 2024-04-26T20:57:45.913 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr": "allow profile osd", 2024-04-26T20:57:45.913 INFO:teuthology.orchestra.run.smithi138.stdout: "mon": "allow profile osd", 2024-04-26T20:57:45.913 INFO:teuthology.orchestra.run.smithi138.stdout: "osd": "allow *" 2024-04-26T20:57:45.913 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-26T20:57:45.913 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-26T20:57:45.913 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-26T20:57:45.913 INFO:teuthology.orchestra.run.smithi138.stdout: "entity": "client.0", 2024-04-26T20:57:45.913 INFO:teuthology.orchestra.run.smithi138.stdout: "key": "AQDMFCxmYsCoFRAAxzCFa5FIV+BhZqore3n18A==", 2024-04-26T20:57:45.914 INFO:teuthology.orchestra.run.smithi138.stdout: "caps": { 2024-04-26T20:57:45.914 INFO:teuthology.orchestra.run.smithi138.stdout: "mds": "allow", 2024-04-26T20:57:45.914 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr": "allow r", 2024-04-26T20:57:45.914 INFO:teuthology.orchestra.run.smithi138.stdout: "mon": "allow rw", 2024-04-26T20:57:45.914 INFO:teuthology.orchestra.run.smithi138.stdout: "osd": "allow rwx" 2024-04-26T20:57:45.914 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-26T20:57:45.914 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-26T20:57:45.914 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-26T20:57:45.914 INFO:teuthology.orchestra.run.smithi138.stdout: "entity": "client.1", 2024-04-26T20:57:45.914 INFO:teuthology.orchestra.run.smithi138.stdout: "key": "AQDMFCxmm7MPHxAA+UHPXA6+oimymXDSAcBEgA==", 2024-04-26T20:57:45.914 INFO:teuthology.orchestra.run.smithi138.stdout: "caps": { 2024-04-26T20:57:45.914 INFO:teuthology.orchestra.run.smithi138.stdout: "mds": "allow", 2024-04-26T20:57:45.914 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr": "allow r", 2024-04-26T20:57:45.914 INFO:teuthology.orchestra.run.smithi138.stdout: "mon": "allow rw", 2024-04-26T20:57:45.914 INFO:teuthology.orchestra.run.smithi138.stdout: "osd": "allow rwx" 2024-04-26T20:57:45.915 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-26T20:57:45.915 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-26T20:57:45.915 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-26T20:57:45.915 INFO:teuthology.orchestra.run.smithi138.stdout: "entity": "client.2", 2024-04-26T20:57:45.915 INFO:teuthology.orchestra.run.smithi138.stdout: "key": "AQDMFCxmMZeAGxAA46isUVFC9CHOwg04BWKyQA==", 2024-04-26T20:57:45.915 INFO:teuthology.orchestra.run.smithi138.stdout: "caps": { 2024-04-26T20:57:45.915 INFO:teuthology.orchestra.run.smithi138.stdout: "mds": "allow", 2024-04-26T20:57:45.915 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr": "allow r", 2024-04-26T20:57:45.915 INFO:teuthology.orchestra.run.smithi138.stdout: "mon": "allow rw", 2024-04-26T20:57:45.915 INFO:teuthology.orchestra.run.smithi138.stdout: "osd": "allow rwx" 2024-04-26T20:57:45.915 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-26T20:57:45.915 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-26T20:57:45.915 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-26T20:57:45.915 INFO:teuthology.orchestra.run.smithi138.stdout: "entity": "client.3", 2024-04-26T20:57:45.916 INFO:teuthology.orchestra.run.smithi138.stdout: "key": "AQDMFCxmRrnmJBAAM2FqoVpEa6dMr6Ezfb1P8w==", 2024-04-26T20:57:45.916 INFO:teuthology.orchestra.run.smithi138.stdout: "caps": { 2024-04-26T20:57:45.916 INFO:teuthology.orchestra.run.smithi138.stdout: "mds": "allow", 2024-04-26T20:57:45.916 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr": "allow r", 2024-04-26T20:57:45.916 INFO:teuthology.orchestra.run.smithi138.stdout: "mon": "allow rw", 2024-04-26T20:57:45.916 INFO:teuthology.orchestra.run.smithi138.stdout: "osd": "allow rwx" 2024-04-26T20:57:45.916 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-26T20:57:45.916 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-26T20:57:45.916 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-26T20:57:45.916 INFO:teuthology.orchestra.run.smithi138.stdout: "entity": "client.admin", 2024-04-26T20:57:45.916 INFO:teuthology.orchestra.run.smithi138.stdout: "key": "AQDLFCxmhvxJHhAAYS1MzrogCgf1rxO42Q8UrA==", 2024-04-26T20:57:45.916 INFO:teuthology.orchestra.run.smithi138.stdout: "caps": { 2024-04-26T20:57:45.916 INFO:teuthology.orchestra.run.smithi138.stdout: "mds": "allow *", 2024-04-26T20:57:45.916 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr": "allow *", 2024-04-26T20:57:45.916 INFO:teuthology.orchestra.run.smithi138.stdout: "mon": "allow *", 2024-04-26T20:57:45.917 INFO:teuthology.orchestra.run.smithi138.stdout: "osd": "allow *" 2024-04-26T20:57:45.917 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-26T20:57:45.917 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-26T20:57:45.917 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-26T20:57:45.917 INFO:teuthology.orchestra.run.smithi138.stdout: "entity": "client.bootstrap-mds", 2024-04-26T20:57:45.917 INFO:teuthology.orchestra.run.smithi138.stdout: "key": "AQDuFCxmQOXoChAAAMUaJCXuyRY3fOUCYLrWlQ==", 2024-04-26T20:57:45.917 INFO:teuthology.orchestra.run.smithi138.stdout: "caps": { 2024-04-26T20:57:45.917 INFO:teuthology.orchestra.run.smithi138.stdout: "mon": "allow profile bootstrap-mds" 2024-04-26T20:57:45.917 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-26T20:57:45.917 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-26T20:57:45.917 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-26T20:57:45.917 INFO:teuthology.orchestra.run.smithi138.stdout: "entity": "client.bootstrap-mgr", 2024-04-26T20:57:45.917 INFO:teuthology.orchestra.run.smithi138.stdout: "key": "AQDuFCxm9u7oChAAL+AD7ecGhCY5OUNn27Jziw==", 2024-04-26T20:57:45.917 INFO:teuthology.orchestra.run.smithi138.stdout: "caps": { 2024-04-26T20:57:45.917 INFO:teuthology.orchestra.run.smithi138.stdout: "mon": "allow profile bootstrap-mgr" 2024-04-26T20:57:45.918 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-26T20:57:45.918 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-26T20:57:45.918 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-26T20:57:45.918 INFO:teuthology.orchestra.run.smithi138.stdout: "entity": "client.bootstrap-osd", 2024-04-26T20:57:45.918 INFO:teuthology.orchestra.run.smithi138.stdout: "key": "AQDuFCxmOvfoChAAOvZGpmu69fZzgMy3L7c7Bg==", 2024-04-26T20:57:45.918 INFO:teuthology.orchestra.run.smithi138.stdout: "caps": { 2024-04-26T20:57:45.918 INFO:teuthology.orchestra.run.smithi138.stdout: "mon": "allow profile bootstrap-osd" 2024-04-26T20:57:45.918 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-26T20:57:45.918 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-26T20:57:45.918 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-26T20:57:45.918 INFO:teuthology.orchestra.run.smithi138.stdout: "entity": "client.bootstrap-rbd", 2024-04-26T20:57:45.918 INFO:teuthology.orchestra.run.smithi138.stdout: "key": "AQDuFCxmcv/oChAAHJuJzVr739ey81NoOi/gmw==", 2024-04-26T20:57:45.918 INFO:teuthology.orchestra.run.smithi138.stdout: "caps": { 2024-04-26T20:57:45.918 INFO:teuthology.orchestra.run.smithi138.stdout: "mon": "allow profile bootstrap-rbd" 2024-04-26T20:57:45.918 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-26T20:57:45.919 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-26T20:57:45.919 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-26T20:57:45.919 INFO:teuthology.orchestra.run.smithi138.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-04-26T20:57:45.919 INFO:teuthology.orchestra.run.smithi138.stdout: "key": "AQDuFCxm3AfpChAAJsj5GK0RVr8li7sYw0b/EA==", 2024-04-26T20:57:45.919 INFO:teuthology.orchestra.run.smithi138.stdout: "caps": { 2024-04-26T20:57:45.919 INFO:teuthology.orchestra.run.smithi138.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-04-26T20:57:45.919 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-26T20:57:45.919 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-26T20:57:45.919 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-26T20:57:45.919 INFO:teuthology.orchestra.run.smithi138.stdout: "entity": "client.bootstrap-rgw", 2024-04-26T20:57:45.919 INFO:teuthology.orchestra.run.smithi138.stdout: "key": "AQDuFCxmVBDpChAASn0liS+CidHF0/FxfW+F+g==", 2024-04-26T20:57:45.919 INFO:teuthology.orchestra.run.smithi138.stdout: "caps": { 2024-04-26T20:57:45.919 INFO:teuthology.orchestra.run.smithi138.stdout: "mon": "allow profile bootstrap-rgw" 2024-04-26T20:57:45.919 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-26T20:57:45.920 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-26T20:57:45.920 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-26T20:57:45.920 INFO:teuthology.orchestra.run.smithi138.stdout: "entity": "mgr.x", 2024-04-26T20:57:45.920 INFO:teuthology.orchestra.run.smithi138.stdout: "key": "AQDLFCxmkFapNRAA2ap9S6nUMWLIknwYDxh/QA==", 2024-04-26T20:57:45.920 INFO:teuthology.orchestra.run.smithi138.stdout: "caps": { 2024-04-26T20:57:45.920 INFO:teuthology.orchestra.run.smithi138.stdout: "mds": "allow *", 2024-04-26T20:57:45.920 INFO:teuthology.orchestra.run.smithi138.stdout: "mon": "allow profile mgr", 2024-04-26T20:57:45.920 INFO:teuthology.orchestra.run.smithi138.stdout: "osd": "allow *" 2024-04-26T20:57:45.920 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-26T20:57:45.920 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-26T20:57:45.920 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-26T20:57:45.920 INFO:teuthology.orchestra.run.smithi138.stdout: "entity": "mgr.y", 2024-04-26T20:57:45.920 INFO:teuthology.orchestra.run.smithi138.stdout: "key": "AQDLFCxmo2zDMRAApLkTdc3di8OH+n8zY8w1vg==", 2024-04-26T20:57:45.920 INFO:teuthology.orchestra.run.smithi138.stdout: "caps": { 2024-04-26T20:57:45.920 INFO:teuthology.orchestra.run.smithi138.stdout: "mds": "allow *", 2024-04-26T20:57:45.921 INFO:teuthology.orchestra.run.smithi138.stdout: "mon": "allow profile mgr", 2024-04-26T20:57:45.921 INFO:teuthology.orchestra.run.smithi138.stdout: "osd": "allow *" 2024-04-26T20:57:45.921 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-26T20:57:45.921 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-26T20:57:45.921 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-26T20:57:45.921 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-26T20:57:45.922 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.900+0000 7fa070600640 1 -- 172.21.15.138:0/3760081143 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fa048068380 msgr2=0x7fa04806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:45.922 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.900+0000 7fa070600640 1 --2- 172.21.15.138:0/3760081143 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fa048068380 0x7fa04806a840 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa0680c77c0 tx=0x7fa054008040 comp rx=0 tx=0).stop 2024-04-26T20:57:45.922 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.900+0000 7fa070600640 1 -- 172.21.15.138:0/3760081143 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa0680d3870 msgr2=0x7fa068152420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:45.922 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.900+0000 7fa070600640 1 --2- 172.21.15.138:0/3760081143 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa0680d3870 0x7fa068152420 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa05c00cf60 tx=0x7fa05c00cf90 comp rx=0 tx=0).stop 2024-04-26T20:57:45.922 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.900+0000 7fa070600640 1 -- 172.21.15.138:0/3760081143 shutdown_connections 2024-04-26T20:57:45.922 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.900+0000 7fa070600640 1 --2- 172.21.15.138:0/3760081143 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fa048068380 0x7fa04806a840 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:45.922 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.900+0000 7fa070600640 1 --2- 172.21.15.138:0/3760081143 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa06815f510 0x7fa0680c67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:45.922 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.900+0000 7fa070600640 1 --2- 172.21.15.138:0/3760081143 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa06815f130 0x7fa068160380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:45.922 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.900+0000 7fa070600640 1 --2- 172.21.15.138:0/3760081143 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa0680d3870 0x7fa068152420 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:45.922 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.900+0000 7fa070600640 1 -- 172.21.15.138:0/3760081143 >> 172.21.15.138:0/3760081143 conn(0x7fa0680d2d80 msgr2=0x7fa0680d3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:45.922 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.900+0000 7fa070600640 1 -- 172.21.15.138:0/3760081143 shutdown_connections 2024-04-26T20:57:45.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:45.900+0000 7fa070600640 1 -- 172.21.15.138:0/3760081143 wait complete. 2024-04-26T20:57:45.927 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-04-26T20:57:46.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.060+0000 7f9383000640 1 Processor -- start 2024-04-26T20:57:46.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.060+0000 7f9383000640 1 -- start start 2024-04-26T20:57:46.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.060+0000 7f9383000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f937c15ce20 0x7f937c161340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:46.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.060+0000 7f9383000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f937c15e0c0 0x7f937c071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:46.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.060+0000 7f9383000640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f937c073b70 con 0x7f937c0cca00 2024-04-26T20:57:46.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.060+0000 7f9383000640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f937c073e10 con 0x7f937c15e0c0 2024-04-26T20:57:46.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.060+0000 7f9383000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f937c0740f0 con 0x7f937c15ce20 2024-04-26T20:57:46.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.060+0000 7f937b400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f937c15e0c0 0x7f937c071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:46.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.060+0000 7f937b400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f937c15e0c0 0x7f937c071ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40886/0 (socket says 172.21.15.138:40886) 2024-04-26T20:57:46.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.060+0000 7f9381000640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f937c0cca00 0x7f937c06de70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:43000/0 (socket says 172.21.15.138:43000) 2024-04-26T20:57:46.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.060+0000 7f937b400640 1 -- 172.21.15.138:0/3972645396 learned_addr learned my addr 172.21.15.138:0/3972645396 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:46.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.060+0000 7f937be00640 1 --2- 172.21.15.138:0/3972645396 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f937c15ce20 0x7f937c161340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:46.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.060+0000 7f937b400640 1 -- 172.21.15.138:0/3972645396 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f937c15ce20 msgr2=0x7f937c161340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:46.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.060+0000 7f937b400640 1 --2- 172.21.15.138:0/3972645396 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f937c15ce20 0x7f937c161340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:46.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.060+0000 7f937b400640 1 -- 172.21.15.138:0/3972645396 >> v1:172.21.15.138:6789/0 conn(0x7f937c0cca00 legacy=0x7f937c06de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:46.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.060+0000 7f937b400640 1 -- 172.21.15.138:0/3972645396 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f937c160b40 con 0x7f937c15e0c0 2024-04-26T20:57:46.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.060+0000 7f937aa00640 1 -- 172.21.15.138:0/3972645396 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4152306817 0 0) 0x7f937c073b70 con 0x7f937c0cca00 2024-04-26T20:57:46.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.064+0000 7f937b400640 1 --2- 172.21.15.138:0/3972645396 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f937c15e0c0 0x7f937c071ee0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f9368009870 tx=0x7f936801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eefbc17fe8dfe81 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:46.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.064+0000 7f937aa00640 1 -- 172.21.15.138:0/3972645396 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93680ab640 con 0x7f937c15e0c0 2024-04-26T20:57:46.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.064+0000 7f937aa00640 1 -- 172.21.15.138:0/3972645396 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93680b0070 con 0x7f937c15e0c0 2024-04-26T20:57:46.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.064+0000 7f937aa00640 1 -- 172.21.15.138:0/3972645396 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93680aba00 con 0x7f937c15e0c0 2024-04-26T20:57:46.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.064+0000 7f9383000640 1 -- 172.21.15.138:0/3972645396 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f937c15e0c0 msgr2=0x7f937c071ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:46.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.064+0000 7f9383000640 1 --2- 172.21.15.138:0/3972645396 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f937c15e0c0 0x7f937c071ee0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f9368009870 tx=0x7f936801c530 comp rx=0 tx=0).stop 2024-04-26T20:57:46.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.064+0000 7f9383000640 1 -- 172.21.15.138:0/3972645396 shutdown_connections 2024-04-26T20:57:46.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.064+0000 7f9383000640 1 --2- 172.21.15.138:0/3972645396 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f937c15e0c0 0x7f937c071ee0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:46.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.064+0000 7f9383000640 1 --2- 172.21.15.138:0/3972645396 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f937c15ce20 0x7f937c161340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:46.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.064+0000 7f9383000640 1 -- 172.21.15.138:0/3972645396 >> 172.21.15.138:0/3972645396 conn(0x7f937c0d0b20 msgr2=0x7f937c0d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:46.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.064+0000 7f9383000640 1 -- 172.21.15.138:0/3972645396 shutdown_connections 2024-04-26T20:57:46.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.064+0000 7f9383000640 1 -- 172.21.15.138:0/3972645396 wait complete. 2024-04-26T20:57:46.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.064+0000 7f9383000640 1 Processor -- start 2024-04-26T20:57:46.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.068+0000 7f9383000640 1 -- start start 2024-04-26T20:57:46.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.068+0000 7f9383000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f937c0cca00 0x7f937c151630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:46.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.068+0000 7f9383000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f937c15ce20 0x7f937c1579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:46.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.068+0000 7f9383000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f937c15e0c0 0x7f937c14fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:46.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.068+0000 7f9383000640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f937c0725a0 con 0x7f937c0cca00 2024-04-26T20:57:46.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.068+0000 7f9383000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f937c072420 con 0x7f937c15ce20 2024-04-26T20:57:46.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.068+0000 7f9383000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f937c15d200 con 0x7f937c15e0c0 2024-04-26T20:57:46.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.068+0000 7f937be00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f937c0cca00 0x7f937c151630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:46.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.068+0000 7f937be00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f937c0cca00 0x7f937c151630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40892/0 (socket says 172.21.15.138:40892) 2024-04-26T20:57:46.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.068+0000 7f937be00640 1 -- 172.21.15.138:0/3510509412 learned_addr learned my addr 172.21.15.138:0/3510509412 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:46.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.068+0000 7f937be00640 1 -- 172.21.15.138:0/3510509412 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f937c15e0c0 msgr2=0x7f937c14fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:46.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.068+0000 7f937be00640 1 --2- 172.21.15.138:0/3510509412 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f937c15e0c0 0x7f937c14fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:46.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.068+0000 7f937be00640 1 -- 172.21.15.138:0/3510509412 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f937c15ce20 msgr2=0x7f937c1579c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:46.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.068+0000 7f937be00640 1 --2- 172.21.15.138:0/3510509412 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f937c15ce20 0x7f937c1579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:46.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.068+0000 7f937be00640 1 -- 172.21.15.138:0/3510509412 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f937c151b70 con 0x7f937c0cca00 2024-04-26T20:57:46.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.068+0000 7f937be00640 1 --2- 172.21.15.138:0/3510509412 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f937c0cca00 0x7f937c151630 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f936c00d800 tx=0x7f936c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:46.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.068+0000 7f9373e00640 1 -- 172.21.15.138:0/3510509412 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f936c00b6c0 con 0x7f937c0cca00 2024-04-26T20:57:46.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.068+0000 7f9373e00640 1 -- 172.21.15.138:0/3510509412 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f936c019070 con 0x7f937c0cca00 2024-04-26T20:57:46.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.068+0000 7f9373e00640 1 -- 172.21.15.138:0/3510509412 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f936c00ba60 con 0x7f937c0cca00 2024-04-26T20:57:46.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.068+0000 7f9383000640 1 -- 172.21.15.138:0/3510509412 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f937c15a5c0 con 0x7f937c0cca00 2024-04-26T20:57:46.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.068+0000 7f9383000640 1 -- 172.21.15.138:0/3510509412 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f937c15ae60 con 0x7f937c0cca00 2024-04-26T20:57:46.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.068+0000 7f9383000640 1 -- 172.21.15.138:0/3510509412 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f937c069510 con 0x7f937c0cca00 2024-04-26T20:57:46.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.072+0000 7f9373e00640 1 -- 172.21.15.138:0/3510509412 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f936c00bc00 con 0x7f937c0cca00 2024-04-26T20:57:46.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.072+0000 7f9373e00640 1 --2- 172.21.15.138:0/3510509412 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f935c068380 0x7f935c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:46.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.072+0000 7f9373e00640 1 -- 172.21.15.138:0/3510509412 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f936c086cb0 con 0x7f937c0cca00 2024-04-26T20:57:46.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.072+0000 7f937b400640 1 --2- 172.21.15.138:0/3510509412 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f935c068380 0x7f935c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:46.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.072+0000 7f937b400640 1 --2- 172.21.15.138:0/3510509412 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f935c068380 0x7f935c06a840 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f93680af000 tx=0x7f9368004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:46.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.076+0000 7f9373e00640 1 -- 172.21.15.138:0/3510509412 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f936c057420 con 0x7f937c0cca00 2024-04-26T20:57:46.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.292+0000 7f9383000640 1 -- 172.21.15.138:0/3510509412 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f937c1569d0 con 0x7f937c0cca00 2024-04-26T20:57:46.298 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.292+0000 7f9373e00640 1 -- 172.21.15.138:0/3510509412 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f936c056d20 con 0x7f937c0cca00 2024-04-26T20:57:46.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.296+0000 7f9383000640 1 -- 172.21.15.138:0/3510509412 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f935c068380 msgr2=0x7f935c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:46.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.296+0000 7f9383000640 1 --2- 172.21.15.138:0/3510509412 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f935c068380 0x7f935c06a840 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f93680af000 tx=0x7f9368004740 comp rx=0 tx=0).stop 2024-04-26T20:57:46.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.296+0000 7f9383000640 1 -- 172.21.15.138:0/3510509412 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f937c0cca00 msgr2=0x7f937c151630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:46.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.296+0000 7f9383000640 1 --2- 172.21.15.138:0/3510509412 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f937c0cca00 0x7f937c151630 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f936c00d800 tx=0x7f936c00dcc0 comp rx=0 tx=0).stop 2024-04-26T20:57:46.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.296+0000 7f9383000640 1 -- 172.21.15.138:0/3510509412 shutdown_connections 2024-04-26T20:57:46.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.296+0000 7f9383000640 1 --2- 172.21.15.138:0/3510509412 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f935c068380 0x7f935c06a840 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:46.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.296+0000 7f9383000640 1 --2- 172.21.15.138:0/3510509412 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f937c15e0c0 0x7f937c14fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:46.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.296+0000 7f9383000640 1 --2- 172.21.15.138:0/3510509412 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f937c15ce20 0x7f937c1579c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:46.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.296+0000 7f9383000640 1 --2- 172.21.15.138:0/3510509412 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f937c0cca00 0x7f937c151630 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:46.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.296+0000 7f9383000640 1 -- 172.21.15.138:0/3510509412 >> 172.21.15.138:0/3510509412 conn(0x7f937c0d0b20 msgr2=0x7f937c159200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:46.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.296+0000 7f9383000640 1 -- 172.21.15.138:0/3510509412 shutdown_connections 2024-04-26T20:57:46.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.296+0000 7f9383000640 1 -- 172.21.15.138:0/3510509412 wait complete. 2024-04-26T20:57:46.319 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-04-26T20:57:46.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.448+0000 7f87d0a00640 1 Processor -- start 2024-04-26T20:57:46.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.448+0000 7f87d0a00640 1 -- start start 2024-04-26T20:57:46.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.452+0000 7f87d0a00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f87cc0cbe00 0x7f87cc06de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:46.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.452+0000 7f87d0a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87cc0cc1e0 0x7f87cc073b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:46.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.452+0000 7f87d0a00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f87cc0ce6f0 0x7f87cc0ceb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:46.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.452+0000 7f87d0a00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f87cc073680 con 0x7f87cc0cbe00 2024-04-26T20:57:46.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.452+0000 7f87d0a00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f87cc0727f0 con 0x7f87cc0ce6f0 2024-04-26T20:57:46.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.452+0000 7f87d0a00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f87cc072a70 con 0x7f87cc0cc1e0 2024-04-26T20:57:46.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.452+0000 7f87c9e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f87cc0cbe00 0x7f87cc06de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:46.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.452+0000 7f87c9e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f87cc0cbe00 0x7f87cc06de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40900/0 (socket says 172.21.15.138:40900) 2024-04-26T20:57:46.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.452+0000 7f87c9e00640 1 -- 172.21.15.138:0/1473136692 learned_addr learned my addr 172.21.15.138:0/1473136692 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:46.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.452+0000 7f87ca800640 1 --2- 172.21.15.138:0/1473136692 >> v2:172.21.15.143:3300/0 conn(0x7f87cc0ce6f0 0x7f87cc0ceb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:46.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.452+0000 7f87c1400640 1 --2- 172.21.15.138:0/1473136692 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87cc0cc1e0 0x7f87cc073b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:46.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.452+0000 7f87c9e00640 1 -- 172.21.15.138:0/1473136692 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87cc0cc1e0 msgr2=0x7f87cc073b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:46.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.452+0000 7f87c9e00640 1 --2- 172.21.15.138:0/1473136692 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87cc0cc1e0 0x7f87cc073b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:46.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.452+0000 7f87c9e00640 1 -- 172.21.15.138:0/1473136692 >> v2:172.21.15.143:3300/0 conn(0x7f87cc0ce6f0 msgr2=0x7f87cc0ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:46.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.452+0000 7f87c9e00640 1 --2- 172.21.15.138:0/1473136692 >> v2:172.21.15.143:3300/0 conn(0x7f87cc0ce6f0 0x7f87cc0ceb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:46.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.452+0000 7f87c9e00640 1 -- 172.21.15.138:0/1473136692 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87cc072d50 con 0x7f87cc0cbe00 2024-04-26T20:57:46.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.456+0000 7f87c9e00640 1 --2- 172.21.15.138:0/1473136692 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f87cc0cbe00 0x7f87cc06de70 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f87cc071b00 tx=0x7f87bc01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de259192f05dc1d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:46.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.456+0000 7f87c9400640 1 -- 172.21.15.138:0/1473136692 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87bc0a5670 con 0x7f87cc0cbe00 2024-04-26T20:57:46.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.456+0000 7f87c9400640 1 -- 172.21.15.138:0/1473136692 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87bc0a5810 con 0x7f87cc0cbe00 2024-04-26T20:57:46.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.456+0000 7f87c9400640 1 -- 172.21.15.138:0/1473136692 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87bc0a5be0 con 0x7f87cc0cbe00 2024-04-26T20:57:46.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.456+0000 7f87d0a00640 1 -- 172.21.15.138:0/1473136692 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f87cc0cbe00 msgr2=0x7f87cc06de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:46.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.456+0000 7f87d0a00640 1 --2- 172.21.15.138:0/1473136692 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f87cc0cbe00 0x7f87cc06de70 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f87cc071b00 tx=0x7f87bc01c9f0 comp rx=0 tx=0).stop 2024-04-26T20:57:46.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.456+0000 7f87d0a00640 1 -- 172.21.15.138:0/1473136692 shutdown_connections 2024-04-26T20:57:46.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.456+0000 7f87d0a00640 1 --2- 172.21.15.138:0/1473136692 >> v2:172.21.15.143:3300/0 conn(0x7f87cc0ce6f0 0x7f87cc0ceb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:46.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.456+0000 7f87d0a00640 1 --2- 172.21.15.138:0/1473136692 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87cc0cc1e0 0x7f87cc073b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:46.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.456+0000 7f87d0a00640 1 --2- 172.21.15.138:0/1473136692 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f87cc0cbe00 0x7f87cc06de70 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:46.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.456+0000 7f87d0a00640 1 -- 172.21.15.138:0/1473136692 >> 172.21.15.138:0/1473136692 conn(0x7f87cc0d0b20 msgr2=0x7f87cc0d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:46.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.456+0000 7f87d0a00640 1 -- 172.21.15.138:0/1473136692 shutdown_connections 2024-04-26T20:57:46.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.456+0000 7f87d0a00640 1 -- 172.21.15.138:0/1473136692 wait complete. 2024-04-26T20:57:46.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.456+0000 7f87d0a00640 1 Processor -- start 2024-04-26T20:57:46.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.456+0000 7f87d0a00640 1 -- start start 2024-04-26T20:57:46.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.460+0000 7f87d0a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f87cc0cbe00 0x7f87cc0b66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:46.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.460+0000 7f87d0a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f87cc0cc1e0 0x7f87cc0b1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:46.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.460+0000 7f87d0a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87cc0ce6f0 0x7f87cc0b37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:46.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.460+0000 7f87d0a00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f87cc06e530 con 0x7f87cc0cbe00 2024-04-26T20:57:46.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.460+0000 7f87d0a00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f87cc06e3b0 con 0x7f87cc0cc1e0 2024-04-26T20:57:46.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.460+0000 7f87d0a00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f87cc074050 con 0x7f87cc0ce6f0 2024-04-26T20:57:46.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.460+0000 7f87c9e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f87cc0cbe00 0x7f87cc0b66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:46.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.460+0000 7f87c9e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f87cc0cbe00 0x7f87cc0b66b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40914/0 (socket says 172.21.15.138:40914) 2024-04-26T20:57:46.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.460+0000 7f87c9e00640 1 -- 172.21.15.138:0/611549195 learned_addr learned my addr 172.21.15.138:0/611549195 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:46.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.460+0000 7f87ca800640 1 --2- 172.21.15.138:0/611549195 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87cc0ce6f0 0x7f87cc0b37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:46.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.460+0000 7f87c1400640 1 --2- 172.21.15.138:0/611549195 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f87cc0cc1e0 0x7f87cc0b1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:46.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.460+0000 7f87c9e00640 1 -- 172.21.15.138:0/611549195 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87cc0ce6f0 msgr2=0x7f87cc0b37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:46.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.460+0000 7f87c9e00640 1 --2- 172.21.15.138:0/611549195 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87cc0ce6f0 0x7f87cc0b37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:46.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.460+0000 7f87c9e00640 1 -- 172.21.15.138:0/611549195 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f87cc0cc1e0 msgr2=0x7f87cc0b1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:46.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.460+0000 7f87c9e00640 1 --2- 172.21.15.138:0/611549195 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f87cc0cc1e0 0x7f87cc0b1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:46.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.460+0000 7f87c9e00640 1 -- 172.21.15.138:0/611549195 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87cc0b5650 con 0x7f87cc0cbe00 2024-04-26T20:57:46.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.460+0000 7f87c1400640 1 --2- 172.21.15.138:0/611549195 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f87cc0cc1e0 0x7f87cc0b1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:46.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.460+0000 7f87c9e00640 1 --2- 172.21.15.138:0/611549195 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f87cc0cbe00 0x7f87cc0b66b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f87bc0af040 tx=0x7f87bc019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:46.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.460+0000 7f87c2a00640 1 -- 172.21.15.138:0/611549195 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87bc0b8670 con 0x7f87cc0cbe00 2024-04-26T20:57:46.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.460+0000 7f87c2a00640 1 -- 172.21.15.138:0/611549195 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87bc0be070 con 0x7f87cc0cbe00 2024-04-26T20:57:46.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.460+0000 7f87d0a00640 1 -- 172.21.15.138:0/611549195 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87cc0b21f0 con 0x7f87cc0cbe00 2024-04-26T20:57:46.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.460+0000 7f87c2a00640 1 -- 172.21.15.138:0/611549195 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87bc0b8a70 con 0x7f87cc0cbe00 2024-04-26T20:57:46.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.460+0000 7f87d0a00640 1 -- 172.21.15.138:0/611549195 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87cc0b5bd0 con 0x7f87cc0cbe00 2024-04-26T20:57:46.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.460+0000 7f87d0a00640 1 -- 172.21.15.138:0/611549195 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87cc069510 con 0x7f87cc0cbe00 2024-04-26T20:57:46.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.460+0000 7f87c2a00640 1 -- 172.21.15.138:0/611549195 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f87bc0b8c10 con 0x7f87cc0cbe00 2024-04-26T20:57:46.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.464+0000 7f87c2a00640 1 --2- 172.21.15.138:0/611549195 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f87a8068380 0x7f87a806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:46.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.464+0000 7f87c2a00640 1 -- 172.21.15.138:0/611549195 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f87bc1224f0 con 0x7f87cc0cbe00 2024-04-26T20:57:46.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.464+0000 7f87c1400640 1 --2- 172.21.15.138:0/611549195 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f87a8068380 0x7f87a806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:46.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.464+0000 7f87c1400640 1 --2- 172.21.15.138:0/611549195 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f87a8068380 0x7f87a806a840 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f87b4004660 tx=0x7f87b4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:46.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.464+0000 7f87c2a00640 1 -- 172.21.15.138:0/611549195 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f87bc0165e0 con 0x7f87cc0cbe00 2024-04-26T20:57:46.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.684+0000 7f87d0a00640 1 -- 172.21.15.138:0/611549195 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f87cc0c89d0 con 0x7f87cc0cbe00 2024-04-26T20:57:46.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.684+0000 7f87c2a00640 1 -- 172.21.15.138:0/611549195 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f87bc0c23c0 con 0x7f87cc0cbe00 2024-04-26T20:57:46.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.688+0000 7f87d0a00640 1 -- 172.21.15.138:0/611549195 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f87a8068380 msgr2=0x7f87a806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:46.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.688+0000 7f87d0a00640 1 --2- 172.21.15.138:0/611549195 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f87a8068380 0x7f87a806a840 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f87b4004660 tx=0x7f87b4008040 comp rx=0 tx=0).stop 2024-04-26T20:57:46.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.688+0000 7f87d0a00640 1 -- 172.21.15.138:0/611549195 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f87cc0cbe00 msgr2=0x7f87cc0b66b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:46.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.688+0000 7f87d0a00640 1 --2- 172.21.15.138:0/611549195 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f87cc0cbe00 0x7f87cc0b66b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f87bc0af040 tx=0x7f87bc019790 comp rx=0 tx=0).stop 2024-04-26T20:57:46.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.688+0000 7f87d0a00640 1 -- 172.21.15.138:0/611549195 shutdown_connections 2024-04-26T20:57:46.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.688+0000 7f87d0a00640 1 --2- 172.21.15.138:0/611549195 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f87a8068380 0x7f87a806a840 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:46.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.688+0000 7f87d0a00640 1 --2- 172.21.15.138:0/611549195 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87cc0ce6f0 0x7f87cc0b37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:46.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.688+0000 7f87d0a00640 1 --2- 172.21.15.138:0/611549195 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f87cc0cc1e0 0x7f87cc0b1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:46.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.688+0000 7f87d0a00640 1 --2- 172.21.15.138:0/611549195 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f87cc0cbe00 0x7f87cc0b66b0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:46.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.688+0000 7f87d0a00640 1 -- 172.21.15.138:0/611549195 >> 172.21.15.138:0/611549195 conn(0x7f87cc0d0b20 msgr2=0x7f87cc0c4680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:46.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.688+0000 7f87d0a00640 1 -- 172.21.15.138:0/611549195 shutdown_connections 2024-04-26T20:57:46.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.688+0000 7f87d0a00640 1 -- 172.21.15.138:0/611549195 wait complete. 2024-04-26T20:57:46.711 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-04-26T20:57:46.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.844+0000 7fa647c00640 1 Processor -- start 2024-04-26T20:57:46.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.844+0000 7fa647c00640 1 -- start start 2024-04-26T20:57:46.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.844+0000 7fa647c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa64015cf80 0x7fa640073b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:46.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.844+0000 7fa647c00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa6400cc1e0 0x7fa6400ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:46.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.844+0000 7fa647c00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6400727f0 con 0x7fa6400cbe00 2024-04-26T20:57:46.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.844+0000 7fa647c00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fa640073680 con 0x7fa6400cc1e0 2024-04-26T20:57:46.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.844+0000 7fa647c00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fa640072a70 con 0x7fa64015cf80 2024-04-26T20:57:46.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.844+0000 7fa645200640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fa6400cbe00 0x7fa64006de70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:43014/0 (socket says 172.21.15.138:43014) 2024-04-26T20:57:46.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.844+0000 7fa645200640 1 -- 172.21.15.138:0/3328368312 learned_addr learned my addr 172.21.15.138:0/3328368312 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:46.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.844+0000 7fa637e00640 1 --2- 172.21.15.138:0/3328368312 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa64015cf80 0x7fa640073b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:46.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.844+0000 7fa645c00640 1 --2- 172.21.15.138:0/3328368312 >> v2:172.21.15.143:3300/0 conn(0x7fa6400cc1e0 0x7fa6400ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:46.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.844+0000 7fa63fe00640 1 -- 172.21.15.138:0/3328368312 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 555266613 0 0) 0x7fa630001120 con 0x7fa6400cbe00 2024-04-26T20:57:46.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.844+0000 7fa63fe00640 1 -- 172.21.15.138:0/3328368312 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa624003530 con 0x7fa6400cbe00 2024-04-26T20:57:46.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.844+0000 7fa63fe00640 1 -- 172.21.15.138:0/3328368312 <== mon.0 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2576239367 0 0) 0x7fa624003530 con 0x7fa6400cbe00 2024-04-26T20:57:46.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.844+0000 7fa63fe00640 1 -- 172.21.15.138:0/3328368312 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa64015cf80 msgr2=0x7fa640073b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:46.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.844+0000 7fa63fe00640 1 --2- 172.21.15.138:0/3328368312 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa64015cf80 0x7fa640073b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:46.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.844+0000 7fa63fe00640 1 -- 172.21.15.138:0/3328368312 >> v2:172.21.15.143:3300/0 conn(0x7fa6400cc1e0 msgr2=0x7fa6400ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:46.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.844+0000 7fa63fe00640 1 --2- 172.21.15.138:0/3328368312 >> v2:172.21.15.143:3300/0 conn(0x7fa6400cc1e0 0x7fa6400ce6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:46.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.844+0000 7fa63fe00640 1 -- 172.21.15.138:0/3328368312 --> v1:172.21.15.138:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa640072d50 con 0x7fa6400cbe00 2024-04-26T20:57:46.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.844+0000 7fa63fe00640 1 -- 172.21.15.138:0/3328368312 <== mon.0 v1:172.21.15.138:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2715389689 0 0) 0x7fa630001850 con 0x7fa6400cbe00 2024-04-26T20:57:46.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.844+0000 7fa63fe00640 1 -- 172.21.15.138:0/3328368312 >> v1:172.21.15.138:6789/0 conn(0x7fa6400cbe00 legacy=0x7fa64006de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:46.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.844+0000 7fa63fe00640 1 --2- 172.21.15.138:0/3328368312 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6240039c0 0x7fa624003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:46.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.844+0000 7fa63fe00640 1 --2- 172.21.15.138:0/3328368312 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa624004810 0x7fa624004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:46.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.844+0000 7fa63fe00640 1 --2- 172.21.15.138:0/3328368312 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa64015cf80 0x7fa6240051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:46.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.844+0000 7fa63fe00640 1 -- 172.21.15.138:0/3328368312 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fa640073680 con 0x7fa6240039c0 2024-04-26T20:57:46.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.844+0000 7fa63fe00640 1 -- 172.21.15.138:0/3328368312 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fa640072a70 con 0x7fa624004810 2024-04-26T20:57:46.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.844+0000 7fa63fe00640 1 -- 172.21.15.138:0/3328368312 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fa62400dbe0 con 0x7fa64015cf80 2024-04-26T20:57:46.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.844+0000 7fa645200640 1 --2- 172.21.15.138:0/3328368312 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6240039c0 0x7fa624003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:46.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.844+0000 7fa637e00640 1 --2- 172.21.15.138:0/3328368312 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa624004810 0x7fa624004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:46.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.844+0000 7fa645c00640 1 --2- 172.21.15.138:0/3328368312 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa64015cf80 0x7fa6240051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:46.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.844+0000 7fa645200640 1 -- 172.21.15.138:0/3328368312 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa64015cf80 msgr2=0x7fa6240051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:46.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.844+0000 7fa645200640 1 --2- 172.21.15.138:0/3328368312 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa64015cf80 0x7fa6240051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:46.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.844+0000 7fa645200640 1 -- 172.21.15.138:0/3328368312 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa624004810 msgr2=0x7fa624004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:46.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.844+0000 7fa645200640 1 --2- 172.21.15.138:0/3328368312 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa624004810 0x7fa624004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:46.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.844+0000 7fa645200640 1 -- 172.21.15.138:0/3328368312 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa624003530 con 0x7fa6240039c0 2024-04-26T20:57:46.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.848+0000 7fa645200640 1 --2- 172.21.15.138:0/3328368312 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6240039c0 0x7fa624003de0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa63000c4c0 tx=0x7fa63001ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4652ce2ab370a684 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:46.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.848+0000 7fa63fe00640 1 -- 172.21.15.138:0/3328368312 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa63000c0e0 con 0x7fa6240039c0 2024-04-26T20:57:46.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.848+0000 7fa63fe00640 1 -- 172.21.15.138:0/3328368312 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6300a9020 con 0x7fa6240039c0 2024-04-26T20:57:46.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.848+0000 7fa63fe00640 1 -- 172.21.15.138:0/3328368312 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa630005ae0 con 0x7fa6240039c0 2024-04-26T20:57:46.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.848+0000 7fa647c00640 1 -- 172.21.15.138:0/3328368312 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6240039c0 msgr2=0x7fa624003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:46.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.848+0000 7fa647c00640 1 --2- 172.21.15.138:0/3328368312 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6240039c0 0x7fa624003de0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa63000c4c0 tx=0x7fa63001ccc0 comp rx=0 tx=0).stop 2024-04-26T20:57:46.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.848+0000 7fa645c00640 1 -- 172.21.15.138:0/3328368312 reap_dead start 2024-04-26T20:57:46.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.848+0000 7fa647c00640 1 -- 172.21.15.138:0/3328368312 shutdown_connections 2024-04-26T20:57:46.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.848+0000 7fa647c00640 1 -- 172.21.15.138:0/3328368312 >> 172.21.15.138:0/3328368312 conn(0x7fa6400d0b20 msgr2=0x7fa6400d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:46.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.848+0000 7fa647c00640 1 -- 172.21.15.138:0/3328368312 shutdown_connections 2024-04-26T20:57:46.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.848+0000 7fa647c00640 1 -- 172.21.15.138:0/3328368312 wait complete. 2024-04-26T20:57:46.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.852+0000 7fa647c00640 1 Processor -- start 2024-04-26T20:57:46.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.852+0000 7fa647c00640 1 -- start start 2024-04-26T20:57:46.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.852+0000 7fa647c00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6240039c0 0x7fa6401521e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:46.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.852+0000 7fa647c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa6400c9870 0x7fa640161c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:46.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.852+0000 7fa647c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa6401621c0 0x7fa6400c7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:46.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.852+0000 7fa647c00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fa6400d0900 con 0x7fa6240039c0 2024-04-26T20:57:46.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.852+0000 7fa647c00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fa6400d0780 con 0x7fa6400c9870 2024-04-26T20:57:46.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.852+0000 7fa647c00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fa64006e700 con 0x7fa6401621c0 2024-04-26T20:57:46.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.852+0000 7fa645200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6240039c0 0x7fa6401521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:46.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.852+0000 7fa645200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6240039c0 0x7fa6401521e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40928/0 (socket says 172.21.15.138:40928) 2024-04-26T20:57:46.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.852+0000 7fa645200640 1 -- 172.21.15.138:0/3137130742 learned_addr learned my addr 172.21.15.138:0/3137130742 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:46.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.852+0000 7fa637e00640 1 --2- 172.21.15.138:0/3137130742 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa6400c9870 0x7fa640161c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:46.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.852+0000 7fa645c00640 1 --2- 172.21.15.138:0/3137130742 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa6401621c0 0x7fa6400c7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:46.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.852+0000 7fa645200640 1 -- 172.21.15.138:0/3137130742 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa6401621c0 msgr2=0x7fa6400c7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:46.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.852+0000 7fa645200640 1 --2- 172.21.15.138:0/3137130742 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa6401621c0 0x7fa6400c7bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:46.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.852+0000 7fa645200640 1 -- 172.21.15.138:0/3137130742 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa6400c9870 msgr2=0x7fa640161c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:46.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.852+0000 7fa645200640 1 --2- 172.21.15.138:0/3137130742 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa6400c9870 0x7fa640161c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:46.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.852+0000 7fa645200640 1 -- 172.21.15.138:0/3137130742 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6400c87d0 con 0x7fa6240039c0 2024-04-26T20:57:46.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.852+0000 7fa645c00640 1 --2- 172.21.15.138:0/3137130742 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa6401621c0 0x7fa6400c7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:46.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.852+0000 7fa645200640 1 --2- 172.21.15.138:0/3137130742 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6240039c0 0x7fa6401521e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa6300ab040 tx=0x7fa624005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:46.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.852+0000 7fa63d600640 1 -- 172.21.15.138:0/3137130742 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6300049f0 con 0x7fa6240039c0 2024-04-26T20:57:46.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.852+0000 7fa63d600640 1 -- 172.21.15.138:0/3137130742 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa630004b90 con 0x7fa6240039c0 2024-04-26T20:57:46.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.852+0000 7fa647c00640 1 -- 172.21.15.138:0/3137130742 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6400c8ab0 con 0x7fa6240039c0 2024-04-26T20:57:46.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.852+0000 7fa63d600640 1 -- 172.21.15.138:0/3137130742 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6300070d0 con 0x7fa6240039c0 2024-04-26T20:57:46.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.852+0000 7fa647c00640 1 -- 172.21.15.138:0/3137130742 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6400c9070 con 0x7fa6240039c0 2024-04-26T20:57:46.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.856+0000 7fa647c00640 1 -- 172.21.15.138:0/3137130742 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa640069510 con 0x7fa6240039c0 2024-04-26T20:57:46.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.856+0000 7fa63d600640 1 -- 172.21.15.138:0/3137130742 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa630007270 con 0x7fa6240039c0 2024-04-26T20:57:46.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.856+0000 7fa63d600640 1 --2- 172.21.15.138:0/3137130742 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fa61c068380 0x7fa61c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:46.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.856+0000 7fa63d600640 1 -- 172.21.15.138:0/3137130742 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7fa63011f590 con 0x7fa6240039c0 2024-04-26T20:57:46.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.856+0000 7fa637e00640 1 --2- 172.21.15.138:0/3137130742 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fa61c068380 0x7fa61c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:46.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.856+0000 7fa637e00640 1 --2- 172.21.15.138:0/3137130742 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fa61c068380 0x7fa61c06a840 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa640157620 tx=0x7fa628009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:46.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:46.860+0000 7fa63d600640 1 -- 172.21.15.138:0/3137130742 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa6300b4070 con 0x7fa6240039c0 2024-04-26T20:57:47.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.072+0000 7fa647c00640 1 -- 172.21.15.138:0/3137130742 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7fa6401625a0 con 0x7fa6240039c0 2024-04-26T20:57:47.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.076+0000 7fa63d600640 1 -- 172.21.15.138:0/3137130742 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7fa6400727f0 con 0x7fa6240039c0 2024-04-26T20:57:47.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.076+0000 7fa647c00640 1 -- 172.21.15.138:0/3137130742 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fa61c068380 msgr2=0x7fa61c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:47.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.076+0000 7fa647c00640 1 --2- 172.21.15.138:0/3137130742 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fa61c068380 0x7fa61c06a840 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa640157620 tx=0x7fa628009190 comp rx=0 tx=0).stop 2024-04-26T20:57:47.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.076+0000 7fa647c00640 1 -- 172.21.15.138:0/3137130742 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6240039c0 msgr2=0x7fa6401521e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:47.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.076+0000 7fa647c00640 1 --2- 172.21.15.138:0/3137130742 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6240039c0 0x7fa6401521e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa6300ab040 tx=0x7fa624005840 comp rx=0 tx=0).stop 2024-04-26T20:57:47.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.076+0000 7fa647c00640 1 -- 172.21.15.138:0/3137130742 shutdown_connections 2024-04-26T20:57:47.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.076+0000 7fa647c00640 1 --2- 172.21.15.138:0/3137130742 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fa61c068380 0x7fa61c06a840 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:47.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.076+0000 7fa647c00640 1 --2- 172.21.15.138:0/3137130742 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa6401621c0 0x7fa6400c7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:47.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.076+0000 7fa647c00640 1 --2- 172.21.15.138:0/3137130742 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa6400c9870 0x7fa640161c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:47.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.076+0000 7fa647c00640 1 --2- 172.21.15.138:0/3137130742 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6240039c0 0x7fa6401521e0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:47.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.076+0000 7fa647c00640 1 -- 172.21.15.138:0/3137130742 >> 172.21.15.138:0/3137130742 conn(0x7fa6400d0b20 msgr2=0x7fa6400cdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:47.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.076+0000 7fa647c00640 1 -- 172.21.15.138:0/3137130742 shutdown_connections 2024-04-26T20:57:47.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.076+0000 7fa647c00640 1 -- 172.21.15.138:0/3137130742 wait complete. 2024-04-26T20:57:47.102 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-04-26T20:57:47.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.232+0000 7f113e400640 1 Processor -- start 2024-04-26T20:57:47.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.232+0000 7f113e400640 1 -- start start 2024-04-26T20:57:47.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.232+0000 7f113e400640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f11380cbe00 0x7f113806de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:47.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.232+0000 7f113e400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f11380cc1e0 0x7f1138073b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:47.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.232+0000 7f113e400640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11380727f0 con 0x7f11380ce6f0 2024-04-26T20:57:47.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.232+0000 7f113e400640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f1138073680 con 0x7f11380cc1e0 2024-04-26T20:57:47.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.232+0000 7f113e400640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f1138072a70 con 0x7f11380cbe00 2024-04-26T20:57:47.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.236+0000 7f1137e00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f11380ce6f0 0x7f11380ceb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:43024/0 (socket says 172.21.15.138:43024) 2024-04-26T20:57:47.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.236+0000 7f1137e00640 1 -- 172.21.15.138:0/2334235424 learned_addr learned my addr 172.21.15.138:0/2334235424 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:47.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.236+0000 7f1136a00640 1 --2- 172.21.15.138:0/2334235424 >> v2:172.21.15.138:3300/0 conn(0x7f11380cc1e0 0x7f1138073b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:47.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.236+0000 7f1137400640 1 --2- 172.21.15.138:0/2334235424 >> v2:172.21.15.143:3300/0 conn(0x7f11380cbe00 0x7f113806de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:47.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.236+0000 7f1136000640 1 -- 172.21.15.138:0/2334235424 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1841799371 0 0) 0x7f1130001120 con 0x7f11380ce6f0 2024-04-26T20:57:47.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.236+0000 7f1136000640 1 -- 172.21.15.138:0/2334235424 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f111c003530 con 0x7f11380ce6f0 2024-04-26T20:57:47.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.236+0000 7f1136a00640 1 -- 172.21.15.138:0/2334235424 >> v2:172.21.15.143:3300/0 conn(0x7f11380cbe00 msgr2=0x7f113806de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:47.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.236+0000 7f1136a00640 1 --2- 172.21.15.138:0/2334235424 >> v2:172.21.15.143:3300/0 conn(0x7f11380cbe00 0x7f113806de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:47.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.236+0000 7f1136a00640 1 -- 172.21.15.138:0/2334235424 >> v1:172.21.15.138:6789/0 conn(0x7f11380ce6f0 legacy=0x7f11380ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:47.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.236+0000 7f1136a00640 1 -- 172.21.15.138:0/2334235424 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1138072d50 con 0x7f11380cc1e0 2024-04-26T20:57:47.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.236+0000 7f1136a00640 1 --2- 172.21.15.138:0/2334235424 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11380cc1e0 0x7f1138073b10 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1138074a70 tx=0x7f112401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce0deb342f64fce1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:47.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.236+0000 7f1136000640 1 -- 172.21.15.138:0/2334235424 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11240b0070 con 0x7f11380cc1e0 2024-04-26T20:57:47.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.236+0000 7f1136000640 1 -- 172.21.15.138:0/2334235424 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11240ab600 con 0x7f11380cc1e0 2024-04-26T20:57:47.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.236+0000 7f1136000640 1 -- 172.21.15.138:0/2334235424 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11240ab9d0 con 0x7f11380cc1e0 2024-04-26T20:57:47.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.240+0000 7f113e400640 1 -- 172.21.15.138:0/2334235424 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11380cc1e0 msgr2=0x7f1138073b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:47.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.240+0000 7f113e400640 1 --2- 172.21.15.138:0/2334235424 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11380cc1e0 0x7f1138073b10 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1138074a70 tx=0x7f112401c480 comp rx=0 tx=0).stop 2024-04-26T20:57:47.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.240+0000 7f113e400640 1 -- 172.21.15.138:0/2334235424 shutdown_connections 2024-04-26T20:57:47.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.240+0000 7f113e400640 1 --2- 172.21.15.138:0/2334235424 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11380cc1e0 0x7f1138073b10 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:47.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.240+0000 7f113e400640 1 --2- 172.21.15.138:0/2334235424 >> v2:172.21.15.143:3300/0 conn(0x7f11380cbe00 0x7f113806de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:47.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.240+0000 7f113e400640 1 -- 172.21.15.138:0/2334235424 >> 172.21.15.138:0/2334235424 conn(0x7f11380d0b20 msgr2=0x7f11380d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:47.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.240+0000 7f113e400640 1 -- 172.21.15.138:0/2334235424 shutdown_connections 2024-04-26T20:57:47.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.240+0000 7f113e400640 1 -- 172.21.15.138:0/2334235424 wait complete. 2024-04-26T20:57:47.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.240+0000 7f113e400640 1 Processor -- start 2024-04-26T20:57:47.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.240+0000 7f113e400640 1 -- start start 2024-04-26T20:57:47.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.240+0000 7f113e400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f11380cbe00 0x7f11381522e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:47.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.240+0000 7f113e400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11380cc1e0 0x7f11381596b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:47.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.240+0000 7f113e400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11380ce6f0 0x7f11380af2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:47.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.240+0000 7f113e400640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f11380741d0 con 0x7f11380ce6f0 2024-04-26T20:57:47.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.240+0000 7f113e400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f1138074050 con 0x7f11380cc1e0 2024-04-26T20:57:47.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.240+0000 7f113e400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f11380d0780 con 0x7f11380cbe00 2024-04-26T20:57:47.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.240+0000 7f1137e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11380ce6f0 0x7f11380af2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:47.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.240+0000 7f1137e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11380ce6f0 0x7f11380af2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40954/0 (socket says 172.21.15.138:40954) 2024-04-26T20:57:47.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.240+0000 7f1137e00640 1 -- 172.21.15.138:0/208194392 learned_addr learned my addr 172.21.15.138:0/208194392 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:47.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.240+0000 7f1137400640 1 --2- 172.21.15.138:0/208194392 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f11380cbe00 0x7f11381522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:47.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.240+0000 7f1136a00640 1 --2- 172.21.15.138:0/208194392 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11380cc1e0 0x7f11381596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:47.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.244+0000 7f1137e00640 1 -- 172.21.15.138:0/208194392 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f11380cbe00 msgr2=0x7f11381522e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:47.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.244+0000 7f1137e00640 1 --2- 172.21.15.138:0/208194392 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f11380cbe00 0x7f11381522e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:47.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.244+0000 7f1137e00640 1 -- 172.21.15.138:0/208194392 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11380cc1e0 msgr2=0x7f11381596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:47.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.244+0000 7f1137e00640 1 --2- 172.21.15.138:0/208194392 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11380cc1e0 0x7f11381596b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:47.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.244+0000 7f1137e00640 1 -- 172.21.15.138:0/208194392 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11380c8870 con 0x7f11380ce6f0 2024-04-26T20:57:47.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.244+0000 7f1137400640 1 --2- 172.21.15.138:0/208194392 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f11380cbe00 0x7f11381522e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:47.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.244+0000 7f1137e00640 1 --2- 172.21.15.138:0/208194392 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11380ce6f0 0x7f11380af2d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f113000c3c0 tx=0x7f113000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:47.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.244+0000 7f112f400640 1 -- 172.21.15.138:0/208194392 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1130017070 con 0x7f11380ce6f0 2024-04-26T20:57:47.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.244+0000 7f112f400640 1 -- 172.21.15.138:0/208194392 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1130005cf0 con 0x7f11380ce6f0 2024-04-26T20:57:47.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.244+0000 7f113e400640 1 -- 172.21.15.138:0/208194392 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11380c8b50 con 0x7f11380ce6f0 2024-04-26T20:57:47.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.244+0000 7f112f400640 1 -- 172.21.15.138:0/208194392 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11300072f0 con 0x7f11380ce6f0 2024-04-26T20:57:47.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.244+0000 7f113e400640 1 -- 172.21.15.138:0/208194392 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11380aedb0 con 0x7f11380ce6f0 2024-04-26T20:57:47.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.244+0000 7f113e400640 1 -- 172.21.15.138:0/208194392 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11380ae8c0 con 0x7f11380ce6f0 2024-04-26T20:57:47.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.244+0000 7f112f400640 1 -- 172.21.15.138:0/208194392 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f113001a070 con 0x7f11380ce6f0 2024-04-26T20:57:47.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.244+0000 7f112f400640 1 --2- 172.21.15.138:0/208194392 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f11180683b0 0x7f111806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:47.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.244+0000 7f112f400640 1 -- 172.21.15.138:0/208194392 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f1130085b40 con 0x7f11380ce6f0 2024-04-26T20:57:47.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.244+0000 7f1137400640 1 --2- 172.21.15.138:0/208194392 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f11180683b0 0x7f111806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:47.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.248+0000 7f1137400640 1 --2- 172.21.15.138:0/208194392 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f11180683b0 0x7f111806a870 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f11380b0620 tx=0x7f112800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:47.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.252+0000 7f112f400640 1 -- 172.21.15.138:0/208194392 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f11380727f0 con 0x7f11380ce6f0 2024-04-26T20:57:47.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.460+0000 7f113e400640 1 -- 172.21.15.138:0/208194392 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f11380694f0 con 0x7f11380ce6f0 2024-04-26T20:57:47.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.464+0000 7f112f400640 1 -- 172.21.15.138:0/208194392 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f11300562c0 con 0x7f11380ce6f0 2024-04-26T20:57:47.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.464+0000 7f113e400640 1 -- 172.21.15.138:0/208194392 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f11180683b0 msgr2=0x7f111806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:47.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.464+0000 7f113e400640 1 --2- 172.21.15.138:0/208194392 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f11180683b0 0x7f111806a870 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f11380b0620 tx=0x7f112800b040 comp rx=0 tx=0).stop 2024-04-26T20:57:47.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.464+0000 7f113e400640 1 -- 172.21.15.138:0/208194392 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11380ce6f0 msgr2=0x7f11380af2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:47.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.464+0000 7f113e400640 1 --2- 172.21.15.138:0/208194392 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11380ce6f0 0x7f11380af2d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f113000c3c0 tx=0x7f113000c880 comp rx=0 tx=0).stop 2024-04-26T20:57:47.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.464+0000 7f113e400640 1 -- 172.21.15.138:0/208194392 shutdown_connections 2024-04-26T20:57:47.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.464+0000 7f113e400640 1 --2- 172.21.15.138:0/208194392 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f11180683b0 0x7f111806a870 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:47.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.464+0000 7f113e400640 1 --2- 172.21.15.138:0/208194392 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11380ce6f0 0x7f11380af2d0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:47.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.464+0000 7f113e400640 1 --2- 172.21.15.138:0/208194392 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11380cc1e0 0x7f11381596b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:47.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.464+0000 7f113e400640 1 --2- 172.21.15.138:0/208194392 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f11380cbe00 0x7f11381522e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:47.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.464+0000 7f113e400640 1 -- 172.21.15.138:0/208194392 >> 172.21.15.138:0/208194392 conn(0x7f11380d0b20 msgr2=0x7f11381535b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:47.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.464+0000 7f113e400640 1 -- 172.21.15.138:0/208194392 shutdown_connections 2024-04-26T20:57:47.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.464+0000 7f113e400640 1 -- 172.21.15.138:0/208194392 wait complete. 2024-04-26T20:57:47.490 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-04-26T20:57:47.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.624+0000 7ffa98000640 1 Processor -- start 2024-04-26T20:57:47.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.624+0000 7ffa98000640 1 -- start start 2024-04-26T20:57:47.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.624+0000 7ffa98000640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ffa900cbe00 0x7ffa9006de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:47.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.624+0000 7ffa98000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffa9015cf80 0x7ffa900ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:47.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.624+0000 7ffa98000640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa900727f0 con 0x7ffa900cc1e0 2024-04-26T20:57:47.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.624+0000 7ffa98000640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7ffa90074220 con 0x7ffa900cbe00 2024-04-26T20:57:47.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.624+0000 7ffa98000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ffa90073680 con 0x7ffa9015cf80 2024-04-26T20:57:47.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.624+0000 7ffa94c00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7ffa900cc1e0 0x7ffa90073b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:43036/0 (socket says 172.21.15.138:43036) 2024-04-26T20:57:47.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.624+0000 7ffa94c00640 1 -- 172.21.15.138:0/2756801436 learned_addr learned my addr 172.21.15.138:0/2756801436 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:47.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.624+0000 7ffa96000640 1 --2- 172.21.15.138:0/2756801436 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffa9015cf80 0x7ffa900ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:47.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.624+0000 7ffa95600640 1 --2- 172.21.15.138:0/2756801436 >> v2:172.21.15.143:3300/0 conn(0x7ffa900cbe00 0x7ffa9006de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:47.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.624+0000 7ffa8fe00640 1 -- 172.21.15.138:0/2756801436 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1968142506 0 0) 0x7ffa7c001120 con 0x7ffa900cc1e0 2024-04-26T20:57:47.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.624+0000 7ffa8fe00640 1 -- 172.21.15.138:0/2756801436 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa78003530 con 0x7ffa900cc1e0 2024-04-26T20:57:47.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.624+0000 7ffa8fe00640 1 -- 172.21.15.138:0/2756801436 <== mon.0 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 79537963 0 0) 0x7ffa78003530 con 0x7ffa900cc1e0 2024-04-26T20:57:47.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.624+0000 7ffa8fe00640 1 -- 172.21.15.138:0/2756801436 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffa9015cf80 msgr2=0x7ffa900ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:47.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.624+0000 7ffa8fe00640 1 --2- 172.21.15.138:0/2756801436 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffa9015cf80 0x7ffa900ce6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:47.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.624+0000 7ffa8fe00640 1 -- 172.21.15.138:0/2756801436 >> v2:172.21.15.143:3300/0 conn(0x7ffa900cbe00 msgr2=0x7ffa9006de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:47.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.624+0000 7ffa8fe00640 1 --2- 172.21.15.138:0/2756801436 >> v2:172.21.15.143:3300/0 conn(0x7ffa900cbe00 0x7ffa9006de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:47.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.624+0000 7ffa8fe00640 1 -- 172.21.15.138:0/2756801436 --> v1:172.21.15.138:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa90072a70 con 0x7ffa900cc1e0 2024-04-26T20:57:47.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.624+0000 7ffa8fe00640 1 -- 172.21.15.138:0/2756801436 <== mon.0 v1:172.21.15.138:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2715389689 0 0) 0x7ffa7c001850 con 0x7ffa900cc1e0 2024-04-26T20:57:47.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.624+0000 7ffa8fe00640 1 -- 172.21.15.138:0/2756801436 >> v1:172.21.15.138:6789/0 conn(0x7ffa900cc1e0 legacy=0x7ffa90073b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:47.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.624+0000 7ffa8fe00640 1 --2- 172.21.15.138:0/2756801436 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa780039c0 0x7ffa78003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:47.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.624+0000 7ffa8fe00640 1 --2- 172.21.15.138:0/2756801436 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa78004810 0x7ffa78004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:47.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.624+0000 7ffa8fe00640 1 --2- 172.21.15.138:0/2756801436 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffa9015cf80 0x7ffa780051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:47.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.624+0000 7ffa8fe00640 1 -- 172.21.15.138:0/2756801436 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ffa90074220 con 0x7ffa78004810 2024-04-26T20:57:47.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.624+0000 7ffa8fe00640 1 -- 172.21.15.138:0/2756801436 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ffa90073680 con 0x7ffa780039c0 2024-04-26T20:57:47.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.624+0000 7ffa8fe00640 1 -- 172.21.15.138:0/2756801436 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ffa7800b9d0 con 0x7ffa9015cf80 2024-04-26T20:57:47.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.624+0000 7ffa94c00640 1 --2- 172.21.15.138:0/2756801436 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa78004810 0x7ffa78004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:47.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.624+0000 7ffa95600640 1 --2- 172.21.15.138:0/2756801436 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa780039c0 0x7ffa78003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:47.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.624+0000 7ffa96000640 1 --2- 172.21.15.138:0/2756801436 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffa9015cf80 0x7ffa780051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:47.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.624+0000 7ffa94c00640 1 -- 172.21.15.138:0/2756801436 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffa9015cf80 msgr2=0x7ffa780051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:47.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.624+0000 7ffa94c00640 1 --2- 172.21.15.138:0/2756801436 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffa9015cf80 0x7ffa780051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:47.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.624+0000 7ffa94c00640 1 -- 172.21.15.138:0/2756801436 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa780039c0 msgr2=0x7ffa78003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:47.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.624+0000 7ffa94c00640 1 --2- 172.21.15.138:0/2756801436 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa780039c0 0x7ffa78003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:47.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.624+0000 7ffa94c00640 1 -- 172.21.15.138:0/2756801436 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa78003530 con 0x7ffa78004810 2024-04-26T20:57:47.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.628+0000 7ffa94c00640 1 --2- 172.21.15.138:0/2756801436 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa78004810 0x7ffa78004c90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c00c4c0 tx=0x7ffa7c01f440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c141d4868cceee9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:47.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.628+0000 7ffa8fe00640 1 -- 172.21.15.138:0/2756801436 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c00c0e0 con 0x7ffa78004810 2024-04-26T20:57:47.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.628+0000 7ffa8fe00640 1 -- 172.21.15.138:0/2756801436 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa7c005b00 con 0x7ffa78004810 2024-04-26T20:57:47.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.628+0000 7ffa8fe00640 1 -- 172.21.15.138:0/2756801436 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c007070 con 0x7ffa78004810 2024-04-26T20:57:47.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.628+0000 7ffa98000640 1 -- 172.21.15.138:0/2756801436 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa78004810 msgr2=0x7ffa78004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:47.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.628+0000 7ffa98000640 1 --2- 172.21.15.138:0/2756801436 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa78004810 0x7ffa78004c90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c00c4c0 tx=0x7ffa7c01f440 comp rx=0 tx=0).stop 2024-04-26T20:57:47.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.628+0000 7ffa96000640 1 -- 172.21.15.138:0/2756801436 reap_dead start 2024-04-26T20:57:47.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.628+0000 7ffa98000640 1 -- 172.21.15.138:0/2756801436 shutdown_connections 2024-04-26T20:57:47.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.628+0000 7ffa98000640 1 -- 172.21.15.138:0/2756801436 >> 172.21.15.138:0/2756801436 conn(0x7ffa900d0b20 msgr2=0x7ffa900d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:47.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.628+0000 7ffa98000640 1 -- 172.21.15.138:0/2756801436 shutdown_connections 2024-04-26T20:57:47.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.628+0000 7ffa98000640 1 -- 172.21.15.138:0/2756801436 wait complete. 2024-04-26T20:57:47.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.632+0000 7ffa98000640 1 Processor -- start 2024-04-26T20:57:47.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.632+0000 7ffa98000640 1 -- start start 2024-04-26T20:57:47.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.632+0000 7ffa98000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffa78004810 0x7ffa900c7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:47.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.632+0000 7ffa98000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa900c9320 0x7ffa900b4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:47.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.632+0000 7ffa98000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa90158330 0x7ffa900b5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:47.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.632+0000 7ffa98000640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ffa90073310 con 0x7ffa900c9320 2024-04-26T20:57:47.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.632+0000 7ffa98000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ffa90073030 con 0x7ffa90158330 2024-04-26T20:57:47.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.632+0000 7ffa98000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ffa9006e3b0 con 0x7ffa78004810 2024-04-26T20:57:47.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.632+0000 7ffa94c00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa900c9320 0x7ffa900b4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:47.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.632+0000 7ffa94c00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa900c9320 0x7ffa900b4b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40974/0 (socket says 172.21.15.138:40974) 2024-04-26T20:57:47.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.632+0000 7ffa94c00640 1 -- 172.21.15.138:0/2120152670 learned_addr learned my addr 172.21.15.138:0/2120152670 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:47.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.632+0000 7ffa95600640 1 --2- 172.21.15.138:0/2120152670 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffa78004810 0x7ffa900c7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:47.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.632+0000 7ffa96000640 1 --2- 172.21.15.138:0/2120152670 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa90158330 0x7ffa900b5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:47.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.632+0000 7ffa94c00640 1 -- 172.21.15.138:0/2120152670 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffa78004810 msgr2=0x7ffa900c7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:47.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.632+0000 7ffa94c00640 1 --2- 172.21.15.138:0/2120152670 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffa78004810 0x7ffa900c7bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:47.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.632+0000 7ffa94c00640 1 -- 172.21.15.138:0/2120152670 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa90158330 msgr2=0x7ffa900b5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:47.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.632+0000 7ffa94c00640 1 --2- 172.21.15.138:0/2120152670 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa90158330 0x7ffa900b5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:47.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.632+0000 7ffa94c00640 1 -- 172.21.15.138:0/2120152670 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa900b50c0 con 0x7ffa900c9320 2024-04-26T20:57:47.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.632+0000 7ffa94c00640 1 --2- 172.21.15.138:0/2120152670 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa900c9320 0x7ffa900b4b80 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c09ba90 tx=0x7ffa78005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:47.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.632+0000 7ffa8d600640 1 -- 172.21.15.138:0/2120152670 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c005cb0 con 0x7ffa900c9320 2024-04-26T20:57:47.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.632+0000 7ffa8d600640 1 -- 172.21.15.138:0/2120152670 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa7c005e50 con 0x7ffa900c9320 2024-04-26T20:57:47.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.632+0000 7ffa8d600640 1 -- 172.21.15.138:0/2120152670 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c001830 con 0x7ffa900c9320 2024-04-26T20:57:47.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.632+0000 7ffa98000640 1 -- 172.21.15.138:0/2120152670 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa900c8280 con 0x7ffa900c9320 2024-04-26T20:57:47.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.632+0000 7ffa98000640 1 -- 172.21.15.138:0/2120152670 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa900c8840 con 0x7ffa900c9320 2024-04-26T20:57:47.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.636+0000 7ffa98000640 1 -- 172.21.15.138:0/2120152670 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa90069510 con 0x7ffa900c9320 2024-04-26T20:57:47.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.636+0000 7ffa8d600640 1 -- 172.21.15.138:0/2120152670 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ffa7c0ba030 con 0x7ffa900c9320 2024-04-26T20:57:47.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.636+0000 7ffa8d600640 1 --2- 172.21.15.138:0/2120152670 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ffa70068380 0x7ffa7006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:47.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.636+0000 7ffa8d600640 1 -- 172.21.15.138:0/2120152670 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7ffa7c122f30 con 0x7ffa900c9320 2024-04-26T20:57:47.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.636+0000 7ffa95600640 1 --2- 172.21.15.138:0/2120152670 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ffa70068380 0x7ffa7006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:47.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.636+0000 7ffa95600640 1 --2- 172.21.15.138:0/2120152670 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ffa70068380 0x7ffa7006a840 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ffa84009a60 tx=0x7ffa84008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:47.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.640+0000 7ffa8d600640 1 -- 172.21.15.138:0/2120152670 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ffa7c0c1020 con 0x7ffa900c9320 2024-04-26T20:57:47.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.856+0000 7ffa98000640 1 -- 172.21.15.138:0/2120152670 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7ffa90159e10 con 0x7ffa900c9320 2024-04-26T20:57:47.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.860+0000 7ffa8d600640 1 -- 172.21.15.138:0/2120152670 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) ==== 97+0+0 (secure 0 0 0) 0x7ffa900727f0 con 0x7ffa900c9320 2024-04-26T20:57:47.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.860+0000 7ffa98000640 1 -- 172.21.15.138:0/2120152670 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ffa70068380 msgr2=0x7ffa7006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:47.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.860+0000 7ffa98000640 1 --2- 172.21.15.138:0/2120152670 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ffa70068380 0x7ffa7006a840 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ffa84009a60 tx=0x7ffa84008040 comp rx=0 tx=0).stop 2024-04-26T20:57:47.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.860+0000 7ffa98000640 1 -- 172.21.15.138:0/2120152670 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa900c9320 msgr2=0x7ffa900b4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:47.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.860+0000 7ffa98000640 1 --2- 172.21.15.138:0/2120152670 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa900c9320 0x7ffa900b4b80 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c09ba90 tx=0x7ffa78005840 comp rx=0 tx=0).stop 2024-04-26T20:57:47.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.860+0000 7ffa98000640 1 -- 172.21.15.138:0/2120152670 shutdown_connections 2024-04-26T20:57:47.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.860+0000 7ffa98000640 1 --2- 172.21.15.138:0/2120152670 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ffa70068380 0x7ffa7006a840 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:47.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.860+0000 7ffa98000640 1 --2- 172.21.15.138:0/2120152670 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa90158330 0x7ffa900b5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:47.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.860+0000 7ffa98000640 1 --2- 172.21.15.138:0/2120152670 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa900c9320 0x7ffa900b4b80 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:47.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.860+0000 7ffa98000640 1 --2- 172.21.15.138:0/2120152670 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffa78004810 0x7ffa900c7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:47.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.860+0000 7ffa98000640 1 -- 172.21.15.138:0/2120152670 >> 172.21.15.138:0/2120152670 conn(0x7ffa900d0b20 msgr2=0x7ffa900b1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:47.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.860+0000 7ffa98000640 1 -- 172.21.15.138:0/2120152670 shutdown_connections 2024-04-26T20:57:47.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:47.860+0000 7ffa98000640 1 -- 172.21.15.138:0/2120152670 wait complete. 2024-04-26T20:57:47.886 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-04-26T20:57:48.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.016+0000 7fcd8d200640 1 Processor -- start 2024-04-26T20:57:48.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.016+0000 7fcd8d200640 1 -- start start 2024-04-26T20:57:48.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.016+0000 7fcd8d200640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fcd880cc1e0 0x7fcd880ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:48.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.016+0000 7fcd8d200640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd880727f0 con 0x7fcd8815cf80 2024-04-26T20:57:48.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.016+0000 7fcd8d200640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd88072a70 con 0x7fcd880cbe00 2024-04-26T20:57:48.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.016+0000 7fcd8d200640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fcd88074220 con 0x7fcd880cc1e0 2024-04-26T20:57:48.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.016+0000 7fcd7d400640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fcd8815cf80 0x7fcd88073b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:43044/0 (socket says 172.21.15.138:43044) 2024-04-26T20:57:48.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.016+0000 7fcd7d400640 1 -- 172.21.15.138:0/2160213604 learned_addr learned my addr 172.21.15.138:0/2160213604 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:48.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.016+0000 7fcd86800640 1 --2- 172.21.15.138:0/2160213604 >> v2:172.21.15.143:3300/0 conn(0x7fcd880cc1e0 0x7fcd880ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:48.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.016+0000 7fcd85400640 1 -- 172.21.15.138:0/2160213604 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4179000158 0 0) 0x7fcd70001120 con 0x7fcd8815cf80 2024-04-26T20:57:48.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.016+0000 7fcd85400640 1 -- 172.21.15.138:0/2160213604 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd6c005740 con 0x7fcd8815cf80 2024-04-26T20:57:48.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.016+0000 7fcd85400640 1 -- 172.21.15.138:0/2160213604 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3879195175 0 0) 0x7fcd88072a70 con 0x7fcd880cbe00 2024-04-26T20:57:48.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.016+0000 7fcd85400640 1 -- 172.21.15.138:0/2160213604 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd70001120 con 0x7fcd880cbe00 2024-04-26T20:57:48.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.020+0000 7fcd85400640 1 -- 172.21.15.138:0/2160213604 <== mon.0 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2576166383 0 0) 0x7fcd6c005740 con 0x7fcd8815cf80 2024-04-26T20:57:48.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.020+0000 7fcd85400640 1 -- 172.21.15.138:0/2160213604 >> v2:172.21.15.143:3300/0 conn(0x7fcd880cc1e0 msgr2=0x7fcd880ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:48.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.020+0000 7fcd85400640 1 --2- 172.21.15.138:0/2160213604 >> v2:172.21.15.143:3300/0 conn(0x7fcd880cc1e0 0x7fcd880ce6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:48.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.020+0000 7fcd85400640 1 -- 172.21.15.138:0/2160213604 >> v1:172.21.15.143:6789/0 conn(0x7fcd880cbe00 legacy=0x7fcd8806de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:48.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.020+0000 7fcd85400640 1 -- 172.21.15.138:0/2160213604 --> v1:172.21.15.138:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd88072d50 con 0x7fcd8815cf80 2024-04-26T20:57:48.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.020+0000 7fcd85400640 1 -- 172.21.15.138:0/2160213604 <== mon.0 v1:172.21.15.138:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2715389689 0 0) 0x7fcd70001850 con 0x7fcd8815cf80 2024-04-26T20:57:48.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.020+0000 7fcd85400640 1 -- 172.21.15.138:0/2160213604 >> v1:172.21.15.138:6789/0 conn(0x7fcd8815cf80 legacy=0x7fcd88073b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:48.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.020+0000 7fcd85400640 1 --2- 172.21.15.138:0/2160213604 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd6c005d60 0x7fcd6c006160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:48.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.020+0000 7fcd85400640 1 --2- 172.21.15.138:0/2160213604 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcd6c006a20 0x7fcd6c006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:48.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.020+0000 7fcd85400640 1 --2- 172.21.15.138:0/2160213604 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcd6c0073e0 0x7fcd6c00dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:48.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.020+0000 7fcd85400640 1 -- 172.21.15.138:0/2160213604 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fcd88074220 con 0x7fcd6c005d60 2024-04-26T20:57:48.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.020+0000 7fcd85400640 1 -- 172.21.15.138:0/2160213604 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fcd6c00e260 con 0x7fcd6c0073e0 2024-04-26T20:57:48.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.020+0000 7fcd85400640 1 -- 172.21.15.138:0/2160213604 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fcd6c00e460 con 0x7fcd6c006a20 2024-04-26T20:57:48.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.020+0000 7fcd85e00640 1 --2- 172.21.15.138:0/2160213604 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd6c005d60 0x7fcd6c006160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:48.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.020+0000 7fcd7d400640 1 --2- 172.21.15.138:0/2160213604 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcd6c006a20 0x7fcd6c006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:48.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.020+0000 7fcd86800640 1 --2- 172.21.15.138:0/2160213604 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcd6c0073e0 0x7fcd6c00dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:48.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.020+0000 7fcd85e00640 1 -- 172.21.15.138:0/2160213604 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcd6c006a20 msgr2=0x7fcd6c006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:48.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.020+0000 7fcd85e00640 1 --2- 172.21.15.138:0/2160213604 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcd6c006a20 0x7fcd6c006ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:48.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.020+0000 7fcd85e00640 1 -- 172.21.15.138:0/2160213604 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcd6c0073e0 msgr2=0x7fcd6c00dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:48.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.020+0000 7fcd85e00640 1 --2- 172.21.15.138:0/2160213604 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcd6c0073e0 0x7fcd6c00dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:48.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.020+0000 7fcd85e00640 1 -- 172.21.15.138:0/2160213604 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd6c005740 con 0x7fcd6c005d60 2024-04-26T20:57:48.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.020+0000 7fcd86800640 1 -- 172.21.15.138:0/2160213604 reap_dead start 2024-04-26T20:57:48.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.020+0000 7fcd85e00640 1 --2- 172.21.15.138:0/2160213604 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd6c005d60 0x7fcd6c006160 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fcd780018d0 tx=0x7fcd7801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf43661066b9575c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:48.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.020+0000 7fcd85400640 1 -- 172.21.15.138:0/2160213604 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd78001520 con 0x7fcd6c005d60 2024-04-26T20:57:48.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.024+0000 7fcd85400640 1 -- 172.21.15.138:0/2160213604 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd780052f0 con 0x7fcd6c005d60 2024-04-26T20:57:48.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.024+0000 7fcd85400640 1 -- 172.21.15.138:0/2160213604 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd78003840 con 0x7fcd6c005d60 2024-04-26T20:57:48.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.024+0000 7fcd8d200640 1 -- 172.21.15.138:0/2160213604 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd6c005d60 msgr2=0x7fcd6c006160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:48.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.024+0000 7fcd8d200640 1 --2- 172.21.15.138:0/2160213604 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd6c005d60 0x7fcd6c006160 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fcd780018d0 tx=0x7fcd7801c520 comp rx=0 tx=0).stop 2024-04-26T20:57:48.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.024+0000 7fcd8d200640 1 -- 172.21.15.138:0/2160213604 shutdown_connections 2024-04-26T20:57:48.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.024+0000 7fcd8d200640 1 --2- 172.21.15.138:0/2160213604 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd6c005d60 0x7fcd6c006160 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:48.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.024+0000 7fcd8d200640 1 -- 172.21.15.138:0/2160213604 >> 172.21.15.138:0/2160213604 conn(0x7fcd880d0b20 msgr2=0x7fcd880d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:48.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.024+0000 7fcd8d200640 1 -- 172.21.15.138:0/2160213604 shutdown_connections 2024-04-26T20:57:48.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.024+0000 7fcd8d200640 1 -- 172.21.15.138:0/2160213604 wait complete. 2024-04-26T20:57:48.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.024+0000 7fcd8d200640 1 Processor -- start 2024-04-26T20:57:48.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.024+0000 7fcd8d200640 1 -- start start 2024-04-26T20:57:48.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.024+0000 7fcd8d200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcd6c005d60 0x7fcd8815e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:48.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.024+0000 7fcd8d200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd88160300 0x7fcd881e94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:48.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.024+0000 7fcd8d200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcd88154d80 0x7fcd88155200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:48.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.024+0000 7fcd8d200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fcd880d0900 con 0x7fcd88160300 2024-04-26T20:57:48.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.024+0000 7fcd8d200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fcd880d0780 con 0x7fcd6c005d60 2024-04-26T20:57:48.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.024+0000 7fcd8d200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fcd880ce6f0 con 0x7fcd88154d80 2024-04-26T20:57:48.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.024+0000 7fcd7d400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd88160300 0x7fcd881e94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:48.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.024+0000 7fcd7d400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd88160300 0x7fcd881e94b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40988/0 (socket says 172.21.15.138:40988) 2024-04-26T20:57:48.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.024+0000 7fcd7d400640 1 -- 172.21.15.138:0/3756600185 learned_addr learned my addr 172.21.15.138:0/3756600185 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:48.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.024+0000 7fcd86800640 1 --2- 172.21.15.138:0/3756600185 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcd88154d80 0x7fcd88155200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:48.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.024+0000 7fcd85e00640 1 --2- 172.21.15.138:0/3756600185 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcd6c005d60 0x7fcd8815e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:48.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.028+0000 7fcd7d400640 1 -- 172.21.15.138:0/3756600185 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcd88154d80 msgr2=0x7fcd88155200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:48.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.028+0000 7fcd7d400640 1 --2- 172.21.15.138:0/3756600185 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcd88154d80 0x7fcd88155200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:48.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.028+0000 7fcd7d400640 1 -- 172.21.15.138:0/3756600185 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcd6c005d60 msgr2=0x7fcd8815e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:48.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.028+0000 7fcd7d400640 1 --2- 172.21.15.138:0/3756600185 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcd6c005d60 0x7fcd8815e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:48.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.028+0000 7fcd7d400640 1 -- 172.21.15.138:0/3756600185 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd88155740 con 0x7fcd88160300 2024-04-26T20:57:48.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.028+0000 7fcd7d400640 1 --2- 172.21.15.138:0/3756600185 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd88160300 0x7fcd881e94b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fcd700019c0 tx=0x7fcd70007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:48.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.028+0000 7fcd7ea00640 1 -- 172.21.15.138:0/3756600185 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd7000f960 con 0x7fcd88160300 2024-04-26T20:57:48.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.028+0000 7fcd7ea00640 1 -- 172.21.15.138:0/3756600185 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd70018070 con 0x7fcd88160300 2024-04-26T20:57:48.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.028+0000 7fcd8d200640 1 -- 172.21.15.138:0/3756600185 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd8815ead0 con 0x7fcd88160300 2024-04-26T20:57:48.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.028+0000 7fcd7ea00640 1 -- 172.21.15.138:0/3756600185 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd7000fd00 con 0x7fcd88160300 2024-04-26T20:57:48.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.028+0000 7fcd8d200640 1 -- 172.21.15.138:0/3756600185 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd8815f090 con 0x7fcd88160300 2024-04-26T20:57:48.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.028+0000 7fcd8d200640 1 -- 172.21.15.138:0/3756600185 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd88069510 con 0x7fcd88160300 2024-04-26T20:57:48.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.028+0000 7fcd7ea00640 1 -- 172.21.15.138:0/3756600185 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcd7001d460 con 0x7fcd88160300 2024-04-26T20:57:48.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.028+0000 7fcd7ea00640 1 --2- 172.21.15.138:0/3756600185 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fcd640683b0 0x7fcd6406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:48.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.028+0000 7fcd7ea00640 1 -- 172.21.15.138:0/3756600185 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7fcd70086a20 con 0x7fcd88160300 2024-04-26T20:57:48.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.028+0000 7fcd85e00640 1 --2- 172.21.15.138:0/3756600185 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fcd640683b0 0x7fcd6406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:48.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.032+0000 7fcd85e00640 1 --2- 172.21.15.138:0/3756600185 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fcd640683b0 0x7fcd6406a870 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fcd780ac000 tx=0x7fcd78009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:48.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.032+0000 7fcd7ea00640 1 -- 172.21.15.138:0/3756600185 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fcd88155740 con 0x7fcd88160300 2024-04-26T20:57:48.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.244+0000 7fcd8d200640 1 -- 172.21.15.138:0/3756600185 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7fcd8806f110 con 0x7fcd88160300 2024-04-26T20:57:48.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.248+0000 7fcd7ea00640 1 -- 172.21.15.138:0/3756600185 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) ==== 90+0+0 (secure 0 0 0) 0x7fcd880727f0 con 0x7fcd88160300 2024-04-26T20:57:48.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.248+0000 7fcd8d200640 1 -- 172.21.15.138:0/3756600185 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fcd640683b0 msgr2=0x7fcd6406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:48.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.248+0000 7fcd8d200640 1 --2- 172.21.15.138:0/3756600185 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fcd640683b0 0x7fcd6406a870 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fcd780ac000 tx=0x7fcd78009040 comp rx=0 tx=0).stop 2024-04-26T20:57:48.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.248+0000 7fcd8d200640 1 -- 172.21.15.138:0/3756600185 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd88160300 msgr2=0x7fcd881e94b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:48.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.248+0000 7fcd8d200640 1 --2- 172.21.15.138:0/3756600185 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd88160300 0x7fcd881e94b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fcd700019c0 tx=0x7fcd70007720 comp rx=0 tx=0).stop 2024-04-26T20:57:48.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.248+0000 7fcd8d200640 1 -- 172.21.15.138:0/3756600185 shutdown_connections 2024-04-26T20:57:48.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.248+0000 7fcd8d200640 1 --2- 172.21.15.138:0/3756600185 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fcd640683b0 0x7fcd6406a870 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:48.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.248+0000 7fcd8d200640 1 --2- 172.21.15.138:0/3756600185 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcd88154d80 0x7fcd88155200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:48.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.248+0000 7fcd8d200640 1 --2- 172.21.15.138:0/3756600185 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd88160300 0x7fcd881e94b0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:48.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.248+0000 7fcd8d200640 1 --2- 172.21.15.138:0/3756600185 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcd6c005d60 0x7fcd8815e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:48.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.248+0000 7fcd8d200640 1 -- 172.21.15.138:0/3756600185 >> 172.21.15.138:0/3756600185 conn(0x7fcd880d0b20 msgr2=0x7fcd88159410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:48.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.248+0000 7fcd8d200640 1 -- 172.21.15.138:0/3756600185 shutdown_connections 2024-04-26T20:57:48.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.248+0000 7fcd8d200640 1 -- 172.21.15.138:0/3756600185 wait complete. 2024-04-26T20:57:48.273 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:57:48.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.400+0000 7f1442800640 1 Processor -- start 2024-04-26T20:57:48.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.404+0000 7f1442800640 1 -- start start 2024-04-26T20:57:48.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.404+0000 7f1442800640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f143c0b0ee0 0x7f143c15fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:48.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.404+0000 7f1442800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f143c0ae940 0x7f143c0aedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:48.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.404+0000 7f1442800640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f143c0d18d0 con 0x7f143c070ca0 2024-04-26T20:57:48.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.404+0000 7f1442800640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f143c06c3a0 con 0x7f143c0b0ee0 2024-04-26T20:57:48.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.404+0000 7f1442800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f143c06c680 con 0x7f143c0ae940 2024-04-26T20:57:48.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.404+0000 7f1441400640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f143c070ca0 0x7f143c071080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:43054/0 (socket says 172.21.15.138:43054) 2024-04-26T20:57:48.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.404+0000 7f1441400640 1 -- 172.21.15.138:0/2588297282 learned_addr learned my addr 172.21.15.138:0/2588297282 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:48.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.404+0000 7f143be00640 1 -- 172.21.15.138:0/2588297282 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3553613522 0 0) 0x7f143c0d18d0 con 0x7f143c070ca0 2024-04-26T20:57:48.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.404+0000 7f143be00640 1 -- 172.21.15.138:0/2588297282 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1424003530 con 0x7f143c070ca0 2024-04-26T20:57:48.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.404+0000 7f1441e00640 1 --2- 172.21.15.138:0/2588297282 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f143c0ae940 0x7f143c0aedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:48.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.404+0000 7f1440a00640 1 --2- 172.21.15.138:0/2588297282 >> v2:172.21.15.143:3300/0 conn(0x7f143c0b0ee0 0x7f143c15fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:48.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.404+0000 7f143be00640 1 -- 172.21.15.138:0/2588297282 <== mon.0 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2426856445 0 0) 0x7f1424003530 con 0x7f143c070ca0 2024-04-26T20:57:48.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.404+0000 7f143be00640 1 -- 172.21.15.138:0/2588297282 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f143c0ae940 msgr2=0x7f143c0aedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:48.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.404+0000 7f143be00640 1 --2- 172.21.15.138:0/2588297282 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f143c0ae940 0x7f143c0aedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:48.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.404+0000 7f143be00640 1 -- 172.21.15.138:0/2588297282 >> v2:172.21.15.143:3300/0 conn(0x7f143c0b0ee0 msgr2=0x7f143c15fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:48.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.404+0000 7f143be00640 1 --2- 172.21.15.138:0/2588297282 >> v2:172.21.15.143:3300/0 conn(0x7f143c0b0ee0 0x7f143c15fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:48.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.404+0000 7f143be00640 1 -- 172.21.15.138:0/2588297282 --> v1:172.21.15.138:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f143c06c960 con 0x7f143c070ca0 2024-04-26T20:57:48.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.404+0000 7f143be00640 1 -- 172.21.15.138:0/2588297282 <== mon.0 v1:172.21.15.138:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2715389689 0 0) 0x7f1430001680 con 0x7f143c070ca0 2024-04-26T20:57:48.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.404+0000 7f143be00640 1 -- 172.21.15.138:0/2588297282 >> v1:172.21.15.138:6789/0 conn(0x7f143c070ca0 legacy=0x7f143c071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:48.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.404+0000 7f143be00640 1 --2- 172.21.15.138:0/2588297282 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14240039c0 0x7f1424003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:48.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.404+0000 7f143be00640 1 --2- 172.21.15.138:0/2588297282 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f143c0ae940 0x7f1424004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:48.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.404+0000 7f143be00640 1 --2- 172.21.15.138:0/2588297282 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1424004d50 0x7f14240051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:48.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.404+0000 7f143be00640 1 -- 172.21.15.138:0/2588297282 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f143c06c3a0 con 0x7f14240039c0 2024-04-26T20:57:48.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.404+0000 7f143be00640 1 -- 172.21.15.138:0/2588297282 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f143c06c680 con 0x7f1424004d50 2024-04-26T20:57:48.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.404+0000 7f143be00640 1 -- 172.21.15.138:0/2588297282 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f142400b9d0 con 0x7f143c0ae940 2024-04-26T20:57:48.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.404+0000 7f1441400640 1 --2- 172.21.15.138:0/2588297282 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14240039c0 0x7f1424003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:48.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.404+0000 7f1440a00640 1 --2- 172.21.15.138:0/2588297282 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f143c0ae940 0x7f1424004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:48.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.404+0000 7f1441e00640 1 --2- 172.21.15.138:0/2588297282 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1424004d50 0x7f14240051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:48.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.404+0000 7f1441400640 1 -- 172.21.15.138:0/2588297282 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f143c0ae940 msgr2=0x7f1424004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:48.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.404+0000 7f1441400640 1 --2- 172.21.15.138:0/2588297282 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f143c0ae940 0x7f1424004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:48.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.404+0000 7f1441400640 1 -- 172.21.15.138:0/2588297282 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1424004d50 msgr2=0x7f14240051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:48.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.404+0000 7f1441400640 1 --2- 172.21.15.138:0/2588297282 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1424004d50 0x7f14240051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:48.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.404+0000 7f1441400640 1 -- 172.21.15.138:0/2588297282 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1424003530 con 0x7f14240039c0 2024-04-26T20:57:48.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.404+0000 7f1441e00640 1 --2- 172.21.15.138:0/2588297282 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1424004d50 0x7f14240051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:57:48.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.408+0000 7f1441400640 1 --2- 172.21.15.138:0/2588297282 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14240039c0 0x7f1424003de0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f143000c240 tx=0x7f143001ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9a2aeed688deb5a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:48.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.408+0000 7f143be00640 1 -- 172.21.15.138:0/2588297282 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1430007d60 con 0x7f14240039c0 2024-04-26T20:57:48.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.408+0000 7f143be00640 1 -- 172.21.15.138:0/2588297282 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14300a9020 con 0x7f14240039c0 2024-04-26T20:57:48.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.408+0000 7f143be00640 1 -- 172.21.15.138:0/2588297282 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1430005ae0 con 0x7f14240039c0 2024-04-26T20:57:48.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.408+0000 7f1442800640 1 -- 172.21.15.138:0/2588297282 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14240039c0 msgr2=0x7f1424003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:48.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.408+0000 7f1442800640 1 --2- 172.21.15.138:0/2588297282 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14240039c0 0x7f1424003de0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f143000c240 tx=0x7f143001ccc0 comp rx=0 tx=0).stop 2024-04-26T20:57:48.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.408+0000 7f1441e00640 1 -- 172.21.15.138:0/2588297282 reap_dead start 2024-04-26T20:57:48.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.408+0000 7f1442800640 1 -- 172.21.15.138:0/2588297282 shutdown_connections 2024-04-26T20:57:48.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.408+0000 7f1442800640 1 -- 172.21.15.138:0/2588297282 >> 172.21.15.138:0/2588297282 conn(0x7f143c0d1ac0 msgr2=0x7f143c0d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:48.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.408+0000 7f1442800640 1 -- 172.21.15.138:0/2588297282 shutdown_connections 2024-04-26T20:57:48.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.408+0000 7f1442800640 1 -- 172.21.15.138:0/2588297282 wait complete. 2024-04-26T20:57:48.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.412+0000 7f1442800640 1 Processor -- start 2024-04-26T20:57:48.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.412+0000 7f1442800640 1 -- start start 2024-04-26T20:57:48.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.412+0000 7f1442800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14240039c0 0x7f143c0d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:48.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.412+0000 7f1442800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f143c147620 0x7f143c144c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:48.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.412+0000 7f1442800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f143c0ce6e0 0x7f143c06f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:48.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.412+0000 7f1442800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f143c0af560 con 0x7f143c147620 2024-04-26T20:57:48.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.412+0000 7f1442800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f143c156260 con 0x7f14240039c0 2024-04-26T20:57:48.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.412+0000 7f1442800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f143c0af6e0 con 0x7f143c0ce6e0 2024-04-26T20:57:48.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.412+0000 7f1440a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f143c147620 0x7f143c144c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:48.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.412+0000 7f1440a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f143c147620 0x7f143c144c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:41008/0 (socket says 172.21.15.138:41008) 2024-04-26T20:57:48.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.412+0000 7f1440a00640 1 -- 172.21.15.138:0/886699269 learned_addr learned my addr 172.21.15.138:0/886699269 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:48.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.412+0000 7f1441e00640 1 --2- 172.21.15.138:0/886699269 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f143c0ce6e0 0x7f143c06f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:48.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.412+0000 7f1441400640 1 --2- 172.21.15.138:0/886699269 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14240039c0 0x7f143c0d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:48.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.412+0000 7f1440a00640 1 -- 172.21.15.138:0/886699269 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f143c0ce6e0 msgr2=0x7f143c06f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:48.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.412+0000 7f1440a00640 1 --2- 172.21.15.138:0/886699269 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f143c0ce6e0 0x7f143c06f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:48.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.412+0000 7f1440a00640 1 -- 172.21.15.138:0/886699269 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14240039c0 msgr2=0x7f143c0d0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:48.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.412+0000 7f1440a00640 1 --2- 172.21.15.138:0/886699269 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14240039c0 0x7f143c0d0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:48.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.412+0000 7f1440a00640 1 -- 172.21.15.138:0/886699269 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f143c0ceee0 con 0x7f143c147620 2024-04-26T20:57:48.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.412+0000 7f1441e00640 1 --2- 172.21.15.138:0/886699269 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f143c0ce6e0 0x7f143c06f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:48.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.412+0000 7f1441400640 1 --2- 172.21.15.138:0/886699269 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14240039c0 0x7f143c0d0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:48.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.412+0000 7f1440a00640 1 --2- 172.21.15.138:0/886699269 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f143c147620 0x7f143c144c30 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f1428011640 tx=0x7f1428011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:48.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.412+0000 7f1439600640 1 -- 172.21.15.138:0/886699269 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f142800f920 con 0x7f143c147620 2024-04-26T20:57:48.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.412+0000 7f1439600640 1 -- 172.21.15.138:0/886699269 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f142800fac0 con 0x7f143c147620 2024-04-26T20:57:48.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.412+0000 7f1439600640 1 -- 172.21.15.138:0/886699269 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f142800fe70 con 0x7f143c147620 2024-04-26T20:57:48.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.412+0000 7f1442800640 1 -- 172.21.15.138:0/886699269 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f143c0cf740 con 0x7f143c147620 2024-04-26T20:57:48.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.412+0000 7f1442800640 1 -- 172.21.15.138:0/886699269 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f143c0cf460 con 0x7f143c147620 2024-04-26T20:57:48.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.412+0000 7f1442800640 1 -- 172.21.15.138:0/886699269 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f143c069430 con 0x7f143c147620 2024-04-26T20:57:48.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.416+0000 7f1439600640 1 -- 172.21.15.138:0/886699269 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1428015460 con 0x7f143c147620 2024-04-26T20:57:48.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.416+0000 7f1439600640 1 --2- 172.21.15.138:0/886699269 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f141c068380 0x7f141c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:48.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.416+0000 7f1439600640 1 -- 172.21.15.138:0/886699269 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f1428086db0 con 0x7f143c147620 2024-04-26T20:57:48.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.416+0000 7f1441400640 1 --2- 172.21.15.138:0/886699269 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f141c068380 0x7f141c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:48.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.416+0000 7f1441400640 1 --2- 172.21.15.138:0/886699269 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f141c068380 0x7f141c06a840 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f14300aa000 tx=0x7f1430001ac0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:48.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.420+0000 7f1439600640 1 -- 172.21.15.138:0/886699269 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f142808b070 con 0x7f143c147620 2024-04-26T20:57:48.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.580+0000 7f1442800640 1 -- 172.21.15.138:0/886699269 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f143c0b5d60 con 0x7f143c147620 2024-04-26T20:57:48.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.580+0000 7f1439600640 1 -- 172.21.15.138:0/886699269 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+13224 (secure 0 0 0) 0x7f1428019030 con 0x7f143c147620 2024-04-26T20:57:48.585 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:57:48.585 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":37,"fsid":"c22b4730-12cc-4558-8535-b965384398c0","created":"2024-04-26T20:56:14.182475+0000","modified":"2024-04-26T20:57:45.525775+0000","last_up_change":"2024-04-26T20:56:26.013243+0000","last_in_change":"2024-04-26T20:56:16.714055+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:56:27.265834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3f9a2e34-3199-466f-a6cf-57927318121e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6801","nonce":3534772245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6803","nonce":3534772245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6807","nonce":3534772245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6805","nonce":3534772245}]},"public_addr":"172.21.15.138:6801/3534772245","cluster_addr":"172.21.15.138:6803/3534772245","heartbeat_back_addr":"172.21.15.138:6807/3534772245","heartbeat_front_addr":"172.21.15.138:6805/3534772245","state":["exists","up"]},{"osd":1,"uuid":"e881fcf6-3248-4696-a2ef-95d206d77712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6817","nonce":1427635773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6819","nonce":1427635773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6823","nonce":1427635773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6821","nonce":1427635773}]},"public_addr":"172.21.15.138:6817/1427635773","cluster_addr":"172.21.15.138:6819/1427635773","heartbeat_back_addr":"172.21.15.138:6823/1427635773","heartbeat_front_addr":"172.21.15.138:6821/1427635773","state":["exists","up"]},{"osd":2,"uuid":"f7d1db33-7672-4699-ae47-9f1e0a8e4222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6809","nonce":4273721573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6811","nonce":4273721573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6815","nonce":4273721573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6813","nonce":4273721573}]},"public_addr":"172.21.15.138:6809/4273721573","cluster_addr":"172.21.15.138:6811/4273721573","heartbeat_back_addr":"172.21.15.138:6815/4273721573","heartbeat_front_addr":"172.21.15.138:6813/4273721573","state":["exists","up"]},{"osd":3,"uuid":"2f4e0a9a-b8f6-4468-844a-a4501cd85054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6825","nonce":3098242154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6827","nonce":3098242154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6831","nonce":3098242154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6829","nonce":3098242154}]},"public_addr":"172.21.15.138:6825/3098242154","cluster_addr":"172.21.15.138:6827/3098242154","heartbeat_back_addr":"172.21.15.138:6831/3098242154","heartbeat_front_addr":"172.21.15.138:6829/3098242154","state":["exists","up"]},{"osd":4,"uuid":"c85df99b-3624-410e-866b-86830af2cfe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6801","nonce":2942056312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6803","nonce":2942056312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6807","nonce":2942056312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6805","nonce":2942056312}]},"public_addr":"172.21.15.143:6801/2942056312","cluster_addr":"172.21.15.143:6803/2942056312","heartbeat_back_addr":"172.21.15.143:6807/2942056312","heartbeat_front_addr":"172.21.15.143:6805/2942056312","state":["exists","up"]},{"osd":5,"uuid":"9af1efb5-c416-4808-b5ef-de0679ab9705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6809","nonce":1910222887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6811","nonce":1910222887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6815","nonce":1910222887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6813","nonce":1910222887}]},"public_addr":"172.21.15.143:6809/1910222887","cluster_addr":"172.21.15.143:6811/1910222887","heartbeat_back_addr":"172.21.15.143:6815/1910222887","heartbeat_front_addr":"172.21.15.143:6813/1910222887","state":["exists","up"]},{"osd":6,"uuid":"d7138615-8838-45ff-9072-2fd0683362f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6817","nonce":1082239825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6819","nonce":1082239825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6823","nonce":1082239825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6821","nonce":1082239825}]},"public_addr":"172.21.15.143:6817/1082239825","cluster_addr":"172.21.15.143:6819/1082239825","heartbeat_back_addr":"172.21.15.143:6823/1082239825","heartbeat_front_addr":"172.21.15.143:6821/1082239825","state":["exists","up"]},{"osd":7,"uuid":"0c27172b-35c4-49ec-ba0b-0137b8ff0010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6825","nonce":3295508495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6827","nonce":3295508495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6831","nonce":3295508495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6829","nonce":3295508495}]},"public_addr":"172.21.15.143:6825/3295508495","cluster_addr":"172.21.15.143:6827/3295508495","heartbeat_back_addr":"172.21.15.143:6831/3295508495","heartbeat_front_addr":"172.21.15.143:6829/3295508495","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.326627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.396119+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.433915+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.414179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.216947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.329272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.503073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.436382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:57:48.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.580+0000 7f1442800640 1 -- 172.21.15.138:0/886699269 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f141c068380 msgr2=0x7f141c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:48.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.580+0000 7f1442800640 1 --2- 172.21.15.138:0/886699269 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f141c068380 0x7f141c06a840 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f14300aa000 tx=0x7f1430001ac0 comp rx=0 tx=0).stop 2024-04-26T20:57:48.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.580+0000 7f1442800640 1 -- 172.21.15.138:0/886699269 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f143c147620 msgr2=0x7f143c144c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:48.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.580+0000 7f1442800640 1 --2- 172.21.15.138:0/886699269 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f143c147620 0x7f143c144c30 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f1428011640 tx=0x7f1428011b00 comp rx=0 tx=0).stop 2024-04-26T20:57:48.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.580+0000 7f1442800640 1 -- 172.21.15.138:0/886699269 shutdown_connections 2024-04-26T20:57:48.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.580+0000 7f1442800640 1 --2- 172.21.15.138:0/886699269 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f141c068380 0x7f141c06a840 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:48.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.580+0000 7f1442800640 1 --2- 172.21.15.138:0/886699269 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f143c0ce6e0 0x7f143c06f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:48.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.580+0000 7f1442800640 1 --2- 172.21.15.138:0/886699269 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f143c147620 0x7f143c144c30 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:48.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.580+0000 7f1442800640 1 --2- 172.21.15.138:0/886699269 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14240039c0 0x7f143c0d0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:48.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.580+0000 7f1442800640 1 -- 172.21.15.138:0/886699269 >> 172.21.15.138:0/886699269 conn(0x7f143c0d1ac0 msgr2=0x7f143c0b53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:48.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.580+0000 7f1442800640 1 -- 172.21.15.138:0/886699269 shutdown_connections 2024-04-26T20:57:48.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.580+0000 7f1442800640 1 -- 172.21.15.138:0/886699269 wait complete. 2024-04-26T20:57:48.606 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:56:27.265834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T20:57:48.606 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T20:57:48.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.740+0000 7f0e5f400640 1 Processor -- start 2024-04-26T20:57:48.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.740+0000 7f0e5f400640 1 -- start start 2024-04-26T20:57:48.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.740+0000 7f0e5f400640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f0e5815bdc0 0x7f0e5815f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:48.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.740+0000 7f0e5f400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e58073d70 0x7f0e5815fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:48.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.740+0000 7f0e5f400640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e5806dee0 con 0x7f0e5806f880 2024-04-26T20:57:48.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.740+0000 7f0e5f400640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f0e5815c1a0 con 0x7f0e5815bdc0 2024-04-26T20:57:48.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.740+0000 7f0e5f400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f0e5806e180 con 0x7f0e58073d70 2024-04-26T20:57:48.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.740+0000 7f0e5d400640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f0e5806f880 0x7f0e580cb6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:43060/0 (socket says 172.21.15.138:43060) 2024-04-26T20:57:48.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.740+0000 7f0e5d400640 1 -- 172.21.15.138:0/3944063601 learned_addr learned my addr 172.21.15.138:0/3944063601 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:48.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.740+0000 7f0e5ca00640 1 --2- 172.21.15.138:0/3944063601 >> v2:172.21.15.143:3300/0 conn(0x7f0e5815bdc0 0x7f0e5815f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:48.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.740+0000 7f0e4fe00640 1 --2- 172.21.15.138:0/3944063601 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e58073d70 0x7f0e5815fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:48.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.740+0000 7f0e57e00640 1 -- 172.21.15.138:0/3944063601 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 539753631 0 0) 0x7f0e5806dee0 con 0x7f0e5806f880 2024-04-26T20:57:48.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.740+0000 7f0e57e00640 1 -- 172.21.15.138:0/3944063601 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e3c003530 con 0x7f0e5806f880 2024-04-26T20:57:48.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.740+0000 7f0e5ca00640 1 -- 172.21.15.138:0/3944063601 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e58073d70 msgr2=0x7f0e5815fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:48.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.740+0000 7f0e5ca00640 1 --2- 172.21.15.138:0/3944063601 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e58073d70 0x7f0e5815fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:48.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.740+0000 7f0e5ca00640 1 -- 172.21.15.138:0/3944063601 >> v1:172.21.15.138:6789/0 conn(0x7f0e5806f880 legacy=0x7f0e580cb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:48.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.740+0000 7f0e5ca00640 1 -- 172.21.15.138:0/3944063601 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e5806e460 con 0x7f0e5815bdc0 2024-04-26T20:57:48.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.740+0000 7f0e4fe00640 1 --2- 172.21.15.138:0/3944063601 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e58073d70 0x7f0e5815fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:57:48.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.744+0000 7f0e5ca00640 1 --2- 172.21.15.138:0/3944063601 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0e5815bdc0 0x7f0e5815f930 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0e480097c0 tx=0x7f0e4801c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=adcc57684dce7d2c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:48.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.744+0000 7f0e57e00640 1 -- 172.21.15.138:0/3944063601 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e480b0070 con 0x7f0e5815bdc0 2024-04-26T20:57:48.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.744+0000 7f0e57e00640 1 -- 172.21.15.138:0/3944063601 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e480ab600 con 0x7f0e5815bdc0 2024-04-26T20:57:48.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.744+0000 7f0e57e00640 1 -- 172.21.15.138:0/3944063601 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e480ab9b0 con 0x7f0e5815bdc0 2024-04-26T20:57:48.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.744+0000 7f0e5f400640 1 -- 172.21.15.138:0/3944063601 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0e5815bdc0 msgr2=0x7f0e5815f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:48.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.744+0000 7f0e5f400640 1 --2- 172.21.15.138:0/3944063601 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0e5815bdc0 0x7f0e5815f930 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0e480097c0 tx=0x7f0e4801c410 comp rx=0 tx=0).stop 2024-04-26T20:57:48.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.744+0000 7f0e5f400640 1 -- 172.21.15.138:0/3944063601 shutdown_connections 2024-04-26T20:57:48.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.744+0000 7f0e5f400640 1 --2- 172.21.15.138:0/3944063601 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e58073d70 0x7f0e5815fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:48.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.744+0000 7f0e5f400640 1 --2- 172.21.15.138:0/3944063601 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0e5815bdc0 0x7f0e5815f930 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:48.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.744+0000 7f0e5f400640 1 -- 172.21.15.138:0/3944063601 >> 172.21.15.138:0/3944063601 conn(0x7f0e580d0bb0 msgr2=0x7f0e580d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:48.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.744+0000 7f0e5f400640 1 -- 172.21.15.138:0/3944063601 shutdown_connections 2024-04-26T20:57:48.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.744+0000 7f0e5f400640 1 -- 172.21.15.138:0/3944063601 wait complete. 2024-04-26T20:57:48.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.748+0000 7f0e5f400640 1 Processor -- start 2024-04-26T20:57:48.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.748+0000 7f0e5f400640 1 -- start start 2024-04-26T20:57:48.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.748+0000 7f0e5f400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0e5806f880 0x7f0e580c4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:48.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.748+0000 7f0e5f400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0e58073d70 0x7f0e5815c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:48.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.748+0000 7f0e5f400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e5815bdc0 0x7f0e580cf320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:48.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.748+0000 7f0e5f400640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f0e58167050 con 0x7f0e5806f880 2024-04-26T20:57:48.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.748+0000 7f0e5f400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f0e58166ed0 con 0x7f0e58073d70 2024-04-26T20:57:48.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.748+0000 7f0e5f400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f0e581671d0 con 0x7f0e5815bdc0 2024-04-26T20:57:48.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.748+0000 7f0e5ca00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0e5806f880 0x7f0e580c4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:48.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.748+0000 7f0e5ca00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0e5806f880 0x7f0e580c4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:41022/0 (socket says 172.21.15.138:41022) 2024-04-26T20:57:48.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.748+0000 7f0e5ca00640 1 -- 172.21.15.138:0/4180002613 learned_addr learned my addr 172.21.15.138:0/4180002613 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:48.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.748+0000 7f0e5d400640 1 --2- 172.21.15.138:0/4180002613 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e5815bdc0 0x7f0e580cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:48.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.748+0000 7f0e4fe00640 1 --2- 172.21.15.138:0/4180002613 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0e58073d70 0x7f0e5815c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:48.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.748+0000 7f0e5ca00640 1 -- 172.21.15.138:0/4180002613 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e5815bdc0 msgr2=0x7f0e580cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:48.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.748+0000 7f0e5ca00640 1 --2- 172.21.15.138:0/4180002613 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e5815bdc0 0x7f0e580cf320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:48.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.748+0000 7f0e5ca00640 1 -- 172.21.15.138:0/4180002613 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0e58073d70 msgr2=0x7f0e5815c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:48.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.748+0000 7f0e5ca00640 1 --2- 172.21.15.138:0/4180002613 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0e58073d70 0x7f0e5815c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:48.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.748+0000 7f0e5ca00640 1 -- 172.21.15.138:0/4180002613 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e58167f90 con 0x7f0e5806f880 2024-04-26T20:57:48.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.748+0000 7f0e4fe00640 1 --2- 172.21.15.138:0/4180002613 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0e58073d70 0x7f0e5815c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:48.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.748+0000 7f0e5ca00640 1 --2- 172.21.15.138:0/4180002613 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0e5806f880 0x7f0e580c4380 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f0e4801aac0 tx=0x7f0e480191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:48.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.748+0000 7f0e55600640 1 -- 172.21.15.138:0/4180002613 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e480b9020 con 0x7f0e5806f880 2024-04-26T20:57:48.757 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.748+0000 7f0e55600640 1 -- 172.21.15.138:0/4180002613 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e480ab7b0 con 0x7f0e5806f880 2024-04-26T20:57:48.757 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.748+0000 7f0e55600640 1 -- 172.21.15.138:0/4180002613 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e480b0040 con 0x7f0e5806f880 2024-04-26T20:57:48.757 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.748+0000 7f0e5f400640 1 -- 172.21.15.138:0/4180002613 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e58168270 con 0x7f0e5806f880 2024-04-26T20:57:48.757 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.748+0000 7f0e5f400640 1 -- 172.21.15.138:0/4180002613 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e58168830 con 0x7f0e5806f880 2024-04-26T20:57:48.757 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.748+0000 7f0e5f400640 1 -- 172.21.15.138:0/4180002613 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e58069430 con 0x7f0e5806f880 2024-04-26T20:57:48.757 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.752+0000 7f0e55600640 1 -- 172.21.15.138:0/4180002613 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0e480bc020 con 0x7f0e5806f880 2024-04-26T20:57:48.758 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.752+0000 7f0e55600640 1 --2- 172.21.15.138:0/4180002613 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0e34068380 0x7f0e3406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:48.758 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.752+0000 7f0e55600640 1 -- 172.21.15.138:0/4180002613 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f0e48120750 con 0x7f0e5806f880 2024-04-26T20:57:48.758 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.752+0000 7f0e4fe00640 1 --2- 172.21.15.138:0/4180002613 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0e34068380 0x7f0e3406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:48.758 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.752+0000 7f0e4fe00640 1 --2- 172.21.15.138:0/4180002613 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0e34068380 0x7f0e3406a840 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0e58074190 tx=0x7f0e40008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:48.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.756+0000 7f0e55600640 1 -- 172.21.15.138:0/4180002613 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0e480c3030 con 0x7f0e5806f880 2024-04-26T20:57:48.919 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.912+0000 7f0e5f400640 1 -- 172.21.15.138:0/4180002613 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0e580d19c0 con 0x7f0e5806f880 2024-04-26T20:57:48.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.916+0000 7f0e55600640 1 -- 172.21.15.138:0/4180002613 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) ==== 93+0+10 (secure 0 0 0) 0x7f0e48016090 con 0x7f0e5806f880 2024-04-26T20:57:48.920 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 1 2024-04-26T20:57:48.922 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.916+0000 7f0e5f400640 1 -- 172.21.15.138:0/4180002613 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0e34068380 msgr2=0x7f0e3406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:48.922 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.916+0000 7f0e5f400640 1 --2- 172.21.15.138:0/4180002613 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0e34068380 0x7f0e3406a840 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0e58074190 tx=0x7f0e40008040 comp rx=0 tx=0).stop 2024-04-26T20:57:48.922 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.916+0000 7f0e5f400640 1 -- 172.21.15.138:0/4180002613 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0e5806f880 msgr2=0x7f0e580c4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:48.922 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.916+0000 7f0e5f400640 1 --2- 172.21.15.138:0/4180002613 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0e5806f880 0x7f0e580c4380 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f0e4801aac0 tx=0x7f0e480191b0 comp rx=0 tx=0).stop 2024-04-26T20:57:48.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.916+0000 7f0e5f400640 1 -- 172.21.15.138:0/4180002613 shutdown_connections 2024-04-26T20:57:48.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.916+0000 7f0e5f400640 1 --2- 172.21.15.138:0/4180002613 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0e34068380 0x7f0e3406a840 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:48.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.916+0000 7f0e5f400640 1 --2- 172.21.15.138:0/4180002613 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e5815bdc0 0x7f0e580cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:48.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.916+0000 7f0e5f400640 1 --2- 172.21.15.138:0/4180002613 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0e58073d70 0x7f0e5815c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:48.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.916+0000 7f0e5f400640 1 --2- 172.21.15.138:0/4180002613 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0e5806f880 0x7f0e580c4380 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:48.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.916+0000 7f0e5f400640 1 -- 172.21.15.138:0/4180002613 >> 172.21.15.138:0/4180002613 conn(0x7f0e580d0bb0 msgr2=0x7f0e580c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:48.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.916+0000 7f0e5f400640 1 -- 172.21.15.138:0/4180002613 shutdown_connections 2024-04-26T20:57:48.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:48.916+0000 7f0e5f400640 1 -- 172.21.15.138:0/4180002613 wait complete. 2024-04-26T20:57:48.941 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-26T20:57:49.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.072+0000 7f5223a00640 1 Processor -- start 2024-04-26T20:57:49.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.072+0000 7f5223a00640 1 -- start start 2024-04-26T20:57:49.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.072+0000 7f5223a00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f521c15d0f0 0x7f521c0d1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:49.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.072+0000 7f5223a00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f521c0d0950 0x7f521c0d1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:49.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.072+0000 7f5223a00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f521c0ce540 con 0x7f521c0b2280 2024-04-26T20:57:49.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.072+0000 7f5223a00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f521c0d0e50 con 0x7f521c15d0f0 2024-04-26T20:57:49.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.072+0000 7f5223a00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f521c0b26e0 con 0x7f521c0d0950 2024-04-26T20:57:49.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.072+0000 7f5221000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f521c15d0f0 0x7f521c0d1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:49.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.072+0000 7f5221000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f521c15d0f0 0x7f521c0d1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:41026/0 (socket says 172.21.15.138:41026) 2024-04-26T20:57:49.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.072+0000 7f5221000640 1 -- 172.21.15.138:0/1963157108 learned_addr learned my addr 172.21.15.138:0/1963157108 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:49.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.072+0000 7f5221a00640 1 --2- 172.21.15.138:0/1963157108 >> v2:172.21.15.143:3300/0 conn(0x7f521c0d0950 0x7f521c0d1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:49.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.072+0000 7f5221000640 1 -- 172.21.15.138:0/1963157108 >> v2:172.21.15.143:3300/0 conn(0x7f521c0d0950 msgr2=0x7f521c0d1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:49.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.072+0000 7f5221000640 1 --2- 172.21.15.138:0/1963157108 >> v2:172.21.15.143:3300/0 conn(0x7f521c0d0950 0x7f521c0d1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:49.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.072+0000 7f5221000640 1 -- 172.21.15.138:0/1963157108 >> v1:172.21.15.143:6789/0 conn(0x7f521c0b2280 legacy=0x7f521c0cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:49.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.072+0000 7f5221000640 1 -- 172.21.15.138:0/1963157108 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f521c0ce820 con 0x7f521c15d0f0 2024-04-26T20:57:49.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.076+0000 7f5221000640 1 --2- 172.21.15.138:0/1963157108 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f521c15d0f0 0x7f521c0d1010 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f521c0d2a30 tx=0x7f520c01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83ab34ea2b935c3e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:49.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.076+0000 7f521be00640 1 -- 172.21.15.138:0/1963157108 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f520c0b0070 con 0x7f521c15d0f0 2024-04-26T20:57:49.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.076+0000 7f521be00640 1 -- 172.21.15.138:0/1963157108 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f520c0ab600 con 0x7f521c15d0f0 2024-04-26T20:57:49.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.076+0000 7f521be00640 1 -- 172.21.15.138:0/1963157108 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f520c0ab9d0 con 0x7f521c15d0f0 2024-04-26T20:57:49.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.076+0000 7f5223a00640 1 -- 172.21.15.138:0/1963157108 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f521c15d0f0 msgr2=0x7f521c0d1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:49.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.076+0000 7f5223a00640 1 --2- 172.21.15.138:0/1963157108 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f521c15d0f0 0x7f521c0d1010 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f521c0d2a30 tx=0x7f520c01c4e0 comp rx=0 tx=0).stop 2024-04-26T20:57:49.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.076+0000 7f5223a00640 1 -- 172.21.15.138:0/1963157108 shutdown_connections 2024-04-26T20:57:49.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.076+0000 7f5223a00640 1 --2- 172.21.15.138:0/1963157108 >> v2:172.21.15.143:3300/0 conn(0x7f521c0d0950 0x7f521c0d1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:49.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.076+0000 7f5223a00640 1 --2- 172.21.15.138:0/1963157108 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f521c15d0f0 0x7f521c0d1010 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:49.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.076+0000 7f5223a00640 1 -- 172.21.15.138:0/1963157108 >> 172.21.15.138:0/1963157108 conn(0x7f521c0d2d80 msgr2=0x7f521c0d3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:49.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.076+0000 7f5223a00640 1 -- 172.21.15.138:0/1963157108 shutdown_connections 2024-04-26T20:57:49.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.076+0000 7f5223a00640 1 -- 172.21.15.138:0/1963157108 wait complete. 2024-04-26T20:57:49.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.080+0000 7f5223a00640 1 Processor -- start 2024-04-26T20:57:49.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.080+0000 7f5223a00640 1 -- start start 2024-04-26T20:57:49.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.080+0000 7f5223a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f521c0b2280 0x7f521c071430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:49.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.080+0000 7f5223a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f521c0d0950 0x7f521c152480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:49.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.080+0000 7f5223a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f521c15d0f0 0x7f521c1529c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:49.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.080+0000 7f5223a00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f521c16a040 con 0x7f521c0d0950 2024-04-26T20:57:49.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.080+0000 7f5223a00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f521c169ec0 con 0x7f521c0b2280 2024-04-26T20:57:49.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.080+0000 7f5223a00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f521c16a1c0 con 0x7f521c15d0f0 2024-04-26T20:57:49.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.080+0000 7f5213e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f521c0d0950 0x7f521c152480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:49.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.080+0000 7f5213e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f521c0d0950 0x7f521c152480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:41042/0 (socket says 172.21.15.138:41042) 2024-04-26T20:57:49.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.080+0000 7f5213e00640 1 -- 172.21.15.138:0/3085766111 learned_addr learned my addr 172.21.15.138:0/3085766111 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:49.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.080+0000 7f5221a00640 1 --2- 172.21.15.138:0/3085766111 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f521c15d0f0 0x7f521c1529c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:49.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.080+0000 7f5221000640 1 --2- 172.21.15.138:0/3085766111 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f521c0b2280 0x7f521c071430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:49.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.080+0000 7f5213e00640 1 -- 172.21.15.138:0/3085766111 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f521c15d0f0 msgr2=0x7f521c1529c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:49.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.080+0000 7f5213e00640 1 --2- 172.21.15.138:0/3085766111 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f521c15d0f0 0x7f521c1529c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:49.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.080+0000 7f5213e00640 1 -- 172.21.15.138:0/3085766111 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f521c0b2280 msgr2=0x7f521c071430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:49.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.080+0000 7f5213e00640 1 --2- 172.21.15.138:0/3085766111 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f521c0b2280 0x7f521c071430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:49.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.080+0000 7f5213e00640 1 -- 172.21.15.138:0/3085766111 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f521c153cf0 con 0x7f521c0d0950 2024-04-26T20:57:49.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.080+0000 7f5213e00640 1 --2- 172.21.15.138:0/3085766111 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f521c0d0950 0x7f521c152480 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f520400c450 tx=0x7f520400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:49.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.080+0000 7f5219600640 1 -- 172.21.15.138:0/3085766111 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5204012830 con 0x7f521c0d0950 2024-04-26T20:57:49.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.080+0000 7f5219600640 1 -- 172.21.15.138:0/3085766111 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5204017070 con 0x7f521c0d0950 2024-04-26T20:57:49.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.080+0000 7f5219600640 1 -- 172.21.15.138:0/3085766111 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5204012c30 con 0x7f521c0d0950 2024-04-26T20:57:49.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.080+0000 7f5223a00640 1 -- 172.21.15.138:0/3085766111 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f521c153fd0 con 0x7f521c0d0950 2024-04-26T20:57:49.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.080+0000 7f5223a00640 1 -- 172.21.15.138:0/3085766111 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f521c154d10 con 0x7f521c0d0950 2024-04-26T20:57:49.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.084+0000 7f5223a00640 1 -- 172.21.15.138:0/3085766111 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f521c069510 con 0x7f521c0d0950 2024-04-26T20:57:49.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.084+0000 7f5219600640 1 -- 172.21.15.138:0/3085766111 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f520401c460 con 0x7f521c0d0950 2024-04-26T20:57:49.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.084+0000 7f5219600640 1 --2- 172.21.15.138:0/3085766111 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f51f8068380 0x7f51f806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:49.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.084+0000 7f5219600640 1 -- 172.21.15.138:0/3085766111 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f5204086410 con 0x7f521c0d0950 2024-04-26T20:57:49.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.084+0000 7f5221000640 1 --2- 172.21.15.138:0/3085766111 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f51f8068380 0x7f51f806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:49.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.084+0000 7f5221000640 1 --2- 172.21.15.138:0/3085766111 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f51f8068380 0x7f51f806a840 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f520c0ad000 tx=0x7f520c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:49.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.088+0000 7f5219600640 1 -- 172.21.15.138:0/3085766111 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f52040565d0 con 0x7f521c0d0950 2024-04-26T20:57:49.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.248+0000 7f5223a00640 1 -- 172.21.15.138:0/3085766111 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f521c0b8b10 con 0x7f521c0d0950 2024-04-26T20:57:49.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.248+0000 7f5219600640 1 -- 172.21.15.138:0/3085766111 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v37) ==== 84+0+65 (secure 0 0 0) 0x7f520405a8d0 con 0x7f521c0d0950 2024-04-26T20:57:49.254 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:57:49.254 INFO:teuthology.orchestra.run.smithi138.stdout:[ 2024-04-26T20:57:49.254 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-26T20:57:49.254 INFO:teuthology.orchestra.run.smithi138.stdout: "poolnum": 1, 2024-04-26T20:57:49.254 INFO:teuthology.orchestra.run.smithi138.stdout: "poolname": ".mgr" 2024-04-26T20:57:49.255 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-26T20:57:49.255 INFO:teuthology.orchestra.run.smithi138.stdout:] 2024-04-26T20:57:49.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.252+0000 7f5223a00640 1 -- 172.21.15.138:0/3085766111 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f51f8068380 msgr2=0x7f51f806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:49.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.252+0000 7f5223a00640 1 --2- 172.21.15.138:0/3085766111 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f51f8068380 0x7f51f806a840 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f520c0ad000 tx=0x7f520c008040 comp rx=0 tx=0).stop 2024-04-26T20:57:49.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.252+0000 7f5223a00640 1 -- 172.21.15.138:0/3085766111 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f521c0d0950 msgr2=0x7f521c152480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:49.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.252+0000 7f5223a00640 1 --2- 172.21.15.138:0/3085766111 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f521c0d0950 0x7f521c152480 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f520400c450 tx=0x7f520400c910 comp rx=0 tx=0).stop 2024-04-26T20:57:49.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.252+0000 7f5223a00640 1 -- 172.21.15.138:0/3085766111 shutdown_connections 2024-04-26T20:57:49.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.252+0000 7f5223a00640 1 --2- 172.21.15.138:0/3085766111 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f51f8068380 0x7f51f806a840 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:49.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.252+0000 7f5223a00640 1 --2- 172.21.15.138:0/3085766111 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f521c15d0f0 0x7f521c1529c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:49.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.252+0000 7f5223a00640 1 --2- 172.21.15.138:0/3085766111 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f521c0d0950 0x7f521c152480 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:49.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.252+0000 7f5223a00640 1 --2- 172.21.15.138:0/3085766111 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f521c0b2280 0x7f521c071430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:49.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.252+0000 7f5223a00640 1 -- 172.21.15.138:0/3085766111 >> 172.21.15.138:0/3085766111 conn(0x7f521c0d2d80 msgr2=0x7f521c0ccc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:49.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.252+0000 7f5223a00640 1 -- 172.21.15.138:0/3085766111 shutdown_connections 2024-04-26T20:57:49.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.252+0000 7f5223a00640 1 -- 172.21.15.138:0/3085766111 wait complete. 2024-04-26T20:57:49.276 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-26T20:57:49.276 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-26T20:57:49.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.408+0000 7f9d09200640 1 Processor -- start 2024-04-26T20:57:49.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.408+0000 7f9d09200640 1 -- start start 2024-04-26T20:57:49.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.412+0000 7f9d09200640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9d0415c020 0x7f9d04073e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:49.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.412+0000 7f9d09200640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d0406e1a0 con 0x7f9d040cc2e0 2024-04-26T20:57:49.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.412+0000 7f9d09200640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d0406e480 con 0x7f9d0415bc40 2024-04-26T20:57:49.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.412+0000 7f9d09200640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f9d04073380 con 0x7f9d0415c020 2024-04-26T20:57:49.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.412+0000 7f9d01400640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f9d040cc2e0 0x7f9d040ce720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:43066/0 (socket says 172.21.15.138:43066) 2024-04-26T20:57:49.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.412+0000 7f9d01400640 1 -- 172.21.15.138:0/1643911096 learned_addr learned my addr 172.21.15.138:0/1643911096 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:49.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.412+0000 7f9d02800640 1 --2- 172.21.15.138:0/1643911096 >> v2:172.21.15.143:3300/0 conn(0x7f9d0415c020 0x7f9d04073e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:49.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.412+0000 7f9d00a00640 1 -- 172.21.15.138:0/1643911096 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1587309926 0 0) 0x7f9d0406e1a0 con 0x7f9d040cc2e0 2024-04-26T20:57:49.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.412+0000 7f9d00a00640 1 -- 172.21.15.138:0/1643911096 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ce8003530 con 0x7f9d040cc2e0 2024-04-26T20:57:49.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.412+0000 7f9d00a00640 1 -- 172.21.15.138:0/1643911096 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2903261441 0 0) 0x7f9d0406e480 con 0x7f9d0415bc40 2024-04-26T20:57:49.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.412+0000 7f9d00a00640 1 -- 172.21.15.138:0/1643911096 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d0406e1a0 con 0x7f9d0415bc40 2024-04-26T20:57:49.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.412+0000 7f9d02800640 1 -- 172.21.15.138:0/1643911096 >> v1:172.21.15.143:6789/0 conn(0x7f9d0415bc40 legacy=0x7f9d040cbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:49.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.412+0000 7f9d02800640 1 -- 172.21.15.138:0/1643911096 >> v1:172.21.15.138:6789/0 conn(0x7f9d040cc2e0 legacy=0x7f9d040ce720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:49.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.412+0000 7f9d02800640 1 -- 172.21.15.138:0/1643911096 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d04073660 con 0x7f9d0415c020 2024-04-26T20:57:49.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.416+0000 7f9d02800640 1 --2- 172.21.15.138:0/1643911096 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9d0415c020 0x7f9d04073e60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc009d90 tx=0x7f9cfc01c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6908385b9138d0ee server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:49.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.416+0000 7f9d00a00640 1 -- 172.21.15.138:0/1643911096 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc0b2070 con 0x7f9d0415c020 2024-04-26T20:57:49.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.416+0000 7f9d00a00640 1 -- 172.21.15.138:0/1643911096 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cfc0a5940 con 0x7f9d0415c020 2024-04-26T20:57:49.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.416+0000 7f9d00a00640 1 -- 172.21.15.138:0/1643911096 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc0a5d10 con 0x7f9d0415c020 2024-04-26T20:57:49.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.416+0000 7f9d09200640 1 -- 172.21.15.138:0/1643911096 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9d0415c020 msgr2=0x7f9d04073e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:49.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.416+0000 7f9d09200640 1 --2- 172.21.15.138:0/1643911096 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9d0415c020 0x7f9d04073e60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc009d90 tx=0x7f9cfc01c970 comp rx=0 tx=0).stop 2024-04-26T20:57:49.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.416+0000 7f9d09200640 1 -- 172.21.15.138:0/1643911096 shutdown_connections 2024-04-26T20:57:49.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.416+0000 7f9d09200640 1 --2- 172.21.15.138:0/1643911096 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9d0415c020 0x7f9d04073e60 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:49.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.416+0000 7f9d09200640 1 -- 172.21.15.138:0/1643911096 >> 172.21.15.138:0/1643911096 conn(0x7f9d040d0b50 msgr2=0x7f9d040d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:49.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.416+0000 7f9d09200640 1 -- 172.21.15.138:0/1643911096 shutdown_connections 2024-04-26T20:57:49.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.416+0000 7f9d09200640 1 -- 172.21.15.138:0/1643911096 wait complete. 2024-04-26T20:57:49.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.416+0000 7f9d09200640 1 Processor -- start 2024-04-26T20:57:49.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.416+0000 7f9d09200640 1 -- start start 2024-04-26T20:57:49.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.416+0000 7f9d09200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9d040cc2e0 0x7f9d041518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:49.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.416+0000 7f9d09200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9d0415bc40 0x7f9d040c5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:49.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.416+0000 7f9d09200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9d0415c020 0x7f9d040c5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:49.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.416+0000 7f9d09200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0416a0c0 con 0x7f9d040cc2e0 2024-04-26T20:57:49.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.416+0000 7f9d09200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f9d04169f40 con 0x7f9d0415bc40 2024-04-26T20:57:49.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.416+0000 7f9d09200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f9d0416a240 con 0x7f9d0415c020 2024-04-26T20:57:49.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.420+0000 7f9d01e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9d040cc2e0 0x7f9d041518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:49.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.420+0000 7f9d01e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9d040cc2e0 0x7f9d041518e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:41048/0 (socket says 172.21.15.138:41048) 2024-04-26T20:57:49.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.420+0000 7f9d01e00640 1 -- 172.21.15.138:0/88930851 learned_addr learned my addr 172.21.15.138:0/88930851 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:49.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.420+0000 7f9d02800640 1 --2- 172.21.15.138:0/88930851 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9d0415c020 0x7f9d040c5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:49.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.420+0000 7f9d01400640 1 --2- 172.21.15.138:0/88930851 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9d0415bc40 0x7f9d040c5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:49.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.420+0000 7f9d01e00640 1 -- 172.21.15.138:0/88930851 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9d0415c020 msgr2=0x7f9d040c5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:49.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.420+0000 7f9d01e00640 1 --2- 172.21.15.138:0/88930851 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9d0415c020 0x7f9d040c5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:49.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.420+0000 7f9d01e00640 1 -- 172.21.15.138:0/88930851 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9d0415bc40 msgr2=0x7f9d040c5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:49.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.420+0000 7f9d01e00640 1 --2- 172.21.15.138:0/88930851 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9d0415bc40 0x7f9d040c5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:49.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.420+0000 7f9d01e00640 1 -- 172.21.15.138:0/88930851 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d04159150 con 0x7f9d040cc2e0 2024-04-26T20:57:49.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.420+0000 7f9d01e00640 1 --2- 172.21.15.138:0/88930851 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9d040cc2e0 0x7f9d041518e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f9cec00c4c0 tx=0x7f9cec00c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:49.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.420+0000 7f9cfa000640 1 -- 172.21.15.138:0/88930851 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cec0052d0 con 0x7f9d040cc2e0 2024-04-26T20:57:49.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.420+0000 7f9cfa000640 1 -- 172.21.15.138:0/88930851 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cec005470 con 0x7f9d040cc2e0 2024-04-26T20:57:49.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.420+0000 7f9cfa000640 1 -- 172.21.15.138:0/88930851 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cec012870 con 0x7f9d040cc2e0 2024-04-26T20:57:49.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.420+0000 7f9d09200640 1 -- 172.21.15.138:0/88930851 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d041522b0 con 0x7f9d040cc2e0 2024-04-26T20:57:49.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.420+0000 7f9d09200640 1 -- 172.21.15.138:0/88930851 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d041596a0 con 0x7f9d040cc2e0 2024-04-26T20:57:49.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.420+0000 7f9d09200640 1 -- 172.21.15.138:0/88930851 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d04069510 con 0x7f9d040cc2e0 2024-04-26T20:57:49.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.420+0000 7f9cfa000640 1 -- 172.21.15.138:0/88930851 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9cec012a10 con 0x7f9d040cc2e0 2024-04-26T20:57:49.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.420+0000 7f9cfa000640 1 --2- 172.21.15.138:0/88930851 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9ce0068380 0x7f9ce006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:49.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.420+0000 7f9cfa000640 1 -- 172.21.15.138:0/88930851 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f9cec086510 con 0x7f9d040cc2e0 2024-04-26T20:57:49.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.424+0000 7f9d01400640 1 --2- 172.21.15.138:0/88930851 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9ce0068380 0x7f9ce006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:49.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.424+0000 7f9d01400640 1 --2- 172.21.15.138:0/88930851 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9ce0068380 0x7f9ce006a840 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9d040b1b80 tx=0x7f9cf4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:49.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.424+0000 7f9cfa000640 1 -- 172.21.15.138:0/88930851 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9d041522b0 con 0x7f9d040cc2e0 2024-04-26T20:57:49.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:49.584+0000 7f9d09200640 1 -- 172.21.15.138:0/88930851 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f9d040c4430 con 0x7f9d040cc2e0 2024-04-26T20:57:50.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.536+0000 7f9cfa000640 1 -- 172.21.15.138:0/88930851 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v38) ==== 138+0+0 (secure 0 0 0) 0x7f9cec056bf0 con 0x7f9d040cc2e0 2024-04-26T20:57:50.541 INFO:teuthology.orchestra.run.smithi138.stderr:pool 'cephfs_metadata' created 2024-04-26T20:57:50.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.540+0000 7f9d09200640 1 -- 172.21.15.138:0/88930851 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9ce0068380 msgr2=0x7f9ce006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:50.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.540+0000 7f9d09200640 1 --2- 172.21.15.138:0/88930851 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9ce0068380 0x7f9ce006a840 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9d040b1b80 tx=0x7f9cf4009040 comp rx=0 tx=0).stop 2024-04-26T20:57:50.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.540+0000 7f9d09200640 1 -- 172.21.15.138:0/88930851 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9d040cc2e0 msgr2=0x7f9d041518e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:50.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.540+0000 7f9d09200640 1 --2- 172.21.15.138:0/88930851 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9d040cc2e0 0x7f9d041518e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f9cec00c4c0 tx=0x7f9cec00c980 comp rx=0 tx=0).stop 2024-04-26T20:57:50.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.540+0000 7f9d09200640 1 -- 172.21.15.138:0/88930851 shutdown_connections 2024-04-26T20:57:50.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.540+0000 7f9d09200640 1 --2- 172.21.15.138:0/88930851 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9ce0068380 0x7f9ce006a840 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:50.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.540+0000 7f9d09200640 1 --2- 172.21.15.138:0/88930851 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9d0415c020 0x7f9d040c5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:50.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.540+0000 7f9d09200640 1 --2- 172.21.15.138:0/88930851 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9d0415bc40 0x7f9d040c5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:50.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.540+0000 7f9d09200640 1 --2- 172.21.15.138:0/88930851 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9d040cc2e0 0x7f9d041518e0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:50.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.540+0000 7f9d09200640 1 -- 172.21.15.138:0/88930851 >> 172.21.15.138:0/88930851 conn(0x7f9d040d0b50 msgr2=0x7f9d04075930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:50.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.540+0000 7f9d09200640 1 -- 172.21.15.138:0/88930851 shutdown_connections 2024-04-26T20:57:50.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.540+0000 7f9d09200640 1 -- 172.21.15.138:0/88930851 wait complete. 2024-04-26T20:57:50.571 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-26T20:57:50.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.712+0000 7f0be2800640 1 Processor -- start 2024-04-26T20:57:50.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.712+0000 7f0be2800640 1 -- start start 2024-04-26T20:57:50.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.712+0000 7f0be2800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0bdc15f220 0x7f0bdc06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:50.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.712+0000 7f0be2800640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bdc0d1e50 con 0x7f0bdc06e4a0 2024-04-26T20:57:50.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.712+0000 7f0be2800640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bdc0d2130 con 0x7f0bdc15f600 2024-04-26T20:57:50.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.712+0000 7f0be2800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f0bdc06dbf0 con 0x7f0bdc15f220 2024-04-26T20:57:50.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.712+0000 7f0be1e00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f0bdc06e4a0 0x7f0bdc0cdd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:43078/0 (socket says 172.21.15.138:43078) 2024-04-26T20:57:50.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.712+0000 7f0be1e00640 1 -- 172.21.15.138:0/4220846757 learned_addr learned my addr 172.21.15.138:0/4220846757 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:50.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.712+0000 7f0be1400640 1 --2- 172.21.15.138:0/4220846757 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0bdc15f220 0x7f0bdc06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:50.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.712+0000 7f0bdbe00640 1 -- 172.21.15.138:0/4220846757 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3541728606 0 0) 0x7f0bdc0d1e50 con 0x7f0bdc06e4a0 2024-04-26T20:57:50.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.712+0000 7f0bdbe00640 1 -- 172.21.15.138:0/4220846757 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0bc4003530 con 0x7f0bdc06e4a0 2024-04-26T20:57:50.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.712+0000 7f0bdbe00640 1 -- 172.21.15.138:0/4220846757 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 74901017 0 0) 0x7f0bdc0d2130 con 0x7f0bdc15f600 2024-04-26T20:57:50.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.712+0000 7f0bdbe00640 1 -- 172.21.15.138:0/4220846757 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0bdc0d1e50 con 0x7f0bdc15f600 2024-04-26T20:57:50.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.712+0000 7f0be1400640 1 -- 172.21.15.138:0/4220846757 >> v1:172.21.15.143:6789/0 conn(0x7f0bdc15f600 legacy=0x7f0bdc06dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:50.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.712+0000 7f0be1400640 1 -- 172.21.15.138:0/4220846757 >> v1:172.21.15.138:6789/0 conn(0x7f0bdc06e4a0 legacy=0x7f0bdc0cdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:50.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.712+0000 7f0be1400640 1 -- 172.21.15.138:0/4220846757 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bdc0cd530 con 0x7f0bdc15f220 2024-04-26T20:57:50.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.716+0000 7f0be1400640 1 --2- 172.21.15.138:0/4220846757 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0bdc15f220 0x7f0bdc06d6b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0bd00097f0 tx=0x7f0bd001c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adfced64b899cc35 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:50.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.716+0000 7f0bdbe00640 1 -- 172.21.15.138:0/4220846757 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd00b0070 con 0x7f0bdc15f220 2024-04-26T20:57:50.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.716+0000 7f0bdbe00640 1 -- 172.21.15.138:0/4220846757 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bd00ab600 con 0x7f0bdc15f220 2024-04-26T20:57:50.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.716+0000 7f0bdbe00640 1 -- 172.21.15.138:0/4220846757 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd00ab9d0 con 0x7f0bdc15f220 2024-04-26T20:57:50.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.716+0000 7f0be2800640 1 -- 172.21.15.138:0/4220846757 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0bdc15f220 msgr2=0x7f0bdc06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:50.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.716+0000 7f0be2800640 1 --2- 172.21.15.138:0/4220846757 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0bdc15f220 0x7f0bdc06d6b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0bd00097f0 tx=0x7f0bd001c4e0 comp rx=0 tx=0).stop 2024-04-26T20:57:50.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.716+0000 7f0be2800640 1 -- 172.21.15.138:0/4220846757 shutdown_connections 2024-04-26T20:57:50.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.716+0000 7f0be2800640 1 --2- 172.21.15.138:0/4220846757 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0bdc15f220 0x7f0bdc06d6b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:50.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.716+0000 7f0be2800640 1 -- 172.21.15.138:0/4220846757 >> 172.21.15.138:0/4220846757 conn(0x7f0bdc0d2d40 msgr2=0x7f0bdc0d3150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:50.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.716+0000 7f0be2800640 1 -- 172.21.15.138:0/4220846757 shutdown_connections 2024-04-26T20:57:50.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.716+0000 7f0be2800640 1 -- 172.21.15.138:0/4220846757 wait complete. 2024-04-26T20:57:50.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.720+0000 7f0be2800640 1 Processor -- start 2024-04-26T20:57:50.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.720+0000 7f0be2800640 1 -- start start 2024-04-26T20:57:50.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.720+0000 7f0be2800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0bdc06e4a0 0x7f0bdc155ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:50.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.720+0000 7f0be2800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0bdc15f220 0x7f0bdc0cc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:50.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.720+0000 7f0be2800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0bdc15f600 0x7f0bdc0cc810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:50.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.720+0000 7f0be2800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f0bdc0cefe0 con 0x7f0bdc06e4a0 2024-04-26T20:57:50.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.720+0000 7f0be2800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f0bdc0cee60 con 0x7f0bdc15f600 2024-04-26T20:57:50.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.720+0000 7f0be2800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f0bdc16cf60 con 0x7f0bdc15f220 2024-04-26T20:57:50.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.720+0000 7f0be1400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0bdc06e4a0 0x7f0bdc155ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:50.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.720+0000 7f0be1400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0bdc06e4a0 0x7f0bdc155ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:41060/0 (socket says 172.21.15.138:41060) 2024-04-26T20:57:50.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.720+0000 7f0be1400640 1 -- 172.21.15.138:0/3204110367 learned_addr learned my addr 172.21.15.138:0/3204110367 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:50.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.720+0000 7f0be0a00640 1 --2- 172.21.15.138:0/3204110367 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0bdc15f220 0x7f0bdc0cc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:50.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.720+0000 7f0be1e00640 1 --2- 172.21.15.138:0/3204110367 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0bdc15f600 0x7f0bdc0cc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:50.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.720+0000 7f0be1400640 1 -- 172.21.15.138:0/3204110367 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0bdc15f220 msgr2=0x7f0bdc0cc2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:50.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.720+0000 7f0be1400640 1 --2- 172.21.15.138:0/3204110367 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0bdc15f220 0x7f0bdc0cc2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:50.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.720+0000 7f0be1400640 1 -- 172.21.15.138:0/3204110367 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0bdc15f600 msgr2=0x7f0bdc0cc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:50.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.720+0000 7f0be1400640 1 --2- 172.21.15.138:0/3204110367 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0bdc15f600 0x7f0bdc0cc810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:50.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.720+0000 7f0be1400640 1 -- 172.21.15.138:0/3204110367 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bdc15dd70 con 0x7f0bdc06e4a0 2024-04-26T20:57:50.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.720+0000 7f0be1e00640 1 --2- 172.21.15.138:0/3204110367 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0bdc15f600 0x7f0bdc0cc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:57:50.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.720+0000 7f0be1400640 1 --2- 172.21.15.138:0/3204110367 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0bdc06e4a0 0x7f0bdc155ad0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f0bd00097f0 tx=0x7f0bd0019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:50.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.720+0000 7f0bd9600640 1 -- 172.21.15.138:0/3204110367 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd00b0040 con 0x7f0bdc06e4a0 2024-04-26T20:57:50.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.720+0000 7f0bd9600640 1 -- 172.21.15.138:0/3204110367 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bd00ba070 con 0x7f0bdc06e4a0 2024-04-26T20:57:50.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.720+0000 7f0bd9600640 1 -- 172.21.15.138:0/3204110367 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd00abe60 con 0x7f0bdc06e4a0 2024-04-26T20:57:50.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.720+0000 7f0be2800640 1 -- 172.21.15.138:0/3204110367 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bdc15da90 con 0x7f0bdc06e4a0 2024-04-26T20:57:50.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.720+0000 7f0be2800640 1 -- 172.21.15.138:0/3204110367 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bdc0cb2e0 con 0x7f0bdc06e4a0 2024-04-26T20:57:50.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.724+0000 7f0be2800640 1 -- 172.21.15.138:0/3204110367 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bdc069430 con 0x7f0bdc06e4a0 2024-04-26T20:57:50.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.724+0000 7f0bd9600640 1 -- 172.21.15.138:0/3204110367 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0bd00b4650 con 0x7f0bdc06e4a0 2024-04-26T20:57:50.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.724+0000 7f0bd9600640 1 --2- 172.21.15.138:0/3204110367 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0bbc068380 0x7f0bbc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:50.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.724+0000 7f0bd9600640 1 -- 172.21.15.138:0/3204110367 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5619+0+0 (secure 0 0 0) 0x7f0bd0120fb0 con 0x7f0bdc06e4a0 2024-04-26T20:57:50.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.724+0000 7f0be0a00640 1 --2- 172.21.15.138:0/3204110367 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0bbc068380 0x7f0bbc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:50.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.724+0000 7f0be0a00640 1 --2- 172.21.15.138:0/3204110367 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0bbc068380 0x7f0bbc06a840 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8007fd0 tx=0x7f0bc8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:50.733 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.728+0000 7f0bd9600640 1 -- 172.21.15.138:0/3204110367 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0bd00160d0 con 0x7f0bdc06e4a0 2024-04-26T20:57:50.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:50.888+0000 7f0be2800640 1 -- 172.21.15.138:0/3204110367 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f0bdc0d3560 con 0x7f0bdc06e4a0 2024-04-26T20:57:51.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.540+0000 7f0bd9600640 1 -- 172.21.15.138:0/3204110367 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v39) ==== 170+0+0 (secure 0 0 0) 0x7f0bd00f16c0 con 0x7f0bdc06e4a0 2024-04-26T20:57:51.547 INFO:teuthology.orchestra.run.smithi138.stderr:pool 'cephfs_data' created 2024-04-26T20:57:51.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.544+0000 7f0be2800640 1 -- 172.21.15.138:0/3204110367 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0bbc068380 msgr2=0x7f0bbc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:51.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.544+0000 7f0be2800640 1 --2- 172.21.15.138:0/3204110367 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0bbc068380 0x7f0bbc06a840 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8007fd0 tx=0x7f0bc8009040 comp rx=0 tx=0).stop 2024-04-26T20:57:51.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.544+0000 7f0be2800640 1 -- 172.21.15.138:0/3204110367 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0bdc06e4a0 msgr2=0x7f0bdc155ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:51.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.544+0000 7f0be2800640 1 --2- 172.21.15.138:0/3204110367 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0bdc06e4a0 0x7f0bdc155ad0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f0bd00097f0 tx=0x7f0bd0019280 comp rx=0 tx=0).stop 2024-04-26T20:57:51.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.548+0000 7f0be2800640 1 -- 172.21.15.138:0/3204110367 shutdown_connections 2024-04-26T20:57:51.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.548+0000 7f0be2800640 1 --2- 172.21.15.138:0/3204110367 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0bbc068380 0x7f0bbc06a840 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:51.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.548+0000 7f0be2800640 1 --2- 172.21.15.138:0/3204110367 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0bdc15f600 0x7f0bdc0cc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:51.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.548+0000 7f0be2800640 1 --2- 172.21.15.138:0/3204110367 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0bdc15f220 0x7f0bdc0cc2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:51.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.548+0000 7f0be2800640 1 --2- 172.21.15.138:0/3204110367 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0bdc06e4a0 0x7f0bdc155ad0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:51.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.548+0000 7f0be2800640 1 -- 172.21.15.138:0/3204110367 >> 172.21.15.138:0/3204110367 conn(0x7f0bdc0d2d40 msgr2=0x7f0bdc160790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:51.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.548+0000 7f0be2800640 1 -- 172.21.15.138:0/3204110367 shutdown_connections 2024-04-26T20:57:51.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.548+0000 7f0be2800640 1 -- 172.21.15.138:0/3204110367 wait complete. 2024-04-26T20:57:51.591 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-26T20:57:51.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.724+0000 7ff688800640 1 Processor -- start 2024-04-26T20:57:51.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.724+0000 7ff688800640 1 -- start start 2024-04-26T20:57:51.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.724+0000 7ff688800640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff68015aa60 0x7ff6800cc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:51.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.724+0000 7ff688800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff6800cb910 0x7ff6800b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:51.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.724+0000 7ff688800640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6800cd210 con 0x7ff6800ccd20 2024-04-26T20:57:51.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.724+0000 7ff688800640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7ff68015d6a0 con 0x7ff6800cb910 2024-04-26T20:57:51.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.724+0000 7ff688800640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7ff68015d980 con 0x7ff68015aa60 2024-04-26T20:57:51.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.728+0000 7ff686800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff6800cb910 0x7ff6800b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:51.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.728+0000 7ff685e00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff68015aa60 0x7ff6800cc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:51.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.728+0000 7ff686800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff6800cb910 0x7ff6800b5aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:41068/0 (socket says 172.21.15.138:41068) 2024-04-26T20:57:51.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.728+0000 7ff686800640 1 -- 172.21.15.138:0/726296926 learned_addr learned my addr 172.21.15.138:0/726296926 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:51.733 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.728+0000 7ff686800640 1 -- 172.21.15.138:0/726296926 >> v2:172.21.15.143:3300/0 conn(0x7ff68015aa60 msgr2=0x7ff6800cc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:51.733 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.728+0000 7ff686800640 1 --2- 172.21.15.138:0/726296926 >> v2:172.21.15.143:3300/0 conn(0x7ff68015aa60 0x7ff6800cc7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:51.733 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.728+0000 7ff686800640 1 -- 172.21.15.138:0/726296926 >> v1:172.21.15.143:6789/0 conn(0x7ff6800ccd20 legacy=0x7ff6800cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:51.733 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.728+0000 7ff686800640 1 -- 172.21.15.138:0/726296926 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff68015dc60 con 0x7ff6800cb910 2024-04-26T20:57:51.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.728+0000 7ff686800640 1 --2- 172.21.15.138:0/726296926 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6800cb910 0x7ff6800b5aa0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff680076430 tx=0x7ff67c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee4881967b493f8f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:51.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.728+0000 7ff684a00640 1 -- 172.21.15.138:0/726296926 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff67c0a56c0 con 0x7ff6800cb910 2024-04-26T20:57:51.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.728+0000 7ff684a00640 1 -- 172.21.15.138:0/726296926 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff67c0a5860 con 0x7ff6800cb910 2024-04-26T20:57:51.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.728+0000 7ff684a00640 1 -- 172.21.15.138:0/726296926 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff67c0a5c30 con 0x7ff6800cb910 2024-04-26T20:57:51.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.732+0000 7ff688800640 1 -- 172.21.15.138:0/726296926 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6800cb910 msgr2=0x7ff6800b5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:51.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.732+0000 7ff688800640 1 --2- 172.21.15.138:0/726296926 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6800cb910 0x7ff6800b5aa0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff680076430 tx=0x7ff67c01c9f0 comp rx=0 tx=0).stop 2024-04-26T20:57:51.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.732+0000 7ff688800640 1 -- 172.21.15.138:0/726296926 shutdown_connections 2024-04-26T20:57:51.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.732+0000 7ff688800640 1 --2- 172.21.15.138:0/726296926 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6800cb910 0x7ff6800b5aa0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:51.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.732+0000 7ff688800640 1 --2- 172.21.15.138:0/726296926 >> v2:172.21.15.143:3300/0 conn(0x7ff68015aa60 0x7ff6800cc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:51.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.732+0000 7ff688800640 1 -- 172.21.15.138:0/726296926 >> 172.21.15.138:0/726296926 conn(0x7ff6800d0bb0 msgr2=0x7ff6800d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:51.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.732+0000 7ff688800640 1 -- 172.21.15.138:0/726296926 shutdown_connections 2024-04-26T20:57:51.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.732+0000 7ff688800640 1 -- 172.21.15.138:0/726296926 wait complete. 2024-04-26T20:57:51.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.732+0000 7ff688800640 1 Processor -- start 2024-04-26T20:57:51.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.732+0000 7ff688800640 1 -- start start 2024-04-26T20:57:51.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.732+0000 7ff688800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff6800cb910 0x7ff68014dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:51.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.732+0000 7ff688800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6800ccd20 0x7ff6801f8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:51.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.732+0000 7ff688800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff68015aa60 0x7ff68014f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:51.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.732+0000 7ff688800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff68006e0f0 con 0x7ff6800ccd20 2024-04-26T20:57:51.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.732+0000 7ff688800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ff680072240 con 0x7ff68015aa60 2024-04-26T20:57:51.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.732+0000 7ff688800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ff68006e270 con 0x7ff6800cb910 2024-04-26T20:57:51.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.732+0000 7ff685400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6800ccd20 0x7ff6801f8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:51.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.732+0000 7ff685400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6800ccd20 0x7ff6801f8750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:41084/0 (socket says 172.21.15.138:41084) 2024-04-26T20:57:51.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.732+0000 7ff685400640 1 -- 172.21.15.138:0/2150630997 learned_addr learned my addr 172.21.15.138:0/2150630997 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:51.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.732+0000 7ff685e00640 1 --2- 172.21.15.138:0/2150630997 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff6800cb910 0x7ff68014dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:51.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.732+0000 7ff686800640 1 --2- 172.21.15.138:0/2150630997 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff68015aa60 0x7ff68014f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:51.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.732+0000 7ff685400640 1 -- 172.21.15.138:0/2150630997 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff6800cb910 msgr2=0x7ff68014dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:51.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.732+0000 7ff685400640 1 --2- 172.21.15.138:0/2150630997 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff6800cb910 0x7ff68014dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:51.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.732+0000 7ff685400640 1 -- 172.21.15.138:0/2150630997 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff68015aa60 msgr2=0x7ff68014f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:51.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.732+0000 7ff685400640 1 --2- 172.21.15.138:0/2150630997 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff68015aa60 0x7ff68014f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:51.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.732+0000 7ff685400640 1 -- 172.21.15.138:0/2150630997 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6801f9180 con 0x7ff6800ccd20 2024-04-26T20:57:51.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.736+0000 7ff685400640 1 --2- 172.21.15.138:0/2150630997 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6800ccd20 0x7ff6801f8750 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff67000c430 tx=0x7ff67000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:51.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.736+0000 7ff67a000640 1 -- 172.21.15.138:0/2150630997 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6700052d0 con 0x7ff6800ccd20 2024-04-26T20:57:51.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.736+0000 7ff67a000640 1 -- 172.21.15.138:0/2150630997 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff670005470 con 0x7ff6800ccd20 2024-04-26T20:57:51.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.736+0000 7ff67a000640 1 -- 172.21.15.138:0/2150630997 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff670007260 con 0x7ff6800ccd20 2024-04-26T20:57:51.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.736+0000 7ff688800640 1 -- 172.21.15.138:0/2150630997 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6801f9460 con 0x7ff6800ccd20 2024-04-26T20:57:51.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.736+0000 7ff688800640 1 -- 172.21.15.138:0/2150630997 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff680166440 con 0x7ff6800ccd20 2024-04-26T20:57:51.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.736+0000 7ff688800640 1 -- 172.21.15.138:0/2150630997 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff680166640 con 0x7ff6800ccd20 2024-04-26T20:57:51.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.736+0000 7ff67a000640 1 -- 172.21.15.138:0/2150630997 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff670007400 con 0x7ff6800ccd20 2024-04-26T20:57:51.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.736+0000 7ff67a000640 1 --2- 172.21.15.138:0/2150630997 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff664068380 0x7ff66406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:51.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.736+0000 7ff67a000640 1 -- 172.21.15.138:0/2150630997 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6001+0+0 (secure 0 0 0) 0x7ff670085e90 con 0x7ff6800ccd20 2024-04-26T20:57:51.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.736+0000 7ff685e00640 1 --2- 172.21.15.138:0/2150630997 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff664068380 0x7ff66406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:51.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.740+0000 7ff685e00640 1 --2- 172.21.15.138:0/2150630997 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff664068380 0x7ff66406a840 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff680154130 tx=0x7ff674009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:51.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.744+0000 7ff67a000640 1 -- 172.21.15.138:0/2150630997 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff680166640 con 0x7ff6800ccd20 2024-04-26T20:57:51.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:51.932+0000 7ff688800640 1 -- 172.21.15.138:0/2150630997 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7ff680069430 con 0x7ff6800ccd20 2024-04-26T20:57:52.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.544+0000 7ff67a000640 1 -- 172.21.15.138:0/2150630997 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) ==== 172+0+0 (secure 0 0 0) 0x7ff670055d60 con 0x7ff6800ccd20 2024-04-26T20:57:52.549 INFO:teuthology.orchestra.run.smithi138.stderr:new fs with metadata pool 5 and data pool 6 2024-04-26T20:57:52.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.548+0000 7ff688800640 1 -- 172.21.15.138:0/2150630997 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff664068380 msgr2=0x7ff66406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:52.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.548+0000 7ff688800640 1 --2- 172.21.15.138:0/2150630997 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff664068380 0x7ff66406a840 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff680154130 tx=0x7ff674009190 comp rx=0 tx=0).stop 2024-04-26T20:57:52.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.548+0000 7ff688800640 1 -- 172.21.15.138:0/2150630997 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6800ccd20 msgr2=0x7ff6801f8750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:52.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.548+0000 7ff688800640 1 --2- 172.21.15.138:0/2150630997 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6800ccd20 0x7ff6801f8750 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff67000c430 tx=0x7ff67000c8f0 comp rx=0 tx=0).stop 2024-04-26T20:57:52.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.548+0000 7ff688800640 1 -- 172.21.15.138:0/2150630997 shutdown_connections 2024-04-26T20:57:52.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.548+0000 7ff688800640 1 --2- 172.21.15.138:0/2150630997 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff664068380 0x7ff66406a840 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:52.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.548+0000 7ff688800640 1 --2- 172.21.15.138:0/2150630997 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff68015aa60 0x7ff68014f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:52.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.548+0000 7ff688800640 1 --2- 172.21.15.138:0/2150630997 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6800ccd20 0x7ff6801f8750 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:52.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.548+0000 7ff688800640 1 --2- 172.21.15.138:0/2150630997 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff6800cb910 0x7ff68014dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:52.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.548+0000 7ff688800640 1 -- 172.21.15.138:0/2150630997 >> 172.21.15.138:0/2150630997 conn(0x7ff6800d0bb0 msgr2=0x7ff68015ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:52.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.548+0000 7ff688800640 1 -- 172.21.15.138:0/2150630997 shutdown_connections 2024-04-26T20:57:52.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.552+0000 7ff688800640 1 -- 172.21.15.138:0/2150630997 wait complete. 2024-04-26T20:57:52.599 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:57:52.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.732+0000 7f49f1400640 1 Processor -- start 2024-04-26T20:57:52.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.732+0000 7f49f1400640 1 -- start start 2024-04-26T20:57:52.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.732+0000 7f49f1400640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f49ec15d0f0 0x7f49ec0d1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:52.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.732+0000 7f49f1400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f49ec0d0950 0x7f49ec0d1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:52.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.732+0000 7f49f1400640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49ec0ce540 con 0x7f49ec0b2280 2024-04-26T20:57:52.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.732+0000 7f49f1400640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f49ec0d0e50 con 0x7f49ec15d0f0 2024-04-26T20:57:52.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.732+0000 7f49f1400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f49ec0b26e0 con 0x7f49ec0d0950 2024-04-26T20:57:52.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.732+0000 7f49e9e00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f49ec0b2280 0x7f49ec0cf750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:43088/0 (socket says 172.21.15.138:43088) 2024-04-26T20:57:52.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.732+0000 7f49e9e00640 1 -- 172.21.15.138:0/3211677147 learned_addr learned my addr 172.21.15.138:0/3211677147 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:52.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.732+0000 7f49ea800640 1 --2- 172.21.15.138:0/3211677147 >> v2:172.21.15.143:3300/0 conn(0x7f49ec15d0f0 0x7f49ec0d1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:52.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.732+0000 7f49eb200640 1 --2- 172.21.15.138:0/3211677147 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f49ec0d0950 0x7f49ec0d1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:52.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.732+0000 7f49e9400640 1 -- 172.21.15.138:0/3211677147 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3701331965 0 0) 0x7f49ec0ce540 con 0x7f49ec0b2280 2024-04-26T20:57:52.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.732+0000 7f49e9400640 1 -- 172.21.15.138:0/3211677147 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f49d0003530 con 0x7f49ec0b2280 2024-04-26T20:57:52.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.732+0000 7f49ea800640 1 -- 172.21.15.138:0/3211677147 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f49ec0d0950 msgr2=0x7f49ec0d1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:52.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.732+0000 7f49ea800640 1 --2- 172.21.15.138:0/3211677147 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f49ec0d0950 0x7f49ec0d1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:52.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.732+0000 7f49e9400640 1 -- 172.21.15.138:0/3211677147 <== mon.0 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1133315832 0 0) 0x7f49d0003530 con 0x7f49ec0b2280 2024-04-26T20:57:52.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.732+0000 7f49ea800640 1 -- 172.21.15.138:0/3211677147 >> v1:172.21.15.138:6789/0 conn(0x7f49ec0b2280 legacy=0x7f49ec0cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:52.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.732+0000 7f49ea800640 1 -- 172.21.15.138:0/3211677147 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49ec0ce820 con 0x7f49ec15d0f0 2024-04-26T20:57:52.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.736+0000 7f49ea800640 1 --2- 172.21.15.138:0/3211677147 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f49ec15d0f0 0x7f49ec0d1010 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f49dc0097c0 tx=0x7f49dc01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62f1ae12c5f17695 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:52.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.736+0000 7f49e9400640 1 -- 172.21.15.138:0/3211677147 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49dc0b0070 con 0x7f49ec15d0f0 2024-04-26T20:57:52.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.736+0000 7f49e9400640 1 -- 172.21.15.138:0/3211677147 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49dc0ab400 con 0x7f49ec15d0f0 2024-04-26T20:57:52.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.736+0000 7f49e9400640 1 -- 172.21.15.138:0/3211677147 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d8001680 con 0x7f49ec15d0f0 2024-04-26T20:57:52.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.736+0000 7f49f1400640 1 -- 172.21.15.138:0/3211677147 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f49ec15d0f0 msgr2=0x7f49ec0d1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:52.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.736+0000 7f49f1400640 1 --2- 172.21.15.138:0/3211677147 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f49ec15d0f0 0x7f49ec0d1010 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f49dc0097c0 tx=0x7f49dc01c3c0 comp rx=0 tx=0).stop 2024-04-26T20:57:52.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.736+0000 7f49f1400640 1 -- 172.21.15.138:0/3211677147 shutdown_connections 2024-04-26T20:57:52.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.736+0000 7f49f1400640 1 --2- 172.21.15.138:0/3211677147 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f49ec0d0950 0x7f49ec0d1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:52.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.736+0000 7f49f1400640 1 --2- 172.21.15.138:0/3211677147 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f49ec15d0f0 0x7f49ec0d1010 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:52.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.736+0000 7f49f1400640 1 -- 172.21.15.138:0/3211677147 >> 172.21.15.138:0/3211677147 conn(0x7f49ec0d2d80 msgr2=0x7f49ec0d3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:52.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.736+0000 7f49f1400640 1 -- 172.21.15.138:0/3211677147 shutdown_connections 2024-04-26T20:57:52.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.736+0000 7f49f1400640 1 -- 172.21.15.138:0/3211677147 wait complete. 2024-04-26T20:57:52.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.740+0000 7f49f1400640 1 Processor -- start 2024-04-26T20:57:52.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.740+0000 7f49f1400640 1 -- start start 2024-04-26T20:57:52.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.740+0000 7f49f1400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f49ec0b2280 0x7f49ec0c7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:52.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.740+0000 7f49f1400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f49ec0d0950 0x7f49ec15bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:52.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.740+0000 7f49f1400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49ec15d0f0 0x7f49ec0cb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:52.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.740+0000 7f49f1400640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f49ec16a040 con 0x7f49ec15d0f0 2024-04-26T20:57:52.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.740+0000 7f49f1400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f49ec169ec0 con 0x7f49ec0d0950 2024-04-26T20:57:52.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.740+0000 7f49f1400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f49ec16a1c0 con 0x7f49ec0b2280 2024-04-26T20:57:52.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.740+0000 7f49eb200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49ec15d0f0 0x7f49ec0cb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:52.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.740+0000 7f49eb200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49ec15d0f0 0x7f49ec0cb6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:41088/0 (socket says 172.21.15.138:41088) 2024-04-26T20:57:52.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.740+0000 7f49eb200640 1 -- 172.21.15.138:0/2482754890 learned_addr learned my addr 172.21.15.138:0/2482754890 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:52.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.740+0000 7f49e9e00640 1 --2- 172.21.15.138:0/2482754890 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f49ec0d0950 0x7f49ec15bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:52.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.740+0000 7f49ea800640 1 --2- 172.21.15.138:0/2482754890 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f49ec0b2280 0x7f49ec0c7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:52.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.740+0000 7f49eb200640 1 -- 172.21.15.138:0/2482754890 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f49ec0b2280 msgr2=0x7f49ec0c7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:52.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.740+0000 7f49eb200640 1 --2- 172.21.15.138:0/2482754890 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f49ec0b2280 0x7f49ec0c7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:52.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.740+0000 7f49eb200640 1 -- 172.21.15.138:0/2482754890 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f49ec0d0950 msgr2=0x7f49ec15bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:52.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.740+0000 7f49eb200640 1 --2- 172.21.15.138:0/2482754890 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f49ec0d0950 0x7f49ec15bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:52.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.740+0000 7f49eb200640 1 -- 172.21.15.138:0/2482754890 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49ec0c6910 con 0x7f49ec15d0f0 2024-04-26T20:57:52.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.740+0000 7f49eb200640 1 --2- 172.21.15.138:0/2482754890 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49ec15d0f0 0x7f49ec0cb6a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f49e4009e30 tx=0x7f49e400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:52.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.740+0000 7f49e2a00640 1 -- 172.21.15.138:0/2482754890 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e4018020 con 0x7f49ec15d0f0 2024-04-26T20:57:52.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.740+0000 7f49e2a00640 1 -- 172.21.15.138:0/2482754890 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49e4014480 con 0x7f49ec15d0f0 2024-04-26T20:57:52.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.740+0000 7f49f1400640 1 -- 172.21.15.138:0/2482754890 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49ec0c6bf0 con 0x7f49ec15d0f0 2024-04-26T20:57:52.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.740+0000 7f49e2a00640 1 -- 172.21.15.138:0/2482754890 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e4014870 con 0x7f49ec15d0f0 2024-04-26T20:57:52.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.740+0000 7f49f1400640 1 -- 172.21.15.138:0/2482754890 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49ec157620 con 0x7f49ec15d0f0 2024-04-26T20:57:52.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.744+0000 7f49f1400640 1 -- 172.21.15.138:0/2482754890 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49ec069510 con 0x7f49ec15d0f0 2024-04-26T20:57:52.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.744+0000 7f49e2a00640 1 -- 172.21.15.138:0/2482754890 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f49e401b020 con 0x7f49ec15d0f0 2024-04-26T20:57:52.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.744+0000 7f49e2a00640 1 --2- 172.21.15.138:0/2482754890 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f49cc068380 0x7f49cc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:52.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.744+0000 7f49e2a00640 1 -- 172.21.15.138:0/2482754890 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f49e4087910 con 0x7f49ec15d0f0 2024-04-26T20:57:52.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.744+0000 7f49ea800640 1 --2- 172.21.15.138:0/2482754890 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f49cc068380 0x7f49cc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:52.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.744+0000 7f49ea800640 1 --2- 172.21.15.138:0/2482754890 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f49cc068380 0x7f49cc06a840 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f49dc0ad000 tx=0x7f49dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:52.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.748+0000 7f49e2a00640 1 -- 172.21.15.138:0/2482754890 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f49e4022030 con 0x7f49ec15d0f0 2024-04-26T20:57:52.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.908+0000 7f49f1400640 1 -- 172.21.15.138:0/2482754890 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f49ec0b88a0 con 0x7f49ec15d0f0 2024-04-26T20:57:52.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.908+0000 7f49e2a00640 1 -- 172.21.15.138:0/2482754890 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+17015 (secure 0 0 0) 0x7f49e4010040 con 0x7f49ec15d0f0 2024-04-26T20:57:52.916 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:57:52.916 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":40,"fsid":"c22b4730-12cc-4558-8535-b965384398c0","created":"2024-04-26T20:56:14.182475+0000","modified":"2024-04-26T20:57:51.937823+0000","last_up_change":"2024-04-26T20:56:26.013243+0000","last_in_change":"2024-04-26T20:56:16.714055+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:56:27.265834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:57:49.597600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-26T20:57:50.901951+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3f9a2e34-3199-466f-a6cf-57927318121e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6801","nonce":3534772245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6803","nonce":3534772245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6807","nonce":3534772245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6805","nonce":3534772245}]},"public_addr":"172.21.15.138:6801/3534772245","cluster_addr":"172.21.15.138:6803/3534772245","heartbeat_back_addr":"172.21.15.138:6807/3534772245","heartbeat_front_addr":"172.21.15.138:6805/3534772245","state":["exists","up"]},{"osd":1,"uuid":"e881fcf6-3248-4696-a2ef-95d206d77712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6817","nonce":1427635773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6819","nonce":1427635773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6823","nonce":1427635773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6821","nonce":1427635773}]},"public_addr":"172.21.15.138:6817/1427635773","cluster_addr":"172.21.15.138:6819/1427635773","heartbeat_back_addr":"172.21.15.138:6823/1427635773","heartbeat_front_addr":"172.21.15.138:6821/1427635773","state":["exists","up"]},{"osd":2,"uuid":"f7d1db33-7672-4699-ae47-9f1e0a8e4222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6809","nonce":4273721573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6811","nonce":4273721573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6815","nonce":4273721573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6813","nonce":4273721573}]},"public_addr":"172.21.15.138:6809/4273721573","cluster_addr":"172.21.15.138:6811/4273721573","heartbeat_back_addr":"172.21.15.138:6815/4273721573","heartbeat_front_addr":"172.21.15.138:6813/4273721573","state":["exists","up"]},{"osd":3,"uuid":"2f4e0a9a-b8f6-4468-844a-a4501cd85054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6825","nonce":3098242154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6827","nonce":3098242154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6831","nonce":3098242154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6829","nonce":3098242154}]},"public_addr":"172.21.15.138:6825/3098242154","cluster_addr":"172.21.15.138:6827/3098242154","heartbeat_back_addr":"172.21.15.138:6831/3098242154","heartbeat_front_addr":"172.21.15.138:6829/3098242154","state":["exists","up"]},{"osd":4,"uuid":"c85df99b-3624-410e-866b-86830af2cfe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6801","nonce":2942056312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6803","nonce":2942056312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6807","nonce":2942056312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6805","nonce":2942056312}]},"public_addr":"172.21.15.143:6801/2942056312","cluster_addr":"172.21.15.143:6803/2942056312","heartbeat_back_addr":"172.21.15.143:6807/2942056312","heartbeat_front_addr":"172.21.15.143:6805/2942056312","state":["exists","up"]},{"osd":5,"uuid":"9af1efb5-c416-4808-b5ef-de0679ab9705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6809","nonce":1910222887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6811","nonce":1910222887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6815","nonce":1910222887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6813","nonce":1910222887}]},"public_addr":"172.21.15.143:6809/1910222887","cluster_addr":"172.21.15.143:6811/1910222887","heartbeat_back_addr":"172.21.15.143:6815/1910222887","heartbeat_front_addr":"172.21.15.143:6813/1910222887","state":["exists","up"]},{"osd":6,"uuid":"d7138615-8838-45ff-9072-2fd0683362f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6817","nonce":1082239825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6819","nonce":1082239825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6823","nonce":1082239825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6821","nonce":1082239825}]},"public_addr":"172.21.15.143:6817/1082239825","cluster_addr":"172.21.15.143:6819/1082239825","heartbeat_back_addr":"172.21.15.143:6823/1082239825","heartbeat_front_addr":"172.21.15.143:6821/1082239825","state":["exists","up"]},{"osd":7,"uuid":"0c27172b-35c4-49ec-ba0b-0137b8ff0010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6825","nonce":3295508495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6827","nonce":3295508495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6831","nonce":3295508495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6829","nonce":3295508495}]},"public_addr":"172.21.15.143:6825/3295508495","cluster_addr":"172.21.15.143:6827/3295508495","heartbeat_back_addr":"172.21.15.143:6831/3295508495","heartbeat_front_addr":"172.21.15.143:6829/3295508495","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.326627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.396119+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.433915+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.414179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.216947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.329272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.503073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.436382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:57:52.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.912+0000 7f49f1400640 1 -- 172.21.15.138:0/2482754890 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f49cc068380 msgr2=0x7f49cc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:52.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.912+0000 7f49f1400640 1 --2- 172.21.15.138:0/2482754890 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f49cc068380 0x7f49cc06a840 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f49dc0ad000 tx=0x7f49dc008040 comp rx=0 tx=0).stop 2024-04-26T20:57:52.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.912+0000 7f49f1400640 1 -- 172.21.15.138:0/2482754890 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49ec15d0f0 msgr2=0x7f49ec0cb6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:52.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.912+0000 7f49f1400640 1 --2- 172.21.15.138:0/2482754890 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49ec15d0f0 0x7f49ec0cb6a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f49e4009e30 tx=0x7f49e400c490 comp rx=0 tx=0).stop 2024-04-26T20:57:52.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.912+0000 7f49f1400640 1 -- 172.21.15.138:0/2482754890 shutdown_connections 2024-04-26T20:57:52.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.912+0000 7f49f1400640 1 --2- 172.21.15.138:0/2482754890 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f49cc068380 0x7f49cc06a840 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:52.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.912+0000 7f49f1400640 1 --2- 172.21.15.138:0/2482754890 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49ec15d0f0 0x7f49ec0cb6a0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:52.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.912+0000 7f49f1400640 1 --2- 172.21.15.138:0/2482754890 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f49ec0d0950 0x7f49ec15bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:52.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.912+0000 7f49f1400640 1 --2- 172.21.15.138:0/2482754890 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f49ec0b2280 0x7f49ec0c7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:52.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.912+0000 7f49f1400640 1 -- 172.21.15.138:0/2482754890 >> 172.21.15.138:0/2482754890 conn(0x7f49ec0d2d80 msgr2=0x7f49ec06e730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:52.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.912+0000 7f49f1400640 1 -- 172.21.15.138:0/2482754890 shutdown_connections 2024-04-26T20:57:52.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:52.912+0000 7f49f1400640 1 -- 172.21.15.138:0/2482754890 wait complete. 2024-04-26T20:57:52.937 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:57:53.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.068+0000 7f4cd2e00640 1 Processor -- start 2024-04-26T20:57:53.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.068+0000 7f4cd2e00640 1 -- start start 2024-04-26T20:57:53.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.068+0000 7f4cd2e00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4ccc15ce20 0x7f4ccc161340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:53.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.068+0000 7f4cd2e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4ccc15e0c0 0x7f4ccc071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:53.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.068+0000 7f4cd2e00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ccc073b70 con 0x7f4ccc0cca00 2024-04-26T20:57:53.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.068+0000 7f4cd2e00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f4ccc073e10 con 0x7f4ccc15e0c0 2024-04-26T20:57:53.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.068+0000 7f4cd2e00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f4ccc0740f0 con 0x7f4ccc15ce20 2024-04-26T20:57:53.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.068+0000 7f4cc3400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4ccc15e0c0 0x7f4ccc071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:53.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.068+0000 7f4cd0e00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f4ccc0cca00 0x7f4ccc0cce20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:43102/0 (socket says 172.21.15.138:43102) 2024-04-26T20:57:53.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.068+0000 7f4cd0e00640 1 -- 172.21.15.138:0/13016469 learned_addr learned my addr 172.21.15.138:0/13016469 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:53.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.068+0000 7f4ccbe00640 1 --2- 172.21.15.138:0/13016469 >> v2:172.21.15.143:3300/0 conn(0x7f4ccc15ce20 0x7f4ccc161340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:53.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.068+0000 7f4cc3400640 1 -- 172.21.15.138:0/13016469 >> v2:172.21.15.143:3300/0 conn(0x7f4ccc15ce20 msgr2=0x7f4ccc161340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:53.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.068+0000 7f4cc3400640 1 --2- 172.21.15.138:0/13016469 >> v2:172.21.15.143:3300/0 conn(0x7f4ccc15ce20 0x7f4ccc161340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:53.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.068+0000 7f4cc3400640 1 -- 172.21.15.138:0/13016469 >> v1:172.21.15.138:6789/0 conn(0x7f4ccc0cca00 legacy=0x7f4ccc0cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:53.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.068+0000 7f4cc3400640 1 -- 172.21.15.138:0/13016469 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ccc160b40 con 0x7f4ccc15e0c0 2024-04-26T20:57:53.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.068+0000 7f4ccb400640 1 -- 172.21.15.138:0/13016469 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 449356438 0 0) 0x7f4ccc073b70 con 0x7f4ccc0cca00 2024-04-26T20:57:53.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.068+0000 7f4ccbe00640 1 --2- 172.21.15.138:0/13016469 >> v2:172.21.15.143:3300/0 conn(0x7f4ccc15ce20 0x7f4ccc161340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:57:53.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.072+0000 7f4cc3400640 1 --2- 172.21.15.138:0/13016469 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ccc15e0c0 0x7f4ccc071ee0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc074390 tx=0x7f4cb401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf28589e67058a96 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:53.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.072+0000 7f4ccb400640 1 -- 172.21.15.138:0/13016469 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb40b0070 con 0x7f4ccc15e0c0 2024-04-26T20:57:53.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.072+0000 7f4ccb400640 1 -- 172.21.15.138:0/13016469 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cb40ab600 con 0x7f4ccc15e0c0 2024-04-26T20:57:53.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.072+0000 7f4ccb400640 1 -- 172.21.15.138:0/13016469 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb40ab9d0 con 0x7f4ccc15e0c0 2024-04-26T20:57:53.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.072+0000 7f4cd2e00640 1 -- 172.21.15.138:0/13016469 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ccc15e0c0 msgr2=0x7f4ccc071ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:53.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.072+0000 7f4cd2e00640 1 --2- 172.21.15.138:0/13016469 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ccc15e0c0 0x7f4ccc071ee0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc074390 tx=0x7f4cb401c450 comp rx=0 tx=0).stop 2024-04-26T20:57:53.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.072+0000 7f4cd2e00640 1 -- 172.21.15.138:0/13016469 shutdown_connections 2024-04-26T20:57:53.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.072+0000 7f4cd2e00640 1 --2- 172.21.15.138:0/13016469 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ccc15e0c0 0x7f4ccc071ee0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:53.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.072+0000 7f4cd2e00640 1 --2- 172.21.15.138:0/13016469 >> v2:172.21.15.143:3300/0 conn(0x7f4ccc15ce20 0x7f4ccc161340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:53.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.072+0000 7f4cd2e00640 1 -- 172.21.15.138:0/13016469 >> 172.21.15.138:0/13016469 conn(0x7f4ccc0d0b20 msgr2=0x7f4ccc0d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:53.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.072+0000 7f4cd2e00640 1 -- 172.21.15.138:0/13016469 shutdown_connections 2024-04-26T20:57:53.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.072+0000 7f4cd2e00640 1 -- 172.21.15.138:0/13016469 wait complete. 2024-04-26T20:57:53.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.072+0000 7f4cd2e00640 1 Processor -- start 2024-04-26T20:57:53.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.076+0000 7f4cd2e00640 1 -- start start 2024-04-26T20:57:53.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.076+0000 7f4cd2e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ccc0cca00 0x7f4ccc0ca470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:53.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.076+0000 7f4cd2e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ccc15ce20 0x7f4ccc155700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:53.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.076+0000 7f4cd2e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4ccc15e0c0 0x7f4ccc0ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:53.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.076+0000 7f4cd2e00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f4ccc15d380 con 0x7f4ccc0cca00 2024-04-26T20:57:53.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.076+0000 7f4cd2e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f4ccc15d200 con 0x7f4ccc15ce20 2024-04-26T20:57:53.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.076+0000 7f4cd2e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f4ccc06e680 con 0x7f4ccc15e0c0 2024-04-26T20:57:53.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.076+0000 7f4ccbe00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ccc0cca00 0x7f4ccc0ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:53.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.076+0000 7f4ccbe00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ccc0cca00 0x7f4ccc0ca470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:41110/0 (socket says 172.21.15.138:41110) 2024-04-26T20:57:53.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.076+0000 7f4ccbe00640 1 -- 172.21.15.138:0/3118444260 learned_addr learned my addr 172.21.15.138:0/3118444260 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:53.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.076+0000 7f4ccbe00640 1 -- 172.21.15.138:0/3118444260 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4ccc15e0c0 msgr2=0x7f4ccc0ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:53.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.076+0000 7f4ccbe00640 1 --2- 172.21.15.138:0/3118444260 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4ccc15e0c0 0x7f4ccc0ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:53.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.076+0000 7f4ccbe00640 1 -- 172.21.15.138:0/3118444260 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ccc15ce20 msgr2=0x7f4ccc155700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:53.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.076+0000 7f4cc3400640 1 --2- 172.21.15.138:0/3118444260 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ccc15ce20 0x7f4ccc155700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:53.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.076+0000 7f4ccbe00640 1 --2- 172.21.15.138:0/3118444260 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ccc15ce20 0x7f4ccc155700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:53.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.076+0000 7f4ccbe00640 1 -- 172.21.15.138:0/3118444260 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ccc0c99d0 con 0x7f4ccc0cca00 2024-04-26T20:57:53.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.076+0000 7f4cc3400640 1 --2- 172.21.15.138:0/3118444260 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ccc15ce20 0x7f4ccc155700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:57:53.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.076+0000 7f4ccbe00640 1 --2- 172.21.15.138:0/3118444260 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ccc0cca00 0x7f4ccc0ca470 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc00c7c0 tx=0x7f4cbc00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:53.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.076+0000 7f4cc8c00640 1 -- 172.21.15.138:0/3118444260 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc007a30 con 0x7f4ccc0cca00 2024-04-26T20:57:53.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.076+0000 7f4cc8c00640 1 -- 172.21.15.138:0/3118444260 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cbc007bd0 con 0x7f4ccc0cca00 2024-04-26T20:57:53.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.076+0000 7f4cd2e00640 1 -- 172.21.15.138:0/3118444260 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ccc0c8290 con 0x7f4ccc0cca00 2024-04-26T20:57:53.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.076+0000 7f4cc8c00640 1 -- 172.21.15.138:0/3118444260 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc0113f0 con 0x7f4ccc0cca00 2024-04-26T20:57:53.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.076+0000 7f4cd2e00640 1 -- 172.21.15.138:0/3118444260 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ccc0c9f50 con 0x7f4ccc0cca00 2024-04-26T20:57:53.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.076+0000 7f4cd2e00640 1 -- 172.21.15.138:0/3118444260 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ccc069510 con 0x7f4ccc0cca00 2024-04-26T20:57:53.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.080+0000 7f4cc8c00640 1 -- 172.21.15.138:0/3118444260 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4cbc011590 con 0x7f4ccc0cca00 2024-04-26T20:57:53.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.080+0000 7f4cc8c00640 1 --2- 172.21.15.138:0/3118444260 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4ca8068380 0x7f4ca806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:53.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.080+0000 7f4cc8c00640 1 -- 172.21.15.138:0/3118444260 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f4cbc087180 con 0x7f4ccc0cca00 2024-04-26T20:57:53.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.080+0000 7f4cc3400640 1 --2- 172.21.15.138:0/3118444260 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4ca8068380 0x7f4ca806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:53.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.080+0000 7f4cc3400640 1 --2- 172.21.15.138:0/3118444260 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4ca8068380 0x7f4ca806a840 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4cb40ad000 tx=0x7f4cb4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:53.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.084+0000 7f4cc8c00640 1 -- 172.21.15.138:0/3118444260 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4cbc015020 con 0x7f4ccc0cca00 2024-04-26T20:57:53.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.240+0000 7f4cd2e00640 1 -- 172.21.15.138:0/3118444260 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4ccc15c5e0 con 0x7f4ccc0cca00 2024-04-26T20:57:53.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.240+0000 7f4cc8c00640 1 -- 172.21.15.138:0/3118444260 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+17015 (secure 0 0 0) 0x7f4cbc057620 con 0x7f4ccc0cca00 2024-04-26T20:57:53.247 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:57:53.247 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":40,"fsid":"c22b4730-12cc-4558-8535-b965384398c0","created":"2024-04-26T20:56:14.182475+0000","modified":"2024-04-26T20:57:51.937823+0000","last_up_change":"2024-04-26T20:56:26.013243+0000","last_in_change":"2024-04-26T20:56:16.714055+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:56:27.265834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:57:49.597600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-26T20:57:50.901951+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3f9a2e34-3199-466f-a6cf-57927318121e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6801","nonce":3534772245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6803","nonce":3534772245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6807","nonce":3534772245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6805","nonce":3534772245}]},"public_addr":"172.21.15.138:6801/3534772245","cluster_addr":"172.21.15.138:6803/3534772245","heartbeat_back_addr":"172.21.15.138:6807/3534772245","heartbeat_front_addr":"172.21.15.138:6805/3534772245","state":["exists","up"]},{"osd":1,"uuid":"e881fcf6-3248-4696-a2ef-95d206d77712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6817","nonce":1427635773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6819","nonce":1427635773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6823","nonce":1427635773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6821","nonce":1427635773}]},"public_addr":"172.21.15.138:6817/1427635773","cluster_addr":"172.21.15.138:6819/1427635773","heartbeat_back_addr":"172.21.15.138:6823/1427635773","heartbeat_front_addr":"172.21.15.138:6821/1427635773","state":["exists","up"]},{"osd":2,"uuid":"f7d1db33-7672-4699-ae47-9f1e0a8e4222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6809","nonce":4273721573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6811","nonce":4273721573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6815","nonce":4273721573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6813","nonce":4273721573}]},"public_addr":"172.21.15.138:6809/4273721573","cluster_addr":"172.21.15.138:6811/4273721573","heartbeat_back_addr":"172.21.15.138:6815/4273721573","heartbeat_front_addr":"172.21.15.138:6813/4273721573","state":["exists","up"]},{"osd":3,"uuid":"2f4e0a9a-b8f6-4468-844a-a4501cd85054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6825","nonce":3098242154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6827","nonce":3098242154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6831","nonce":3098242154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6829","nonce":3098242154}]},"public_addr":"172.21.15.138:6825/3098242154","cluster_addr":"172.21.15.138:6827/3098242154","heartbeat_back_addr":"172.21.15.138:6831/3098242154","heartbeat_front_addr":"172.21.15.138:6829/3098242154","state":["exists","up"]},{"osd":4,"uuid":"c85df99b-3624-410e-866b-86830af2cfe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6801","nonce":2942056312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6803","nonce":2942056312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6807","nonce":2942056312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6805","nonce":2942056312}]},"public_addr":"172.21.15.143:6801/2942056312","cluster_addr":"172.21.15.143:6803/2942056312","heartbeat_back_addr":"172.21.15.143:6807/2942056312","heartbeat_front_addr":"172.21.15.143:6805/2942056312","state":["exists","up"]},{"osd":5,"uuid":"9af1efb5-c416-4808-b5ef-de0679ab9705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6809","nonce":1910222887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6811","nonce":1910222887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6815","nonce":1910222887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6813","nonce":1910222887}]},"public_addr":"172.21.15.143:6809/1910222887","cluster_addr":"172.21.15.143:6811/1910222887","heartbeat_back_addr":"172.21.15.143:6815/1910222887","heartbeat_front_addr":"172.21.15.143:6813/1910222887","state":["exists","up"]},{"osd":6,"uuid":"d7138615-8838-45ff-9072-2fd0683362f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6817","nonce":1082239825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6819","nonce":1082239825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6823","nonce":1082239825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6821","nonce":1082239825}]},"public_addr":"172.21.15.143:6817/1082239825","cluster_addr":"172.21.15.143:6819/1082239825","heartbeat_back_addr":"172.21.15.143:6823/1082239825","heartbeat_front_addr":"172.21.15.143:6821/1082239825","state":["exists","up"]},{"osd":7,"uuid":"0c27172b-35c4-49ec-ba0b-0137b8ff0010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6825","nonce":3295508495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6827","nonce":3295508495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6831","nonce":3295508495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6829","nonce":3295508495}]},"public_addr":"172.21.15.143:6825/3295508495","cluster_addr":"172.21.15.143:6827/3295508495","heartbeat_back_addr":"172.21.15.143:6831/3295508495","heartbeat_front_addr":"172.21.15.143:6829/3295508495","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.326627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.396119+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.433915+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.414179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.216947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.329272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.503073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.436382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:57:53.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.244+0000 7f4cd2e00640 1 -- 172.21.15.138:0/3118444260 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4ca8068380 msgr2=0x7f4ca806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:53.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.244+0000 7f4cd2e00640 1 --2- 172.21.15.138:0/3118444260 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4ca8068380 0x7f4ca806a840 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4cb40ad000 tx=0x7f4cb4008040 comp rx=0 tx=0).stop 2024-04-26T20:57:53.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.244+0000 7f4cd2e00640 1 -- 172.21.15.138:0/3118444260 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ccc0cca00 msgr2=0x7f4ccc0ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:53.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.244+0000 7f4cd2e00640 1 --2- 172.21.15.138:0/3118444260 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ccc0cca00 0x7f4ccc0ca470 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc00c7c0 tx=0x7f4cbc00cc80 comp rx=0 tx=0).stop 2024-04-26T20:57:53.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.244+0000 7f4cd2e00640 1 -- 172.21.15.138:0/3118444260 shutdown_connections 2024-04-26T20:57:53.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.244+0000 7f4cd2e00640 1 --2- 172.21.15.138:0/3118444260 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4ca8068380 0x7f4ca806a840 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:53.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.244+0000 7f4cd2e00640 1 --2- 172.21.15.138:0/3118444260 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4ccc15e0c0 0x7f4ccc0ce6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:53.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.244+0000 7f4cd2e00640 1 --2- 172.21.15.138:0/3118444260 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ccc15ce20 0x7f4ccc155700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:53.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.244+0000 7f4cd2e00640 1 --2- 172.21.15.138:0/3118444260 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ccc0cca00 0x7f4ccc0ca470 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:53.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.244+0000 7f4cd2e00640 1 -- 172.21.15.138:0/3118444260 >> 172.21.15.138:0/3118444260 conn(0x7f4ccc0d0b20 msgr2=0x7f4ccc15ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:53.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.244+0000 7f4cd2e00640 1 -- 172.21.15.138:0/3118444260 shutdown_connections 2024-04-26T20:57:53.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.244+0000 7f4cd2e00640 1 -- 172.21.15.138:0/3118444260 wait complete. 2024-04-26T20:57:53.269 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-26T20:57:53.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.400+0000 7fe94ae00640 1 Processor -- start 2024-04-26T20:57:53.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.400+0000 7fe94ae00640 1 -- start start 2024-04-26T20:57:53.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.404+0000 7fe94ae00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe94415e180 0x7fe9440cb200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:53.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.404+0000 7fe94ae00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9440cd210 con 0x7fe9440cb740 2024-04-26T20:57:53.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.404+0000 7fe94ae00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe94415d6a0 con 0x7fe94415aa60 2024-04-26T20:57:53.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.404+0000 7fe94ae00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fe94415d980 con 0x7fe94415e180 2024-04-26T20:57:53.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.404+0000 7fe943400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe94415e180 0x7fe9440cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:53.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.404+0000 7fe948e00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fe9440cb740 0x7fe9440b5aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:43110/0 (socket says 172.21.15.138:43110) 2024-04-26T20:57:53.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.404+0000 7fe948e00640 1 -- 172.21.15.138:0/2895066873 learned_addr learned my addr 172.21.15.138:0/2895066873 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:53.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.404+0000 7fe943400640 1 -- 172.21.15.138:0/2895066873 >> v1:172.21.15.143:6789/0 conn(0x7fe94415aa60 legacy=0x7fe9440cc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:53.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.404+0000 7fe943400640 1 -- 172.21.15.138:0/2895066873 >> v1:172.21.15.138:6789/0 conn(0x7fe9440cb740 legacy=0x7fe9440b5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:53.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.404+0000 7fe943400640 1 -- 172.21.15.138:0/2895066873 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe94415dc60 con 0x7fe94415e180 2024-04-26T20:57:53.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.404+0000 7fe942a00640 1 -- 172.21.15.138:0/2895066873 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3492918264 0 0) 0x7fe9440cd210 con 0x7fe9440cb740 2024-04-26T20:57:53.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.408+0000 7fe943400640 1 --2- 172.21.15.138:0/2895066873 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe94415e180 0x7fe9440cb200 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fe9300097c0 tx=0x7fe93001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f7a60a9b8d857ad server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:53.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.408+0000 7fe942a00640 1 -- 172.21.15.138:0/2895066873 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9300b0070 con 0x7fe94415e180 2024-04-26T20:57:53.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.408+0000 7fe942a00640 1 -- 172.21.15.138:0/2895066873 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9300ab600 con 0x7fe94415e180 2024-04-26T20:57:53.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.408+0000 7fe942a00640 1 -- 172.21.15.138:0/2895066873 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9300ab9d0 con 0x7fe94415e180 2024-04-26T20:57:53.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.408+0000 7fe94ae00640 1 -- 172.21.15.138:0/2895066873 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe94415e180 msgr2=0x7fe9440cb200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:53.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.408+0000 7fe94ae00640 1 --2- 172.21.15.138:0/2895066873 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe94415e180 0x7fe9440cb200 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fe9300097c0 tx=0x7fe93001c460 comp rx=0 tx=0).stop 2024-04-26T20:57:53.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.408+0000 7fe94ae00640 1 -- 172.21.15.138:0/2895066873 shutdown_connections 2024-04-26T20:57:53.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.408+0000 7fe94ae00640 1 --2- 172.21.15.138:0/2895066873 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe94415e180 0x7fe9440cb200 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:53.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.408+0000 7fe94ae00640 1 -- 172.21.15.138:0/2895066873 >> 172.21.15.138:0/2895066873 conn(0x7fe9440d0bb0 msgr2=0x7fe9440d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:53.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.408+0000 7fe94ae00640 1 -- 172.21.15.138:0/2895066873 shutdown_connections 2024-04-26T20:57:53.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.408+0000 7fe94ae00640 1 -- 172.21.15.138:0/2895066873 wait complete. 2024-04-26T20:57:53.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.408+0000 7fe94ae00640 1 Processor -- start 2024-04-26T20:57:53.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.408+0000 7fe94ae00640 1 -- start start 2024-04-26T20:57:53.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.412+0000 7fe94ae00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe9440cb740 0x7fe9440c5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:53.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.412+0000 7fe94ae00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe94415aa60 0x7fe944155980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:53.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.412+0000 7fe94ae00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe944156100 0x7fe9440b4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:53.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.412+0000 7fe94ae00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe944072030 con 0x7fe94415aa60 2024-04-26T20:57:53.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.412+0000 7fe94ae00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fe9440cbb90 con 0x7fe944156100 2024-04-26T20:57:53.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.412+0000 7fe94ae00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fe9440721b0 con 0x7fe9440cb740 2024-04-26T20:57:53.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.412+0000 7fe943400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe94415aa60 0x7fe944155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:53.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.412+0000 7fe943400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe94415aa60 0x7fe944155980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:41126/0 (socket says 172.21.15.138:41126) 2024-04-26T20:57:53.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.412+0000 7fe943400640 1 -- 172.21.15.138:0/557588092 learned_addr learned my addr 172.21.15.138:0/557588092 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:53.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.412+0000 7fe948e00640 1 --2- 172.21.15.138:0/557588092 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe944156100 0x7fe9440b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:53.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.412+0000 7fe943e00640 1 --2- 172.21.15.138:0/557588092 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe9440cb740 0x7fe9440c5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:53.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.412+0000 7fe943400640 1 -- 172.21.15.138:0/557588092 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe9440cb740 msgr2=0x7fe9440c5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:53.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.412+0000 7fe943400640 1 --2- 172.21.15.138:0/557588092 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe9440cb740 0x7fe9440c5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:53.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.412+0000 7fe943400640 1 -- 172.21.15.138:0/557588092 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe944156100 msgr2=0x7fe9440b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:53.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.412+0000 7fe943400640 1 --2- 172.21.15.138:0/557588092 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe944156100 0x7fe9440b4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:53.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.412+0000 7fe943400640 1 -- 172.21.15.138:0/557588092 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe944155ec0 con 0x7fe94415aa60 2024-04-26T20:57:53.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.412+0000 7fe943400640 1 --2- 172.21.15.138:0/557588092 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe94415aa60 0x7fe944155980 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe9300ae040 tx=0x7fe93001aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:53.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.412+0000 7fe93be00640 1 -- 172.21.15.138:0/557588092 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9300b0050 con 0x7fe94415aa60 2024-04-26T20:57:53.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.412+0000 7fe93be00640 1 -- 172.21.15.138:0/557588092 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9300b1040 con 0x7fe94415aa60 2024-04-26T20:57:53.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.412+0000 7fe94ae00640 1 -- 172.21.15.138:0/557588092 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9440c63a0 con 0x7fe94415aa60 2024-04-26T20:57:53.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.412+0000 7fe93be00640 1 -- 172.21.15.138:0/557588092 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe930004220 con 0x7fe94415aa60 2024-04-26T20:57:53.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.412+0000 7fe94ae00640 1 -- 172.21.15.138:0/557588092 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9440c6960 con 0x7fe94415aa60 2024-04-26T20:57:53.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.412+0000 7fe94ae00640 1 -- 172.21.15.138:0/557588092 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe944069430 con 0x7fe94415aa60 2024-04-26T20:57:53.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.412+0000 7fe93be00640 1 -- 172.21.15.138:0/557588092 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe9300be060 con 0x7fe94415aa60 2024-04-26T20:57:53.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.416+0000 7fe93be00640 1 --2- 172.21.15.138:0/557588092 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe924068380 0x7fe92406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:53.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.416+0000 7fe93be00640 1 -- 172.21.15.138:0/557588092 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fe9301204b0 con 0x7fe94415aa60 2024-04-26T20:57:53.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.416+0000 7fe943e00640 1 --2- 172.21.15.138:0/557588092 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe924068380 0x7fe92406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:53.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.416+0000 7fe943e00640 1 --2- 172.21.15.138:0/557588092 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe924068380 0x7fe92406a840 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe934004e30 tx=0x7fe934009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:53.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.420+0000 7fe93be00640 1 -- 172.21.15.138:0/557588092 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe930016050 con 0x7fe94415aa60 2024-04-26T20:57:53.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:53.616+0000 7fe94ae00640 1 -- 172.21.15.138:0/557588092 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fe94406fbd0 con 0x7fe94415aa60 2024-04-26T20:57:54.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.576+0000 7fe93be00640 1 -- 172.21.15.138:0/557588092 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7fe9300f0970 con 0x7fe94415aa60 2024-04-26T20:57:54.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.576+0000 7fe94ae00640 1 -- 172.21.15.138:0/557588092 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe924068380 msgr2=0x7fe92406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:54.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.576+0000 7fe94ae00640 1 --2- 172.21.15.138:0/557588092 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe924068380 0x7fe92406a840 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe934004e30 tx=0x7fe934009040 comp rx=0 tx=0).stop 2024-04-26T20:57:54.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.576+0000 7fe94ae00640 1 -- 172.21.15.138:0/557588092 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe94415aa60 msgr2=0x7fe944155980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:54.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.576+0000 7fe94ae00640 1 --2- 172.21.15.138:0/557588092 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe94415aa60 0x7fe944155980 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe9300ae040 tx=0x7fe93001aca0 comp rx=0 tx=0).stop 2024-04-26T20:57:54.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.576+0000 7fe94ae00640 1 -- 172.21.15.138:0/557588092 shutdown_connections 2024-04-26T20:57:54.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.576+0000 7fe94ae00640 1 --2- 172.21.15.138:0/557588092 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe924068380 0x7fe92406a840 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:54.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.576+0000 7fe94ae00640 1 --2- 172.21.15.138:0/557588092 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe944156100 0x7fe9440b4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:54.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.576+0000 7fe94ae00640 1 --2- 172.21.15.138:0/557588092 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe94415aa60 0x7fe944155980 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:54.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.576+0000 7fe94ae00640 1 --2- 172.21.15.138:0/557588092 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe9440cb740 0x7fe9440c5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:54.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.576+0000 7fe94ae00640 1 -- 172.21.15.138:0/557588092 >> 172.21.15.138:0/557588092 conn(0x7fe9440d0bb0 msgr2=0x7fe9440b06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:54.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.576+0000 7fe94ae00640 1 -- 172.21.15.138:0/557588092 shutdown_connections 2024-04-26T20:57:54.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.576+0000 7fe94ae00640 1 -- 172.21.15.138:0/557588092 wait complete. 2024-04-26T20:57:54.605 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-26T20:57:54.605 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-26T20:57:54.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.740+0000 7f4803800640 1 Processor -- start 2024-04-26T20:57:54.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.740+0000 7f4803800640 1 -- start start 2024-04-26T20:57:54.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.740+0000 7f4803800640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f47fc15e180 0x7f47fc0cb200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:54.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.740+0000 7f4803800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f47fc0cb740 0x7f47fc0b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:54.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.740+0000 7f4803800640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47fc0cd210 con 0x7f47fc15aa60 2024-04-26T20:57:54.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.740+0000 7f4803800640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f47fc15d6a0 con 0x7f47fc0cb740 2024-04-26T20:57:54.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.740+0000 7f4803800640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f47fc15d980 con 0x7f47fc15e180 2024-04-26T20:57:54.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.740+0000 7f4801800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f47fc0cb740 0x7f47fc0b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:54.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.740+0000 7f4800e00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f47fc15aa60 0x7f47fc0cc7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:58824/0 (socket says 172.21.15.138:58824) 2024-04-26T20:57:54.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.740+0000 7f4800e00640 1 -- 172.21.15.138:0/255098407 learned_addr learned my addr 172.21.15.138:0/255098407 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:54.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.740+0000 7f47f3e00640 1 --2- 172.21.15.138:0/255098407 >> v2:172.21.15.143:3300/0 conn(0x7f47fc15e180 0x7f47fc0cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:54.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.740+0000 7f4801800640 1 -- 172.21.15.138:0/255098407 >> v2:172.21.15.143:3300/0 conn(0x7f47fc15e180 msgr2=0x7f47fc0cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:54.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.740+0000 7f4801800640 1 --2- 172.21.15.138:0/255098407 >> v2:172.21.15.143:3300/0 conn(0x7f47fc15e180 0x7f47fc0cb200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:54.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.740+0000 7f4801800640 1 -- 172.21.15.138:0/255098407 >> v1:172.21.15.138:6789/0 conn(0x7f47fc15aa60 legacy=0x7f47fc0cc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:54.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.740+0000 7f4801800640 1 -- 172.21.15.138:0/255098407 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47fc15dc60 con 0x7f47fc0cb740 2024-04-26T20:57:54.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.740+0000 7f47fbe00640 1 -- 172.21.15.138:0/255098407 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4053305901 0 0) 0x7f47fc0cd210 con 0x7f47fc15aa60 2024-04-26T20:57:54.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.744+0000 7f4801800640 1 --2- 172.21.15.138:0/255098407 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47fc0cb740 0x7f47fc0b5aa0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f47fc074b90 tx=0x7f47f401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3f6056d49e70de1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:54.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.744+0000 7f47fbe00640 1 -- 172.21.15.138:0/255098407 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f40b2070 con 0x7f47fc0cb740 2024-04-26T20:57:54.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.744+0000 7f47fbe00640 1 -- 172.21.15.138:0/255098407 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47f40a57f0 con 0x7f47fc0cb740 2024-04-26T20:57:54.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.744+0000 7f47fbe00640 1 -- 172.21.15.138:0/255098407 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f40a5bc0 con 0x7f47fc0cb740 2024-04-26T20:57:54.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.744+0000 7f4803800640 1 -- 172.21.15.138:0/255098407 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47fc0cb740 msgr2=0x7f47fc0b5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:54.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.744+0000 7f4803800640 1 --2- 172.21.15.138:0/255098407 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47fc0cb740 0x7f47fc0b5aa0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f47fc074b90 tx=0x7f47f401c930 comp rx=0 tx=0).stop 2024-04-26T20:57:54.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.744+0000 7f4803800640 1 -- 172.21.15.138:0/255098407 shutdown_connections 2024-04-26T20:57:54.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.744+0000 7f4803800640 1 --2- 172.21.15.138:0/255098407 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47fc0cb740 0x7f47fc0b5aa0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:54.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.744+0000 7f4803800640 1 --2- 172.21.15.138:0/255098407 >> v2:172.21.15.143:3300/0 conn(0x7f47fc15e180 0x7f47fc0cb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:54.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.744+0000 7f4803800640 1 -- 172.21.15.138:0/255098407 >> 172.21.15.138:0/255098407 conn(0x7f47fc0d0bb0 msgr2=0x7f47fc0d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:54.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.744+0000 7f4803800640 1 -- 172.21.15.138:0/255098407 shutdown_connections 2024-04-26T20:57:54.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.744+0000 7f4803800640 1 -- 172.21.15.138:0/255098407 wait complete. 2024-04-26T20:57:54.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.748+0000 7f4803800640 1 Processor -- start 2024-04-26T20:57:54.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.748+0000 7f4803800640 1 -- start start 2024-04-26T20:57:54.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.748+0000 7f4803800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47fc0cb740 0x7f47fc15c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:54.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.748+0000 7f4803800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f47fc15aa60 0x7f47fc0b51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:54.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.748+0000 7f4803800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47fc15e180 0x7f47fc15e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:54.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.748+0000 7f4803800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f47fc06dee0 con 0x7f47fc0cb740 2024-04-26T20:57:54.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.748+0000 7f4803800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f47fc072240 con 0x7f47fc15aa60 2024-04-26T20:57:54.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.748+0000 7f4803800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f47fc06e060 con 0x7f47fc15e180 2024-04-26T20:57:54.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.748+0000 7f4800e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47fc0cb740 0x7f47fc15c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:54.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.748+0000 7f4800e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47fc0cb740 0x7f47fc15c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:53020/0 (socket says 172.21.15.138:53020) 2024-04-26T20:57:54.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.748+0000 7f4800e00640 1 -- 172.21.15.138:0/932437855 learned_addr learned my addr 172.21.15.138:0/932437855 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:54.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.748+0000 7f47f3e00640 1 --2- 172.21.15.138:0/932437855 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f47fc15aa60 0x7f47fc0b51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:54.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.748+0000 7f4801800640 1 --2- 172.21.15.138:0/932437855 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47fc15e180 0x7f47fc15e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:54.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.748+0000 7f4800e00640 1 -- 172.21.15.138:0/932437855 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47fc15e180 msgr2=0x7f47fc15e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:54.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.748+0000 7f4800e00640 1 --2- 172.21.15.138:0/932437855 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47fc15e180 0x7f47fc15e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:54.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.748+0000 7f4800e00640 1 -- 172.21.15.138:0/932437855 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f47fc15aa60 msgr2=0x7f47fc0b51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:54.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.748+0000 7f4800e00640 1 --2- 172.21.15.138:0/932437855 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f47fc15aa60 0x7f47fc0b51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:54.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.748+0000 7f4800e00640 1 -- 172.21.15.138:0/932437855 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47fc0b4c90 con 0x7f47fc0cb740 2024-04-26T20:57:54.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.748+0000 7f47f3e00640 1 --2- 172.21.15.138:0/932437855 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f47fc15aa60 0x7f47fc0b51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:54.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.748+0000 7f4800e00640 1 --2- 172.21.15.138:0/932437855 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47fc0cb740 0x7f47fc15c360 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f47ec0011f0 tx=0x7f47ec00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:54.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.748+0000 7f47f9600640 1 -- 172.21.15.138:0/932437855 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ec018070 con 0x7f47fc0cb740 2024-04-26T20:57:54.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.748+0000 7f47f9600640 1 -- 172.21.15.138:0/932437855 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47ec0074e0 con 0x7f47fc0cb740 2024-04-26T20:57:54.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.748+0000 7f47f9600640 1 -- 172.21.15.138:0/932437855 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ec004a10 con 0x7f47fc0cb740 2024-04-26T20:57:54.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.748+0000 7f4803800640 1 -- 172.21.15.138:0/932437855 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47fc0b43f0 con 0x7f47fc0cb740 2024-04-26T20:57:54.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.748+0000 7f4803800640 1 -- 172.21.15.138:0/932437855 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47fc0b49b0 con 0x7f47fc0cb740 2024-04-26T20:57:54.757 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.752+0000 7f4803800640 1 -- 172.21.15.138:0/932437855 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47fc069430 con 0x7f47fc0cb740 2024-04-26T20:57:54.757 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.752+0000 7f47f9600640 1 -- 172.21.15.138:0/932437855 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f47ec004bb0 con 0x7f47fc0cb740 2024-04-26T20:57:54.758 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.752+0000 7f47f9600640 1 --2- 172.21.15.138:0/932437855 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f47d80683b0 0x7f47d806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:54.758 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.752+0000 7f47f9600640 1 -- 172.21.15.138:0/932437855 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f47ec085c10 con 0x7f47fc0cb740 2024-04-26T20:57:54.758 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.752+0000 7f47f3e00640 1 --2- 172.21.15.138:0/932437855 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f47d80683b0 0x7f47d806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:54.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.752+0000 7f47f3e00640 1 --2- 172.21.15.138:0/932437855 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f47d80683b0 0x7f47d806a870 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f47fc15cd20 tx=0x7f47e4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:54.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.756+0000 7f47f9600640 1 -- 172.21.15.138:0/932437855 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f47ec055a80 con 0x7f47fc0cb740 2024-04-26T20:57:54.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:54.952+0000 7f4803800640 1 -- 172.21.15.138:0/932437855 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f47fc06fbd0 con 0x7f47fc0cb740 2024-04-26T20:57:55.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.584+0000 7f47f9600640 1 -- 172.21.15.138:0/932437855 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7f47ec059d80 con 0x7f47fc0cb740 2024-04-26T20:57:55.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.584+0000 7f4803800640 1 -- 172.21.15.138:0/932437855 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f47d80683b0 msgr2=0x7f47d806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:55.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.584+0000 7f4803800640 1 --2- 172.21.15.138:0/932437855 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f47d80683b0 0x7f47d806a870 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f47fc15cd20 tx=0x7f47e4008040 comp rx=0 tx=0).stop 2024-04-26T20:57:55.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.584+0000 7f4803800640 1 -- 172.21.15.138:0/932437855 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47fc0cb740 msgr2=0x7f47fc15c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:55.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.584+0000 7f4803800640 1 --2- 172.21.15.138:0/932437855 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47fc0cb740 0x7f47fc15c360 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f47ec0011f0 tx=0x7f47ec00c9b0 comp rx=0 tx=0).stop 2024-04-26T20:57:55.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.584+0000 7f4803800640 1 -- 172.21.15.138:0/932437855 shutdown_connections 2024-04-26T20:57:55.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.584+0000 7f4803800640 1 --2- 172.21.15.138:0/932437855 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f47d80683b0 0x7f47d806a870 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:55.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.584+0000 7f4803800640 1 --2- 172.21.15.138:0/932437855 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47fc15e180 0x7f47fc15e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:55.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.584+0000 7f4803800640 1 --2- 172.21.15.138:0/932437855 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f47fc15aa60 0x7f47fc0b51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:55.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.584+0000 7f4803800640 1 --2- 172.21.15.138:0/932437855 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47fc0cb740 0x7f47fc15c360 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:55.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.584+0000 7f4803800640 1 -- 172.21.15.138:0/932437855 >> 172.21.15.138:0/932437855 conn(0x7f47fc0d0bb0 msgr2=0x7f47fc0728f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:55.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.584+0000 7f4803800640 1 -- 172.21.15.138:0/932437855 shutdown_connections 2024-04-26T20:57:55.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.584+0000 7f4803800640 1 -- 172.21.15.138:0/932437855 wait complete. 2024-04-26T20:57:55.613 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-26T20:57:55.613 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:57:55.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.748+0000 7f2f07a00640 1 Processor -- start 2024-04-26T20:57:55.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.748+0000 7f2f07a00640 1 -- start start 2024-04-26T20:57:55.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.748+0000 7f2f07a00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2f000cbe00 0x7f2f0006de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:55.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.748+0000 7f2f07a00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f2f000cc1e0 0x7f2f00073b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:55.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.748+0000 7f2f07a00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f000727f0 con 0x7f2f000ce6f0 2024-04-26T20:57:55.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.748+0000 7f2f07a00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f2f00073680 con 0x7f2f000cbe00 2024-04-26T20:57:55.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.748+0000 7f2f07a00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f2f00072a70 con 0x7f2f000cc1e0 2024-04-26T20:57:55.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.748+0000 7f2f05000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2f000cbe00 0x7f2f0006de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:55.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.748+0000 7f2f05000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2f000cbe00 0x7f2f0006de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:53028/0 (socket says 172.21.15.138:53028) 2024-04-26T20:57:55.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.748+0000 7f2f05000640 1 -- 172.21.15.138:0/2933731460 learned_addr learned my addr 172.21.15.138:0/2933731460 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:55.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.748+0000 7f2f05000640 1 -- 172.21.15.138:0/2933731460 >> v2:172.21.15.143:3300/0 conn(0x7f2f000cc1e0 msgr2=0x7f2f00073b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:55.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.748+0000 7f2f05000640 1 --2- 172.21.15.138:0/2933731460 >> v2:172.21.15.143:3300/0 conn(0x7f2f000cc1e0 0x7f2f00073b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:55.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.748+0000 7f2f05000640 1 -- 172.21.15.138:0/2933731460 >> v1:172.21.15.143:6789/0 conn(0x7f2f000ce6f0 legacy=0x7f2f000ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:55.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.748+0000 7f2f05000640 1 -- 172.21.15.138:0/2933731460 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f00072d50 con 0x7f2f000cbe00 2024-04-26T20:57:55.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.748+0000 7f2f05000640 1 --2- 172.21.15.138:0/2933731460 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2f000cbe00 0x7f2f0006de70 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f2f000b6c50 tx=0x7f2ee801c300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b764941a7adf2877 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:55.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.748+0000 7f2eff400640 1 -- 172.21.15.138:0/2933731460 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee80b0070 con 0x7f2f000cbe00 2024-04-26T20:57:55.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.748+0000 7f2eff400640 1 -- 172.21.15.138:0/2933731460 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ee80ab600 con 0x7f2f000cbe00 2024-04-26T20:57:55.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.748+0000 7f2eff400640 1 -- 172.21.15.138:0/2933731460 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee80ab9d0 con 0x7f2f000cbe00 2024-04-26T20:57:55.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.752+0000 7f2f07a00640 1 -- 172.21.15.138:0/2933731460 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2f000cbe00 msgr2=0x7f2f0006de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:55.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.752+0000 7f2f07a00640 1 --2- 172.21.15.138:0/2933731460 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2f000cbe00 0x7f2f0006de70 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f2f000b6c50 tx=0x7f2ee801c300 comp rx=0 tx=0).stop 2024-04-26T20:57:55.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.752+0000 7f2f07a00640 1 -- 172.21.15.138:0/2933731460 shutdown_connections 2024-04-26T20:57:55.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.752+0000 7f2f07a00640 1 --2- 172.21.15.138:0/2933731460 >> v2:172.21.15.143:3300/0 conn(0x7f2f000cc1e0 0x7f2f00073b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:55.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.752+0000 7f2f07a00640 1 --2- 172.21.15.138:0/2933731460 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2f000cbe00 0x7f2f0006de70 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:55.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.752+0000 7f2f07a00640 1 -- 172.21.15.138:0/2933731460 >> 172.21.15.138:0/2933731460 conn(0x7f2f000d0b20 msgr2=0x7f2f000d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:55.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.752+0000 7f2f07a00640 1 -- 172.21.15.138:0/2933731460 shutdown_connections 2024-04-26T20:57:55.757 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.752+0000 7f2f07a00640 1 -- 172.21.15.138:0/2933731460 wait complete. 2024-04-26T20:57:55.757 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.752+0000 7f2f07a00640 1 Processor -- start 2024-04-26T20:57:55.758 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.752+0000 7f2f07a00640 1 -- start start 2024-04-26T20:57:55.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.752+0000 7f2f07a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2f000cbe00 0x7f2f00149da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:55.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.752+0000 7f2f07a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2f000cc1e0 0x7f2f00153c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:55.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.752+0000 7f2f07a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2f000ce6f0 0x7f2f001541a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:55.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.752+0000 7f2f07a00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f2f000741d0 con 0x7f2f000ce6f0 2024-04-26T20:57:55.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.752+0000 7f2f07a00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f2f00074050 con 0x7f2f000cbe00 2024-04-26T20:57:55.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.752+0000 7f2f07a00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f2f000d0780 con 0x7f2f000cc1e0 2024-04-26T20:57:55.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.752+0000 7f2f05a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2f000ce6f0 0x7f2f001541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:55.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.752+0000 7f2f05a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2f000ce6f0 0x7f2f001541a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:53034/0 (socket says 172.21.15.138:53034) 2024-04-26T20:57:55.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.752+0000 7f2f05a00640 1 -- 172.21.15.138:0/3865877026 learned_addr learned my addr 172.21.15.138:0/3865877026 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:55.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.752+0000 7f2f05a00640 1 -- 172.21.15.138:0/3865877026 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2f000cc1e0 msgr2=0x7f2f00153c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:55.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.752+0000 7f2f05a00640 1 --2- 172.21.15.138:0/3865877026 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2f000cc1e0 0x7f2f00153c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:55.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.752+0000 7f2f05a00640 1 -- 172.21.15.138:0/3865877026 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2f000cbe00 msgr2=0x7f2f00149da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:55.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.752+0000 7f2f05a00640 1 --2- 172.21.15.138:0/3865877026 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2f000cbe00 0x7f2f00149da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:55.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.752+0000 7f2f05a00640 1 -- 172.21.15.138:0/3865877026 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f000b4960 con 0x7f2f000ce6f0 2024-04-26T20:57:55.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.756+0000 7f2f05a00640 1 --2- 172.21.15.138:0/3865877026 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2f000ce6f0 0x7f2f001541a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2ef800b990 tx=0x7f2ef800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:55.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.756+0000 7f2efcc00640 1 -- 172.21.15.138:0/3865877026 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef8019070 con 0x7f2f000ce6f0 2024-04-26T20:57:55.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.756+0000 7f2efcc00640 1 -- 172.21.15.138:0/3865877026 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ef800cba0 con 0x7f2f000ce6f0 2024-04-26T20:57:55.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.756+0000 7f2f07a00640 1 -- 172.21.15.138:0/3865877026 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f000c98f0 con 0x7f2f000ce6f0 2024-04-26T20:57:55.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.756+0000 7f2efcc00640 1 -- 172.21.15.138:0/3865877026 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef8014440 con 0x7f2f000ce6f0 2024-04-26T20:57:55.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.756+0000 7f2f07a00640 1 -- 172.21.15.138:0/3865877026 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f00154d20 con 0x7f2f000ce6f0 2024-04-26T20:57:55.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.756+0000 7f2f07a00640 1 -- 172.21.15.138:0/3865877026 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f00069510 con 0x7f2f000ce6f0 2024-04-26T20:57:55.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.756+0000 7f2efcc00640 1 -- 172.21.15.138:0/3865877026 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2ef801c070 con 0x7f2f000ce6f0 2024-04-26T20:57:55.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.756+0000 7f2efcc00640 1 --2- 172.21.15.138:0/3865877026 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f2edc068380 0x7f2edc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:55.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.756+0000 7f2efcc00640 1 -- 172.21.15.138:0/3865877026 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f2ef8086910 con 0x7f2f000ce6f0 2024-04-26T20:57:55.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.756+0000 7f2f05000640 1 --2- 172.21.15.138:0/3865877026 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f2edc068380 0x7f2edc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:55.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.760+0000 7f2f05000640 1 --2- 172.21.15.138:0/3865877026 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f2edc068380 0x7f2edc06a840 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2ee80ad000 tx=0x7f2ee8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:55.766 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.760+0000 7f2efcc00640 1 -- 172.21.15.138:0/3865877026 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2ef8056d30 con 0x7f2f000ce6f0 2024-04-26T20:57:55.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.956+0000 7f2f07a00640 1 -- 172.21.15.138:0/3865877026 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2f0015af20 con 0x7f2f000ce6f0 2024-04-26T20:57:55.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.956+0000 7f2efcc00640 1 -- 172.21.15.138:0/3865877026 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5187 (secure 0 0 0) 0x7f2ef8056630 con 0x7f2f000ce6f0 2024-04-26T20:57:55.963 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:57:55.963 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5158,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/593330829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":593330829},{"type":"v1","addr":"172.21.15.143:6837","nonce":593330829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5304,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/3236230135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":3236230135},{"type":"v1","addr":"172.21.15.138:6834","nonce":3236230135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5307,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/3539747566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":3539747566},{"type":"v1","addr":"172.21.15.138:6835","nonce":3539747566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:57:51.937789+0000","modified":"2024-04-26T20:57:54.956885+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5310},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5310":{"gid":5310,"name":"d","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6836/483370849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":483370849},{"type":"v1","addr":"172.21.15.143:6836","nonce":483370849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5310,"qdb_cluster":[5310]},"id":2}]} 2024-04-26T20:57:55.964 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 18 2024-04-26T20:57:55.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.960+0000 7f2f07a00640 1 -- 172.21.15.138:0/3865877026 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f2edc068380 msgr2=0x7f2edc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:55.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.960+0000 7f2f07a00640 1 --2- 172.21.15.138:0/3865877026 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f2edc068380 0x7f2edc06a840 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2ee80ad000 tx=0x7f2ee8008040 comp rx=0 tx=0).stop 2024-04-26T20:57:55.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.960+0000 7f2f07a00640 1 -- 172.21.15.138:0/3865877026 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2f000ce6f0 msgr2=0x7f2f001541a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:55.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.960+0000 7f2f07a00640 1 --2- 172.21.15.138:0/3865877026 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2f000ce6f0 0x7f2f001541a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2ef800b990 tx=0x7f2ef800be50 comp rx=0 tx=0).stop 2024-04-26T20:57:55.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.960+0000 7f2f07a00640 1 -- 172.21.15.138:0/3865877026 shutdown_connections 2024-04-26T20:57:55.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.960+0000 7f2f07a00640 1 --2- 172.21.15.138:0/3865877026 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f2edc068380 0x7f2edc06a840 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:55.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.960+0000 7f2f07a00640 1 --2- 172.21.15.138:0/3865877026 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2f000ce6f0 0x7f2f001541a0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:55.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.960+0000 7f2f07a00640 1 --2- 172.21.15.138:0/3865877026 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2f000cc1e0 0x7f2f00153c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:55.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.960+0000 7f2f07a00640 1 --2- 172.21.15.138:0/3865877026 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2f000cbe00 0x7f2f00149da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:55.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.960+0000 7f2f07a00640 1 -- 172.21.15.138:0/3865877026 >> 172.21.15.138:0/3865877026 conn(0x7f2f000d0b20 msgr2=0x7f2f0006e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:55.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.960+0000 7f2f07a00640 1 -- 172.21.15.138:0/3865877026 shutdown_connections 2024-04-26T20:57:55.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:55.960+0000 7f2f07a00640 1 -- 172.21.15.138:0/3865877026 wait complete. 2024-04-26T20:57:55.984 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:57:56.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.116+0000 7f3c90400640 1 Processor -- start 2024-04-26T20:57:56.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.116+0000 7f3c90400640 1 -- start start 2024-04-26T20:57:56.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.116+0000 7f3c90400640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f3c8815d0f0 0x7f3c880d1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:56.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.116+0000 7f3c90400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f3c880b2280 0x7f3c880d1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:56.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.116+0000 7f3c90400640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c880ce540 con 0x7f3c880d0950 2024-04-26T20:57:56.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.116+0000 7f3c90400640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f3c880d0e50 con 0x7f3c880b2280 2024-04-26T20:57:56.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.116+0000 7f3c90400640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f3c880b26e0 con 0x7f3c8815d0f0 2024-04-26T20:57:56.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.116+0000 7f3c8d000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f3c880b2280 0x7f3c880d1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:56.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.116+0000 7f3c8d000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f3c880b2280 0x7f3c880d1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:53036/0 (socket says 172.21.15.138:53036) 2024-04-26T20:57:56.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.116+0000 7f3c8d000640 1 -- 172.21.15.138:0/2141950326 learned_addr learned my addr 172.21.15.138:0/2141950326 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:56.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.116+0000 7f3c8da00640 1 --2- 172.21.15.138:0/2141950326 >> v2:172.21.15.143:3300/0 conn(0x7f3c8815d0f0 0x7f3c880d1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:56.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.116+0000 7f3c8d000640 1 -- 172.21.15.138:0/2141950326 >> v2:172.21.15.143:3300/0 conn(0x7f3c8815d0f0 msgr2=0x7f3c880d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:56.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.116+0000 7f3c8d000640 1 --2- 172.21.15.138:0/2141950326 >> v2:172.21.15.143:3300/0 conn(0x7f3c8815d0f0 0x7f3c880d1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:56.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.116+0000 7f3c8d000640 1 -- 172.21.15.138:0/2141950326 >> v1:172.21.15.143:6789/0 conn(0x7f3c880d0950 legacy=0x7f3c880cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:56.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.116+0000 7f3c8d000640 1 -- 172.21.15.138:0/2141950326 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c880ce820 con 0x7f3c880b2280 2024-04-26T20:57:56.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.120+0000 7f3c8d000640 1 --2- 172.21.15.138:0/2141950326 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c880b2280 0x7f3c880d1550 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f3c88073320 tx=0x7f3c7401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa26cc59a9ccf2bf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:56.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.120+0000 7f3c87e00640 1 -- 172.21.15.138:0/2141950326 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c740b0070 con 0x7f3c880b2280 2024-04-26T20:57:56.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.120+0000 7f3c87e00640 1 -- 172.21.15.138:0/2141950326 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c740ab600 con 0x7f3c880b2280 2024-04-26T20:57:56.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.120+0000 7f3c87e00640 1 -- 172.21.15.138:0/2141950326 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c740ab9d0 con 0x7f3c880b2280 2024-04-26T20:57:56.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.120+0000 7f3c90400640 1 -- 172.21.15.138:0/2141950326 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c880b2280 msgr2=0x7f3c880d1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:56.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.120+0000 7f3c90400640 1 --2- 172.21.15.138:0/2141950326 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c880b2280 0x7f3c880d1550 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f3c88073320 tx=0x7f3c7401c4e0 comp rx=0 tx=0).stop 2024-04-26T20:57:56.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.120+0000 7f3c90400640 1 -- 172.21.15.138:0/2141950326 shutdown_connections 2024-04-26T20:57:56.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.120+0000 7f3c90400640 1 --2- 172.21.15.138:0/2141950326 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c880b2280 0x7f3c880d1550 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:56.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.120+0000 7f3c90400640 1 --2- 172.21.15.138:0/2141950326 >> v2:172.21.15.143:3300/0 conn(0x7f3c8815d0f0 0x7f3c880d1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:56.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.120+0000 7f3c90400640 1 -- 172.21.15.138:0/2141950326 >> 172.21.15.138:0/2141950326 conn(0x7f3c880d2d80 msgr2=0x7f3c880d3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:56.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.120+0000 7f3c90400640 1 -- 172.21.15.138:0/2141950326 shutdown_connections 2024-04-26T20:57:56.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.120+0000 7f3c90400640 1 -- 172.21.15.138:0/2141950326 wait complete. 2024-04-26T20:57:56.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.120+0000 7f3c90400640 1 Processor -- start 2024-04-26T20:57:56.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.120+0000 7f3c90400640 1 -- start start 2024-04-26T20:57:56.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.124+0000 7f3c90400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3c880b2280 0x7f3c881545e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:56.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.124+0000 7f3c90400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3c880d0950 0x7f3c881529e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:56.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.124+0000 7f3c90400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c8815d0f0 0x7f3c88156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:56.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.124+0000 7f3c90400640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f3c8816a040 con 0x7f3c8815d0f0 2024-04-26T20:57:56.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.124+0000 7f3c90400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f3c88169ec0 con 0x7f3c880b2280 2024-04-26T20:57:56.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.124+0000 7f3c90400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f3c8816a1c0 con 0x7f3c880d0950 2024-04-26T20:57:56.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.124+0000 7f3c8e400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c8815d0f0 0x7f3c88156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:56.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.124+0000 7f3c8e400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c8815d0f0 0x7f3c88156060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:53052/0 (socket says 172.21.15.138:53052) 2024-04-26T20:57:56.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.124+0000 7f3c8e400640 1 -- 172.21.15.138:0/4061595775 learned_addr learned my addr 172.21.15.138:0/4061595775 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:56.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.124+0000 7f3c8d000640 1 --2- 172.21.15.138:0/4061595775 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3c880d0950 0x7f3c881529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:56.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.124+0000 7f3c8da00640 1 --2- 172.21.15.138:0/4061595775 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3c880b2280 0x7f3c881545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:56.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.124+0000 7f3c8e400640 1 -- 172.21.15.138:0/4061595775 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3c880d0950 msgr2=0x7f3c881529e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:56.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.124+0000 7f3c8e400640 1 --2- 172.21.15.138:0/4061595775 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3c880d0950 0x7f3c881529e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:56.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.124+0000 7f3c8e400640 1 -- 172.21.15.138:0/4061595775 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3c880b2280 msgr2=0x7f3c881545e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:56.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.124+0000 7f3c8e400640 1 --2- 172.21.15.138:0/4061595775 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3c880b2280 0x7f3c881545e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:56.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.124+0000 7f3c8e400640 1 -- 172.21.15.138:0/4061595775 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c88156ec0 con 0x7f3c8815d0f0 2024-04-26T20:57:56.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.124+0000 7f3c8e400640 1 --2- 172.21.15.138:0/4061595775 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c8815d0f0 0x7f3c88156060 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f3c8000c7b0 tx=0x7f3c8000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:56.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.124+0000 7f3c85600640 1 -- 172.21.15.138:0/4061595775 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c80016020 con 0x7f3c8815d0f0 2024-04-26T20:57:56.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.124+0000 7f3c85600640 1 -- 172.21.15.138:0/4061595775 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c8000aa90 con 0x7f3c8815d0f0 2024-04-26T20:57:56.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.124+0000 7f3c85600640 1 -- 172.21.15.138:0/4061595775 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c8000ce60 con 0x7f3c8815d0f0 2024-04-26T20:57:56.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.124+0000 7f3c90400640 1 -- 172.21.15.138:0/4061595775 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c88153d70 con 0x7f3c8815d0f0 2024-04-26T20:57:56.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.124+0000 7f3c90400640 1 -- 172.21.15.138:0/4061595775 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c88152f20 con 0x7f3c8815d0f0 2024-04-26T20:57:56.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.124+0000 7f3c90400640 1 -- 172.21.15.138:0/4061595775 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c88069510 con 0x7f3c8815d0f0 2024-04-26T20:57:56.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.128+0000 7f3c85600640 1 -- 172.21.15.138:0/4061595775 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3c80019020 con 0x7f3c8815d0f0 2024-04-26T20:57:56.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.128+0000 7f3c85600640 1 --2- 172.21.15.138:0/4061595775 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f3c68068380 0x7f3c6806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:56.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.128+0000 7f3c85600640 1 -- 172.21.15.138:0/4061595775 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f3c80086d90 con 0x7f3c8815d0f0 2024-04-26T20:57:56.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.128+0000 7f3c8da00640 1 --2- 172.21.15.138:0/4061595775 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f3c68068380 0x7f3c6806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:56.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.128+0000 7f3c8da00640 1 --2- 172.21.15.138:0/4061595775 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f3c68068380 0x7f3c6806a840 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c0079c0 tx=0x7f3c7c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:56.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.136+0000 7f3c85600640 1 -- 172.21.15.138:0/4061595775 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3c80020020 con 0x7f3c8815d0f0 2024-04-26T20:57:56.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.292+0000 7f3c90400640 1 -- 172.21.15.138:0/4061595775 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3c880d32e0 con 0x7f3c8815d0f0 2024-04-26T20:57:56.297 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.292+0000 7f3c85600640 1 -- 172.21.15.138:0/4061595775 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) ==== 74+0+17002 (secure 0 0 0) 0x7f3c80056ad0 con 0x7f3c8815d0f0 2024-04-26T20:57:56.297 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:57:56.298 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":41,"fsid":"c22b4730-12cc-4558-8535-b965384398c0","created":"2024-04-26T20:56:14.182475+0000","modified":"2024-04-26T20:57:53.563810+0000","last_up_change":"2024-04-26T20:56:26.013243+0000","last_in_change":"2024-04-26T20:56:16.714055+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:56:27.265834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:57:49.597600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-26T20:57:50.901951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3f9a2e34-3199-466f-a6cf-57927318121e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6801","nonce":3534772245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6803","nonce":3534772245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6807","nonce":3534772245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6805","nonce":3534772245}]},"public_addr":"172.21.15.138:6801/3534772245","cluster_addr":"172.21.15.138:6803/3534772245","heartbeat_back_addr":"172.21.15.138:6807/3534772245","heartbeat_front_addr":"172.21.15.138:6805/3534772245","state":["exists","up"]},{"osd":1,"uuid":"e881fcf6-3248-4696-a2ef-95d206d77712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6817","nonce":1427635773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6819","nonce":1427635773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6823","nonce":1427635773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6821","nonce":1427635773}]},"public_addr":"172.21.15.138:6817/1427635773","cluster_addr":"172.21.15.138:6819/1427635773","heartbeat_back_addr":"172.21.15.138:6823/1427635773","heartbeat_front_addr":"172.21.15.138:6821/1427635773","state":["exists","up"]},{"osd":2,"uuid":"f7d1db33-7672-4699-ae47-9f1e0a8e4222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6809","nonce":4273721573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6811","nonce":4273721573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6815","nonce":4273721573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6813","nonce":4273721573}]},"public_addr":"172.21.15.138:6809/4273721573","cluster_addr":"172.21.15.138:6811/4273721573","heartbeat_back_addr":"172.21.15.138:6815/4273721573","heartbeat_front_addr":"172.21.15.138:6813/4273721573","state":["exists","up"]},{"osd":3,"uuid":"2f4e0a9a-b8f6-4468-844a-a4501cd85054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6825","nonce":3098242154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6827","nonce":3098242154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6831","nonce":3098242154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6829","nonce":3098242154}]},"public_addr":"172.21.15.138:6825/3098242154","cluster_addr":"172.21.15.138:6827/3098242154","heartbeat_back_addr":"172.21.15.138:6831/3098242154","heartbeat_front_addr":"172.21.15.138:6829/3098242154","state":["exists","up"]},{"osd":4,"uuid":"c85df99b-3624-410e-866b-86830af2cfe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6801","nonce":2942056312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6803","nonce":2942056312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6807","nonce":2942056312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6805","nonce":2942056312}]},"public_addr":"172.21.15.143:6801/2942056312","cluster_addr":"172.21.15.143:6803/2942056312","heartbeat_back_addr":"172.21.15.143:6807/2942056312","heartbeat_front_addr":"172.21.15.143:6805/2942056312","state":["exists","up"]},{"osd":5,"uuid":"9af1efb5-c416-4808-b5ef-de0679ab9705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6809","nonce":1910222887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6811","nonce":1910222887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6815","nonce":1910222887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6813","nonce":1910222887}]},"public_addr":"172.21.15.143:6809/1910222887","cluster_addr":"172.21.15.143:6811/1910222887","heartbeat_back_addr":"172.21.15.143:6815/1910222887","heartbeat_front_addr":"172.21.15.143:6813/1910222887","state":["exists","up"]},{"osd":6,"uuid":"d7138615-8838-45ff-9072-2fd0683362f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6817","nonce":1082239825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6819","nonce":1082239825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6823","nonce":1082239825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6821","nonce":1082239825}]},"public_addr":"172.21.15.143:6817/1082239825","cluster_addr":"172.21.15.143:6819/1082239825","heartbeat_back_addr":"172.21.15.143:6823/1082239825","heartbeat_front_addr":"172.21.15.143:6821/1082239825","state":["exists","up"]},{"osd":7,"uuid":"0c27172b-35c4-49ec-ba0b-0137b8ff0010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6825","nonce":3295508495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6827","nonce":3295508495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6831","nonce":3295508495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6829","nonce":3295508495}]},"public_addr":"172.21.15.143:6825/3295508495","cluster_addr":"172.21.15.143:6827/3295508495","heartbeat_back_addr":"172.21.15.143:6831/3295508495","heartbeat_front_addr":"172.21.15.143:6829/3295508495","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.326627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.396119+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.433915+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.414179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.216947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.329272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.503073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.436382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:57:56.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.292+0000 7f3c90400640 1 -- 172.21.15.138:0/4061595775 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f3c68068380 msgr2=0x7f3c6806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:56.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.292+0000 7f3c90400640 1 --2- 172.21.15.138:0/4061595775 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f3c68068380 0x7f3c6806a840 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c0079c0 tx=0x7f3c7c008040 comp rx=0 tx=0).stop 2024-04-26T20:57:56.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.292+0000 7f3c90400640 1 -- 172.21.15.138:0/4061595775 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c8815d0f0 msgr2=0x7f3c88156060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:56.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.292+0000 7f3c90400640 1 --2- 172.21.15.138:0/4061595775 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c8815d0f0 0x7f3c88156060 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f3c8000c7b0 tx=0x7f3c8000cc70 comp rx=0 tx=0).stop 2024-04-26T20:57:56.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.296+0000 7f3c90400640 1 -- 172.21.15.138:0/4061595775 shutdown_connections 2024-04-26T20:57:56.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.296+0000 7f3c90400640 1 --2- 172.21.15.138:0/4061595775 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f3c68068380 0x7f3c6806a840 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:56.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.296+0000 7f3c90400640 1 --2- 172.21.15.138:0/4061595775 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c8815d0f0 0x7f3c88156060 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:56.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.296+0000 7f3c90400640 1 --2- 172.21.15.138:0/4061595775 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3c880d0950 0x7f3c881529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:56.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.296+0000 7f3c90400640 1 --2- 172.21.15.138:0/4061595775 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3c880b2280 0x7f3c881545e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:56.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.296+0000 7f3c90400640 1 -- 172.21.15.138:0/4061595775 >> 172.21.15.138:0/4061595775 conn(0x7f3c880d2d80 msgr2=0x7f3c881595a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:56.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.296+0000 7f3c90400640 1 -- 172.21.15.138:0/4061595775 shutdown_connections 2024-04-26T20:57:56.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.296+0000 7f3c90400640 1 -- 172.21.15.138:0/4061595775 wait complete. 2024-04-26T20:57:56.319 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-26T20:57:56.319 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T20:57:56.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.452+0000 7f4304200640 1 Processor -- start 2024-04-26T20:57:56.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.452+0000 7f4304200640 1 -- start start 2024-04-26T20:57:56.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.452+0000 7f4304200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42fc0cc1e0 0x7f42fc0ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:56.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.452+0000 7f4304200640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42fc0727f0 con 0x7f42fc15cf80 2024-04-26T20:57:56.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.452+0000 7f4304200640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42fc072a70 con 0x7f42fc0cbe00 2024-04-26T20:57:56.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.452+0000 7f4304200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f42fc074220 con 0x7f42fc0cc1e0 2024-04-26T20:57:56.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.452+0000 7f4300e00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f42fc15cf80 0x7f42fc073b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:58828/0 (socket says 172.21.15.138:58828) 2024-04-26T20:57:56.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.452+0000 7f4300e00640 1 -- 172.21.15.138:0/3856924565 learned_addr learned my addr 172.21.15.138:0/3856924565 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:56.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.452+0000 7f4302200640 1 --2- 172.21.15.138:0/3856924565 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42fc0cc1e0 0x7f42fc0ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:56.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.452+0000 7f42fbe00640 1 -- 172.21.15.138:0/3856924565 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1901301509 0 0) 0x7f42e8001120 con 0x7f42fc15cf80 2024-04-26T20:57:56.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.452+0000 7f42fbe00640 1 -- 172.21.15.138:0/3856924565 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42e4003530 con 0x7f42fc15cf80 2024-04-26T20:57:56.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.452+0000 7f42fbe00640 1 -- 172.21.15.138:0/3856924565 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2999775632 0 0) 0x7f42fc072a70 con 0x7f42fc0cbe00 2024-04-26T20:57:56.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.452+0000 7f42fbe00640 1 -- 172.21.15.138:0/3856924565 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42e8001120 con 0x7f42fc0cbe00 2024-04-26T20:57:56.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.452+0000 7f4302200640 1 -- 172.21.15.138:0/3856924565 >> v1:172.21.15.143:6789/0 conn(0x7f42fc0cbe00 legacy=0x7f42fc06de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:56.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.452+0000 7f4302200640 1 -- 172.21.15.138:0/3856924565 >> v1:172.21.15.138:6789/0 conn(0x7f42fc15cf80 legacy=0x7f42fc073b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:56.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.452+0000 7f4302200640 1 -- 172.21.15.138:0/3856924565 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42fc072d50 con 0x7f42fc0cc1e0 2024-04-26T20:57:56.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.452+0000 7f4302200640 1 --2- 172.21.15.138:0/3856924565 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42fc0cc1e0 0x7f42fc0ce6f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f42f4009dc0 tx=0x7f42f401c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a1d170b6f35f573 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:56.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.452+0000 7f42fbe00640 1 -- 172.21.15.138:0/3856924565 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f40b2070 con 0x7f42fc0cc1e0 2024-04-26T20:57:56.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.452+0000 7f42fbe00640 1 -- 172.21.15.138:0/3856924565 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42f40a5750 con 0x7f42fc0cc1e0 2024-04-26T20:57:56.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.452+0000 7f42fbe00640 1 -- 172.21.15.138:0/3856924565 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f40a5b20 con 0x7f42fc0cc1e0 2024-04-26T20:57:56.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.452+0000 7f4304200640 1 -- 172.21.15.138:0/3856924565 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42fc0cc1e0 msgr2=0x7f42fc0ce6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:56.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.452+0000 7f4304200640 1 --2- 172.21.15.138:0/3856924565 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42fc0cc1e0 0x7f42fc0ce6f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f42f4009dc0 tx=0x7f42f401c990 comp rx=0 tx=0).stop 2024-04-26T20:57:56.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.452+0000 7f4304200640 1 -- 172.21.15.138:0/3856924565 shutdown_connections 2024-04-26T20:57:56.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.452+0000 7f4304200640 1 --2- 172.21.15.138:0/3856924565 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42fc0cc1e0 0x7f42fc0ce6f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:56.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.452+0000 7f4304200640 1 -- 172.21.15.138:0/3856924565 >> 172.21.15.138:0/3856924565 conn(0x7f42fc0d0b20 msgr2=0x7f42fc0d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:56.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.452+0000 7f4304200640 1 -- 172.21.15.138:0/3856924565 shutdown_connections 2024-04-26T20:57:56.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.452+0000 7f4304200640 1 -- 172.21.15.138:0/3856924565 wait complete. 2024-04-26T20:57:56.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.456+0000 7f4304200640 1 Processor -- start 2024-04-26T20:57:56.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.456+0000 7f4304200640 1 -- start start 2024-04-26T20:57:56.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.456+0000 7f4304200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42fc0cbe00 0x7f42fc149f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:56.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.456+0000 7f4304200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42fc0cc1e0 0x7f42fc0b51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:56.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.456+0000 7f4304200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42fc15cf80 0x7f42fc0b5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:56.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.456+0000 7f4304200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f42fc0d0780 con 0x7f42fc0cbe00 2024-04-26T20:57:56.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.456+0000 7f4304200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f42fc073680 con 0x7f42fc15cf80 2024-04-26T20:57:56.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.456+0000 7f4304200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f42fc0d0900 con 0x7f42fc0cc1e0 2024-04-26T20:57:56.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.456+0000 7f4301800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42fc0cbe00 0x7f42fc149f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:56.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.456+0000 7f4301800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42fc0cbe00 0x7f42fc149f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:53056/0 (socket says 172.21.15.138:53056) 2024-04-26T20:57:56.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.456+0000 7f4301800640 1 -- 172.21.15.138:0/3379969189 learned_addr learned my addr 172.21.15.138:0/3379969189 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:56.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.456+0000 7f4302200640 1 --2- 172.21.15.138:0/3379969189 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42fc15cf80 0x7f42fc0b5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:56.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.456+0000 7f4300e00640 1 --2- 172.21.15.138:0/3379969189 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42fc0cc1e0 0x7f42fc0b51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:56.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.456+0000 7f4301800640 1 -- 172.21.15.138:0/3379969189 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42fc0cc1e0 msgr2=0x7f42fc0b51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:56.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.456+0000 7f4301800640 1 --2- 172.21.15.138:0/3379969189 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42fc0cc1e0 0x7f42fc0b51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:56.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.456+0000 7f4301800640 1 -- 172.21.15.138:0/3379969189 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42fc15cf80 msgr2=0x7f42fc0b5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:56.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.456+0000 7f4301800640 1 --2- 172.21.15.138:0/3379969189 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42fc15cf80 0x7f42fc0b5720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:56.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.456+0000 7f4301800640 1 -- 172.21.15.138:0/3379969189 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42fc0b3cd0 con 0x7f42fc0cbe00 2024-04-26T20:57:56.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.456+0000 7f4301800640 1 --2- 172.21.15.138:0/3379969189 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42fc0cbe00 0x7f42fc149f40 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f42f000c430 tx=0x7f42f000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:56.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.456+0000 7f42f9600640 1 -- 172.21.15.138:0/3379969189 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f0017070 con 0x7f42fc0cbe00 2024-04-26T20:57:56.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.456+0000 7f42f9600640 1 -- 172.21.15.138:0/3379969189 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42f00052f0 con 0x7f42fc0cbe00 2024-04-26T20:57:56.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.456+0000 7f42f9600640 1 -- 172.21.15.138:0/3379969189 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f0003840 con 0x7f42fc0cbe00 2024-04-26T20:57:56.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.456+0000 7f4304200640 1 -- 172.21.15.138:0/3379969189 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42fc0b3fb0 con 0x7f42fc0cbe00 2024-04-26T20:57:56.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.456+0000 7f4304200640 1 -- 172.21.15.138:0/3379969189 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42fc0b4570 con 0x7f42fc0cbe00 2024-04-26T20:57:56.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.460+0000 7f4304200640 1 -- 172.21.15.138:0/3379969189 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42fc069510 con 0x7f42fc0cbe00 2024-04-26T20:57:56.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.460+0000 7f42f9600640 1 -- 172.21.15.138:0/3379969189 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f42f001a070 con 0x7f42fc0cbe00 2024-04-26T20:57:56.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.460+0000 7f42f9600640 1 --2- 172.21.15.138:0/3379969189 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f42dc068380 0x7f42dc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:56.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.460+0000 7f42f9600640 1 -- 172.21.15.138:0/3379969189 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f42f0085f30 con 0x7f42fc0cbe00 2024-04-26T20:57:56.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.460+0000 7f4300e00640 1 --2- 172.21.15.138:0/3379969189 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f42dc068380 0x7f42dc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:56.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.464+0000 7f4300e00640 1 --2- 172.21.15.138:0/3379969189 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f42dc068380 0x7f42dc06a840 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f42fc0b6100 tx=0x7f42e8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:56.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.464+0000 7f42f9600640 1 -- 172.21.15.138:0/3379969189 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f42f0056360 con 0x7f42fc0cbe00 2024-04-26T20:57:56.531 INFO:tasks.ceph.mds.d.smithi143.stderr:2024-04-26T20:57:56.529+0000 7f695f000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T20:57:56.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.620+0000 7f4304200640 1 -- 172.21.15.138:0/3379969189 --> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f42fc075260 con 0x7f42dc068380 2024-04-26T20:57:56.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.628+0000 7f42f9600640 1 -- 172.21.15.138:0/3379969189 <== mgr.4100 v2:172.21.15.143:6832/4275464198 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242398 (secure 0 0 0) 0x7f42fc075260 con 0x7f42dc068380 2024-04-26T20:57:56.634 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:57:56.636 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-04-26T20:57:56.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.628+0000 7f4304200640 1 -- 172.21.15.138:0/3379969189 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f42dc068380 msgr2=0x7f42dc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:56.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.628+0000 7f4304200640 1 --2- 172.21.15.138:0/3379969189 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f42dc068380 0x7f42dc06a840 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f42fc0b6100 tx=0x7f42e8009040 comp rx=0 tx=0).stop 2024-04-26T20:57:56.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.628+0000 7f4304200640 1 -- 172.21.15.138:0/3379969189 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42fc0cbe00 msgr2=0x7f42fc149f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:56.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.628+0000 7f4304200640 1 --2- 172.21.15.138:0/3379969189 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42fc0cbe00 0x7f42fc149f40 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f42f000c430 tx=0x7f42f000c8f0 comp rx=0 tx=0).stop 2024-04-26T20:57:56.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.632+0000 7f4304200640 1 -- 172.21.15.138:0/3379969189 shutdown_connections 2024-04-26T20:57:56.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.632+0000 7f4304200640 1 --2- 172.21.15.138:0/3379969189 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f42dc068380 0x7f42dc06a840 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:56.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.632+0000 7f4304200640 1 --2- 172.21.15.138:0/3379969189 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42fc15cf80 0x7f42fc0b5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:56.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.632+0000 7f4304200640 1 --2- 172.21.15.138:0/3379969189 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42fc0cc1e0 0x7f42fc0b51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:56.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.632+0000 7f4304200640 1 --2- 172.21.15.138:0/3379969189 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42fc0cbe00 0x7f42fc149f40 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:56.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.632+0000 7f4304200640 1 -- 172.21.15.138:0/3379969189 >> 172.21.15.138:0/3379969189 conn(0x7f42fc0d0b20 msgr2=0x7f42fc0cd460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:56.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.632+0000 7f4304200640 1 -- 172.21.15.138:0/3379969189 shutdown_connections 2024-04-26T20:57:56.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.632+0000 7f4304200640 1 -- 172.21.15.138:0/3379969189 wait complete. 2024-04-26T20:57:56.655 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":80,"stamp":"2024-04-26T20:57:55.259253+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592014,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":171,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":127,"ondisk_log_size":127,"up":92,"acting":92,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":53,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220728,"kb_used_data":4552,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753992,"statfs":{"total":773094113280,"available":772868087808,"internally_reserved":0,"allocated":4661248,"data_stored":2622873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1646,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.715593"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.593260+0000","last_change":"2024-04-26T20:57:52.581808+0000","last_active":"2024-04-26T20:57:52.593260+0000","last_peered":"2024-04-26T20:57:52.593260+0000","last_clean":"2024-04-26T20:57:52.593260+0000","last_became_active":"2024-04-26T20:57:52.581483+0000","last_became_peered":"2024-04-26T20:57:52.581483+0000","last_unstale":"2024-04-26T20:57:52.593260+0000","last_undegraded":"2024-04-26T20:57:52.593260+0000","last_fullsized":"2024-04-26T20:57:52.593260+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:55:05.593379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.597744+0000","last_change":"2024-04-26T20:57:52.589332+0000","last_active":"2024-04-26T20:57:52.597744+0000","last_peered":"2024-04-26T20:57:52.597744+0000","last_clean":"2024-04-26T20:57:52.597744+0000","last_became_active":"2024-04-26T20:57:52.589025+0000","last_became_peered":"2024-04-26T20:57:52.589025+0000","last_unstale":"2024-04-26T20:57:52.597744+0000","last_undegraded":"2024-04-26T20:57:52.597744+0000","last_fullsized":"2024-04-26T20:57:52.597744+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:15:08.538065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.591009+0000","last_change":"2024-04-26T20:57:52.577582+0000","last_active":"2024-04-26T20:57:52.591009+0000","last_peered":"2024-04-26T20:57:52.591009+0000","last_clean":"2024-04-26T20:57:52.591009+0000","last_became_active":"2024-04-26T20:57:52.576872+0000","last_became_peered":"2024-04-26T20:57:52.576872+0000","last_unstale":"2024-04-26T20:57:52.591009+0000","last_undegraded":"2024-04-26T20:57:52.591009+0000","last_fullsized":"2024-04-26T20:57:52.591009+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:26:56.698718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.594421+0000","last_change":"2024-04-26T20:57:52.583828+0000","last_active":"2024-04-26T20:57:52.594421+0000","last_peered":"2024-04-26T20:57:52.594421+0000","last_clean":"2024-04-26T20:57:52.594421+0000","last_became_active":"2024-04-26T20:57:52.582894+0000","last_became_peered":"2024-04-26T20:57:52.582894+0000","last_unstale":"2024-04-26T20:57:52.594421+0000","last_undegraded":"2024-04-26T20:57:52.594421+0000","last_fullsized":"2024-04-26T20:57:52.594421+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:09:22.814425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.594443+0000","last_change":"2024-04-26T20:57:52.584019+0000","last_active":"2024-04-26T20:57:52.594443+0000","last_peered":"2024-04-26T20:57:52.594443+0000","last_clean":"2024-04-26T20:57:52.594443+0000","last_became_active":"2024-04-26T20:57:52.583140+0000","last_became_peered":"2024-04-26T20:57:52.583140+0000","last_unstale":"2024-04-26T20:57:52.594443+0000","last_undegraded":"2024-04-26T20:57:52.594443+0000","last_fullsized":"2024-04-26T20:57:52.594443+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:31:16.104032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.594480+0000","last_change":"2024-04-26T20:57:52.585325+0000","last_active":"2024-04-26T20:57:52.594480+0000","last_peered":"2024-04-26T20:57:52.594480+0000","last_clean":"2024-04-26T20:57:52.594480+0000","last_became_active":"2024-04-26T20:57:52.585083+0000","last_became_peered":"2024-04-26T20:57:52.585083+0000","last_unstale":"2024-04-26T20:57:52.594480+0000","last_undegraded":"2024-04-26T20:57:52.594480+0000","last_fullsized":"2024-04-26T20:57:52.594480+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:05:21.832612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.594400+0000","last_change":"2024-04-26T20:57:52.583636+0000","last_active":"2024-04-26T20:57:52.594400+0000","last_peered":"2024-04-26T20:57:52.594400+0000","last_clean":"2024-04-26T20:57:52.594400+0000","last_became_active":"2024-04-26T20:57:52.582497+0000","last_became_peered":"2024-04-26T20:57:52.582497+0000","last_unstale":"2024-04-26T20:57:52.594400+0000","last_undegraded":"2024-04-26T20:57:52.594400+0000","last_fullsized":"2024-04-26T20:57:52.594400+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:16:51.269657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-26T20:57:50.552717+0000","last_change":"2024-04-26T20:57:50.552717+0000","last_active":"2024-04-26T20:57:50.534132+0000","last_peered":"2024-04-26T20:57:50.534132+0000","last_clean":"2024-04-26T20:57:50.534132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:50.552717+0000","last_undegraded":"2024-04-26T20:57:50.552717+0000","last_fullsized":"2024-04-26T20:57:50.552717+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-26T20:57:50.546168+0000","last_change":"2024-04-26T20:57:50.546168+0000","last_active":"2024-04-26T20:57:50.534132+0000","last_peered":"2024-04-26T20:57:50.534132+0000","last_clean":"2024-04-26T20:57:50.534132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:50.546168+0000","last_undegraded":"2024-04-26T20:57:50.546168+0000","last_fullsized":"2024-04-26T20:57:50.546168+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.588846+0000","last_change":"2024-04-26T20:57:51.573664+0000","last_active":"2024-04-26T20:57:52.588846+0000","last_peered":"2024-04-26T20:57:52.588846+0000","last_clean":"2024-04-26T20:57:52.588846+0000","last_became_active":"2024-04-26T20:57:51.572927+0000","last_became_peered":"2024-04-26T20:57:51.572927+0000","last_unstale":"2024-04-26T20:57:52.588846+0000","last_undegraded":"2024-04-26T20:57:52.588846+0000","last_fullsized":"2024-04-26T20:57:52.588846+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:04:55.596385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-26T20:57:50.552729+0000","last_change":"2024-04-26T20:57:50.552729+0000","last_active":"2024-04-26T20:57:50.534132+0000","last_peered":"2024-04-26T20:57:50.534132+0000","last_clean":"2024-04-26T20:57:50.534132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:50.552729+0000","last_undegraded":"2024-04-26T20:57:50.552729+0000","last_fullsized":"2024-04-26T20:57:50.552729+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.594461+0000","last_change":"2024-04-26T20:57:52.587538+0000","last_active":"2024-04-26T20:57:52.594461+0000","last_peered":"2024-04-26T20:57:52.594461+0000","last_clean":"2024-04-26T20:57:52.594461+0000","last_became_active":"2024-04-26T20:57:52.587138+0000","last_became_peered":"2024-04-26T20:57:52.587138+0000","last_unstale":"2024-04-26T20:57:52.594461+0000","last_undegraded":"2024-04-26T20:57:52.594461+0000","last_fullsized":"2024-04-26T20:57:52.594461+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:39:40.382481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-26T20:57:50.552713+0000","last_change":"2024-04-26T20:57:50.552713+0000","last_active":"2024-04-26T20:57:50.534132+0000","last_peered":"2024-04-26T20:57:50.534132+0000","last_clean":"2024-04-26T20:57:50.534132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:50.552713+0000","last_undegraded":"2024-04-26T20:57:50.552713+0000","last_fullsized":"2024-04-26T20:57:50.552713+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-26T20:57:50.550542+0000","last_change":"2024-04-26T20:57:50.550542+0000","last_active":"2024-04-26T20:57:50.534132+0000","last_peered":"2024-04-26T20:57:50.534132+0000","last_clean":"2024-04-26T20:57:50.534132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:50.550542+0000","last_undegraded":"2024-04-26T20:57:50.550542+0000","last_fullsized":"2024-04-26T20:57:50.550542+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.561404+0000","last_change":"2024-04-26T20:57:51.574572+0000","last_active":"2024-04-26T20:57:52.561404+0000","last_peered":"2024-04-26T20:57:52.561404+0000","last_clean":"2024-04-26T20:57:52.561404+0000","last_became_active":"2024-04-26T20:57:51.574213+0000","last_became_peered":"2024-04-26T20:57:51.574213+0000","last_unstale":"2024-04-26T20:57:52.561404+0000","last_undegraded":"2024-04-26T20:57:52.561404+0000","last_fullsized":"2024-04-26T20:57:52.561404+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:10:26.507698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-26T20:57:50.549831+0000","last_change":"2024-04-26T20:57:50.549831+0000","last_active":"2024-04-26T20:57:50.534132+0000","last_peered":"2024-04-26T20:57:50.534132+0000","last_clean":"2024-04-26T20:57:50.534132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:50.549831+0000","last_undegraded":"2024-04-26T20:57:50.549831+0000","last_fullsized":"2024-04-26T20:57:50.549831+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.590985+0000","last_change":"2024-04-26T20:57:52.575008+0000","last_active":"2024-04-26T20:57:52.590985+0000","last_peered":"2024-04-26T20:57:52.590985+0000","last_clean":"2024-04-26T20:57:52.590985+0000","last_became_active":"2024-04-26T20:57:52.574553+0000","last_became_peered":"2024-04-26T20:57:52.574553+0000","last_unstale":"2024-04-26T20:57:52.590985+0000","last_undegraded":"2024-04-26T20:57:52.590985+0000","last_fullsized":"2024-04-26T20:57:52.590985+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:03:23.551336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.563732+0000","last_change":"2024-04-26T20:57:51.576675+0000","last_active":"2024-04-26T20:57:52.563732+0000","last_peered":"2024-04-26T20:57:52.563732+0000","last_clean":"2024-04-26T20:57:52.563732+0000","last_became_active":"2024-04-26T20:57:51.576394+0000","last_became_peered":"2024-04-26T20:57:51.576394+0000","last_unstale":"2024-04-26T20:57:52.563732+0000","last_undegraded":"2024-04-26T20:57:52.563732+0000","last_fullsized":"2024-04-26T20:57:52.563732+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:44:14.717022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-26T20:57:50.548856+0000","last_change":"2024-04-26T20:57:50.548856+0000","last_active":"2024-04-26T20:57:50.534132+0000","last_peered":"2024-04-26T20:57:50.534132+0000","last_clean":"2024-04-26T20:57:50.534132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:50.548856+0000","last_undegraded":"2024-04-26T20:57:50.548856+0000","last_fullsized":"2024-04-26T20:57:50.548856+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.597943+0000","last_change":"2024-04-26T20:57:52.593299+0000","last_active":"2024-04-26T20:57:52.597943+0000","last_peered":"2024-04-26T20:57:52.597943+0000","last_clean":"2024-04-26T20:57:52.597943+0000","last_became_active":"2024-04-26T20:57:52.591280+0000","last_became_peered":"2024-04-26T20:57:52.591280+0000","last_unstale":"2024-04-26T20:57:52.597943+0000","last_undegraded":"2024-04-26T20:57:52.597943+0000","last_fullsized":"2024-04-26T20:57:52.597943+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:44:43.597451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-26T20:57:50.548109+0000","last_change":"2024-04-26T20:57:50.548109+0000","last_active":"2024-04-26T20:57:50.534132+0000","last_peered":"2024-04-26T20:57:50.534132+0000","last_clean":"2024-04-26T20:57:50.534132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:50.548109+0000","last_undegraded":"2024-04-26T20:57:50.548109+0000","last_fullsized":"2024-04-26T20:57:50.548109+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.598025+0000","last_change":"2024-04-26T20:57:51.574348+0000","last_active":"2024-04-26T20:57:52.598025+0000","last_peered":"2024-04-26T20:57:52.598025+0000","last_clean":"2024-04-26T20:57:52.598025+0000","last_became_active":"2024-04-26T20:57:51.574023+0000","last_became_peered":"2024-04-26T20:57:51.574023+0000","last_unstale":"2024-04-26T20:57:52.598025+0000","last_undegraded":"2024-04-26T20:57:52.598025+0000","last_fullsized":"2024-04-26T20:57:52.598025+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:29:31.014100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.594378+0000","last_change":"2024-04-26T20:57:52.583405+0000","last_active":"2024-04-26T20:57:52.594378+0000","last_peered":"2024-04-26T20:57:52.594378+0000","last_clean":"2024-04-26T20:57:52.594378+0000","last_became_active":"2024-04-26T20:57:52.582257+0000","last_became_peered":"2024-04-26T20:57:52.582257+0000","last_unstale":"2024-04-26T20:57:52.594378+0000","last_undegraded":"2024-04-26T20:57:52.594378+0000","last_fullsized":"2024-04-26T20:57:52.594378+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:04.761374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.581443+0000","last_change":"2024-04-26T20:57:51.572541+0000","last_active":"2024-04-26T20:57:52.581443+0000","last_peered":"2024-04-26T20:57:52.581443+0000","last_clean":"2024-04-26T20:57:52.581443+0000","last_became_active":"2024-04-26T20:57:51.571967+0000","last_became_peered":"2024-04-26T20:57:51.571967+0000","last_unstale":"2024-04-26T20:57:52.581443+0000","last_undegraded":"2024-04-26T20:57:52.581443+0000","last_fullsized":"2024-04-26T20:57:52.581443+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:11:04.894675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-26T20:57:50.546721+0000","last_change":"2024-04-26T20:57:50.546721+0000","last_active":"2024-04-26T20:57:50.534132+0000","last_peered":"2024-04-26T20:57:50.534132+0000","last_clean":"2024-04-26T20:57:50.534132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:50.546721+0000","last_undegraded":"2024-04-26T20:57:50.546721+0000","last_fullsized":"2024-04-26T20:57:50.546721+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-26T20:57:50.548912+0000","last_change":"2024-04-26T20:57:50.548912+0000","last_active":"2024-04-26T20:57:50.534132+0000","last_peered":"2024-04-26T20:57:50.534132+0000","last_clean":"2024-04-26T20:57:50.534132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:50.548912+0000","last_undegraded":"2024-04-26T20:57:50.548912+0000","last_fullsized":"2024-04-26T20:57:50.548912+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-26T20:57:50.552609+0000","last_change":"2024-04-26T20:57:50.552609+0000","last_active":"2024-04-26T20:57:50.534132+0000","last_peered":"2024-04-26T20:57:50.534132+0000","last_clean":"2024-04-26T20:57:50.534132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:50.552609+0000","last_undegraded":"2024-04-26T20:57:50.552609+0000","last_fullsized":"2024-04-26T20:57:50.552609+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-26T20:57:50.551229+0000","last_change":"2024-04-26T20:57:50.551229+0000","last_active":"2024-04-26T20:57:50.534132+0000","last_peered":"2024-04-26T20:57:50.534132+0000","last_clean":"2024-04-26T20:57:50.534132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:50.551229+0000","last_undegraded":"2024-04-26T20:57:50.551229+0000","last_fullsized":"2024-04-26T20:57:50.551229+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-26T20:57:50.548355+0000","last_change":"2024-04-26T20:57:50.548355+0000","last_active":"2024-04-26T20:57:50.534132+0000","last_peered":"2024-04-26T20:57:50.534132+0000","last_clean":"2024-04-26T20:57:50.534132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:50.548355+0000","last_undegraded":"2024-04-26T20:57:50.548355+0000","last_fullsized":"2024-04-26T20:57:50.548355+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-26T20:57:50.546845+0000","last_change":"2024-04-26T20:57:50.546845+0000","last_active":"2024-04-26T20:57:50.534132+0000","last_peered":"2024-04-26T20:57:50.534132+0000","last_clean":"2024-04-26T20:57:50.534132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:50.546845+0000","last_undegraded":"2024-04-26T20:57:50.546845+0000","last_fullsized":"2024-04-26T20:57:50.546845+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-26T20:57:50.553653+0000","last_change":"2024-04-26T20:57:50.553653+0000","last_active":"2024-04-26T20:57:50.534132+0000","last_peered":"2024-04-26T20:57:50.534132+0000","last_clean":"2024-04-26T20:57:50.534132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:50.553653+0000","last_undegraded":"2024-04-26T20:57:50.553653+0000","last_fullsized":"2024-04-26T20:57:50.553653+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-26T20:57:50.553573+0000","last_change":"2024-04-26T20:57:50.553573+0000","last_active":"2024-04-26T20:57:50.534132+0000","last_peered":"2024-04-26T20:57:50.534132+0000","last_clean":"2024-04-26T20:57:50.534132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:50.553573+0000","last_undegraded":"2024-04-26T20:57:50.553573+0000","last_fullsized":"2024-04-26T20:57:50.553573+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.588400+0000","last_change":"2024-04-26T20:57:52.570952+0000","last_active":"2024-04-26T20:57:52.588400+0000","last_peered":"2024-04-26T20:57:52.588400+0000","last_clean":"2024-04-26T20:57:52.588400+0000","last_became_active":"2024-04-26T20:57:52.570601+0000","last_became_peered":"2024-04-26T20:57:52.570601+0000","last_unstale":"2024-04-26T20:57:52.588400+0000","last_undegraded":"2024-04-26T20:57:52.588400+0000","last_fullsized":"2024-04-26T20:57:52.588400+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:14:41.960247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-26T20:57:50.546168+0000","last_change":"2024-04-26T20:57:50.546168+0000","last_active":"2024-04-26T20:57:50.534132+0000","last_peered":"2024-04-26T20:57:50.534132+0000","last_clean":"2024-04-26T20:57:50.534132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:50.546168+0000","last_undegraded":"2024-04-26T20:57:50.546168+0000","last_fullsized":"2024-04-26T20:57:50.546168+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-26T20:57:50.550243+0000","last_change":"2024-04-26T20:57:50.550243+0000","last_active":"2024-04-26T20:57:50.534132+0000","last_peered":"2024-04-26T20:57:50.534132+0000","last_clean":"2024-04-26T20:57:50.534132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:50.550243+0000","last_undegraded":"2024-04-26T20:57:50.550243+0000","last_fullsized":"2024-04-26T20:57:50.550243+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.585479+0000","last_change":"2024-04-26T20:57:52.570583+0000","last_active":"2024-04-26T20:57:52.585479+0000","last_peered":"2024-04-26T20:57:52.585479+0000","last_clean":"2024-04-26T20:57:52.585479+0000","last_became_active":"2024-04-26T20:57:52.570303+0000","last_became_peered":"2024-04-26T20:57:52.570303+0000","last_unstale":"2024-04-26T20:57:52.585479+0000","last_undegraded":"2024-04-26T20:57:52.585479+0000","last_fullsized":"2024-04-26T20:57:52.585479+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:45:31.989965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-26T20:57:50.546153+0000","last_change":"2024-04-26T20:57:50.546153+0000","last_active":"2024-04-26T20:57:50.534132+0000","last_peered":"2024-04-26T20:57:50.534132+0000","last_clean":"2024-04-26T20:57:50.534132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:50.546153+0000","last_undegraded":"2024-04-26T20:57:50.546153+0000","last_fullsized":"2024-04-26T20:57:50.546153+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-26T20:57:50.548269+0000","last_change":"2024-04-26T20:57:50.548269+0000","last_active":"2024-04-26T20:57:50.534132+0000","last_peered":"2024-04-26T20:57:50.534132+0000","last_clean":"2024-04-26T20:57:50.534132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:50.548269+0000","last_undegraded":"2024-04-26T20:57:50.548269+0000","last_fullsized":"2024-04-26T20:57:50.548269+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-26T20:57:50.546364+0000","last_change":"2024-04-26T20:57:50.546364+0000","last_active":"2024-04-26T20:57:50.534132+0000","last_peered":"2024-04-26T20:57:50.534132+0000","last_clean":"2024-04-26T20:57:50.534132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:50.546364+0000","last_undegraded":"2024-04-26T20:57:50.546364+0000","last_fullsized":"2024-04-26T20:57:50.546364+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-26T20:57:50.546174+0000","last_change":"2024-04-26T20:57:50.546174+0000","last_active":"2024-04-26T20:57:50.534132+0000","last_peered":"2024-04-26T20:57:50.534132+0000","last_clean":"2024-04-26T20:57:50.534132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:50.546174+0000","last_undegraded":"2024-04-26T20:57:50.546174+0000","last_fullsized":"2024-04-26T20:57:50.546174+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.561642+0000","last_change":"2024-04-26T20:57:51.571206+0000","last_active":"2024-04-26T20:57:52.561642+0000","last_peered":"2024-04-26T20:57:52.561642+0000","last_clean":"2024-04-26T20:57:52.561642+0000","last_became_active":"2024-04-26T20:57:51.570877+0000","last_became_peered":"2024-04-26T20:57:51.570877+0000","last_unstale":"2024-04-26T20:57:52.561642+0000","last_undegraded":"2024-04-26T20:57:52.561642+0000","last_fullsized":"2024-04-26T20:57:52.561642+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:49:38.164099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-26T20:57:50.545719+0000","last_change":"2024-04-26T20:57:50.545719+0000","last_active":"2024-04-26T20:57:50.534132+0000","last_peered":"2024-04-26T20:57:50.534132+0000","last_clean":"2024-04-26T20:57:50.534132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:50.545719+0000","last_undegraded":"2024-04-26T20:57:50.545719+0000","last_fullsized":"2024-04-26T20:57:50.545719+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-26T20:57:50.548262+0000","last_change":"2024-04-26T20:57:50.548262+0000","last_active":"2024-04-26T20:57:50.534132+0000","last_peered":"2024-04-26T20:57:50.534132+0000","last_clean":"2024-04-26T20:57:50.534132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:50.548262+0000","last_undegraded":"2024-04-26T20:57:50.548262+0000","last_fullsized":"2024-04-26T20:57:50.548262+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.570297+0000","last_change":"2024-04-26T20:57:51.579142+0000","last_active":"2024-04-26T20:57:52.570297+0000","last_peered":"2024-04-26T20:57:52.570297+0000","last_clean":"2024-04-26T20:57:52.570297+0000","last_became_active":"2024-04-26T20:57:51.578834+0000","last_became_peered":"2024-04-26T20:57:51.578834+0000","last_unstale":"2024-04-26T20:57:52.570297+0000","last_undegraded":"2024-04-26T20:57:52.570297+0000","last_fullsized":"2024-04-26T20:57:52.570297+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:48:04.831644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-26T20:57:50.545776+0000","last_change":"2024-04-26T20:57:50.545776+0000","last_active":"2024-04-26T20:57:50.534132+0000","last_peered":"2024-04-26T20:57:50.534132+0000","last_clean":"2024-04-26T20:57:50.534132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:50.545776+0000","last_undegraded":"2024-04-26T20:57:50.545776+0000","last_fullsized":"2024-04-26T20:57:50.545776+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":198,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T20:57:50.550171+0000","last_change":"2024-04-26T20:56:29.347462+0000","last_active":"2024-04-26T20:57:50.550171+0000","last_peered":"2024-04-26T20:57:50.550171+0000","last_clean":"2024-04-26T20:57:50.550171+0000","last_became_active":"2024-04-26T20:56:29.346224+0000","last_became_peered":"2024-04-26T20:56:29.346224+0000","last_unstale":"2024-04-26T20:57:50.550171+0000","last_undegraded":"2024-04-26T20:57:50.550171+0000","last_fullsized":"2024-04-26T20:57:50.550171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:28.079105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:28.079105+0000","last_clean_scrub_stamp":"2024-04-26T20:56:28.079105+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:13.693525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":26,"acting":26,"num_store_stats":1},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1646,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509461,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":179097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509460,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":179097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509461,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1024000,"data_stored":769465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509461,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":172888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509461,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":179097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509460,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1024000,"data_stored":769465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509459,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":179097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":475136,"data_stored":194667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T20:57:56.659 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T20:57:56.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.836+0000 7f8dad800640 1 Processor -- start 2024-04-26T20:57:56.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.836+0000 7f8dad800640 1 -- start start 2024-04-26T20:57:56.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.836+0000 7f8dad800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8da8073be0 0x7f8da81664e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:56.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.836+0000 7f8dad800640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8da8072130 con 0x7f8da80cba90 2024-04-26T20:57:56.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.840+0000 7f8dad800640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8da815cae0 con 0x7f8da8159250 2024-04-26T20:57:56.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.840+0000 7f8dad800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f8da815f4e0 con 0x7f8da8073be0 2024-04-26T20:57:56.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.840+0000 7f8d9e000640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f8da80cba90 0x7f8da815bb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:58840/0 (socket says 172.21.15.138:58840) 2024-04-26T20:57:56.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.840+0000 7f8d9e000640 1 -- 172.21.15.138:0/2454675570 learned_addr learned my addr 172.21.15.138:0/2454675570 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:56.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.840+0000 7f8da7400640 1 --2- 172.21.15.138:0/2454675570 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8da8073be0 0x7f8da81664e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:56.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.840+0000 7f8da6000640 1 -- 172.21.15.138:0/2454675570 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3413502233 0 0) 0x7f8da8072130 con 0x7f8da80cba90 2024-04-26T20:57:56.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.840+0000 7f8da6000640 1 -- 172.21.15.138:0/2454675570 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d8c003530 con 0x7f8da80cba90 2024-04-26T20:57:56.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.840+0000 7f8da6000640 1 -- 172.21.15.138:0/2454675570 <== mon.0 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3219082631 0 0) 0x7f8d8c003530 con 0x7f8da80cba90 2024-04-26T20:57:56.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.840+0000 7f8da6000640 1 -- 172.21.15.138:0/2454675570 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8da8073be0 msgr2=0x7f8da81664e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:56.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.840+0000 7f8da6000640 1 --2- 172.21.15.138:0/2454675570 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8da8073be0 0x7f8da81664e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:56.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.840+0000 7f8da6000640 1 -- 172.21.15.138:0/2454675570 >> v1:172.21.15.143:6789/0 conn(0x7f8da8159250 legacy=0x7f8da80cb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:56.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.840+0000 7f8da6000640 1 -- 172.21.15.138:0/2454675570 --> v1:172.21.15.138:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8da815c800 con 0x7f8da80cba90 2024-04-26T20:57:56.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.840+0000 7f8da6000640 1 -- 172.21.15.138:0/2454675570 <== mon.0 v1:172.21.15.138:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2715389689 0 0) 0x7f8d90001680 con 0x7f8da80cba90 2024-04-26T20:57:56.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.840+0000 7f8da6000640 1 -- 172.21.15.138:0/2454675570 >> v1:172.21.15.138:6789/0 conn(0x7f8da80cba90 legacy=0x7f8da815bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:56.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.840+0000 7f8da6000640 1 --2- 172.21.15.138:0/2454675570 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d8c0039f0 0x7f8d8c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:56.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.840+0000 7f8da6000640 1 --2- 172.21.15.138:0/2454675570 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8da8073be0 0x7f8d8c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:56.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.840+0000 7f8da6000640 1 --2- 172.21.15.138:0/2454675570 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8d8c004d50 0x7f8d8c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:56.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.840+0000 7f8da6000640 1 -- 172.21.15.138:0/2454675570 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f8da815f4e0 con 0x7f8d8c004d50 2024-04-26T20:57:56.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.840+0000 7f8da6000640 1 -- 172.21.15.138:0/2454675570 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f8d8c00ba80 con 0x7f8d8c0039f0 2024-04-26T20:57:56.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.840+0000 7f8da6000640 1 -- 172.21.15.138:0/2454675570 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f8d8c00de90 con 0x7f8da8073be0 2024-04-26T20:57:56.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.840+0000 7f8da7400640 1 --2- 172.21.15.138:0/2454675570 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8d8c004d50 0x7f8d8c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:56.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.840+0000 7f8da6a00640 1 --2- 172.21.15.138:0/2454675570 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d8c0039f0 0x7f8d8c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:56.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.840+0000 7f8d9e000640 1 --2- 172.21.15.138:0/2454675570 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8da8073be0 0x7f8d8c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:56.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.840+0000 7f8da7400640 1 -- 172.21.15.138:0/2454675570 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8da8073be0 msgr2=0x7f8d8c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:56.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.840+0000 7f8da7400640 1 --2- 172.21.15.138:0/2454675570 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8da8073be0 0x7f8d8c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:56.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.840+0000 7f8da7400640 1 -- 172.21.15.138:0/2454675570 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d8c0039f0 msgr2=0x7f8d8c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:56.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.840+0000 7f8da7400640 1 --2- 172.21.15.138:0/2454675570 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d8c0039f0 0x7f8d8c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:56.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.840+0000 7f8da7400640 1 -- 172.21.15.138:0/2454675570 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d8c003530 con 0x7f8d8c004d50 2024-04-26T20:57:56.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.840+0000 7f8d9e000640 1 --2- 172.21.15.138:0/2454675570 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8da8073be0 0x7f8d8c004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:57:56.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.844+0000 7f8da7400640 1 --2- 172.21.15.138:0/2454675570 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8d8c004d50 0x7f8d8c0051d0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f8da0009fc0 tx=0x7f8da001cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d392b655bbba205f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:56.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.844+0000 7f8da6000640 1 -- 172.21.15.138:0/2454675570 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da00b2070 con 0x7f8d8c004d50 2024-04-26T20:57:56.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.844+0000 7f8da6000640 1 -- 172.21.15.138:0/2454675570 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8da00a59f0 con 0x7f8d8c004d50 2024-04-26T20:57:56.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.844+0000 7f8da6000640 1 -- 172.21.15.138:0/2454675570 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da0009c10 con 0x7f8d8c004d50 2024-04-26T20:57:56.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.844+0000 7f8dad800640 1 -- 172.21.15.138:0/2454675570 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8d8c004d50 msgr2=0x7f8d8c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:56.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.844+0000 7f8dad800640 1 --2- 172.21.15.138:0/2454675570 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8d8c004d50 0x7f8d8c0051d0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f8da0009fc0 tx=0x7f8da001cc80 comp rx=0 tx=0).stop 2024-04-26T20:57:56.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.844+0000 7f8da7400640 1 -- 172.21.15.138:0/2454675570 reap_dead start 2024-04-26T20:57:56.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.844+0000 7f8dad800640 1 -- 172.21.15.138:0/2454675570 shutdown_connections 2024-04-26T20:57:56.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.844+0000 7f8dad800640 1 -- 172.21.15.138:0/2454675570 >> 172.21.15.138:0/2454675570 conn(0x7f8da80d0b20 msgr2=0x7f8da80d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:56.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.844+0000 7f8dad800640 1 -- 172.21.15.138:0/2454675570 shutdown_connections 2024-04-26T20:57:56.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.844+0000 7f8dad800640 1 -- 172.21.15.138:0/2454675570 wait complete. 2024-04-26T20:57:56.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.844+0000 7f8dad800640 1 Processor -- start 2024-04-26T20:57:56.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.844+0000 7f8dad800640 1 -- start start 2024-04-26T20:57:56.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.848+0000 7f8dad800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d8c004d50 0x7f8da80ca980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:56.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.848+0000 7f8dad800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8da814eb70 0x7f8da814e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:56.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.848+0000 7f8dad800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8da8159cc0 0x7f8da815a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:56.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.848+0000 7f8dad800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f8da8166870 con 0x7f8da8159cc0 2024-04-26T20:57:56.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.848+0000 7f8dad800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f8da81666f0 con 0x7f8d8c004d50 2024-04-26T20:57:56.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.848+0000 7f8dad800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f8da81669f0 con 0x7f8da814eb70 2024-04-26T20:57:56.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.848+0000 7f8da7400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8da8159cc0 0x7f8da815a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:56.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.848+0000 7f8da7400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8da8159cc0 0x7f8da815a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:53064/0 (socket says 172.21.15.138:53064) 2024-04-26T20:57:56.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.848+0000 7f8da7400640 1 -- 172.21.15.138:0/950629055 learned_addr learned my addr 172.21.15.138:0/950629055 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:56.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.848+0000 7f8da6a00640 1 --2- 172.21.15.138:0/950629055 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d8c004d50 0x7f8da80ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:56.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.848+0000 7f8d9e000640 1 --2- 172.21.15.138:0/950629055 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8da814eb70 0x7f8da814e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:56.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.848+0000 7f8da7400640 1 -- 172.21.15.138:0/950629055 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8da814eb70 msgr2=0x7f8da814e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:56.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.848+0000 7f8da7400640 1 --2- 172.21.15.138:0/950629055 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8da814eb70 0x7f8da814e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:56.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.848+0000 7f8da7400640 1 -- 172.21.15.138:0/950629055 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d8c004d50 msgr2=0x7f8da80ca980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:56.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.848+0000 7f8da7400640 1 --2- 172.21.15.138:0/950629055 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d8c004d50 0x7f8da80ca980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:56.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.848+0000 7f8da7400640 1 -- 172.21.15.138:0/950629055 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8da81514d0 con 0x7f8da8159cc0 2024-04-26T20:57:56.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.848+0000 7f8da7400640 1 --2- 172.21.15.138:0/950629055 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8da8159cc0 0x7f8da815a140 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f8da0002240 tx=0x7f8da0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:56.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.848+0000 7f8d9f400640 1 -- 172.21.15.138:0/950629055 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da00bb070 con 0x7f8da8159cc0 2024-04-26T20:57:56.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.848+0000 7f8d9f400640 1 -- 172.21.15.138:0/950629055 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8da00a57f0 con 0x7f8da8159cc0 2024-04-26T20:57:56.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.848+0000 7f8dad800640 1 -- 172.21.15.138:0/950629055 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8da81517b0 con 0x7f8da8159cc0 2024-04-26T20:57:56.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.848+0000 7f8d9f400640 1 -- 172.21.15.138:0/950629055 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da00b2040 con 0x7f8da8159cc0 2024-04-26T20:57:56.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.848+0000 7f8dad800640 1 -- 172.21.15.138:0/950629055 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8da8151170 con 0x7f8da8159cc0 2024-04-26T20:57:56.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.848+0000 7f8dad800640 1 -- 172.21.15.138:0/950629055 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8da80cd530 con 0x7f8da8159cc0 2024-04-26T20:57:56.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.848+0000 7f8d9f400640 1 -- 172.21.15.138:0/950629055 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8da00be070 con 0x7f8da8159cc0 2024-04-26T20:57:56.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.852+0000 7f8d9f400640 1 --2- 172.21.15.138:0/950629055 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f8d84068380 0x7f8d8406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:56.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.852+0000 7f8d9f400640 1 -- 172.21.15.138:0/950629055 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f8da0120290 con 0x7f8da8159cc0 2024-04-26T20:57:56.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.852+0000 7f8da6a00640 1 --2- 172.21.15.138:0/950629055 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f8d84068380 0x7f8d8406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:56.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.852+0000 7f8da6a00640 1 --2- 172.21.15.138:0/950629055 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f8d84068380 0x7f8d8406a840 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8d98000c10 tx=0x7f8d98009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:56.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:56.856+0000 7f8d9f400640 1 -- 172.21.15.138:0/950629055 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8da0016990 con 0x7f8da8159cc0 2024-04-26T20:57:57.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.008+0000 7f8dad800640 1 -- 172.21.15.138:0/950629055 --> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8da8069510 con 0x7f8d84068380 2024-04-26T20:57:57.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.016+0000 7f8d9f400640 1 -- 172.21.15.138:0/950629055 <== mgr.4100 v2:172.21.15.143:6832/4275464198 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242398 (secure 0 0 0) 0x7f8da8069510 con 0x7f8d84068380 2024-04-26T20:57:57.019 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:57:57.021 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-04-26T20:57:57.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.020+0000 7f8dad800640 1 -- 172.21.15.138:0/950629055 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f8d84068380 msgr2=0x7f8d8406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:57.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.020+0000 7f8dad800640 1 --2- 172.21.15.138:0/950629055 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f8d84068380 0x7f8d8406a840 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8d98000c10 tx=0x7f8d98009040 comp rx=0 tx=0).stop 2024-04-26T20:57:57.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.020+0000 7f8dad800640 1 -- 172.21.15.138:0/950629055 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8da8159cc0 msgr2=0x7f8da815a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:57.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.020+0000 7f8dad800640 1 --2- 172.21.15.138:0/950629055 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8da8159cc0 0x7f8da815a140 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f8da0002240 tx=0x7f8da0009750 comp rx=0 tx=0).stop 2024-04-26T20:57:57.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.020+0000 7f8dad800640 1 -- 172.21.15.138:0/950629055 shutdown_connections 2024-04-26T20:57:57.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.020+0000 7f8dad800640 1 --2- 172.21.15.138:0/950629055 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f8d84068380 0x7f8d8406a840 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:57.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.020+0000 7f8dad800640 1 --2- 172.21.15.138:0/950629055 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8da8159cc0 0x7f8da815a140 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:57.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.020+0000 7f8dad800640 1 --2- 172.21.15.138:0/950629055 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8da814eb70 0x7f8da814e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:57.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.020+0000 7f8dad800640 1 --2- 172.21.15.138:0/950629055 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d8c004d50 0x7f8da80ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:57.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.020+0000 7f8dad800640 1 -- 172.21.15.138:0/950629055 >> 172.21.15.138:0/950629055 conn(0x7f8da80d0b20 msgr2=0x7f8da815ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:57.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.020+0000 7f8dad800640 1 -- 172.21.15.138:0/950629055 shutdown_connections 2024-04-26T20:57:57.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.020+0000 7f8dad800640 1 -- 172.21.15.138:0/950629055 wait complete. 2024-04-26T20:57:57.040 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":80,"stamp":"2024-04-26T20:57:55.259253+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592014,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":171,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":127,"ondisk_log_size":127,"up":92,"acting":92,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":53,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220728,"kb_used_data":4552,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753992,"statfs":{"total":773094113280,"available":772868087808,"internally_reserved":0,"allocated":4661248,"data_stored":2622873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1646,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.715593"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.593260+0000","last_change":"2024-04-26T20:57:52.581808+0000","last_active":"2024-04-26T20:57:52.593260+0000","last_peered":"2024-04-26T20:57:52.593260+0000","last_clean":"2024-04-26T20:57:52.593260+0000","last_became_active":"2024-04-26T20:57:52.581483+0000","last_became_peered":"2024-04-26T20:57:52.581483+0000","last_unstale":"2024-04-26T20:57:52.593260+0000","last_undegraded":"2024-04-26T20:57:52.593260+0000","last_fullsized":"2024-04-26T20:57:52.593260+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:55:05.593379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.597744+0000","last_change":"2024-04-26T20:57:52.589332+0000","last_active":"2024-04-26T20:57:52.597744+0000","last_peered":"2024-04-26T20:57:52.597744+0000","last_clean":"2024-04-26T20:57:52.597744+0000","last_became_active":"2024-04-26T20:57:52.589025+0000","last_became_peered":"2024-04-26T20:57:52.589025+0000","last_unstale":"2024-04-26T20:57:52.597744+0000","last_undegraded":"2024-04-26T20:57:52.597744+0000","last_fullsized":"2024-04-26T20:57:52.597744+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:15:08.538065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.591009+0000","last_change":"2024-04-26T20:57:52.577582+0000","last_active":"2024-04-26T20:57:52.591009+0000","last_peered":"2024-04-26T20:57:52.591009+0000","last_clean":"2024-04-26T20:57:52.591009+0000","last_became_active":"2024-04-26T20:57:52.576872+0000","last_became_peered":"2024-04-26T20:57:52.576872+0000","last_unstale":"2024-04-26T20:57:52.591009+0000","last_undegraded":"2024-04-26T20:57:52.591009+0000","last_fullsized":"2024-04-26T20:57:52.591009+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:26:56.698718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.594421+0000","last_change":"2024-04-26T20:57:52.583828+0000","last_active":"2024-04-26T20:57:52.594421+0000","last_peered":"2024-04-26T20:57:52.594421+0000","last_clean":"2024-04-26T20:57:52.594421+0000","last_became_active":"2024-04-26T20:57:52.582894+0000","last_became_peered":"2024-04-26T20:57:52.582894+0000","last_unstale":"2024-04-26T20:57:52.594421+0000","last_undegraded":"2024-04-26T20:57:52.594421+0000","last_fullsized":"2024-04-26T20:57:52.594421+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:09:22.814425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.594443+0000","last_change":"2024-04-26T20:57:52.584019+0000","last_active":"2024-04-26T20:57:52.594443+0000","last_peered":"2024-04-26T20:57:52.594443+0000","last_clean":"2024-04-26T20:57:52.594443+0000","last_became_active":"2024-04-26T20:57:52.583140+0000","last_became_peered":"2024-04-26T20:57:52.583140+0000","last_unstale":"2024-04-26T20:57:52.594443+0000","last_undegraded":"2024-04-26T20:57:52.594443+0000","last_fullsized":"2024-04-26T20:57:52.594443+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:31:16.104032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.594480+0000","last_change":"2024-04-26T20:57:52.585325+0000","last_active":"2024-04-26T20:57:52.594480+0000","last_peered":"2024-04-26T20:57:52.594480+0000","last_clean":"2024-04-26T20:57:52.594480+0000","last_became_active":"2024-04-26T20:57:52.585083+0000","last_became_peered":"2024-04-26T20:57:52.585083+0000","last_unstale":"2024-04-26T20:57:52.594480+0000","last_undegraded":"2024-04-26T20:57:52.594480+0000","last_fullsized":"2024-04-26T20:57:52.594480+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:05:21.832612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.594400+0000","last_change":"2024-04-26T20:57:52.583636+0000","last_active":"2024-04-26T20:57:52.594400+0000","last_peered":"2024-04-26T20:57:52.594400+0000","last_clean":"2024-04-26T20:57:52.594400+0000","last_became_active":"2024-04-26T20:57:52.582497+0000","last_became_peered":"2024-04-26T20:57:52.582497+0000","last_unstale":"2024-04-26T20:57:52.594400+0000","last_undegraded":"2024-04-26T20:57:52.594400+0000","last_fullsized":"2024-04-26T20:57:52.594400+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:16:51.269657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-26T20:57:50.552717+0000","last_change":"2024-04-26T20:57:50.552717+0000","last_active":"2024-04-26T20:57:50.534132+0000","last_peered":"2024-04-26T20:57:50.534132+0000","last_clean":"2024-04-26T20:57:50.534132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:50.552717+0000","last_undegraded":"2024-04-26T20:57:50.552717+0000","last_fullsized":"2024-04-26T20:57:50.552717+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-26T20:57:50.546168+0000","last_change":"2024-04-26T20:57:50.546168+0000","last_active":"2024-04-26T20:57:50.534132+0000","last_peered":"2024-04-26T20:57:50.534132+0000","last_clean":"2024-04-26T20:57:50.534132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:50.546168+0000","last_undegraded":"2024-04-26T20:57:50.546168+0000","last_fullsized":"2024-04-26T20:57:50.546168+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.588846+0000","last_change":"2024-04-26T20:57:51.573664+0000","last_active":"2024-04-26T20:57:52.588846+0000","last_peered":"2024-04-26T20:57:52.588846+0000","last_clean":"2024-04-26T20:57:52.588846+0000","last_became_active":"2024-04-26T20:57:51.572927+0000","last_became_peered":"2024-04-26T20:57:51.572927+0000","last_unstale":"2024-04-26T20:57:52.588846+0000","last_undegraded":"2024-04-26T20:57:52.588846+0000","last_fullsized":"2024-04-26T20:57:52.588846+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:04:55.596385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-26T20:57:50.552729+0000","last_change":"2024-04-26T20:57:50.552729+0000","last_active":"2024-04-26T20:57:50.534132+0000","last_peered":"2024-04-26T20:57:50.534132+0000","last_clean":"2024-04-26T20:57:50.534132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:50.552729+0000","last_undegraded":"2024-04-26T20:57:50.552729+0000","last_fullsized":"2024-04-26T20:57:50.552729+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.594461+0000","last_change":"2024-04-26T20:57:52.587538+0000","last_active":"2024-04-26T20:57:52.594461+0000","last_peered":"2024-04-26T20:57:52.594461+0000","last_clean":"2024-04-26T20:57:52.594461+0000","last_became_active":"2024-04-26T20:57:52.587138+0000","last_became_peered":"2024-04-26T20:57:52.587138+0000","last_unstale":"2024-04-26T20:57:52.594461+0000","last_undegraded":"2024-04-26T20:57:52.594461+0000","last_fullsized":"2024-04-26T20:57:52.594461+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:39:40.382481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-26T20:57:50.552713+0000","last_change":"2024-04-26T20:57:50.552713+0000","last_active":"2024-04-26T20:57:50.534132+0000","last_peered":"2024-04-26T20:57:50.534132+0000","last_clean":"2024-04-26T20:57:50.534132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:50.552713+0000","last_undegraded":"2024-04-26T20:57:50.552713+0000","last_fullsized":"2024-04-26T20:57:50.552713+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-26T20:57:50.550542+0000","last_change":"2024-04-26T20:57:50.550542+0000","last_active":"2024-04-26T20:57:50.534132+0000","last_peered":"2024-04-26T20:57:50.534132+0000","last_clean":"2024-04-26T20:57:50.534132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:50.550542+0000","last_undegraded":"2024-04-26T20:57:50.550542+0000","last_fullsized":"2024-04-26T20:57:50.550542+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.561404+0000","last_change":"2024-04-26T20:57:51.574572+0000","last_active":"2024-04-26T20:57:52.561404+0000","last_peered":"2024-04-26T20:57:52.561404+0000","last_clean":"2024-04-26T20:57:52.561404+0000","last_became_active":"2024-04-26T20:57:51.574213+0000","last_became_peered":"2024-04-26T20:57:51.574213+0000","last_unstale":"2024-04-26T20:57:52.561404+0000","last_undegraded":"2024-04-26T20:57:52.561404+0000","last_fullsized":"2024-04-26T20:57:52.561404+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:10:26.507698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-26T20:57:50.549831+0000","last_change":"2024-04-26T20:57:50.549831+0000","last_active":"2024-04-26T20:57:50.534132+0000","last_peered":"2024-04-26T20:57:50.534132+0000","last_clean":"2024-04-26T20:57:50.534132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:50.549831+0000","last_undegraded":"2024-04-26T20:57:50.549831+0000","last_fullsized":"2024-04-26T20:57:50.549831+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.590985+0000","last_change":"2024-04-26T20:57:52.575008+0000","last_active":"2024-04-26T20:57:52.590985+0000","last_peered":"2024-04-26T20:57:52.590985+0000","last_clean":"2024-04-26T20:57:52.590985+0000","last_became_active":"2024-04-26T20:57:52.574553+0000","last_became_peered":"2024-04-26T20:57:52.574553+0000","last_unstale":"2024-04-26T20:57:52.590985+0000","last_undegraded":"2024-04-26T20:57:52.590985+0000","last_fullsized":"2024-04-26T20:57:52.590985+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:03:23.551336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.563732+0000","last_change":"2024-04-26T20:57:51.576675+0000","last_active":"2024-04-26T20:57:52.563732+0000","last_peered":"2024-04-26T20:57:52.563732+0000","last_clean":"2024-04-26T20:57:52.563732+0000","last_became_active":"2024-04-26T20:57:51.576394+0000","last_became_peered":"2024-04-26T20:57:51.576394+0000","last_unstale":"2024-04-26T20:57:52.563732+0000","last_undegraded":"2024-04-26T20:57:52.563732+0000","last_fullsized":"2024-04-26T20:57:52.563732+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:44:14.717022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-26T20:57:50.548856+0000","last_change":"2024-04-26T20:57:50.548856+0000","last_active":"2024-04-26T20:57:50.534132+0000","last_peered":"2024-04-26T20:57:50.534132+0000","last_clean":"2024-04-26T20:57:50.534132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:50.548856+0000","last_undegraded":"2024-04-26T20:57:50.548856+0000","last_fullsized":"2024-04-26T20:57:50.548856+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.597943+0000","last_change":"2024-04-26T20:57:52.593299+0000","last_active":"2024-04-26T20:57:52.597943+0000","last_peered":"2024-04-26T20:57:52.597943+0000","last_clean":"2024-04-26T20:57:52.597943+0000","last_became_active":"2024-04-26T20:57:52.591280+0000","last_became_peered":"2024-04-26T20:57:52.591280+0000","last_unstale":"2024-04-26T20:57:52.597943+0000","last_undegraded":"2024-04-26T20:57:52.597943+0000","last_fullsized":"2024-04-26T20:57:52.597943+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:44:43.597451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-26T20:57:50.548109+0000","last_change":"2024-04-26T20:57:50.548109+0000","last_active":"2024-04-26T20:57:50.534132+0000","last_peered":"2024-04-26T20:57:50.534132+0000","last_clean":"2024-04-26T20:57:50.534132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:50.548109+0000","last_undegraded":"2024-04-26T20:57:50.548109+0000","last_fullsized":"2024-04-26T20:57:50.548109+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.598025+0000","last_change":"2024-04-26T20:57:51.574348+0000","last_active":"2024-04-26T20:57:52.598025+0000","last_peered":"2024-04-26T20:57:52.598025+0000","last_clean":"2024-04-26T20:57:52.598025+0000","last_became_active":"2024-04-26T20:57:51.574023+0000","last_became_peered":"2024-04-26T20:57:51.574023+0000","last_unstale":"2024-04-26T20:57:52.598025+0000","last_undegraded":"2024-04-26T20:57:52.598025+0000","last_fullsized":"2024-04-26T20:57:52.598025+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:29:31.014100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.594378+0000","last_change":"2024-04-26T20:57:52.583405+0000","last_active":"2024-04-26T20:57:52.594378+0000","last_peered":"2024-04-26T20:57:52.594378+0000","last_clean":"2024-04-26T20:57:52.594378+0000","last_became_active":"2024-04-26T20:57:52.582257+0000","last_became_peered":"2024-04-26T20:57:52.582257+0000","last_unstale":"2024-04-26T20:57:52.594378+0000","last_undegraded":"2024-04-26T20:57:52.594378+0000","last_fullsized":"2024-04-26T20:57:52.594378+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:04.761374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.581443+0000","last_change":"2024-04-26T20:57:51.572541+0000","last_active":"2024-04-26T20:57:52.581443+0000","last_peered":"2024-04-26T20:57:52.581443+0000","last_clean":"2024-04-26T20:57:52.581443+0000","last_became_active":"2024-04-26T20:57:51.571967+0000","last_became_peered":"2024-04-26T20:57:51.571967+0000","last_unstale":"2024-04-26T20:57:52.581443+0000","last_undegraded":"2024-04-26T20:57:52.581443+0000","last_fullsized":"2024-04-26T20:57:52.581443+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:11:04.894675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-26T20:57:50.546721+0000","last_change":"2024-04-26T20:57:50.546721+0000","last_active":"2024-04-26T20:57:50.534132+0000","last_peered":"2024-04-26T20:57:50.534132+0000","last_clean":"2024-04-26T20:57:50.534132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:50.546721+0000","last_undegraded":"2024-04-26T20:57:50.546721+0000","last_fullsized":"2024-04-26T20:57:50.546721+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-26T20:57:50.548912+0000","last_change":"2024-04-26T20:57:50.548912+0000","last_active":"2024-04-26T20:57:50.534132+0000","last_peered":"2024-04-26T20:57:50.534132+0000","last_clean":"2024-04-26T20:57:50.534132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:50.548912+0000","last_undegraded":"2024-04-26T20:57:50.548912+0000","last_fullsized":"2024-04-26T20:57:50.548912+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-26T20:57:50.552609+0000","last_change":"2024-04-26T20:57:50.552609+0000","last_active":"2024-04-26T20:57:50.534132+0000","last_peered":"2024-04-26T20:57:50.534132+0000","last_clean":"2024-04-26T20:57:50.534132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:50.552609+0000","last_undegraded":"2024-04-26T20:57:50.552609+0000","last_fullsized":"2024-04-26T20:57:50.552609+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-26T20:57:50.551229+0000","last_change":"2024-04-26T20:57:50.551229+0000","last_active":"2024-04-26T20:57:50.534132+0000","last_peered":"2024-04-26T20:57:50.534132+0000","last_clean":"2024-04-26T20:57:50.534132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:50.551229+0000","last_undegraded":"2024-04-26T20:57:50.551229+0000","last_fullsized":"2024-04-26T20:57:50.551229+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-26T20:57:50.548355+0000","last_change":"2024-04-26T20:57:50.548355+0000","last_active":"2024-04-26T20:57:50.534132+0000","last_peered":"2024-04-26T20:57:50.534132+0000","last_clean":"2024-04-26T20:57:50.534132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:50.548355+0000","last_undegraded":"2024-04-26T20:57:50.548355+0000","last_fullsized":"2024-04-26T20:57:50.548355+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-26T20:57:50.546845+0000","last_change":"2024-04-26T20:57:50.546845+0000","last_active":"2024-04-26T20:57:50.534132+0000","last_peered":"2024-04-26T20:57:50.534132+0000","last_clean":"2024-04-26T20:57:50.534132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:50.546845+0000","last_undegraded":"2024-04-26T20:57:50.546845+0000","last_fullsized":"2024-04-26T20:57:50.546845+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-26T20:57:50.553653+0000","last_change":"2024-04-26T20:57:50.553653+0000","last_active":"2024-04-26T20:57:50.534132+0000","last_peered":"2024-04-26T20:57:50.534132+0000","last_clean":"2024-04-26T20:57:50.534132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:50.553653+0000","last_undegraded":"2024-04-26T20:57:50.553653+0000","last_fullsized":"2024-04-26T20:57:50.553653+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-26T20:57:50.553573+0000","last_change":"2024-04-26T20:57:50.553573+0000","last_active":"2024-04-26T20:57:50.534132+0000","last_peered":"2024-04-26T20:57:50.534132+0000","last_clean":"2024-04-26T20:57:50.534132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:50.553573+0000","last_undegraded":"2024-04-26T20:57:50.553573+0000","last_fullsized":"2024-04-26T20:57:50.553573+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.588400+0000","last_change":"2024-04-26T20:57:52.570952+0000","last_active":"2024-04-26T20:57:52.588400+0000","last_peered":"2024-04-26T20:57:52.588400+0000","last_clean":"2024-04-26T20:57:52.588400+0000","last_became_active":"2024-04-26T20:57:52.570601+0000","last_became_peered":"2024-04-26T20:57:52.570601+0000","last_unstale":"2024-04-26T20:57:52.588400+0000","last_undegraded":"2024-04-26T20:57:52.588400+0000","last_fullsized":"2024-04-26T20:57:52.588400+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:14:41.960247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-26T20:57:50.546168+0000","last_change":"2024-04-26T20:57:50.546168+0000","last_active":"2024-04-26T20:57:50.534132+0000","last_peered":"2024-04-26T20:57:50.534132+0000","last_clean":"2024-04-26T20:57:50.534132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:50.546168+0000","last_undegraded":"2024-04-26T20:57:50.546168+0000","last_fullsized":"2024-04-26T20:57:50.546168+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-26T20:57:50.550243+0000","last_change":"2024-04-26T20:57:50.550243+0000","last_active":"2024-04-26T20:57:50.534132+0000","last_peered":"2024-04-26T20:57:50.534132+0000","last_clean":"2024-04-26T20:57:50.534132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:50.550243+0000","last_undegraded":"2024-04-26T20:57:50.550243+0000","last_fullsized":"2024-04-26T20:57:50.550243+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.585479+0000","last_change":"2024-04-26T20:57:52.570583+0000","last_active":"2024-04-26T20:57:52.585479+0000","last_peered":"2024-04-26T20:57:52.585479+0000","last_clean":"2024-04-26T20:57:52.585479+0000","last_became_active":"2024-04-26T20:57:52.570303+0000","last_became_peered":"2024-04-26T20:57:52.570303+0000","last_unstale":"2024-04-26T20:57:52.585479+0000","last_undegraded":"2024-04-26T20:57:52.585479+0000","last_fullsized":"2024-04-26T20:57:52.585479+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:45:31.989965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-26T20:57:50.546153+0000","last_change":"2024-04-26T20:57:50.546153+0000","last_active":"2024-04-26T20:57:50.534132+0000","last_peered":"2024-04-26T20:57:50.534132+0000","last_clean":"2024-04-26T20:57:50.534132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:50.546153+0000","last_undegraded":"2024-04-26T20:57:50.546153+0000","last_fullsized":"2024-04-26T20:57:50.546153+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-26T20:57:50.548269+0000","last_change":"2024-04-26T20:57:50.548269+0000","last_active":"2024-04-26T20:57:50.534132+0000","last_peered":"2024-04-26T20:57:50.534132+0000","last_clean":"2024-04-26T20:57:50.534132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:50.548269+0000","last_undegraded":"2024-04-26T20:57:50.548269+0000","last_fullsized":"2024-04-26T20:57:50.548269+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-26T20:57:50.546364+0000","last_change":"2024-04-26T20:57:50.546364+0000","last_active":"2024-04-26T20:57:50.534132+0000","last_peered":"2024-04-26T20:57:50.534132+0000","last_clean":"2024-04-26T20:57:50.534132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:50.546364+0000","last_undegraded":"2024-04-26T20:57:50.546364+0000","last_fullsized":"2024-04-26T20:57:50.546364+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-26T20:57:50.546174+0000","last_change":"2024-04-26T20:57:50.546174+0000","last_active":"2024-04-26T20:57:50.534132+0000","last_peered":"2024-04-26T20:57:50.534132+0000","last_clean":"2024-04-26T20:57:50.534132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:50.546174+0000","last_undegraded":"2024-04-26T20:57:50.546174+0000","last_fullsized":"2024-04-26T20:57:50.546174+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.561642+0000","last_change":"2024-04-26T20:57:51.571206+0000","last_active":"2024-04-26T20:57:52.561642+0000","last_peered":"2024-04-26T20:57:52.561642+0000","last_clean":"2024-04-26T20:57:52.561642+0000","last_became_active":"2024-04-26T20:57:51.570877+0000","last_became_peered":"2024-04-26T20:57:51.570877+0000","last_unstale":"2024-04-26T20:57:52.561642+0000","last_undegraded":"2024-04-26T20:57:52.561642+0000","last_fullsized":"2024-04-26T20:57:52.561642+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:49:38.164099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-26T20:57:50.545719+0000","last_change":"2024-04-26T20:57:50.545719+0000","last_active":"2024-04-26T20:57:50.534132+0000","last_peered":"2024-04-26T20:57:50.534132+0000","last_clean":"2024-04-26T20:57:50.534132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:50.545719+0000","last_undegraded":"2024-04-26T20:57:50.545719+0000","last_fullsized":"2024-04-26T20:57:50.545719+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-26T20:57:50.548262+0000","last_change":"2024-04-26T20:57:50.548262+0000","last_active":"2024-04-26T20:57:50.534132+0000","last_peered":"2024-04-26T20:57:50.534132+0000","last_clean":"2024-04-26T20:57:50.534132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:50.548262+0000","last_undegraded":"2024-04-26T20:57:50.548262+0000","last_fullsized":"2024-04-26T20:57:50.548262+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.570297+0000","last_change":"2024-04-26T20:57:51.579142+0000","last_active":"2024-04-26T20:57:52.570297+0000","last_peered":"2024-04-26T20:57:52.570297+0000","last_clean":"2024-04-26T20:57:52.570297+0000","last_became_active":"2024-04-26T20:57:51.578834+0000","last_became_peered":"2024-04-26T20:57:51.578834+0000","last_unstale":"2024-04-26T20:57:52.570297+0000","last_undegraded":"2024-04-26T20:57:52.570297+0000","last_fullsized":"2024-04-26T20:57:52.570297+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:48:04.831644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:57:51.542169+0000","last_change":"2024-04-26T20:57:51.542169+0000","last_active":"2024-04-26T20:57:51.542169+0000","last_peered":"2024-04-26T20:57:51.542169+0000","last_clean":"2024-04-26T20:57:51.542169+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:51.542169+0000","last_undegraded":"2024-04-26T20:57:51.542169+0000","last_fullsized":"2024-04-26T20:57:51.542169+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-04-26T20:57:50.545776+0000","last_change":"2024-04-26T20:57:50.545776+0000","last_active":"2024-04-26T20:57:50.534132+0000","last_peered":"2024-04-26T20:57:50.534132+0000","last_clean":"2024-04-26T20:57:50.534132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:57:50.545776+0000","last_undegraded":"2024-04-26T20:57:50.545776+0000","last_fullsized":"2024-04-26T20:57:50.545776+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":198,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T20:57:50.550171+0000","last_change":"2024-04-26T20:56:29.347462+0000","last_active":"2024-04-26T20:57:50.550171+0000","last_peered":"2024-04-26T20:57:50.550171+0000","last_clean":"2024-04-26T20:57:50.550171+0000","last_became_active":"2024-04-26T20:56:29.346224+0000","last_became_peered":"2024-04-26T20:56:29.346224+0000","last_unstale":"2024-04-26T20:57:50.550171+0000","last_undegraded":"2024-04-26T20:57:50.550171+0000","last_fullsized":"2024-04-26T20:57:50.550171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:28.079105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:28.079105+0000","last_clean_scrub_stamp":"2024-04-26T20:56:28.079105+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:13.693525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":26,"acting":26,"num_store_stats":1},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1646,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509461,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":179097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509460,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":179097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509461,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1024000,"data_stored":769465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509461,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":172888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509461,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":179097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509460,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1024000,"data_stored":769465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509459,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":179097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":475136,"data_stored":194667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T20:57:57.043 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T20:57:57.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.220+0000 7f4820a00640 1 Processor -- start 2024-04-26T20:57:57.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.220+0000 7f4820a00640 1 -- start start 2024-04-26T20:57:57.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.224+0000 7f4820a00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f481c0cbe00 0x7f481c06de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:57.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.224+0000 7f4820a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f481c0cc1e0 0x7f481c073b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:57.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.224+0000 7f4820a00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f481c0ce6f0 0x7f481c0ceb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:57.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.224+0000 7f4820a00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f481c073680 con 0x7f481c0cbe00 2024-04-26T20:57:57.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.224+0000 7f4820a00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f481c0727f0 con 0x7f481c0ce6f0 2024-04-26T20:57:57.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.224+0000 7f4820a00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f481c072a70 con 0x7f481c0cc1e0 2024-04-26T20:57:57.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.224+0000 7f4819e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f481c0cbe00 0x7f481c06de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:57.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.224+0000 7f4819e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f481c0cbe00 0x7f481c06de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:53076/0 (socket says 172.21.15.138:53076) 2024-04-26T20:57:57.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.224+0000 7f4819e00640 1 -- 172.21.15.138:0/1064917409 learned_addr learned my addr 172.21.15.138:0/1064917409 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:57.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.224+0000 7f4811400640 1 --2- 172.21.15.138:0/1064917409 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f481c0cc1e0 0x7f481c073b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:57.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.224+0000 7f481a800640 1 --2- 172.21.15.138:0/1064917409 >> v2:172.21.15.143:3300/0 conn(0x7f481c0ce6f0 0x7f481c0ceb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:57.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.224+0000 7f4819e00640 1 -- 172.21.15.138:0/1064917409 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f481c0cc1e0 msgr2=0x7f481c073b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:57.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.224+0000 7f4819e00640 1 --2- 172.21.15.138:0/1064917409 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f481c0cc1e0 0x7f481c073b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:57.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.224+0000 7f4819e00640 1 -- 172.21.15.138:0/1064917409 >> v2:172.21.15.143:3300/0 conn(0x7f481c0ce6f0 msgr2=0x7f481c0ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:57.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.224+0000 7f4819e00640 1 --2- 172.21.15.138:0/1064917409 >> v2:172.21.15.143:3300/0 conn(0x7f481c0ce6f0 0x7f481c0ceb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:57.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.224+0000 7f4819e00640 1 -- 172.21.15.138:0/1064917409 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f481c072d50 con 0x7f481c0cbe00 2024-04-26T20:57:57.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.228+0000 7f4819e00640 1 --2- 172.21.15.138:0/1064917409 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f481c0cbe00 0x7f481c06de70 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f481c071b00 tx=0x7f480c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42d0628d72abeee3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:57.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.228+0000 7f4819400640 1 -- 172.21.15.138:0/1064917409 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f480c0b0070 con 0x7f481c0cbe00 2024-04-26T20:57:57.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.228+0000 7f4819400640 1 -- 172.21.15.138:0/1064917409 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f480c0ab600 con 0x7f481c0cbe00 2024-04-26T20:57:57.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.228+0000 7f4819400640 1 -- 172.21.15.138:0/1064917409 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f480c0ab9d0 con 0x7f481c0cbe00 2024-04-26T20:57:57.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.228+0000 7f4820a00640 1 -- 172.21.15.138:0/1064917409 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f481c0cbe00 msgr2=0x7f481c06de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:57.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.228+0000 7f4820a00640 1 --2- 172.21.15.138:0/1064917409 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f481c0cbe00 0x7f481c06de70 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f481c071b00 tx=0x7f480c01c520 comp rx=0 tx=0).stop 2024-04-26T20:57:57.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.228+0000 7f4820a00640 1 -- 172.21.15.138:0/1064917409 shutdown_connections 2024-04-26T20:57:57.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.228+0000 7f4820a00640 1 --2- 172.21.15.138:0/1064917409 >> v2:172.21.15.143:3300/0 conn(0x7f481c0ce6f0 0x7f481c0ceb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:57.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.228+0000 7f4820a00640 1 --2- 172.21.15.138:0/1064917409 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f481c0cc1e0 0x7f481c073b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:57.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.228+0000 7f4820a00640 1 --2- 172.21.15.138:0/1064917409 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f481c0cbe00 0x7f481c06de70 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:57.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.228+0000 7f4820a00640 1 -- 172.21.15.138:0/1064917409 >> 172.21.15.138:0/1064917409 conn(0x7f481c0d0b20 msgr2=0x7f481c0d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:57.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.228+0000 7f4820a00640 1 -- 172.21.15.138:0/1064917409 shutdown_connections 2024-04-26T20:57:57.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.228+0000 7f4820a00640 1 -- 172.21.15.138:0/1064917409 wait complete. 2024-04-26T20:57:57.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.228+0000 7f4820a00640 1 Processor -- start 2024-04-26T20:57:57.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.228+0000 7f4820a00640 1 -- start start 2024-04-26T20:57:57.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.228+0000 7f4820a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f481c0cbe00 0x7f481c14a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:57.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.228+0000 7f4820a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f481c0cc1e0 0x7f481c1f8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:57.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.232+0000 7f4820a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f481c0ce6f0 0x7f481c151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:57.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.232+0000 7f4820a00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f481c06e530 con 0x7f481c0cbe00 2024-04-26T20:57:57.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.232+0000 7f4820a00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f481c06e3b0 con 0x7f481c0cc1e0 2024-04-26T20:57:57.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.232+0000 7f4820a00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f481c074050 con 0x7f481c0ce6f0 2024-04-26T20:57:57.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.232+0000 7f4819e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f481c0cbe00 0x7f481c14a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:57.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.232+0000 7f4819e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f481c0cbe00 0x7f481c14a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:53088/0 (socket says 172.21.15.138:53088) 2024-04-26T20:57:57.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.232+0000 7f4819e00640 1 -- 172.21.15.138:0/2968878451 learned_addr learned my addr 172.21.15.138:0/2968878451 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:57.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.232+0000 7f4819e00640 1 -- 172.21.15.138:0/2968878451 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f481c0ce6f0 msgr2=0x7f481c151ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:57.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.232+0000 7f4819e00640 1 --2- 172.21.15.138:0/2968878451 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f481c0ce6f0 0x7f481c151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:57.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.232+0000 7f4819e00640 1 -- 172.21.15.138:0/2968878451 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f481c0cc1e0 msgr2=0x7f481c1f8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:57.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.232+0000 7f4819e00640 1 --2- 172.21.15.138:0/2968878451 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f481c0cc1e0 0x7f481c1f8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:57.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.232+0000 7f4819e00640 1 -- 172.21.15.138:0/2968878451 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f481c1f8710 con 0x7f481c0cbe00 2024-04-26T20:57:57.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.232+0000 7f4819e00640 1 --2- 172.21.15.138:0/2968878451 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f481c0cbe00 0x7f481c14a8d0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f480c01cdc0 tx=0x7f480c01ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:57.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.232+0000 7f4812a00640 1 -- 172.21.15.138:0/2968878451 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f480c0b0040 con 0x7f481c0cbe00 2024-04-26T20:57:57.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.232+0000 7f4812a00640 1 -- 172.21.15.138:0/2968878451 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f480c0bc070 con 0x7f481c0cbe00 2024-04-26T20:57:57.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.232+0000 7f4820a00640 1 -- 172.21.15.138:0/2968878451 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f481c1f89f0 con 0x7f481c0cbe00 2024-04-26T20:57:57.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.232+0000 7f4812a00640 1 -- 172.21.15.138:0/2968878451 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f480c0b6660 con 0x7f481c0cbe00 2024-04-26T20:57:57.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.232+0000 7f4820a00640 1 -- 172.21.15.138:0/2968878451 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f481c1f8fb0 con 0x7f481c0cbe00 2024-04-26T20:57:57.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.232+0000 7f4820a00640 1 -- 172.21.15.138:0/2968878451 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f481c069510 con 0x7f481c0cbe00 2024-04-26T20:57:57.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.232+0000 7f4812a00640 1 -- 172.21.15.138:0/2968878451 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f480c0b6800 con 0x7f481c0cbe00 2024-04-26T20:57:57.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.236+0000 7f4812a00640 1 --2- 172.21.15.138:0/2968878451 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f47f8068380 0x7f47f806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:57.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.236+0000 7f4812a00640 1 -- 172.21.15.138:0/2968878451 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f480c120e80 con 0x7f481c0cbe00 2024-04-26T20:57:57.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.236+0000 7f4811400640 1 --2- 172.21.15.138:0/2968878451 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f47f8068380 0x7f47f806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:57.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.236+0000 7f4811400640 1 --2- 172.21.15.138:0/2968878451 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f47f8068380 0x7f47f806a840 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f481c0b26e0 tx=0x7f4804008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:57.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.240+0000 7f4812a00640 1 -- 172.21.15.138:0/2968878451 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f480c016110 con 0x7f481c0cbe00 2024-04-26T20:57:57.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.392+0000 7f4820a00640 1 -- 172.21.15.138:0/2968878451 --> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f481c0c7e90 con 0x7f47f8068380 2024-04-26T20:57:57.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.400+0000 7f4812a00640 1 -- 172.21.15.138:0/2968878451 <== mgr.4100 v2:172.21.15.143:6832/4275464198 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251943 (secure 0 0 0) 0x7f481c0c7e90 con 0x7f47f8068380 2024-04-26T20:57:57.405 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:57:57.406 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-04-26T20:57:57.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.404+0000 7f4820a00640 1 -- 172.21.15.138:0/2968878451 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f47f8068380 msgr2=0x7f47f806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:57.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.404+0000 7f4820a00640 1 --2- 172.21.15.138:0/2968878451 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f47f8068380 0x7f47f806a840 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f481c0b26e0 tx=0x7f4804008040 comp rx=0 tx=0).stop 2024-04-26T20:57:57.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.404+0000 7f4820a00640 1 -- 172.21.15.138:0/2968878451 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f481c0cbe00 msgr2=0x7f481c14a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:57.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.404+0000 7f4820a00640 1 --2- 172.21.15.138:0/2968878451 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f481c0cbe00 0x7f481c14a8d0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f480c01cdc0 tx=0x7f480c01ad60 comp rx=0 tx=0).stop 2024-04-26T20:57:57.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.404+0000 7f4820a00640 1 -- 172.21.15.138:0/2968878451 shutdown_connections 2024-04-26T20:57:57.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.404+0000 7f4820a00640 1 --2- 172.21.15.138:0/2968878451 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f47f8068380 0x7f47f806a840 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:57.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.404+0000 7f4820a00640 1 --2- 172.21.15.138:0/2968878451 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f481c0ce6f0 0x7f481c151ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:57.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.404+0000 7f4820a00640 1 --2- 172.21.15.138:0/2968878451 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f481c0cc1e0 0x7f481c1f8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:57.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.404+0000 7f4820a00640 1 --2- 172.21.15.138:0/2968878451 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f481c0cbe00 0x7f481c14a8d0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:57.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.404+0000 7f4820a00640 1 -- 172.21.15.138:0/2968878451 >> 172.21.15.138:0/2968878451 conn(0x7f481c0d0b20 msgr2=0x7f481c15ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:57.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.404+0000 7f4820a00640 1 -- 172.21.15.138:0/2968878451 shutdown_connections 2024-04-26T20:57:57.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.404+0000 7f4820a00640 1 -- 172.21.15.138:0/2968878451 wait complete. 2024-04-26T20:57:57.425 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2024-04-26T20:57:57.259623+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221036,"kb_used_data":4848,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753684,"statfs":{"total":773094113280,"available":772867772416,"internally_reserved":0,"allocated":4964352,"data_stored":2769156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001322"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.593260+0000","last_change":"2024-04-26T20:57:52.581808+0000","last_active":"2024-04-26T20:57:52.593260+0000","last_peered":"2024-04-26T20:57:52.593260+0000","last_clean":"2024-04-26T20:57:52.593260+0000","last_became_active":"2024-04-26T20:57:52.581483+0000","last_became_peered":"2024-04-26T20:57:52.581483+0000","last_unstale":"2024-04-26T20:57:52.593260+0000","last_undegraded":"2024-04-26T20:57:52.593260+0000","last_fullsized":"2024-04-26T20:57:52.593260+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:55:05.593379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.575819+0000","last_change":"2024-04-26T20:57:52.584136+0000","last_active":"2024-04-26T20:57:53.575819+0000","last_peered":"2024-04-26T20:57:53.575819+0000","last_clean":"2024-04-26T20:57:53.575819+0000","last_became_active":"2024-04-26T20:57:52.583831+0000","last_became_peered":"2024-04-26T20:57:52.583831+0000","last_unstale":"2024-04-26T20:57:53.575819+0000","last_undegraded":"2024-04-26T20:57:53.575819+0000","last_fullsized":"2024-04-26T20:57:53.575819+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:13.183123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.597744+0000","last_change":"2024-04-26T20:57:52.589332+0000","last_active":"2024-04-26T20:57:52.597744+0000","last_peered":"2024-04-26T20:57:52.597744+0000","last_clean":"2024-04-26T20:57:52.597744+0000","last_became_active":"2024-04-26T20:57:52.589025+0000","last_became_peered":"2024-04-26T20:57:52.589025+0000","last_unstale":"2024-04-26T20:57:52.597744+0000","last_undegraded":"2024-04-26T20:57:52.597744+0000","last_fullsized":"2024-04-26T20:57:52.597744+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:15:08.538065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.591009+0000","last_change":"2024-04-26T20:57:52.577582+0000","last_active":"2024-04-26T20:57:52.591009+0000","last_peered":"2024-04-26T20:57:52.591009+0000","last_clean":"2024-04-26T20:57:52.591009+0000","last_became_active":"2024-04-26T20:57:52.576872+0000","last_became_peered":"2024-04-26T20:57:52.576872+0000","last_unstale":"2024-04-26T20:57:52.591009+0000","last_undegraded":"2024-04-26T20:57:52.591009+0000","last_fullsized":"2024-04-26T20:57:52.591009+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:26:56.698718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574966+0000","last_change":"2024-04-26T20:57:52.590233+0000","last_active":"2024-04-26T20:57:53.574966+0000","last_peered":"2024-04-26T20:57:53.574966+0000","last_clean":"2024-04-26T20:57:53.574966+0000","last_became_active":"2024-04-26T20:57:52.589943+0000","last_became_peered":"2024-04-26T20:57:52.589943+0000","last_unstale":"2024-04-26T20:57:53.574966+0000","last_undegraded":"2024-04-26T20:57:53.574966+0000","last_fullsized":"2024-04-26T20:57:53.574966+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:55:42.728542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574507+0000","last_change":"2024-04-26T20:57:52.586359+0000","last_active":"2024-04-26T20:57:53.574507+0000","last_peered":"2024-04-26T20:57:53.574507+0000","last_clean":"2024-04-26T20:57:53.574507+0000","last_became_active":"2024-04-26T20:57:52.586013+0000","last_became_peered":"2024-04-26T20:57:52.586013+0000","last_unstale":"2024-04-26T20:57:53.574507+0000","last_undegraded":"2024-04-26T20:57:53.574507+0000","last_fullsized":"2024-04-26T20:57:53.574507+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:03:40.972633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574608+0000","last_change":"2024-04-26T20:57:52.578308+0000","last_active":"2024-04-26T20:57:53.574608+0000","last_peered":"2024-04-26T20:57:53.574608+0000","last_clean":"2024-04-26T20:57:53.574608+0000","last_became_active":"2024-04-26T20:57:52.578063+0000","last_became_peered":"2024-04-26T20:57:52.578063+0000","last_unstale":"2024-04-26T20:57:53.574608+0000","last_undegraded":"2024-04-26T20:57:53.574608+0000","last_fullsized":"2024-04-26T20:57:53.574608+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:14:02.457147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.594421+0000","last_change":"2024-04-26T20:57:52.583828+0000","last_active":"2024-04-26T20:57:52.594421+0000","last_peered":"2024-04-26T20:57:52.594421+0000","last_clean":"2024-04-26T20:57:52.594421+0000","last_became_active":"2024-04-26T20:57:52.582894+0000","last_became_peered":"2024-04-26T20:57:52.582894+0000","last_unstale":"2024-04-26T20:57:52.594421+0000","last_undegraded":"2024-04-26T20:57:52.594421+0000","last_fullsized":"2024-04-26T20:57:52.594421+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:09:22.814425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.575370+0000","last_change":"2024-04-26T20:57:52.590616+0000","last_active":"2024-04-26T20:57:53.575370+0000","last_peered":"2024-04-26T20:57:53.575370+0000","last_clean":"2024-04-26T20:57:53.575370+0000","last_became_active":"2024-04-26T20:57:52.589972+0000","last_became_peered":"2024-04-26T20:57:52.589972+0000","last_unstale":"2024-04-26T20:57:53.575370+0000","last_undegraded":"2024-04-26T20:57:53.575370+0000","last_fullsized":"2024-04-26T20:57:53.575370+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:50:33.246661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.575071+0000","last_change":"2024-04-26T20:57:52.575175+0000","last_active":"2024-04-26T20:57:53.575071+0000","last_peered":"2024-04-26T20:57:53.575071+0000","last_clean":"2024-04-26T20:57:53.575071+0000","last_became_active":"2024-04-26T20:57:52.574917+0000","last_became_peered":"2024-04-26T20:57:52.574917+0000","last_unstale":"2024-04-26T20:57:53.575071+0000","last_undegraded":"2024-04-26T20:57:53.575071+0000","last_fullsized":"2024-04-26T20:57:53.575071+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:36:55.831432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.698301+0000","last_change":"2024-04-26T20:57:52.579280+0000","last_active":"2024-04-26T20:57:53.698301+0000","last_peered":"2024-04-26T20:57:53.698301+0000","last_clean":"2024-04-26T20:57:53.698301+0000","last_became_active":"2024-04-26T20:57:52.578799+0000","last_became_peered":"2024-04-26T20:57:52.578799+0000","last_unstale":"2024-04-26T20:57:53.698301+0000","last_undegraded":"2024-04-26T20:57:53.698301+0000","last_fullsized":"2024-04-26T20:57:53.698301+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:53:53.499485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574534+0000","last_change":"2024-04-26T20:57:52.585045+0000","last_active":"2024-04-26T20:57:53.574534+0000","last_peered":"2024-04-26T20:57:53.574534+0000","last_clean":"2024-04-26T20:57:53.574534+0000","last_became_active":"2024-04-26T20:57:52.584748+0000","last_became_peered":"2024-04-26T20:57:52.584748+0000","last_unstale":"2024-04-26T20:57:53.574534+0000","last_undegraded":"2024-04-26T20:57:53.574534+0000","last_fullsized":"2024-04-26T20:57:53.574534+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:19:07.737363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574687+0000","last_change":"2024-04-26T20:57:52.583032+0000","last_active":"2024-04-26T20:57:53.574687+0000","last_peered":"2024-04-26T20:57:53.574687+0000","last_clean":"2024-04-26T20:57:53.574687+0000","last_became_active":"2024-04-26T20:57:52.582788+0000","last_became_peered":"2024-04-26T20:57:52.582788+0000","last_unstale":"2024-04-26T20:57:53.574687+0000","last_undegraded":"2024-04-26T20:57:53.574687+0000","last_fullsized":"2024-04-26T20:57:53.574687+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:55:42.728542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.490142+0000","last_change":"2024-04-26T20:57:52.577582+0000","last_active":"2024-04-26T20:57:55.490142+0000","last_peered":"2024-04-26T20:57:55.490142+0000","last_clean":"2024-04-26T20:57:55.490142+0000","last_became_active":"2024-04-26T20:57:52.577366+0000","last_became_peered":"2024-04-26T20:57:52.577366+0000","last_unstale":"2024-04-26T20:57:55.490142+0000","last_undegraded":"2024-04-26T20:57:55.490142+0000","last_fullsized":"2024-04-26T20:57:55.490142+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:07.021199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.490598+0000","last_change":"2024-04-26T20:57:52.586188+0000","last_active":"2024-04-26T20:57:55.490598+0000","last_peered":"2024-04-26T20:57:55.490598+0000","last_clean":"2024-04-26T20:57:55.490598+0000","last_became_active":"2024-04-26T20:57:52.585816+0000","last_became_peered":"2024-04-26T20:57:52.585816+0000","last_unstale":"2024-04-26T20:57:55.490598+0000","last_undegraded":"2024-04-26T20:57:55.490598+0000","last_fullsized":"2024-04-26T20:57:55.490598+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:06:03.397876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574464+0000","last_change":"2024-04-26T20:57:52.587967+0000","last_active":"2024-04-26T20:57:53.574464+0000","last_peered":"2024-04-26T20:57:53.574464+0000","last_clean":"2024-04-26T20:57:53.574464+0000","last_became_active":"2024-04-26T20:57:52.587598+0000","last_became_peered":"2024-04-26T20:57:52.587598+0000","last_unstale":"2024-04-26T20:57:53.574464+0000","last_undegraded":"2024-04-26T20:57:53.574464+0000","last_fullsized":"2024-04-26T20:57:53.574464+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:19:07.737363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.491248+0000","last_change":"2024-04-26T20:57:52.582167+0000","last_active":"2024-04-26T20:57:55.491248+0000","last_peered":"2024-04-26T20:57:55.491248+0000","last_clean":"2024-04-26T20:57:55.491248+0000","last_became_active":"2024-04-26T20:57:52.581896+0000","last_became_peered":"2024-04-26T20:57:52.581896+0000","last_unstale":"2024-04-26T20:57:55.491248+0000","last_undegraded":"2024-04-26T20:57:55.491248+0000","last_fullsized":"2024-04-26T20:57:55.491248+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:33.773431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.491119+0000","last_change":"2024-04-26T20:57:52.582700+0000","last_active":"2024-04-26T20:57:55.491119+0000","last_peered":"2024-04-26T20:57:55.491119+0000","last_clean":"2024-04-26T20:57:55.491119+0000","last_became_active":"2024-04-26T20:57:52.582355+0000","last_became_peered":"2024-04-26T20:57:52.582355+0000","last_unstale":"2024-04-26T20:57:55.491119+0000","last_undegraded":"2024-04-26T20:57:55.491119+0000","last_fullsized":"2024-04-26T20:57:55.491119+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:31:29.694312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.491331+0000","last_change":"2024-04-26T20:57:52.593273+0000","last_active":"2024-04-26T20:57:55.491331+0000","last_peered":"2024-04-26T20:57:55.491331+0000","last_clean":"2024-04-26T20:57:55.491331+0000","last_became_active":"2024-04-26T20:57:52.592960+0000","last_became_peered":"2024-04-26T20:57:52.592960+0000","last_unstale":"2024-04-26T20:57:55.491331+0000","last_undegraded":"2024-04-26T20:57:55.491331+0000","last_fullsized":"2024-04-26T20:57:55.491331+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:13.183123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.698054+0000","last_change":"2024-04-26T20:57:52.569599+0000","last_active":"2024-04-26T20:57:53.698054+0000","last_peered":"2024-04-26T20:57:53.698054+0000","last_clean":"2024-04-26T20:57:53.698054+0000","last_became_active":"2024-04-26T20:57:52.569345+0000","last_became_peered":"2024-04-26T20:57:52.569345+0000","last_unstale":"2024-04-26T20:57:53.698054+0000","last_undegraded":"2024-04-26T20:57:53.698054+0000","last_fullsized":"2024-04-26T20:57:53.698054+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:26.856916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.698008+0000","last_change":"2024-04-26T20:57:52.592270+0000","last_active":"2024-04-26T20:57:53.698008+0000","last_peered":"2024-04-26T20:57:53.698008+0000","last_clean":"2024-04-26T20:57:53.698008+0000","last_became_active":"2024-04-26T20:57:52.591984+0000","last_became_peered":"2024-04-26T20:57:52.591984+0000","last_unstale":"2024-04-26T20:57:53.698008+0000","last_undegraded":"2024-04-26T20:57:53.698008+0000","last_fullsized":"2024-04-26T20:57:53.698008+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:28:20.157680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.697892+0000","last_change":"2024-04-26T20:57:52.576852+0000","last_active":"2024-04-26T20:57:53.697892+0000","last_peered":"2024-04-26T20:57:53.697892+0000","last_clean":"2024-04-26T20:57:53.697892+0000","last_became_active":"2024-04-26T20:57:52.575571+0000","last_became_peered":"2024-04-26T20:57:52.575571+0000","last_unstale":"2024-04-26T20:57:53.697892+0000","last_undegraded":"2024-04-26T20:57:53.697892+0000","last_fullsized":"2024-04-26T20:57:53.697892+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:55.128152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.490770+0000","last_change":"2024-04-26T20:57:52.586306+0000","last_active":"2024-04-26T20:57:55.490770+0000","last_peered":"2024-04-26T20:57:55.490770+0000","last_clean":"2024-04-26T20:57:55.490770+0000","last_became_active":"2024-04-26T20:57:52.585992+0000","last_became_peered":"2024-04-26T20:57:52.585992+0000","last_unstale":"2024-04-26T20:57:55.490770+0000","last_undegraded":"2024-04-26T20:57:55.490770+0000","last_fullsized":"2024-04-26T20:57:55.490770+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:09:38.712604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.594443+0000","last_change":"2024-04-26T20:57:52.584019+0000","last_active":"2024-04-26T20:57:52.594443+0000","last_peered":"2024-04-26T20:57:52.594443+0000","last_clean":"2024-04-26T20:57:52.594443+0000","last_became_active":"2024-04-26T20:57:52.583140+0000","last_became_peered":"2024-04-26T20:57:52.583140+0000","last_unstale":"2024-04-26T20:57:52.594443+0000","last_undegraded":"2024-04-26T20:57:52.594443+0000","last_fullsized":"2024-04-26T20:57:52.594443+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:31:16.104032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.490262+0000","last_change":"2024-04-26T20:57:52.579168+0000","last_active":"2024-04-26T20:57:55.490262+0000","last_peered":"2024-04-26T20:57:55.490262+0000","last_clean":"2024-04-26T20:57:55.490262+0000","last_became_active":"2024-04-26T20:57:52.578943+0000","last_became_peered":"2024-04-26T20:57:52.578943+0000","last_unstale":"2024-04-26T20:57:55.490262+0000","last_undegraded":"2024-04-26T20:57:55.490262+0000","last_fullsized":"2024-04-26T20:57:55.490262+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:10.898445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.594480+0000","last_change":"2024-04-26T20:57:52.585325+0000","last_active":"2024-04-26T20:57:52.594480+0000","last_peered":"2024-04-26T20:57:52.594480+0000","last_clean":"2024-04-26T20:57:52.594480+0000","last_became_active":"2024-04-26T20:57:52.585083+0000","last_became_peered":"2024-04-26T20:57:52.585083+0000","last_unstale":"2024-04-26T20:57:52.594480+0000","last_undegraded":"2024-04-26T20:57:52.594480+0000","last_fullsized":"2024-04-26T20:57:52.594480+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:05:21.832612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.698347+0000","last_change":"2024-04-26T20:57:52.578861+0000","last_active":"2024-04-26T20:57:53.698347+0000","last_peered":"2024-04-26T20:57:53.698347+0000","last_clean":"2024-04-26T20:57:53.698347+0000","last_became_active":"2024-04-26T20:57:52.578454+0000","last_became_peered":"2024-04-26T20:57:52.578454+0000","last_unstale":"2024-04-26T20:57:53.698347+0000","last_undegraded":"2024-04-26T20:57:53.698347+0000","last_fullsized":"2024-04-26T20:57:53.698347+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:43:41.131361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574874+0000","last_change":"2024-04-26T20:57:52.577688+0000","last_active":"2024-04-26T20:57:53.574874+0000","last_peered":"2024-04-26T20:57:53.574874+0000","last_clean":"2024-04-26T20:57:53.574874+0000","last_became_active":"2024-04-26T20:57:52.577426+0000","last_became_peered":"2024-04-26T20:57:52.577426+0000","last_unstale":"2024-04-26T20:57:53.574874+0000","last_undegraded":"2024-04-26T20:57:53.574874+0000","last_fullsized":"2024-04-26T20:57:53.574874+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:33.561350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.490763+0000","last_change":"2024-04-26T20:57:52.583932+0000","last_active":"2024-04-26T20:57:55.490763+0000","last_peered":"2024-04-26T20:57:55.490763+0000","last_clean":"2024-04-26T20:57:55.490763+0000","last_became_active":"2024-04-26T20:57:52.583671+0000","last_became_peered":"2024-04-26T20:57:52.583671+0000","last_unstale":"2024-04-26T20:57:55.490763+0000","last_undegraded":"2024-04-26T20:57:55.490763+0000","last_fullsized":"2024-04-26T20:57:55.490763+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:48:59.322923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.490695+0000","last_change":"2024-04-26T20:57:52.569868+0000","last_active":"2024-04-26T20:57:55.490695+0000","last_peered":"2024-04-26T20:57:55.490695+0000","last_clean":"2024-04-26T20:57:55.490695+0000","last_became_active":"2024-04-26T20:57:52.569591+0000","last_became_peered":"2024-04-26T20:57:52.569591+0000","last_unstale":"2024-04-26T20:57:55.490695+0000","last_undegraded":"2024-04-26T20:57:55.490695+0000","last_fullsized":"2024-04-26T20:57:55.490695+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:37:30.401536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574754+0000","last_change":"2024-04-26T20:57:52.581841+0000","last_active":"2024-04-26T20:57:53.574754+0000","last_peered":"2024-04-26T20:57:53.574754+0000","last_clean":"2024-04-26T20:57:53.574754+0000","last_became_active":"2024-04-26T20:57:52.581591+0000","last_became_peered":"2024-04-26T20:57:52.581591+0000","last_unstale":"2024-04-26T20:57:53.574754+0000","last_undegraded":"2024-04-26T20:57:53.574754+0000","last_fullsized":"2024-04-26T20:57:53.574754+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:43:08.977177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.594400+0000","last_change":"2024-04-26T20:57:52.583636+0000","last_active":"2024-04-26T20:57:52.594400+0000","last_peered":"2024-04-26T20:57:52.594400+0000","last_clean":"2024-04-26T20:57:52.594400+0000","last_became_active":"2024-04-26T20:57:52.582497+0000","last_became_peered":"2024-04-26T20:57:52.582497+0000","last_unstale":"2024-04-26T20:57:52.594400+0000","last_undegraded":"2024-04-26T20:57:52.594400+0000","last_fullsized":"2024-04-26T20:57:52.594400+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:16:51.269657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.491024+0000","last_change":"2024-04-26T20:57:52.569273+0000","last_active":"2024-04-26T20:57:55.491024+0000","last_peered":"2024-04-26T20:57:55.491024+0000","last_clean":"2024-04-26T20:57:55.491024+0000","last_became_active":"2024-04-26T20:57:52.568195+0000","last_became_peered":"2024-04-26T20:57:52.568195+0000","last_unstale":"2024-04-26T20:57:55.491024+0000","last_undegraded":"2024-04-26T20:57:55.491024+0000","last_fullsized":"2024-04-26T20:57:55.491024+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:05:40.669900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"40'4","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.490270+0000","last_change":"2024-04-26T20:57:51.572743+0000","last_active":"2024-04-26T20:57:55.490270+0000","last_peered":"2024-04-26T20:57:55.490270+0000","last_clean":"2024-04-26T20:57:55.490270+0000","last_became_active":"2024-04-26T20:57:51.572350+0000","last_became_peered":"2024-04-26T20:57:51.572350+0000","last_unstale":"2024-04-26T20:57:55.490270+0000","last_undegraded":"2024-04-26T20:57:55.490270+0000","last_fullsized":"2024-04-26T20:57:55.490270+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:50:32.238625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.575427+0000","last_change":"2024-04-26T20:57:52.587288+0000","last_active":"2024-04-26T20:57:53.575427+0000","last_peered":"2024-04-26T20:57:53.575427+0000","last_clean":"2024-04-26T20:57:53.575427+0000","last_became_active":"2024-04-26T20:57:52.586875+0000","last_became_peered":"2024-04-26T20:57:52.586875+0000","last_unstale":"2024-04-26T20:57:53.575427+0000","last_undegraded":"2024-04-26T20:57:53.575427+0000","last_fullsized":"2024-04-26T20:57:53.575427+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:16.143937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.575702+0000","last_change":"2024-04-26T20:57:51.566643+0000","last_active":"2024-04-26T20:57:53.575702+0000","last_peered":"2024-04-26T20:57:53.575702+0000","last_clean":"2024-04-26T20:57:53.575702+0000","last_became_active":"2024-04-26T20:57:51.566309+0000","last_became_peered":"2024-04-26T20:57:51.566309+0000","last_unstale":"2024-04-26T20:57:53.575702+0000","last_undegraded":"2024-04-26T20:57:53.575702+0000","last_fullsized":"2024-04-26T20:57:53.575702+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:50:32.238625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.491255+0000","last_change":"2024-04-26T20:57:52.566380+0000","last_active":"2024-04-26T20:57:55.491255+0000","last_peered":"2024-04-26T20:57:55.491255+0000","last_clean":"2024-04-26T20:57:55.491255+0000","last_became_active":"2024-04-26T20:57:52.566143+0000","last_became_peered":"2024-04-26T20:57:52.566143+0000","last_unstale":"2024-04-26T20:57:55.491255+0000","last_undegraded":"2024-04-26T20:57:55.491255+0000","last_fullsized":"2024-04-26T20:57:55.491255+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:30.531635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.588846+0000","last_change":"2024-04-26T20:57:51.573664+0000","last_active":"2024-04-26T20:57:52.588846+0000","last_peered":"2024-04-26T20:57:52.588846+0000","last_clean":"2024-04-26T20:57:52.588846+0000","last_became_active":"2024-04-26T20:57:51.572927+0000","last_became_peered":"2024-04-26T20:57:51.572927+0000","last_unstale":"2024-04-26T20:57:52.588846+0000","last_undegraded":"2024-04-26T20:57:52.588846+0000","last_fullsized":"2024-04-26T20:57:52.588846+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:04:55.596385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.576004+0000","last_change":"2024-04-26T20:57:52.585801+0000","last_active":"2024-04-26T20:57:53.576004+0000","last_peered":"2024-04-26T20:57:53.576004+0000","last_clean":"2024-04-26T20:57:53.576004+0000","last_became_active":"2024-04-26T20:57:52.584731+0000","last_became_peered":"2024-04-26T20:57:52.584731+0000","last_unstale":"2024-04-26T20:57:53.576004+0000","last_undegraded":"2024-04-26T20:57:53.576004+0000","last_fullsized":"2024-04-26T20:57:53.576004+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:28:20.157680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.490184+0000","last_change":"2024-04-26T20:57:51.574013+0000","last_active":"2024-04-26T20:57:55.490184+0000","last_peered":"2024-04-26T20:57:55.490184+0000","last_clean":"2024-04-26T20:57:55.490184+0000","last_became_active":"2024-04-26T20:57:51.573800+0000","last_became_peered":"2024-04-26T20:57:51.573800+0000","last_unstale":"2024-04-26T20:57:55.490184+0000","last_undegraded":"2024-04-26T20:57:55.490184+0000","last_fullsized":"2024-04-26T20:57:55.490184+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:43:07.969141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.594461+0000","last_change":"2024-04-26T20:57:52.587538+0000","last_active":"2024-04-26T20:57:52.594461+0000","last_peered":"2024-04-26T20:57:52.594461+0000","last_clean":"2024-04-26T20:57:52.594461+0000","last_became_active":"2024-04-26T20:57:52.587138+0000","last_became_peered":"2024-04-26T20:57:52.587138+0000","last_unstale":"2024-04-26T20:57:52.594461+0000","last_undegraded":"2024-04-26T20:57:52.594461+0000","last_fullsized":"2024-04-26T20:57:52.594461+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:39:40.382481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.490119+0000","last_change":"2024-04-26T20:57:51.570397+0000","last_active":"2024-04-26T20:57:55.490119+0000","last_peered":"2024-04-26T20:57:55.490119+0000","last_clean":"2024-04-26T20:57:55.490119+0000","last_became_active":"2024-04-26T20:57:51.570089+0000","last_became_peered":"2024-04-26T20:57:51.570089+0000","last_unstale":"2024-04-26T20:57:55.490119+0000","last_undegraded":"2024-04-26T20:57:55.490119+0000","last_fullsized":"2024-04-26T20:57:55.490119+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:55:41.720506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.697981+0000","last_change":"2024-04-26T20:57:52.585311+0000","last_active":"2024-04-26T20:57:53.697981+0000","last_peered":"2024-04-26T20:57:53.697981+0000","last_clean":"2024-04-26T20:57:53.697981+0000","last_became_active":"2024-04-26T20:57:52.585061+0000","last_became_peered":"2024-04-26T20:57:52.585061+0000","last_unstale":"2024-04-26T20:57:53.697981+0000","last_undegraded":"2024-04-26T20:57:53.697981+0000","last_fullsized":"2024-04-26T20:57:53.697981+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:13.183123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574697+0000","last_change":"2024-04-26T20:57:51.571733+0000","last_active":"2024-04-26T20:57:53.574697+0000","last_peered":"2024-04-26T20:57:53.574697+0000","last_clean":"2024-04-26T20:57:53.574697+0000","last_became_active":"2024-04-26T20:57:51.571446+0000","last_became_peered":"2024-04-26T20:57:51.571446+0000","last_unstale":"2024-04-26T20:57:53.574697+0000","last_undegraded":"2024-04-26T20:57:53.574697+0000","last_fullsized":"2024-04-26T20:57:53.574697+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:07.815468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.490783+0000","last_change":"2024-04-26T20:57:52.570641+0000","last_active":"2024-04-26T20:57:55.490783+0000","last_peered":"2024-04-26T20:57:55.490783+0000","last_clean":"2024-04-26T20:57:55.490783+0000","last_became_active":"2024-04-26T20:57:52.570421+0000","last_became_peered":"2024-04-26T20:57:52.570421+0000","last_unstale":"2024-04-26T20:57:55.490783+0000","last_undegraded":"2024-04-26T20:57:55.490783+0000","last_fullsized":"2024-04-26T20:57:55.490783+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:40.105119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.561404+0000","last_change":"2024-04-26T20:57:51.574572+0000","last_active":"2024-04-26T20:57:52.561404+0000","last_peered":"2024-04-26T20:57:52.561404+0000","last_clean":"2024-04-26T20:57:52.561404+0000","last_became_active":"2024-04-26T20:57:51.574213+0000","last_became_peered":"2024-04-26T20:57:51.574213+0000","last_unstale":"2024-04-26T20:57:52.561404+0000","last_undegraded":"2024-04-26T20:57:52.561404+0000","last_fullsized":"2024-04-26T20:57:52.561404+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:10:26.507698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.575337+0000","last_change":"2024-04-26T20:57:52.586106+0000","last_active":"2024-04-26T20:57:53.575337+0000","last_peered":"2024-04-26T20:57:53.575337+0000","last_clean":"2024-04-26T20:57:53.575337+0000","last_became_active":"2024-04-26T20:57:52.585860+0000","last_became_peered":"2024-04-26T20:57:52.585860+0000","last_unstale":"2024-04-26T20:57:53.575337+0000","last_undegraded":"2024-04-26T20:57:53.575337+0000","last_fullsized":"2024-04-26T20:57:53.575337+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:55.128152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574408+0000","last_change":"2024-04-26T20:57:51.573590+0000","last_active":"2024-04-26T20:57:53.574408+0000","last_peered":"2024-04-26T20:57:53.574408+0000","last_clean":"2024-04-26T20:57:53.574408+0000","last_became_active":"2024-04-26T20:57:51.573293+0000","last_became_peered":"2024-04-26T20:57:51.573293+0000","last_unstale":"2024-04-26T20:57:53.574408+0000","last_undegraded":"2024-04-26T20:57:53.574408+0000","last_fullsized":"2024-04-26T20:57:53.574408+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:55:23.008549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.590985+0000","last_change":"2024-04-26T20:57:52.575008+0000","last_active":"2024-04-26T20:57:52.590985+0000","last_peered":"2024-04-26T20:57:52.590985+0000","last_clean":"2024-04-26T20:57:52.590985+0000","last_became_active":"2024-04-26T20:57:52.574553+0000","last_became_peered":"2024-04-26T20:57:52.574553+0000","last_unstale":"2024-04-26T20:57:52.590985+0000","last_undegraded":"2024-04-26T20:57:52.590985+0000","last_fullsized":"2024-04-26T20:57:52.590985+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:03:23.551336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.563732+0000","last_change":"2024-04-26T20:57:51.576675+0000","last_active":"2024-04-26T20:57:52.563732+0000","last_peered":"2024-04-26T20:57:52.563732+0000","last_clean":"2024-04-26T20:57:52.563732+0000","last_became_active":"2024-04-26T20:57:51.576394+0000","last_became_peered":"2024-04-26T20:57:51.576394+0000","last_unstale":"2024-04-26T20:57:52.563732+0000","last_undegraded":"2024-04-26T20:57:52.563732+0000","last_fullsized":"2024-04-26T20:57:52.563732+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:44:14.717022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.490288+0000","last_change":"2024-04-26T20:57:52.576139+0000","last_active":"2024-04-26T20:57:55.490288+0000","last_peered":"2024-04-26T20:57:55.490288+0000","last_clean":"2024-04-26T20:57:55.490288+0000","last_became_active":"2024-04-26T20:57:52.575825+0000","last_became_peered":"2024-04-26T20:57:52.575825+0000","last_unstale":"2024-04-26T20:57:55.490288+0000","last_undegraded":"2024-04-26T20:57:55.490288+0000","last_fullsized":"2024-04-26T20:57:55.490288+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:43:43.232931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.491096+0000","last_change":"2024-04-26T20:57:51.566363+0000","last_active":"2024-04-26T20:57:55.491096+0000","last_peered":"2024-04-26T20:57:55.491096+0000","last_clean":"2024-04-26T20:57:55.491096+0000","last_became_active":"2024-04-26T20:57:51.566020+0000","last_became_peered":"2024-04-26T20:57:51.566020+0000","last_unstale":"2024-04-26T20:57:55.491096+0000","last_undegraded":"2024-04-26T20:57:55.491096+0000","last_fullsized":"2024-04-26T20:57:55.491096+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:51:59.832838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.597943+0000","last_change":"2024-04-26T20:57:52.593299+0000","last_active":"2024-04-26T20:57:52.597943+0000","last_peered":"2024-04-26T20:57:52.597943+0000","last_clean":"2024-04-26T20:57:52.597943+0000","last_became_active":"2024-04-26T20:57:52.591280+0000","last_became_peered":"2024-04-26T20:57:52.591280+0000","last_unstale":"2024-04-26T20:57:52.597943+0000","last_undegraded":"2024-04-26T20:57:52.597943+0000","last_fullsized":"2024-04-26T20:57:52.597943+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:44:43.597451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.490897+0000","last_change":"2024-04-26T20:57:51.569668+0000","last_active":"2024-04-26T20:57:55.490897+0000","last_peered":"2024-04-26T20:57:55.490897+0000","last_clean":"2024-04-26T20:57:55.490897+0000","last_became_active":"2024-04-26T20:57:51.569384+0000","last_became_peered":"2024-04-26T20:57:51.569384+0000","last_unstale":"2024-04-26T20:57:55.490897+0000","last_undegraded":"2024-04-26T20:57:55.490897+0000","last_fullsized":"2024-04-26T20:57:55.490897+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:49:18.242393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.575283+0000","last_change":"2024-04-26T20:57:52.577388+0000","last_active":"2024-04-26T20:57:53.575283+0000","last_peered":"2024-04-26T20:57:53.575283+0000","last_clean":"2024-04-26T20:57:53.575283+0000","last_became_active":"2024-04-26T20:57:52.577116+0000","last_became_peered":"2024-04-26T20:57:52.577116+0000","last_unstale":"2024-04-26T20:57:53.575283+0000","last_undegraded":"2024-04-26T20:57:53.575283+0000","last_fullsized":"2024-04-26T20:57:53.575283+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:08:20.328489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.598025+0000","last_change":"2024-04-26T20:57:51.574348+0000","last_active":"2024-04-26T20:57:52.598025+0000","last_peered":"2024-04-26T20:57:52.598025+0000","last_clean":"2024-04-26T20:57:52.598025+0000","last_became_active":"2024-04-26T20:57:51.574023+0000","last_became_peered":"2024-04-26T20:57:51.574023+0000","last_unstale":"2024-04-26T20:57:52.598025+0000","last_undegraded":"2024-04-26T20:57:52.598025+0000","last_fullsized":"2024-04-26T20:57:52.598025+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:29:31.014100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.594378+0000","last_change":"2024-04-26T20:57:52.583405+0000","last_active":"2024-04-26T20:57:52.594378+0000","last_peered":"2024-04-26T20:57:52.594378+0000","last_clean":"2024-04-26T20:57:52.594378+0000","last_became_active":"2024-04-26T20:57:52.582257+0000","last_became_peered":"2024-04-26T20:57:52.582257+0000","last_unstale":"2024-04-26T20:57:52.594378+0000","last_undegraded":"2024-04-26T20:57:52.594378+0000","last_fullsized":"2024-04-26T20:57:52.594378+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:04.761374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.581443+0000","last_change":"2024-04-26T20:57:51.572541+0000","last_active":"2024-04-26T20:57:52.581443+0000","last_peered":"2024-04-26T20:57:52.581443+0000","last_clean":"2024-04-26T20:57:52.581443+0000","last_became_active":"2024-04-26T20:57:51.571967+0000","last_became_peered":"2024-04-26T20:57:51.571967+0000","last_unstale":"2024-04-26T20:57:52.581443+0000","last_undegraded":"2024-04-26T20:57:52.581443+0000","last_fullsized":"2024-04-26T20:57:52.581443+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:11:04.894675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574548+0000","last_change":"2024-04-26T20:57:52.581005+0000","last_active":"2024-04-26T20:57:53.574548+0000","last_peered":"2024-04-26T20:57:53.574548+0000","last_clean":"2024-04-26T20:57:53.574548+0000","last_became_active":"2024-04-26T20:57:52.580685+0000","last_became_peered":"2024-04-26T20:57:52.580685+0000","last_unstale":"2024-04-26T20:57:53.574548+0000","last_undegraded":"2024-04-26T20:57:53.574548+0000","last_fullsized":"2024-04-26T20:57:53.574548+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:23:22.653755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574567+0000","last_change":"2024-04-26T20:57:51.571181+0000","last_active":"2024-04-26T20:57:53.574567+0000","last_peered":"2024-04-26T20:57:53.574567+0000","last_clean":"2024-04-26T20:57:53.574567+0000","last_became_active":"2024-04-26T20:57:51.570305+0000","last_became_peered":"2024-04-26T20:57:51.570305+0000","last_unstale":"2024-04-26T20:57:53.574567+0000","last_undegraded":"2024-04-26T20:57:53.574567+0000","last_fullsized":"2024-04-26T20:57:53.574567+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:43:07.969141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.698155+0000","last_change":"2024-04-26T20:57:52.584791+0000","last_active":"2024-04-26T20:57:53.698155+0000","last_peered":"2024-04-26T20:57:53.698155+0000","last_clean":"2024-04-26T20:57:53.698155+0000","last_became_active":"2024-04-26T20:57:52.575922+0000","last_became_peered":"2024-04-26T20:57:52.575922+0000","last_unstale":"2024-04-26T20:57:53.698155+0000","last_undegraded":"2024-04-26T20:57:53.698155+0000","last_fullsized":"2024-04-26T20:57:53.698155+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:12:05.356796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.490849+0000","last_change":"2024-04-26T20:57:51.563498+0000","last_active":"2024-04-26T20:57:55.490849+0000","last_peered":"2024-04-26T20:57:55.490849+0000","last_clean":"2024-04-26T20:57:55.490849+0000","last_became_active":"2024-04-26T20:57:51.563243+0000","last_became_peered":"2024-04-26T20:57:51.563243+0000","last_unstale":"2024-04-26T20:57:55.490849+0000","last_undegraded":"2024-04-26T20:57:55.490849+0000","last_fullsized":"2024-04-26T20:57:55.490849+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:47:09.428746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.575128+0000","last_change":"2024-04-26T20:57:52.584930+0000","last_active":"2024-04-26T20:57:53.575128+0000","last_peered":"2024-04-26T20:57:53.575128+0000","last_clean":"2024-04-26T20:57:53.575128+0000","last_became_active":"2024-04-26T20:57:52.584641+0000","last_became_peered":"2024-04-26T20:57:52.584641+0000","last_unstale":"2024-04-26T20:57:53.575128+0000","last_undegraded":"2024-04-26T20:57:53.575128+0000","last_fullsized":"2024-04-26T20:57:53.575128+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:33.561350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.490157+0000","last_change":"2024-04-26T20:57:51.567931+0000","last_active":"2024-04-26T20:57:55.490157+0000","last_peered":"2024-04-26T20:57:55.490157+0000","last_clean":"2024-04-26T20:57:55.490157+0000","last_became_active":"2024-04-26T20:57:51.567552+0000","last_became_peered":"2024-04-26T20:57:51.567552+0000","last_unstale":"2024-04-26T20:57:55.490157+0000","last_undegraded":"2024-04-26T20:57:55.490157+0000","last_fullsized":"2024-04-26T20:57:55.490157+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:32.553314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.575154+0000","last_change":"2024-04-26T20:57:52.581758+0000","last_active":"2024-04-26T20:57:53.575154+0000","last_peered":"2024-04-26T20:57:53.575154+0000","last_clean":"2024-04-26T20:57:53.575154+0000","last_became_active":"2024-04-26T20:57:52.581085+0000","last_became_peered":"2024-04-26T20:57:52.581085+0000","last_unstale":"2024-04-26T20:57:53.575154+0000","last_undegraded":"2024-04-26T20:57:53.575154+0000","last_fullsized":"2024-04-26T20:57:53.575154+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:37:58.253968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.575198+0000","last_change":"2024-04-26T20:57:51.575710+0000","last_active":"2024-04-26T20:57:53.575198+0000","last_peered":"2024-04-26T20:57:53.575198+0000","last_clean":"2024-04-26T20:57:53.575198+0000","last_became_active":"2024-04-26T20:57:51.575446+0000","last_became_peered":"2024-04-26T20:57:51.575446+0000","last_unstale":"2024-04-26T20:57:53.575198+0000","last_undegraded":"2024-04-26T20:57:53.575198+0000","last_fullsized":"2024-04-26T20:57:53.575198+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:05.463288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.575005+0000","last_change":"2024-04-26T20:57:52.585080+0000","last_active":"2024-04-26T20:57:53.575005+0000","last_peered":"2024-04-26T20:57:53.575005+0000","last_clean":"2024-04-26T20:57:53.575005+0000","last_became_active":"2024-04-26T20:57:52.584794+0000","last_became_peered":"2024-04-26T20:57:52.584794+0000","last_unstale":"2024-04-26T20:57:53.575005+0000","last_undegraded":"2024-04-26T20:57:53.575005+0000","last_fullsized":"2024-04-26T20:57:53.575005+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:50:33.246661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.491209+0000","last_change":"2024-04-26T20:57:51.569389+0000","last_active":"2024-04-26T20:57:55.491209+0000","last_peered":"2024-04-26T20:57:55.491209+0000","last_clean":"2024-04-26T20:57:55.491209+0000","last_became_active":"2024-04-26T20:57:51.569128+0000","last_became_peered":"2024-04-26T20:57:51.569128+0000","last_unstale":"2024-04-26T20:57:55.491209+0000","last_undegraded":"2024-04-26T20:57:55.491209+0000","last_fullsized":"2024-04-26T20:57:55.491209+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:44.305635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.575094+0000","last_change":"2024-04-26T20:57:52.580234+0000","last_active":"2024-04-26T20:57:53.575094+0000","last_peered":"2024-04-26T20:57:53.575094+0000","last_clean":"2024-04-26T20:57:53.575094+0000","last_became_active":"2024-04-26T20:57:52.579929+0000","last_became_peered":"2024-04-26T20:57:52.579929+0000","last_unstale":"2024-04-26T20:57:53.575094+0000","last_undegraded":"2024-04-26T20:57:53.575094+0000","last_fullsized":"2024-04-26T20:57:53.575094+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:11.582177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574794+0000","last_change":"2024-04-26T20:57:51.577610+0000","last_active":"2024-04-26T20:57:53.574794+0000","last_peered":"2024-04-26T20:57:53.574794+0000","last_clean":"2024-04-26T20:57:53.574794+0000","last_became_active":"2024-04-26T20:57:51.577352+0000","last_became_peered":"2024-04-26T20:57:51.577352+0000","last_unstale":"2024-04-26T20:57:53.574794+0000","last_undegraded":"2024-04-26T20:57:53.574794+0000","last_fullsized":"2024-04-26T20:57:53.574794+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:05:01.247112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.491689+0000","last_change":"2024-04-26T20:57:52.593107+0000","last_active":"2024-04-26T20:57:55.491689+0000","last_peered":"2024-04-26T20:57:55.491689+0000","last_clean":"2024-04-26T20:57:55.491689+0000","last_became_active":"2024-04-26T20:57:52.592849+0000","last_became_peered":"2024-04-26T20:57:52.592849+0000","last_unstale":"2024-04-26T20:57:55.491689+0000","last_undegraded":"2024-04-26T20:57:55.491689+0000","last_fullsized":"2024-04-26T20:57:55.491689+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:28:20.157680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.491238+0000","last_change":"2024-04-26T20:57:51.573218+0000","last_active":"2024-04-26T20:57:55.491238+0000","last_peered":"2024-04-26T20:57:55.491238+0000","last_clean":"2024-04-26T20:57:55.491238+0000","last_became_active":"2024-04-26T20:57:51.572070+0000","last_became_peered":"2024-04-26T20:57:51.572070+0000","last_unstale":"2024-04-26T20:57:55.491238+0000","last_undegraded":"2024-04-26T20:57:55.491238+0000","last_fullsized":"2024-04-26T20:57:55.491238+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:43.209710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.490566+0000","last_change":"2024-04-26T20:57:52.580620+0000","last_active":"2024-04-26T20:57:55.490566+0000","last_peered":"2024-04-26T20:57:55.490566+0000","last_clean":"2024-04-26T20:57:55.490566+0000","last_became_active":"2024-04-26T20:57:52.580262+0000","last_became_peered":"2024-04-26T20:57:52.580262+0000","last_unstale":"2024-04-26T20:57:55.490566+0000","last_undegraded":"2024-04-26T20:57:55.490566+0000","last_fullsized":"2024-04-26T20:57:55.490566+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:18:30.707432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.491177+0000","last_change":"2024-04-26T20:57:51.572477+0000","last_active":"2024-04-26T20:57:55.491177+0000","last_peered":"2024-04-26T20:57:55.491177+0000","last_clean":"2024-04-26T20:57:55.491177+0000","last_became_active":"2024-04-26T20:57:51.572200+0000","last_became_peered":"2024-04-26T20:57:51.572200+0000","last_unstale":"2024-04-26T20:57:55.491177+0000","last_undegraded":"2024-04-26T20:57:55.491177+0000","last_fullsized":"2024-04-26T20:57:55.491177+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:03:39.964597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.588400+0000","last_change":"2024-04-26T20:57:52.570952+0000","last_active":"2024-04-26T20:57:52.588400+0000","last_peered":"2024-04-26T20:57:52.588400+0000","last_clean":"2024-04-26T20:57:52.588400+0000","last_became_active":"2024-04-26T20:57:52.570601+0000","last_became_peered":"2024-04-26T20:57:52.570601+0000","last_unstale":"2024-04-26T20:57:52.588400+0000","last_undegraded":"2024-04-26T20:57:52.588400+0000","last_fullsized":"2024-04-26T20:57:52.588400+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:14:41.960247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574671+0000","last_change":"2024-04-26T20:57:51.575051+0000","last_active":"2024-04-26T20:57:53.574671+0000","last_peered":"2024-04-26T20:57:53.574671+0000","last_clean":"2024-04-26T20:57:53.574671+0000","last_became_active":"2024-04-26T20:57:51.574755+0000","last_became_peered":"2024-04-26T20:57:51.574755+0000","last_unstale":"2024-04-26T20:57:53.574671+0000","last_undegraded":"2024-04-26T20:57:53.574671+0000","last_fullsized":"2024-04-26T20:57:53.574671+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:32.553314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.697923+0000","last_change":"2024-04-26T20:57:52.584567+0000","last_active":"2024-04-26T20:57:53.697923+0000","last_peered":"2024-04-26T20:57:53.697923+0000","last_clean":"2024-04-26T20:57:53.697923+0000","last_became_active":"2024-04-26T20:57:52.584136+0000","last_became_peered":"2024-04-26T20:57:52.584136+0000","last_unstale":"2024-04-26T20:57:53.697923+0000","last_undegraded":"2024-04-26T20:57:53.697923+0000","last_fullsized":"2024-04-26T20:57:53.697923+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:16.143937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574660+0000","last_change":"2024-04-26T20:57:51.573894+0000","last_active":"2024-04-26T20:57:53.574660+0000","last_peered":"2024-04-26T20:57:53.574660+0000","last_clean":"2024-04-26T20:57:53.574660+0000","last_became_active":"2024-04-26T20:57:51.573467+0000","last_became_peered":"2024-04-26T20:57:51.573467+0000","last_unstale":"2024-04-26T20:57:53.574660+0000","last_undegraded":"2024-04-26T20:57:53.574660+0000","last_fullsized":"2024-04-26T20:57:53.574660+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:53.725346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.585479+0000","last_change":"2024-04-26T20:57:52.570583+0000","last_active":"2024-04-26T20:57:52.585479+0000","last_peered":"2024-04-26T20:57:52.585479+0000","last_clean":"2024-04-26T20:57:52.585479+0000","last_became_active":"2024-04-26T20:57:52.570303+0000","last_became_peered":"2024-04-26T20:57:52.570303+0000","last_unstale":"2024-04-26T20:57:52.585479+0000","last_undegraded":"2024-04-26T20:57:52.585479+0000","last_fullsized":"2024-04-26T20:57:52.585479+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:45:31.989965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574244+0000","last_change":"2024-04-26T20:57:51.571920+0000","last_active":"2024-04-26T20:57:53.574244+0000","last_peered":"2024-04-26T20:57:53.574244+0000","last_clean":"2024-04-26T20:57:53.574244+0000","last_became_active":"2024-04-26T20:57:51.571644+0000","last_became_peered":"2024-04-26T20:57:51.571644+0000","last_unstale":"2024-04-26T20:57:53.574244+0000","last_undegraded":"2024-04-26T20:57:53.574244+0000","last_fullsized":"2024-04-26T20:57:53.574244+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:55:41.720506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574710+0000","last_change":"2024-04-26T20:57:52.593531+0000","last_active":"2024-04-26T20:57:53.574710+0000","last_peered":"2024-04-26T20:57:53.574710+0000","last_clean":"2024-04-26T20:57:53.574710+0000","last_became_active":"2024-04-26T20:57:52.592602+0000","last_became_peered":"2024-04-26T20:57:52.592602+0000","last_unstale":"2024-04-26T20:57:53.574710+0000","last_undegraded":"2024-04-26T20:57:53.574710+0000","last_fullsized":"2024-04-26T20:57:53.574710+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:14:02.457147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.491202+0000","last_change":"2024-04-26T20:57:51.570771+0000","last_active":"2024-04-26T20:57:55.491202+0000","last_peered":"2024-04-26T20:57:55.491202+0000","last_clean":"2024-04-26T20:57:55.491202+0000","last_became_active":"2024-04-26T20:57:51.570488+0000","last_became_peered":"2024-04-26T20:57:51.570488+0000","last_unstale":"2024-04-26T20:57:55.491202+0000","last_undegraded":"2024-04-26T20:57:55.491202+0000","last_fullsized":"2024-04-26T20:57:55.491202+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:44:02.286474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.698377+0000","last_change":"2024-04-26T20:57:52.579072+0000","last_active":"2024-04-26T20:57:53.698377+0000","last_peered":"2024-04-26T20:57:53.698377+0000","last_clean":"2024-04-26T20:57:53.698377+0000","last_became_active":"2024-04-26T20:57:52.578605+0000","last_became_peered":"2024-04-26T20:57:52.578605+0000","last_unstale":"2024-04-26T20:57:53.698377+0000","last_undegraded":"2024-04-26T20:57:53.698377+0000","last_fullsized":"2024-04-26T20:57:53.698377+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:06:38.434416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"41'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.575429+0000","last_change":"2024-04-26T20:57:51.577840+0000","last_active":"2024-04-26T20:57:53.575429+0000","last_peered":"2024-04-26T20:57:53.575429+0000","last_clean":"2024-04-26T20:57:53.575429+0000","last_became_active":"2024-04-26T20:57:51.577584+0000","last_became_peered":"2024-04-26T20:57:51.577584+0000","last_unstale":"2024-04-26T20:57:53.575429+0000","last_undegraded":"2024-04-26T20:57:53.575429+0000","last_fullsized":"2024-04-26T20:57:53.575429+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:41:35.733249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.491274+0000","last_change":"2024-04-26T20:57:52.580763+0000","last_active":"2024-04-26T20:57:55.491274+0000","last_peered":"2024-04-26T20:57:55.491274+0000","last_clean":"2024-04-26T20:57:55.491274+0000","last_became_active":"2024-04-26T20:57:52.580489+0000","last_became_peered":"2024-04-26T20:57:52.580489+0000","last_unstale":"2024-04-26T20:57:55.491274+0000","last_undegraded":"2024-04-26T20:57:55.491274+0000","last_fullsized":"2024-04-26T20:57:55.491274+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:16.143937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574942+0000","last_change":"2024-04-26T20:57:51.574263+0000","last_active":"2024-04-26T20:57:53.574942+0000","last_peered":"2024-04-26T20:57:53.574942+0000","last_clean":"2024-04-26T20:57:53.574942+0000","last_became_active":"2024-04-26T20:57:51.573941+0000","last_became_peered":"2024-04-26T20:57:51.573941+0000","last_unstale":"2024-04-26T20:57:53.574942+0000","last_undegraded":"2024-04-26T20:57:53.574942+0000","last_fullsized":"2024-04-26T20:57:53.574942+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:38.596761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574968+0000","last_change":"2024-04-26T20:57:52.592217+0000","last_active":"2024-04-26T20:57:53.574968+0000","last_peered":"2024-04-26T20:57:53.574968+0000","last_clean":"2024-04-26T20:57:53.574968+0000","last_became_active":"2024-04-26T20:57:52.591954+0000","last_became_peered":"2024-04-26T20:57:52.591954+0000","last_unstale":"2024-04-26T20:57:53.574968+0000","last_undegraded":"2024-04-26T20:57:53.574968+0000","last_fullsized":"2024-04-26T20:57:53.574968+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:43:08.977177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.561642+0000","last_change":"2024-04-26T20:57:51.571206+0000","last_active":"2024-04-26T20:57:52.561642+0000","last_peered":"2024-04-26T20:57:52.561642+0000","last_clean":"2024-04-26T20:57:52.561642+0000","last_became_active":"2024-04-26T20:57:51.570877+0000","last_became_peered":"2024-04-26T20:57:51.570877+0000","last_unstale":"2024-04-26T20:57:52.561642+0000","last_undegraded":"2024-04-26T20:57:52.561642+0000","last_fullsized":"2024-04-26T20:57:52.561642+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:49:38.164099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574698+0000","last_change":"2024-04-26T20:57:52.594833+0000","last_active":"2024-04-26T20:57:53.574698+0000","last_peered":"2024-04-26T20:57:53.574698+0000","last_clean":"2024-04-26T20:57:53.574698+0000","last_became_active":"2024-04-26T20:57:52.594522+0000","last_became_peered":"2024-04-26T20:57:52.594522+0000","last_unstale":"2024-04-26T20:57:53.574698+0000","last_undegraded":"2024-04-26T20:57:53.574698+0000","last_fullsized":"2024-04-26T20:57:53.574698+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:12.952743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.698207+0000","last_change":"2024-04-26T20:57:51.574086+0000","last_active":"2024-04-26T20:57:53.698207+0000","last_peered":"2024-04-26T20:57:53.698207+0000","last_clean":"2024-04-26T20:57:53.698207+0000","last_became_active":"2024-04-26T20:57:51.573834+0000","last_became_peered":"2024-04-26T20:57:51.573834+0000","last_unstale":"2024-04-26T20:57:53.698207+0000","last_undegraded":"2024-04-26T20:57:53.698207+0000","last_fullsized":"2024-04-26T20:57:53.698207+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:50:32.238625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.490916+0000","last_change":"2024-04-26T20:57:52.588655+0000","last_active":"2024-04-26T20:57:55.490916+0000","last_peered":"2024-04-26T20:57:55.490916+0000","last_clean":"2024-04-26T20:57:55.490916+0000","last_became_active":"2024-04-26T20:57:52.588356+0000","last_became_peered":"2024-04-26T20:57:52.588356+0000","last_unstale":"2024-04-26T20:57:55.490916+0000","last_undegraded":"2024-04-26T20:57:55.490916+0000","last_fullsized":"2024-04-26T20:57:55.490916+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:13.137551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.490834+0000","last_change":"2024-04-26T20:57:51.567675+0000","last_active":"2024-04-26T20:57:55.490834+0000","last_peered":"2024-04-26T20:57:55.490834+0000","last_clean":"2024-04-26T20:57:55.490834+0000","last_became_active":"2024-04-26T20:57:51.567464+0000","last_became_peered":"2024-04-26T20:57:51.567464+0000","last_unstale":"2024-04-26T20:57:55.490834+0000","last_undegraded":"2024-04-26T20:57:55.490834+0000","last_fullsized":"2024-04-26T20:57:55.490834+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:17.267826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.698084+0000","last_change":"2024-04-26T20:57:52.587210+0000","last_active":"2024-04-26T20:57:53.698084+0000","last_peered":"2024-04-26T20:57:53.698084+0000","last_clean":"2024-04-26T20:57:53.698084+0000","last_became_active":"2024-04-26T20:57:52.587015+0000","last_became_peered":"2024-04-26T20:57:52.587015+0000","last_unstale":"2024-04-26T20:57:53.698084+0000","last_undegraded":"2024-04-26T20:57:53.698084+0000","last_fullsized":"2024-04-26T20:57:53.698084+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:06:01.245752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.570297+0000","last_change":"2024-04-26T20:57:51.579142+0000","last_active":"2024-04-26T20:57:52.570297+0000","last_peered":"2024-04-26T20:57:52.570297+0000","last_clean":"2024-04-26T20:57:52.570297+0000","last_became_active":"2024-04-26T20:57:51.578834+0000","last_became_peered":"2024-04-26T20:57:51.578834+0000","last_unstale":"2024-04-26T20:57:52.570297+0000","last_undegraded":"2024-04-26T20:57:52.570297+0000","last_fullsized":"2024-04-26T20:57:52.570297+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:48:04.831644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.491150+0000","last_change":"2024-04-26T20:57:52.569231+0000","last_active":"2024-04-26T20:57:55.491150+0000","last_peered":"2024-04-26T20:57:55.491150+0000","last_clean":"2024-04-26T20:57:55.491150+0000","last_became_active":"2024-04-26T20:57:52.568915+0000","last_became_peered":"2024-04-26T20:57:52.568915+0000","last_unstale":"2024-04-26T20:57:55.491150+0000","last_undegraded":"2024-04-26T20:57:55.491150+0000","last_fullsized":"2024-04-26T20:57:55.491150+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:12:00.029798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.698099+0000","last_change":"2024-04-26T20:57:51.574337+0000","last_active":"2024-04-26T20:57:53.698099+0000","last_peered":"2024-04-26T20:57:53.698099+0000","last_clean":"2024-04-26T20:57:53.698099+0000","last_became_active":"2024-04-26T20:57:51.573114+0000","last_became_peered":"2024-04-26T20:57:51.573114+0000","last_unstale":"2024-04-26T20:57:53.698099+0000","last_undegraded":"2024-04-26T20:57:53.698099+0000","last_fullsized":"2024-04-26T20:57:53.698099+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:36:54.823396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":204,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574525+0000","last_change":"2024-04-26T20:56:29.347462+0000","last_active":"2024-04-26T20:57:53.574525+0000","last_peered":"2024-04-26T20:57:53.574525+0000","last_clean":"2024-04-26T20:57:53.574525+0000","last_became_active":"2024-04-26T20:56:29.346224+0000","last_became_peered":"2024-04-26T20:56:29.346224+0000","last_unstale":"2024-04-26T20:57:53.574525+0000","last_undegraded":"2024-04-26T20:57:53.574525+0000","last_fullsized":"2024-04-26T20:57:53.574525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:28.079105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:28.079105+0000","last_clean_scrub_stamp":"2024-04-26T20:56:28.079105+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:13.693525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509462,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":471040,"data_stored":199693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509461,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":471040,"data_stored":199657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509462,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28060,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343780,"statfs":{"total":96636764160,"available":96608030720,"internally_reserved":0,"allocated":1064960,"data_stored":790573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509462,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":193021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509462,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":201817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509461,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1064960,"data_stored":790013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509460,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":475136,"data_stored":199715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":475136,"data_stored":194667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T20:57:57.431 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-26T20:57:57.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.600+0000 7f5ec0c00640 1 Processor -- start 2024-04-26T20:57:57.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.600+0000 7f5ec0c00640 1 -- start start 2024-04-26T20:57:57.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.600+0000 7f5ec0c00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5ebc15f410 0x7f5ebc0cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:57.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.600+0000 7f5ec0c00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f5ebc0d1f10 0x7f5ebc0cfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:57.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.600+0000 7f5ec0c00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ebc06d6c0 con 0x7f5ebc0d3850 2024-04-26T20:57:57.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.600+0000 7f5ec0c00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f5ebc15f7f0 con 0x7f5ebc0d1f10 2024-04-26T20:57:57.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.600+0000 7f5ec0c00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f5ebc0d2340 con 0x7f5ebc15f410 2024-04-26T20:57:57.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.600+0000 7f5eb9400640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f5ebc0d3850 0x7f5ebc0cddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:58854/0 (socket says 172.21.15.138:58854) 2024-04-26T20:57:57.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.600+0000 7f5eb9400640 1 -- 172.21.15.138:0/2133249850 learned_addr learned my addr 172.21.15.138:0/2133249850 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:57:57.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.600+0000 7f5eb9e00640 1 --2- 172.21.15.138:0/2133249850 >> v2:172.21.15.143:3300/0 conn(0x7f5ebc15f410 0x7f5ebc0cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:57.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.600+0000 7f5eba800640 1 --2- 172.21.15.138:0/2133249850 >> v2:172.21.15.138:3300/0 conn(0x7f5ebc0d1f10 0x7f5ebc0cfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:57.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.604+0000 7f5eb8a00640 1 -- 172.21.15.138:0/2133249850 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2384748284 0 0) 0x7f5ebc06d6c0 con 0x7f5ebc0d3850 2024-04-26T20:57:57.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.604+0000 7f5eb8a00640 1 -- 172.21.15.138:0/2133249850 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ea0003530 con 0x7f5ebc0d3850 2024-04-26T20:57:57.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.604+0000 7f5eb9e00640 1 -- 172.21.15.138:0/2133249850 >> v2:172.21.15.138:3300/0 conn(0x7f5ebc0d1f10 msgr2=0x7f5ebc0cfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:57.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.604+0000 7f5eb9e00640 1 --2- 172.21.15.138:0/2133249850 >> v2:172.21.15.138:3300/0 conn(0x7f5ebc0d1f10 0x7f5ebc0cfaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:57.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.604+0000 7f5eb9e00640 1 -- 172.21.15.138:0/2133249850 >> v1:172.21.15.138:6789/0 conn(0x7f5ebc0d3850 legacy=0x7f5ebc0cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:57.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.604+0000 7f5eb9e00640 1 -- 172.21.15.138:0/2133249850 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ebc06d9a0 con 0x7f5ebc15f410 2024-04-26T20:57:57.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.604+0000 7f5eba800640 1 --2- 172.21.15.138:0/2133249850 >> v2:172.21.15.138:3300/0 conn(0x7f5ebc0d1f10 0x7f5ebc0cfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:57:57.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.604+0000 7f5eb9e00640 1 --2- 172.21.15.138:0/2133249850 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ebc15f410 0x7f5ebc0cf5b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc072fb0 tx=0x7f5eac01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20499cc70081caf1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:57.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.604+0000 7f5eb8a00640 1 -- 172.21.15.138:0/2133249850 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eac0b0070 con 0x7f5ebc15f410 2024-04-26T20:57:57.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.604+0000 7f5eb8a00640 1 -- 172.21.15.138:0/2133249850 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5eac0ab600 con 0x7f5ebc15f410 2024-04-26T20:57:57.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.604+0000 7f5eb8a00640 1 -- 172.21.15.138:0/2133249850 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eac0ab9d0 con 0x7f5ebc15f410 2024-04-26T20:57:57.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.608+0000 7f5ec0c00640 1 -- 172.21.15.138:0/2133249850 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ebc15f410 msgr2=0x7f5ebc0cf5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:57.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.608+0000 7f5ec0c00640 1 --2- 172.21.15.138:0/2133249850 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ebc15f410 0x7f5ebc0cf5b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc072fb0 tx=0x7f5eac01c3f0 comp rx=0 tx=0).stop 2024-04-26T20:57:57.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.608+0000 7f5ec0c00640 1 -- 172.21.15.138:0/2133249850 shutdown_connections 2024-04-26T20:57:57.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.608+0000 7f5ec0c00640 1 --2- 172.21.15.138:0/2133249850 >> v2:172.21.15.138:3300/0 conn(0x7f5ebc0d1f10 0x7f5ebc0cfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:57.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.608+0000 7f5ec0c00640 1 --2- 172.21.15.138:0/2133249850 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ebc15f410 0x7f5ebc0cf5b0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:57.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.608+0000 7f5ec0c00640 1 -- 172.21.15.138:0/2133249850 >> 172.21.15.138:0/2133249850 conn(0x7f5ebc0d2d30 msgr2=0x7f5ebc0d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:57.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.608+0000 7f5ec0c00640 1 -- 172.21.15.138:0/2133249850 shutdown_connections 2024-04-26T20:57:57.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.608+0000 7f5ec0c00640 1 -- 172.21.15.138:0/2133249850 wait complete. 2024-04-26T20:57:57.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.608+0000 7f5ec0c00640 1 Processor -- start 2024-04-26T20:57:57.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.608+0000 7f5ec0c00640 1 -- start start 2024-04-26T20:57:57.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.608+0000 7f5ec0c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ebc0d1f10 0x7f5ebc0cb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:57.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.608+0000 7f5ec0c00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ebc0d3850 0x7f5ebc157250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:57.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.608+0000 7f5ec0c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5ebc15f410 0x7f5ebc15e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:57.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.608+0000 7f5ec0c00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f5ebc0cee70 con 0x7f5ebc0d3850 2024-04-26T20:57:57.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.608+0000 7f5ec0c00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f5ebc0cecf0 con 0x7f5ebc0d1f10 2024-04-26T20:57:57.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.608+0000 7f5ec0c00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f5ebc0ceff0 con 0x7f5ebc15f410 2024-04-26T20:57:57.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.608+0000 7f5eb9400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ebc0d3850 0x7f5ebc157250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:57.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.608+0000 7f5eb9400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ebc0d3850 0x7f5ebc157250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:53108/0 (socket says 172.21.15.138:53108) 2024-04-26T20:57:57.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.608+0000 7f5eb9400640 1 -- 172.21.15.138:0/1927745541 learned_addr learned my addr 172.21.15.138:0/1927745541 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:57.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.608+0000 7f5eb9e00640 1 --2- 172.21.15.138:0/1927745541 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ebc0d1f10 0x7f5ebc0cb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:57.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.608+0000 7f5eba800640 1 --2- 172.21.15.138:0/1927745541 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5ebc15f410 0x7f5ebc15e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:57.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.608+0000 7f5eb9400640 1 -- 172.21.15.138:0/1927745541 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5ebc15f410 msgr2=0x7f5ebc15e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:57.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.608+0000 7f5eb9400640 1 --2- 172.21.15.138:0/1927745541 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5ebc15f410 0x7f5ebc15e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:57.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.608+0000 7f5eb9400640 1 -- 172.21.15.138:0/1927745541 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ebc0d1f10 msgr2=0x7f5ebc0cb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:57.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.608+0000 7f5eb9400640 1 --2- 172.21.15.138:0/1927745541 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ebc0d1f10 0x7f5ebc0cb0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:57.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.608+0000 7f5eb9400640 1 -- 172.21.15.138:0/1927745541 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ebc157790 con 0x7f5ebc0d3850 2024-04-26T20:57:57.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.612+0000 7f5eb9400640 1 --2- 172.21.15.138:0/1927745541 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ebc0d3850 0x7f5ebc157250 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f5ea800c3c0 tx=0x7f5ea800c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:57.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.612+0000 7f5eb2000640 1 -- 172.21.15.138:0/1927745541 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea8017070 con 0x7f5ebc0d3850 2024-04-26T20:57:57.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.612+0000 7f5eb2000640 1 -- 172.21.15.138:0/1927745541 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ea8005db0 con 0x7f5ebc0d3850 2024-04-26T20:57:57.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.612+0000 7f5eb2000640 1 -- 172.21.15.138:0/1927745541 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea80072f0 con 0x7f5ebc0d3850 2024-04-26T20:57:57.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.612+0000 7f5ec0c00640 1 -- 172.21.15.138:0/1927745541 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ebc0cb6e0 con 0x7f5ebc0d3850 2024-04-26T20:57:57.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.612+0000 7f5ec0c00640 1 -- 172.21.15.138:0/1927745541 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ebc0cbca0 con 0x7f5ebc0d3850 2024-04-26T20:57:57.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.612+0000 7f5ec0c00640 1 -- 172.21.15.138:0/1927745541 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ebc069510 con 0x7f5ebc0d3850 2024-04-26T20:57:57.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.612+0000 7f5eb2000640 1 -- 172.21.15.138:0/1927745541 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5ea801a070 con 0x7f5ebc0d3850 2024-04-26T20:57:57.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.612+0000 7f5eb2000640 1 --2- 172.21.15.138:0/1927745541 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5e9c068380 0x7f5e9c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:57.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.612+0000 7f5eb2000640 1 -- 172.21.15.138:0/1927745541 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f5ea8085f80 con 0x7f5ebc0d3850 2024-04-26T20:57:57.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.612+0000 7f5eb9e00640 1 --2- 172.21.15.138:0/1927745541 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5e9c068380 0x7f5e9c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:57.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.616+0000 7f5eb9e00640 1 --2- 172.21.15.138:0/1927745541 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5e9c068380 0x7f5e9c06a840 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5eac0ad000 tx=0x7f5eac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:57.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.616+0000 7f5eb2000640 1 -- 172.21.15.138:0/1927745541 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5ea8055cc0 con 0x7f5ebc0d3850 2024-04-26T20:57:57.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.828+0000 7f5ec0c00640 1 -- 172.21.15.138:0/1927745541 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f5ebc06dd00 con 0x7f5ebc0d3850 2024-04-26T20:57:57.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.828+0000 7f5eb2000640 1 -- 172.21.15.138:0/1927745541 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1174 (secure 0 0 0) 0x7f5ea8059fc0 con 0x7f5ebc0d3850 2024-04-26T20:57:57.831 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:57:57.831 INFO:teuthology.orchestra.run.smithi138.stdout:{"fsid":"c22b4730-12cc-4558-8535-b965384398c0","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":103,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":41,"num_osds":8,"num_up_osds":8,"osd_up_since":1714164986,"num_in_osds":8,"osd_in_since":1714164976,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":226340864,"bytes_avail":772867772416,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":18,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"d","status":"up:active","gid":5310}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2024-04-26T20:57:35.254770+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-26T20:57:57.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.832+0000 7f5ec0c00640 1 -- 172.21.15.138:0/1927745541 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5e9c068380 msgr2=0x7f5e9c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:57.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.832+0000 7f5ec0c00640 1 --2- 172.21.15.138:0/1927745541 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5e9c068380 0x7f5e9c06a840 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5eac0ad000 tx=0x7f5eac008040 comp rx=0 tx=0).stop 2024-04-26T20:57:57.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.832+0000 7f5ec0c00640 1 -- 172.21.15.138:0/1927745541 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ebc0d3850 msgr2=0x7f5ebc157250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:57.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.832+0000 7f5ec0c00640 1 --2- 172.21.15.138:0/1927745541 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ebc0d3850 0x7f5ebc157250 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f5ea800c3c0 tx=0x7f5ea800c7c0 comp rx=0 tx=0).stop 2024-04-26T20:57:57.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.832+0000 7f5ec0c00640 1 -- 172.21.15.138:0/1927745541 shutdown_connections 2024-04-26T20:57:57.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.832+0000 7f5ec0c00640 1 --2- 172.21.15.138:0/1927745541 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5e9c068380 0x7f5e9c06a840 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:57.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.832+0000 7f5ec0c00640 1 --2- 172.21.15.138:0/1927745541 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5ebc15f410 0x7f5ebc15e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:57.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.832+0000 7f5ec0c00640 1 --2- 172.21.15.138:0/1927745541 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ebc0d3850 0x7f5ebc157250 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:57.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.832+0000 7f5ec0c00640 1 --2- 172.21.15.138:0/1927745541 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ebc0d1f10 0x7f5ebc0cb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:57.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.832+0000 7f5ec0c00640 1 -- 172.21.15.138:0/1927745541 >> 172.21.15.138:0/1927745541 conn(0x7f5ebc0d2d30 msgr2=0x7f5ebc0cddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:57.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.832+0000 7f5ec0c00640 1 -- 172.21.15.138:0/1927745541 shutdown_connections 2024-04-26T20:57:57.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.832+0000 7f5ec0c00640 1 -- 172.21.15.138:0/1927745541 wait complete. 2024-04-26T20:57:57.852 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-26T20:57:57.852 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T20:57:57.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.984+0000 7ff367e00640 1 Processor -- start 2024-04-26T20:57:57.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.984+0000 7ff367e00640 1 -- start start 2024-04-26T20:57:57.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.988+0000 7ff367e00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff36015e0c0 0x7ff360071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:57.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.988+0000 7ff367e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff3600cca00 0x7ff3600cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:57.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.988+0000 7ff367e00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3600cd360 con 0x7ff36015ce20 2024-04-26T20:57:57.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.988+0000 7ff367e00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7ff360073b70 con 0x7ff3600cca00 2024-04-26T20:57:57.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.988+0000 7ff367e00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7ff360073e10 con 0x7ff36015e0c0 2024-04-26T20:57:57.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.988+0000 7ff365e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff3600cca00 0x7ff3600cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:57.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.988+0000 7ff365e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff3600cca00 0x7ff3600cce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:53122/0 (socket says 172.21.15.138:53122) 2024-04-26T20:57:57.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.988+0000 7ff365e00640 1 -- 172.21.15.138:0/4173960833 learned_addr learned my addr 172.21.15.138:0/4173960833 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:57.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.988+0000 7ff364a00640 1 --2- 172.21.15.138:0/4173960833 >> v2:172.21.15.143:3300/0 conn(0x7ff36015e0c0 0x7ff360071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:57.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.988+0000 7ff365e00640 1 -- 172.21.15.138:0/4173960833 >> v2:172.21.15.143:3300/0 conn(0x7ff36015e0c0 msgr2=0x7ff360071ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:57:57.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.988+0000 7ff365e00640 1 --2- 172.21.15.138:0/4173960833 >> v2:172.21.15.143:3300/0 conn(0x7ff36015e0c0 0x7ff360071ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:57.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.988+0000 7ff365e00640 1 -- 172.21.15.138:0/4173960833 >> v1:172.21.15.143:6789/0 conn(0x7ff36015ce20 legacy=0x7ff360161340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:57.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.988+0000 7ff365e00640 1 -- 172.21.15.138:0/4173960833 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3600740f0 con 0x7ff3600cca00 2024-04-26T20:57:57.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.992+0000 7ff365e00640 1 --2- 172.21.15.138:0/4173960833 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3600cca00 0x7ff3600cce20 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff36006fb00 tx=0x7ff35801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aa25c3f0824ad3f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:57.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.992+0000 7ff35fe00640 1 -- 172.21.15.138:0/4173960833 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3580a57d0 con 0x7ff3600cca00 2024-04-26T20:57:57.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.992+0000 7ff35fe00640 1 -- 172.21.15.138:0/4173960833 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3580a5970 con 0x7ff3600cca00 2024-04-26T20:57:57.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.992+0000 7ff35fe00640 1 -- 172.21.15.138:0/4173960833 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3580a5d40 con 0x7ff3600cca00 2024-04-26T20:57:57.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.992+0000 7ff367e00640 1 -- 172.21.15.138:0/4173960833 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3600cca00 msgr2=0x7ff3600cce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:57.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.992+0000 7ff367e00640 1 --2- 172.21.15.138:0/4173960833 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3600cca00 0x7ff3600cce20 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff36006fb00 tx=0x7ff35801c9f0 comp rx=0 tx=0).stop 2024-04-26T20:57:57.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.992+0000 7ff367e00640 1 -- 172.21.15.138:0/4173960833 shutdown_connections 2024-04-26T20:57:57.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.992+0000 7ff367e00640 1 --2- 172.21.15.138:0/4173960833 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3600cca00 0x7ff3600cce20 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:57.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.992+0000 7ff367e00640 1 --2- 172.21.15.138:0/4173960833 >> v2:172.21.15.143:3300/0 conn(0x7ff36015e0c0 0x7ff360071ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:57.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.992+0000 7ff367e00640 1 -- 172.21.15.138:0/4173960833 >> 172.21.15.138:0/4173960833 conn(0x7ff3600d0b20 msgr2=0x7ff3600d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:57.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.992+0000 7ff367e00640 1 -- 172.21.15.138:0/4173960833 shutdown_connections 2024-04-26T20:57:57.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.992+0000 7ff367e00640 1 -- 172.21.15.138:0/4173960833 wait complete. 2024-04-26T20:57:57.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.992+0000 7ff367e00640 1 Processor -- start 2024-04-26T20:57:57.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.992+0000 7ff367e00640 1 -- start start 2024-04-26T20:57:57.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.992+0000 7ff367e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff3600cca00 0x7ff3600cfa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:57.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.992+0000 7ff367e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff36015ce20 0x7ff360149480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:57.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.992+0000 7ff367e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff36015e0c0 0x7ff36014ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:57.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.992+0000 7ff367e00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff36015d380 con 0x7ff36015ce20 2024-04-26T20:57:57.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.992+0000 7ff367e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ff36015d200 con 0x7ff36015e0c0 2024-04-26T20:57:57.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.992+0000 7ff367e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ff36006e680 con 0x7ff3600cca00 2024-04-26T20:57:57.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.992+0000 7ff364a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff36015ce20 0x7ff360149480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:57.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.992+0000 7ff364a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff36015ce20 0x7ff360149480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:53130/0 (socket says 172.21.15.138:53130) 2024-04-26T20:57:57.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.992+0000 7ff364a00640 1 -- 172.21.15.138:0/3306546729 learned_addr learned my addr 172.21.15.138:0/3306546729 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:57:57.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.996+0000 7ff365400640 1 --2- 172.21.15.138:0/3306546729 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff3600cca00 0x7ff3600cfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:57.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.996+0000 7ff365e00640 1 --2- 172.21.15.138:0/3306546729 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff36015e0c0 0x7ff36014ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:57.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.996+0000 7ff364a00640 1 -- 172.21.15.138:0/3306546729 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff3600cca00 msgr2=0x7ff3600cfa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:57.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.996+0000 7ff364a00640 1 --2- 172.21.15.138:0/3306546729 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff3600cca00 0x7ff3600cfa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:57.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.996+0000 7ff364a00640 1 -- 172.21.15.138:0/3306546729 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff36015e0c0 msgr2=0x7ff36014ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:57.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.996+0000 7ff364a00640 1 --2- 172.21.15.138:0/3306546729 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff36015e0c0 0x7ff36014ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:57.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.996+0000 7ff364a00640 1 -- 172.21.15.138:0/3306546729 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3600cffc0 con 0x7ff36015ce20 2024-04-26T20:57:57.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.996+0000 7ff364a00640 1 --2- 172.21.15.138:0/3306546729 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff36015ce20 0x7ff360149480 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7ff34c00e8a0 tx=0x7ff34c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:57.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.996+0000 7ff35d600640 1 -- 172.21.15.138:0/3306546729 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff34c017070 con 0x7ff36015ce20 2024-04-26T20:57:57.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.996+0000 7ff35d600640 1 -- 172.21.15.138:0/3306546729 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff34c00c940 con 0x7ff36015ce20 2024-04-26T20:57:57.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.996+0000 7ff367e00640 1 -- 172.21.15.138:0/3306546729 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3600ce9e0 con 0x7ff36015ce20 2024-04-26T20:57:57.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.996+0000 7ff35d600640 1 -- 172.21.15.138:0/3306546729 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff34c00ccf0 con 0x7ff36015ce20 2024-04-26T20:57:57.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.996+0000 7ff367e00640 1 -- 172.21.15.138:0/3306546729 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3600cefa0 con 0x7ff36015ce20 2024-04-26T20:57:57.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.996+0000 7ff367e00640 1 -- 172.21.15.138:0/3306546729 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff360069510 con 0x7ff36015ce20 2024-04-26T20:57:57.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.996+0000 7ff35d600640 1 -- 172.21.15.138:0/3306546729 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff34c01a070 con 0x7ff36015ce20 2024-04-26T20:57:57.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.996+0000 7ff35d600640 1 --2- 172.21.15.138:0/3306546729 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff340068380 0x7ff34006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:57.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:57.996+0000 7ff35d600640 1 -- 172.21.15.138:0/3306546729 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7ff34c086910 con 0x7ff36015ce20 2024-04-26T20:57:57.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:58.000+0000 7ff365400640 1 --2- 172.21.15.138:0/3306546729 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff340068380 0x7ff34006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:58.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:58.000+0000 7ff365400640 1 --2- 172.21.15.138:0/3306546729 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff340068380 0x7ff34006a840 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff3600ce3f0 tx=0x7ff354009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:58.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:58.000+0000 7ff35d600640 1 -- 172.21.15.138:0/3306546729 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff34c056780 con 0x7ff36015ce20 2024-04-26T20:57:58.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:58.152+0000 7ff367e00640 1 -- 172.21.15.138:0/3306546729 --> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff3601672e0 con 0x7ff340068380 2024-04-26T20:57:58.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:58.160+0000 7ff35d600640 1 -- 172.21.15.138:0/3306546729 <== mgr.4100 v2:172.21.15.143:6832/4275464198 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251943 (secure 0 0 0) 0x7ff3601672e0 con 0x7ff340068380 2024-04-26T20:57:58.165 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:57:58.166 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-04-26T20:57:58.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:58.164+0000 7ff367e00640 1 -- 172.21.15.138:0/3306546729 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff340068380 msgr2=0x7ff34006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:58.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:58.164+0000 7ff367e00640 1 --2- 172.21.15.138:0/3306546729 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff340068380 0x7ff34006a840 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff3600ce3f0 tx=0x7ff354009040 comp rx=0 tx=0).stop 2024-04-26T20:57:58.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:58.164+0000 7ff367e00640 1 -- 172.21.15.138:0/3306546729 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff36015ce20 msgr2=0x7ff360149480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:58.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:58.164+0000 7ff367e00640 1 --2- 172.21.15.138:0/3306546729 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff36015ce20 0x7ff360149480 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7ff34c00e8a0 tx=0x7ff34c00eca0 comp rx=0 tx=0).stop 2024-04-26T20:57:58.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:58.164+0000 7ff367e00640 1 -- 172.21.15.138:0/3306546729 shutdown_connections 2024-04-26T20:57:58.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:58.164+0000 7ff367e00640 1 --2- 172.21.15.138:0/3306546729 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff340068380 0x7ff34006a840 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:58.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:58.164+0000 7ff367e00640 1 --2- 172.21.15.138:0/3306546729 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff36015e0c0 0x7ff36014ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:58.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:58.164+0000 7ff367e00640 1 --2- 172.21.15.138:0/3306546729 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff36015ce20 0x7ff360149480 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:58.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:58.164+0000 7ff367e00640 1 --2- 172.21.15.138:0/3306546729 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff3600cca00 0x7ff3600cfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:58.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:58.164+0000 7ff367e00640 1 -- 172.21.15.138:0/3306546729 >> 172.21.15.138:0/3306546729 conn(0x7ff3600d0b20 msgr2=0x7ff36015d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:58.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:58.164+0000 7ff367e00640 1 -- 172.21.15.138:0/3306546729 shutdown_connections 2024-04-26T20:57:58.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:57:58.164+0000 7ff367e00640 1 -- 172.21.15.138:0/3306546729 wait complete. 2024-04-26T20:57:58.185 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2024-04-26T20:57:57.259623+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221036,"kb_used_data":4848,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753684,"statfs":{"total":773094113280,"available":772867772416,"internally_reserved":0,"allocated":4964352,"data_stored":2769156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001322"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.593260+0000","last_change":"2024-04-26T20:57:52.581808+0000","last_active":"2024-04-26T20:57:52.593260+0000","last_peered":"2024-04-26T20:57:52.593260+0000","last_clean":"2024-04-26T20:57:52.593260+0000","last_became_active":"2024-04-26T20:57:52.581483+0000","last_became_peered":"2024-04-26T20:57:52.581483+0000","last_unstale":"2024-04-26T20:57:52.593260+0000","last_undegraded":"2024-04-26T20:57:52.593260+0000","last_fullsized":"2024-04-26T20:57:52.593260+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:55:05.593379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.575819+0000","last_change":"2024-04-26T20:57:52.584136+0000","last_active":"2024-04-26T20:57:53.575819+0000","last_peered":"2024-04-26T20:57:53.575819+0000","last_clean":"2024-04-26T20:57:53.575819+0000","last_became_active":"2024-04-26T20:57:52.583831+0000","last_became_peered":"2024-04-26T20:57:52.583831+0000","last_unstale":"2024-04-26T20:57:53.575819+0000","last_undegraded":"2024-04-26T20:57:53.575819+0000","last_fullsized":"2024-04-26T20:57:53.575819+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:13.183123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.597744+0000","last_change":"2024-04-26T20:57:52.589332+0000","last_active":"2024-04-26T20:57:52.597744+0000","last_peered":"2024-04-26T20:57:52.597744+0000","last_clean":"2024-04-26T20:57:52.597744+0000","last_became_active":"2024-04-26T20:57:52.589025+0000","last_became_peered":"2024-04-26T20:57:52.589025+0000","last_unstale":"2024-04-26T20:57:52.597744+0000","last_undegraded":"2024-04-26T20:57:52.597744+0000","last_fullsized":"2024-04-26T20:57:52.597744+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:15:08.538065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.591009+0000","last_change":"2024-04-26T20:57:52.577582+0000","last_active":"2024-04-26T20:57:52.591009+0000","last_peered":"2024-04-26T20:57:52.591009+0000","last_clean":"2024-04-26T20:57:52.591009+0000","last_became_active":"2024-04-26T20:57:52.576872+0000","last_became_peered":"2024-04-26T20:57:52.576872+0000","last_unstale":"2024-04-26T20:57:52.591009+0000","last_undegraded":"2024-04-26T20:57:52.591009+0000","last_fullsized":"2024-04-26T20:57:52.591009+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:26:56.698718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574966+0000","last_change":"2024-04-26T20:57:52.590233+0000","last_active":"2024-04-26T20:57:53.574966+0000","last_peered":"2024-04-26T20:57:53.574966+0000","last_clean":"2024-04-26T20:57:53.574966+0000","last_became_active":"2024-04-26T20:57:52.589943+0000","last_became_peered":"2024-04-26T20:57:52.589943+0000","last_unstale":"2024-04-26T20:57:53.574966+0000","last_undegraded":"2024-04-26T20:57:53.574966+0000","last_fullsized":"2024-04-26T20:57:53.574966+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:55:42.728542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574507+0000","last_change":"2024-04-26T20:57:52.586359+0000","last_active":"2024-04-26T20:57:53.574507+0000","last_peered":"2024-04-26T20:57:53.574507+0000","last_clean":"2024-04-26T20:57:53.574507+0000","last_became_active":"2024-04-26T20:57:52.586013+0000","last_became_peered":"2024-04-26T20:57:52.586013+0000","last_unstale":"2024-04-26T20:57:53.574507+0000","last_undegraded":"2024-04-26T20:57:53.574507+0000","last_fullsized":"2024-04-26T20:57:53.574507+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:03:40.972633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574608+0000","last_change":"2024-04-26T20:57:52.578308+0000","last_active":"2024-04-26T20:57:53.574608+0000","last_peered":"2024-04-26T20:57:53.574608+0000","last_clean":"2024-04-26T20:57:53.574608+0000","last_became_active":"2024-04-26T20:57:52.578063+0000","last_became_peered":"2024-04-26T20:57:52.578063+0000","last_unstale":"2024-04-26T20:57:53.574608+0000","last_undegraded":"2024-04-26T20:57:53.574608+0000","last_fullsized":"2024-04-26T20:57:53.574608+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:14:02.457147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.594421+0000","last_change":"2024-04-26T20:57:52.583828+0000","last_active":"2024-04-26T20:57:52.594421+0000","last_peered":"2024-04-26T20:57:52.594421+0000","last_clean":"2024-04-26T20:57:52.594421+0000","last_became_active":"2024-04-26T20:57:52.582894+0000","last_became_peered":"2024-04-26T20:57:52.582894+0000","last_unstale":"2024-04-26T20:57:52.594421+0000","last_undegraded":"2024-04-26T20:57:52.594421+0000","last_fullsized":"2024-04-26T20:57:52.594421+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:09:22.814425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.575370+0000","last_change":"2024-04-26T20:57:52.590616+0000","last_active":"2024-04-26T20:57:53.575370+0000","last_peered":"2024-04-26T20:57:53.575370+0000","last_clean":"2024-04-26T20:57:53.575370+0000","last_became_active":"2024-04-26T20:57:52.589972+0000","last_became_peered":"2024-04-26T20:57:52.589972+0000","last_unstale":"2024-04-26T20:57:53.575370+0000","last_undegraded":"2024-04-26T20:57:53.575370+0000","last_fullsized":"2024-04-26T20:57:53.575370+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:50:33.246661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.575071+0000","last_change":"2024-04-26T20:57:52.575175+0000","last_active":"2024-04-26T20:57:53.575071+0000","last_peered":"2024-04-26T20:57:53.575071+0000","last_clean":"2024-04-26T20:57:53.575071+0000","last_became_active":"2024-04-26T20:57:52.574917+0000","last_became_peered":"2024-04-26T20:57:52.574917+0000","last_unstale":"2024-04-26T20:57:53.575071+0000","last_undegraded":"2024-04-26T20:57:53.575071+0000","last_fullsized":"2024-04-26T20:57:53.575071+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:36:55.831432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.698301+0000","last_change":"2024-04-26T20:57:52.579280+0000","last_active":"2024-04-26T20:57:53.698301+0000","last_peered":"2024-04-26T20:57:53.698301+0000","last_clean":"2024-04-26T20:57:53.698301+0000","last_became_active":"2024-04-26T20:57:52.578799+0000","last_became_peered":"2024-04-26T20:57:52.578799+0000","last_unstale":"2024-04-26T20:57:53.698301+0000","last_undegraded":"2024-04-26T20:57:53.698301+0000","last_fullsized":"2024-04-26T20:57:53.698301+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:53:53.499485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574534+0000","last_change":"2024-04-26T20:57:52.585045+0000","last_active":"2024-04-26T20:57:53.574534+0000","last_peered":"2024-04-26T20:57:53.574534+0000","last_clean":"2024-04-26T20:57:53.574534+0000","last_became_active":"2024-04-26T20:57:52.584748+0000","last_became_peered":"2024-04-26T20:57:52.584748+0000","last_unstale":"2024-04-26T20:57:53.574534+0000","last_undegraded":"2024-04-26T20:57:53.574534+0000","last_fullsized":"2024-04-26T20:57:53.574534+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:19:07.737363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574687+0000","last_change":"2024-04-26T20:57:52.583032+0000","last_active":"2024-04-26T20:57:53.574687+0000","last_peered":"2024-04-26T20:57:53.574687+0000","last_clean":"2024-04-26T20:57:53.574687+0000","last_became_active":"2024-04-26T20:57:52.582788+0000","last_became_peered":"2024-04-26T20:57:52.582788+0000","last_unstale":"2024-04-26T20:57:53.574687+0000","last_undegraded":"2024-04-26T20:57:53.574687+0000","last_fullsized":"2024-04-26T20:57:53.574687+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:55:42.728542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.490142+0000","last_change":"2024-04-26T20:57:52.577582+0000","last_active":"2024-04-26T20:57:55.490142+0000","last_peered":"2024-04-26T20:57:55.490142+0000","last_clean":"2024-04-26T20:57:55.490142+0000","last_became_active":"2024-04-26T20:57:52.577366+0000","last_became_peered":"2024-04-26T20:57:52.577366+0000","last_unstale":"2024-04-26T20:57:55.490142+0000","last_undegraded":"2024-04-26T20:57:55.490142+0000","last_fullsized":"2024-04-26T20:57:55.490142+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:07.021199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.490598+0000","last_change":"2024-04-26T20:57:52.586188+0000","last_active":"2024-04-26T20:57:55.490598+0000","last_peered":"2024-04-26T20:57:55.490598+0000","last_clean":"2024-04-26T20:57:55.490598+0000","last_became_active":"2024-04-26T20:57:52.585816+0000","last_became_peered":"2024-04-26T20:57:52.585816+0000","last_unstale":"2024-04-26T20:57:55.490598+0000","last_undegraded":"2024-04-26T20:57:55.490598+0000","last_fullsized":"2024-04-26T20:57:55.490598+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:06:03.397876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574464+0000","last_change":"2024-04-26T20:57:52.587967+0000","last_active":"2024-04-26T20:57:53.574464+0000","last_peered":"2024-04-26T20:57:53.574464+0000","last_clean":"2024-04-26T20:57:53.574464+0000","last_became_active":"2024-04-26T20:57:52.587598+0000","last_became_peered":"2024-04-26T20:57:52.587598+0000","last_unstale":"2024-04-26T20:57:53.574464+0000","last_undegraded":"2024-04-26T20:57:53.574464+0000","last_fullsized":"2024-04-26T20:57:53.574464+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:19:07.737363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.491248+0000","last_change":"2024-04-26T20:57:52.582167+0000","last_active":"2024-04-26T20:57:55.491248+0000","last_peered":"2024-04-26T20:57:55.491248+0000","last_clean":"2024-04-26T20:57:55.491248+0000","last_became_active":"2024-04-26T20:57:52.581896+0000","last_became_peered":"2024-04-26T20:57:52.581896+0000","last_unstale":"2024-04-26T20:57:55.491248+0000","last_undegraded":"2024-04-26T20:57:55.491248+0000","last_fullsized":"2024-04-26T20:57:55.491248+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:33.773431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.491119+0000","last_change":"2024-04-26T20:57:52.582700+0000","last_active":"2024-04-26T20:57:55.491119+0000","last_peered":"2024-04-26T20:57:55.491119+0000","last_clean":"2024-04-26T20:57:55.491119+0000","last_became_active":"2024-04-26T20:57:52.582355+0000","last_became_peered":"2024-04-26T20:57:52.582355+0000","last_unstale":"2024-04-26T20:57:55.491119+0000","last_undegraded":"2024-04-26T20:57:55.491119+0000","last_fullsized":"2024-04-26T20:57:55.491119+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:31:29.694312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.491331+0000","last_change":"2024-04-26T20:57:52.593273+0000","last_active":"2024-04-26T20:57:55.491331+0000","last_peered":"2024-04-26T20:57:55.491331+0000","last_clean":"2024-04-26T20:57:55.491331+0000","last_became_active":"2024-04-26T20:57:52.592960+0000","last_became_peered":"2024-04-26T20:57:52.592960+0000","last_unstale":"2024-04-26T20:57:55.491331+0000","last_undegraded":"2024-04-26T20:57:55.491331+0000","last_fullsized":"2024-04-26T20:57:55.491331+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:13.183123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.698054+0000","last_change":"2024-04-26T20:57:52.569599+0000","last_active":"2024-04-26T20:57:53.698054+0000","last_peered":"2024-04-26T20:57:53.698054+0000","last_clean":"2024-04-26T20:57:53.698054+0000","last_became_active":"2024-04-26T20:57:52.569345+0000","last_became_peered":"2024-04-26T20:57:52.569345+0000","last_unstale":"2024-04-26T20:57:53.698054+0000","last_undegraded":"2024-04-26T20:57:53.698054+0000","last_fullsized":"2024-04-26T20:57:53.698054+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:26.856916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.698008+0000","last_change":"2024-04-26T20:57:52.592270+0000","last_active":"2024-04-26T20:57:53.698008+0000","last_peered":"2024-04-26T20:57:53.698008+0000","last_clean":"2024-04-26T20:57:53.698008+0000","last_became_active":"2024-04-26T20:57:52.591984+0000","last_became_peered":"2024-04-26T20:57:52.591984+0000","last_unstale":"2024-04-26T20:57:53.698008+0000","last_undegraded":"2024-04-26T20:57:53.698008+0000","last_fullsized":"2024-04-26T20:57:53.698008+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:28:20.157680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.697892+0000","last_change":"2024-04-26T20:57:52.576852+0000","last_active":"2024-04-26T20:57:53.697892+0000","last_peered":"2024-04-26T20:57:53.697892+0000","last_clean":"2024-04-26T20:57:53.697892+0000","last_became_active":"2024-04-26T20:57:52.575571+0000","last_became_peered":"2024-04-26T20:57:52.575571+0000","last_unstale":"2024-04-26T20:57:53.697892+0000","last_undegraded":"2024-04-26T20:57:53.697892+0000","last_fullsized":"2024-04-26T20:57:53.697892+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:55.128152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.490770+0000","last_change":"2024-04-26T20:57:52.586306+0000","last_active":"2024-04-26T20:57:55.490770+0000","last_peered":"2024-04-26T20:57:55.490770+0000","last_clean":"2024-04-26T20:57:55.490770+0000","last_became_active":"2024-04-26T20:57:52.585992+0000","last_became_peered":"2024-04-26T20:57:52.585992+0000","last_unstale":"2024-04-26T20:57:55.490770+0000","last_undegraded":"2024-04-26T20:57:55.490770+0000","last_fullsized":"2024-04-26T20:57:55.490770+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:09:38.712604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.594443+0000","last_change":"2024-04-26T20:57:52.584019+0000","last_active":"2024-04-26T20:57:52.594443+0000","last_peered":"2024-04-26T20:57:52.594443+0000","last_clean":"2024-04-26T20:57:52.594443+0000","last_became_active":"2024-04-26T20:57:52.583140+0000","last_became_peered":"2024-04-26T20:57:52.583140+0000","last_unstale":"2024-04-26T20:57:52.594443+0000","last_undegraded":"2024-04-26T20:57:52.594443+0000","last_fullsized":"2024-04-26T20:57:52.594443+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:31:16.104032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.490262+0000","last_change":"2024-04-26T20:57:52.579168+0000","last_active":"2024-04-26T20:57:55.490262+0000","last_peered":"2024-04-26T20:57:55.490262+0000","last_clean":"2024-04-26T20:57:55.490262+0000","last_became_active":"2024-04-26T20:57:52.578943+0000","last_became_peered":"2024-04-26T20:57:52.578943+0000","last_unstale":"2024-04-26T20:57:55.490262+0000","last_undegraded":"2024-04-26T20:57:55.490262+0000","last_fullsized":"2024-04-26T20:57:55.490262+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:10.898445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.594480+0000","last_change":"2024-04-26T20:57:52.585325+0000","last_active":"2024-04-26T20:57:52.594480+0000","last_peered":"2024-04-26T20:57:52.594480+0000","last_clean":"2024-04-26T20:57:52.594480+0000","last_became_active":"2024-04-26T20:57:52.585083+0000","last_became_peered":"2024-04-26T20:57:52.585083+0000","last_unstale":"2024-04-26T20:57:52.594480+0000","last_undegraded":"2024-04-26T20:57:52.594480+0000","last_fullsized":"2024-04-26T20:57:52.594480+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:05:21.832612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.698347+0000","last_change":"2024-04-26T20:57:52.578861+0000","last_active":"2024-04-26T20:57:53.698347+0000","last_peered":"2024-04-26T20:57:53.698347+0000","last_clean":"2024-04-26T20:57:53.698347+0000","last_became_active":"2024-04-26T20:57:52.578454+0000","last_became_peered":"2024-04-26T20:57:52.578454+0000","last_unstale":"2024-04-26T20:57:53.698347+0000","last_undegraded":"2024-04-26T20:57:53.698347+0000","last_fullsized":"2024-04-26T20:57:53.698347+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:43:41.131361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574874+0000","last_change":"2024-04-26T20:57:52.577688+0000","last_active":"2024-04-26T20:57:53.574874+0000","last_peered":"2024-04-26T20:57:53.574874+0000","last_clean":"2024-04-26T20:57:53.574874+0000","last_became_active":"2024-04-26T20:57:52.577426+0000","last_became_peered":"2024-04-26T20:57:52.577426+0000","last_unstale":"2024-04-26T20:57:53.574874+0000","last_undegraded":"2024-04-26T20:57:53.574874+0000","last_fullsized":"2024-04-26T20:57:53.574874+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:33.561350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.490763+0000","last_change":"2024-04-26T20:57:52.583932+0000","last_active":"2024-04-26T20:57:55.490763+0000","last_peered":"2024-04-26T20:57:55.490763+0000","last_clean":"2024-04-26T20:57:55.490763+0000","last_became_active":"2024-04-26T20:57:52.583671+0000","last_became_peered":"2024-04-26T20:57:52.583671+0000","last_unstale":"2024-04-26T20:57:55.490763+0000","last_undegraded":"2024-04-26T20:57:55.490763+0000","last_fullsized":"2024-04-26T20:57:55.490763+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:48:59.322923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.490695+0000","last_change":"2024-04-26T20:57:52.569868+0000","last_active":"2024-04-26T20:57:55.490695+0000","last_peered":"2024-04-26T20:57:55.490695+0000","last_clean":"2024-04-26T20:57:55.490695+0000","last_became_active":"2024-04-26T20:57:52.569591+0000","last_became_peered":"2024-04-26T20:57:52.569591+0000","last_unstale":"2024-04-26T20:57:55.490695+0000","last_undegraded":"2024-04-26T20:57:55.490695+0000","last_fullsized":"2024-04-26T20:57:55.490695+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:37:30.401536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574754+0000","last_change":"2024-04-26T20:57:52.581841+0000","last_active":"2024-04-26T20:57:53.574754+0000","last_peered":"2024-04-26T20:57:53.574754+0000","last_clean":"2024-04-26T20:57:53.574754+0000","last_became_active":"2024-04-26T20:57:52.581591+0000","last_became_peered":"2024-04-26T20:57:52.581591+0000","last_unstale":"2024-04-26T20:57:53.574754+0000","last_undegraded":"2024-04-26T20:57:53.574754+0000","last_fullsized":"2024-04-26T20:57:53.574754+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:43:08.977177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.594400+0000","last_change":"2024-04-26T20:57:52.583636+0000","last_active":"2024-04-26T20:57:52.594400+0000","last_peered":"2024-04-26T20:57:52.594400+0000","last_clean":"2024-04-26T20:57:52.594400+0000","last_became_active":"2024-04-26T20:57:52.582497+0000","last_became_peered":"2024-04-26T20:57:52.582497+0000","last_unstale":"2024-04-26T20:57:52.594400+0000","last_undegraded":"2024-04-26T20:57:52.594400+0000","last_fullsized":"2024-04-26T20:57:52.594400+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:16:51.269657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.491024+0000","last_change":"2024-04-26T20:57:52.569273+0000","last_active":"2024-04-26T20:57:55.491024+0000","last_peered":"2024-04-26T20:57:55.491024+0000","last_clean":"2024-04-26T20:57:55.491024+0000","last_became_active":"2024-04-26T20:57:52.568195+0000","last_became_peered":"2024-04-26T20:57:52.568195+0000","last_unstale":"2024-04-26T20:57:55.491024+0000","last_undegraded":"2024-04-26T20:57:55.491024+0000","last_fullsized":"2024-04-26T20:57:55.491024+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:05:40.669900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"40'4","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.490270+0000","last_change":"2024-04-26T20:57:51.572743+0000","last_active":"2024-04-26T20:57:55.490270+0000","last_peered":"2024-04-26T20:57:55.490270+0000","last_clean":"2024-04-26T20:57:55.490270+0000","last_became_active":"2024-04-26T20:57:51.572350+0000","last_became_peered":"2024-04-26T20:57:51.572350+0000","last_unstale":"2024-04-26T20:57:55.490270+0000","last_undegraded":"2024-04-26T20:57:55.490270+0000","last_fullsized":"2024-04-26T20:57:55.490270+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:50:32.238625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.575427+0000","last_change":"2024-04-26T20:57:52.587288+0000","last_active":"2024-04-26T20:57:53.575427+0000","last_peered":"2024-04-26T20:57:53.575427+0000","last_clean":"2024-04-26T20:57:53.575427+0000","last_became_active":"2024-04-26T20:57:52.586875+0000","last_became_peered":"2024-04-26T20:57:52.586875+0000","last_unstale":"2024-04-26T20:57:53.575427+0000","last_undegraded":"2024-04-26T20:57:53.575427+0000","last_fullsized":"2024-04-26T20:57:53.575427+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:16.143937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.575702+0000","last_change":"2024-04-26T20:57:51.566643+0000","last_active":"2024-04-26T20:57:53.575702+0000","last_peered":"2024-04-26T20:57:53.575702+0000","last_clean":"2024-04-26T20:57:53.575702+0000","last_became_active":"2024-04-26T20:57:51.566309+0000","last_became_peered":"2024-04-26T20:57:51.566309+0000","last_unstale":"2024-04-26T20:57:53.575702+0000","last_undegraded":"2024-04-26T20:57:53.575702+0000","last_fullsized":"2024-04-26T20:57:53.575702+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:50:32.238625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.491255+0000","last_change":"2024-04-26T20:57:52.566380+0000","last_active":"2024-04-26T20:57:55.491255+0000","last_peered":"2024-04-26T20:57:55.491255+0000","last_clean":"2024-04-26T20:57:55.491255+0000","last_became_active":"2024-04-26T20:57:52.566143+0000","last_became_peered":"2024-04-26T20:57:52.566143+0000","last_unstale":"2024-04-26T20:57:55.491255+0000","last_undegraded":"2024-04-26T20:57:55.491255+0000","last_fullsized":"2024-04-26T20:57:55.491255+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:30.531635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.588846+0000","last_change":"2024-04-26T20:57:51.573664+0000","last_active":"2024-04-26T20:57:52.588846+0000","last_peered":"2024-04-26T20:57:52.588846+0000","last_clean":"2024-04-26T20:57:52.588846+0000","last_became_active":"2024-04-26T20:57:51.572927+0000","last_became_peered":"2024-04-26T20:57:51.572927+0000","last_unstale":"2024-04-26T20:57:52.588846+0000","last_undegraded":"2024-04-26T20:57:52.588846+0000","last_fullsized":"2024-04-26T20:57:52.588846+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:04:55.596385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.576004+0000","last_change":"2024-04-26T20:57:52.585801+0000","last_active":"2024-04-26T20:57:53.576004+0000","last_peered":"2024-04-26T20:57:53.576004+0000","last_clean":"2024-04-26T20:57:53.576004+0000","last_became_active":"2024-04-26T20:57:52.584731+0000","last_became_peered":"2024-04-26T20:57:52.584731+0000","last_unstale":"2024-04-26T20:57:53.576004+0000","last_undegraded":"2024-04-26T20:57:53.576004+0000","last_fullsized":"2024-04-26T20:57:53.576004+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:28:20.157680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.490184+0000","last_change":"2024-04-26T20:57:51.574013+0000","last_active":"2024-04-26T20:57:55.490184+0000","last_peered":"2024-04-26T20:57:55.490184+0000","last_clean":"2024-04-26T20:57:55.490184+0000","last_became_active":"2024-04-26T20:57:51.573800+0000","last_became_peered":"2024-04-26T20:57:51.573800+0000","last_unstale":"2024-04-26T20:57:55.490184+0000","last_undegraded":"2024-04-26T20:57:55.490184+0000","last_fullsized":"2024-04-26T20:57:55.490184+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:43:07.969141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.594461+0000","last_change":"2024-04-26T20:57:52.587538+0000","last_active":"2024-04-26T20:57:52.594461+0000","last_peered":"2024-04-26T20:57:52.594461+0000","last_clean":"2024-04-26T20:57:52.594461+0000","last_became_active":"2024-04-26T20:57:52.587138+0000","last_became_peered":"2024-04-26T20:57:52.587138+0000","last_unstale":"2024-04-26T20:57:52.594461+0000","last_undegraded":"2024-04-26T20:57:52.594461+0000","last_fullsized":"2024-04-26T20:57:52.594461+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:39:40.382481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.490119+0000","last_change":"2024-04-26T20:57:51.570397+0000","last_active":"2024-04-26T20:57:55.490119+0000","last_peered":"2024-04-26T20:57:55.490119+0000","last_clean":"2024-04-26T20:57:55.490119+0000","last_became_active":"2024-04-26T20:57:51.570089+0000","last_became_peered":"2024-04-26T20:57:51.570089+0000","last_unstale":"2024-04-26T20:57:55.490119+0000","last_undegraded":"2024-04-26T20:57:55.490119+0000","last_fullsized":"2024-04-26T20:57:55.490119+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:55:41.720506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.697981+0000","last_change":"2024-04-26T20:57:52.585311+0000","last_active":"2024-04-26T20:57:53.697981+0000","last_peered":"2024-04-26T20:57:53.697981+0000","last_clean":"2024-04-26T20:57:53.697981+0000","last_became_active":"2024-04-26T20:57:52.585061+0000","last_became_peered":"2024-04-26T20:57:52.585061+0000","last_unstale":"2024-04-26T20:57:53.697981+0000","last_undegraded":"2024-04-26T20:57:53.697981+0000","last_fullsized":"2024-04-26T20:57:53.697981+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:13.183123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574697+0000","last_change":"2024-04-26T20:57:51.571733+0000","last_active":"2024-04-26T20:57:53.574697+0000","last_peered":"2024-04-26T20:57:53.574697+0000","last_clean":"2024-04-26T20:57:53.574697+0000","last_became_active":"2024-04-26T20:57:51.571446+0000","last_became_peered":"2024-04-26T20:57:51.571446+0000","last_unstale":"2024-04-26T20:57:53.574697+0000","last_undegraded":"2024-04-26T20:57:53.574697+0000","last_fullsized":"2024-04-26T20:57:53.574697+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:07.815468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.490783+0000","last_change":"2024-04-26T20:57:52.570641+0000","last_active":"2024-04-26T20:57:55.490783+0000","last_peered":"2024-04-26T20:57:55.490783+0000","last_clean":"2024-04-26T20:57:55.490783+0000","last_became_active":"2024-04-26T20:57:52.570421+0000","last_became_peered":"2024-04-26T20:57:52.570421+0000","last_unstale":"2024-04-26T20:57:55.490783+0000","last_undegraded":"2024-04-26T20:57:55.490783+0000","last_fullsized":"2024-04-26T20:57:55.490783+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:40.105119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.561404+0000","last_change":"2024-04-26T20:57:51.574572+0000","last_active":"2024-04-26T20:57:52.561404+0000","last_peered":"2024-04-26T20:57:52.561404+0000","last_clean":"2024-04-26T20:57:52.561404+0000","last_became_active":"2024-04-26T20:57:51.574213+0000","last_became_peered":"2024-04-26T20:57:51.574213+0000","last_unstale":"2024-04-26T20:57:52.561404+0000","last_undegraded":"2024-04-26T20:57:52.561404+0000","last_fullsized":"2024-04-26T20:57:52.561404+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:10:26.507698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.575337+0000","last_change":"2024-04-26T20:57:52.586106+0000","last_active":"2024-04-26T20:57:53.575337+0000","last_peered":"2024-04-26T20:57:53.575337+0000","last_clean":"2024-04-26T20:57:53.575337+0000","last_became_active":"2024-04-26T20:57:52.585860+0000","last_became_peered":"2024-04-26T20:57:52.585860+0000","last_unstale":"2024-04-26T20:57:53.575337+0000","last_undegraded":"2024-04-26T20:57:53.575337+0000","last_fullsized":"2024-04-26T20:57:53.575337+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:55.128152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574408+0000","last_change":"2024-04-26T20:57:51.573590+0000","last_active":"2024-04-26T20:57:53.574408+0000","last_peered":"2024-04-26T20:57:53.574408+0000","last_clean":"2024-04-26T20:57:53.574408+0000","last_became_active":"2024-04-26T20:57:51.573293+0000","last_became_peered":"2024-04-26T20:57:51.573293+0000","last_unstale":"2024-04-26T20:57:53.574408+0000","last_undegraded":"2024-04-26T20:57:53.574408+0000","last_fullsized":"2024-04-26T20:57:53.574408+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:55:23.008549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.590985+0000","last_change":"2024-04-26T20:57:52.575008+0000","last_active":"2024-04-26T20:57:52.590985+0000","last_peered":"2024-04-26T20:57:52.590985+0000","last_clean":"2024-04-26T20:57:52.590985+0000","last_became_active":"2024-04-26T20:57:52.574553+0000","last_became_peered":"2024-04-26T20:57:52.574553+0000","last_unstale":"2024-04-26T20:57:52.590985+0000","last_undegraded":"2024-04-26T20:57:52.590985+0000","last_fullsized":"2024-04-26T20:57:52.590985+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:03:23.551336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.563732+0000","last_change":"2024-04-26T20:57:51.576675+0000","last_active":"2024-04-26T20:57:52.563732+0000","last_peered":"2024-04-26T20:57:52.563732+0000","last_clean":"2024-04-26T20:57:52.563732+0000","last_became_active":"2024-04-26T20:57:51.576394+0000","last_became_peered":"2024-04-26T20:57:51.576394+0000","last_unstale":"2024-04-26T20:57:52.563732+0000","last_undegraded":"2024-04-26T20:57:52.563732+0000","last_fullsized":"2024-04-26T20:57:52.563732+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:44:14.717022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.490288+0000","last_change":"2024-04-26T20:57:52.576139+0000","last_active":"2024-04-26T20:57:55.490288+0000","last_peered":"2024-04-26T20:57:55.490288+0000","last_clean":"2024-04-26T20:57:55.490288+0000","last_became_active":"2024-04-26T20:57:52.575825+0000","last_became_peered":"2024-04-26T20:57:52.575825+0000","last_unstale":"2024-04-26T20:57:55.490288+0000","last_undegraded":"2024-04-26T20:57:55.490288+0000","last_fullsized":"2024-04-26T20:57:55.490288+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:43:43.232931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.491096+0000","last_change":"2024-04-26T20:57:51.566363+0000","last_active":"2024-04-26T20:57:55.491096+0000","last_peered":"2024-04-26T20:57:55.491096+0000","last_clean":"2024-04-26T20:57:55.491096+0000","last_became_active":"2024-04-26T20:57:51.566020+0000","last_became_peered":"2024-04-26T20:57:51.566020+0000","last_unstale":"2024-04-26T20:57:55.491096+0000","last_undegraded":"2024-04-26T20:57:55.491096+0000","last_fullsized":"2024-04-26T20:57:55.491096+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:51:59.832838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.597943+0000","last_change":"2024-04-26T20:57:52.593299+0000","last_active":"2024-04-26T20:57:52.597943+0000","last_peered":"2024-04-26T20:57:52.597943+0000","last_clean":"2024-04-26T20:57:52.597943+0000","last_became_active":"2024-04-26T20:57:52.591280+0000","last_became_peered":"2024-04-26T20:57:52.591280+0000","last_unstale":"2024-04-26T20:57:52.597943+0000","last_undegraded":"2024-04-26T20:57:52.597943+0000","last_fullsized":"2024-04-26T20:57:52.597943+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:44:43.597451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.490897+0000","last_change":"2024-04-26T20:57:51.569668+0000","last_active":"2024-04-26T20:57:55.490897+0000","last_peered":"2024-04-26T20:57:55.490897+0000","last_clean":"2024-04-26T20:57:55.490897+0000","last_became_active":"2024-04-26T20:57:51.569384+0000","last_became_peered":"2024-04-26T20:57:51.569384+0000","last_unstale":"2024-04-26T20:57:55.490897+0000","last_undegraded":"2024-04-26T20:57:55.490897+0000","last_fullsized":"2024-04-26T20:57:55.490897+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:49:18.242393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.575283+0000","last_change":"2024-04-26T20:57:52.577388+0000","last_active":"2024-04-26T20:57:53.575283+0000","last_peered":"2024-04-26T20:57:53.575283+0000","last_clean":"2024-04-26T20:57:53.575283+0000","last_became_active":"2024-04-26T20:57:52.577116+0000","last_became_peered":"2024-04-26T20:57:52.577116+0000","last_unstale":"2024-04-26T20:57:53.575283+0000","last_undegraded":"2024-04-26T20:57:53.575283+0000","last_fullsized":"2024-04-26T20:57:53.575283+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:08:20.328489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.598025+0000","last_change":"2024-04-26T20:57:51.574348+0000","last_active":"2024-04-26T20:57:52.598025+0000","last_peered":"2024-04-26T20:57:52.598025+0000","last_clean":"2024-04-26T20:57:52.598025+0000","last_became_active":"2024-04-26T20:57:51.574023+0000","last_became_peered":"2024-04-26T20:57:51.574023+0000","last_unstale":"2024-04-26T20:57:52.598025+0000","last_undegraded":"2024-04-26T20:57:52.598025+0000","last_fullsized":"2024-04-26T20:57:52.598025+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:29:31.014100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.594378+0000","last_change":"2024-04-26T20:57:52.583405+0000","last_active":"2024-04-26T20:57:52.594378+0000","last_peered":"2024-04-26T20:57:52.594378+0000","last_clean":"2024-04-26T20:57:52.594378+0000","last_became_active":"2024-04-26T20:57:52.582257+0000","last_became_peered":"2024-04-26T20:57:52.582257+0000","last_unstale":"2024-04-26T20:57:52.594378+0000","last_undegraded":"2024-04-26T20:57:52.594378+0000","last_fullsized":"2024-04-26T20:57:52.594378+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:04.761374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.581443+0000","last_change":"2024-04-26T20:57:51.572541+0000","last_active":"2024-04-26T20:57:52.581443+0000","last_peered":"2024-04-26T20:57:52.581443+0000","last_clean":"2024-04-26T20:57:52.581443+0000","last_became_active":"2024-04-26T20:57:51.571967+0000","last_became_peered":"2024-04-26T20:57:51.571967+0000","last_unstale":"2024-04-26T20:57:52.581443+0000","last_undegraded":"2024-04-26T20:57:52.581443+0000","last_fullsized":"2024-04-26T20:57:52.581443+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:11:04.894675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574548+0000","last_change":"2024-04-26T20:57:52.581005+0000","last_active":"2024-04-26T20:57:53.574548+0000","last_peered":"2024-04-26T20:57:53.574548+0000","last_clean":"2024-04-26T20:57:53.574548+0000","last_became_active":"2024-04-26T20:57:52.580685+0000","last_became_peered":"2024-04-26T20:57:52.580685+0000","last_unstale":"2024-04-26T20:57:53.574548+0000","last_undegraded":"2024-04-26T20:57:53.574548+0000","last_fullsized":"2024-04-26T20:57:53.574548+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:23:22.653755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574567+0000","last_change":"2024-04-26T20:57:51.571181+0000","last_active":"2024-04-26T20:57:53.574567+0000","last_peered":"2024-04-26T20:57:53.574567+0000","last_clean":"2024-04-26T20:57:53.574567+0000","last_became_active":"2024-04-26T20:57:51.570305+0000","last_became_peered":"2024-04-26T20:57:51.570305+0000","last_unstale":"2024-04-26T20:57:53.574567+0000","last_undegraded":"2024-04-26T20:57:53.574567+0000","last_fullsized":"2024-04-26T20:57:53.574567+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:43:07.969141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.698155+0000","last_change":"2024-04-26T20:57:52.584791+0000","last_active":"2024-04-26T20:57:53.698155+0000","last_peered":"2024-04-26T20:57:53.698155+0000","last_clean":"2024-04-26T20:57:53.698155+0000","last_became_active":"2024-04-26T20:57:52.575922+0000","last_became_peered":"2024-04-26T20:57:52.575922+0000","last_unstale":"2024-04-26T20:57:53.698155+0000","last_undegraded":"2024-04-26T20:57:53.698155+0000","last_fullsized":"2024-04-26T20:57:53.698155+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:12:05.356796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.490849+0000","last_change":"2024-04-26T20:57:51.563498+0000","last_active":"2024-04-26T20:57:55.490849+0000","last_peered":"2024-04-26T20:57:55.490849+0000","last_clean":"2024-04-26T20:57:55.490849+0000","last_became_active":"2024-04-26T20:57:51.563243+0000","last_became_peered":"2024-04-26T20:57:51.563243+0000","last_unstale":"2024-04-26T20:57:55.490849+0000","last_undegraded":"2024-04-26T20:57:55.490849+0000","last_fullsized":"2024-04-26T20:57:55.490849+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:47:09.428746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.575128+0000","last_change":"2024-04-26T20:57:52.584930+0000","last_active":"2024-04-26T20:57:53.575128+0000","last_peered":"2024-04-26T20:57:53.575128+0000","last_clean":"2024-04-26T20:57:53.575128+0000","last_became_active":"2024-04-26T20:57:52.584641+0000","last_became_peered":"2024-04-26T20:57:52.584641+0000","last_unstale":"2024-04-26T20:57:53.575128+0000","last_undegraded":"2024-04-26T20:57:53.575128+0000","last_fullsized":"2024-04-26T20:57:53.575128+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:33.561350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.490157+0000","last_change":"2024-04-26T20:57:51.567931+0000","last_active":"2024-04-26T20:57:55.490157+0000","last_peered":"2024-04-26T20:57:55.490157+0000","last_clean":"2024-04-26T20:57:55.490157+0000","last_became_active":"2024-04-26T20:57:51.567552+0000","last_became_peered":"2024-04-26T20:57:51.567552+0000","last_unstale":"2024-04-26T20:57:55.490157+0000","last_undegraded":"2024-04-26T20:57:55.490157+0000","last_fullsized":"2024-04-26T20:57:55.490157+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:32.553314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.575154+0000","last_change":"2024-04-26T20:57:52.581758+0000","last_active":"2024-04-26T20:57:53.575154+0000","last_peered":"2024-04-26T20:57:53.575154+0000","last_clean":"2024-04-26T20:57:53.575154+0000","last_became_active":"2024-04-26T20:57:52.581085+0000","last_became_peered":"2024-04-26T20:57:52.581085+0000","last_unstale":"2024-04-26T20:57:53.575154+0000","last_undegraded":"2024-04-26T20:57:53.575154+0000","last_fullsized":"2024-04-26T20:57:53.575154+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:37:58.253968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.575198+0000","last_change":"2024-04-26T20:57:51.575710+0000","last_active":"2024-04-26T20:57:53.575198+0000","last_peered":"2024-04-26T20:57:53.575198+0000","last_clean":"2024-04-26T20:57:53.575198+0000","last_became_active":"2024-04-26T20:57:51.575446+0000","last_became_peered":"2024-04-26T20:57:51.575446+0000","last_unstale":"2024-04-26T20:57:53.575198+0000","last_undegraded":"2024-04-26T20:57:53.575198+0000","last_fullsized":"2024-04-26T20:57:53.575198+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:05.463288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.575005+0000","last_change":"2024-04-26T20:57:52.585080+0000","last_active":"2024-04-26T20:57:53.575005+0000","last_peered":"2024-04-26T20:57:53.575005+0000","last_clean":"2024-04-26T20:57:53.575005+0000","last_became_active":"2024-04-26T20:57:52.584794+0000","last_became_peered":"2024-04-26T20:57:52.584794+0000","last_unstale":"2024-04-26T20:57:53.575005+0000","last_undegraded":"2024-04-26T20:57:53.575005+0000","last_fullsized":"2024-04-26T20:57:53.575005+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:50:33.246661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.491209+0000","last_change":"2024-04-26T20:57:51.569389+0000","last_active":"2024-04-26T20:57:55.491209+0000","last_peered":"2024-04-26T20:57:55.491209+0000","last_clean":"2024-04-26T20:57:55.491209+0000","last_became_active":"2024-04-26T20:57:51.569128+0000","last_became_peered":"2024-04-26T20:57:51.569128+0000","last_unstale":"2024-04-26T20:57:55.491209+0000","last_undegraded":"2024-04-26T20:57:55.491209+0000","last_fullsized":"2024-04-26T20:57:55.491209+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:44.305635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.575094+0000","last_change":"2024-04-26T20:57:52.580234+0000","last_active":"2024-04-26T20:57:53.575094+0000","last_peered":"2024-04-26T20:57:53.575094+0000","last_clean":"2024-04-26T20:57:53.575094+0000","last_became_active":"2024-04-26T20:57:52.579929+0000","last_became_peered":"2024-04-26T20:57:52.579929+0000","last_unstale":"2024-04-26T20:57:53.575094+0000","last_undegraded":"2024-04-26T20:57:53.575094+0000","last_fullsized":"2024-04-26T20:57:53.575094+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:11.582177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574794+0000","last_change":"2024-04-26T20:57:51.577610+0000","last_active":"2024-04-26T20:57:53.574794+0000","last_peered":"2024-04-26T20:57:53.574794+0000","last_clean":"2024-04-26T20:57:53.574794+0000","last_became_active":"2024-04-26T20:57:51.577352+0000","last_became_peered":"2024-04-26T20:57:51.577352+0000","last_unstale":"2024-04-26T20:57:53.574794+0000","last_undegraded":"2024-04-26T20:57:53.574794+0000","last_fullsized":"2024-04-26T20:57:53.574794+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:05:01.247112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.491689+0000","last_change":"2024-04-26T20:57:52.593107+0000","last_active":"2024-04-26T20:57:55.491689+0000","last_peered":"2024-04-26T20:57:55.491689+0000","last_clean":"2024-04-26T20:57:55.491689+0000","last_became_active":"2024-04-26T20:57:52.592849+0000","last_became_peered":"2024-04-26T20:57:52.592849+0000","last_unstale":"2024-04-26T20:57:55.491689+0000","last_undegraded":"2024-04-26T20:57:55.491689+0000","last_fullsized":"2024-04-26T20:57:55.491689+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:28:20.157680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.491238+0000","last_change":"2024-04-26T20:57:51.573218+0000","last_active":"2024-04-26T20:57:55.491238+0000","last_peered":"2024-04-26T20:57:55.491238+0000","last_clean":"2024-04-26T20:57:55.491238+0000","last_became_active":"2024-04-26T20:57:51.572070+0000","last_became_peered":"2024-04-26T20:57:51.572070+0000","last_unstale":"2024-04-26T20:57:55.491238+0000","last_undegraded":"2024-04-26T20:57:55.491238+0000","last_fullsized":"2024-04-26T20:57:55.491238+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:43.209710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.490566+0000","last_change":"2024-04-26T20:57:52.580620+0000","last_active":"2024-04-26T20:57:55.490566+0000","last_peered":"2024-04-26T20:57:55.490566+0000","last_clean":"2024-04-26T20:57:55.490566+0000","last_became_active":"2024-04-26T20:57:52.580262+0000","last_became_peered":"2024-04-26T20:57:52.580262+0000","last_unstale":"2024-04-26T20:57:55.490566+0000","last_undegraded":"2024-04-26T20:57:55.490566+0000","last_fullsized":"2024-04-26T20:57:55.490566+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:18:30.707432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.491177+0000","last_change":"2024-04-26T20:57:51.572477+0000","last_active":"2024-04-26T20:57:55.491177+0000","last_peered":"2024-04-26T20:57:55.491177+0000","last_clean":"2024-04-26T20:57:55.491177+0000","last_became_active":"2024-04-26T20:57:51.572200+0000","last_became_peered":"2024-04-26T20:57:51.572200+0000","last_unstale":"2024-04-26T20:57:55.491177+0000","last_undegraded":"2024-04-26T20:57:55.491177+0000","last_fullsized":"2024-04-26T20:57:55.491177+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:03:39.964597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.588400+0000","last_change":"2024-04-26T20:57:52.570952+0000","last_active":"2024-04-26T20:57:52.588400+0000","last_peered":"2024-04-26T20:57:52.588400+0000","last_clean":"2024-04-26T20:57:52.588400+0000","last_became_active":"2024-04-26T20:57:52.570601+0000","last_became_peered":"2024-04-26T20:57:52.570601+0000","last_unstale":"2024-04-26T20:57:52.588400+0000","last_undegraded":"2024-04-26T20:57:52.588400+0000","last_fullsized":"2024-04-26T20:57:52.588400+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:14:41.960247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574671+0000","last_change":"2024-04-26T20:57:51.575051+0000","last_active":"2024-04-26T20:57:53.574671+0000","last_peered":"2024-04-26T20:57:53.574671+0000","last_clean":"2024-04-26T20:57:53.574671+0000","last_became_active":"2024-04-26T20:57:51.574755+0000","last_became_peered":"2024-04-26T20:57:51.574755+0000","last_unstale":"2024-04-26T20:57:53.574671+0000","last_undegraded":"2024-04-26T20:57:53.574671+0000","last_fullsized":"2024-04-26T20:57:53.574671+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:32.553314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.697923+0000","last_change":"2024-04-26T20:57:52.584567+0000","last_active":"2024-04-26T20:57:53.697923+0000","last_peered":"2024-04-26T20:57:53.697923+0000","last_clean":"2024-04-26T20:57:53.697923+0000","last_became_active":"2024-04-26T20:57:52.584136+0000","last_became_peered":"2024-04-26T20:57:52.584136+0000","last_unstale":"2024-04-26T20:57:53.697923+0000","last_undegraded":"2024-04-26T20:57:53.697923+0000","last_fullsized":"2024-04-26T20:57:53.697923+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:16.143937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574660+0000","last_change":"2024-04-26T20:57:51.573894+0000","last_active":"2024-04-26T20:57:53.574660+0000","last_peered":"2024-04-26T20:57:53.574660+0000","last_clean":"2024-04-26T20:57:53.574660+0000","last_became_active":"2024-04-26T20:57:51.573467+0000","last_became_peered":"2024-04-26T20:57:51.573467+0000","last_unstale":"2024-04-26T20:57:53.574660+0000","last_undegraded":"2024-04-26T20:57:53.574660+0000","last_fullsized":"2024-04-26T20:57:53.574660+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:53.725346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.585479+0000","last_change":"2024-04-26T20:57:52.570583+0000","last_active":"2024-04-26T20:57:52.585479+0000","last_peered":"2024-04-26T20:57:52.585479+0000","last_clean":"2024-04-26T20:57:52.585479+0000","last_became_active":"2024-04-26T20:57:52.570303+0000","last_became_peered":"2024-04-26T20:57:52.570303+0000","last_unstale":"2024-04-26T20:57:52.585479+0000","last_undegraded":"2024-04-26T20:57:52.585479+0000","last_fullsized":"2024-04-26T20:57:52.585479+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:45:31.989965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574244+0000","last_change":"2024-04-26T20:57:51.571920+0000","last_active":"2024-04-26T20:57:53.574244+0000","last_peered":"2024-04-26T20:57:53.574244+0000","last_clean":"2024-04-26T20:57:53.574244+0000","last_became_active":"2024-04-26T20:57:51.571644+0000","last_became_peered":"2024-04-26T20:57:51.571644+0000","last_unstale":"2024-04-26T20:57:53.574244+0000","last_undegraded":"2024-04-26T20:57:53.574244+0000","last_fullsized":"2024-04-26T20:57:53.574244+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:55:41.720506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574710+0000","last_change":"2024-04-26T20:57:52.593531+0000","last_active":"2024-04-26T20:57:53.574710+0000","last_peered":"2024-04-26T20:57:53.574710+0000","last_clean":"2024-04-26T20:57:53.574710+0000","last_became_active":"2024-04-26T20:57:52.592602+0000","last_became_peered":"2024-04-26T20:57:52.592602+0000","last_unstale":"2024-04-26T20:57:53.574710+0000","last_undegraded":"2024-04-26T20:57:53.574710+0000","last_fullsized":"2024-04-26T20:57:53.574710+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:14:02.457147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.491202+0000","last_change":"2024-04-26T20:57:51.570771+0000","last_active":"2024-04-26T20:57:55.491202+0000","last_peered":"2024-04-26T20:57:55.491202+0000","last_clean":"2024-04-26T20:57:55.491202+0000","last_became_active":"2024-04-26T20:57:51.570488+0000","last_became_peered":"2024-04-26T20:57:51.570488+0000","last_unstale":"2024-04-26T20:57:55.491202+0000","last_undegraded":"2024-04-26T20:57:55.491202+0000","last_fullsized":"2024-04-26T20:57:55.491202+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:44:02.286474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.698377+0000","last_change":"2024-04-26T20:57:52.579072+0000","last_active":"2024-04-26T20:57:53.698377+0000","last_peered":"2024-04-26T20:57:53.698377+0000","last_clean":"2024-04-26T20:57:53.698377+0000","last_became_active":"2024-04-26T20:57:52.578605+0000","last_became_peered":"2024-04-26T20:57:52.578605+0000","last_unstale":"2024-04-26T20:57:53.698377+0000","last_undegraded":"2024-04-26T20:57:53.698377+0000","last_fullsized":"2024-04-26T20:57:53.698377+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:06:38.434416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"41'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.575429+0000","last_change":"2024-04-26T20:57:51.577840+0000","last_active":"2024-04-26T20:57:53.575429+0000","last_peered":"2024-04-26T20:57:53.575429+0000","last_clean":"2024-04-26T20:57:53.575429+0000","last_became_active":"2024-04-26T20:57:51.577584+0000","last_became_peered":"2024-04-26T20:57:51.577584+0000","last_unstale":"2024-04-26T20:57:53.575429+0000","last_undegraded":"2024-04-26T20:57:53.575429+0000","last_fullsized":"2024-04-26T20:57:53.575429+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:41:35.733249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.491274+0000","last_change":"2024-04-26T20:57:52.580763+0000","last_active":"2024-04-26T20:57:55.491274+0000","last_peered":"2024-04-26T20:57:55.491274+0000","last_clean":"2024-04-26T20:57:55.491274+0000","last_became_active":"2024-04-26T20:57:52.580489+0000","last_became_peered":"2024-04-26T20:57:52.580489+0000","last_unstale":"2024-04-26T20:57:55.491274+0000","last_undegraded":"2024-04-26T20:57:55.491274+0000","last_fullsized":"2024-04-26T20:57:55.491274+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:16.143937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574942+0000","last_change":"2024-04-26T20:57:51.574263+0000","last_active":"2024-04-26T20:57:53.574942+0000","last_peered":"2024-04-26T20:57:53.574942+0000","last_clean":"2024-04-26T20:57:53.574942+0000","last_became_active":"2024-04-26T20:57:51.573941+0000","last_became_peered":"2024-04-26T20:57:51.573941+0000","last_unstale":"2024-04-26T20:57:53.574942+0000","last_undegraded":"2024-04-26T20:57:53.574942+0000","last_fullsized":"2024-04-26T20:57:53.574942+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:38.596761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574968+0000","last_change":"2024-04-26T20:57:52.592217+0000","last_active":"2024-04-26T20:57:53.574968+0000","last_peered":"2024-04-26T20:57:53.574968+0000","last_clean":"2024-04-26T20:57:53.574968+0000","last_became_active":"2024-04-26T20:57:52.591954+0000","last_became_peered":"2024-04-26T20:57:52.591954+0000","last_unstale":"2024-04-26T20:57:53.574968+0000","last_undegraded":"2024-04-26T20:57:53.574968+0000","last_fullsized":"2024-04-26T20:57:53.574968+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:43:08.977177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.561642+0000","last_change":"2024-04-26T20:57:51.571206+0000","last_active":"2024-04-26T20:57:52.561642+0000","last_peered":"2024-04-26T20:57:52.561642+0000","last_clean":"2024-04-26T20:57:52.561642+0000","last_became_active":"2024-04-26T20:57:51.570877+0000","last_became_peered":"2024-04-26T20:57:51.570877+0000","last_unstale":"2024-04-26T20:57:52.561642+0000","last_undegraded":"2024-04-26T20:57:52.561642+0000","last_fullsized":"2024-04-26T20:57:52.561642+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:49:38.164099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574698+0000","last_change":"2024-04-26T20:57:52.594833+0000","last_active":"2024-04-26T20:57:53.574698+0000","last_peered":"2024-04-26T20:57:53.574698+0000","last_clean":"2024-04-26T20:57:53.574698+0000","last_became_active":"2024-04-26T20:57:52.594522+0000","last_became_peered":"2024-04-26T20:57:52.594522+0000","last_unstale":"2024-04-26T20:57:53.574698+0000","last_undegraded":"2024-04-26T20:57:53.574698+0000","last_fullsized":"2024-04-26T20:57:53.574698+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:12.952743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.698207+0000","last_change":"2024-04-26T20:57:51.574086+0000","last_active":"2024-04-26T20:57:53.698207+0000","last_peered":"2024-04-26T20:57:53.698207+0000","last_clean":"2024-04-26T20:57:53.698207+0000","last_became_active":"2024-04-26T20:57:51.573834+0000","last_became_peered":"2024-04-26T20:57:51.573834+0000","last_unstale":"2024-04-26T20:57:53.698207+0000","last_undegraded":"2024-04-26T20:57:53.698207+0000","last_fullsized":"2024-04-26T20:57:53.698207+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:50:32.238625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.490916+0000","last_change":"2024-04-26T20:57:52.588655+0000","last_active":"2024-04-26T20:57:55.490916+0000","last_peered":"2024-04-26T20:57:55.490916+0000","last_clean":"2024-04-26T20:57:55.490916+0000","last_became_active":"2024-04-26T20:57:52.588356+0000","last_became_peered":"2024-04-26T20:57:52.588356+0000","last_unstale":"2024-04-26T20:57:55.490916+0000","last_undegraded":"2024-04-26T20:57:55.490916+0000","last_fullsized":"2024-04-26T20:57:55.490916+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:13.137551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.490834+0000","last_change":"2024-04-26T20:57:51.567675+0000","last_active":"2024-04-26T20:57:55.490834+0000","last_peered":"2024-04-26T20:57:55.490834+0000","last_clean":"2024-04-26T20:57:55.490834+0000","last_became_active":"2024-04-26T20:57:51.567464+0000","last_became_peered":"2024-04-26T20:57:51.567464+0000","last_unstale":"2024-04-26T20:57:55.490834+0000","last_undegraded":"2024-04-26T20:57:55.490834+0000","last_fullsized":"2024-04-26T20:57:55.490834+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:17.267826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.698084+0000","last_change":"2024-04-26T20:57:52.587210+0000","last_active":"2024-04-26T20:57:53.698084+0000","last_peered":"2024-04-26T20:57:53.698084+0000","last_clean":"2024-04-26T20:57:53.698084+0000","last_became_active":"2024-04-26T20:57:52.587015+0000","last_became_peered":"2024-04-26T20:57:52.587015+0000","last_unstale":"2024-04-26T20:57:53.698084+0000","last_undegraded":"2024-04-26T20:57:53.698084+0000","last_fullsized":"2024-04-26T20:57:53.698084+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:06:01.245752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T20:57:52.570297+0000","last_change":"2024-04-26T20:57:51.579142+0000","last_active":"2024-04-26T20:57:52.570297+0000","last_peered":"2024-04-26T20:57:52.570297+0000","last_clean":"2024-04-26T20:57:52.570297+0000","last_became_active":"2024-04-26T20:57:51.578834+0000","last_became_peered":"2024-04-26T20:57:51.578834+0000","last_unstale":"2024-04-26T20:57:52.570297+0000","last_undegraded":"2024-04-26T20:57:52.570297+0000","last_fullsized":"2024-04-26T20:57:52.570297+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:48:04.831644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.491150+0000","last_change":"2024-04-26T20:57:52.569231+0000","last_active":"2024-04-26T20:57:55.491150+0000","last_peered":"2024-04-26T20:57:55.491150+0000","last_clean":"2024-04-26T20:57:55.491150+0000","last_became_active":"2024-04-26T20:57:52.568915+0000","last_became_peered":"2024-04-26T20:57:52.568915+0000","last_unstale":"2024-04-26T20:57:55.491150+0000","last_undegraded":"2024-04-26T20:57:55.491150+0000","last_fullsized":"2024-04-26T20:57:55.491150+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:12:00.029798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.698099+0000","last_change":"2024-04-26T20:57:51.574337+0000","last_active":"2024-04-26T20:57:53.698099+0000","last_peered":"2024-04-26T20:57:53.698099+0000","last_clean":"2024-04-26T20:57:53.698099+0000","last_became_active":"2024-04-26T20:57:51.573114+0000","last_became_peered":"2024-04-26T20:57:51.573114+0000","last_unstale":"2024-04-26T20:57:53.698099+0000","last_undegraded":"2024-04-26T20:57:53.698099+0000","last_fullsized":"2024-04-26T20:57:53.698099+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:36:54.823396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":204,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574525+0000","last_change":"2024-04-26T20:56:29.347462+0000","last_active":"2024-04-26T20:57:53.574525+0000","last_peered":"2024-04-26T20:57:53.574525+0000","last_clean":"2024-04-26T20:57:53.574525+0000","last_became_active":"2024-04-26T20:56:29.346224+0000","last_became_peered":"2024-04-26T20:56:29.346224+0000","last_unstale":"2024-04-26T20:57:53.574525+0000","last_undegraded":"2024-04-26T20:57:53.574525+0000","last_fullsized":"2024-04-26T20:57:53.574525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:28.079105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:28.079105+0000","last_clean_scrub_stamp":"2024-04-26T20:56:28.079105+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:13.693525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509462,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":471040,"data_stored":199693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509461,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":471040,"data_stored":199657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509462,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28060,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343780,"statfs":{"total":96636764160,"available":96608030720,"internally_reserved":0,"allocated":1064960,"data_stored":790573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509462,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":193021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509462,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":201817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509461,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1064960,"data_stored":790013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509460,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":475136,"data_stored":199715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":475136,"data_stored":194667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T20:58:01.189 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T20:58:01.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.328+0000 7fbd42c00640 1 Processor -- start 2024-04-26T20:58:01.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.328+0000 7fbd42c00640 1 -- start start 2024-04-26T20:58:01.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.328+0000 7fbd42c00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fbd3c15f2b0 0x7fbd3c1637d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:01.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.328+0000 7fbd42c00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd3c163d10 con 0x7fbd3c0cee00 2024-04-26T20:58:01.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.328+0000 7fbd42c00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd3c0ccb60 con 0x7fbd3c0ae8c0 2024-04-26T20:58:01.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.328+0000 7fbd42c00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fbd3c15f690 con 0x7fbd3c15f2b0 2024-04-26T20:58:01.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.328+0000 7fbd40c00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fbd3c0cee00 0x7fbd3c0cbaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:58868/0 (socket says 172.21.15.138:58868) 2024-04-26T20:58:01.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.328+0000 7fbd40c00640 1 -- 172.21.15.138:0/1771331978 learned_addr learned my addr 172.21.15.138:0/1771331978 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:01.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.328+0000 7fbd3be00640 1 --2- 172.21.15.138:0/1771331978 >> v2:172.21.15.143:3300/0 conn(0x7fbd3c15f2b0 0x7fbd3c1637d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:01.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.328+0000 7fbd3b400640 1 -- 172.21.15.138:0/1771331978 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3333757070 0 0) 0x7fbd3c163d10 con 0x7fbd3c0cee00 2024-04-26T20:58:01.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.328+0000 7fbd3b400640 1 -- 172.21.15.138:0/1771331978 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd20003530 con 0x7fbd3c0cee00 2024-04-26T20:58:01.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.328+0000 7fbd3b400640 1 -- 172.21.15.138:0/1771331978 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1756737712 0 0) 0x7fbd3c0ccb60 con 0x7fbd3c0ae8c0 2024-04-26T20:58:01.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.328+0000 7fbd3b400640 1 -- 172.21.15.138:0/1771331978 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd3c163d10 con 0x7fbd3c0ae8c0 2024-04-26T20:58:01.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.328+0000 7fbd3b400640 1 -- 172.21.15.138:0/1771331978 <== mon.0 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1109528949 0 0) 0x7fbd20003530 con 0x7fbd3c0cee00 2024-04-26T20:58:01.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.328+0000 7fbd3b400640 1 -- 172.21.15.138:0/1771331978 >> v2:172.21.15.143:3300/0 conn(0x7fbd3c15f2b0 msgr2=0x7fbd3c1637d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:01.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.328+0000 7fbd3b400640 1 --2- 172.21.15.138:0/1771331978 >> v2:172.21.15.143:3300/0 conn(0x7fbd3c15f2b0 0x7fbd3c1637d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:01.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.328+0000 7fbd3b400640 1 -- 172.21.15.138:0/1771331978 >> v1:172.21.15.143:6789/0 conn(0x7fbd3c0ae8c0 legacy=0x7fbd3c0ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:01.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.328+0000 7fbd3b400640 1 -- 172.21.15.138:0/1771331978 --> v1:172.21.15.138:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd3c0cce40 con 0x7fbd3c0cee00 2024-04-26T20:58:01.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.328+0000 7fbd3b400640 1 -- 172.21.15.138:0/1771331978 <== mon.0 v1:172.21.15.138:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2715389689 0 0) 0x7fbd34001a00 con 0x7fbd3c0cee00 2024-04-26T20:58:01.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.328+0000 7fbd3b400640 1 -- 172.21.15.138:0/1771331978 >> v1:172.21.15.138:6789/0 conn(0x7fbd3c0cee00 legacy=0x7fbd3c0cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:01.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.328+0000 7fbd3b400640 1 --2- 172.21.15.138:0/1771331978 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd20003b50 0x7fbd20003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:01.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.328+0000 7fbd3b400640 1 --2- 172.21.15.138:0/1771331978 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd20004810 0x7fbd20004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:01.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.328+0000 7fbd3b400640 1 --2- 172.21.15.138:0/1771331978 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbd200051d0 0x7fbd2000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:01.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.328+0000 7fbd3b400640 1 -- 172.21.15.138:0/1771331978 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fbd3c15f690 con 0x7fbd20003b50 2024-04-26T20:58:01.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.328+0000 7fbd3b400640 1 -- 172.21.15.138:0/1771331978 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fbd2000c100 con 0x7fbd20004810 2024-04-26T20:58:01.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.328+0000 7fbd3b400640 1 -- 172.21.15.138:0/1771331978 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fbd2000c300 con 0x7fbd200051d0 2024-04-26T20:58:01.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.328+0000 7fbd3be00640 1 --2- 172.21.15.138:0/1771331978 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd20003b50 0x7fbd20003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:01.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.328+0000 7fbd33400640 1 --2- 172.21.15.138:0/1771331978 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd20004810 0x7fbd20004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:01.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.328+0000 7fbd40c00640 1 --2- 172.21.15.138:0/1771331978 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbd200051d0 0x7fbd2000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:01.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.328+0000 7fbd3be00640 1 -- 172.21.15.138:0/1771331978 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbd200051d0 msgr2=0x7fbd2000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:01.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.328+0000 7fbd3be00640 1 --2- 172.21.15.138:0/1771331978 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbd200051d0 0x7fbd2000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:01.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.328+0000 7fbd3be00640 1 -- 172.21.15.138:0/1771331978 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd20004810 msgr2=0x7fbd20004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:01.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.328+0000 7fbd3be00640 1 --2- 172.21.15.138:0/1771331978 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd20004810 0x7fbd20004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:01.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.328+0000 7fbd3be00640 1 -- 172.21.15.138:0/1771331978 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd20003530 con 0x7fbd20003b50 2024-04-26T20:58:01.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.328+0000 7fbd40c00640 1 -- 172.21.15.138:0/1771331978 reap_dead start 2024-04-26T20:58:01.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.332+0000 7fbd3be00640 1 --2- 172.21.15.138:0/1771331978 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd20003b50 0x7fbd20003f50 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c009ae0 tx=0x7fbd2c01ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=957fb51c909a54a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:01.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.332+0000 7fbd3b400640 1 -- 172.21.15.138:0/1771331978 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c0096b0 con 0x7fbd20003b50 2024-04-26T20:58:01.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.332+0000 7fbd3b400640 1 -- 172.21.15.138:0/1771331978 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd2c0a6470 con 0x7fbd20003b50 2024-04-26T20:58:01.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.332+0000 7fbd3b400640 1 -- 172.21.15.138:0/1771331978 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c0a6860 con 0x7fbd20003b50 2024-04-26T20:58:01.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.332+0000 7fbd42c00640 1 -- 172.21.15.138:0/1771331978 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd20003b50 msgr2=0x7fbd20003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:01.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.332+0000 7fbd42c00640 1 --2- 172.21.15.138:0/1771331978 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd20003b50 0x7fbd20003f50 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c009ae0 tx=0x7fbd2c01ca90 comp rx=0 tx=0).stop 2024-04-26T20:58:01.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.332+0000 7fbd42c00640 1 -- 172.21.15.138:0/1771331978 shutdown_connections 2024-04-26T20:58:01.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.332+0000 7fbd42c00640 1 --2- 172.21.15.138:0/1771331978 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd20003b50 0x7fbd20003f50 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:01.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.332+0000 7fbd42c00640 1 -- 172.21.15.138:0/1771331978 >> 172.21.15.138:0/1771331978 conn(0x7fbd3c0d0b20 msgr2=0x7fbd3c0d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:01.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.332+0000 7fbd42c00640 1 -- 172.21.15.138:0/1771331978 shutdown_connections 2024-04-26T20:58:01.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.332+0000 7fbd42c00640 1 -- 172.21.15.138:0/1771331978 wait complete. 2024-04-26T20:58:01.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.336+0000 7fbd42c00640 1 Processor -- start 2024-04-26T20:58:01.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.336+0000 7fbd42c00640 1 -- start start 2024-04-26T20:58:01.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.336+0000 7fbd42c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd20003b50 0x7fbd3c0c4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:01.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.336+0000 7fbd42c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbd3c0c5bc0 0x7fbd3c1500a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:01.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.336+0000 7fbd42c00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd3c0b60e0 0x7fbd3c06ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:01.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.336+0000 7fbd42c00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fbd3c0cc290 con 0x7fbd3c0b60e0 2024-04-26T20:58:01.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.336+0000 7fbd42c00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fbd3c0cd120 con 0x7fbd20003b50 2024-04-26T20:58:01.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.336+0000 7fbd42c00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fbd3c0cc410 con 0x7fbd3c0c5bc0 2024-04-26T20:58:01.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.336+0000 7fbd40c00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd3c0b60e0 0x7fbd3c06ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:01.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.336+0000 7fbd3be00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd20003b50 0x7fbd3c0c4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:01.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.336+0000 7fbd33400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbd3c0c5bc0 0x7fbd3c1500a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:01.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.336+0000 7fbd3be00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd20003b50 0x7fbd3c0c4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.138:37488/0 (socket says 172.21.15.138:37488) 2024-04-26T20:58:01.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.336+0000 7fbd40c00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd3c0b60e0 0x7fbd3c06ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:53146/0 (socket says 172.21.15.138:53146) 2024-04-26T20:58:01.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.336+0000 7fbd3be00640 1 -- 172.21.15.138:0/896410314 learned_addr learned my addr 172.21.15.138:0/896410314 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:01.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.336+0000 7fbd40c00640 1 -- 172.21.15.138:0/896410314 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbd3c0c5bc0 msgr2=0x7fbd3c1500a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:01.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.336+0000 7fbd40c00640 1 --2- 172.21.15.138:0/896410314 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbd3c0c5bc0 0x7fbd3c1500a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:01.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.336+0000 7fbd40c00640 1 -- 172.21.15.138:0/896410314 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd20003b50 msgr2=0x7fbd3c0c4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:01.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.336+0000 7fbd40c00640 1 --2- 172.21.15.138:0/896410314 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd20003b50 0x7fbd3c0c4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:01.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.336+0000 7fbd40c00640 1 -- 172.21.15.138:0/896410314 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd3c0b4f50 con 0x7fbd3c0b60e0 2024-04-26T20:58:01.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.336+0000 7fbd33400640 1 --2- 172.21.15.138:0/896410314 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbd3c0c5bc0 0x7fbd3c1500a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:58:01.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.336+0000 7fbd3be00640 1 --2- 172.21.15.138:0/896410314 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd20003b50 0x7fbd3c0c4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:58:01.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.336+0000 7fbd40c00640 1 --2- 172.21.15.138:0/896410314 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd3c0b60e0 0x7fbd3c06ebf0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c0cd570 tx=0x7fbd34007b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:01.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.336+0000 7fbd38c00640 1 -- 172.21.15.138:0/896410314 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd3400ea40 con 0x7fbd3c0b60e0 2024-04-26T20:58:01.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.336+0000 7fbd38c00640 1 -- 172.21.15.138:0/896410314 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd3400ebe0 con 0x7fbd3c0b60e0 2024-04-26T20:58:01.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.336+0000 7fbd38c00640 1 -- 172.21.15.138:0/896410314 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd3400edd0 con 0x7fbd3c0b60e0 2024-04-26T20:58:01.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.336+0000 7fbd42c00640 1 -- 172.21.15.138:0/896410314 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd3c0b5230 con 0x7fbd3c0b60e0 2024-04-26T20:58:01.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.336+0000 7fbd42c00640 1 -- 172.21.15.138:0/896410314 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd3c0b6560 con 0x7fbd3c0b60e0 2024-04-26T20:58:01.341 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.340+0000 7fbd42c00640 1 -- 172.21.15.138:0/896410314 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd3c069510 con 0x7fbd3c0b60e0 2024-04-26T20:58:01.341 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.340+0000 7fbd38c00640 1 -- 172.21.15.138:0/896410314 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbd3401a020 con 0x7fbd3c0b60e0 2024-04-26T20:58:01.341 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.340+0000 7fbd38c00640 1 --2- 172.21.15.138:0/896410314 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fbd180683b0 0x7fbd1806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:01.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.340+0000 7fbd38c00640 1 -- 172.21.15.138:0/896410314 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fbd34086440 con 0x7fbd3c0b60e0 2024-04-26T20:58:01.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.340+0000 7fbd3be00640 1 --2- 172.21.15.138:0/896410314 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fbd180683b0 0x7fbd1806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:01.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.340+0000 7fbd3be00640 1 --2- 172.21.15.138:0/896410314 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fbd180683b0 0x7fbd1806a870 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c01cad0 tx=0x7fbd2c0b3040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:01.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.344+0000 7fbd38c00640 1 -- 172.21.15.138:0/896410314 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fbd34021020 con 0x7fbd3c0b60e0 2024-04-26T20:58:01.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.500+0000 7fbd42c00640 1 -- 172.21.15.138:0/896410314 --> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbd3c0b4d00 con 0x7fbd180683b0 2024-04-26T20:58:01.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.504+0000 7fbd38c00640 1 -- 172.21.15.138:0/896410314 <== mgr.4100 v2:172.21.15.143:6832/4275464198 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251956 (secure 0 0 0) 0x7fbd3c0b4d00 con 0x7fbd180683b0 2024-04-26T20:58:01.509 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:01.510 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-04-26T20:58:01.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.508+0000 7fbd42c00640 1 -- 172.21.15.138:0/896410314 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fbd180683b0 msgr2=0x7fbd1806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:01.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.508+0000 7fbd42c00640 1 --2- 172.21.15.138:0/896410314 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fbd180683b0 0x7fbd1806a870 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c01cad0 tx=0x7fbd2c0b3040 comp rx=0 tx=0).stop 2024-04-26T20:58:01.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.508+0000 7fbd42c00640 1 -- 172.21.15.138:0/896410314 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd3c0b60e0 msgr2=0x7fbd3c06ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:01.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.508+0000 7fbd42c00640 1 --2- 172.21.15.138:0/896410314 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd3c0b60e0 0x7fbd3c06ebf0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c0cd570 tx=0x7fbd34007b10 comp rx=0 tx=0).stop 2024-04-26T20:58:01.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.508+0000 7fbd42c00640 1 -- 172.21.15.138:0/896410314 shutdown_connections 2024-04-26T20:58:01.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.508+0000 7fbd42c00640 1 --2- 172.21.15.138:0/896410314 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fbd180683b0 0x7fbd1806a870 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:01.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.508+0000 7fbd42c00640 1 --2- 172.21.15.138:0/896410314 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd3c0b60e0 0x7fbd3c06ebf0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:01.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.508+0000 7fbd42c00640 1 --2- 172.21.15.138:0/896410314 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbd3c0c5bc0 0x7fbd3c1500a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:01.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.508+0000 7fbd42c00640 1 --2- 172.21.15.138:0/896410314 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd20003b50 0x7fbd3c0c4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:01.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.508+0000 7fbd42c00640 1 -- 172.21.15.138:0/896410314 >> 172.21.15.138:0/896410314 conn(0x7fbd3c0d0b20 msgr2=0x7fbd3c0d0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:01.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.508+0000 7fbd42c00640 1 -- 172.21.15.138:0/896410314 shutdown_connections 2024-04-26T20:58:01.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.508+0000 7fbd42c00640 1 -- 172.21.15.138:0/896410314 wait complete. 2024-04-26T20:58:01.529 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":83,"stamp":"2024-04-26T20:58:01.260621+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221040,"kb_used_data":4860,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753680,"statfs":{"total":773094113280,"available":772867768320,"internally_reserved":0,"allocated":4976640,"data_stored":2775848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.707650"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.492170+0000","last_change":"2024-04-26T20:57:52.581808+0000","last_active":"2024-04-26T20:57:55.492170+0000","last_peered":"2024-04-26T20:57:55.492170+0000","last_clean":"2024-04-26T20:57:55.492170+0000","last_became_active":"2024-04-26T20:57:52.581483+0000","last_became_peered":"2024-04-26T20:57:52.581483+0000","last_unstale":"2024-04-26T20:57:55.492170+0000","last_undegraded":"2024-04-26T20:57:55.492170+0000","last_fullsized":"2024-04-26T20:57:55.492170+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:59:31.726648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.575819+0000","last_change":"2024-04-26T20:57:52.584136+0000","last_active":"2024-04-26T20:57:53.575819+0000","last_peered":"2024-04-26T20:57:53.575819+0000","last_clean":"2024-04-26T20:57:53.575819+0000","last_became_active":"2024-04-26T20:57:52.583831+0000","last_became_peered":"2024-04-26T20:57:52.583831+0000","last_unstale":"2024-04-26T20:57:53.575819+0000","last_undegraded":"2024-04-26T20:57:53.575819+0000","last_fullsized":"2024-04-26T20:57:53.575819+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:13.183123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.492105+0000","last_change":"2024-04-26T20:57:52.589332+0000","last_active":"2024-04-26T20:57:55.492105+0000","last_peered":"2024-04-26T20:57:55.492105+0000","last_clean":"2024-04-26T20:57:55.492105+0000","last_became_active":"2024-04-26T20:57:52.589025+0000","last_became_peered":"2024-04-26T20:57:52.589025+0000","last_unstale":"2024-04-26T20:57:55.492105+0000","last_undegraded":"2024-04-26T20:57:55.492105+0000","last_fullsized":"2024-04-26T20:57:55.492105+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:32:30.418094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.491832+0000","last_change":"2024-04-26T20:57:52.577582+0000","last_active":"2024-04-26T20:57:55.491832+0000","last_peered":"2024-04-26T20:57:55.491832+0000","last_clean":"2024-04-26T20:57:55.491832+0000","last_became_active":"2024-04-26T20:57:52.576872+0000","last_became_peered":"2024-04-26T20:57:52.576872+0000","last_unstale":"2024-04-26T20:57:55.491832+0000","last_undegraded":"2024-04-26T20:57:55.491832+0000","last_fullsized":"2024-04-26T20:57:55.491832+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:54.444509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574966+0000","last_change":"2024-04-26T20:57:52.590233+0000","last_active":"2024-04-26T20:57:53.574966+0000","last_peered":"2024-04-26T20:57:53.574966+0000","last_clean":"2024-04-26T20:57:53.574966+0000","last_became_active":"2024-04-26T20:57:52.589943+0000","last_became_peered":"2024-04-26T20:57:52.589943+0000","last_unstale":"2024-04-26T20:57:53.574966+0000","last_undegraded":"2024-04-26T20:57:53.574966+0000","last_fullsized":"2024-04-26T20:57:53.574966+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:55:42.728542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574507+0000","last_change":"2024-04-26T20:57:52.586359+0000","last_active":"2024-04-26T20:57:53.574507+0000","last_peered":"2024-04-26T20:57:53.574507+0000","last_clean":"2024-04-26T20:57:53.574507+0000","last_became_active":"2024-04-26T20:57:52.586013+0000","last_became_peered":"2024-04-26T20:57:52.586013+0000","last_unstale":"2024-04-26T20:57:53.574507+0000","last_undegraded":"2024-04-26T20:57:53.574507+0000","last_fullsized":"2024-04-26T20:57:53.574507+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:03:40.972633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574608+0000","last_change":"2024-04-26T20:57:52.578308+0000","last_active":"2024-04-26T20:57:53.574608+0000","last_peered":"2024-04-26T20:57:53.574608+0000","last_clean":"2024-04-26T20:57:53.574608+0000","last_became_active":"2024-04-26T20:57:52.578063+0000","last_became_peered":"2024-04-26T20:57:52.578063+0000","last_unstale":"2024-04-26T20:57:53.574608+0000","last_undegraded":"2024-04-26T20:57:53.574608+0000","last_fullsized":"2024-04-26T20:57:53.574608+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:14:02.457147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.491272+0000","last_change":"2024-04-26T20:57:52.583828+0000","last_active":"2024-04-26T20:57:55.491272+0000","last_peered":"2024-04-26T20:57:55.491272+0000","last_clean":"2024-04-26T20:57:55.491272+0000","last_became_active":"2024-04-26T20:57:52.582894+0000","last_became_peered":"2024-04-26T20:57:52.582894+0000","last_unstale":"2024-04-26T20:57:55.491272+0000","last_undegraded":"2024-04-26T20:57:55.491272+0000","last_fullsized":"2024-04-26T20:57:55.491272+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:07:20.480071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.575370+0000","last_change":"2024-04-26T20:57:52.590616+0000","last_active":"2024-04-26T20:57:53.575370+0000","last_peered":"2024-04-26T20:57:53.575370+0000","last_clean":"2024-04-26T20:57:53.575370+0000","last_became_active":"2024-04-26T20:57:52.589972+0000","last_became_peered":"2024-04-26T20:57:52.589972+0000","last_unstale":"2024-04-26T20:57:53.575370+0000","last_undegraded":"2024-04-26T20:57:53.575370+0000","last_fullsized":"2024-04-26T20:57:53.575370+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:50:33.246661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.575071+0000","last_change":"2024-04-26T20:57:52.575175+0000","last_active":"2024-04-26T20:57:53.575071+0000","last_peered":"2024-04-26T20:57:53.575071+0000","last_clean":"2024-04-26T20:57:53.575071+0000","last_became_active":"2024-04-26T20:57:52.574917+0000","last_became_peered":"2024-04-26T20:57:52.574917+0000","last_unstale":"2024-04-26T20:57:53.575071+0000","last_undegraded":"2024-04-26T20:57:53.575071+0000","last_fullsized":"2024-04-26T20:57:53.575071+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:36:55.831432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.698301+0000","last_change":"2024-04-26T20:57:52.579280+0000","last_active":"2024-04-26T20:57:53.698301+0000","last_peered":"2024-04-26T20:57:53.698301+0000","last_clean":"2024-04-26T20:57:53.698301+0000","last_became_active":"2024-04-26T20:57:52.578799+0000","last_became_peered":"2024-04-26T20:57:52.578799+0000","last_unstale":"2024-04-26T20:57:53.698301+0000","last_undegraded":"2024-04-26T20:57:53.698301+0000","last_fullsized":"2024-04-26T20:57:53.698301+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:53:53.499485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574534+0000","last_change":"2024-04-26T20:57:52.585045+0000","last_active":"2024-04-26T20:57:53.574534+0000","last_peered":"2024-04-26T20:57:53.574534+0000","last_clean":"2024-04-26T20:57:53.574534+0000","last_became_active":"2024-04-26T20:57:52.584748+0000","last_became_peered":"2024-04-26T20:57:52.584748+0000","last_unstale":"2024-04-26T20:57:53.574534+0000","last_undegraded":"2024-04-26T20:57:53.574534+0000","last_fullsized":"2024-04-26T20:57:53.574534+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:19:07.737363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574687+0000","last_change":"2024-04-26T20:57:52.583032+0000","last_active":"2024-04-26T20:57:53.574687+0000","last_peered":"2024-04-26T20:57:53.574687+0000","last_clean":"2024-04-26T20:57:53.574687+0000","last_became_active":"2024-04-26T20:57:52.582788+0000","last_became_peered":"2024-04-26T20:57:52.582788+0000","last_unstale":"2024-04-26T20:57:53.574687+0000","last_undegraded":"2024-04-26T20:57:53.574687+0000","last_fullsized":"2024-04-26T20:57:53.574687+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:55:42.728542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.490142+0000","last_change":"2024-04-26T20:57:52.577582+0000","last_active":"2024-04-26T20:57:55.490142+0000","last_peered":"2024-04-26T20:57:55.490142+0000","last_clean":"2024-04-26T20:57:55.490142+0000","last_became_active":"2024-04-26T20:57:52.577366+0000","last_became_peered":"2024-04-26T20:57:52.577366+0000","last_unstale":"2024-04-26T20:57:55.490142+0000","last_undegraded":"2024-04-26T20:57:55.490142+0000","last_fullsized":"2024-04-26T20:57:55.490142+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:07.021199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.490598+0000","last_change":"2024-04-26T20:57:52.586188+0000","last_active":"2024-04-26T20:57:55.490598+0000","last_peered":"2024-04-26T20:57:55.490598+0000","last_clean":"2024-04-26T20:57:55.490598+0000","last_became_active":"2024-04-26T20:57:52.585816+0000","last_became_peered":"2024-04-26T20:57:52.585816+0000","last_unstale":"2024-04-26T20:57:55.490598+0000","last_undegraded":"2024-04-26T20:57:55.490598+0000","last_fullsized":"2024-04-26T20:57:55.490598+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:06:03.397876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574464+0000","last_change":"2024-04-26T20:57:52.587967+0000","last_active":"2024-04-26T20:57:53.574464+0000","last_peered":"2024-04-26T20:57:53.574464+0000","last_clean":"2024-04-26T20:57:53.574464+0000","last_became_active":"2024-04-26T20:57:52.587598+0000","last_became_peered":"2024-04-26T20:57:52.587598+0000","last_unstale":"2024-04-26T20:57:53.574464+0000","last_undegraded":"2024-04-26T20:57:53.574464+0000","last_fullsized":"2024-04-26T20:57:53.574464+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:19:07.737363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.491248+0000","last_change":"2024-04-26T20:57:52.582167+0000","last_active":"2024-04-26T20:57:55.491248+0000","last_peered":"2024-04-26T20:57:55.491248+0000","last_clean":"2024-04-26T20:57:55.491248+0000","last_became_active":"2024-04-26T20:57:52.581896+0000","last_became_peered":"2024-04-26T20:57:52.581896+0000","last_unstale":"2024-04-26T20:57:55.491248+0000","last_undegraded":"2024-04-26T20:57:55.491248+0000","last_fullsized":"2024-04-26T20:57:55.491248+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:33.773431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.491119+0000","last_change":"2024-04-26T20:57:52.582700+0000","last_active":"2024-04-26T20:57:55.491119+0000","last_peered":"2024-04-26T20:57:55.491119+0000","last_clean":"2024-04-26T20:57:55.491119+0000","last_became_active":"2024-04-26T20:57:52.582355+0000","last_became_peered":"2024-04-26T20:57:52.582355+0000","last_unstale":"2024-04-26T20:57:55.491119+0000","last_undegraded":"2024-04-26T20:57:55.491119+0000","last_fullsized":"2024-04-26T20:57:55.491119+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:31:29.694312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.491331+0000","last_change":"2024-04-26T20:57:52.593273+0000","last_active":"2024-04-26T20:57:55.491331+0000","last_peered":"2024-04-26T20:57:55.491331+0000","last_clean":"2024-04-26T20:57:55.491331+0000","last_became_active":"2024-04-26T20:57:52.592960+0000","last_became_peered":"2024-04-26T20:57:52.592960+0000","last_unstale":"2024-04-26T20:57:55.491331+0000","last_undegraded":"2024-04-26T20:57:55.491331+0000","last_fullsized":"2024-04-26T20:57:55.491331+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:13.183123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.698054+0000","last_change":"2024-04-26T20:57:52.569599+0000","last_active":"2024-04-26T20:57:53.698054+0000","last_peered":"2024-04-26T20:57:53.698054+0000","last_clean":"2024-04-26T20:57:53.698054+0000","last_became_active":"2024-04-26T20:57:52.569345+0000","last_became_peered":"2024-04-26T20:57:52.569345+0000","last_unstale":"2024-04-26T20:57:53.698054+0000","last_undegraded":"2024-04-26T20:57:53.698054+0000","last_fullsized":"2024-04-26T20:57:53.698054+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:26.856916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.698008+0000","last_change":"2024-04-26T20:57:52.592270+0000","last_active":"2024-04-26T20:57:53.698008+0000","last_peered":"2024-04-26T20:57:53.698008+0000","last_clean":"2024-04-26T20:57:53.698008+0000","last_became_active":"2024-04-26T20:57:52.591984+0000","last_became_peered":"2024-04-26T20:57:52.591984+0000","last_unstale":"2024-04-26T20:57:53.698008+0000","last_undegraded":"2024-04-26T20:57:53.698008+0000","last_fullsized":"2024-04-26T20:57:53.698008+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:28:20.157680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.697892+0000","last_change":"2024-04-26T20:57:52.576852+0000","last_active":"2024-04-26T20:57:53.697892+0000","last_peered":"2024-04-26T20:57:53.697892+0000","last_clean":"2024-04-26T20:57:53.697892+0000","last_became_active":"2024-04-26T20:57:52.575571+0000","last_became_peered":"2024-04-26T20:57:52.575571+0000","last_unstale":"2024-04-26T20:57:53.697892+0000","last_undegraded":"2024-04-26T20:57:53.697892+0000","last_fullsized":"2024-04-26T20:57:53.697892+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:55.128152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.490770+0000","last_change":"2024-04-26T20:57:52.586306+0000","last_active":"2024-04-26T20:57:55.490770+0000","last_peered":"2024-04-26T20:57:55.490770+0000","last_clean":"2024-04-26T20:57:55.490770+0000","last_became_active":"2024-04-26T20:57:52.585992+0000","last_became_peered":"2024-04-26T20:57:52.585992+0000","last_unstale":"2024-04-26T20:57:55.490770+0000","last_undegraded":"2024-04-26T20:57:55.490770+0000","last_fullsized":"2024-04-26T20:57:55.490770+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:09:38.712604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.491420+0000","last_change":"2024-04-26T20:57:52.584019+0000","last_active":"2024-04-26T20:57:55.491420+0000","last_peered":"2024-04-26T20:57:55.491420+0000","last_clean":"2024-04-26T20:57:55.491420+0000","last_became_active":"2024-04-26T20:57:52.583140+0000","last_became_peered":"2024-04-26T20:57:52.583140+0000","last_unstale":"2024-04-26T20:57:55.491420+0000","last_undegraded":"2024-04-26T20:57:55.491420+0000","last_fullsized":"2024-04-26T20:57:55.491420+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:25.562628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.490262+0000","last_change":"2024-04-26T20:57:52.579168+0000","last_active":"2024-04-26T20:57:55.490262+0000","last_peered":"2024-04-26T20:57:55.490262+0000","last_clean":"2024-04-26T20:57:55.490262+0000","last_became_active":"2024-04-26T20:57:52.578943+0000","last_became_peered":"2024-04-26T20:57:52.578943+0000","last_unstale":"2024-04-26T20:57:55.490262+0000","last_undegraded":"2024-04-26T20:57:55.490262+0000","last_fullsized":"2024-04-26T20:57:55.490262+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:10.898445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.491780+0000","last_change":"2024-04-26T20:57:52.585325+0000","last_active":"2024-04-26T20:57:55.491780+0000","last_peered":"2024-04-26T20:57:55.491780+0000","last_clean":"2024-04-26T20:57:55.491780+0000","last_became_active":"2024-04-26T20:57:52.585083+0000","last_became_peered":"2024-04-26T20:57:52.585083+0000","last_unstale":"2024-04-26T20:57:55.491780+0000","last_undegraded":"2024-04-26T20:57:55.491780+0000","last_fullsized":"2024-04-26T20:57:55.491780+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:00:42.689944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.698347+0000","last_change":"2024-04-26T20:57:52.578861+0000","last_active":"2024-04-26T20:57:53.698347+0000","last_peered":"2024-04-26T20:57:53.698347+0000","last_clean":"2024-04-26T20:57:53.698347+0000","last_became_active":"2024-04-26T20:57:52.578454+0000","last_became_peered":"2024-04-26T20:57:52.578454+0000","last_unstale":"2024-04-26T20:57:53.698347+0000","last_undegraded":"2024-04-26T20:57:53.698347+0000","last_fullsized":"2024-04-26T20:57:53.698347+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:43:41.131361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574874+0000","last_change":"2024-04-26T20:57:52.577688+0000","last_active":"2024-04-26T20:57:53.574874+0000","last_peered":"2024-04-26T20:57:53.574874+0000","last_clean":"2024-04-26T20:57:53.574874+0000","last_became_active":"2024-04-26T20:57:52.577426+0000","last_became_peered":"2024-04-26T20:57:52.577426+0000","last_unstale":"2024-04-26T20:57:53.574874+0000","last_undegraded":"2024-04-26T20:57:53.574874+0000","last_fullsized":"2024-04-26T20:57:53.574874+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:33.561350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.490763+0000","last_change":"2024-04-26T20:57:52.583932+0000","last_active":"2024-04-26T20:57:55.490763+0000","last_peered":"2024-04-26T20:57:55.490763+0000","last_clean":"2024-04-26T20:57:55.490763+0000","last_became_active":"2024-04-26T20:57:52.583671+0000","last_became_peered":"2024-04-26T20:57:52.583671+0000","last_unstale":"2024-04-26T20:57:55.490763+0000","last_undegraded":"2024-04-26T20:57:55.490763+0000","last_fullsized":"2024-04-26T20:57:55.490763+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:48:59.322923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.490695+0000","last_change":"2024-04-26T20:57:52.569868+0000","last_active":"2024-04-26T20:57:55.490695+0000","last_peered":"2024-04-26T20:57:55.490695+0000","last_clean":"2024-04-26T20:57:55.490695+0000","last_became_active":"2024-04-26T20:57:52.569591+0000","last_became_peered":"2024-04-26T20:57:52.569591+0000","last_unstale":"2024-04-26T20:57:55.490695+0000","last_undegraded":"2024-04-26T20:57:55.490695+0000","last_fullsized":"2024-04-26T20:57:55.490695+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:37:30.401536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574754+0000","last_change":"2024-04-26T20:57:52.581841+0000","last_active":"2024-04-26T20:57:53.574754+0000","last_peered":"2024-04-26T20:57:53.574754+0000","last_clean":"2024-04-26T20:57:53.574754+0000","last_became_active":"2024-04-26T20:57:52.581591+0000","last_became_peered":"2024-04-26T20:57:52.581591+0000","last_unstale":"2024-04-26T20:57:53.574754+0000","last_undegraded":"2024-04-26T20:57:53.574754+0000","last_fullsized":"2024-04-26T20:57:53.574754+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:43:08.977177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.491453+0000","last_change":"2024-04-26T20:57:52.583636+0000","last_active":"2024-04-26T20:57:55.491453+0000","last_peered":"2024-04-26T20:57:55.491453+0000","last_clean":"2024-04-26T20:57:55.491453+0000","last_became_active":"2024-04-26T20:57:52.582497+0000","last_became_peered":"2024-04-26T20:57:52.582497+0000","last_unstale":"2024-04-26T20:57:55.491453+0000","last_undegraded":"2024-04-26T20:57:55.491453+0000","last_fullsized":"2024-04-26T20:57:55.491453+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:06:47.714849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.491024+0000","last_change":"2024-04-26T20:57:52.569273+0000","last_active":"2024-04-26T20:57:55.491024+0000","last_peered":"2024-04-26T20:57:55.491024+0000","last_clean":"2024-04-26T20:57:55.491024+0000","last_became_active":"2024-04-26T20:57:52.568195+0000","last_became_peered":"2024-04-26T20:57:52.568195+0000","last_unstale":"2024-04-26T20:57:55.491024+0000","last_undegraded":"2024-04-26T20:57:55.491024+0000","last_fullsized":"2024-04-26T20:57:55.491024+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:05:40.669900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"40'4","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.490270+0000","last_change":"2024-04-26T20:57:51.572743+0000","last_active":"2024-04-26T20:57:55.490270+0000","last_peered":"2024-04-26T20:57:55.490270+0000","last_clean":"2024-04-26T20:57:55.490270+0000","last_became_active":"2024-04-26T20:57:51.572350+0000","last_became_peered":"2024-04-26T20:57:51.572350+0000","last_unstale":"2024-04-26T20:57:55.490270+0000","last_undegraded":"2024-04-26T20:57:55.490270+0000","last_fullsized":"2024-04-26T20:57:55.490270+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:50:32.238625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.575427+0000","last_change":"2024-04-26T20:57:52.587288+0000","last_active":"2024-04-26T20:57:53.575427+0000","last_peered":"2024-04-26T20:57:53.575427+0000","last_clean":"2024-04-26T20:57:53.575427+0000","last_became_active":"2024-04-26T20:57:52.586875+0000","last_became_peered":"2024-04-26T20:57:52.586875+0000","last_unstale":"2024-04-26T20:57:53.575427+0000","last_undegraded":"2024-04-26T20:57:53.575427+0000","last_fullsized":"2024-04-26T20:57:53.575427+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:16.143937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.575702+0000","last_change":"2024-04-26T20:57:51.566643+0000","last_active":"2024-04-26T20:57:53.575702+0000","last_peered":"2024-04-26T20:57:53.575702+0000","last_clean":"2024-04-26T20:57:53.575702+0000","last_became_active":"2024-04-26T20:57:51.566309+0000","last_became_peered":"2024-04-26T20:57:51.566309+0000","last_unstale":"2024-04-26T20:57:53.575702+0000","last_undegraded":"2024-04-26T20:57:53.575702+0000","last_fullsized":"2024-04-26T20:57:53.575702+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:50:32.238625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.491255+0000","last_change":"2024-04-26T20:57:52.566380+0000","last_active":"2024-04-26T20:57:55.491255+0000","last_peered":"2024-04-26T20:57:55.491255+0000","last_clean":"2024-04-26T20:57:55.491255+0000","last_became_active":"2024-04-26T20:57:52.566143+0000","last_became_peered":"2024-04-26T20:57:52.566143+0000","last_unstale":"2024-04-26T20:57:55.491255+0000","last_undegraded":"2024-04-26T20:57:55.491255+0000","last_fullsized":"2024-04-26T20:57:55.491255+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:30.531635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.492149+0000","last_change":"2024-04-26T20:57:51.573664+0000","last_active":"2024-04-26T20:57:55.492149+0000","last_peered":"2024-04-26T20:57:55.492149+0000","last_clean":"2024-04-26T20:57:55.492149+0000","last_became_active":"2024-04-26T20:57:51.572927+0000","last_became_peered":"2024-04-26T20:57:51.572927+0000","last_unstale":"2024-04-26T20:57:55.492149+0000","last_undegraded":"2024-04-26T20:57:55.492149+0000","last_fullsized":"2024-04-26T20:57:55.492149+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:04:55.596385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.576004+0000","last_change":"2024-04-26T20:57:52.585801+0000","last_active":"2024-04-26T20:57:53.576004+0000","last_peered":"2024-04-26T20:57:53.576004+0000","last_clean":"2024-04-26T20:57:53.576004+0000","last_became_active":"2024-04-26T20:57:52.584731+0000","last_became_peered":"2024-04-26T20:57:52.584731+0000","last_unstale":"2024-04-26T20:57:53.576004+0000","last_undegraded":"2024-04-26T20:57:53.576004+0000","last_fullsized":"2024-04-26T20:57:53.576004+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:28:20.157680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.490184+0000","last_change":"2024-04-26T20:57:51.574013+0000","last_active":"2024-04-26T20:57:55.490184+0000","last_peered":"2024-04-26T20:57:55.490184+0000","last_clean":"2024-04-26T20:57:55.490184+0000","last_became_active":"2024-04-26T20:57:51.573800+0000","last_became_peered":"2024-04-26T20:57:51.573800+0000","last_unstale":"2024-04-26T20:57:55.490184+0000","last_undegraded":"2024-04-26T20:57:55.490184+0000","last_fullsized":"2024-04-26T20:57:55.490184+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:43:07.969141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.491848+0000","last_change":"2024-04-26T20:57:52.587538+0000","last_active":"2024-04-26T20:57:55.491848+0000","last_peered":"2024-04-26T20:57:55.491848+0000","last_clean":"2024-04-26T20:57:55.491848+0000","last_became_active":"2024-04-26T20:57:52.587138+0000","last_became_peered":"2024-04-26T20:57:52.587138+0000","last_unstale":"2024-04-26T20:57:55.491848+0000","last_undegraded":"2024-04-26T20:57:55.491848+0000","last_fullsized":"2024-04-26T20:57:55.491848+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:41:24.188302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.490119+0000","last_change":"2024-04-26T20:57:51.570397+0000","last_active":"2024-04-26T20:57:55.490119+0000","last_peered":"2024-04-26T20:57:55.490119+0000","last_clean":"2024-04-26T20:57:55.490119+0000","last_became_active":"2024-04-26T20:57:51.570089+0000","last_became_peered":"2024-04-26T20:57:51.570089+0000","last_unstale":"2024-04-26T20:57:55.490119+0000","last_undegraded":"2024-04-26T20:57:55.490119+0000","last_fullsized":"2024-04-26T20:57:55.490119+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:55:41.720506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.697981+0000","last_change":"2024-04-26T20:57:52.585311+0000","last_active":"2024-04-26T20:57:53.697981+0000","last_peered":"2024-04-26T20:57:53.697981+0000","last_clean":"2024-04-26T20:57:53.697981+0000","last_became_active":"2024-04-26T20:57:52.585061+0000","last_became_peered":"2024-04-26T20:57:52.585061+0000","last_unstale":"2024-04-26T20:57:53.697981+0000","last_undegraded":"2024-04-26T20:57:53.697981+0000","last_fullsized":"2024-04-26T20:57:53.697981+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:13.183123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574697+0000","last_change":"2024-04-26T20:57:51.571733+0000","last_active":"2024-04-26T20:57:53.574697+0000","last_peered":"2024-04-26T20:57:53.574697+0000","last_clean":"2024-04-26T20:57:53.574697+0000","last_became_active":"2024-04-26T20:57:51.571446+0000","last_became_peered":"2024-04-26T20:57:51.571446+0000","last_unstale":"2024-04-26T20:57:53.574697+0000","last_undegraded":"2024-04-26T20:57:53.574697+0000","last_fullsized":"2024-04-26T20:57:53.574697+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:07.815468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.490783+0000","last_change":"2024-04-26T20:57:52.570641+0000","last_active":"2024-04-26T20:57:55.490783+0000","last_peered":"2024-04-26T20:57:55.490783+0000","last_clean":"2024-04-26T20:57:55.490783+0000","last_became_active":"2024-04-26T20:57:52.570421+0000","last_became_peered":"2024-04-26T20:57:52.570421+0000","last_unstale":"2024-04-26T20:57:55.490783+0000","last_undegraded":"2024-04-26T20:57:55.490783+0000","last_fullsized":"2024-04-26T20:57:55.490783+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:40.105119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.491336+0000","last_change":"2024-04-26T20:57:51.574572+0000","last_active":"2024-04-26T20:57:55.491336+0000","last_peered":"2024-04-26T20:57:55.491336+0000","last_clean":"2024-04-26T20:57:55.491336+0000","last_became_active":"2024-04-26T20:57:51.574213+0000","last_became_peered":"2024-04-26T20:57:51.574213+0000","last_unstale":"2024-04-26T20:57:55.491336+0000","last_undegraded":"2024-04-26T20:57:55.491336+0000","last_fullsized":"2024-04-26T20:57:55.491336+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:10:26.507698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.575337+0000","last_change":"2024-04-26T20:57:52.586106+0000","last_active":"2024-04-26T20:57:53.575337+0000","last_peered":"2024-04-26T20:57:53.575337+0000","last_clean":"2024-04-26T20:57:53.575337+0000","last_became_active":"2024-04-26T20:57:52.585860+0000","last_became_peered":"2024-04-26T20:57:52.585860+0000","last_unstale":"2024-04-26T20:57:53.575337+0000","last_undegraded":"2024-04-26T20:57:53.575337+0000","last_fullsized":"2024-04-26T20:57:53.575337+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:55.128152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574408+0000","last_change":"2024-04-26T20:57:51.573590+0000","last_active":"2024-04-26T20:57:53.574408+0000","last_peered":"2024-04-26T20:57:53.574408+0000","last_clean":"2024-04-26T20:57:53.574408+0000","last_became_active":"2024-04-26T20:57:51.573293+0000","last_became_peered":"2024-04-26T20:57:51.573293+0000","last_unstale":"2024-04-26T20:57:53.574408+0000","last_undegraded":"2024-04-26T20:57:53.574408+0000","last_fullsized":"2024-04-26T20:57:53.574408+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:55:23.008549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.491916+0000","last_change":"2024-04-26T20:57:52.575008+0000","last_active":"2024-04-26T20:57:55.491916+0000","last_peered":"2024-04-26T20:57:55.491916+0000","last_clean":"2024-04-26T20:57:55.491916+0000","last_became_active":"2024-04-26T20:57:52.574553+0000","last_became_peered":"2024-04-26T20:57:52.574553+0000","last_unstale":"2024-04-26T20:57:55.491916+0000","last_undegraded":"2024-04-26T20:57:55.491916+0000","last_fullsized":"2024-04-26T20:57:55.491916+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:07:44.096701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.492213+0000","last_change":"2024-04-26T20:57:51.576675+0000","last_active":"2024-04-26T20:57:55.492213+0000","last_peered":"2024-04-26T20:57:55.492213+0000","last_clean":"2024-04-26T20:57:55.492213+0000","last_became_active":"2024-04-26T20:57:51.576394+0000","last_became_peered":"2024-04-26T20:57:51.576394+0000","last_unstale":"2024-04-26T20:57:55.492213+0000","last_undegraded":"2024-04-26T20:57:55.492213+0000","last_fullsized":"2024-04-26T20:57:55.492213+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:44:14.717022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.490288+0000","last_change":"2024-04-26T20:57:52.576139+0000","last_active":"2024-04-26T20:57:55.490288+0000","last_peered":"2024-04-26T20:57:55.490288+0000","last_clean":"2024-04-26T20:57:55.490288+0000","last_became_active":"2024-04-26T20:57:52.575825+0000","last_became_peered":"2024-04-26T20:57:52.575825+0000","last_unstale":"2024-04-26T20:57:55.490288+0000","last_undegraded":"2024-04-26T20:57:55.490288+0000","last_fullsized":"2024-04-26T20:57:55.490288+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:43:43.232931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.491096+0000","last_change":"2024-04-26T20:57:51.566363+0000","last_active":"2024-04-26T20:57:55.491096+0000","last_peered":"2024-04-26T20:57:55.491096+0000","last_clean":"2024-04-26T20:57:55.491096+0000","last_became_active":"2024-04-26T20:57:51.566020+0000","last_became_peered":"2024-04-26T20:57:51.566020+0000","last_unstale":"2024-04-26T20:57:55.491096+0000","last_undegraded":"2024-04-26T20:57:55.491096+0000","last_fullsized":"2024-04-26T20:57:55.491096+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:51:59.832838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.492114+0000","last_change":"2024-04-26T20:57:52.593299+0000","last_active":"2024-04-26T20:57:55.492114+0000","last_peered":"2024-04-26T20:57:55.492114+0000","last_clean":"2024-04-26T20:57:55.492114+0000","last_became_active":"2024-04-26T20:57:52.591280+0000","last_became_peered":"2024-04-26T20:57:52.591280+0000","last_unstale":"2024-04-26T20:57:55.492114+0000","last_undegraded":"2024-04-26T20:57:55.492114+0000","last_fullsized":"2024-04-26T20:57:55.492114+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:45:53.756909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.490897+0000","last_change":"2024-04-26T20:57:51.569668+0000","last_active":"2024-04-26T20:57:55.490897+0000","last_peered":"2024-04-26T20:57:55.490897+0000","last_clean":"2024-04-26T20:57:55.490897+0000","last_became_active":"2024-04-26T20:57:51.569384+0000","last_became_peered":"2024-04-26T20:57:51.569384+0000","last_unstale":"2024-04-26T20:57:55.490897+0000","last_undegraded":"2024-04-26T20:57:55.490897+0000","last_fullsized":"2024-04-26T20:57:55.490897+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:49:18.242393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.575283+0000","last_change":"2024-04-26T20:57:52.577388+0000","last_active":"2024-04-26T20:57:53.575283+0000","last_peered":"2024-04-26T20:57:53.575283+0000","last_clean":"2024-04-26T20:57:53.575283+0000","last_became_active":"2024-04-26T20:57:52.577116+0000","last_became_peered":"2024-04-26T20:57:52.577116+0000","last_unstale":"2024-04-26T20:57:53.575283+0000","last_undegraded":"2024-04-26T20:57:53.575283+0000","last_fullsized":"2024-04-26T20:57:53.575283+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:08:20.328489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.492040+0000","last_change":"2024-04-26T20:57:51.574348+0000","last_active":"2024-04-26T20:57:55.492040+0000","last_peered":"2024-04-26T20:57:55.492040+0000","last_clean":"2024-04-26T20:57:55.492040+0000","last_became_active":"2024-04-26T20:57:51.574023+0000","last_became_peered":"2024-04-26T20:57:51.574023+0000","last_unstale":"2024-04-26T20:57:55.492040+0000","last_undegraded":"2024-04-26T20:57:55.492040+0000","last_fullsized":"2024-04-26T20:57:55.492040+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:29:31.014100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.491954+0000","last_change":"2024-04-26T20:57:52.583405+0000","last_active":"2024-04-26T20:57:55.491954+0000","last_peered":"2024-04-26T20:57:55.491954+0000","last_clean":"2024-04-26T20:57:55.491954+0000","last_became_active":"2024-04-26T20:57:52.582257+0000","last_became_peered":"2024-04-26T20:57:52.582257+0000","last_unstale":"2024-04-26T20:57:55.491954+0000","last_undegraded":"2024-04-26T20:57:55.491954+0000","last_fullsized":"2024-04-26T20:57:55.491954+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:39.396387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.491677+0000","last_change":"2024-04-26T20:57:51.572541+0000","last_active":"2024-04-26T20:57:55.491677+0000","last_peered":"2024-04-26T20:57:55.491677+0000","last_clean":"2024-04-26T20:57:55.491677+0000","last_became_active":"2024-04-26T20:57:51.571967+0000","last_became_peered":"2024-04-26T20:57:51.571967+0000","last_unstale":"2024-04-26T20:57:55.491677+0000","last_undegraded":"2024-04-26T20:57:55.491677+0000","last_fullsized":"2024-04-26T20:57:55.491677+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:11:04.894675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574548+0000","last_change":"2024-04-26T20:57:52.581005+0000","last_active":"2024-04-26T20:57:53.574548+0000","last_peered":"2024-04-26T20:57:53.574548+0000","last_clean":"2024-04-26T20:57:53.574548+0000","last_became_active":"2024-04-26T20:57:52.580685+0000","last_became_peered":"2024-04-26T20:57:52.580685+0000","last_unstale":"2024-04-26T20:57:53.574548+0000","last_undegraded":"2024-04-26T20:57:53.574548+0000","last_fullsized":"2024-04-26T20:57:53.574548+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:23:22.653755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574567+0000","last_change":"2024-04-26T20:57:51.571181+0000","last_active":"2024-04-26T20:57:53.574567+0000","last_peered":"2024-04-26T20:57:53.574567+0000","last_clean":"2024-04-26T20:57:53.574567+0000","last_became_active":"2024-04-26T20:57:51.570305+0000","last_became_peered":"2024-04-26T20:57:51.570305+0000","last_unstale":"2024-04-26T20:57:53.574567+0000","last_undegraded":"2024-04-26T20:57:53.574567+0000","last_fullsized":"2024-04-26T20:57:53.574567+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:43:07.969141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.698155+0000","last_change":"2024-04-26T20:57:52.584791+0000","last_active":"2024-04-26T20:57:53.698155+0000","last_peered":"2024-04-26T20:57:53.698155+0000","last_clean":"2024-04-26T20:57:53.698155+0000","last_became_active":"2024-04-26T20:57:52.575922+0000","last_became_peered":"2024-04-26T20:57:52.575922+0000","last_unstale":"2024-04-26T20:57:53.698155+0000","last_undegraded":"2024-04-26T20:57:53.698155+0000","last_fullsized":"2024-04-26T20:57:53.698155+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:12:05.356796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.490849+0000","last_change":"2024-04-26T20:57:51.563498+0000","last_active":"2024-04-26T20:57:55.490849+0000","last_peered":"2024-04-26T20:57:55.490849+0000","last_clean":"2024-04-26T20:57:55.490849+0000","last_became_active":"2024-04-26T20:57:51.563243+0000","last_became_peered":"2024-04-26T20:57:51.563243+0000","last_unstale":"2024-04-26T20:57:55.490849+0000","last_undegraded":"2024-04-26T20:57:55.490849+0000","last_fullsized":"2024-04-26T20:57:55.490849+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:47:09.428746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.575128+0000","last_change":"2024-04-26T20:57:52.584930+0000","last_active":"2024-04-26T20:57:53.575128+0000","last_peered":"2024-04-26T20:57:53.575128+0000","last_clean":"2024-04-26T20:57:53.575128+0000","last_became_active":"2024-04-26T20:57:52.584641+0000","last_became_peered":"2024-04-26T20:57:52.584641+0000","last_unstale":"2024-04-26T20:57:53.575128+0000","last_undegraded":"2024-04-26T20:57:53.575128+0000","last_fullsized":"2024-04-26T20:57:53.575128+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:33.561350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.490157+0000","last_change":"2024-04-26T20:57:51.567931+0000","last_active":"2024-04-26T20:57:55.490157+0000","last_peered":"2024-04-26T20:57:55.490157+0000","last_clean":"2024-04-26T20:57:55.490157+0000","last_became_active":"2024-04-26T20:57:51.567552+0000","last_became_peered":"2024-04-26T20:57:51.567552+0000","last_unstale":"2024-04-26T20:57:55.490157+0000","last_undegraded":"2024-04-26T20:57:55.490157+0000","last_fullsized":"2024-04-26T20:57:55.490157+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:32.553314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.575154+0000","last_change":"2024-04-26T20:57:52.581758+0000","last_active":"2024-04-26T20:57:53.575154+0000","last_peered":"2024-04-26T20:57:53.575154+0000","last_clean":"2024-04-26T20:57:53.575154+0000","last_became_active":"2024-04-26T20:57:52.581085+0000","last_became_peered":"2024-04-26T20:57:52.581085+0000","last_unstale":"2024-04-26T20:57:53.575154+0000","last_undegraded":"2024-04-26T20:57:53.575154+0000","last_fullsized":"2024-04-26T20:57:53.575154+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:37:58.253968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.575198+0000","last_change":"2024-04-26T20:57:51.575710+0000","last_active":"2024-04-26T20:57:53.575198+0000","last_peered":"2024-04-26T20:57:53.575198+0000","last_clean":"2024-04-26T20:57:53.575198+0000","last_became_active":"2024-04-26T20:57:51.575446+0000","last_became_peered":"2024-04-26T20:57:51.575446+0000","last_unstale":"2024-04-26T20:57:53.575198+0000","last_undegraded":"2024-04-26T20:57:53.575198+0000","last_fullsized":"2024-04-26T20:57:53.575198+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:05.463288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.575005+0000","last_change":"2024-04-26T20:57:52.585080+0000","last_active":"2024-04-26T20:57:53.575005+0000","last_peered":"2024-04-26T20:57:53.575005+0000","last_clean":"2024-04-26T20:57:53.575005+0000","last_became_active":"2024-04-26T20:57:52.584794+0000","last_became_peered":"2024-04-26T20:57:52.584794+0000","last_unstale":"2024-04-26T20:57:53.575005+0000","last_undegraded":"2024-04-26T20:57:53.575005+0000","last_fullsized":"2024-04-26T20:57:53.575005+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:50:33.246661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.491209+0000","last_change":"2024-04-26T20:57:51.569389+0000","last_active":"2024-04-26T20:57:55.491209+0000","last_peered":"2024-04-26T20:57:55.491209+0000","last_clean":"2024-04-26T20:57:55.491209+0000","last_became_active":"2024-04-26T20:57:51.569128+0000","last_became_peered":"2024-04-26T20:57:51.569128+0000","last_unstale":"2024-04-26T20:57:55.491209+0000","last_undegraded":"2024-04-26T20:57:55.491209+0000","last_fullsized":"2024-04-26T20:57:55.491209+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:44.305635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.575094+0000","last_change":"2024-04-26T20:57:52.580234+0000","last_active":"2024-04-26T20:57:53.575094+0000","last_peered":"2024-04-26T20:57:53.575094+0000","last_clean":"2024-04-26T20:57:53.575094+0000","last_became_active":"2024-04-26T20:57:52.579929+0000","last_became_peered":"2024-04-26T20:57:52.579929+0000","last_unstale":"2024-04-26T20:57:53.575094+0000","last_undegraded":"2024-04-26T20:57:53.575094+0000","last_fullsized":"2024-04-26T20:57:53.575094+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:11.582177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574794+0000","last_change":"2024-04-26T20:57:51.577610+0000","last_active":"2024-04-26T20:57:53.574794+0000","last_peered":"2024-04-26T20:57:53.574794+0000","last_clean":"2024-04-26T20:57:53.574794+0000","last_became_active":"2024-04-26T20:57:51.577352+0000","last_became_peered":"2024-04-26T20:57:51.577352+0000","last_unstale":"2024-04-26T20:57:53.574794+0000","last_undegraded":"2024-04-26T20:57:53.574794+0000","last_fullsized":"2024-04-26T20:57:53.574794+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:05:01.247112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.491689+0000","last_change":"2024-04-26T20:57:52.593107+0000","last_active":"2024-04-26T20:57:55.491689+0000","last_peered":"2024-04-26T20:57:55.491689+0000","last_clean":"2024-04-26T20:57:55.491689+0000","last_became_active":"2024-04-26T20:57:52.592849+0000","last_became_peered":"2024-04-26T20:57:52.592849+0000","last_unstale":"2024-04-26T20:57:55.491689+0000","last_undegraded":"2024-04-26T20:57:55.491689+0000","last_fullsized":"2024-04-26T20:57:55.491689+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:28:20.157680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.491238+0000","last_change":"2024-04-26T20:57:51.573218+0000","last_active":"2024-04-26T20:57:55.491238+0000","last_peered":"2024-04-26T20:57:55.491238+0000","last_clean":"2024-04-26T20:57:55.491238+0000","last_became_active":"2024-04-26T20:57:51.572070+0000","last_became_peered":"2024-04-26T20:57:51.572070+0000","last_unstale":"2024-04-26T20:57:55.491238+0000","last_undegraded":"2024-04-26T20:57:55.491238+0000","last_fullsized":"2024-04-26T20:57:55.491238+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:43.209710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.490566+0000","last_change":"2024-04-26T20:57:52.580620+0000","last_active":"2024-04-26T20:57:55.490566+0000","last_peered":"2024-04-26T20:57:55.490566+0000","last_clean":"2024-04-26T20:57:55.490566+0000","last_became_active":"2024-04-26T20:57:52.580262+0000","last_became_peered":"2024-04-26T20:57:52.580262+0000","last_unstale":"2024-04-26T20:57:55.490566+0000","last_undegraded":"2024-04-26T20:57:55.490566+0000","last_fullsized":"2024-04-26T20:57:55.490566+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:18:30.707432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.491177+0000","last_change":"2024-04-26T20:57:51.572477+0000","last_active":"2024-04-26T20:57:55.491177+0000","last_peered":"2024-04-26T20:57:55.491177+0000","last_clean":"2024-04-26T20:57:55.491177+0000","last_became_active":"2024-04-26T20:57:51.572200+0000","last_became_peered":"2024-04-26T20:57:51.572200+0000","last_unstale":"2024-04-26T20:57:55.491177+0000","last_undegraded":"2024-04-26T20:57:55.491177+0000","last_fullsized":"2024-04-26T20:57:55.491177+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:03:39.964597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.491192+0000","last_change":"2024-04-26T20:57:52.570952+0000","last_active":"2024-04-26T20:57:55.491192+0000","last_peered":"2024-04-26T20:57:55.491192+0000","last_clean":"2024-04-26T20:57:55.491192+0000","last_became_active":"2024-04-26T20:57:52.570601+0000","last_became_peered":"2024-04-26T20:57:52.570601+0000","last_unstale":"2024-04-26T20:57:55.491192+0000","last_undegraded":"2024-04-26T20:57:55.491192+0000","last_fullsized":"2024-04-26T20:57:55.491192+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:05.767731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574671+0000","last_change":"2024-04-26T20:57:51.575051+0000","last_active":"2024-04-26T20:57:53.574671+0000","last_peered":"2024-04-26T20:57:53.574671+0000","last_clean":"2024-04-26T20:57:53.574671+0000","last_became_active":"2024-04-26T20:57:51.574755+0000","last_became_peered":"2024-04-26T20:57:51.574755+0000","last_unstale":"2024-04-26T20:57:53.574671+0000","last_undegraded":"2024-04-26T20:57:53.574671+0000","last_fullsized":"2024-04-26T20:57:53.574671+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:32.553314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.697923+0000","last_change":"2024-04-26T20:57:52.584567+0000","last_active":"2024-04-26T20:57:53.697923+0000","last_peered":"2024-04-26T20:57:53.697923+0000","last_clean":"2024-04-26T20:57:53.697923+0000","last_became_active":"2024-04-26T20:57:52.584136+0000","last_became_peered":"2024-04-26T20:57:52.584136+0000","last_unstale":"2024-04-26T20:57:53.697923+0000","last_undegraded":"2024-04-26T20:57:53.697923+0000","last_fullsized":"2024-04-26T20:57:53.697923+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:16.143937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574660+0000","last_change":"2024-04-26T20:57:51.573894+0000","last_active":"2024-04-26T20:57:53.574660+0000","last_peered":"2024-04-26T20:57:53.574660+0000","last_clean":"2024-04-26T20:57:53.574660+0000","last_became_active":"2024-04-26T20:57:51.573467+0000","last_became_peered":"2024-04-26T20:57:51.573467+0000","last_unstale":"2024-04-26T20:57:53.574660+0000","last_undegraded":"2024-04-26T20:57:53.574660+0000","last_fullsized":"2024-04-26T20:57:53.574660+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:53.725346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.491559+0000","last_change":"2024-04-26T20:57:52.570583+0000","last_active":"2024-04-26T20:57:55.491559+0000","last_peered":"2024-04-26T20:57:55.491559+0000","last_clean":"2024-04-26T20:57:55.491559+0000","last_became_active":"2024-04-26T20:57:52.570303+0000","last_became_peered":"2024-04-26T20:57:52.570303+0000","last_unstale":"2024-04-26T20:57:55.491559+0000","last_undegraded":"2024-04-26T20:57:55.491559+0000","last_fullsized":"2024-04-26T20:57:55.491559+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:45.016039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574244+0000","last_change":"2024-04-26T20:57:51.571920+0000","last_active":"2024-04-26T20:57:53.574244+0000","last_peered":"2024-04-26T20:57:53.574244+0000","last_clean":"2024-04-26T20:57:53.574244+0000","last_became_active":"2024-04-26T20:57:51.571644+0000","last_became_peered":"2024-04-26T20:57:51.571644+0000","last_unstale":"2024-04-26T20:57:53.574244+0000","last_undegraded":"2024-04-26T20:57:53.574244+0000","last_fullsized":"2024-04-26T20:57:53.574244+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:55:41.720506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574710+0000","last_change":"2024-04-26T20:57:52.593531+0000","last_active":"2024-04-26T20:57:53.574710+0000","last_peered":"2024-04-26T20:57:53.574710+0000","last_clean":"2024-04-26T20:57:53.574710+0000","last_became_active":"2024-04-26T20:57:52.592602+0000","last_became_peered":"2024-04-26T20:57:52.592602+0000","last_unstale":"2024-04-26T20:57:53.574710+0000","last_undegraded":"2024-04-26T20:57:53.574710+0000","last_fullsized":"2024-04-26T20:57:53.574710+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:14:02.457147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.491202+0000","last_change":"2024-04-26T20:57:51.570771+0000","last_active":"2024-04-26T20:57:55.491202+0000","last_peered":"2024-04-26T20:57:55.491202+0000","last_clean":"2024-04-26T20:57:55.491202+0000","last_became_active":"2024-04-26T20:57:51.570488+0000","last_became_peered":"2024-04-26T20:57:51.570488+0000","last_unstale":"2024-04-26T20:57:55.491202+0000","last_undegraded":"2024-04-26T20:57:55.491202+0000","last_fullsized":"2024-04-26T20:57:55.491202+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:44:02.286474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.698377+0000","last_change":"2024-04-26T20:57:52.579072+0000","last_active":"2024-04-26T20:57:53.698377+0000","last_peered":"2024-04-26T20:57:53.698377+0000","last_clean":"2024-04-26T20:57:53.698377+0000","last_became_active":"2024-04-26T20:57:52.578605+0000","last_became_peered":"2024-04-26T20:57:52.578605+0000","last_unstale":"2024-04-26T20:57:53.698377+0000","last_undegraded":"2024-04-26T20:57:53.698377+0000","last_fullsized":"2024-04-26T20:57:53.698377+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:06:38.434416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"41'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.575429+0000","last_change":"2024-04-26T20:57:51.577840+0000","last_active":"2024-04-26T20:57:53.575429+0000","last_peered":"2024-04-26T20:57:53.575429+0000","last_clean":"2024-04-26T20:57:53.575429+0000","last_became_active":"2024-04-26T20:57:51.577584+0000","last_became_peered":"2024-04-26T20:57:51.577584+0000","last_unstale":"2024-04-26T20:57:53.575429+0000","last_undegraded":"2024-04-26T20:57:53.575429+0000","last_fullsized":"2024-04-26T20:57:53.575429+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:41:35.733249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.491274+0000","last_change":"2024-04-26T20:57:52.580763+0000","last_active":"2024-04-26T20:57:55.491274+0000","last_peered":"2024-04-26T20:57:55.491274+0000","last_clean":"2024-04-26T20:57:55.491274+0000","last_became_active":"2024-04-26T20:57:52.580489+0000","last_became_peered":"2024-04-26T20:57:52.580489+0000","last_unstale":"2024-04-26T20:57:55.491274+0000","last_undegraded":"2024-04-26T20:57:55.491274+0000","last_fullsized":"2024-04-26T20:57:55.491274+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:16.143937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574942+0000","last_change":"2024-04-26T20:57:51.574263+0000","last_active":"2024-04-26T20:57:53.574942+0000","last_peered":"2024-04-26T20:57:53.574942+0000","last_clean":"2024-04-26T20:57:53.574942+0000","last_became_active":"2024-04-26T20:57:51.573941+0000","last_became_peered":"2024-04-26T20:57:51.573941+0000","last_unstale":"2024-04-26T20:57:53.574942+0000","last_undegraded":"2024-04-26T20:57:53.574942+0000","last_fullsized":"2024-04-26T20:57:53.574942+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:38.596761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574968+0000","last_change":"2024-04-26T20:57:52.592217+0000","last_active":"2024-04-26T20:57:53.574968+0000","last_peered":"2024-04-26T20:57:53.574968+0000","last_clean":"2024-04-26T20:57:53.574968+0000","last_became_active":"2024-04-26T20:57:52.591954+0000","last_became_peered":"2024-04-26T20:57:52.591954+0000","last_unstale":"2024-04-26T20:57:53.574968+0000","last_undegraded":"2024-04-26T20:57:53.574968+0000","last_fullsized":"2024-04-26T20:57:53.574968+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:43:08.977177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.491932+0000","last_change":"2024-04-26T20:57:51.571206+0000","last_active":"2024-04-26T20:57:55.491932+0000","last_peered":"2024-04-26T20:57:55.491932+0000","last_clean":"2024-04-26T20:57:55.491932+0000","last_became_active":"2024-04-26T20:57:51.570877+0000","last_became_peered":"2024-04-26T20:57:51.570877+0000","last_unstale":"2024-04-26T20:57:55.491932+0000","last_undegraded":"2024-04-26T20:57:55.491932+0000","last_fullsized":"2024-04-26T20:57:55.491932+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:49:38.164099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574698+0000","last_change":"2024-04-26T20:57:52.594833+0000","last_active":"2024-04-26T20:57:53.574698+0000","last_peered":"2024-04-26T20:57:53.574698+0000","last_clean":"2024-04-26T20:57:53.574698+0000","last_became_active":"2024-04-26T20:57:52.594522+0000","last_became_peered":"2024-04-26T20:57:52.594522+0000","last_unstale":"2024-04-26T20:57:53.574698+0000","last_undegraded":"2024-04-26T20:57:53.574698+0000","last_fullsized":"2024-04-26T20:57:53.574698+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:12.952743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.698207+0000","last_change":"2024-04-26T20:57:51.574086+0000","last_active":"2024-04-26T20:57:53.698207+0000","last_peered":"2024-04-26T20:57:53.698207+0000","last_clean":"2024-04-26T20:57:53.698207+0000","last_became_active":"2024-04-26T20:57:51.573834+0000","last_became_peered":"2024-04-26T20:57:51.573834+0000","last_unstale":"2024-04-26T20:57:53.698207+0000","last_undegraded":"2024-04-26T20:57:53.698207+0000","last_fullsized":"2024-04-26T20:57:53.698207+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:50:32.238625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.490916+0000","last_change":"2024-04-26T20:57:52.588655+0000","last_active":"2024-04-26T20:57:55.490916+0000","last_peered":"2024-04-26T20:57:55.490916+0000","last_clean":"2024-04-26T20:57:55.490916+0000","last_became_active":"2024-04-26T20:57:52.588356+0000","last_became_peered":"2024-04-26T20:57:52.588356+0000","last_unstale":"2024-04-26T20:57:55.490916+0000","last_undegraded":"2024-04-26T20:57:55.490916+0000","last_fullsized":"2024-04-26T20:57:55.490916+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:13.137551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.490834+0000","last_change":"2024-04-26T20:57:51.567675+0000","last_active":"2024-04-26T20:57:55.490834+0000","last_peered":"2024-04-26T20:57:55.490834+0000","last_clean":"2024-04-26T20:57:55.490834+0000","last_became_active":"2024-04-26T20:57:51.567464+0000","last_became_peered":"2024-04-26T20:57:51.567464+0000","last_unstale":"2024-04-26T20:57:55.490834+0000","last_undegraded":"2024-04-26T20:57:55.490834+0000","last_fullsized":"2024-04-26T20:57:55.490834+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:17.267826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.698084+0000","last_change":"2024-04-26T20:57:52.587210+0000","last_active":"2024-04-26T20:57:53.698084+0000","last_peered":"2024-04-26T20:57:53.698084+0000","last_clean":"2024-04-26T20:57:53.698084+0000","last_became_active":"2024-04-26T20:57:52.587015+0000","last_became_peered":"2024-04-26T20:57:52.587015+0000","last_unstale":"2024-04-26T20:57:53.698084+0000","last_undegraded":"2024-04-26T20:57:53.698084+0000","last_fullsized":"2024-04-26T20:57:53.698084+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:06:01.245752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.492079+0000","last_change":"2024-04-26T20:57:51.579142+0000","last_active":"2024-04-26T20:57:55.492079+0000","last_peered":"2024-04-26T20:57:55.492079+0000","last_clean":"2024-04-26T20:57:55.492079+0000","last_became_active":"2024-04-26T20:57:51.578834+0000","last_became_peered":"2024-04-26T20:57:51.578834+0000","last_unstale":"2024-04-26T20:57:55.492079+0000","last_undegraded":"2024-04-26T20:57:55.492079+0000","last_fullsized":"2024-04-26T20:57:55.492079+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:48:04.831644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:55.491150+0000","last_change":"2024-04-26T20:57:52.569231+0000","last_active":"2024-04-26T20:57:55.491150+0000","last_peered":"2024-04-26T20:57:55.491150+0000","last_clean":"2024-04-26T20:57:55.491150+0000","last_became_active":"2024-04-26T20:57:52.568915+0000","last_became_peered":"2024-04-26T20:57:52.568915+0000","last_unstale":"2024-04-26T20:57:55.491150+0000","last_undegraded":"2024-04-26T20:57:55.491150+0000","last_fullsized":"2024-04-26T20:57:55.491150+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:12:00.029798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.698099+0000","last_change":"2024-04-26T20:57:51.574337+0000","last_active":"2024-04-26T20:57:53.698099+0000","last_peered":"2024-04-26T20:57:53.698099+0000","last_clean":"2024-04-26T20:57:53.698099+0000","last_became_active":"2024-04-26T20:57:51.573114+0000","last_became_peered":"2024-04-26T20:57:51.573114+0000","last_unstale":"2024-04-26T20:57:53.698099+0000","last_undegraded":"2024-04-26T20:57:53.698099+0000","last_fullsized":"2024-04-26T20:57:53.698099+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:36:54.823396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":204,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T20:57:53.574525+0000","last_change":"2024-04-26T20:56:29.347462+0000","last_active":"2024-04-26T20:57:53.574525+0000","last_peered":"2024-04-26T20:57:53.574525+0000","last_clean":"2024-04-26T20:57:53.574525+0000","last_became_active":"2024-04-26T20:56:29.346224+0000","last_became_peered":"2024-04-26T20:56:29.346224+0000","last_unstale":"2024-04-26T20:57:53.574525+0000","last_undegraded":"2024-04-26T20:57:53.574525+0000","last_fullsized":"2024-04-26T20:57:53.574525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:28.079105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:28.079105+0000","last_clean_scrub_stamp":"2024-04-26T20:56:28.079105+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:13.693525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509462,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":471040,"data_stored":199693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509461,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":471040,"data_stored":199657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509462,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28060,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343780,"statfs":{"total":96636764160,"available":96608030720,"internally_reserved":0,"allocated":1064960,"data_stored":790573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509462,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":193021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509462,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":201817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509461,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1064960,"data_stored":790013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509460,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":475136,"data_stored":199715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":487424,"data_stored":201359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T20:58:01.533 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-26T20:58:01.533 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-26T20:58:01.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.712+0000 7f4f97200640 1 Processor -- start 2024-04-26T20:58:01.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.712+0000 7f4f97200640 1 -- start start 2024-04-26T20:58:01.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.712+0000 7f4f97200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4f980c9020 0x7f4f9806e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:01.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.712+0000 7f4f97200640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4f9806df50 0x7f4f980cddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:01.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.712+0000 7f4f97200640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f980d2400 con 0x7f4f980d1940 2024-04-26T20:58:01.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.712+0000 7f4f97200640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f4f980cd930 con 0x7f4f9806df50 2024-04-26T20:58:01.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.712+0000 7f4f97200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f4f980d2120 con 0x7f4f980c9020 2024-04-26T20:58:01.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.712+0000 7f4f96800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4f9806df50 0x7f4f980cddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:01.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.712+0000 7f4f96800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4f9806df50 0x7f4f980cddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:53154/0 (socket says 172.21.15.138:53154) 2024-04-26T20:58:01.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.712+0000 7f4f96800640 1 -- 172.21.15.138:0/2048411949 learned_addr learned my addr 172.21.15.138:0/2048411949 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:01.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.712+0000 7f4f95e00640 1 --2- 172.21.15.138:0/2048411949 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4f980c9020 0x7f4f9806e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:01.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.716+0000 7f4f96800640 1 -- 172.21.15.138:0/2048411949 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4f980c9020 msgr2=0x7f4f9806e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:01.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.716+0000 7f4f96800640 1 --2- 172.21.15.138:0/2048411949 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4f980c9020 0x7f4f9806e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:01.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.716+0000 7f4f96800640 1 -- 172.21.15.138:0/2048411949 >> v1:172.21.15.138:6789/0 conn(0x7f4f980d1940 legacy=0x7f4f9806d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:01.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.716+0000 7f4f96800640 1 -- 172.21.15.138:0/2048411949 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f980cd2e0 con 0x7f4f9806df50 2024-04-26T20:58:01.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.716+0000 7f4f95400640 1 -- 172.21.15.138:0/2048411949 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2911174430 0 0) 0x7f4f980d2400 con 0x7f4f980d1940 2024-04-26T20:58:01.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.716+0000 7f4f96800640 1 --2- 172.21.15.138:0/2048411949 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4f9806df50 0x7f4f980cddc0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f4f90009870 tx=0x7f4f9001c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d542cff3d5bd63c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:01.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.716+0000 7f4f95400640 1 -- 172.21.15.138:0/2048411949 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f900ab640 con 0x7f4f9806df50 2024-04-26T20:58:01.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.716+0000 7f4f95400640 1 -- 172.21.15.138:0/2048411949 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f900b0070 con 0x7f4f9806df50 2024-04-26T20:58:01.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.716+0000 7f4f95400640 1 -- 172.21.15.138:0/2048411949 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f900aba00 con 0x7f4f9806df50 2024-04-26T20:58:01.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.716+0000 7f4f97200640 1 -- 172.21.15.138:0/2048411949 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4f9806df50 msgr2=0x7f4f980cddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:01.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.716+0000 7f4f97200640 1 --2- 172.21.15.138:0/2048411949 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4f9806df50 0x7f4f980cddc0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f4f90009870 tx=0x7f4f9001c530 comp rx=0 tx=0).stop 2024-04-26T20:58:01.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.716+0000 7f4f97200640 1 -- 172.21.15.138:0/2048411949 shutdown_connections 2024-04-26T20:58:01.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.716+0000 7f4f97200640 1 --2- 172.21.15.138:0/2048411949 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4f9806df50 0x7f4f980cddc0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:01.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.716+0000 7f4f97200640 1 --2- 172.21.15.138:0/2048411949 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4f980c9020 0x7f4f9806e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:01.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.716+0000 7f4f97200640 1 -- 172.21.15.138:0/2048411949 >> 172.21.15.138:0/2048411949 conn(0x7f4f980d2bf0 msgr2=0x7f4f980d3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:01.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.720+0000 7f4f97200640 1 -- 172.21.15.138:0/2048411949 shutdown_connections 2024-04-26T20:58:01.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.720+0000 7f4f97200640 1 -- 172.21.15.138:0/2048411949 wait complete. 2024-04-26T20:58:01.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.720+0000 7f4f97200640 1 Processor -- start 2024-04-26T20:58:01.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.720+0000 7f4f97200640 1 -- start start 2024-04-26T20:58:01.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.720+0000 7f4f97200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4f9806df50 0x7f4f9814b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:01.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.720+0000 7f4f97200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4f980c9020 0x7f4f980cc320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:01.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.720+0000 7f4f97200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4f980d1940 0x7f4f980cc860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:01.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.720+0000 7f4f97200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f4f980cec90 con 0x7f4f9806df50 2024-04-26T20:58:01.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.720+0000 7f4f97200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f4f980ceb10 con 0x7f4f980d1940 2024-04-26T20:58:01.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.720+0000 7f4f97200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f4f980cee10 con 0x7f4f980c9020 2024-04-26T20:58:01.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.720+0000 7f4f95e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4f9806df50 0x7f4f9814b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:01.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.720+0000 7f4f95e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4f9806df50 0x7f4f9814b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:53160/0 (socket says 172.21.15.138:53160) 2024-04-26T20:58:01.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.720+0000 7f4f95e00640 1 -- 172.21.15.138:0/3007856713 learned_addr learned my addr 172.21.15.138:0/3007856713 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:01.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.720+0000 7f4f8d400640 1 --2- 172.21.15.138:0/3007856713 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4f980c9020 0x7f4f980cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:01.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.720+0000 7f4f96800640 1 --2- 172.21.15.138:0/3007856713 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4f980d1940 0x7f4f980cc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:01.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.720+0000 7f4f95e00640 1 -- 172.21.15.138:0/3007856713 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4f980c9020 msgr2=0x7f4f980cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:01.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.720+0000 7f4f95e00640 1 --2- 172.21.15.138:0/3007856713 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4f980c9020 0x7f4f980cc320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:01.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.720+0000 7f4f95e00640 1 -- 172.21.15.138:0/3007856713 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4f980d1940 msgr2=0x7f4f980cc860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:01.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.720+0000 7f4f95e00640 1 --2- 172.21.15.138:0/3007856713 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4f980d1940 0x7f4f980cc860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:01.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.720+0000 7f4f95e00640 1 -- 172.21.15.138:0/3007856713 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f980caa90 con 0x7f4f9806df50 2024-04-26T20:58:01.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.720+0000 7f4f95e00640 1 --2- 172.21.15.138:0/3007856713 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4f9806df50 0x7f4f9814b960 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f4f88009db0 tx=0x7f4f8800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:01.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.720+0000 7f4f8ea00640 1 -- 172.21.15.138:0/3007856713 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f88018020 con 0x7f4f9806df50 2024-04-26T20:58:01.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.720+0000 7f4f8ea00640 1 -- 172.21.15.138:0/3007856713 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f88014480 con 0x7f4f9806df50 2024-04-26T20:58:01.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.720+0000 7f4f97200640 1 -- 172.21.15.138:0/3007856713 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f980cad70 con 0x7f4f9806df50 2024-04-26T20:58:01.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.720+0000 7f4f8ea00640 1 -- 172.21.15.138:0/3007856713 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f88014850 con 0x7f4f9806df50 2024-04-26T20:58:01.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.724+0000 7f4f97200640 1 -- 172.21.15.138:0/3007856713 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f98155570 con 0x7f4f9806df50 2024-04-26T20:58:01.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.724+0000 7f4f97200640 1 -- 172.21.15.138:0/3007856713 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f98069430 con 0x7f4f9806df50 2024-04-26T20:58:01.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.724+0000 7f4f8ea00640 1 -- 172.21.15.138:0/3007856713 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4f8801b020 con 0x7f4f9806df50 2024-04-26T20:58:01.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.724+0000 7f4f8ea00640 1 --2- 172.21.15.138:0/3007856713 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4f740683b0 0x7f4f7406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:01.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.724+0000 7f4f8ea00640 1 -- 172.21.15.138:0/3007856713 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f4f88087590 con 0x7f4f9806df50 2024-04-26T20:58:01.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.724+0000 7f4f8d400640 1 --2- 172.21.15.138:0/3007856713 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4f740683b0 0x7f4f7406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:01.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.724+0000 7f4f8d400640 1 --2- 172.21.15.138:0/3007856713 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4f740683b0 0x7f4f7406a870 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4f98156cc0 tx=0x7f4f80009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:01.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.728+0000 7f4f8ea00640 1 -- 172.21.15.138:0/3007856713 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4f88022070 con 0x7f4f9806df50 2024-04-26T20:58:01.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.940+0000 7f4f97200640 1 -- 172.21.15.138:0/3007856713 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f4f9815c800 con 0x7f4f9806df50 2024-04-26T20:58:01.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.944+0000 7f4f8ea00640 1 -- 172.21.15.138:0/3007856713 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7f4f88010040 con 0x7f4f9806df50 2024-04-26T20:58:01.945 INFO:teuthology.orchestra.run.smithi138.stdout:[client.0] 2024-04-26T20:58:01.945 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQDMFCxmYsCoFRAAxzCFa5FIV+BhZqore3n18A== 2024-04-26T20:58:01.945 INFO:teuthology.orchestra.run.smithi138.stdout: caps mds = "allow" 2024-04-26T20:58:01.946 INFO:teuthology.orchestra.run.smithi138.stdout: caps mon = "allow r" 2024-04-26T20:58:01.946 INFO:teuthology.orchestra.run.smithi138.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-26T20:58:01.946 INFO:teuthology.orchestra.run.smithi138.stderr:updated caps for client.0 2024-04-26T20:58:01.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.944+0000 7f4f97200640 1 -- 172.21.15.138:0/3007856713 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4f740683b0 msgr2=0x7f4f7406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:01.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.944+0000 7f4f97200640 1 --2- 172.21.15.138:0/3007856713 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4f740683b0 0x7f4f7406a870 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4f98156cc0 tx=0x7f4f80009040 comp rx=0 tx=0).stop 2024-04-26T20:58:01.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.944+0000 7f4f97200640 1 -- 172.21.15.138:0/3007856713 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4f9806df50 msgr2=0x7f4f9814b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:01.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.944+0000 7f4f97200640 1 --2- 172.21.15.138:0/3007856713 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4f9806df50 0x7f4f9814b960 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f4f88009db0 tx=0x7f4f8800c490 comp rx=0 tx=0).stop 2024-04-26T20:58:01.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.944+0000 7f4f97200640 1 -- 172.21.15.138:0/3007856713 shutdown_connections 2024-04-26T20:58:01.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.944+0000 7f4f97200640 1 --2- 172.21.15.138:0/3007856713 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4f740683b0 0x7f4f7406a870 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:01.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.944+0000 7f4f97200640 1 --2- 172.21.15.138:0/3007856713 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4f980d1940 0x7f4f980cc860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:01.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.944+0000 7f4f97200640 1 --2- 172.21.15.138:0/3007856713 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4f980c9020 0x7f4f980cc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:01.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.944+0000 7f4f97200640 1 --2- 172.21.15.138:0/3007856713 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4f9806df50 0x7f4f9814b960 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:01.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.944+0000 7f4f97200640 1 -- 172.21.15.138:0/3007856713 >> 172.21.15.138:0/3007856713 conn(0x7f4f980d2bf0 msgr2=0x7f4f9806d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:01.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.944+0000 7f4f97200640 1 -- 172.21.15.138:0/3007856713 shutdown_connections 2024-04-26T20:58:01.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:01.944+0000 7f4f97200640 1 -- 172.21.15.138:0/3007856713 wait complete. 2024-04-26T20:58:01.967 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:58:02.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.100+0000 7f6407000640 1 Processor -- start 2024-04-26T20:58:02.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.100+0000 7f6407000640 1 -- start start 2024-04-26T20:58:02.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.100+0000 7f6407000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f64000cbe00 0x7f640006de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:02.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.100+0000 7f6407000640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f64000cc1e0 0x7f6400073b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:02.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.104+0000 7f6407000640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64000727f0 con 0x7f64000ce6f0 2024-04-26T20:58:02.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.104+0000 7f6407000640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f6400073680 con 0x7f64000cbe00 2024-04-26T20:58:02.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.104+0000 7f6407000640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f6400072a70 con 0x7f64000cc1e0 2024-04-26T20:58:02.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.104+0000 7f63ffe00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f64000cbe00 0x7f640006de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:02.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.104+0000 7f63ffe00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f64000cbe00 0x7f640006de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:53162/0 (socket says 172.21.15.138:53162) 2024-04-26T20:58:02.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.104+0000 7f63ffe00640 1 -- 172.21.15.138:0/1316822473 learned_addr learned my addr 172.21.15.138:0/1316822473 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:02.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.104+0000 7f63f7400640 1 --2- 172.21.15.138:0/1316822473 >> v2:172.21.15.143:3300/0 conn(0x7f64000cc1e0 0x7f6400073b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:02.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.104+0000 7f63ffe00640 1 -- 172.21.15.138:0/1316822473 >> v2:172.21.15.143:3300/0 conn(0x7f64000cc1e0 msgr2=0x7f6400073b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:02.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.104+0000 7f63ffe00640 1 --2- 172.21.15.138:0/1316822473 >> v2:172.21.15.143:3300/0 conn(0x7f64000cc1e0 0x7f6400073b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:02.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.104+0000 7f63ffe00640 1 -- 172.21.15.138:0/1316822473 >> v1:172.21.15.143:6789/0 conn(0x7f64000ce6f0 legacy=0x7f64000ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:02.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.104+0000 7f63ffe00640 1 -- 172.21.15.138:0/1316822473 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6400072d50 con 0x7f64000cbe00 2024-04-26T20:58:02.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.104+0000 7f63ffe00640 1 --2- 172.21.15.138:0/1316822473 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64000cbe00 0x7f640006de70 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f64000b6c50 tx=0x7f63f001ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99cd17d5687d8d85 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:02.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.104+0000 7f63ff400640 1 -- 172.21.15.138:0/1316822473 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f00b4070 con 0x7f64000cbe00 2024-04-26T20:58:02.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.104+0000 7f63ff400640 1 -- 172.21.15.138:0/1316822473 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63f00a79c0 con 0x7f64000cbe00 2024-04-26T20:58:02.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.104+0000 7f63ff400640 1 -- 172.21.15.138:0/1316822473 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f00a7d90 con 0x7f64000cbe00 2024-04-26T20:58:02.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.108+0000 7f6407000640 1 -- 172.21.15.138:0/1316822473 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64000cbe00 msgr2=0x7f640006de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:02.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.108+0000 7f6407000640 1 --2- 172.21.15.138:0/1316822473 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64000cbe00 0x7f640006de70 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f64000b6c50 tx=0x7f63f001ebf0 comp rx=0 tx=0).stop 2024-04-26T20:58:02.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.108+0000 7f6407000640 1 -- 172.21.15.138:0/1316822473 shutdown_connections 2024-04-26T20:58:02.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.108+0000 7f6407000640 1 --2- 172.21.15.138:0/1316822473 >> v2:172.21.15.143:3300/0 conn(0x7f64000cc1e0 0x7f6400073b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:02.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.108+0000 7f6407000640 1 --2- 172.21.15.138:0/1316822473 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64000cbe00 0x7f640006de70 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:02.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.108+0000 7f6407000640 1 -- 172.21.15.138:0/1316822473 >> 172.21.15.138:0/1316822473 conn(0x7f64000d0b20 msgr2=0x7f64000d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:02.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.108+0000 7f6407000640 1 -- 172.21.15.138:0/1316822473 shutdown_connections 2024-04-26T20:58:02.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.108+0000 7f6407000640 1 -- 172.21.15.138:0/1316822473 wait complete. 2024-04-26T20:58:02.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.108+0000 7f6407000640 1 Processor -- start 2024-04-26T20:58:02.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.108+0000 7f6407000640 1 -- start start 2024-04-26T20:58:02.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.108+0000 7f6407000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64000cbe00 0x7f64001f8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:02.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.108+0000 7f6407000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f64000cc1e0 0x7f6400156f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:02.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.108+0000 7f6407000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f64000ce6f0 0x7f64000b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:02.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.108+0000 7f6407000640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f64000741d0 con 0x7f64000cbe00 2024-04-26T20:58:02.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.108+0000 7f6407000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f6400074050 con 0x7f64000cc1e0 2024-04-26T20:58:02.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.108+0000 7f6407000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f64000d0780 con 0x7f64000ce6f0 2024-04-26T20:58:02.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.108+0000 7f63ffe00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64000cbe00 0x7f64001f8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:02.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.108+0000 7f63ffe00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64000cbe00 0x7f64001f8bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:53168/0 (socket says 172.21.15.138:53168) 2024-04-26T20:58:02.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.108+0000 7f63ffe00640 1 -- 172.21.15.138:0/3068264989 learned_addr learned my addr 172.21.15.138:0/3068264989 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:02.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.108+0000 7f63f7400640 1 --2- 172.21.15.138:0/3068264989 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f64000cc1e0 0x7f6400156f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:02.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.108+0000 7f6405000640 1 --2- 172.21.15.138:0/3068264989 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f64000ce6f0 0x7f64000b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:02.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.108+0000 7f63ffe00640 1 -- 172.21.15.138:0/3068264989 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f64000ce6f0 msgr2=0x7f64000b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:02.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.108+0000 7f63ffe00640 1 --2- 172.21.15.138:0/3068264989 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f64000ce6f0 0x7f64000b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:02.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.108+0000 7f63ffe00640 1 -- 172.21.15.138:0/3068264989 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f64000cc1e0 msgr2=0x7f6400156f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:02.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.108+0000 7f63ffe00640 1 --2- 172.21.15.138:0/3068264989 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f64000cc1e0 0x7f6400156f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:02.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.108+0000 7f63ffe00640 1 -- 172.21.15.138:0/3068264989 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64001f9110 con 0x7f64000cbe00 2024-04-26T20:58:02.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.112+0000 7f63ffe00640 1 --2- 172.21.15.138:0/3068264989 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64000cbe00 0x7f64001f8bd0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f63f000b2c0 tx=0x7f63f001d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:02.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.112+0000 7f63fcc00640 1 -- 172.21.15.138:0/3068264989 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f00bf070 con 0x7f64000cbe00 2024-04-26T20:58:02.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.112+0000 7f63fcc00640 1 -- 172.21.15.138:0/3068264989 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63f00af9d0 con 0x7f64000cbe00 2024-04-26T20:58:02.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.112+0000 7f63fcc00640 1 -- 172.21.15.138:0/3068264989 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f00b4070 con 0x7f64000cbe00 2024-04-26T20:58:02.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.112+0000 7f6407000640 1 -- 172.21.15.138:0/3068264989 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64000aebf0 con 0x7f64000cbe00 2024-04-26T20:58:02.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.112+0000 7f6407000640 1 -- 172.21.15.138:0/3068264989 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64000af1b0 con 0x7f64000cbe00 2024-04-26T20:58:02.114 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.112+0000 7f6407000640 1 -- 172.21.15.138:0/3068264989 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6400069510 con 0x7f64000cbe00 2024-04-26T20:58:02.114 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.112+0000 7f63fcc00640 1 -- 172.21.15.138:0/3068264989 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f63f00b93e0 con 0x7f64000cbe00 2024-04-26T20:58:02.114 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.112+0000 7f63fcc00640 1 --2- 172.21.15.138:0/3068264989 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f63dc068380 0x7f63dc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:02.115 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.112+0000 7f63fcc00640 1 -- 172.21.15.138:0/3068264989 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f63f0120dd0 con 0x7f64000cbe00 2024-04-26T20:58:02.115 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.112+0000 7f63f7400640 1 --2- 172.21.15.138:0/3068264989 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f63dc068380 0x7f63dc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:02.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.116+0000 7f63f7400640 1 --2- 172.21.15.138:0/3068264989 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f63dc068380 0x7f63dc06a840 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f640015df70 tx=0x7f63e8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:02.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.116+0000 7f63fcc00640 1 -- 172.21.15.138:0/3068264989 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f64001f9110 con 0x7f64000cbe00 2024-04-26T20:58:02.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.312+0000 7f6407000640 1 -- 172.21.15.138:0/3068264989 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f640015cc80 con 0x7f64000cbe00 2024-04-26T20:58:02.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.312+0000 7f63fcc00640 1 -- 172.21.15.138:0/3068264989 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5187 (secure 0 0 0) 0x7f63f0122070 con 0x7f64000cbe00 2024-04-26T20:58:02.313 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:02.313 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5158,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/593330829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":593330829},{"type":"v1","addr":"172.21.15.143:6837","nonce":593330829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5304,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/3236230135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":3236230135},{"type":"v1","addr":"172.21.15.138:6834","nonce":3236230135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5307,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/3539747566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":3539747566},{"type":"v1","addr":"172.21.15.138:6835","nonce":3539747566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:57:51.937789+0000","modified":"2024-04-26T20:57:54.956885+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5310},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5310":{"gid":5310,"name":"d","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6836/483370849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":483370849},{"type":"v1","addr":"172.21.15.143:6836","nonce":483370849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5310,"qdb_cluster":[5310]},"id":2}]} 2024-04-26T20:58:02.314 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 18 2024-04-26T20:58:02.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.312+0000 7f6407000640 1 -- 172.21.15.138:0/3068264989 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f63dc068380 msgr2=0x7f63dc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:02.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.312+0000 7f6407000640 1 --2- 172.21.15.138:0/3068264989 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f63dc068380 0x7f63dc06a840 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f640015df70 tx=0x7f63e8008040 comp rx=0 tx=0).stop 2024-04-26T20:58:02.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.312+0000 7f6407000640 1 -- 172.21.15.138:0/3068264989 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64000cbe00 msgr2=0x7f64001f8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:02.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.312+0000 7f6407000640 1 --2- 172.21.15.138:0/3068264989 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64000cbe00 0x7f64001f8bd0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f63f000b2c0 tx=0x7f63f001d430 comp rx=0 tx=0).stop 2024-04-26T20:58:02.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.312+0000 7f6407000640 1 -- 172.21.15.138:0/3068264989 shutdown_connections 2024-04-26T20:58:02.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.312+0000 7f6407000640 1 --2- 172.21.15.138:0/3068264989 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f63dc068380 0x7f63dc06a840 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:02.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.312+0000 7f6407000640 1 --2- 172.21.15.138:0/3068264989 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f64000ce6f0 0x7f64000b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:02.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.312+0000 7f6407000640 1 --2- 172.21.15.138:0/3068264989 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f64000cc1e0 0x7f6400156f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:02.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.312+0000 7f6407000640 1 --2- 172.21.15.138:0/3068264989 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64000cbe00 0x7f64001f8bd0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:02.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.312+0000 7f6407000640 1 -- 172.21.15.138:0/3068264989 >> 172.21.15.138:0/3068264989 conn(0x7f64000d0b20 msgr2=0x7f64000b5c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:02.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.312+0000 7f6407000640 1 -- 172.21.15.138:0/3068264989 shutdown_connections 2024-04-26T20:58:02.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.312+0000 7f6407000640 1 -- 172.21.15.138:0/3068264989 wait complete. 2024-04-26T20:58:02.736 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T20:57:51.937789+0000', 'modified': '2024-04-26T20:57:54.956885+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5310}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5310': {'gid': 5310, 'name': 'd', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.143:6836/483370849', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6834', 'nonce': 483370849}, {'type': 'v1', 'addr': '172.21.15.143:6836', 'nonce': 483370849}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5310, 'qdb_cluster': [5310]} 2024-04-26T20:58:02.737 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T20:58:02.737 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-26T20:58:02.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.872+0000 7fb20a000640 1 Processor -- start 2024-04-26T20:58:02.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.872+0000 7fb20a000640 1 -- start start 2024-04-26T20:58:02.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.872+0000 7fb20a000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb20415d0f0 0x7fb2040d1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:02.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.872+0000 7fb20a000640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2040d0570 con 0x7fb2040d0950 2024-04-26T20:58:02.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.872+0000 7fb20a000640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2040ce540 con 0x7fb2040b2280 2024-04-26T20:58:02.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.872+0000 7fb20a000640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fb2040d0e50 con 0x7fb20415d0f0 2024-04-26T20:58:02.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.876+0000 7fb203400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb20415d0f0 0x7fb2040d1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:02.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.876+0000 7fb203400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb20415d0f0 0x7fb2040d1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:53180/0 (socket says 172.21.15.138:53180) 2024-04-26T20:58:02.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.876+0000 7fb203400640 1 -- 172.21.15.138:0/753428278 learned_addr learned my addr 172.21.15.138:0/753428278 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:02.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.876+0000 7fb203e00640 1 --1- 172.21.15.138:0/753428278 >> v1:172.21.15.138:6789/0 conn(0x7fb2040d0950 0x7fb2040cfe60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:58888/0 (socket says 172.21.15.138:58888) 2024-04-26T20:58:02.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.876+0000 7fb203400640 1 -- 172.21.15.138:0/753428278 >> v1:172.21.15.143:6789/0 conn(0x7fb2040b2280 legacy=0x7fb2040cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:02.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.876+0000 7fb203400640 1 -- 172.21.15.138:0/753428278 >> v1:172.21.15.138:6789/0 conn(0x7fb2040d0950 legacy=0x7fb2040cfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:02.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.876+0000 7fb203400640 1 -- 172.21.15.138:0/753428278 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2040ce820 con 0x7fb20415d0f0 2024-04-26T20:58:02.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.876+0000 7fb203400640 1 --2- 172.21.15.138:0/753428278 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb20415d0f0 0x7fb2040d1010 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4009870 tx=0x7fb1f401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c27481d3d424f8f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:02.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.876+0000 7fb202a00640 1 -- 172.21.15.138:0/753428278 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f40b2070 con 0x7fb20415d0f0 2024-04-26T20:58:02.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.876+0000 7fb202a00640 1 -- 172.21.15.138:0/753428278 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1f40a9070 con 0x7fb20415d0f0 2024-04-26T20:58:02.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.876+0000 7fb202a00640 1 -- 172.21.15.138:0/753428278 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f40ad880 con 0x7fb20415d0f0 2024-04-26T20:58:02.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.880+0000 7fb20a000640 1 -- 172.21.15.138:0/753428278 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb20415d0f0 msgr2=0x7fb2040d1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:02.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.880+0000 7fb20a000640 1 --2- 172.21.15.138:0/753428278 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb20415d0f0 0x7fb2040d1010 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4009870 tx=0x7fb1f401c560 comp rx=0 tx=0).stop 2024-04-26T20:58:02.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.880+0000 7fb20a000640 1 -- 172.21.15.138:0/753428278 shutdown_connections 2024-04-26T20:58:02.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.880+0000 7fb20a000640 1 --2- 172.21.15.138:0/753428278 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb20415d0f0 0x7fb2040d1010 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:02.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.880+0000 7fb20a000640 1 -- 172.21.15.138:0/753428278 >> 172.21.15.138:0/753428278 conn(0x7fb2040d2d80 msgr2=0x7fb2040d3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:02.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.880+0000 7fb20a000640 1 -- 172.21.15.138:0/753428278 shutdown_connections 2024-04-26T20:58:02.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.880+0000 7fb20a000640 1 -- 172.21.15.138:0/753428278 wait complete. 2024-04-26T20:58:02.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.880+0000 7fb20a000640 1 Processor -- start 2024-04-26T20:58:02.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.880+0000 7fb20a000640 1 -- start start 2024-04-26T20:58:02.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.880+0000 7fb20a000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2040b2280 0x7fb20413dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:02.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.880+0000 7fb20a000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb2040d0950 0x7fb20409ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:02.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.880+0000 7fb20a000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb20415d0f0 0x7fb2040cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:02.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.880+0000 7fb20a000640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fb2040d18e0 con 0x7fb2040b2280 2024-04-26T20:58:02.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.880+0000 7fb20a000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fb2040d1760 con 0x7fb20415d0f0 2024-04-26T20:58:02.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.880+0000 7fb20a000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb20416b4d0 con 0x7fb2040d0950 2024-04-26T20:58:02.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.880+0000 7fb203400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2040b2280 0x7fb20413dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:02.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.880+0000 7fb203400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2040b2280 0x7fb20413dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:53186/0 (socket says 172.21.15.138:53186) 2024-04-26T20:58:02.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.880+0000 7fb203400640 1 -- 172.21.15.138:0/3183049866 learned_addr learned my addr 172.21.15.138:0/3183049866 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:02.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.880+0000 7fb1faa00640 1 --2- 172.21.15.138:0/3183049866 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb2040d0950 0x7fb20409ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:02.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.880+0000 7fb203e00640 1 --2- 172.21.15.138:0/3183049866 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb20415d0f0 0x7fb2040cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:02.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.880+0000 7fb203400640 1 -- 172.21.15.138:0/3183049866 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb2040d0950 msgr2=0x7fb20409ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:02.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.880+0000 7fb203400640 1 --2- 172.21.15.138:0/3183049866 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb2040d0950 0x7fb20409ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:02.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.880+0000 7fb203400640 1 -- 172.21.15.138:0/3183049866 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb20415d0f0 msgr2=0x7fb2040cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:02.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.880+0000 7fb203400640 1 --2- 172.21.15.138:0/3183049866 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb20415d0f0 0x7fb2040cc7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:02.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.880+0000 7fb203400640 1 -- 172.21.15.138:0/3183049866 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb20413e3e0 con 0x7fb2040b2280 2024-04-26T20:58:02.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.880+0000 7fb203e00640 1 --2- 172.21.15.138:0/3183049866 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb20415d0f0 0x7fb2040cc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:58:02.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.884+0000 7fb203400640 1 --2- 172.21.15.138:0/3183049866 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2040b2280 0x7fb20413dce0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb1f40b0040 tx=0x7fb1f401ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:02.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.884+0000 7fb1fbe00640 1 -- 172.21.15.138:0/3183049866 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f40bc020 con 0x7fb2040b2280 2024-04-26T20:58:02.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.884+0000 7fb1fbe00640 1 -- 172.21.15.138:0/3183049866 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1f40b8420 con 0x7fb2040b2280 2024-04-26T20:58:02.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.884+0000 7fb1fbe00640 1 -- 172.21.15.138:0/3183049866 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f40b2040 con 0x7fb2040b2280 2024-04-26T20:58:02.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.884+0000 7fb20a000640 1 -- 172.21.15.138:0/3183049866 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb20413e6c0 con 0x7fb2040b2280 2024-04-26T20:58:02.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.884+0000 7fb20a000640 1 -- 172.21.15.138:0/3183049866 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb20413ec80 con 0x7fb2040b2280 2024-04-26T20:58:02.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.884+0000 7fb1fbe00640 1 -- 172.21.15.138:0/3183049866 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb1f40bf020 con 0x7fb2040b2280 2024-04-26T20:58:02.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.884+0000 7fb1fbe00640 1 --2- 172.21.15.138:0/3183049866 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb1e0068380 0x7fb1e006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:02.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.888+0000 7fb1fbe00640 1 -- 172.21.15.138:0/3183049866 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fb1f4120ee0 con 0x7fb2040b2280 2024-04-26T20:58:02.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.888+0000 7fb1faa00640 1 --2- 172.21.15.138:0/3183049866 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb1e0068380 0x7fb1e006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:02.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.888+0000 7fb20d45f000 1 Processor -- start 2024-04-26T20:58:02.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.888+0000 7fb20d45f000 1 -- start start 2024-04-26T20:58:02.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.888+0000 7fb1faa00640 1 --2- 172.21.15.138:0/3183049866 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb1e0068380 0x7fb1e006a840 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb20409e490 tx=0x7fb1ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:02.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.888+0000 7fb20d45f000 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559174b04700 0x559174b04ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:02.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.888+0000 7fb20d45f000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559174b05020 0x559174abb200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:02.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.888+0000 7fb20d45f000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559174abb740 0x559174abbb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:02.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.888+0000 7fb20d45f000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x559174973140 con 0x559174b05020 2024-04-26T20:58:02.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.888+0000 7fb20d45f000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x559174908e00 con 0x559174abb740 2024-04-26T20:58:02.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.888+0000 7fb20d45f000 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x5591748c1a00 con 0x559174b04700 2024-04-26T20:58:02.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.888+0000 7fb1faa00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559174b05020 0x559174abb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:02.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.888+0000 7fb1faa00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559174b05020 0x559174abb200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:53194/0 (socket says 172.21.15.138:53194) 2024-04-26T20:58:02.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.888+0000 7fb1faa00640 1 -- 172.21.15.138:0/4230599436 learned_addr learned my addr 172.21.15.138:0/4230599436 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:02.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.888+0000 7fb203e00640 1 --2- 172.21.15.138:0/4230599436 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559174abb740 0x559174abbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:02.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.888+0000 7fb203400640 1 --2- 172.21.15.138:0/4230599436 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559174b04700 0x559174b04ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:02.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.888+0000 7fb1faa00640 1 -- 172.21.15.138:0/4230599436 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559174b04700 msgr2=0x559174b04ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:02.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.888+0000 7fb1faa00640 1 --2- 172.21.15.138:0/4230599436 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559174b04700 0x559174b04ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:02.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.888+0000 7fb1faa00640 1 -- 172.21.15.138:0/4230599436 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559174abb740 msgr2=0x559174abbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:02.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.888+0000 7fb1faa00640 1 --2- 172.21.15.138:0/4230599436 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559174abb740 0x559174abbb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:02.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.888+0000 7fb1faa00640 1 -- 172.21.15.138:0/4230599436 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591748c60e0 con 0x559174b05020 2024-04-26T20:58:02.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.888+0000 7fb1faa00640 1 --2- 172.21.15.138:0/4230599436 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559174b05020 0x559174abb200 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec005230 tx=0x7fb1ec011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e73452701b52e3ab server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:02.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.888+0000 7fb1f3e00640 1 -- 172.21.15.138:0/4230599436 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec021450 con 0x559174b05020 2024-04-26T20:58:02.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.888+0000 7fb1f3e00640 1 -- 172.21.15.138:0/4230599436 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1ec0215f0 con 0x559174b05020 2024-04-26T20:58:02.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.888+0000 7fb1f3e00640 1 -- 172.21.15.138:0/4230599436 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec0219c0 con 0x559174b05020 2024-04-26T20:58:02.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.888+0000 7fb20d45f000 1 -- 172.21.15.138:0/4230599436 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559174b05020 msgr2=0x559174abb200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:02.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.888+0000 7fb20d45f000 1 --2- 172.21.15.138:0/4230599436 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559174b05020 0x559174abb200 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec005230 tx=0x7fb1ec011000 comp rx=0 tx=0).stop 2024-04-26T20:58:02.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.888+0000 7fb20d45f000 1 -- 172.21.15.138:0/4230599436 shutdown_connections 2024-04-26T20:58:02.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.888+0000 7fb20d45f000 1 --2- 172.21.15.138:0/4230599436 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559174abb740 0x559174abbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:02.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.888+0000 7fb20d45f000 1 --2- 172.21.15.138:0/4230599436 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559174b05020 0x559174abb200 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:02.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.888+0000 7fb20d45f000 1 --2- 172.21.15.138:0/4230599436 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559174b04700 0x559174b04ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:02.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.888+0000 7fb20d45f000 1 -- 172.21.15.138:0/4230599436 >> 172.21.15.138:0/4230599436 conn(0x559174ab76f0 msgr2=0x559174ab9ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:02.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.888+0000 7fb20d45f000 1 -- 172.21.15.138:0/4230599436 shutdown_connections 2024-04-26T20:58:02.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.888+0000 7fb20d45f000 1 -- 172.21.15.138:0/4230599436 wait complete. 2024-04-26T20:58:02.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.888+0000 7fb20d45f000 1 -- start start 2024-04-26T20:58:02.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.892+0000 7fb20d45f000 1 Processor -- start 2024-04-26T20:58:02.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.892+0000 7fb20d45f000 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559174abb740 0x559174b0fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:02.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.892+0000 7fb20d45f000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559174b04700 0x559174b101f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:02.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.892+0000 7fb20d45f000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559174b05020 0x559174af68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:02.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.892+0000 7fb20d45f000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x559174916200 con 0x559174b05020 2024-04-26T20:58:02.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.892+0000 7fb20d45f000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x5591748ace80 con 0x559174b04700 2024-04-26T20:58:02.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.892+0000 7fb20d45f000 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x559174903ae0 con 0x559174abb740 2024-04-26T20:58:02.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.892+0000 7fb20d45f000 10 client.0 _ll_register_callbacks cb 0x559174915da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:58:02.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.892+0000 7fb203e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559174b05020 0x559174af68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:02.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.892+0000 7fb203e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559174b05020 0x559174af68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:53206/0 (socket says 172.21.15.138:53206) 2024-04-26T20:58:02.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.892+0000 7fb203e00640 1 -- 172.21.15.138:0/3495391703 learned_addr learned my addr 172.21.15.138:0/3495391703 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:02.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.892+0000 7fb1faa00640 1 --2- 172.21.15.138:0/3495391703 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559174b04700 0x559174b101f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:02.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.892+0000 7fb203e00640 1 -- 172.21.15.138:0/3495391703 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559174abb740 msgr2=0x559174b0fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:02.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.892+0000 7fb203e00640 1 --2- 172.21.15.138:0/3495391703 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559174abb740 0x559174b0fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:02.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.892+0000 7fb203e00640 1 -- 172.21.15.138:0/3495391703 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559174b04700 msgr2=0x559174b101f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:02.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.892+0000 7fb203e00640 1 --2- 172.21.15.138:0/3495391703 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559174b04700 0x559174b101f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:02.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.892+0000 7fb203e00640 1 -- 172.21.15.138:0/3495391703 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591748a84e0 con 0x559174b05020 2024-04-26T20:58:02.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.892+0000 7fb1faa00640 1 --2- 172.21.15.138:0/3495391703 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559174b04700 0x559174b101f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:58:02.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.892+0000 7fb203e00640 1 --2- 172.21.15.138:0/3495391703 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559174b05020 0x559174af68a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc007b80 tx=0x7fb1fc0019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e14e1bc818d688e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:02.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.892+0000 7fb1f0c00640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-04-26T20:58:02.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.892+0000 7fb1f0c00640 1 -- 172.21.15.138:0/3495391703 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc013570 con 0x559174b05020 2024-04-26T20:58:02.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.892+0000 7fb1f0c00640 1 -- 172.21.15.138:0/3495391703 <== mon.0 v2:172.21.15.138:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fb1fc013710 con 0x559174b05020 2024-04-26T20:58:02.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.892+0000 7fb20d45f000 1 -- 172.21.15.138:0/3495391703 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb1ec0215f0 con 0x559174b05020 2024-04-26T20:58:02.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.892+0000 7fb1f0c00640 1 -- 172.21.15.138:0/3495391703 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fb1fc021050 con 0x559174b05020 2024-04-26T20:58:02.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.892+0000 7fb20d45f000 10 client.5517 fetch_fsmap learned FSMap version 18 2024-04-26T20:58:02.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.892+0000 7fb20d45f000 1 -- 172.21.15.138:0/3495391703 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55917488ee80 con 0x559174b05020 2024-04-26T20:58:02.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.892+0000 7fb1f0c00640 1 -- 172.21.15.138:0/3495391703 <== mon.0 v2:172.21.15.138:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1ec0215f0 con 0x559174b05020 2024-04-26T20:58:02.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.892+0000 7fb1f0c00640 1 -- 172.21.15.138:0/3495391703 <== mon.0 v2:172.21.15.138:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7fb1fc024020 con 0x559174b05020 2024-04-26T20:58:02.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.892+0000 7fb20d45f000 10 client.5517 fetch_fsmap finished waiting for FSMap version 18 2024-04-26T20:58:02.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.892+0000 7fb20d45f000 10 client.5517 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-26T20:58:02.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.892+0000 7fb20d45f000 20 client.5517 populate_metadata read hostname 'smithi138' 2024-04-26T20:58:02.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.892+0000 7fb20d45f000 1 --2- 172.21.15.138:0/3495391703 >> [v2:172.21.15.143:6834/483370849,v1:172.21.15.143:6836/483370849] conn(0x559174af7640 0x559174af7a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:02.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.892+0000 7fb20d45f000 4 client.5517 mds_command: new command op to 5310 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:58:02.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.892+0000 7fb20d45f000 1 -- 172.21.15.138:0/3495391703 --> [v2:172.21.15.143:6834/483370849,v1:172.21.15.143:6836/483370849] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5591748a1bc0 con 0x559174af7640 2024-04-26T20:58:02.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.892+0000 7fb203400640 1 --2- 172.21.15.138:0/3495391703 >> [v2:172.21.15.143:6834/483370849,v1:172.21.15.143:6836/483370849] conn(0x559174af7640 0x559174af7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:02.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.892+0000 7fb203400640 1 --2- 172.21.15.138:0/3495391703 >> [v2:172.21.15.143:6834/483370849,v1:172.21.15.143:6836/483370849] conn(0x559174af7640 0x559174af7a20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa7560aa766903d4 server_cookie=8043ec7dd5a8e3e3 in_seq=0 out_seq=0 2024-04-26T20:58:02.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.892+0000 7fb1f0c00640 10 client.5517 ms_handle_connect on v2:172.21.15.143:6834/483370849 2024-04-26T20:58:02.900 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.896+0000 7fb1f0c00640 1 -- 172.21.15.138:0/3495391703 <== mds.0 v2:172.21.15.143:6834/483370849 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5591748a1bc0 con 0x559174af7640 2024-04-26T20:58:02.900 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.896+0000 7fb1f0c00640 10 client.5517 handle_command_reply: tid=0 2024-04-26T20:58:02.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.896+0000 7fb20d45f000 1 client.5517 shutdown 2024-04-26T20:58:02.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.896+0000 7fb20d45f000 1 -- 172.21.15.138:0/3495391703 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559174b05020 msgr2=0x559174af68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:02.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.896+0000 7fb20d45f000 1 --2- 172.21.15.138:0/3495391703 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559174b05020 0x559174af68a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc007b80 tx=0x7fb1fc0019b0 comp rx=0 tx=0).stop 2024-04-26T20:58:02.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.896+0000 7fb20d45f000 1 -- 172.21.15.138:0/3495391703 shutdown_connections 2024-04-26T20:58:02.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.896+0000 7fb20d45f000 1 --2- 172.21.15.138:0/3495391703 >> [v2:172.21.15.143:6834/483370849,v1:172.21.15.143:6836/483370849] conn(0x559174af7640 0x559174af7a20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:02.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.896+0000 7fb20d45f000 1 --2- 172.21.15.138:0/3495391703 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559174b05020 0x559174af68a0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:02.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.896+0000 7fb20d45f000 1 --2- 172.21.15.138:0/3495391703 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559174b04700 0x559174b101f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:02.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.896+0000 7fb1f0c00640 0 client.5517 ms_handle_reset on v2:172.21.15.143:6834/483370849 2024-04-26T20:58:02.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.896+0000 7fb20d45f000 1 --2- 172.21.15.138:0/3495391703 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559174abb740 0x559174b0fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:02.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.896+0000 7fb20d45f000 1 -- 172.21.15.138:0/3495391703 >> 172.21.15.138:0/3495391703 conn(0x559174ab76f0 msgr2=0x559174aba370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:02.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.896+0000 7fb20d45f000 1 -- 172.21.15.138:0/3495391703 shutdown_connections 2024-04-26T20:58:02.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.896+0000 7fb20d45f000 1 -- 172.21.15.138:0/3495391703 wait complete. 2024-04-26T20:58:02.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.896+0000 7fb20d45f000 20 client.5517 trim_cache size 0 max 16384 2024-04-26T20:58:02.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.912+0000 7fb20d45f000 1 Processor -- start 2024-04-26T20:58:02.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.912+0000 7fb20d45f000 1 -- start start 2024-04-26T20:58:02.916 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.912+0000 7fb20d45f000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559174abb740 0x559174b15f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:02.916 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.912+0000 7fb20d45f000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559174b04700 0x559174b16450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:02.916 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.912+0000 7fb20d45f000 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559174b05020 0x559174b11cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:02.916 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.912+0000 7fb20d45f000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fb20406ec70 con 0x559174abb740 2024-04-26T20:58:02.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.912+0000 7fb20d45f000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fb20409ede0 con 0x559174b04700 2024-04-26T20:58:02.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.912+0000 7fb20d45f000 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb20406e620 con 0x559174b05020 2024-04-26T20:58:02.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.912+0000 7fb203400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559174abb740 0x559174b15f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:02.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.912+0000 7fb203400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559174abb740 0x559174b15f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:53220/0 (socket says 172.21.15.138:53220) 2024-04-26T20:58:02.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.912+0000 7fb203400640 1 -- 172.21.15.138:0/3551773967 learned_addr learned my addr 172.21.15.138:0/3551773967 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:02.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.916+0000 7fb203400640 1 -- 172.21.15.138:0/3551773967 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559174b05020 msgr2=0x559174b11cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:02.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.916+0000 7fb203400640 1 --2- 172.21.15.138:0/3551773967 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559174b05020 0x559174b11cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:02.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.916+0000 7fb203400640 1 -- 172.21.15.138:0/3551773967 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559174b04700 msgr2=0x559174b16450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:02.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.916+0000 7fb1faa00640 1 --2- 172.21.15.138:0/3551773967 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559174b04700 0x559174b16450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:02.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.916+0000 7fb203400640 1 --2- 172.21.15.138:0/3551773967 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559174b04700 0x559174b16450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:02.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.916+0000 7fb203400640 1 -- 172.21.15.138:0/3551773967 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591748c1c50 con 0x559174abb740 2024-04-26T20:58:02.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.916+0000 7fb1faa00640 1 --2- 172.21.15.138:0/3551773967 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559174b04700 0x559174b16450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:58:02.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.916+0000 7fb203400640 1 --2- 172.21.15.138:0/3551773967 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559174abb740 0x559174b15f10 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb1f40ed060 tx=0x7fb1f40a4f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b00803a0fc5294d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:02.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.916+0000 7fb1f3400640 1 -- 172.21.15.138:0/3551773967 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f40f4fb0 con 0x559174abb740 2024-04-26T20:58:02.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.916+0000 7fb1f3400640 1 -- 172.21.15.138:0/3551773967 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1f40a9040 con 0x559174abb740 2024-04-26T20:58:02.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.916+0000 7fb1f3400640 1 -- 172.21.15.138:0/3551773967 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f40f97e0 con 0x559174abb740 2024-04-26T20:58:02.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.916+0000 7fb20d45f000 1 -- 172.21.15.138:0/3551773967 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559174abb740 msgr2=0x559174b15f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:02.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.916+0000 7fb20d45f000 1 --2- 172.21.15.138:0/3551773967 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559174abb740 0x559174b15f10 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb1f40ed060 tx=0x7fb1f40a4f90 comp rx=0 tx=0).stop 2024-04-26T20:58:02.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.916+0000 7fb20d45f000 1 -- 172.21.15.138:0/3551773967 shutdown_connections 2024-04-26T20:58:02.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.916+0000 7fb20d45f000 1 --2- 172.21.15.138:0/3551773967 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559174b05020 0x559174b11cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:02.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.916+0000 7fb20d45f000 1 --2- 172.21.15.138:0/3551773967 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559174b04700 0x559174b16450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:02.922 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.916+0000 7fb20d45f000 1 --2- 172.21.15.138:0/3551773967 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559174abb740 0x559174b15f10 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:02.922 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.916+0000 7fb20d45f000 1 -- 172.21.15.138:0/3551773967 >> 172.21.15.138:0/3551773967 conn(0x559174ab76f0 msgr2=0x559174ac09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:02.922 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.916+0000 7fb20d45f000 1 -- 172.21.15.138:0/3551773967 shutdown_connections 2024-04-26T20:58:02.922 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.916+0000 7fb20d45f000 1 -- 172.21.15.138:0/3551773967 wait complete. 2024-04-26T20:58:02.922 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.916+0000 7fb20d45f000 1 -- start start 2024-04-26T20:58:02.922 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.916+0000 7fb20d45f000 1 Processor -- start 2024-04-26T20:58:02.922 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.916+0000 7fb20d45f000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559174abb740 0x559174b14010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:02.922 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.916+0000 7fb20d45f000 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559174b04700 0x559174b14550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:02.922 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.916+0000 7fb20d45f000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559174b05020 0x559174b14a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:02.922 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.916+0000 7fb20d45f000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x559174908110 con 0x559174abb740 2024-04-26T20:58:02.922 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.916+0000 7fb20d45f000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55917489e7b0 con 0x559174b05020 2024-04-26T20:58:02.922 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.916+0000 7fb20d45f000 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55917490d430 con 0x559174b04700 2024-04-26T20:58:02.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.916+0000 7fb20d45f000 10 client.0 _ll_register_callbacks cb 0x7fb1fc005ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:58:02.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.916+0000 7fb203400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559174abb740 0x559174b14010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:02.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.916+0000 7fb203400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559174abb740 0x559174b14010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:53228/0 (socket says 172.21.15.138:53228) 2024-04-26T20:58:02.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.916+0000 7fb203400640 1 -- 172.21.15.138:0/1404720035 learned_addr learned my addr 172.21.15.138:0/1404720035 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:02.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.916+0000 7fb1faa00640 1 --2- 172.21.15.138:0/1404720035 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559174b04700 0x559174b14550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:02.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.916+0000 7fb203e00640 1 --2- 172.21.15.138:0/1404720035 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559174b05020 0x559174b14a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:02.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.916+0000 7fb203400640 1 -- 172.21.15.138:0/1404720035 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559174b04700 msgr2=0x559174b14550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:02.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.916+0000 7fb203400640 1 --2- 172.21.15.138:0/1404720035 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559174b04700 0x559174b14550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:02.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.916+0000 7fb203400640 1 -- 172.21.15.138:0/1404720035 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559174b05020 msgr2=0x559174b14a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:02.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.916+0000 7fb203400640 1 --2- 172.21.15.138:0/1404720035 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559174b05020 0x559174b14a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:02.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.916+0000 7fb203400640 1 -- 172.21.15.138:0/1404720035 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55917498b160 con 0x559174abb740 2024-04-26T20:58:02.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.920+0000 7fb203400640 1 --2- 172.21.15.138:0/1404720035 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559174abb740 0x559174b14010 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb1f40ed060 tx=0x7fb1f40c3040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22f9f80d86314394 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:02.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.920+0000 7fb1f0c00640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-04-26T20:58:02.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.920+0000 7fb1f0c00640 1 -- 172.21.15.138:0/1404720035 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f40f4fb0 con 0x559174abb740 2024-04-26T20:58:02.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.920+0000 7fb1f0c00640 1 -- 172.21.15.138:0/1404720035 <== mon.0 v2:172.21.15.138:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fb1f411f2f0 con 0x559174abb740 2024-04-26T20:58:02.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.920+0000 7fb20d45f000 1 -- 172.21.15.138:0/1404720035 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb1f40a9040 con 0x559174abb740 2024-04-26T20:58:02.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.920+0000 7fb1f0c00640 1 -- 172.21.15.138:0/1404720035 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fb1f40ed270 con 0x559174abb740 2024-04-26T20:58:02.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.920+0000 7fb20d45f000 10 client.5523 fetch_fsmap learned FSMap version 18 2024-04-26T20:58:02.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.920+0000 7fb20d45f000 1 -- 172.21.15.138:0/1404720035 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x5591745c20c0 con 0x559174abb740 2024-04-26T20:58:02.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.920+0000 7fb1f0c00640 1 -- 172.21.15.138:0/1404720035 <== mon.0 v2:172.21.15.138:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1f40a9040 con 0x559174abb740 2024-04-26T20:58:02.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.920+0000 7fb1f0c00640 1 -- 172.21.15.138:0/1404720035 <== mon.0 v2:172.21.15.138:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7fb1f40b5030 con 0x559174abb740 2024-04-26T20:58:02.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.920+0000 7fb20d45f000 10 client.5523 fetch_fsmap finished waiting for FSMap version 18 2024-04-26T20:58:02.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.920+0000 7fb20d45f000 10 client.5523 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-26T20:58:02.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.920+0000 7fb20d45f000 20 client.5523 populate_metadata read hostname 'smithi138' 2024-04-26T20:58:02.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.920+0000 7fb20d45f000 1 --2- 172.21.15.138:0/1404720035 >> [v2:172.21.15.143:6834/483370849,v1:172.21.15.143:6836/483370849] conn(0x559174b7d8c0 0x559174b7fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:02.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.920+0000 7fb20d45f000 4 client.5523 mds_command: new command op to 5310 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T20:58:02.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.920+0000 7fb20d45f000 1 -- 172.21.15.138:0/1404720035 --> [v2:172.21.15.143:6834/483370849,v1:172.21.15.143:6836/483370849] -- command(tid 0: {"prefix": "status"}) -- 0x559174916a10 con 0x559174b7d8c0 2024-04-26T20:58:02.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.920+0000 7fb1faa00640 1 --2- 172.21.15.138:0/1404720035 >> [v2:172.21.15.143:6834/483370849,v1:172.21.15.143:6836/483370849] conn(0x559174b7d8c0 0x559174b7fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:02.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.920+0000 7fb1faa00640 1 --2- 172.21.15.138:0/1404720035 >> [v2:172.21.15.143:6834/483370849,v1:172.21.15.143:6836/483370849] conn(0x559174b7d8c0 0x559174b7fcb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a794e76da384244 server_cookie=bd95380528cfd1bf in_seq=0 out_seq=0 2024-04-26T20:58:02.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.920+0000 7fb1f0c00640 10 client.5523 ms_handle_connect on v2:172.21.15.143:6834/483370849 2024-04-26T20:58:02.926 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.920+0000 7fb1f0c00640 1 -- 172.21.15.138:0/1404720035 <== mds.0 v2:172.21.15.143:6834/483370849 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x559174916a10 con 0x559174b7d8c0 2024-04-26T20:58:02.926 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.920+0000 7fb1f0c00640 10 client.5523 handle_command_reply: tid=0 2024-04-26T20:58:02.926 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.920+0000 7fb20d45f000 1 client.5523 shutdown 2024-04-26T20:58:02.926 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.920+0000 7fb20d45f000 1 -- 172.21.15.138:0/1404720035 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559174abb740 msgr2=0x559174b14010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:02.926 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.920+0000 7fb20d45f000 1 --2- 172.21.15.138:0/1404720035 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559174abb740 0x559174b14010 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb1f40ed060 tx=0x7fb1f40c3040 comp rx=0 tx=0).stop 2024-04-26T20:58:02.926 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.920+0000 7fb20d45f000 1 -- 172.21.15.138:0/1404720035 shutdown_connections 2024-04-26T20:58:02.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.920+0000 7fb20d45f000 1 --2- 172.21.15.138:0/1404720035 >> [v2:172.21.15.143:6834/483370849,v1:172.21.15.143:6836/483370849] conn(0x559174b7d8c0 0x559174b7fcb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:02.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.920+0000 7fb20d45f000 1 --2- 172.21.15.138:0/1404720035 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559174b05020 0x559174b14a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:02.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.920+0000 7fb20d45f000 1 --2- 172.21.15.138:0/1404720035 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559174b04700 0x559174b14550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:02.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.920+0000 7fb1f0c00640 0 client.5523 ms_handle_reset on v2:172.21.15.143:6834/483370849 2024-04-26T20:58:02.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.920+0000 7fb20d45f000 1 --2- 172.21.15.138:0/1404720035 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559174abb740 0x559174b14010 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:02.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.920+0000 7fb20d45f000 1 -- 172.21.15.138:0/1404720035 >> 172.21.15.138:0/1404720035 conn(0x559174ab76f0 msgr2=0x559174b1ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:02.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.920+0000 7fb20d45f000 1 -- 172.21.15.138:0/1404720035 shutdown_connections 2024-04-26T20:58:02.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.920+0000 7fb20d45f000 1 -- 172.21.15.138:0/1404720035 wait complete. 2024-04-26T20:58:02.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.920+0000 7fb20d45f000 20 client.5523 trim_cache size 0 max 16384 2024-04-26T20:58:02.927 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-26T20:58:02.928 INFO:teuthology.orchestra.run.smithi138.stdout: "cluster_fsid": "c22b4730-12cc-4558-8535-b965384398c0", 2024-04-26T20:58:02.928 INFO:teuthology.orchestra.run.smithi138.stdout: "whoami": 0, 2024-04-26T20:58:02.928 INFO:teuthology.orchestra.run.smithi138.stdout: "id": 5310, 2024-04-26T20:58:02.928 INFO:teuthology.orchestra.run.smithi138.stdout: "want_state": "up:active", 2024-04-26T20:58:02.928 INFO:teuthology.orchestra.run.smithi138.stdout: "state": "up:active", 2024-04-26T20:58:02.928 INFO:teuthology.orchestra.run.smithi138.stdout: "fs_name": "cephfs", 2024-04-26T20:58:02.928 INFO:teuthology.orchestra.run.smithi138.stdout: "rank_uptime": 10.371485235, 2024-04-26T20:58:02.928 INFO:teuthology.orchestra.run.smithi138.stdout: "mdsmap_epoch": 18, 2024-04-26T20:58:02.928 INFO:teuthology.orchestra.run.smithi138.stdout: "osdmap_epoch": 41, 2024-04-26T20:58:02.928 INFO:teuthology.orchestra.run.smithi138.stdout: "osdmap_epoch_barrier": 41, 2024-04-26T20:58:02.928 INFO:teuthology.orchestra.run.smithi138.stdout: "uptime": 18.233121197999999 2024-04-26T20:58:02.928 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-26T20:58:02.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.920+0000 7fb20a000640 1 -- 172.21.15.138:0/3183049866 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb1e0068380 msgr2=0x7fb1e006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:02.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.920+0000 7fb20a000640 1 --2- 172.21.15.138:0/3183049866 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb1e0068380 0x7fb1e006a840 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb20409e490 tx=0x7fb1ec009040 comp rx=0 tx=0).stop 2024-04-26T20:58:02.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.920+0000 7fb20a000640 1 -- 172.21.15.138:0/3183049866 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2040b2280 msgr2=0x7fb20413dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:02.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.920+0000 7fb20a000640 1 --2- 172.21.15.138:0/3183049866 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2040b2280 0x7fb20413dce0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb1f40b0040 tx=0x7fb1f401ada0 comp rx=0 tx=0).stop 2024-04-26T20:58:02.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.920+0000 7fb20a000640 1 -- 172.21.15.138:0/3183049866 shutdown_connections 2024-04-26T20:58:02.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.920+0000 7fb20a000640 1 --2- 172.21.15.138:0/3183049866 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb1e0068380 0x7fb1e006a840 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:02.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.920+0000 7fb20a000640 1 --2- 172.21.15.138:0/3183049866 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb20415d0f0 0x7fb2040cc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:02.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.920+0000 7fb20a000640 1 --2- 172.21.15.138:0/3183049866 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb2040d0950 0x7fb20409ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:02.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.920+0000 7fb20a000640 1 --2- 172.21.15.138:0/3183049866 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2040b2280 0x7fb20413dce0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:02.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.920+0000 7fb20a000640 1 -- 172.21.15.138:0/3183049866 >> 172.21.15.138:0/3183049866 conn(0x7fb2040d2d80 msgr2=0x7fb2040b1280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:02.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.924+0000 7fb20a000640 1 -- 172.21.15.138:0/3183049866 shutdown_connections 2024-04-26T20:58:02.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:02.924+0000 7fb20a000640 1 -- 172.21.15.138:0/3183049866 wait complete. 2024-04-26T20:58:02.942 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T20:58:03.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.076+0000 7f5911200640 1 Processor -- start 2024-04-26T20:58:03.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.076+0000 7f5911200640 1 -- start start 2024-04-26T20:58:03.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.076+0000 7f5911200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f590c0b2280 0x7f590c0b2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:03.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.076+0000 7f5911200640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f590c0ce540 con 0x7f590c0d1720 2024-04-26T20:58:03.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.076+0000 7f5911200640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f590c0ce820 con 0x7f590c15d0f0 2024-04-26T20:58:03.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.076+0000 7f5911200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f590c0d0e50 con 0x7f590c0b2280 2024-04-26T20:58:03.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.076+0000 7f590a800640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f590c0d1720 0x7f590c0b30b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:58894/0 (socket says 172.21.15.138:58894) 2024-04-26T20:58:03.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.076+0000 7f590a800640 1 -- 172.21.15.138:0/16531782 learned_addr learned my addr 172.21.15.138:0/16531782 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:03.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.080+0000 7f5903e00640 1 --2- 172.21.15.138:0/16531782 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f590c0b2280 0x7f590c0b2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:03.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.080+0000 7f5909400640 1 -- 172.21.15.138:0/16531782 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2982579765 0 0) 0x7f590c0ce540 con 0x7f590c0d1720 2024-04-26T20:58:03.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.080+0000 7f5903e00640 1 -- 172.21.15.138:0/16531782 >> v1:172.21.15.143:6789/0 conn(0x7f590c15d0f0 legacy=0x7f590c0d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:03.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.080+0000 7f5903e00640 1 -- 172.21.15.138:0/16531782 >> v1:172.21.15.138:6789/0 conn(0x7f590c0d1720 legacy=0x7f590c0b30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:03.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.080+0000 7f5903e00640 1 -- 172.21.15.138:0/16531782 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f590c0ceb00 con 0x7f590c0b2280 2024-04-26T20:58:03.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.080+0000 7f5903e00640 1 --2- 172.21.15.138:0/16531782 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f590c0b2280 0x7f590c0b2b70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f58f4009770 tx=0x7f58f401c310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=614d1ccc9608a4aa server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:03.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.080+0000 7f5909400640 1 -- 172.21.15.138:0/16531782 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f40b0070 con 0x7f590c0b2280 2024-04-26T20:58:03.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.080+0000 7f5909400640 1 -- 172.21.15.138:0/16531782 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58f40ab600 con 0x7f590c0b2280 2024-04-26T20:58:03.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.080+0000 7f5909400640 1 -- 172.21.15.138:0/16531782 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f40ab9d0 con 0x7f590c0b2280 2024-04-26T20:58:03.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.084+0000 7f5911200640 1 -- 172.21.15.138:0/16531782 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f590c0b2280 msgr2=0x7f590c0b2b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:03.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.084+0000 7f5911200640 1 --2- 172.21.15.138:0/16531782 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f590c0b2280 0x7f590c0b2b70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f58f4009770 tx=0x7f58f401c310 comp rx=0 tx=0).stop 2024-04-26T20:58:03.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.084+0000 7f5911200640 1 -- 172.21.15.138:0/16531782 shutdown_connections 2024-04-26T20:58:03.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.084+0000 7f5911200640 1 --2- 172.21.15.138:0/16531782 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f590c0b2280 0x7f590c0b2b70 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:03.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.084+0000 7f5911200640 1 -- 172.21.15.138:0/16531782 >> 172.21.15.138:0/16531782 conn(0x7f590c0d2d80 msgr2=0x7f590c0d3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:03.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.084+0000 7f5911200640 1 -- 172.21.15.138:0/16531782 shutdown_connections 2024-04-26T20:58:03.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.084+0000 7f5911200640 1 -- 172.21.15.138:0/16531782 wait complete. 2024-04-26T20:58:03.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.084+0000 7f5911200640 1 Processor -- start 2024-04-26T20:58:03.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.084+0000 7f5911200640 1 -- start start 2024-04-26T20:58:03.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.084+0000 7f5911200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f590c0b2280 0x7f590c15ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:03.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.084+0000 7f5911200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f590c0d1720 0x7f590c0cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:03.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.084+0000 7f5911200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f590c15d0f0 0x7f590c154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:03.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.084+0000 7f5911200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f590c16b050 con 0x7f590c15d0f0 2024-04-26T20:58:03.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.084+0000 7f5911200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f590c16aed0 con 0x7f590c0d1720 2024-04-26T20:58:03.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.084+0000 7f5911200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f590c16b1d0 con 0x7f590c0b2280 2024-04-26T20:58:03.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.084+0000 7f590a800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f590c15d0f0 0x7f590c154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:03.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.084+0000 7f590a800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f590c15d0f0 0x7f590c154ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:53238/0 (socket says 172.21.15.138:53238) 2024-04-26T20:58:03.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.084+0000 7f590a800640 1 -- 172.21.15.138:0/3525521466 learned_addr learned my addr 172.21.15.138:0/3525521466 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:03.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.084+0000 7f5903e00640 1 --2- 172.21.15.138:0/3525521466 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f590c0d1720 0x7f590c0cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:03.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.084+0000 7f5909e00640 1 --2- 172.21.15.138:0/3525521466 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f590c0b2280 0x7f590c15ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:03.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.084+0000 7f590a800640 1 -- 172.21.15.138:0/3525521466 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f590c0b2280 msgr2=0x7f590c15ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:03.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.084+0000 7f590a800640 1 --2- 172.21.15.138:0/3525521466 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f590c0b2280 0x7f590c15ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:03.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.084+0000 7f590a800640 1 -- 172.21.15.138:0/3525521466 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f590c0d1720 msgr2=0x7f590c0cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:03.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.084+0000 7f590a800640 1 --2- 172.21.15.138:0/3525521466 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f590c0d1720 0x7f590c0cbff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:03.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.084+0000 7f590a800640 1 -- 172.21.15.138:0/3525521466 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f590c06e300 con 0x7f590c15d0f0 2024-04-26T20:58:03.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.088+0000 7f590a800640 1 --2- 172.21.15.138:0/3525521466 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f590c15d0f0 0x7f590c154ea0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f590400c7d0 tx=0x7f590400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:03.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.088+0000 7f5902000640 1 -- 172.21.15.138:0/3525521466 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5904018070 con 0x7f590c15d0f0 2024-04-26T20:58:03.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.088+0000 7f5902000640 1 -- 172.21.15.138:0/3525521466 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f590400a640 con 0x7f590c15d0f0 2024-04-26T20:58:03.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.088+0000 7f5911200640 1 -- 172.21.15.138:0/3525521466 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f590c06e5e0 con 0x7f590c15d0f0 2024-04-26T20:58:03.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.088+0000 7f5902000640 1 -- 172.21.15.138:0/3525521466 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f590400aa70 con 0x7f590c15d0f0 2024-04-26T20:58:03.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.088+0000 7f5911200640 1 -- 172.21.15.138:0/3525521466 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f590c06eba0 con 0x7f590c15d0f0 2024-04-26T20:58:03.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.088+0000 7f5911200640 1 -- 172.21.15.138:0/3525521466 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f590c156920 con 0x7f590c15d0f0 2024-04-26T20:58:03.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.088+0000 7f5902000640 1 -- 172.21.15.138:0/3525521466 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f590401b070 con 0x7f590c15d0f0 2024-04-26T20:58:03.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.088+0000 7f5902000640 1 --2- 172.21.15.138:0/3525521466 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f58e80683b0 0x7f58e806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:03.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.088+0000 7f5902000640 1 -- 172.21.15.138:0/3525521466 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f59040861a0 con 0x7f590c15d0f0 2024-04-26T20:58:03.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.092+0000 7f5909e00640 1 --2- 172.21.15.138:0/3525521466 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f58e80683b0 0x7f58e806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:03.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.092+0000 7f5909e00640 1 --2- 172.21.15.138:0/3525521466 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f58e80683b0 0x7f58e806a870 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f58fc007fd0 tx=0x7f58fc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:03.095 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.096+0000 7f5902000640 1 -- 172.21.15.138:0/3525521466 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5904055e50 con 0x7f590c15d0f0 2024-04-26T20:58:03.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.288+0000 7f5911200640 1 -- 172.21.15.138:0/3525521466 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f590c069510 con 0x7f590c15d0f0 2024-04-26T20:58:03.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.288+0000 7f5902000640 1 -- 172.21.15.138:0/3525521466 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) ==== 53+0+73 (secure 0 0 0) 0x7f590405a150 con 0x7f590c15d0f0 2024-04-26T20:58:03.289 INFO:teuthology.orchestra.run.smithi138.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T20:58:03.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.288+0000 7f5911200640 1 -- 172.21.15.138:0/3525521466 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f58e80683b0 msgr2=0x7f58e806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:03.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.288+0000 7f5911200640 1 --2- 172.21.15.138:0/3525521466 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f58e80683b0 0x7f58e806a870 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f58fc007fd0 tx=0x7f58fc009040 comp rx=0 tx=0).stop 2024-04-26T20:58:03.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.288+0000 7f5911200640 1 -- 172.21.15.138:0/3525521466 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f590c15d0f0 msgr2=0x7f590c154ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:03.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.288+0000 7f5911200640 1 --2- 172.21.15.138:0/3525521466 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f590c15d0f0 0x7f590c154ea0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f590400c7d0 tx=0x7f590400cc90 comp rx=0 tx=0).stop 2024-04-26T20:58:03.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.288+0000 7f5911200640 1 -- 172.21.15.138:0/3525521466 shutdown_connections 2024-04-26T20:58:03.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.288+0000 7f5911200640 1 --2- 172.21.15.138:0/3525521466 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f58e80683b0 0x7f58e806a870 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:03.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.288+0000 7f5911200640 1 --2- 172.21.15.138:0/3525521466 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f590c15d0f0 0x7f590c154ea0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:03.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.288+0000 7f5911200640 1 --2- 172.21.15.138:0/3525521466 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f590c0d1720 0x7f590c0cbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:03.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.288+0000 7f5911200640 1 --2- 172.21.15.138:0/3525521466 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f590c0b2280 0x7f590c15ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:03.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.288+0000 7f5911200640 1 -- 172.21.15.138:0/3525521466 >> 172.21.15.138:0/3525521466 conn(0x7f590c0d2d80 msgr2=0x7f590c0b0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:03.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.288+0000 7f5911200640 1 -- 172.21.15.138:0/3525521466 shutdown_connections 2024-04-26T20:58:03.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03.288+0000 7f5911200640 1 -- 172.21.15.138:0/3525521466 wait complete. 2024-04-26T20:58:03.310 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-26T20:58:03.310 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T20:58:03.310 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi138.front.sepia.ceph.com 2024-04-26T20:58:03.310 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T20:58:03.310 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T20:58:03.310 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-26T20:58:03.310 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-26T20:58:03.310 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T20:58:03.310 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T20:58:03.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:58:03.311 DEBUG:teuthology.orchestra.run.smithi138:> ip addr 2024-04-26T20:58:03.321 INFO:teuthology.orchestra.run.smithi138.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T20:58:03.321 INFO:teuthology.orchestra.run.smithi138.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T20:58:03.321 INFO:teuthology.orchestra.run.smithi138.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T20:58:03.321 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:58:03.321 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 ::1/128 scope host 2024-04-26T20:58:03.321 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:58:03.321 INFO:teuthology.orchestra.run.smithi138.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T20:58:03.321 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:d9:36:7a brd ff:ff:ff:ff:ff:ff 2024-04-26T20:58:03.321 INFO:teuthology.orchestra.run.smithi138.stdout: altname enp7s0f0 2024-04-26T20:58:03.321 INFO:teuthology.orchestra.run.smithi138.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T20:58:03.321 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:d9:36:7b brd ff:ff:ff:ff:ff:ff 2024-04-26T20:58:03.322 INFO:teuthology.orchestra.run.smithi138.stdout: altname enp7s0f1 2024-04-26T20:58:03.322 INFO:teuthology.orchestra.run.smithi138.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T20:58:03.322 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:88:6f:70 brd ff:ff:ff:ff:ff:ff 2024-04-26T20:58:03.322 INFO:teuthology.orchestra.run.smithi138.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T20:58:03.322 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:88:6f:71 brd ff:ff:ff:ff:ff:ff 2024-04-26T20:58:03.322 INFO:teuthology.orchestra.run.smithi138.stdout: inet 172.21.15.138/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-26T20:58:03.322 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft 42341sec preferred_lft 42341sec 2024-04-26T20:58:03.322 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 fe80::ec4:7aff:fe88:6f71/64 scope link 2024-04-26T20:58:03.322 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:58:03.322 INFO:teuthology.orchestra.run.smithi138.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-26T20:58:03.322 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 02:42:f3:4e:97:bb brd ff:ff:ff:ff:ff:ff 2024-04-26T20:58:03.322 INFO:teuthology.orchestra.run.smithi138.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-26T20:58:03.323 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:58:03.323 INFO:teuthology.orchestra.run.smithi138.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T20:58:03.323 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-26T20:58:03.323 INFO:teuthology.orchestra.run.smithi138.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-26T20:58:03.323 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:58:03.323 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-26T20:58:03.323 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:58:03.323 INFO:teuthology.orchestra.run.smithi138.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T20:58:03.323 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T20:58:03.323 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-26T20:58:03.323 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:58:03.323 INFO:teuthology.orchestra.run.smithi138.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T20:58:03.323 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T20:58:03.323 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-26T20:58:03.324 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:58:03.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:58:03.324 DEBUG:teuthology.orchestra.run.smithi138:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T20:58:03.384 INFO:teuthology.orchestra.run.smithi138.stdout:1 2024-04-26T20:58:03.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:58:03.386 DEBUG:teuthology.orchestra.run.smithi138:> route 2024-04-26T20:58:03.439 INFO:teuthology.orchestra.run.smithi138.stdout:Kernel IP routing table 2024-04-26T20:58:03.439 INFO:teuthology.orchestra.run.smithi138.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T20:58:03.439 INFO:teuthology.orchestra.run.smithi138.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-26T20:58:03.439 INFO:teuthology.orchestra.run.smithi138.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T20:58:03.439 INFO:teuthology.orchestra.run.smithi138.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-26T20:58:03.439 INFO:teuthology.orchestra.run.smithi138.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-26T20:58:03.439 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T20:58:03.439 INFO:teuthology.orchestra.run.smithi138.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T20:58:03.439 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T20:58:03.439 INFO:teuthology.orchestra.run.smithi138.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T20:58:03.439 INFO:teuthology.orchestra.run.smithi138.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T20:58:03.440 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T20:58:03.440 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2024-04-26T20:58:03.440 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T20:58:03.440 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T20:58:03.440 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T20:58:03.440 DEBUG:teuthology.orchestra.run.smithi138:> ') 2024-04-26T20:58:03.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:58:03.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:58:03.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:58:03.577 DEBUG:teuthology.orchestra.run.smithi138:> ip netns list 2024-04-26T20:58:03.585 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T20:58:03.586 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-26T20:58:03.587 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T20:58:03.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:58:03.587 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link set brx.0 up 2024-04-26T20:58:03.655 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T20:58:03.656 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T20:58:03.707 INFO:teuthology.orchestra.run.smithi138.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T20:58:03.707 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T20:58:03.707 DEBUG:teuthology.orchestra.run.smithi138:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T20:58:03.758 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-26T20:58:03.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:58:03.759 DEBUG:teuthology.orchestra.run.smithi138:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T20:58:03.851 INFO:teuthology.orchestra.run.smithi138.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T20:58:03.851 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T20:58:03.865 INFO:teuthology.orchestra.run.smithi138.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T20:58:03.865 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T20:58:03.865 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: resolved to: "172.21.15.138:3300,172.21.15.143:3300,172.21.15.143:3301" 2024-04-26T20:58:03.865 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: trying mount with new device syntax: 0@c22b4730-12cc-4558-8535-b965384398c0.cephfs=/ 2024-04-26T20:58:03.865 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.138:3300/172.21.15.143:3300/172.21.15.143:3301" will pass to kernel 2024-04-26T20:58:03.870 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-26T20:58:03.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:58:03.870 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T20:58:03.891 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T20:58:03.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T20:58:03.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:58:04.005 INFO:teuthology.orchestra.run.smithi138.stdout:client5532 2024-04-26T20:58:04.005 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-26T20:58:04.005 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T20:58:04.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:58:04.014 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir) 2024-04-26T20:58:04.077 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-26T20:58:04.077 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T20:58:04.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:58:04.127 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=subdir/sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-04-26T20:58:04.265 INFO:teuthology.orchestra.run.smithi138.stderr:6+0 records in 2024-04-26T20:58:04.265 INFO:teuthology.orchestra.run.smithi138.stderr:6+0 records out 2024-04-26T20:58:04.265 INFO:teuthology.orchestra.run.smithi138.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0880381 s, 71.5 MB/s 2024-04-26T20:58:04.267 DEBUG:teuthology.orchestra.run.smithi138:> stdin-killer -- python3 -c ' 2024-04-26T20:58:04.267 DEBUG:teuthology.orchestra.run.smithi138:> import os 2024-04-26T20:58:04.267 DEBUG:teuthology.orchestra.run.smithi138:> import stat 2024-04-26T20:58:04.267 DEBUG:teuthology.orchestra.run.smithi138:> import json 2024-04-26T20:58:04.267 DEBUG:teuthology.orchestra.run.smithi138:> import sys 2024-04-26T20:58:04.267 DEBUG:teuthology.orchestra.run.smithi138:> 2024-04-26T20:58:04.267 DEBUG:teuthology.orchestra.run.smithi138:> try: 2024-04-26T20:58:04.267 DEBUG:teuthology.orchestra.run.smithi138:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/sixmegs'"'"') 2024-04-26T20:58:04.267 DEBUG:teuthology.orchestra.run.smithi138:> except OSError as e: 2024-04-26T20:58:04.267 DEBUG:teuthology.orchestra.run.smithi138:> sys.exit(e.errno) 2024-04-26T20:58:04.267 DEBUG:teuthology.orchestra.run.smithi138:> 2024-04-26T20:58:04.267 DEBUG:teuthology.orchestra.run.smithi138:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-04-26T20:58:04.267 DEBUG:teuthology.orchestra.run.smithi138:> print(json.dumps( 2024-04-26T20:58:04.267 DEBUG:teuthology.orchestra.run.smithi138:> dict([(a, getattr(s, a)) for a in attrs]), 2024-04-26T20:58:04.267 DEBUG:teuthology.orchestra.run.smithi138:> indent=2)) 2024-04-26T20:58:04.268 DEBUG:teuthology.orchestra.run.smithi138:> ' 2024-04-26T20:58:04.336 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-26T20:58:04.337 INFO:teuthology.orchestra.run.smithi138.stdout: "st_mode": 33204, 2024-04-26T20:58:04.337 INFO:teuthology.orchestra.run.smithi138.stdout: "st_ino": 1099511627777, 2024-04-26T20:58:04.337 INFO:teuthology.orchestra.run.smithi138.stdout: "st_dev": 44, 2024-04-26T20:58:04.337 INFO:teuthology.orchestra.run.smithi138.stdout: "st_nlink": 1, 2024-04-26T20:58:04.337 INFO:teuthology.orchestra.run.smithi138.stdout: "st_uid": 1000, 2024-04-26T20:58:04.337 INFO:teuthology.orchestra.run.smithi138.stdout: "st_gid": 1271, 2024-04-26T20:58:04.337 INFO:teuthology.orchestra.run.smithi138.stdout: "st_size": 6291456, 2024-04-26T20:58:04.337 INFO:teuthology.orchestra.run.smithi138.stdout: "st_atime": 1714165084.1723611, 2024-04-26T20:58:04.337 INFO:teuthology.orchestra.run.smithi138.stdout: "st_mtime": 1714165084.2123606, 2024-04-26T20:58:04.337 INFO:teuthology.orchestra.run.smithi138.stdout: "st_ctime": 1714165084.2123606 2024-04-26T20:58:04.337 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-26T20:58:04.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:58:04.346 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-26T20:58:04.346 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T20:58:04.395 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-26T20:58:04.396 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T20:58:04.448 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:58:04.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.628+0000 7fec57000640 1 Processor -- start 2024-04-26T20:58:04.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.628+0000 7fec57000640 1 -- start start 2024-04-26T20:58:04.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.628+0000 7fec57000640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fec500cbe00 0x7fec5006de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:04.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.628+0000 7fec57000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec500cc1e0 0x7fec50073b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:04.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.628+0000 7fec57000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fec500ce6f0 0x7fec500ceb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:04.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.628+0000 7fec57000640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fec50073680 con 0x7fec500ce6f0 2024-04-26T20:58:04.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.628+0000 7fec57000640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fec500727f0 con 0x7fec500cbe00 2024-04-26T20:58:04.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.628+0000 7fec57000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fec50072a70 con 0x7fec500cc1e0 2024-04-26T20:58:04.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.628+0000 7fec55000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fec500ce6f0 0x7fec500ceb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:04.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.628+0000 7fec55000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fec500ce6f0 0x7fec500ceb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:59010/0 (socket says 172.21.15.138:59010) 2024-04-26T20:58:04.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.628+0000 7fec55000640 1 -- 172.21.15.138:0/3036540307 learned_addr learned my addr 172.21.15.138:0/3036540307 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:04.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.628+0000 7fec55000640 1 -- 172.21.15.138:0/3036540307 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec500cc1e0 msgr2=0x7fec50073b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:04.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.628+0000 7fec55000640 1 --2- 172.21.15.138:0/3036540307 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec500cc1e0 0x7fec50073b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:04.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.628+0000 7fec55000640 1 -- 172.21.15.138:0/3036540307 >> v2:172.21.15.143:3300/0 conn(0x7fec500cbe00 msgr2=0x7fec5006de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:04.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.628+0000 7fec55000640 1 --2- 172.21.15.138:0/3036540307 >> v2:172.21.15.143:3300/0 conn(0x7fec500cbe00 0x7fec5006de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:04.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.632+0000 7fec55000640 1 -- 172.21.15.138:0/3036540307 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec50072d50 con 0x7fec500ce6f0 2024-04-26T20:58:04.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.632+0000 7fec55000640 1 --2- 172.21.15.138:0/3036540307 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec500ce6f0 0x7fec500ceb80 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fec50074a70 tx=0x7fec4801ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97503ba94bbb6240 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:04.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.632+0000 7fec4f400640 1 -- 172.21.15.138:0/3036540307 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec480a7880 con 0x7fec500ce6f0 2024-04-26T20:58:04.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.632+0000 7fec4f400640 1 -- 172.21.15.138:0/3036540307 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec480a7a20 con 0x7fec500ce6f0 2024-04-26T20:58:04.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.632+0000 7fec4f400640 1 -- 172.21.15.138:0/3036540307 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec480a7df0 con 0x7fec500ce6f0 2024-04-26T20:58:04.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.632+0000 7fec57000640 1 -- 172.21.15.138:0/3036540307 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec500ce6f0 msgr2=0x7fec500ceb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:04.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.632+0000 7fec57000640 1 --2- 172.21.15.138:0/3036540307 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec500ce6f0 0x7fec500ceb80 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fec50074a70 tx=0x7fec4801ec00 comp rx=0 tx=0).stop 2024-04-26T20:58:04.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.632+0000 7fec57000640 1 -- 172.21.15.138:0/3036540307 shutdown_connections 2024-04-26T20:58:04.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.632+0000 7fec57000640 1 --2- 172.21.15.138:0/3036540307 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec500ce6f0 0x7fec500ceb80 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:04.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.632+0000 7fec57000640 1 --2- 172.21.15.138:0/3036540307 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec500cc1e0 0x7fec50073b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:04.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.632+0000 7fec57000640 1 --2- 172.21.15.138:0/3036540307 >> v2:172.21.15.143:3300/0 conn(0x7fec500cbe00 0x7fec5006de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:04.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.632+0000 7fec57000640 1 -- 172.21.15.138:0/3036540307 >> 172.21.15.138:0/3036540307 conn(0x7fec500d0b20 msgr2=0x7fec500d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:04.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.632+0000 7fec57000640 1 -- 172.21.15.138:0/3036540307 shutdown_connections 2024-04-26T20:58:04.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.632+0000 7fec57000640 1 -- 172.21.15.138:0/3036540307 wait complete. 2024-04-26T20:58:04.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.636+0000 7fec57000640 1 Processor -- start 2024-04-26T20:58:04.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.636+0000 7fec57000640 1 -- start start 2024-04-26T20:58:04.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.636+0000 7fec57000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec500cbe00 0x7fec500b1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:04.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.636+0000 7fec57000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec500cc1e0 0x7fec50158910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:04.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.636+0000 7fec57000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec500ce6f0 0x7fec5014a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:04.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.636+0000 7fec57000640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fec5006e530 con 0x7fec500cc1e0 2024-04-26T20:58:04.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.636+0000 7fec57000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fec5006e3b0 con 0x7fec500cbe00 2024-04-26T20:58:04.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.636+0000 7fec57000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fec50074050 con 0x7fec500ce6f0 2024-04-26T20:58:04.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.636+0000 7fec47400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec500cc1e0 0x7fec50158910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:04.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.636+0000 7fec47400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec500cc1e0 0x7fec50158910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:59012/0 (socket says 172.21.15.138:59012) 2024-04-26T20:58:04.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.636+0000 7fec47400640 1 -- 172.21.15.138:0/1111815562 learned_addr learned my addr 172.21.15.138:0/1111815562 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:04.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.636+0000 7fec4fe00640 1 --2- 172.21.15.138:0/1111815562 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec500cbe00 0x7fec500b1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:04.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.636+0000 7fec55000640 1 --2- 172.21.15.138:0/1111815562 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec500ce6f0 0x7fec5014a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:04.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.636+0000 7fec47400640 1 -- 172.21.15.138:0/1111815562 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec500ce6f0 msgr2=0x7fec5014a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:04.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.636+0000 7fec47400640 1 --2- 172.21.15.138:0/1111815562 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec500ce6f0 0x7fec5014a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:04.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.636+0000 7fec47400640 1 -- 172.21.15.138:0/1111815562 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec500cbe00 msgr2=0x7fec500b1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:04.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.636+0000 7fec47400640 1 --2- 172.21.15.138:0/1111815562 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec500cbe00 0x7fec500b1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:04.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.636+0000 7fec47400640 1 -- 172.21.15.138:0/1111815562 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec5014b010 con 0x7fec500cc1e0 2024-04-26T20:58:04.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.636+0000 7fec55000640 1 --2- 172.21.15.138:0/1111815562 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec500ce6f0 0x7fec5014a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:58:04.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.636+0000 7fec4fe00640 1 --2- 172.21.15.138:0/1111815562 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec500cbe00 0x7fec500b1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:58:04.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.636+0000 7fec47400640 1 --2- 172.21.15.138:0/1111815562 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec500cc1e0 0x7fec50158910 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fec3800b550 tx=0x7fec3800ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:04.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.636+0000 7fec4cc00640 1 -- 172.21.15.138:0/1111815562 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec38014070 con 0x7fec500cc1e0 2024-04-26T20:58:04.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.636+0000 7fec4cc00640 1 -- 172.21.15.138:0/1111815562 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec38010890 con 0x7fec500cc1e0 2024-04-26T20:58:04.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.636+0000 7fec4cc00640 1 -- 172.21.15.138:0/1111815562 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec38010c80 con 0x7fec500cc1e0 2024-04-26T20:58:04.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.636+0000 7fec57000640 1 -- 172.21.15.138:0/1111815562 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec50151e10 con 0x7fec500cc1e0 2024-04-26T20:58:04.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.636+0000 7fec57000640 1 -- 172.21.15.138:0/1111815562 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec501523d0 con 0x7fec500cc1e0 2024-04-26T20:58:04.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.640+0000 7fec57000640 1 -- 172.21.15.138:0/1111815562 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec50069510 con 0x7fec500cc1e0 2024-04-26T20:58:04.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.640+0000 7fec4cc00640 1 -- 172.21.15.138:0/1111815562 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fec38017070 con 0x7fec500cc1e0 2024-04-26T20:58:04.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.640+0000 7fec4cc00640 1 --2- 172.21.15.138:0/1111815562 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fec2c068380 0x7fec2c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:04.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.640+0000 7fec4cc00640 1 -- 172.21.15.138:0/1111815562 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fec380869b0 con 0x7fec500cc1e0 2024-04-26T20:58:04.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.640+0000 7fec4fe00640 1 --2- 172.21.15.138:0/1111815562 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fec2c068380 0x7fec2c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:04.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.640+0000 7fec4fe00640 1 --2- 172.21.15.138:0/1111815562 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fec2c068380 0x7fec2c06a840 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fec40006fd0 tx=0x7fec40008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:04.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.644+0000 7fec4cc00640 1 -- 172.21.15.138:0/1111815562 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fec38056d40 con 0x7fec500cc1e0 2024-04-26T20:58:04.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.804+0000 7fec57000640 1 -- 172.21.15.138:0/1111815562 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fec5015d550 con 0x7fec500cc1e0 2024-04-26T20:58:04.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.804+0000 7fec4cc00640 1 -- 172.21.15.138:0/1111815562 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) ==== 74+0+17002 (secure 0 0 0) 0x7fec38010e20 con 0x7fec500cc1e0 2024-04-26T20:58:04.806 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:04.806 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":41,"fsid":"c22b4730-12cc-4558-8535-b965384398c0","created":"2024-04-26T20:56:14.182475+0000","modified":"2024-04-26T20:57:53.563810+0000","last_up_change":"2024-04-26T20:56:26.013243+0000","last_in_change":"2024-04-26T20:56:16.714055+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:56:27.265834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:57:49.597600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-26T20:57:50.901951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3f9a2e34-3199-466f-a6cf-57927318121e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6801","nonce":3534772245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6803","nonce":3534772245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6807","nonce":3534772245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6805","nonce":3534772245}]},"public_addr":"172.21.15.138:6801/3534772245","cluster_addr":"172.21.15.138:6803/3534772245","heartbeat_back_addr":"172.21.15.138:6807/3534772245","heartbeat_front_addr":"172.21.15.138:6805/3534772245","state":["exists","up"]},{"osd":1,"uuid":"e881fcf6-3248-4696-a2ef-95d206d77712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6817","nonce":1427635773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6819","nonce":1427635773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6823","nonce":1427635773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6821","nonce":1427635773}]},"public_addr":"172.21.15.138:6817/1427635773","cluster_addr":"172.21.15.138:6819/1427635773","heartbeat_back_addr":"172.21.15.138:6823/1427635773","heartbeat_front_addr":"172.21.15.138:6821/1427635773","state":["exists","up"]},{"osd":2,"uuid":"f7d1db33-7672-4699-ae47-9f1e0a8e4222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6809","nonce":4273721573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6811","nonce":4273721573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6815","nonce":4273721573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6813","nonce":4273721573}]},"public_addr":"172.21.15.138:6809/4273721573","cluster_addr":"172.21.15.138:6811/4273721573","heartbeat_back_addr":"172.21.15.138:6815/4273721573","heartbeat_front_addr":"172.21.15.138:6813/4273721573","state":["exists","up"]},{"osd":3,"uuid":"2f4e0a9a-b8f6-4468-844a-a4501cd85054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6825","nonce":3098242154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6827","nonce":3098242154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6831","nonce":3098242154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6829","nonce":3098242154}]},"public_addr":"172.21.15.138:6825/3098242154","cluster_addr":"172.21.15.138:6827/3098242154","heartbeat_back_addr":"172.21.15.138:6831/3098242154","heartbeat_front_addr":"172.21.15.138:6829/3098242154","state":["exists","up"]},{"osd":4,"uuid":"c85df99b-3624-410e-866b-86830af2cfe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6801","nonce":2942056312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6803","nonce":2942056312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6807","nonce":2942056312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6805","nonce":2942056312}]},"public_addr":"172.21.15.143:6801/2942056312","cluster_addr":"172.21.15.143:6803/2942056312","heartbeat_back_addr":"172.21.15.143:6807/2942056312","heartbeat_front_addr":"172.21.15.143:6805/2942056312","state":["exists","up"]},{"osd":5,"uuid":"9af1efb5-c416-4808-b5ef-de0679ab9705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6809","nonce":1910222887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6811","nonce":1910222887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6815","nonce":1910222887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6813","nonce":1910222887}]},"public_addr":"172.21.15.143:6809/1910222887","cluster_addr":"172.21.15.143:6811/1910222887","heartbeat_back_addr":"172.21.15.143:6815/1910222887","heartbeat_front_addr":"172.21.15.143:6813/1910222887","state":["exists","up"]},{"osd":6,"uuid":"d7138615-8838-45ff-9072-2fd0683362f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6817","nonce":1082239825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6819","nonce":1082239825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6823","nonce":1082239825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6821","nonce":1082239825}]},"public_addr":"172.21.15.143:6817/1082239825","cluster_addr":"172.21.15.143:6819/1082239825","heartbeat_back_addr":"172.21.15.143:6823/1082239825","heartbeat_front_addr":"172.21.15.143:6821/1082239825","state":["exists","up"]},{"osd":7,"uuid":"0c27172b-35c4-49ec-ba0b-0137b8ff0010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6825","nonce":3295508495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6827","nonce":3295508495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6831","nonce":3295508495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6829","nonce":3295508495}]},"public_addr":"172.21.15.143:6825/3295508495","cluster_addr":"172.21.15.143:6827/3295508495","heartbeat_back_addr":"172.21.15.143:6831/3295508495","heartbeat_front_addr":"172.21.15.143:6829/3295508495","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.326627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.396119+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.433915+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.414179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.216947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.329272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.503073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.436382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:58:04.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.808+0000 7fec57000640 1 -- 172.21.15.138:0/1111815562 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fec2c068380 msgr2=0x7fec2c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:04.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.808+0000 7fec57000640 1 --2- 172.21.15.138:0/1111815562 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fec2c068380 0x7fec2c06a840 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fec40006fd0 tx=0x7fec40008040 comp rx=0 tx=0).stop 2024-04-26T20:58:04.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.808+0000 7fec57000640 1 -- 172.21.15.138:0/1111815562 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec500cc1e0 msgr2=0x7fec50158910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:04.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.808+0000 7fec57000640 1 --2- 172.21.15.138:0/1111815562 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec500cc1e0 0x7fec50158910 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fec3800b550 tx=0x7fec3800ba10 comp rx=0 tx=0).stop 2024-04-26T20:58:04.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.808+0000 7fec57000640 1 -- 172.21.15.138:0/1111815562 shutdown_connections 2024-04-26T20:58:04.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.808+0000 7fec57000640 1 --2- 172.21.15.138:0/1111815562 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fec2c068380 0x7fec2c06a840 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:04.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.808+0000 7fec57000640 1 --2- 172.21.15.138:0/1111815562 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec500ce6f0 0x7fec5014a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:04.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.808+0000 7fec57000640 1 --2- 172.21.15.138:0/1111815562 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec500cc1e0 0x7fec50158910 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:04.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.808+0000 7fec57000640 1 --2- 172.21.15.138:0/1111815562 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec500cbe00 0x7fec500b1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:04.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.808+0000 7fec57000640 1 -- 172.21.15.138:0/1111815562 >> 172.21.15.138:0/1111815562 conn(0x7fec500d0b20 msgr2=0x7fec500c4190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:04.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.808+0000 7fec57000640 1 -- 172.21.15.138:0/1111815562 shutdown_connections 2024-04-26T20:58:04.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.808+0000 7fec57000640 1 -- 172.21.15.138:0/1111815562 wait complete. 2024-04-26T20:58:04.828 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:56:27.265834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T20:57:49.597600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T20:57:50.901951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T20:58:04.828 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T20:58:04.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.964+0000 7f40f0c00640 1 Processor -- start 2024-04-26T20:58:04.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.964+0000 7f40f0c00640 1 -- start start 2024-04-26T20:58:04.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.968+0000 7f40f0c00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f40ec15bdc0 0x7f40ec15f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:04.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.968+0000 7f40f0c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f40ec073d70 0x7f40ec15fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:04.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.968+0000 7f40f0c00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40ec06dee0 con 0x7f40ec06f880 2024-04-26T20:58:04.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.968+0000 7f40f0c00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f40ec15c1a0 con 0x7f40ec15bdc0 2024-04-26T20:58:04.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.968+0000 7f40f0c00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f40ec06e180 con 0x7f40ec073d70 2024-04-26T20:58:04.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.968+0000 7f40e9e00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f40ec15bdc0 0x7f40ec15f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:04.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.968+0000 7f40e1400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f40ec073d70 0x7f40ec15fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:04.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.968+0000 7f40ea800640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f40ec06f880 0x7f40ec0cb6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.138:39324/0 (socket says 172.21.15.138:39324) 2024-04-26T20:58:04.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.968+0000 7f40e9e00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f40ec15bdc0 0x7f40ec15f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.138:56968/0 (socket says 172.21.15.138:56968) 2024-04-26T20:58:04.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.968+0000 7f40e1400640 1 --2- 172.21.15.138:0/720501798 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f40ec073d70 0x7f40ec15fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.138:48990/0 (socket says 172.21.15.138:48990) 2024-04-26T20:58:04.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.968+0000 7f40ea800640 1 -- 172.21.15.138:0/720501798 learned_addr learned my addr 172.21.15.138:0/720501798 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:04.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.968+0000 7f40e9e00640 1 -- 172.21.15.138:0/720501798 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f40ec073d70 msgr2=0x7f40ec15fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:04.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.968+0000 7f40e9e00640 1 --2- 172.21.15.138:0/720501798 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f40ec073d70 0x7f40ec15fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:04.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.968+0000 7f40e9e00640 1 -- 172.21.15.138:0/720501798 >> v1:172.21.15.143:6789/0 conn(0x7f40ec06f880 legacy=0x7f40ec0cb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:04.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.968+0000 7f40e9e00640 1 -- 172.21.15.138:0/720501798 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40ec06e460 con 0x7f40ec15bdc0 2024-04-26T20:58:04.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.968+0000 7f40e1400640 1 --2- 172.21.15.138:0/720501798 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f40ec073d70 0x7f40ec15fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:58:04.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.972+0000 7f40e9e00640 1 --2- 172.21.15.138:0/720501798 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f40ec15bdc0 0x7f40ec15f930 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f40dc00bfa0 tx=0x7f40dc01eae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21ee1320a29bceff server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:04.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.972+0000 7f40e9400640 1 -- 172.21.15.138:0/720501798 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40dc00b2d0 con 0x7f40ec15bdc0 2024-04-26T20:58:04.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.972+0000 7f40e9400640 1 -- 172.21.15.138:0/720501798 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40dc0a77b0 con 0x7f40ec15bdc0 2024-04-26T20:58:04.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.972+0000 7f40e9400640 1 -- 172.21.15.138:0/720501798 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40dc0a7b80 con 0x7f40ec15bdc0 2024-04-26T20:58:04.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.972+0000 7f40f0c00640 1 -- 172.21.15.138:0/720501798 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f40ec15bdc0 msgr2=0x7f40ec15f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:04.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.972+0000 7f40f0c00640 1 --2- 172.21.15.138:0/720501798 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f40ec15bdc0 0x7f40ec15f930 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f40dc00bfa0 tx=0x7f40dc01eae0 comp rx=0 tx=0).stop 2024-04-26T20:58:04.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.972+0000 7f40f0c00640 1 -- 172.21.15.138:0/720501798 shutdown_connections 2024-04-26T20:58:04.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.972+0000 7f40f0c00640 1 --2- 172.21.15.138:0/720501798 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f40ec073d70 0x7f40ec15fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:04.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.972+0000 7f40f0c00640 1 --2- 172.21.15.138:0/720501798 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f40ec15bdc0 0x7f40ec15f930 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:04.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.972+0000 7f40f0c00640 1 -- 172.21.15.138:0/720501798 >> 172.21.15.138:0/720501798 conn(0x7f40ec0d0bb0 msgr2=0x7f40ec0d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:04.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.972+0000 7f40f0c00640 1 -- 172.21.15.138:0/720501798 shutdown_connections 2024-04-26T20:58:04.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.972+0000 7f40f0c00640 1 -- 172.21.15.138:0/720501798 wait complete. 2024-04-26T20:58:04.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.972+0000 7f40f0c00640 1 Processor -- start 2024-04-26T20:58:04.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.972+0000 7f40f0c00640 1 -- start start 2024-04-26T20:58:04.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.976+0000 7f40f0c00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f40ec06f880 0x7f40ec15e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:04.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.976+0000 7f40f0c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f40ec073d70 0x7f40ec14fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:04.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.976+0000 7f40f0c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f40ec15bdc0 0x7f40ec0c5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:04.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.976+0000 7f40f0c00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f40ec06eb00 con 0x7f40ec06f880 2024-04-26T20:58:04.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.976+0000 7f40f0c00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f40ec06e980 con 0x7f40ec15bdc0 2024-04-26T20:58:04.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.976+0000 7f40f0c00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f40ec06ec80 con 0x7f40ec073d70 2024-04-26T20:58:04.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.976+0000 7f40e9e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f40ec06f880 0x7f40ec15e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:04.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.976+0000 7f40e9e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f40ec06f880 0x7f40ec15e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:59014/0 (socket says 172.21.15.138:59014) 2024-04-26T20:58:04.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.976+0000 7f40e9e00640 1 -- 172.21.15.138:0/997045363 learned_addr learned my addr 172.21.15.138:0/997045363 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:04.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.976+0000 7f40ea800640 1 --2- 172.21.15.138:0/997045363 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f40ec15bdc0 0x7f40ec0c5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:04.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.976+0000 7f40e1400640 1 --2- 172.21.15.138:0/997045363 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f40ec073d70 0x7f40ec14fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:04.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.976+0000 7f40e9e00640 1 -- 172.21.15.138:0/997045363 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f40ec073d70 msgr2=0x7f40ec14fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:04.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.976+0000 7f40e9e00640 1 --2- 172.21.15.138:0/997045363 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f40ec073d70 0x7f40ec14fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:04.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.976+0000 7f40e9e00640 1 -- 172.21.15.138:0/997045363 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f40ec15bdc0 msgr2=0x7f40ec0c5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:04.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.976+0000 7f40e9e00640 1 --2- 172.21.15.138:0/997045363 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f40ec15bdc0 0x7f40ec0c5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:04.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.976+0000 7f40e9e00640 1 -- 172.21.15.138:0/997045363 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40ec15ff70 con 0x7f40ec06f880 2024-04-26T20:58:04.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.976+0000 7f40e9e00640 1 --2- 172.21.15.138:0/997045363 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f40ec06f880 0x7f40ec15e6e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f40dc0b1040 tx=0x7f40dc01b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:04.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.976+0000 7f40e2a00640 1 -- 172.21.15.138:0/997045363 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40dc009540 con 0x7f40ec06f880 2024-04-26T20:58:04.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.976+0000 7f40e2a00640 1 -- 172.21.15.138:0/997045363 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40dc0be070 con 0x7f40ec06f880 2024-04-26T20:58:04.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.976+0000 7f40f0c00640 1 -- 172.21.15.138:0/997045363 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40ec150340 con 0x7f40ec06f880 2024-04-26T20:58:04.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.976+0000 7f40e2a00640 1 -- 172.21.15.138:0/997045363 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40dc009940 con 0x7f40ec06f880 2024-04-26T20:58:04.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.976+0000 7f40f0c00640 1 -- 172.21.15.138:0/997045363 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40ec0c4590 con 0x7f40ec06f880 2024-04-26T20:58:04.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.976+0000 7f40f0c00640 1 -- 172.21.15.138:0/997045363 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40ec069430 con 0x7f40ec06f880 2024-04-26T20:58:04.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.980+0000 7f40e2a00640 1 -- 172.21.15.138:0/997045363 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f40dc0b6070 con 0x7f40ec06f880 2024-04-26T20:58:04.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.980+0000 7f40e2a00640 1 --2- 172.21.15.138:0/997045363 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f40c80683b0 0x7f40c806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:04.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.980+0000 7f40e2a00640 1 -- 172.21.15.138:0/997045363 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f40dc121230 con 0x7f40ec06f880 2024-04-26T20:58:04.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.980+0000 7f40e1400640 1 --2- 172.21.15.138:0/997045363 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f40c80683b0 0x7f40c806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:04.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.980+0000 7f40e1400640 1 --2- 172.21.15.138:0/997045363 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f40c80683b0 0x7f40c806a870 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f40d4009580 tx=0x7f40d4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:04.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:04.984+0000 7f40e2a00640 1 -- 172.21.15.138:0/997045363 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f40dc0c7020 con 0x7f40ec06f880 2024-04-26T20:58:05.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.140+0000 7f40f0c00640 1 -- 172.21.15.138:0/997045363 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f40ec0d19c0 con 0x7f40ec06f880 2024-04-26T20:58:05.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.140+0000 7f40e2a00640 1 -- 172.21.15.138:0/997045363 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) ==== 93+0+10 (secure 0 0 0) 0x7f40ec150340 con 0x7f40ec06f880 2024-04-26T20:58:05.143 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 1 2024-04-26T20:58:05.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.144+0000 7f40f0c00640 1 -- 172.21.15.138:0/997045363 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f40c80683b0 msgr2=0x7f40c806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:05.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.144+0000 7f40f0c00640 1 --2- 172.21.15.138:0/997045363 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f40c80683b0 0x7f40c806a870 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f40d4009580 tx=0x7f40d4008040 comp rx=0 tx=0).stop 2024-04-26T20:58:05.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.144+0000 7f40f0c00640 1 -- 172.21.15.138:0/997045363 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f40ec06f880 msgr2=0x7f40ec15e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:05.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.144+0000 7f40f0c00640 1 --2- 172.21.15.138:0/997045363 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f40ec06f880 0x7f40ec15e6e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f40dc0b1040 tx=0x7f40dc01b880 comp rx=0 tx=0).stop 2024-04-26T20:58:05.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.144+0000 7f40f0c00640 1 -- 172.21.15.138:0/997045363 shutdown_connections 2024-04-26T20:58:05.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.144+0000 7f40f0c00640 1 --2- 172.21.15.138:0/997045363 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f40c80683b0 0x7f40c806a870 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:05.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.144+0000 7f40f0c00640 1 --2- 172.21.15.138:0/997045363 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f40ec15bdc0 0x7f40ec0c5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:05.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.144+0000 7f40f0c00640 1 --2- 172.21.15.138:0/997045363 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f40ec073d70 0x7f40ec14fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:05.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.144+0000 7f40f0c00640 1 --2- 172.21.15.138:0/997045363 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f40ec06f880 0x7f40ec15e6e0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:05.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.144+0000 7f40f0c00640 1 -- 172.21.15.138:0/997045363 >> 172.21.15.138:0/997045363 conn(0x7f40ec0d0bb0 msgr2=0x7f40ec15afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:05.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.144+0000 7f40f0c00640 1 -- 172.21.15.138:0/997045363 shutdown_connections 2024-04-26T20:58:05.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.144+0000 7f40f0c00640 1 -- 172.21.15.138:0/997045363 wait complete. 2024-04-26T20:58:05.163 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T20:58:05.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.304+0000 7fcc77200640 1 Processor -- start 2024-04-26T20:58:05.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.304+0000 7fcc77200640 1 -- start start 2024-04-26T20:58:05.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.304+0000 7fcc77200640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fcc7006f880 0x7fcc70166cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:05.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.304+0000 7fcc77200640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc70160750 con 0x7fcc70073d70 2024-04-26T20:58:05.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.304+0000 7fcc77200640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc7006dee0 con 0x7fcc7015bdc0 2024-04-26T20:58:05.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.304+0000 7fcc77200640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fcc7015c1a0 con 0x7fcc7006f880 2024-04-26T20:58:05.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.304+0000 7fcc67400640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fcc70073d70 0x7fcc70160040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:44378/0 (socket says 172.21.15.138:44378) 2024-04-26T20:58:05.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.304+0000 7fcc67400640 1 -- 172.21.15.138:0/1547142583 learned_addr learned my addr 172.21.15.138:0/1547142583 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:05.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.304+0000 7fcc75200640 1 --2- 172.21.15.138:0/1547142583 >> v2:172.21.15.143:3300/0 conn(0x7fcc7006f880 0x7fcc70166cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:05.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.304+0000 7fcc6f400640 1 -- 172.21.15.138:0/1547142583 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2745573472 0 0) 0x7fcc70160750 con 0x7fcc70073d70 2024-04-26T20:58:05.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.304+0000 7fcc6f400640 1 -- 172.21.15.138:0/1547142583 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc54003530 con 0x7fcc70073d70 2024-04-26T20:58:05.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.304+0000 7fcc6f400640 1 -- 172.21.15.138:0/1547142583 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3510984792 0 0) 0x7fcc7006dee0 con 0x7fcc7015bdc0 2024-04-26T20:58:05.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.304+0000 7fcc6f400640 1 -- 172.21.15.138:0/1547142583 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc70160750 con 0x7fcc7015bdc0 2024-04-26T20:58:05.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.304+0000 7fcc75200640 1 -- 172.21.15.138:0/1547142583 >> v1:172.21.15.143:6789/0 conn(0x7fcc7015bdc0 legacy=0x7fcc7015f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:05.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.304+0000 7fcc75200640 1 -- 172.21.15.138:0/1547142583 >> v1:172.21.15.138:6789/0 conn(0x7fcc70073d70 legacy=0x7fcc70160040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:05.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.304+0000 7fcc75200640 1 -- 172.21.15.138:0/1547142583 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc7006e180 con 0x7fcc7006f880 2024-04-26T20:58:05.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.308+0000 7fcc75200640 1 --2- 172.21.15.138:0/1547142583 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc7006f880 0x7fcc70166cc0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcc68009d90 tx=0x7fcc6801c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e1c7d12283eba84 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:05.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.308+0000 7fcc6f400640 1 -- 172.21.15.138:0/1547142583 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc680b2070 con 0x7fcc7006f880 2024-04-26T20:58:05.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.308+0000 7fcc6f400640 1 -- 172.21.15.138:0/1547142583 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc680a5800 con 0x7fcc7006f880 2024-04-26T20:58:05.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.308+0000 7fcc6f400640 1 -- 172.21.15.138:0/1547142583 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc680a5bb0 con 0x7fcc7006f880 2024-04-26T20:58:05.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.308+0000 7fcc77200640 1 -- 172.21.15.138:0/1547142583 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc7006f880 msgr2=0x7fcc70166cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:05.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.308+0000 7fcc77200640 1 --2- 172.21.15.138:0/1547142583 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc7006f880 0x7fcc70166cc0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcc68009d90 tx=0x7fcc6801c850 comp rx=0 tx=0).stop 2024-04-26T20:58:05.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.308+0000 7fcc77200640 1 -- 172.21.15.138:0/1547142583 shutdown_connections 2024-04-26T20:58:05.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.308+0000 7fcc77200640 1 --2- 172.21.15.138:0/1547142583 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc7006f880 0x7fcc70166cc0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:05.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.308+0000 7fcc77200640 1 -- 172.21.15.138:0/1547142583 >> 172.21.15.138:0/1547142583 conn(0x7fcc700d0bb0 msgr2=0x7fcc700d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:05.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.308+0000 7fcc77200640 1 -- 172.21.15.138:0/1547142583 shutdown_connections 2024-04-26T20:58:05.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.308+0000 7fcc77200640 1 -- 172.21.15.138:0/1547142583 wait complete. 2024-04-26T20:58:05.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.312+0000 7fcc77200640 1 Processor -- start 2024-04-26T20:58:05.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.312+0000 7fcc77200640 1 -- start start 2024-04-26T20:58:05.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.312+0000 7fcc77200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc7006f880 0x7fcc7014b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:05.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.312+0000 7fcc77200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcc70073d70 0x7fcc7015d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:05.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.312+0000 7fcc77200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcc7015bdc0 0x7fcc7015da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:05.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.312+0000 7fcc77200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fcc70169ba0 con 0x7fcc7015bdc0 2024-04-26T20:58:05.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.312+0000 7fcc77200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fcc70169a20 con 0x7fcc7006f880 2024-04-26T20:58:05.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.312+0000 7fcc77200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fcc70169d20 con 0x7fcc70073d70 2024-04-26T20:58:05.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.312+0000 7fcc75200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcc7015bdc0 0x7fcc7015da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:05.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.312+0000 7fcc75200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcc7015bdc0 0x7fcc7015da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:59018/0 (socket says 172.21.15.138:59018) 2024-04-26T20:58:05.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.312+0000 7fcc75200640 1 -- 172.21.15.138:0/2381394090 learned_addr learned my addr 172.21.15.138:0/2381394090 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:05.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.312+0000 7fcc6fe00640 1 --2- 172.21.15.138:0/2381394090 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc7006f880 0x7fcc7014b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:05.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.312+0000 7fcc67400640 1 --2- 172.21.15.138:0/2381394090 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcc70073d70 0x7fcc7015d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:05.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.312+0000 7fcc75200640 1 -- 172.21.15.138:0/2381394090 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcc70073d70 msgr2=0x7fcc7015d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:05.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.312+0000 7fcc75200640 1 --2- 172.21.15.138:0/2381394090 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcc70073d70 0x7fcc7015d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:05.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.312+0000 7fcc75200640 1 -- 172.21.15.138:0/2381394090 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc7006f880 msgr2=0x7fcc7014b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:05.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.312+0000 7fcc75200640 1 --2- 172.21.15.138:0/2381394090 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc7006f880 0x7fcc7014b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:05.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.312+0000 7fcc75200640 1 -- 172.21.15.138:0/2381394090 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc7014c0a0 con 0x7fcc7015bdc0 2024-04-26T20:58:05.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.312+0000 7fcc6fe00640 1 --2- 172.21.15.138:0/2381394090 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc7006f880 0x7fcc7014b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:58:05.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.312+0000 7fcc67400640 1 --2- 172.21.15.138:0/2381394090 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcc70073d70 0x7fcc7015d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:58:05.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.312+0000 7fcc75200640 1 --2- 172.21.15.138:0/2381394090 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcc7015bdc0 0x7fcc7015da10 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fcc68009d90 tx=0x7fcc680195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:05.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.312+0000 7fcc6cc00640 1 -- 172.21.15.138:0/2381394090 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc680b2050 con 0x7fcc7015bdc0 2024-04-26T20:58:05.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.312+0000 7fcc6cc00640 1 -- 172.21.15.138:0/2381394090 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc680be070 con 0x7fcc7015bdc0 2024-04-26T20:58:05.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.312+0000 7fcc6cc00640 1 -- 172.21.15.138:0/2381394090 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc68003db0 con 0x7fcc7015bdc0 2024-04-26T20:58:05.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.312+0000 7fcc77200640 1 -- 172.21.15.138:0/2381394090 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc7015f220 con 0x7fcc7015bdc0 2024-04-26T20:58:05.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.312+0000 7fcc77200640 1 -- 172.21.15.138:0/2381394090 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc70152470 con 0x7fcc7015bdc0 2024-04-26T20:58:05.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.316+0000 7fcc77200640 1 -- 172.21.15.138:0/2381394090 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc70069430 con 0x7fcc7015bdc0 2024-04-26T20:58:05.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.316+0000 7fcc6cc00640 1 -- 172.21.15.138:0/2381394090 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcc68004040 con 0x7fcc7015bdc0 2024-04-26T20:58:05.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.316+0000 7fcc6cc00640 1 --2- 172.21.15.138:0/2381394090 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fcc4c068380 0x7fcc4c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:05.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.316+0000 7fcc6cc00640 1 -- 172.21.15.138:0/2381394090 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fcc68121cb0 con 0x7fcc7015bdc0 2024-04-26T20:58:05.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.316+0000 7fcc6fe00640 1 --2- 172.21.15.138:0/2381394090 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fcc4c068380 0x7fcc4c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:05.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.316+0000 7fcc6fe00640 1 --2- 172.21.15.138:0/2381394090 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fcc4c068380 0x7fcc4c06a840 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcc7015f520 tx=0x7fcc60009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:05.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.320+0000 7fcc6cc00640 1 -- 172.21.15.138:0/2381394090 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fcc68016560 con 0x7fcc7015bdc0 2024-04-26T20:58:05.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.476+0000 7fcc77200640 1 -- 172.21.15.138:0/2381394090 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fcc700caab0 con 0x7fcc7015bdc0 2024-04-26T20:58:05.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.480+0000 7fcc6cc00640 1 -- 172.21.15.138:0/2381394090 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v41) ==== 104+0+11 (secure 0 0 0) 0x7fcc680f2040 con 0x7fcc7015bdc0 2024-04-26T20:58:05.480 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 32 2024-04-26T20:58:05.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.480+0000 7fcc77200640 1 -- 172.21.15.138:0/2381394090 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fcc4c068380 msgr2=0x7fcc4c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:05.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.480+0000 7fcc77200640 1 --2- 172.21.15.138:0/2381394090 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fcc4c068380 0x7fcc4c06a840 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcc7015f520 tx=0x7fcc60009040 comp rx=0 tx=0).stop 2024-04-26T20:58:05.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.480+0000 7fcc77200640 1 -- 172.21.15.138:0/2381394090 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcc7015bdc0 msgr2=0x7fcc7015da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:05.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.480+0000 7fcc77200640 1 --2- 172.21.15.138:0/2381394090 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcc7015bdc0 0x7fcc7015da10 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fcc68009d90 tx=0x7fcc680195f0 comp rx=0 tx=0).stop 2024-04-26T20:58:05.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.480+0000 7fcc77200640 1 -- 172.21.15.138:0/2381394090 shutdown_connections 2024-04-26T20:58:05.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.480+0000 7fcc77200640 1 --2- 172.21.15.138:0/2381394090 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fcc4c068380 0x7fcc4c06a840 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:05.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.480+0000 7fcc77200640 1 --2- 172.21.15.138:0/2381394090 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcc7015bdc0 0x7fcc7015da10 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:05.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.480+0000 7fcc77200640 1 --2- 172.21.15.138:0/2381394090 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcc70073d70 0x7fcc7015d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:05.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.480+0000 7fcc77200640 1 --2- 172.21.15.138:0/2381394090 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc7006f880 0x7fcc7014b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:05.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.480+0000 7fcc77200640 1 -- 172.21.15.138:0/2381394090 >> 172.21.15.138:0/2381394090 conn(0x7fcc700d0bb0 msgr2=0x7fcc700d0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:05.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.480+0000 7fcc77200640 1 -- 172.21.15.138:0/2381394090 shutdown_connections 2024-04-26T20:58:05.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.480+0000 7fcc77200640 1 -- 172.21.15.138:0/2381394090 wait complete. 2024-04-26T20:58:05.500 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T20:58:05.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.640+0000 7f7743400640 1 Processor -- start 2024-04-26T20:58:05.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.640+0000 7f7743400640 1 -- start start 2024-04-26T20:58:05.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.640+0000 7f7743400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f773c15f3b0 0x7f773c0d1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:05.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.640+0000 7f7743400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f773c0d3880 0x7f773c0cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:05.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.640+0000 7f7743400640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f773c0cfb20 0x7f773c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:05.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.640+0000 7f7743400640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f773c0cdb80 con 0x7f773c15f3b0 2024-04-26T20:58:05.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.640+0000 7f7743400640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f773c0d2250 con 0x7f773c0cfb20 2024-04-26T20:58:05.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.640+0000 7f7743400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f773c0cd530 con 0x7f773c0d3880 2024-04-26T20:58:05.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.640+0000 7f7740a00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f773c15f3b0 0x7f773c0d1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:05.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.640+0000 7f7740a00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f773c15f3b0 0x7f773c0d1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:59024/0 (socket says 172.21.15.138:59024) 2024-04-26T20:58:05.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.640+0000 7f7740a00640 1 -- 172.21.15.138:0/3017670006 learned_addr learned my addr 172.21.15.138:0/3017670006 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:05.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.640+0000 7f7733e00640 1 --2- 172.21.15.138:0/3017670006 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f773c0d3880 0x7f773c0cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:05.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.640+0000 7f7741400640 1 --2- 172.21.15.138:0/3017670006 >> v2:172.21.15.143:3300/0 conn(0x7f773c0cfb20 0x7f773c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:05.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.640+0000 7f7740a00640 1 -- 172.21.15.138:0/3017670006 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f773c0d3880 msgr2=0x7f773c0cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:05.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.640+0000 7f7740a00640 1 --2- 172.21.15.138:0/3017670006 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f773c0d3880 0x7f773c0cf5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:05.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.640+0000 7f7740a00640 1 -- 172.21.15.138:0/3017670006 >> v2:172.21.15.143:3300/0 conn(0x7f773c0cfb20 msgr2=0x7f773c06d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:05.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.640+0000 7f7740a00640 1 --2- 172.21.15.138:0/3017670006 >> v2:172.21.15.143:3300/0 conn(0x7f773c0cfb20 0x7f773c06d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:05.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.640+0000 7f7740a00640 1 -- 172.21.15.138:0/3017670006 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f773c0cd810 con 0x7f773c15f3b0 2024-04-26T20:58:05.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.644+0000 7f7740a00640 1 --2- 172.21.15.138:0/3017670006 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f773c15f3b0 0x7f773c0d1090 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f773c0c9dc0 tx=0x7f772c01c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dce6877d51fbd5db server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:05.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.644+0000 7f773be00640 1 -- 172.21.15.138:0/3017670006 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f772c0b0070 con 0x7f773c15f3b0 2024-04-26T20:58:05.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.644+0000 7f773be00640 1 -- 172.21.15.138:0/3017670006 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f772c0ab600 con 0x7f773c15f3b0 2024-04-26T20:58:05.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.644+0000 7f773be00640 1 -- 172.21.15.138:0/3017670006 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f772c0ab9d0 con 0x7f773c15f3b0 2024-04-26T20:58:05.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.644+0000 7f7743400640 1 -- 172.21.15.138:0/3017670006 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f773c15f3b0 msgr2=0x7f773c0d1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:05.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.644+0000 7f7743400640 1 --2- 172.21.15.138:0/3017670006 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f773c15f3b0 0x7f773c0d1090 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f773c0c9dc0 tx=0x7f772c01c260 comp rx=0 tx=0).stop 2024-04-26T20:58:05.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.644+0000 7f7743400640 1 -- 172.21.15.138:0/3017670006 shutdown_connections 2024-04-26T20:58:05.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.644+0000 7f7743400640 1 --2- 172.21.15.138:0/3017670006 >> v2:172.21.15.143:3300/0 conn(0x7f773c0cfb20 0x7f773c06d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:05.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.644+0000 7f7743400640 1 --2- 172.21.15.138:0/3017670006 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f773c0d3880 0x7f773c0cf5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:05.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.644+0000 7f7743400640 1 --2- 172.21.15.138:0/3017670006 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f773c15f3b0 0x7f773c0d1090 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:05.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.644+0000 7f7743400640 1 -- 172.21.15.138:0/3017670006 >> 172.21.15.138:0/3017670006 conn(0x7f773c0d2d60 msgr2=0x7f773c0d3170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:05.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.644+0000 7f7743400640 1 -- 172.21.15.138:0/3017670006 shutdown_connections 2024-04-26T20:58:05.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.644+0000 7f7743400640 1 -- 172.21.15.138:0/3017670006 wait complete. 2024-04-26T20:58:05.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.648+0000 7f7743400640 1 Processor -- start 2024-04-26T20:58:05.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.648+0000 7f7743400640 1 -- start start 2024-04-26T20:58:05.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.648+0000 7f7743400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f773c0cfb20 0x7f773c15e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:05.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.648+0000 7f7743400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f773c0d3880 0x7f773c15c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:05.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.648+0000 7f7743400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f773c15f3b0 0x7f773c0b7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:05.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.648+0000 7f7743400640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f773c0ce3a0 con 0x7f773c15f3b0 2024-04-26T20:58:05.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.648+0000 7f7743400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f773c0ce220 con 0x7f773c0cfb20 2024-04-26T20:58:05.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.648+0000 7f7743400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f773c0ce520 con 0x7f773c0d3880 2024-04-26T20:58:05.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.648+0000 7f7741400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f773c15f3b0 0x7f773c0b7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:05.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.648+0000 7f7740a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f773c0cfb20 0x7f773c15e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:05.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.648+0000 7f7741400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f773c15f3b0 0x7f773c0b7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:59028/0 (socket says 172.21.15.138:59028) 2024-04-26T20:58:05.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.648+0000 7f7741400640 1 -- 172.21.15.138:0/1825917962 learned_addr learned my addr 172.21.15.138:0/1825917962 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:05.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.648+0000 7f7733e00640 1 --2- 172.21.15.138:0/1825917962 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f773c0d3880 0x7f773c15c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:05.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.648+0000 7f7741400640 1 -- 172.21.15.138:0/1825917962 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f773c0d3880 msgr2=0x7f773c15c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:05.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.648+0000 7f7741400640 1 --2- 172.21.15.138:0/1825917962 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f773c0d3880 0x7f773c15c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:05.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.648+0000 7f7741400640 1 -- 172.21.15.138:0/1825917962 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f773c0cfb20 msgr2=0x7f773c15e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:05.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.648+0000 7f7741400640 1 --2- 172.21.15.138:0/1825917962 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f773c0cfb20 0x7f773c15e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:05.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.648+0000 7f7741400640 1 -- 172.21.15.138:0/1825917962 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f773c13fdb0 con 0x7f773c15f3b0 2024-04-26T20:58:05.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.648+0000 7f7733e00640 1 --2- 172.21.15.138:0/1825917962 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f773c0d3880 0x7f773c15c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:58:05.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.648+0000 7f7741400640 1 --2- 172.21.15.138:0/1825917962 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f773c15f3b0 0x7f773c0b7450 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f773400ef00 tx=0x7f773400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:05.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.648+0000 7f7739600640 1 -- 172.21.15.138:0/1825917962 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7734018020 con 0x7f773c15f3b0 2024-04-26T20:58:05.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.648+0000 7f7739600640 1 -- 172.21.15.138:0/1825917962 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7734014400 con 0x7f773c15f3b0 2024-04-26T20:58:05.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.648+0000 7f7739600640 1 -- 172.21.15.138:0/1825917962 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77340147f0 con 0x7f773c15f3b0 2024-04-26T20:58:05.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.648+0000 7f7743400640 1 -- 172.21.15.138:0/1825917962 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f773c140090 con 0x7f773c15f3b0 2024-04-26T20:58:05.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.648+0000 7f7743400640 1 -- 172.21.15.138:0/1825917962 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f773c140650 con 0x7f773c15f3b0 2024-04-26T20:58:05.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.648+0000 7f7743400640 1 -- 172.21.15.138:0/1825917962 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f773c069430 con 0x7f773c15f3b0 2024-04-26T20:58:05.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.652+0000 7f7739600640 1 -- 172.21.15.138:0/1825917962 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f773401b020 con 0x7f773c15f3b0 2024-04-26T20:58:05.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.652+0000 7f7739600640 1 --2- 172.21.15.138:0/1825917962 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7718068380 0x7f771806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:05.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.652+0000 7f7739600640 1 -- 172.21.15.138:0/1825917962 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f7734087200 con 0x7f773c15f3b0 2024-04-26T20:58:05.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.652+0000 7f7740a00640 1 --2- 172.21.15.138:0/1825917962 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7718068380 0x7f771806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:05.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.652+0000 7f7740a00640 1 --2- 172.21.15.138:0/1825917962 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7718068380 0x7f771806a840 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f772c0ad000 tx=0x7f772c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:05.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.656+0000 7f7739600640 1 -- 172.21.15.138:0/1825917962 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7734022070 con 0x7f773c15f3b0 2024-04-26T20:58:05.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.812+0000 7f7743400640 1 -- 172.21.15.138:0/1825917962 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f773c158db0 con 0x7f773c15f3b0 2024-04-26T20:58:05.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.812+0000 7f7739600640 1 -- 172.21.15.138:0/1825917962 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v41) ==== 100+0+11 (secure 0 0 0) 0x7f7734057590 con 0x7f773c15f3b0 2024-04-26T20:58:05.814 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 64 2024-04-26T20:58:05.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.816+0000 7f7743400640 1 -- 172.21.15.138:0/1825917962 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7718068380 msgr2=0x7f771806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:05.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.816+0000 7f7743400640 1 --2- 172.21.15.138:0/1825917962 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7718068380 0x7f771806a840 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f772c0ad000 tx=0x7f772c0a6000 comp rx=0 tx=0).stop 2024-04-26T20:58:05.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.816+0000 7f7743400640 1 -- 172.21.15.138:0/1825917962 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f773c15f3b0 msgr2=0x7f773c0b7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:05.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.816+0000 7f7743400640 1 --2- 172.21.15.138:0/1825917962 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f773c15f3b0 0x7f773c0b7450 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f773400ef00 tx=0x7f773400b480 comp rx=0 tx=0).stop 2024-04-26T20:58:05.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.816+0000 7f7743400640 1 -- 172.21.15.138:0/1825917962 shutdown_connections 2024-04-26T20:58:05.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.816+0000 7f7743400640 1 --2- 172.21.15.138:0/1825917962 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7718068380 0x7f771806a840 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:05.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.816+0000 7f7743400640 1 --2- 172.21.15.138:0/1825917962 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f773c15f3b0 0x7f773c0b7450 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:05.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.816+0000 7f7743400640 1 --2- 172.21.15.138:0/1825917962 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f773c0d3880 0x7f773c15c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:05.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.816+0000 7f7743400640 1 --2- 172.21.15.138:0/1825917962 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f773c0cfb20 0x7f773c15e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:05.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.816+0000 7f7743400640 1 -- 172.21.15.138:0/1825917962 >> 172.21.15.138:0/1825917962 conn(0x7f773c0d2d60 msgr2=0x7f773c0ceb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:05.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.816+0000 7f7743400640 1 -- 172.21.15.138:0/1825917962 shutdown_connections 2024-04-26T20:58:05.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.816+0000 7f7743400640 1 -- 172.21.15.138:0/1825917962 wait complete. 2024-04-26T20:58:05.835 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T20:58:05.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.972+0000 7f1055400640 1 Processor -- start 2024-04-26T20:58:05.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.972+0000 7f1055400640 1 -- start start 2024-04-26T20:58:05.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.972+0000 7f1055400640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f105015f130 0x7f10500cf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:05.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.972+0000 7f1055400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10500ced80 0x7f10500cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:05.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.972+0000 7f1055400640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10500d2180 con 0x7f105015f510 2024-04-26T20:58:05.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.972+0000 7f1055400640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f10500cd570 con 0x7f105015f130 2024-04-26T20:58:05.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.972+0000 7f1055400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f10500cd850 con 0x7f10500ced80 2024-04-26T20:58:05.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.972+0000 7f104f200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10500ced80 0x7f10500cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:05.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.972+0000 7f104e800640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f105015f130 0x7f10500cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:05.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.972+0000 7f104e800640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f105015f130 0x7f10500cf600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.138:57004/0 (socket says 172.21.15.138:57004) 2024-04-26T20:58:05.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.972+0000 7f104f200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10500ced80 0x7f10500cfb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.138:49022/0 (socket says 172.21.15.138:49022) 2024-04-26T20:58:05.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.972+0000 7f104e800640 1 -- 172.21.15.138:0/3706198462 learned_addr learned my addr 172.21.15.138:0/3706198462 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:05.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.972+0000 7f104f200640 1 -- 172.21.15.138:0/3706198462 >> v2:172.21.15.143:3300/0 conn(0x7f105015f130 msgr2=0x7f10500cf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:05.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.972+0000 7f104f200640 1 --2- 172.21.15.138:0/3706198462 >> v2:172.21.15.143:3300/0 conn(0x7f105015f130 0x7f10500cf600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:05.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.972+0000 7f104f200640 1 -- 172.21.15.138:0/3706198462 >> v1:172.21.15.143:6789/0 conn(0x7f105015f510 legacy=0x7f105006d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:05.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.972+0000 7f104f200640 1 -- 172.21.15.138:0/3706198462 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f105006e730 con 0x7f10500ced80 2024-04-26T20:58:05.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.972+0000 7f104e800640 1 --2- 172.21.15.138:0/3706198462 >> v2:172.21.15.143:3300/0 conn(0x7f105015f130 0x7f10500cf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:58:05.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.976+0000 7f104f200640 1 --2- 172.21.15.138:0/3706198462 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10500ced80 0x7f10500cfb40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1048009d90 tx=0x7f104801f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af8586c79093cd66 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:05.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.976+0000 7f104de00640 1 -- 172.21.15.138:0/3706198462 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10480b4070 con 0x7f10500ced80 2024-04-26T20:58:05.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.976+0000 7f104de00640 1 -- 172.21.15.138:0/3706198462 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10480af600 con 0x7f10500ced80 2024-04-26T20:58:05.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.976+0000 7f104de00640 1 -- 172.21.15.138:0/3706198462 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10480af9d0 con 0x7f10500ced80 2024-04-26T20:58:05.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.976+0000 7f1055400640 1 -- 172.21.15.138:0/3706198462 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10500ced80 msgr2=0x7f10500cfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:05.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.976+0000 7f1055400640 1 --2- 172.21.15.138:0/3706198462 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10500ced80 0x7f10500cfb40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1048009d90 tx=0x7f104801f150 comp rx=0 tx=0).stop 2024-04-26T20:58:05.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.976+0000 7f1055400640 1 -- 172.21.15.138:0/3706198462 shutdown_connections 2024-04-26T20:58:05.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.976+0000 7f1055400640 1 --2- 172.21.15.138:0/3706198462 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10500ced80 0x7f10500cfb40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:05.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.976+0000 7f1055400640 1 --2- 172.21.15.138:0/3706198462 >> v2:172.21.15.143:3300/0 conn(0x7f105015f130 0x7f10500cf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:05.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.976+0000 7f1055400640 1 -- 172.21.15.138:0/3706198462 >> 172.21.15.138:0/3706198462 conn(0x7f10500d2d80 msgr2=0x7f10500d3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:05.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.976+0000 7f1055400640 1 -- 172.21.15.138:0/3706198462 shutdown_connections 2024-04-26T20:58:05.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.976+0000 7f1055400640 1 -- 172.21.15.138:0/3706198462 wait complete. 2024-04-26T20:58:05.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.980+0000 7f1055400640 1 Processor -- start 2024-04-26T20:58:05.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.980+0000 7f1055400640 1 -- start start 2024-04-26T20:58:05.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.980+0000 7f1055400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10500ced80 0x7f105015cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:05.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.980+0000 7f1055400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f105015f130 0x7f10500c7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:05.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.980+0000 7f1055400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f105015f510 0x7f1050161af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:05.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.980+0000 7f1055400640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f10500d0670 con 0x7f10500ced80 2024-04-26T20:58:05.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.980+0000 7f1055400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f10500d04f0 con 0x7f105015f510 2024-04-26T20:58:05.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.980+0000 7f1055400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f10500d3870 con 0x7f105015f130 2024-04-26T20:58:05.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.980+0000 7f104e800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10500ced80 0x7f105015cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:05.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.980+0000 7f104e800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10500ced80 0x7f105015cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:59036/0 (socket says 172.21.15.138:59036) 2024-04-26T20:58:05.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.980+0000 7f104e800640 1 -- 172.21.15.138:0/949603082 learned_addr learned my addr 172.21.15.138:0/949603082 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:05.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.980+0000 7f1045e00640 1 --2- 172.21.15.138:0/949603082 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f105015f130 0x7f10500c7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:05.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.980+0000 7f104f200640 1 --2- 172.21.15.138:0/949603082 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f105015f510 0x7f1050161af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:05.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.980+0000 7f104e800640 1 -- 172.21.15.138:0/949603082 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f105015f130 msgr2=0x7f10500c7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:05.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.980+0000 7f104e800640 1 --2- 172.21.15.138:0/949603082 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f105015f130 0x7f10500c7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:05.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.980+0000 7f104e800640 1 -- 172.21.15.138:0/949603082 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f105015f510 msgr2=0x7f1050161af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:05.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.980+0000 7f104e800640 1 --2- 172.21.15.138:0/949603082 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f105015f510 0x7f1050161af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:05.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.980+0000 7f104e800640 1 -- 172.21.15.138:0/949603082 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10500c6e40 con 0x7f10500ced80 2024-04-26T20:58:05.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.980+0000 7f104e800640 1 --2- 172.21.15.138:0/949603082 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10500ced80 0x7f105015cef0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f104000ea00 tx=0x7f104000eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:05.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.980+0000 7f1047400640 1 -- 172.21.15.138:0/949603082 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1040017070 con 0x7f10500ced80 2024-04-26T20:58:05.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.980+0000 7f1047400640 1 -- 172.21.15.138:0/949603082 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f104000ca60 con 0x7f10500ced80 2024-04-26T20:58:05.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.980+0000 7f1047400640 1 -- 172.21.15.138:0/949603082 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f104000ce10 con 0x7f10500ced80 2024-04-26T20:58:05.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.980+0000 7f1055400640 1 -- 172.21.15.138:0/949603082 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10500c7120 con 0x7f10500ced80 2024-04-26T20:58:05.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.980+0000 7f1055400640 1 -- 172.21.15.138:0/949603082 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10500c8140 con 0x7f10500ced80 2024-04-26T20:58:05.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.984+0000 7f1055400640 1 -- 172.21.15.138:0/949603082 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1050069510 con 0x7f10500ced80 2024-04-26T20:58:05.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.984+0000 7f1047400640 1 -- 172.21.15.138:0/949603082 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f104001a070 con 0x7f10500ced80 2024-04-26T20:58:05.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.984+0000 7f1047400640 1 --2- 172.21.15.138:0/949603082 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f102c068380 0x7f102c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:05.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.984+0000 7f1047400640 1 -- 172.21.15.138:0/949603082 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f1040086a70 con 0x7f10500ced80 2024-04-26T20:58:05.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.984+0000 7f1045e00640 1 --2- 172.21.15.138:0/949603082 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f102c068380 0x7f102c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:05.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.984+0000 7f1045e00640 1 --2- 172.21.15.138:0/949603082 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f102c068380 0x7f102c06a840 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f10500b70f0 tx=0x7f1038009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:05.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:05.988+0000 7f1047400640 1 -- 172.21.15.138:0/949603082 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f10400567b0 con 0x7f10500ced80 2024-04-26T20:58:06.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.156+0000 7f1055400640 1 -- 172.21.15.138:0/949603082 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f10500d33b0 con 0x7f10500ced80 2024-04-26T20:58:06.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.156+0000 7f1047400640 1 -- 172.21.15.138:0/949603082 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v41) ==== 80+0+0 (secure 0 0 0) 0x7f104005aab0 con 0x7f10500ced80 2024-04-26T20:58:06.159 INFO:teuthology.orchestra.run.smithi138.stderr:listed 0 entries 2024-04-26T20:58:06.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.160+0000 7f1055400640 1 -- 172.21.15.138:0/949603082 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f102c068380 msgr2=0x7f102c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:06.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.160+0000 7f1055400640 1 --2- 172.21.15.138:0/949603082 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f102c068380 0x7f102c06a840 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f10500b70f0 tx=0x7f1038009040 comp rx=0 tx=0).stop 2024-04-26T20:58:06.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.160+0000 7f1055400640 1 -- 172.21.15.138:0/949603082 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10500ced80 msgr2=0x7f105015cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:06.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.160+0000 7f1055400640 1 --2- 172.21.15.138:0/949603082 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10500ced80 0x7f105015cef0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f104000ea00 tx=0x7f104000eec0 comp rx=0 tx=0).stop 2024-04-26T20:58:06.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.160+0000 7f1055400640 1 -- 172.21.15.138:0/949603082 shutdown_connections 2024-04-26T20:58:06.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.160+0000 7f1055400640 1 --2- 172.21.15.138:0/949603082 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f102c068380 0x7f102c06a840 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:06.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.160+0000 7f1055400640 1 --2- 172.21.15.138:0/949603082 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f105015f510 0x7f1050161af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:06.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.160+0000 7f1055400640 1 --2- 172.21.15.138:0/949603082 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f105015f130 0x7f10500c7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:06.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.160+0000 7f1055400640 1 --2- 172.21.15.138:0/949603082 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10500ced80 0x7f105015cef0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:06.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.160+0000 7f1055400640 1 -- 172.21.15.138:0/949603082 >> 172.21.15.138:0/949603082 conn(0x7f10500d2d80 msgr2=0x7f1050070180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:06.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.160+0000 7f1055400640 1 -- 172.21.15.138:0/949603082 shutdown_connections 2024-04-26T20:58:06.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.160+0000 7f1055400640 1 -- 172.21.15.138:0/949603082 wait complete. 2024-04-26T20:58:06.182 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-26T20:58:06.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:58:06.182 DEBUG:teuthology.orchestra.run.smithi138:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-26T20:58:06.233 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi138.front.sepia.ceph.com 2024-04-26T20:58:06.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:58:06.233 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T20:58:06.250 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:58:06.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.424+0000 7f2153600640 1 Processor -- start 2024-04-26T20:58:06.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.424+0000 7f2153600640 1 -- start start 2024-04-26T20:58:06.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.428+0000 7f2153600640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f214c15cf80 0x7f214c073b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:06.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.428+0000 7f2153600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f214c0cc1e0 0x7f214c0ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:06.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.428+0000 7f2153600640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f214c0727f0 con 0x7f214c0cbe00 2024-04-26T20:58:06.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.428+0000 7f2153600640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f214c073680 con 0x7f214c15cf80 2024-04-26T20:58:06.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.428+0000 7f2153600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f214c072a70 con 0x7f214c0cc1e0 2024-04-26T20:58:06.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.428+0000 7f2150c00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f214c0cbe00 0x7f214c06de70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:44384/0 (socket says 172.21.15.138:44384) 2024-04-26T20:58:06.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.428+0000 7f2150c00640 1 -- 172.21.15.138:0/1144275043 learned_addr learned my addr 172.21.15.138:0/1144275043 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:06.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.428+0000 7f2151600640 1 --2- 172.21.15.138:0/1144275043 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f214c0cc1e0 0x7f214c0ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:06.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.428+0000 7f214be00640 1 --2- 172.21.15.138:0/1144275043 >> v2:172.21.15.143:3300/0 conn(0x7f214c15cf80 0x7f214c073b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:06.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.428+0000 7f214b400640 1 -- 172.21.15.138:0/1144275043 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1090831648 0 0) 0x7f213c001120 con 0x7f214c0cbe00 2024-04-26T20:58:06.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.428+0000 7f214b400640 1 -- 172.21.15.138:0/1144275043 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2130003530 con 0x7f214c0cbe00 2024-04-26T20:58:06.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.428+0000 7f214b400640 1 -- 172.21.15.138:0/1144275043 <== mon.0 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2106330022 0 0) 0x7f2130003530 con 0x7f214c0cbe00 2024-04-26T20:58:06.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.428+0000 7f214b400640 1 -- 172.21.15.138:0/1144275043 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f214c0cc1e0 msgr2=0x7f214c0ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:06.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.428+0000 7f214b400640 1 --2- 172.21.15.138:0/1144275043 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f214c0cc1e0 0x7f214c0ce6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:06.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.428+0000 7f214b400640 1 -- 172.21.15.138:0/1144275043 >> v2:172.21.15.143:3300/0 conn(0x7f214c15cf80 msgr2=0x7f214c073b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:06.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.428+0000 7f214b400640 1 --2- 172.21.15.138:0/1144275043 >> v2:172.21.15.143:3300/0 conn(0x7f214c15cf80 0x7f214c073b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:06.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.428+0000 7f214b400640 1 -- 172.21.15.138:0/1144275043 --> v1:172.21.15.138:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f214c072d50 con 0x7f214c0cbe00 2024-04-26T20:58:06.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.428+0000 7f214b400640 1 -- 172.21.15.138:0/1144275043 <== mon.0 v1:172.21.15.138:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2715389689 0 0) 0x7f213c001850 con 0x7f214c0cbe00 2024-04-26T20:58:06.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.428+0000 7f214b400640 1 -- 172.21.15.138:0/1144275043 >> v1:172.21.15.138:6789/0 conn(0x7f214c0cbe00 legacy=0x7f214c06de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:06.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.428+0000 7f214b400640 1 --2- 172.21.15.138:0/1144275043 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f214c0cc1e0 0x7f21300039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:06.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.428+0000 7f214b400640 1 --2- 172.21.15.138:0/1144275043 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2130003f40 0x7f2130004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:06.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.428+0000 7f214b400640 1 --2- 172.21.15.138:0/1144275043 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2130004d50 0x7f21300051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:06.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.428+0000 7f214b400640 1 -- 172.21.15.138:0/1144275043 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f214c073680 con 0x7f2130004d50 2024-04-26T20:58:06.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.428+0000 7f214b400640 1 -- 172.21.15.138:0/1144275043 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f214c072a70 con 0x7f2130003f40 2024-04-26T20:58:06.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.428+0000 7f214b400640 1 -- 172.21.15.138:0/1144275043 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f213000b9d0 con 0x7f214c0cc1e0 2024-04-26T20:58:06.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.428+0000 7f2151600640 1 --2- 172.21.15.138:0/1144275043 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2130004d50 0x7f21300051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:06.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.428+0000 7f2150c00640 1 --2- 172.21.15.138:0/1144275043 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f214c0cc1e0 0x7f21300039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:06.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.428+0000 7f214be00640 1 --2- 172.21.15.138:0/1144275043 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2130003f40 0x7f2130004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:06.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.428+0000 7f2151600640 1 -- 172.21.15.138:0/1144275043 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f214c0cc1e0 msgr2=0x7f21300039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:06.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.428+0000 7f2151600640 1 --2- 172.21.15.138:0/1144275043 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f214c0cc1e0 0x7f21300039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:06.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.428+0000 7f2151600640 1 -- 172.21.15.138:0/1144275043 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2130003f40 msgr2=0x7f2130004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:06.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.428+0000 7f2151600640 1 --2- 172.21.15.138:0/1144275043 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2130003f40 0x7f2130004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:06.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.428+0000 7f2151600640 1 -- 172.21.15.138:0/1144275043 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2130003530 con 0x7f2130004d50 2024-04-26T20:58:06.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.432+0000 7f2151600640 1 --2- 172.21.15.138:0/1144275043 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2130004d50 0x7f21300051d0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f2144009fc0 tx=0x7f214401cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ed93ffb168b9917 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:06.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.432+0000 7f214b400640 1 -- 172.21.15.138:0/1144275043 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21440b2070 con 0x7f2130004d50 2024-04-26T20:58:06.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.432+0000 7f214b400640 1 -- 172.21.15.138:0/1144275043 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21440a5c90 con 0x7f2130004d50 2024-04-26T20:58:06.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.432+0000 7f214b400640 1 -- 172.21.15.138:0/1144275043 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2144009c10 con 0x7f2130004d50 2024-04-26T20:58:06.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.432+0000 7f2153600640 1 -- 172.21.15.138:0/1144275043 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2130004d50 msgr2=0x7f21300051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:06.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.432+0000 7f2153600640 1 --2- 172.21.15.138:0/1144275043 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2130004d50 0x7f21300051d0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f2144009fc0 tx=0x7f214401cc20 comp rx=0 tx=0).stop 2024-04-26T20:58:06.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.432+0000 7f2151600640 1 -- 172.21.15.138:0/1144275043 reap_dead start 2024-04-26T20:58:06.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.432+0000 7f2153600640 1 -- 172.21.15.138:0/1144275043 shutdown_connections 2024-04-26T20:58:06.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.432+0000 7f2153600640 1 -- 172.21.15.138:0/1144275043 >> 172.21.15.138:0/1144275043 conn(0x7f214c0d0b20 msgr2=0x7f214c0d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:06.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.432+0000 7f2153600640 1 -- 172.21.15.138:0/1144275043 shutdown_connections 2024-04-26T20:58:06.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.432+0000 7f2153600640 1 -- 172.21.15.138:0/1144275043 wait complete. 2024-04-26T20:58:06.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.436+0000 7f2153600640 1 Processor -- start 2024-04-26T20:58:06.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.436+0000 7f2153600640 1 -- start start 2024-04-26T20:58:06.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.436+0000 7f2153600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2130004d50 0x7f214c14fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:06.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.436+0000 7f2153600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f214c1510e0 0x7f214c156c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:06.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.436+0000 7f2153600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f214c1532d0 0x7f214c153780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:06.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.436+0000 7f2153600640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f214c074050 con 0x7f214c1532d0 2024-04-26T20:58:06.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.436+0000 7f2153600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f214c073310 con 0x7f2130004d50 2024-04-26T20:58:06.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.436+0000 7f2153600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f214c0741d0 con 0x7f214c1510e0 2024-04-26T20:58:06.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.436+0000 7f2151600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f214c1532d0 0x7f214c153780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:06.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.436+0000 7f2151600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f214c1532d0 0x7f214c153780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:59060/0 (socket says 172.21.15.138:59060) 2024-04-26T20:58:06.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.436+0000 7f2151600640 1 -- 172.21.15.138:0/3940557240 learned_addr learned my addr 172.21.15.138:0/3940557240 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:06.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.436+0000 7f2150c00640 1 --2- 172.21.15.138:0/3940557240 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2130004d50 0x7f214c14fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:06.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.436+0000 7f214be00640 1 --2- 172.21.15.138:0/3940557240 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f214c1510e0 0x7f214c156c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:06.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.436+0000 7f2151600640 1 -- 172.21.15.138:0/3940557240 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f214c1510e0 msgr2=0x7f214c156c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:06.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.436+0000 7f2151600640 1 --2- 172.21.15.138:0/3940557240 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f214c1510e0 0x7f214c156c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:06.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.436+0000 7f2151600640 1 -- 172.21.15.138:0/3940557240 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2130004d50 msgr2=0x7f214c14fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:06.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.436+0000 7f2151600640 1 --2- 172.21.15.138:0/3940557240 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2130004d50 0x7f214c14fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:06.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.436+0000 7f2151600640 1 -- 172.21.15.138:0/3940557240 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f214c151650 con 0x7f214c1532d0 2024-04-26T20:58:06.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.436+0000 7f2151600640 1 --2- 172.21.15.138:0/3940557240 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f214c1532d0 0x7f214c153780 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f2144002240 tx=0x7f2144009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:06.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.436+0000 7f2148c00640 1 -- 172.21.15.138:0/3940557240 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21440bd070 con 0x7f214c1532d0 2024-04-26T20:58:06.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.436+0000 7f2148c00640 1 -- 172.21.15.138:0/3940557240 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21440a5a90 con 0x7f214c1532d0 2024-04-26T20:58:06.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.436+0000 7f2153600640 1 -- 172.21.15.138:0/3940557240 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f214c151930 con 0x7f214c1532d0 2024-04-26T20:58:06.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.436+0000 7f2148c00640 1 -- 172.21.15.138:0/3940557240 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21440b2040 con 0x7f214c1532d0 2024-04-26T20:58:06.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.436+0000 7f2153600640 1 -- 172.21.15.138:0/3940557240 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f214c153cc0 con 0x7f214c1532d0 2024-04-26T20:58:06.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.436+0000 7f2153600640 1 -- 172.21.15.138:0/3940557240 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f214c069510 con 0x7f214c1532d0 2024-04-26T20:58:06.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.440+0000 7f2148c00640 1 -- 172.21.15.138:0/3940557240 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f21440039a0 con 0x7f214c1532d0 2024-04-26T20:58:06.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.440+0000 7f2148c00640 1 --2- 172.21.15.138:0/3940557240 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f212c068350 0x7f212c06a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:06.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.440+0000 7f2148c00640 1 -- 172.21.15.138:0/3940557240 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f21441208f0 con 0x7f214c1532d0 2024-04-26T20:58:06.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.440+0000 7f2150c00640 1 --2- 172.21.15.138:0/3940557240 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f212c068350 0x7f212c06a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:06.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.440+0000 7f2150c00640 1 --2- 172.21.15.138:0/3940557240 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f212c068350 0x7f212c06a810 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f213c007fd0 tx=0x7f213c007b10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:06.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.444+0000 7f2148c00640 1 -- 172.21.15.138:0/3940557240 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2144016990 con 0x7f214c1532d0 2024-04-26T20:58:06.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.636+0000 7f2153600640 1 -- 172.21.15.138:0/3940557240 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f214c15b990 con 0x7f214c1532d0 2024-04-26T20:58:06.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.636+0000 7f2148c00640 1 -- 172.21.15.138:0/3940557240 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5187 (secure 0 0 0) 0x7f21440f06c0 con 0x7f214c1532d0 2024-04-26T20:58:06.636 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:06.637 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5158,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/593330829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":593330829},{"type":"v1","addr":"172.21.15.143:6837","nonce":593330829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5304,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/3236230135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":3236230135},{"type":"v1","addr":"172.21.15.138:6834","nonce":3236230135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5307,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/3539747566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":3539747566},{"type":"v1","addr":"172.21.15.138:6835","nonce":3539747566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:57:51.937789+0000","modified":"2024-04-26T20:57:54.956885+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5310},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5310":{"gid":5310,"name":"d","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6836/483370849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":483370849},{"type":"v1","addr":"172.21.15.143:6836","nonce":483370849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5310,"qdb_cluster":[5310]},"id":2}]} 2024-04-26T20:58:06.637 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 18 2024-04-26T20:58:06.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.636+0000 7f2153600640 1 -- 172.21.15.138:0/3940557240 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f212c068350 msgr2=0x7f212c06a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:06.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.636+0000 7f2153600640 1 --2- 172.21.15.138:0/3940557240 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f212c068350 0x7f212c06a810 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f213c007fd0 tx=0x7f213c007b10 comp rx=0 tx=0).stop 2024-04-26T20:58:06.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.636+0000 7f2153600640 1 -- 172.21.15.138:0/3940557240 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f214c1532d0 msgr2=0x7f214c153780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:06.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.636+0000 7f2153600640 1 --2- 172.21.15.138:0/3940557240 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f214c1532d0 0x7f214c153780 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f2144002240 tx=0x7f2144009750 comp rx=0 tx=0).stop 2024-04-26T20:58:06.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.636+0000 7f2153600640 1 -- 172.21.15.138:0/3940557240 shutdown_connections 2024-04-26T20:58:06.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.636+0000 7f2153600640 1 --2- 172.21.15.138:0/3940557240 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f212c068350 0x7f212c06a810 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:06.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.636+0000 7f2153600640 1 --2- 172.21.15.138:0/3940557240 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f214c1532d0 0x7f214c153780 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:06.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.636+0000 7f2153600640 1 --2- 172.21.15.138:0/3940557240 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f214c1510e0 0x7f214c156c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:06.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.636+0000 7f2153600640 1 --2- 172.21.15.138:0/3940557240 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2130004d50 0x7f214c14fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:06.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.636+0000 7f2153600640 1 -- 172.21.15.138:0/3940557240 >> 172.21.15.138:0/3940557240 conn(0x7f214c0d0b20 msgr2=0x7f214c0cdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:06.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.636+0000 7f2153600640 1 -- 172.21.15.138:0/3940557240 shutdown_connections 2024-04-26T20:58:06.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.636+0000 7f2153600640 1 -- 172.21.15.138:0/3940557240 wait complete. 2024-04-26T20:58:06.658 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json flush journal 2024-04-26T20:58:06.835 INFO:teuthology.orchestra.run.smithi143.stdout:{"message":"","return_code":0} 2024-04-26T20:58:06.836 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-26T20:58:06.836 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-26T20:58:06.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.972+0000 7f7af2200640 1 Processor -- start 2024-04-26T20:58:06.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.972+0000 7f7af2200640 1 -- start start 2024-04-26T20:58:06.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.972+0000 7f7af2200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7aec0b8890 0x7f7aec15e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:06.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.972+0000 7f7af2200640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7aec15f300 0x7f7aec0d16d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:06.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.972+0000 7f7af2200640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7aec15f790 con 0x7f7aec15eea0 2024-04-26T20:58:06.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.972+0000 7f7af2200640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f7aec0cec40 con 0x7f7aec15f300 2024-04-26T20:58:06.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.972+0000 7f7af2200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f7aec0d00e0 con 0x7f7aec0b8890 2024-04-26T20:58:06.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.976+0000 7f7aeb400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7aec0b8890 0x7f7aec15e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:06.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.976+0000 7f7aebe00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7aec15f300 0x7f7aec0d16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:06.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.976+0000 7f7aeb400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7aec0b8890 0x7f7aec15e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.138:49078/0 (socket says 172.21.15.138:49078) 2024-04-26T20:58:06.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.976+0000 7f7aebe00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7aec15f300 0x7f7aec0d16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.138:57058/0 (socket says 172.21.15.138:57058) 2024-04-26T20:58:06.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.976+0000 7f7aeb400640 1 -- 172.21.15.138:0/3446020460 learned_addr learned my addr 172.21.15.138:0/3446020460 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:06.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.976+0000 7f7aeb400640 1 -- 172.21.15.138:0/3446020460 >> v2:172.21.15.143:3300/0 conn(0x7f7aec15f300 msgr2=0x7f7aec0d16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:06.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.976+0000 7f7aeb400640 1 --2- 172.21.15.138:0/3446020460 >> v2:172.21.15.143:3300/0 conn(0x7f7aec15f300 0x7f7aec0d16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:06.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.976+0000 7f7aeb400640 1 -- 172.21.15.138:0/3446020460 >> v1:172.21.15.143:6789/0 conn(0x7f7aec15eea0 legacy=0x7f7aec0d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:06.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.976+0000 7f7aeb400640 1 -- 172.21.15.138:0/3446020460 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aec0cdd50 con 0x7f7aec0b8890 2024-04-26T20:58:06.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.976+0000 7f7aebe00640 1 --2- 172.21.15.138:0/3446020460 >> v2:172.21.15.143:3300/0 conn(0x7f7aec15f300 0x7f7aec0d16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:58:06.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.976+0000 7f7aeb400640 1 --2- 172.21.15.138:0/3446020460 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7aec0b8890 0x7f7aec15e960 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7adc009e50 tx=0x7f7adc01ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5d9cfcae64e6df0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:06.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.980+0000 7f7aeaa00640 1 -- 172.21.15.138:0/3446020460 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7adc0a57f0 con 0x7f7aec0b8890 2024-04-26T20:58:06.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.980+0000 7f7aeaa00640 1 -- 172.21.15.138:0/3446020460 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7adc0a5990 con 0x7f7aec0b8890 2024-04-26T20:58:06.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.980+0000 7f7aeaa00640 1 -- 172.21.15.138:0/3446020460 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7adc0a5d60 con 0x7f7aec0b8890 2024-04-26T20:58:06.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.980+0000 7f7af2200640 1 -- 172.21.15.138:0/3446020460 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7aec0b8890 msgr2=0x7f7aec15e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:06.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.980+0000 7f7af2200640 1 --2- 172.21.15.138:0/3446020460 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7aec0b8890 0x7f7aec15e960 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7adc009e50 tx=0x7f7adc01ca30 comp rx=0 tx=0).stop 2024-04-26T20:58:06.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.980+0000 7f7af2200640 1 -- 172.21.15.138:0/3446020460 shutdown_connections 2024-04-26T20:58:06.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.980+0000 7f7af2200640 1 --2- 172.21.15.138:0/3446020460 >> v2:172.21.15.143:3300/0 conn(0x7f7aec15f300 0x7f7aec0d16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:06.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.980+0000 7f7af2200640 1 --2- 172.21.15.138:0/3446020460 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7aec0b8890 0x7f7aec15e960 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:06.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.980+0000 7f7af2200640 1 -- 172.21.15.138:0/3446020460 >> 172.21.15.138:0/3446020460 conn(0x7f7aec0d2cf0 msgr2=0x7f7aec0d3100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:06.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.980+0000 7f7af2200640 1 -- 172.21.15.138:0/3446020460 shutdown_connections 2024-04-26T20:58:06.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.980+0000 7f7af2200640 1 -- 172.21.15.138:0/3446020460 wait complete. 2024-04-26T20:58:06.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.980+0000 7f7af2200640 1 Processor -- start 2024-04-26T20:58:06.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.980+0000 7f7af2200640 1 -- start start 2024-04-26T20:58:06.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.980+0000 7f7af2200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7aec0b8890 0x7f7aec14e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:06.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.980+0000 7f7af2200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7aec15eea0 0x7f7aec14b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:06.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.980+0000 7f7af2200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7aec15f300 0x7f7aec15f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:06.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.980+0000 7f7af2200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f7aec0d3a40 con 0x7f7aec15f300 2024-04-26T20:58:06.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.980+0000 7f7af2200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f7aec0ce8d0 con 0x7f7aec0b8890 2024-04-26T20:58:06.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.980+0000 7f7af2200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f7aec0c8dc0 con 0x7f7aec15eea0 2024-04-26T20:58:06.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.980+0000 7f7aebe00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7aec15f300 0x7f7aec15f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:06.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.984+0000 7f7aeb400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7aec0b8890 0x7f7aec14e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:06.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.984+0000 7f7aebe00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7aec15f300 0x7f7aec15f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:59068/0 (socket says 172.21.15.138:59068) 2024-04-26T20:58:06.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.984+0000 7f7aebe00640 1 -- 172.21.15.138:0/1459729158 learned_addr learned my addr 172.21.15.138:0/1459729158 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:06.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.984+0000 7f7ae2a00640 1 --2- 172.21.15.138:0/1459729158 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7aec15eea0 0x7f7aec14b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:06.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.984+0000 7f7aebe00640 1 -- 172.21.15.138:0/1459729158 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7aec15eea0 msgr2=0x7f7aec14b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:06.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.984+0000 7f7aebe00640 1 --2- 172.21.15.138:0/1459729158 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7aec15eea0 0x7f7aec14b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:06.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.984+0000 7f7aebe00640 1 -- 172.21.15.138:0/1459729158 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7aec0b8890 msgr2=0x7f7aec14e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:06.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.984+0000 7f7aebe00640 1 --2- 172.21.15.138:0/1459729158 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7aec0b8890 0x7f7aec14e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:06.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.984+0000 7f7aebe00640 1 -- 172.21.15.138:0/1459729158 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aec161c90 con 0x7f7aec15f300 2024-04-26T20:58:06.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.984+0000 7f7aebe00640 1 --2- 172.21.15.138:0/1459729158 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7aec15f300 0x7f7aec15f9b0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f7ae400e950 tx=0x7f7ae400ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:06.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.984+0000 7f7ae3e00640 1 -- 172.21.15.138:0/1459729158 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae4017070 con 0x7f7aec15f300 2024-04-26T20:58:06.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.984+0000 7f7ae3e00640 1 -- 172.21.15.138:0/1459729158 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ae400ca00 con 0x7f7aec15f300 2024-04-26T20:58:06.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.984+0000 7f7af2200640 1 -- 172.21.15.138:0/1459729158 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7aec161f70 con 0x7f7aec15f300 2024-04-26T20:58:06.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.984+0000 7f7ae3e00640 1 -- 172.21.15.138:0/1459729158 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae400cdd0 con 0x7f7aec15f300 2024-04-26T20:58:06.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.984+0000 7f7af2200640 1 -- 172.21.15.138:0/1459729158 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7aec14bd70 con 0x7f7aec15f300 2024-04-26T20:58:06.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.984+0000 7f7af2200640 1 -- 172.21.15.138:0/1459729158 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7aec069510 con 0x7f7aec15f300 2024-04-26T20:58:06.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.984+0000 7f7ae3e00640 1 -- 172.21.15.138:0/1459729158 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7ae4013470 con 0x7f7aec15f300 2024-04-26T20:58:06.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.984+0000 7f7ae3e00640 1 --2- 172.21.15.138:0/1459729158 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7ac8068380 0x7f7ac806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:06.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.984+0000 7f7ae3e00640 1 -- 172.21.15.138:0/1459729158 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f7ae40869f0 con 0x7f7aec15f300 2024-04-26T20:58:06.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.988+0000 7f7aeb400640 1 --2- 172.21.15.138:0/1459729158 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7ac8068380 0x7f7ac806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:06.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.988+0000 7f7aeb400640 1 --2- 172.21.15.138:0/1459729158 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7ac8068380 0x7f7ac806a840 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7adc0ae000 tx=0x7f7adc0a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:06.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:06.988+0000 7f7ae3e00640 1 -- 172.21.15.138:0/1459729158 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7ae40567c0 con 0x7f7aec15f300 2024-04-26T20:58:07.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.180+0000 7f7af2200640 1 -- 172.21.15.138:0/1459729158 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f7aec0750a0 con 0x7f7aec15f300 2024-04-26T20:58:07.183 INFO:tasks.ceph.mon.a.smithi138.stderr:2024-04-26T20:58:07.180+0000 7f20de400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T20:58:07.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.184+0000 7f7ae3e00640 1 -- 172.21.15.138:0/1459729158 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) ==== 161+0+0 (secure 0 0 0) 0x7f7ae405aac0 con 0x7f7aec15f300 2024-04-26T20:58:07.185 INFO:teuthology.orchestra.run.smithi138.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T20:58:07.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.184+0000 7f7af2200640 1 -- 172.21.15.138:0/1459729158 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7ac8068380 msgr2=0x7f7ac806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:07.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.184+0000 7f7af2200640 1 --2- 172.21.15.138:0/1459729158 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7ac8068380 0x7f7ac806a840 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7adc0ae000 tx=0x7f7adc0a7070 comp rx=0 tx=0).stop 2024-04-26T20:58:07.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.184+0000 7f7af2200640 1 -- 172.21.15.138:0/1459729158 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7aec15f300 msgr2=0x7f7aec15f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:07.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.184+0000 7f7af2200640 1 --2- 172.21.15.138:0/1459729158 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7aec15f300 0x7f7aec15f9b0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f7ae400e950 tx=0x7f7ae400ee10 comp rx=0 tx=0).stop 2024-04-26T20:58:07.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.188+0000 7f7af2200640 1 -- 172.21.15.138:0/1459729158 shutdown_connections 2024-04-26T20:58:07.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.188+0000 7f7af2200640 1 --2- 172.21.15.138:0/1459729158 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7ac8068380 0x7f7ac806a840 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:07.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.188+0000 7f7af2200640 1 --2- 172.21.15.138:0/1459729158 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7aec15f300 0x7f7aec15f9b0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:07.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.188+0000 7f7af2200640 1 --2- 172.21.15.138:0/1459729158 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7aec15eea0 0x7f7aec14b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:07.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.188+0000 7f7af2200640 1 --2- 172.21.15.138:0/1459729158 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7aec0b8890 0x7f7aec14e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:07.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.188+0000 7f7af2200640 1 -- 172.21.15.138:0/1459729158 >> 172.21.15.138:0/1459729158 conn(0x7f7aec0d2cf0 msgr2=0x7f7aec0b4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:07.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.188+0000 7f7af2200640 1 -- 172.21.15.138:0/1459729158 shutdown_connections 2024-04-26T20:58:07.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.188+0000 7f7af2200640 1 -- 172.21.15.138:0/1459729158 wait complete. 2024-04-26T20:58:07.196 INFO:tasks.ceph.mds.d.smithi143.stderr: -4499> 2024-04-26T20:57:56.529+0000 7f695f000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T20:58:07.208 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T20:58:07.211 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T20:58:07.246 INFO:tasks.ceph.mds.d.smithi143.stdout:starting mds.d at 2024-04-26T20:58:07.252 INFO:teuthology.orchestra.run.smithi138.stdout:[global] 2024-04-26T20:58:07.252 INFO:teuthology.orchestra.run.smithi138.stdout: chdir = "" 2024-04-26T20:58:07.252 INFO:teuthology.orchestra.run.smithi138.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T20:58:07.252 INFO:teuthology.orchestra.run.smithi138.stdout: auth supported = cephx 2024-04-26T20:58:07.252 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.252 INFO:teuthology.orchestra.run.smithi138.stdout: filestore xattr use omap = true 2024-04-26T20:58:07.252 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.252 INFO:teuthology.orchestra.run.smithi138.stdout: mon clock drift allowed = 1.000 2024-04-26T20:58:07.253 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.253 INFO:teuthology.orchestra.run.smithi138.stdout: osd crush chooseleaf type = 0 2024-04-26T20:58:07.253 INFO:teuthology.orchestra.run.smithi138.stdout: auth debug = true 2024-04-26T20:58:07.253 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.253 INFO:teuthology.orchestra.run.smithi138.stdout: ms die on old message = true 2024-04-26T20:58:07.253 INFO:teuthology.orchestra.run.smithi138.stdout: ms die on bug = true 2024-04-26T20:58:07.253 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.253 INFO:teuthology.orchestra.run.smithi138.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T20:58:07.253 INFO:teuthology.orchestra.run.smithi138.stdout: mon pg warn max object skew = 0 2024-04-26T20:58:07.253 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.253 INFO:teuthology.orchestra.run.smithi138.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T20:58:07.253 INFO:teuthology.orchestra.run.smithi138.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T20:58:07.253 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.253 INFO:teuthology.orchestra.run.smithi138.stdout: osd pool default size = 2 2024-04-26T20:58:07.253 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.253 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd allow primary affinity = true 2024-04-26T20:58:07.253 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd allow pg remap = true 2024-04-26T20:58:07.254 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on legacy crush tunables = false 2024-04-26T20:58:07.254 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on crush straw calc version zero = false 2024-04-26T20:58:07.254 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on no sortbitwise = false 2024-04-26T20:58:07.254 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on osd down out interval zero = false 2024-04-26T20:58:07.254 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on too few osds = false 2024-04-26T20:58:07.254 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T20:58:07.254 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T20:58:07.254 INFO:teuthology.orchestra.run.smithi138.stdout: mon_allow_pool_size_one = true 2024-04-26T20:58:07.254 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.255 INFO:teuthology.orchestra.run.smithi138.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T20:58:07.255 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.255 INFO:teuthology.orchestra.run.smithi138.stdout: osd default data pool replay window = 5 2024-04-26T20:58:07.255 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.255 INFO:teuthology.orchestra.run.smithi138.stdout: mon allow pool delete = true 2024-04-26T20:58:07.255 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.255 INFO:teuthology.orchestra.run.smithi138.stdout: mon cluster log file level = debug 2024-04-26T20:58:07.255 INFO:teuthology.orchestra.run.smithi138.stdout: debug asserts on shutdown = true 2024-04-26T20:58:07.255 INFO:teuthology.orchestra.run.smithi138.stdout: mon health detail to clog = false 2024-04-26T20:58:07.255 INFO:teuthology.orchestra.run.smithi138.stdout: mon host = "172.21.15.138,172.21.15.143,[v2:172.21.15.143:3301,v1:172.21.15.143:6790]" 2024-04-26T20:58:07.255 INFO:teuthology.orchestra.run.smithi138.stdout: ms die on skipped message = False 2024-04-26T20:58:07.255 INFO:teuthology.orchestra.run.smithi138.stdout: fsid = c22b4730-12cc-4558-8535-b965384398c0 2024-04-26T20:58:07.255 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.255 INFO:teuthology.orchestra.run.smithi138.stdout:[osd] 2024-04-26T20:58:07.255 INFO:teuthology.orchestra.run.smithi138.stdout: osd journal size = 100 2024-04-26T20:58:07.256 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.256 INFO:teuthology.orchestra.run.smithi138.stdout: osd scrub load threshold = 5.0 2024-04-26T20:58:07.256 INFO:teuthology.orchestra.run.smithi138.stdout: osd scrub max interval = 600 2024-04-26T20:58:07.256 INFO:teuthology.orchestra.run.smithi138.stdout: osd mclock profile = high_recovery_ops 2024-04-26T20:58:07.256 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.256 INFO:teuthology.orchestra.run.smithi138.stdout: osd recover clone overlap = true 2024-04-26T20:58:07.256 INFO:teuthology.orchestra.run.smithi138.stdout: osd recovery max chunk = 1048576 2024-04-26T20:58:07.256 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.256 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug shutdown = true 2024-04-26T20:58:07.256 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug op order = true 2024-04-26T20:58:07.256 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug verify stray on activate = true 2024-04-26T20:58:07.256 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug trim objects = true 2024-04-26T20:58:07.257 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.257 INFO:teuthology.orchestra.run.smithi138.stdout: osd open classes on start = true 2024-04-26T20:58:07.257 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug pg log writeout = true 2024-04-26T20:58:07.257 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.257 INFO:teuthology.orchestra.run.smithi138.stdout: osd deep scrub update digest min age = 30 2024-04-26T20:58:07.257 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.257 INFO:teuthology.orchestra.run.smithi138.stdout: osd map max advance = 10 2024-04-26T20:58:07.257 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.257 INFO:teuthology.orchestra.run.smithi138.stdout: journal zero on create = true 2024-04-26T20:58:07.257 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.257 INFO:teuthology.orchestra.run.smithi138.stdout: filestore ondisk finisher threads = 3 2024-04-26T20:58:07.257 INFO:teuthology.orchestra.run.smithi138.stdout: filestore apply finisher threads = 3 2024-04-26T20:58:07.257 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.257 INFO:teuthology.orchestra.run.smithi138.stdout: bdev debug aio = true 2024-04-26T20:58:07.258 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug misdirected ops = true 2024-04-26T20:58:07.258 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore block size = 96636764160 2024-04-26T20:58:07.258 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore fsck on mount = True 2024-04-26T20:58:07.258 INFO:teuthology.orchestra.run.smithi138.stdout: debug bluefs = 20 2024-04-26T20:58:07.258 INFO:teuthology.orchestra.run.smithi138.stdout: debug bluestore = 20 2024-04-26T20:58:07.258 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2024-04-26T20:58:07.258 INFO:teuthology.orchestra.run.smithi138.stdout: debug osd = 20 2024-04-26T20:58:07.258 INFO:teuthology.orchestra.run.smithi138.stdout: debug rocksdb = 10 2024-04-26T20:58:07.258 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T20:58:07.258 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd full ratio = 0.9 2024-04-26T20:58:07.259 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd nearfull ratio = 0.8 2024-04-26T20:58:07.259 INFO:teuthology.orchestra.run.smithi138.stdout: osd failsafe full ratio = 0.95 2024-04-26T20:58:07.259 INFO:teuthology.orchestra.run.smithi138.stdout: osd objectstore = bluestore 2024-04-26T20:58:07.259 INFO:teuthology.orchestra.run.smithi138.stdout: osd op complaint time = 180 2024-04-26T20:58:07.259 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.259 INFO:teuthology.orchestra.run.smithi138.stdout:[mgr] 2024-04-26T20:58:07.259 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2024-04-26T20:58:07.259 INFO:teuthology.orchestra.run.smithi138.stdout: debug mgr = 20 2024-04-26T20:58:07.259 INFO:teuthology.orchestra.run.smithi138.stdout: debug mon = 20 2024-04-26T20:58:07.259 INFO:teuthology.orchestra.run.smithi138.stdout: debug auth = 20 2024-04-26T20:58:07.259 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min pgs per osd = 4 2024-04-26T20:58:07.259 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min bytes per osd = 10 2024-04-26T20:58:07.259 INFO:teuthology.orchestra.run.smithi138.stdout: mgr/telemetry/nag = false 2024-04-26T20:58:07.259 INFO:teuthology.orchestra.run.smithi138.stdout: debug client = 20 2024-04-26T20:58:07.260 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.260 INFO:teuthology.orchestra.run.smithi138.stdout:[mon] 2024-04-26T20:58:07.260 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2024-04-26T20:58:07.260 INFO:teuthology.orchestra.run.smithi138.stdout: debug mon = 20 2024-04-26T20:58:07.260 INFO:teuthology.orchestra.run.smithi138.stdout: debug paxos = 20 2024-04-26T20:58:07.260 INFO:teuthology.orchestra.run.smithi138.stdout: debug auth = 20 2024-04-26T20:58:07.260 INFO:teuthology.orchestra.run.smithi138.stdout: mon data avail warn = 5 2024-04-26T20:58:07.260 INFO:teuthology.orchestra.run.smithi138.stdout: mon mgr mkfs grace = 240 2024-04-26T20:58:07.260 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min pgs per osd = 4 2024-04-26T20:58:07.260 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd reporter subtree level = osd 2024-04-26T20:58:07.260 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd prime pg temp = true 2024-04-26T20:58:07.261 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min bytes per osd = 10 2024-04-26T20:58:07.261 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.261 INFO:teuthology.orchestra.run.smithi138.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T20:58:07.261 INFO:teuthology.orchestra.run.smithi138.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T20:58:07.261 INFO:teuthology.orchestra.run.smithi138.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T20:58:07.261 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.261 INFO:teuthology.orchestra.run.smithi138.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T20:58:07.261 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T20:58:07.261 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T20:58:07.261 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.261 INFO:teuthology.orchestra.run.smithi138.stdout: # 1m isn't quite enough 2024-04-26T20:58:07.262 INFO:teuthology.orchestra.run.smithi138.stdout: mon_down_mkfs_grace = 2m 2024-04-26T20:58:07.262 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.262 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_filestore_osds = false 2024-04-26T20:58:07.262 INFO:teuthology.orchestra.run.smithi138.stdout: mon down mkfs grace = 300 2024-04-26T20:58:07.262 INFO:teuthology.orchestra.run.smithi138.stdout: mon op complaint time = 120 2024-04-26T20:58:07.262 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.262 INFO:teuthology.orchestra.run.smithi138.stdout:[client] 2024-04-26T20:58:07.262 INFO:teuthology.orchestra.run.smithi138.stdout: rgw cache enabled = true 2024-04-26T20:58:07.262 INFO:teuthology.orchestra.run.smithi138.stdout: rgw enable ops log = true 2024-04-26T20:58:07.262 INFO:teuthology.orchestra.run.smithi138.stdout: rgw enable usage log = true 2024-04-26T20:58:07.262 INFO:teuthology.orchestra.run.smithi138.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T20:58:07.263 INFO:teuthology.orchestra.run.smithi138.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T20:58:07.263 INFO:teuthology.orchestra.run.smithi138.stdout: client mount timeout = 600 2024-04-26T20:58:07.263 INFO:teuthology.orchestra.run.smithi138.stdout: debug client = 20 2024-04-26T20:58:07.263 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2024-04-26T20:58:07.263 INFO:teuthology.orchestra.run.smithi138.stdout: pid file = "" 2024-04-26T20:58:07.263 INFO:teuthology.orchestra.run.smithi138.stdout: rados mon op timeout = 900 2024-04-26T20:58:07.263 INFO:teuthology.orchestra.run.smithi138.stdout: rados osd op timeout = 900 2024-04-26T20:58:07.263 INFO:teuthology.orchestra.run.smithi138.stdout:[mon.a] 2024-04-26T20:58:07.263 INFO:teuthology.orchestra.run.smithi138.stdout:[mon.b] 2024-04-26T20:58:07.263 INFO:teuthology.orchestra.run.smithi138.stdout:[mon.c] 2024-04-26T20:58:07.263 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.a] 2024-04-26T20:58:07.263 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.c] 2024-04-26T20:58:07.263 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.b] 2024-04-26T20:58:07.263 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.d] 2024-04-26T20:58:07.264 INFO:teuthology.orchestra.run.smithi138.stdout:[mds] 2024-04-26T20:58:07.264 INFO:teuthology.orchestra.run.smithi138.stdout: debug mds = 20 2024-04-26T20:58:07.264 INFO:teuthology.orchestra.run.smithi138.stdout: debug mds balancer = 20 2024-04-26T20:58:07.264 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2024-04-26T20:58:07.264 INFO:teuthology.orchestra.run.smithi138.stdout: mds debug frag = True 2024-04-26T20:58:07.264 INFO:teuthology.orchestra.run.smithi138.stdout: mds debug scatterstat = True 2024-04-26T20:58:07.264 INFO:teuthology.orchestra.run.smithi138.stdout: mds op complaint time = 180 2024-04-26T20:58:07.264 INFO:teuthology.orchestra.run.smithi138.stdout: mds verify scatter = False 2024-04-26T20:58:07.264 INFO:teuthology.orchestra.run.smithi138.stdout: osd op complaint time = 180 2024-04-26T20:58:07.264 INFO:teuthology.orchestra.run.smithi138.stdout: rados mon op timeout = 900 2024-04-26T20:58:07.264 INFO:teuthology.orchestra.run.smithi138.stdout: rados osd op timeout = 900 2024-04-26T20:58:07.265 INFO:teuthology.orchestra.run.smithi143.stdout:[global] 2024-04-26T20:58:07.265 INFO:teuthology.orchestra.run.smithi143.stdout: chdir = "" 2024-04-26T20:58:07.265 INFO:teuthology.orchestra.run.smithi143.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T20:58:07.265 INFO:teuthology.orchestra.run.smithi143.stdout: auth supported = cephx 2024-04-26T20:58:07.265 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.265 INFO:teuthology.orchestra.run.smithi143.stdout: filestore xattr use omap = true 2024-04-26T20:58:07.265 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.265 INFO:teuthology.orchestra.run.smithi143.stdout: mon clock drift allowed = 1.000 2024-04-26T20:58:07.265 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.265 INFO:teuthology.orchestra.run.smithi143.stdout: osd crush chooseleaf type = 0 2024-04-26T20:58:07.265 INFO:teuthology.orchestra.run.smithi143.stdout: auth debug = true 2024-04-26T20:58:07.265 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.265 INFO:teuthology.orchestra.run.smithi143.stdout: ms die on old message = true 2024-04-26T20:58:07.265 INFO:teuthology.orchestra.run.smithi143.stdout: ms die on bug = true 2024-04-26T20:58:07.265 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.266 INFO:teuthology.orchestra.run.smithi143.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T20:58:07.266 INFO:teuthology.orchestra.run.smithi143.stdout: mon pg warn max object skew = 0 2024-04-26T20:58:07.266 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.266 INFO:teuthology.orchestra.run.smithi143.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T20:58:07.266 INFO:teuthology.orchestra.run.smithi143.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T20:58:07.266 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.266 INFO:teuthology.orchestra.run.smithi143.stdout: osd pool default size = 2 2024-04-26T20:58:07.266 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.266 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd allow primary affinity = true 2024-04-26T20:58:07.266 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd allow pg remap = true 2024-04-26T20:58:07.266 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on legacy crush tunables = false 2024-04-26T20:58:07.266 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on crush straw calc version zero = false 2024-04-26T20:58:07.267 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on no sortbitwise = false 2024-04-26T20:58:07.267 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on osd down out interval zero = false 2024-04-26T20:58:07.267 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on too few osds = false 2024-04-26T20:58:07.267 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T20:58:07.267 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T20:58:07.267 INFO:teuthology.orchestra.run.smithi143.stdout: mon_allow_pool_size_one = true 2024-04-26T20:58:07.267 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.267 INFO:teuthology.orchestra.run.smithi143.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T20:58:07.267 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.267 INFO:teuthology.orchestra.run.smithi143.stdout: osd default data pool replay window = 5 2024-04-26T20:58:07.267 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.268 INFO:teuthology.orchestra.run.smithi143.stdout: mon allow pool delete = true 2024-04-26T20:58:07.268 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.268 INFO:teuthology.orchestra.run.smithi143.stdout: mon cluster log file level = debug 2024-04-26T20:58:07.268 INFO:teuthology.orchestra.run.smithi143.stdout: debug asserts on shutdown = true 2024-04-26T20:58:07.268 INFO:teuthology.orchestra.run.smithi143.stdout: mon health detail to clog = false 2024-04-26T20:58:07.268 INFO:teuthology.orchestra.run.smithi143.stdout: mon host = "172.21.15.138,172.21.15.143,[v2:172.21.15.143:3301,v1:172.21.15.143:6790]" 2024-04-26T20:58:07.268 INFO:teuthology.orchestra.run.smithi143.stdout: ms die on skipped message = False 2024-04-26T20:58:07.268 INFO:teuthology.orchestra.run.smithi143.stdout: fsid = c22b4730-12cc-4558-8535-b965384398c0 2024-04-26T20:58:07.268 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.268 INFO:teuthology.orchestra.run.smithi143.stdout:[osd] 2024-04-26T20:58:07.268 INFO:teuthology.orchestra.run.smithi143.stdout: osd journal size = 100 2024-04-26T20:58:07.268 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.268 INFO:teuthology.orchestra.run.smithi143.stdout: osd scrub load threshold = 5.0 2024-04-26T20:58:07.268 INFO:teuthology.orchestra.run.smithi143.stdout: osd scrub max interval = 600 2024-04-26T20:58:07.268 INFO:teuthology.orchestra.run.smithi143.stdout: osd mclock profile = high_recovery_ops 2024-04-26T20:58:07.269 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.269 INFO:teuthology.orchestra.run.smithi143.stdout: osd recover clone overlap = true 2024-04-26T20:58:07.269 INFO:teuthology.orchestra.run.smithi143.stdout: osd recovery max chunk = 1048576 2024-04-26T20:58:07.269 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.269 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug shutdown = true 2024-04-26T20:58:07.269 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug op order = true 2024-04-26T20:58:07.269 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug verify stray on activate = true 2024-04-26T20:58:07.269 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug trim objects = true 2024-04-26T20:58:07.269 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.269 INFO:teuthology.orchestra.run.smithi143.stdout: osd open classes on start = true 2024-04-26T20:58:07.269 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug pg log writeout = true 2024-04-26T20:58:07.269 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.270 INFO:teuthology.orchestra.run.smithi143.stdout: osd deep scrub update digest min age = 30 2024-04-26T20:58:07.270 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.270 INFO:teuthology.orchestra.run.smithi143.stdout: osd map max advance = 10 2024-04-26T20:58:07.270 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.270 INFO:teuthology.orchestra.run.smithi143.stdout: journal zero on create = true 2024-04-26T20:58:07.270 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.270 INFO:teuthology.orchestra.run.smithi143.stdout: filestore ondisk finisher threads = 3 2024-04-26T20:58:07.270 INFO:teuthology.orchestra.run.smithi143.stdout: filestore apply finisher threads = 3 2024-04-26T20:58:07.270 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.270 INFO:teuthology.orchestra.run.smithi143.stdout: bdev debug aio = true 2024-04-26T20:58:07.270 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug misdirected ops = true 2024-04-26T20:58:07.270 INFO:teuthology.orchestra.run.smithi143.stdout: bluestore block size = 96636764160 2024-04-26T20:58:07.270 INFO:teuthology.orchestra.run.smithi143.stdout: bluestore fsck on mount = True 2024-04-26T20:58:07.270 INFO:teuthology.orchestra.run.smithi143.stdout: debug bluefs = 20 2024-04-26T20:58:07.270 INFO:teuthology.orchestra.run.smithi143.stdout: debug bluestore = 20 2024-04-26T20:58:07.271 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2024-04-26T20:58:07.271 INFO:teuthology.orchestra.run.smithi143.stdout: debug osd = 20 2024-04-26T20:58:07.271 INFO:teuthology.orchestra.run.smithi143.stdout: debug rocksdb = 10 2024-04-26T20:58:07.271 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T20:58:07.271 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd full ratio = 0.9 2024-04-26T20:58:07.271 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd nearfull ratio = 0.8 2024-04-26T20:58:07.271 INFO:teuthology.orchestra.run.smithi143.stdout: osd failsafe full ratio = 0.95 2024-04-26T20:58:07.271 INFO:teuthology.orchestra.run.smithi143.stdout: osd objectstore = bluestore 2024-04-26T20:58:07.271 INFO:teuthology.orchestra.run.smithi143.stdout: osd op complaint time = 180 2024-04-26T20:58:07.271 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.271 INFO:teuthology.orchestra.run.smithi143.stdout:[mgr] 2024-04-26T20:58:07.271 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2024-04-26T20:58:07.271 INFO:teuthology.orchestra.run.smithi143.stdout: debug mgr = 20 2024-04-26T20:58:07.271 INFO:teuthology.orchestra.run.smithi143.stdout: debug mon = 20 2024-04-26T20:58:07.271 INFO:teuthology.orchestra.run.smithi143.stdout: debug auth = 20 2024-04-26T20:58:07.271 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min pgs per osd = 4 2024-04-26T20:58:07.272 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min bytes per osd = 10 2024-04-26T20:58:07.272 INFO:teuthology.orchestra.run.smithi143.stdout: mgr/telemetry/nag = false 2024-04-26T20:58:07.272 INFO:teuthology.orchestra.run.smithi143.stdout: debug client = 20 2024-04-26T20:58:07.272 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.272 INFO:teuthology.orchestra.run.smithi143.stdout:[mon] 2024-04-26T20:58:07.272 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2024-04-26T20:58:07.272 INFO:teuthology.orchestra.run.smithi143.stdout: debug mon = 20 2024-04-26T20:58:07.272 INFO:teuthology.orchestra.run.smithi143.stdout: debug paxos = 20 2024-04-26T20:58:07.272 INFO:teuthology.orchestra.run.smithi143.stdout: debug auth = 20 2024-04-26T20:58:07.272 INFO:teuthology.orchestra.run.smithi143.stdout: mon data avail warn = 5 2024-04-26T20:58:07.272 INFO:teuthology.orchestra.run.smithi143.stdout: mon mgr mkfs grace = 240 2024-04-26T20:58:07.272 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min pgs per osd = 4 2024-04-26T20:58:07.272 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd reporter subtree level = osd 2024-04-26T20:58:07.272 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd prime pg temp = true 2024-04-26T20:58:07.272 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min bytes per osd = 10 2024-04-26T20:58:07.272 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.273 INFO:teuthology.orchestra.run.smithi143.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T20:58:07.273 INFO:teuthology.orchestra.run.smithi143.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T20:58:07.273 INFO:teuthology.orchestra.run.smithi143.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T20:58:07.273 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.273 INFO:teuthology.orchestra.run.smithi143.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T20:58:07.273 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T20:58:07.273 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T20:58:07.273 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.273 INFO:teuthology.orchestra.run.smithi143.stdout: # 1m isn't quite enough 2024-04-26T20:58:07.273 INFO:teuthology.orchestra.run.smithi143.stdout: mon_down_mkfs_grace = 2m 2024-04-26T20:58:07.273 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.273 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_filestore_osds = false 2024-04-26T20:58:07.273 INFO:teuthology.orchestra.run.smithi143.stdout: mon down mkfs grace = 300 2024-04-26T20:58:07.273 INFO:teuthology.orchestra.run.smithi143.stdout: mon op complaint time = 120 2024-04-26T20:58:07.273 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.273 INFO:teuthology.orchestra.run.smithi143.stdout:[client] 2024-04-26T20:58:07.273 INFO:teuthology.orchestra.run.smithi143.stdout: rgw cache enabled = true 2024-04-26T20:58:07.273 INFO:teuthology.orchestra.run.smithi143.stdout: rgw enable ops log = true 2024-04-26T20:58:07.274 INFO:teuthology.orchestra.run.smithi143.stdout: rgw enable usage log = true 2024-04-26T20:58:07.274 INFO:teuthology.orchestra.run.smithi143.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T20:58:07.274 INFO:teuthology.orchestra.run.smithi143.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T20:58:07.274 INFO:teuthology.orchestra.run.smithi143.stdout: client mount timeout = 600 2024-04-26T20:58:07.274 INFO:teuthology.orchestra.run.smithi143.stdout: debug client = 20 2024-04-26T20:58:07.274 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2024-04-26T20:58:07.274 INFO:teuthology.orchestra.run.smithi143.stdout: pid file = "" 2024-04-26T20:58:07.274 INFO:teuthology.orchestra.run.smithi143.stdout: rados mon op timeout = 900 2024-04-26T20:58:07.274 INFO:teuthology.orchestra.run.smithi143.stdout: rados osd op timeout = 900 2024-04-26T20:58:07.274 INFO:teuthology.orchestra.run.smithi143.stdout:[mon.a] 2024-04-26T20:58:07.274 INFO:teuthology.orchestra.run.smithi143.stdout:[mon.b] 2024-04-26T20:58:07.274 INFO:teuthology.orchestra.run.smithi143.stdout:[mon.c] 2024-04-26T20:58:07.274 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.a] 2024-04-26T20:58:07.274 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.c] 2024-04-26T20:58:07.274 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.b] 2024-04-26T20:58:07.274 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.d] 2024-04-26T20:58:07.275 INFO:teuthology.orchestra.run.smithi143.stdout:[mds] 2024-04-26T20:58:07.275 INFO:teuthology.orchestra.run.smithi143.stdout: debug mds = 20 2024-04-26T20:58:07.275 INFO:teuthology.orchestra.run.smithi143.stdout: debug mds balancer = 20 2024-04-26T20:58:07.275 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2024-04-26T20:58:07.275 INFO:teuthology.orchestra.run.smithi143.stdout: mds debug frag = True 2024-04-26T20:58:07.275 INFO:teuthology.orchestra.run.smithi143.stdout: mds debug scatterstat = True 2024-04-26T20:58:07.275 INFO:teuthology.orchestra.run.smithi143.stdout: mds op complaint time = 180 2024-04-26T20:58:07.275 INFO:teuthology.orchestra.run.smithi143.stdout: mds verify scatter = False 2024-04-26T20:58:07.275 INFO:teuthology.orchestra.run.smithi143.stdout: osd op complaint time = 180 2024-04-26T20:58:07.275 INFO:teuthology.orchestra.run.smithi143.stdout: rados mon op timeout = 900 2024-04-26T20:58:07.275 INFO:teuthology.orchestra.run.smithi143.stdout: rados osd op timeout = 900 2024-04-26T20:58:07.277 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T20:58:07.326 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T20:58:07.365 INFO:teuthology.orchestra.run.smithi138.stdout:[global] 2024-04-26T20:58:07.365 INFO:teuthology.orchestra.run.smithi138.stdout: chdir = "" 2024-04-26T20:58:07.365 INFO:teuthology.orchestra.run.smithi138.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T20:58:07.365 INFO:teuthology.orchestra.run.smithi138.stdout: auth supported = cephx 2024-04-26T20:58:07.365 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.365 INFO:teuthology.orchestra.run.smithi138.stdout: filestore xattr use omap = true 2024-04-26T20:58:07.365 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.365 INFO:teuthology.orchestra.run.smithi138.stdout: mon clock drift allowed = 1.000 2024-04-26T20:58:07.365 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.365 INFO:teuthology.orchestra.run.smithi138.stdout: osd crush chooseleaf type = 0 2024-04-26T20:58:07.365 INFO:teuthology.orchestra.run.smithi138.stdout: auth debug = true 2024-04-26T20:58:07.365 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.366 INFO:teuthology.orchestra.run.smithi138.stdout: ms die on old message = true 2024-04-26T20:58:07.366 INFO:teuthology.orchestra.run.smithi138.stdout: ms die on bug = true 2024-04-26T20:58:07.366 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.366 INFO:teuthology.orchestra.run.smithi138.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T20:58:07.366 INFO:teuthology.orchestra.run.smithi138.stdout: mon pg warn max object skew = 0 2024-04-26T20:58:07.366 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.366 INFO:teuthology.orchestra.run.smithi138.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T20:58:07.366 INFO:teuthology.orchestra.run.smithi138.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T20:58:07.366 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.366 INFO:teuthology.orchestra.run.smithi138.stdout: osd pool default size = 2 2024-04-26T20:58:07.366 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.367 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd allow primary affinity = true 2024-04-26T20:58:07.367 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd allow pg remap = true 2024-04-26T20:58:07.367 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on legacy crush tunables = false 2024-04-26T20:58:07.367 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on crush straw calc version zero = false 2024-04-26T20:58:07.367 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on no sortbitwise = false 2024-04-26T20:58:07.367 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on osd down out interval zero = false 2024-04-26T20:58:07.367 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on too few osds = false 2024-04-26T20:58:07.367 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T20:58:07.367 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T20:58:07.368 INFO:teuthology.orchestra.run.smithi138.stdout: mon_allow_pool_size_one = true 2024-04-26T20:58:07.368 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.368 INFO:teuthology.orchestra.run.smithi138.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T20:58:07.368 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.368 INFO:teuthology.orchestra.run.smithi138.stdout: osd default data pool replay window = 5 2024-04-26T20:58:07.368 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.368 INFO:teuthology.orchestra.run.smithi138.stdout: mon allow pool delete = true 2024-04-26T20:58:07.368 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.368 INFO:teuthology.orchestra.run.smithi138.stdout: mon cluster log file level = debug 2024-04-26T20:58:07.368 INFO:teuthology.orchestra.run.smithi138.stdout: debug asserts on shutdown = true 2024-04-26T20:58:07.368 INFO:teuthology.orchestra.run.smithi138.stdout: mon health detail to clog = false 2024-04-26T20:58:07.368 INFO:teuthology.orchestra.run.smithi138.stdout: mon host = "172.21.15.138,172.21.15.143,[v2:172.21.15.143:3301,v1:172.21.15.143:6790]" 2024-04-26T20:58:07.369 INFO:teuthology.orchestra.run.smithi138.stdout: ms die on skipped message = False 2024-04-26T20:58:07.369 INFO:teuthology.orchestra.run.smithi138.stdout: fsid = c22b4730-12cc-4558-8535-b965384398c0 2024-04-26T20:58:07.369 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.369 INFO:teuthology.orchestra.run.smithi138.stdout:[osd] 2024-04-26T20:58:07.369 INFO:teuthology.orchestra.run.smithi138.stdout: osd journal size = 100 2024-04-26T20:58:07.369 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.369 INFO:teuthology.orchestra.run.smithi138.stdout: osd scrub load threshold = 5.0 2024-04-26T20:58:07.369 INFO:teuthology.orchestra.run.smithi138.stdout: osd scrub max interval = 600 2024-04-26T20:58:07.369 INFO:teuthology.orchestra.run.smithi138.stdout: osd mclock profile = high_recovery_ops 2024-04-26T20:58:07.369 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.370 INFO:teuthology.orchestra.run.smithi138.stdout: osd recover clone overlap = true 2024-04-26T20:58:07.370 INFO:teuthology.orchestra.run.smithi138.stdout: osd recovery max chunk = 1048576 2024-04-26T20:58:07.370 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.370 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug shutdown = true 2024-04-26T20:58:07.370 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug op order = true 2024-04-26T20:58:07.370 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug verify stray on activate = true 2024-04-26T20:58:07.370 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug trim objects = true 2024-04-26T20:58:07.370 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.370 INFO:teuthology.orchestra.run.smithi138.stdout: osd open classes on start = true 2024-04-26T20:58:07.370 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug pg log writeout = true 2024-04-26T20:58:07.371 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.371 INFO:teuthology.orchestra.run.smithi138.stdout: osd deep scrub update digest min age = 30 2024-04-26T20:58:07.371 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.371 INFO:teuthology.orchestra.run.smithi138.stdout: osd map max advance = 10 2024-04-26T20:58:07.371 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.371 INFO:teuthology.orchestra.run.smithi138.stdout: journal zero on create = true 2024-04-26T20:58:07.371 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.371 INFO:teuthology.orchestra.run.smithi138.stdout: filestore ondisk finisher threads = 3 2024-04-26T20:58:07.371 INFO:teuthology.orchestra.run.smithi138.stdout: filestore apply finisher threads = 3 2024-04-26T20:58:07.371 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.371 INFO:teuthology.orchestra.run.smithi138.stdout: bdev debug aio = true 2024-04-26T20:58:07.371 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug misdirected ops = true 2024-04-26T20:58:07.371 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore block size = 96636764160 2024-04-26T20:58:07.371 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore fsck on mount = True 2024-04-26T20:58:07.371 INFO:teuthology.orchestra.run.smithi138.stdout: debug bluefs = 20 2024-04-26T20:58:07.372 INFO:teuthology.orchestra.run.smithi138.stdout: debug bluestore = 20 2024-04-26T20:58:07.372 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2024-04-26T20:58:07.372 INFO:teuthology.orchestra.run.smithi138.stdout: debug osd = 20 2024-04-26T20:58:07.372 INFO:teuthology.orchestra.run.smithi138.stdout: debug rocksdb = 10 2024-04-26T20:58:07.372 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T20:58:07.372 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd full ratio = 0.9 2024-04-26T20:58:07.372 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd nearfull ratio = 0.8 2024-04-26T20:58:07.372 INFO:teuthology.orchestra.run.smithi138.stdout: osd failsafe full ratio = 0.95 2024-04-26T20:58:07.372 INFO:teuthology.orchestra.run.smithi138.stdout: osd objectstore = bluestore 2024-04-26T20:58:07.372 INFO:teuthology.orchestra.run.smithi138.stdout: osd op complaint time = 180 2024-04-26T20:58:07.372 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.372 INFO:teuthology.orchestra.run.smithi138.stdout:[mgr] 2024-04-26T20:58:07.372 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2024-04-26T20:58:07.372 INFO:teuthology.orchestra.run.smithi138.stdout: debug mgr = 20 2024-04-26T20:58:07.372 INFO:teuthology.orchestra.run.smithi138.stdout: debug mon = 20 2024-04-26T20:58:07.373 INFO:teuthology.orchestra.run.smithi138.stdout: debug auth = 20 2024-04-26T20:58:07.373 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min pgs per osd = 4 2024-04-26T20:58:07.373 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min bytes per osd = 10 2024-04-26T20:58:07.373 INFO:teuthology.orchestra.run.smithi138.stdout: mgr/telemetry/nag = false 2024-04-26T20:58:07.373 INFO:teuthology.orchestra.run.smithi138.stdout: debug client = 20 2024-04-26T20:58:07.373 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.373 INFO:teuthology.orchestra.run.smithi138.stdout:[mon] 2024-04-26T20:58:07.373 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2024-04-26T20:58:07.373 INFO:teuthology.orchestra.run.smithi138.stdout: debug mon = 20 2024-04-26T20:58:07.373 INFO:teuthology.orchestra.run.smithi138.stdout: debug paxos = 20 2024-04-26T20:58:07.373 INFO:teuthology.orchestra.run.smithi138.stdout: debug auth = 20 2024-04-26T20:58:07.373 INFO:teuthology.orchestra.run.smithi138.stdout: mon data avail warn = 5 2024-04-26T20:58:07.373 INFO:teuthology.orchestra.run.smithi138.stdout: mon mgr mkfs grace = 240 2024-04-26T20:58:07.373 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min pgs per osd = 4 2024-04-26T20:58:07.373 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd reporter subtree level = osd 2024-04-26T20:58:07.373 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd prime pg temp = true 2024-04-26T20:58:07.373 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min bytes per osd = 10 2024-04-26T20:58:07.374 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.374 INFO:teuthology.orchestra.run.smithi138.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T20:58:07.374 INFO:teuthology.orchestra.run.smithi138.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T20:58:07.374 INFO:teuthology.orchestra.run.smithi138.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T20:58:07.374 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.374 INFO:teuthology.orchestra.run.smithi138.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T20:58:07.374 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T20:58:07.374 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T20:58:07.374 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.374 INFO:teuthology.orchestra.run.smithi138.stdout: # 1m isn't quite enough 2024-04-26T20:58:07.374 INFO:teuthology.orchestra.run.smithi138.stdout: mon_down_mkfs_grace = 2m 2024-04-26T20:58:07.374 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.374 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_filestore_osds = false 2024-04-26T20:58:07.374 INFO:teuthology.orchestra.run.smithi138.stdout: mon down mkfs grace = 300 2024-04-26T20:58:07.374 INFO:teuthology.orchestra.run.smithi138.stdout: mon op complaint time = 120 2024-04-26T20:58:07.374 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.375 INFO:teuthology.orchestra.run.smithi138.stdout:[client] 2024-04-26T20:58:07.375 INFO:teuthology.orchestra.run.smithi138.stdout: rgw cache enabled = true 2024-04-26T20:58:07.375 INFO:teuthology.orchestra.run.smithi138.stdout: rgw enable ops log = true 2024-04-26T20:58:07.375 INFO:teuthology.orchestra.run.smithi138.stdout: rgw enable usage log = true 2024-04-26T20:58:07.375 INFO:teuthology.orchestra.run.smithi138.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T20:58:07.375 INFO:teuthology.orchestra.run.smithi138.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T20:58:07.375 INFO:teuthology.orchestra.run.smithi138.stdout: client mount timeout = 600 2024-04-26T20:58:07.375 INFO:teuthology.orchestra.run.smithi138.stdout: debug client = 20 2024-04-26T20:58:07.375 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2024-04-26T20:58:07.375 INFO:teuthology.orchestra.run.smithi138.stdout: pid file = "" 2024-04-26T20:58:07.375 INFO:teuthology.orchestra.run.smithi138.stdout: rados mon op timeout = 900 2024-04-26T20:58:07.375 INFO:teuthology.orchestra.run.smithi138.stdout: rados osd op timeout = 900 2024-04-26T20:58:07.375 INFO:teuthology.orchestra.run.smithi138.stdout:[mon.a] 2024-04-26T20:58:07.375 INFO:teuthology.orchestra.run.smithi138.stdout:[mon.b] 2024-04-26T20:58:07.375 INFO:teuthology.orchestra.run.smithi138.stdout:[mon.c] 2024-04-26T20:58:07.375 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.a] 2024-04-26T20:58:07.376 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.c] 2024-04-26T20:58:07.376 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.b] 2024-04-26T20:58:07.376 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.d] 2024-04-26T20:58:07.376 INFO:teuthology.orchestra.run.smithi138.stdout:[mds] 2024-04-26T20:58:07.376 INFO:teuthology.orchestra.run.smithi138.stdout: debug mds = 20 2024-04-26T20:58:07.376 INFO:teuthology.orchestra.run.smithi138.stdout: debug mds balancer = 20 2024-04-26T20:58:07.376 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2024-04-26T20:58:07.376 INFO:teuthology.orchestra.run.smithi138.stdout: mds debug frag = True 2024-04-26T20:58:07.376 INFO:teuthology.orchestra.run.smithi138.stdout: mds debug scatterstat = False 2024-04-26T20:58:07.376 INFO:teuthology.orchestra.run.smithi138.stdout: mds op complaint time = 180 2024-04-26T20:58:07.376 INFO:teuthology.orchestra.run.smithi138.stdout: mds verify scatter = False 2024-04-26T20:58:07.376 INFO:teuthology.orchestra.run.smithi138.stdout: osd op complaint time = 180 2024-04-26T20:58:07.376 INFO:teuthology.orchestra.run.smithi138.stdout: rados mon op timeout = 900 2024-04-26T20:58:07.376 INFO:teuthology.orchestra.run.smithi138.stdout: rados osd op timeout = 900 2024-04-26T20:58:07.377 INFO:teuthology.orchestra.run.smithi143.stdout:[global] 2024-04-26T20:58:07.377 INFO:teuthology.orchestra.run.smithi143.stdout: chdir = "" 2024-04-26T20:58:07.377 INFO:teuthology.orchestra.run.smithi143.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T20:58:07.377 INFO:teuthology.orchestra.run.smithi143.stdout: auth supported = cephx 2024-04-26T20:58:07.377 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.377 INFO:teuthology.orchestra.run.smithi143.stdout: filestore xattr use omap = true 2024-04-26T20:58:07.377 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.377 INFO:teuthology.orchestra.run.smithi143.stdout: mon clock drift allowed = 1.000 2024-04-26T20:58:07.377 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.377 INFO:teuthology.orchestra.run.smithi143.stdout: osd crush chooseleaf type = 0 2024-04-26T20:58:07.377 INFO:teuthology.orchestra.run.smithi143.stdout: auth debug = true 2024-04-26T20:58:07.377 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.377 INFO:teuthology.orchestra.run.smithi143.stdout: ms die on old message = true 2024-04-26T20:58:07.378 INFO:teuthology.orchestra.run.smithi143.stdout: ms die on bug = true 2024-04-26T20:58:07.378 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.378 INFO:teuthology.orchestra.run.smithi143.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T20:58:07.378 INFO:teuthology.orchestra.run.smithi143.stdout: mon pg warn max object skew = 0 2024-04-26T20:58:07.378 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.378 INFO:teuthology.orchestra.run.smithi143.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T20:58:07.378 INFO:teuthology.orchestra.run.smithi143.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T20:58:07.378 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.378 INFO:teuthology.orchestra.run.smithi143.stdout: osd pool default size = 2 2024-04-26T20:58:07.378 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.378 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd allow primary affinity = true 2024-04-26T20:58:07.378 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd allow pg remap = true 2024-04-26T20:58:07.378 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on legacy crush tunables = false 2024-04-26T20:58:07.378 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on crush straw calc version zero = false 2024-04-26T20:58:07.378 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on no sortbitwise = false 2024-04-26T20:58:07.379 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on osd down out interval zero = false 2024-04-26T20:58:07.379 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on too few osds = false 2024-04-26T20:58:07.379 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T20:58:07.379 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T20:58:07.379 INFO:teuthology.orchestra.run.smithi143.stdout: mon_allow_pool_size_one = true 2024-04-26T20:58:07.379 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.379 INFO:teuthology.orchestra.run.smithi143.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T20:58:07.379 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.379 INFO:teuthology.orchestra.run.smithi143.stdout: osd default data pool replay window = 5 2024-04-26T20:58:07.379 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.379 INFO:teuthology.orchestra.run.smithi143.stdout: mon allow pool delete = true 2024-04-26T20:58:07.379 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.379 INFO:teuthology.orchestra.run.smithi143.stdout: mon cluster log file level = debug 2024-04-26T20:58:07.379 INFO:teuthology.orchestra.run.smithi143.stdout: debug asserts on shutdown = true 2024-04-26T20:58:07.379 INFO:teuthology.orchestra.run.smithi143.stdout: mon health detail to clog = false 2024-04-26T20:58:07.379 INFO:teuthology.orchestra.run.smithi143.stdout: mon host = "172.21.15.138,172.21.15.143,[v2:172.21.15.143:3301,v1:172.21.15.143:6790]" 2024-04-26T20:58:07.379 INFO:teuthology.orchestra.run.smithi143.stdout: ms die on skipped message = False 2024-04-26T20:58:07.380 INFO:teuthology.orchestra.run.smithi143.stdout: fsid = c22b4730-12cc-4558-8535-b965384398c0 2024-04-26T20:58:07.380 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.380 INFO:teuthology.orchestra.run.smithi143.stdout:[osd] 2024-04-26T20:58:07.380 INFO:teuthology.orchestra.run.smithi143.stdout: osd journal size = 100 2024-04-26T20:58:07.380 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.380 INFO:teuthology.orchestra.run.smithi143.stdout: osd scrub load threshold = 5.0 2024-04-26T20:58:07.380 INFO:teuthology.orchestra.run.smithi143.stdout: osd scrub max interval = 600 2024-04-26T20:58:07.380 INFO:teuthology.orchestra.run.smithi143.stdout: osd mclock profile = high_recovery_ops 2024-04-26T20:58:07.380 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.380 INFO:teuthology.orchestra.run.smithi143.stdout: osd recover clone overlap = true 2024-04-26T20:58:07.380 INFO:teuthology.orchestra.run.smithi143.stdout: osd recovery max chunk = 1048576 2024-04-26T20:58:07.381 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.381 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug shutdown = true 2024-04-26T20:58:07.381 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug op order = true 2024-04-26T20:58:07.381 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug verify stray on activate = true 2024-04-26T20:58:07.381 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug trim objects = true 2024-04-26T20:58:07.381 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.381 INFO:teuthology.orchestra.run.smithi143.stdout: osd open classes on start = true 2024-04-26T20:58:07.381 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug pg log writeout = true 2024-04-26T20:58:07.381 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.381 INFO:teuthology.orchestra.run.smithi143.stdout: osd deep scrub update digest min age = 30 2024-04-26T20:58:07.381 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.381 INFO:teuthology.orchestra.run.smithi143.stdout: osd map max advance = 10 2024-04-26T20:58:07.381 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.381 INFO:teuthology.orchestra.run.smithi143.stdout: journal zero on create = true 2024-04-26T20:58:07.381 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.381 INFO:teuthology.orchestra.run.smithi143.stdout: filestore ondisk finisher threads = 3 2024-04-26T20:58:07.382 INFO:teuthology.orchestra.run.smithi143.stdout: filestore apply finisher threads = 3 2024-04-26T20:58:07.382 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.382 INFO:teuthology.orchestra.run.smithi143.stdout: bdev debug aio = true 2024-04-26T20:58:07.382 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug misdirected ops = true 2024-04-26T20:58:07.382 INFO:teuthology.orchestra.run.smithi143.stdout: bluestore block size = 96636764160 2024-04-26T20:58:07.382 INFO:teuthology.orchestra.run.smithi143.stdout: bluestore fsck on mount = True 2024-04-26T20:58:07.382 INFO:teuthology.orchestra.run.smithi143.stdout: debug bluefs = 20 2024-04-26T20:58:07.382 INFO:teuthology.orchestra.run.smithi143.stdout: debug bluestore = 20 2024-04-26T20:58:07.382 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2024-04-26T20:58:07.382 INFO:teuthology.orchestra.run.smithi143.stdout: debug osd = 20 2024-04-26T20:58:07.382 INFO:teuthology.orchestra.run.smithi143.stdout: debug rocksdb = 10 2024-04-26T20:58:07.382 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T20:58:07.382 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd full ratio = 0.9 2024-04-26T20:58:07.382 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd nearfull ratio = 0.8 2024-04-26T20:58:07.383 INFO:teuthology.orchestra.run.smithi143.stdout: osd failsafe full ratio = 0.95 2024-04-26T20:58:07.383 INFO:teuthology.orchestra.run.smithi143.stdout: osd objectstore = bluestore 2024-04-26T20:58:07.383 INFO:teuthology.orchestra.run.smithi143.stdout: osd op complaint time = 180 2024-04-26T20:58:07.383 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.383 INFO:teuthology.orchestra.run.smithi143.stdout:[mgr] 2024-04-26T20:58:07.383 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2024-04-26T20:58:07.383 INFO:teuthology.orchestra.run.smithi143.stdout: debug mgr = 20 2024-04-26T20:58:07.383 INFO:teuthology.orchestra.run.smithi143.stdout: debug mon = 20 2024-04-26T20:58:07.383 INFO:teuthology.orchestra.run.smithi143.stdout: debug auth = 20 2024-04-26T20:58:07.383 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min pgs per osd = 4 2024-04-26T20:58:07.383 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min bytes per osd = 10 2024-04-26T20:58:07.383 INFO:teuthology.orchestra.run.smithi143.stdout: mgr/telemetry/nag = false 2024-04-26T20:58:07.383 INFO:teuthology.orchestra.run.smithi143.stdout: debug client = 20 2024-04-26T20:58:07.383 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.383 INFO:teuthology.orchestra.run.smithi143.stdout:[mon] 2024-04-26T20:58:07.383 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2024-04-26T20:58:07.383 INFO:teuthology.orchestra.run.smithi143.stdout: debug mon = 20 2024-04-26T20:58:07.384 INFO:teuthology.orchestra.run.smithi143.stdout: debug paxos = 20 2024-04-26T20:58:07.384 INFO:teuthology.orchestra.run.smithi143.stdout: debug auth = 20 2024-04-26T20:58:07.384 INFO:teuthology.orchestra.run.smithi143.stdout: mon data avail warn = 5 2024-04-26T20:58:07.384 INFO:teuthology.orchestra.run.smithi143.stdout: mon mgr mkfs grace = 240 2024-04-26T20:58:07.384 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min pgs per osd = 4 2024-04-26T20:58:07.384 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd reporter subtree level = osd 2024-04-26T20:58:07.384 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd prime pg temp = true 2024-04-26T20:58:07.384 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min bytes per osd = 10 2024-04-26T20:58:07.384 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.384 INFO:teuthology.orchestra.run.smithi143.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T20:58:07.384 INFO:teuthology.orchestra.run.smithi143.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T20:58:07.384 INFO:teuthology.orchestra.run.smithi143.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T20:58:07.384 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.384 INFO:teuthology.orchestra.run.smithi143.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T20:58:07.384 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T20:58:07.385 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T20:58:07.385 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.385 INFO:teuthology.orchestra.run.smithi143.stdout: # 1m isn't quite enough 2024-04-26T20:58:07.385 INFO:teuthology.orchestra.run.smithi143.stdout: mon_down_mkfs_grace = 2m 2024-04-26T20:58:07.385 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.385 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_filestore_osds = false 2024-04-26T20:58:07.385 INFO:teuthology.orchestra.run.smithi143.stdout: mon down mkfs grace = 300 2024-04-26T20:58:07.385 INFO:teuthology.orchestra.run.smithi143.stdout: mon op complaint time = 120 2024-04-26T20:58:07.385 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T20:58:07.385 INFO:teuthology.orchestra.run.smithi143.stdout:[client] 2024-04-26T20:58:07.385 INFO:teuthology.orchestra.run.smithi143.stdout: rgw cache enabled = true 2024-04-26T20:58:07.385 INFO:teuthology.orchestra.run.smithi143.stdout: rgw enable ops log = true 2024-04-26T20:58:07.385 INFO:teuthology.orchestra.run.smithi143.stdout: rgw enable usage log = true 2024-04-26T20:58:07.385 INFO:teuthology.orchestra.run.smithi143.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T20:58:07.385 INFO:teuthology.orchestra.run.smithi143.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T20:58:07.386 INFO:teuthology.orchestra.run.smithi143.stdout: client mount timeout = 600 2024-04-26T20:58:07.386 INFO:teuthology.orchestra.run.smithi143.stdout: debug client = 20 2024-04-26T20:58:07.386 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2024-04-26T20:58:07.386 INFO:teuthology.orchestra.run.smithi143.stdout: pid file = "" 2024-04-26T20:58:07.386 INFO:teuthology.orchestra.run.smithi143.stdout: rados mon op timeout = 900 2024-04-26T20:58:07.386 INFO:teuthology.orchestra.run.smithi143.stdout: rados osd op timeout = 900 2024-04-26T20:58:07.386 INFO:teuthology.orchestra.run.smithi143.stdout:[mon.a] 2024-04-26T20:58:07.386 INFO:teuthology.orchestra.run.smithi143.stdout:[mon.b] 2024-04-26T20:58:07.386 INFO:teuthology.orchestra.run.smithi143.stdout:[mon.c] 2024-04-26T20:58:07.386 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.a] 2024-04-26T20:58:07.386 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.c] 2024-04-26T20:58:07.386 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.b] 2024-04-26T20:58:07.386 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.d] 2024-04-26T20:58:07.386 INFO:teuthology.orchestra.run.smithi143.stdout:[mds] 2024-04-26T20:58:07.386 INFO:teuthology.orchestra.run.smithi143.stdout: debug mds = 20 2024-04-26T20:58:07.387 INFO:teuthology.orchestra.run.smithi143.stdout: debug mds balancer = 20 2024-04-26T20:58:07.387 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2024-04-26T20:58:07.387 INFO:teuthology.orchestra.run.smithi143.stdout: mds debug frag = True 2024-04-26T20:58:07.387 INFO:teuthology.orchestra.run.smithi143.stdout: mds debug scatterstat = False 2024-04-26T20:58:07.387 INFO:teuthology.orchestra.run.smithi143.stdout: mds op complaint time = 180 2024-04-26T20:58:07.387 INFO:teuthology.orchestra.run.smithi143.stdout: mds verify scatter = False 2024-04-26T20:58:07.387 INFO:teuthology.orchestra.run.smithi143.stdout: osd op complaint time = 180 2024-04-26T20:58:07.387 INFO:teuthology.orchestra.run.smithi143.stdout: rados mon op timeout = 900 2024-04-26T20:58:07.387 INFO:teuthology.orchestra.run.smithi143.stdout: rados osd op timeout = 900 2024-04-26T20:58:07.388 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-26T20:58:07.389 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-26T20:58:07.389 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-26T20:58:07.389 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T20:58:07.389 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-26T20:58:07.389 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-26T20:58:07.389 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-26T20:58:07.389 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T20:58:07.389 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-26T20:58:07.390 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-26T20:58:07.390 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-26T20:58:07.390 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T20:58:07.390 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-26T20:58:07.390 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-26T20:58:07.390 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-26T20:58:07.390 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T20:58:07.447 INFO:tasks.ceph.mds.d:Stopped 2024-04-26T20:58:07.447 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-26T20:58:07.448 INFO:tasks.ceph.mds.b:Stopped 2024-04-26T20:58:07.448 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-26T20:58:07.450 INFO:tasks.ceph.mds.a:Stopped 2024-04-26T20:58:07.450 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-26T20:58:07.451 INFO:tasks.ceph.mds.c:Stopped 2024-04-26T20:58:07.452 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-26T20:58:07.492 INFO:tasks.ceph.mds.d:Started 2024-04-26T20:58:07.493 DEBUG:teuthology.parallel:result is None 2024-04-26T20:58:07.493 INFO:tasks.ceph.mds.a:Started 2024-04-26T20:58:07.494 DEBUG:teuthology.parallel:result is None 2024-04-26T20:58:07.494 INFO:tasks.ceph.mds.b:Started 2024-04-26T20:58:07.494 DEBUG:teuthology.parallel:result is None 2024-04-26T20:58:07.495 INFO:tasks.ceph.mds.c:Started 2024-04-26T20:58:07.495 DEBUG:teuthology.parallel:result is None 2024-04-26T20:58:07.495 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph purge cephfs_metadata --yes-i-really-really-mean-it 2024-04-26T20:58:07.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.540+0000 7f76ccecf080 1 Processor -- start 2024-04-26T20:58:07.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.540+0000 7f76ccecf080 1 -- start start 2024-04-26T20:58:07.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.544+0000 7f76ccecf080 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5602e49d2930 0x5602e4aaaf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:07.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.544+0000 7f76ccecf080 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5602e4aa9e20 0x5602e4a90ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:07.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.544+0000 7f76ccecf080 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5602e4aaa910 0x5602e4a91010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:07.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.544+0000 7f76ccecf080 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5602e4a05380 con 0x5602e4aa9e20 2024-04-26T20:58:07.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.544+0000 7f76ccecf080 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x5602e49799a0 con 0x5602e49d2930 2024-04-26T20:58:07.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.544+0000 7f76ccecf080 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x5602e4a05620 con 0x5602e4aaa910 2024-04-26T20:58:07.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.544+0000 7f76c9600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5602e4aa9e20 0x5602e4a90ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:07.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.544+0000 7f76c9600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5602e4aa9e20 0x5602e4a90ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:59092/0 (socket says 172.21.15.138:59092) 2024-04-26T20:58:07.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.544+0000 7f76c9600640 1 -- 172.21.15.138:0/2139749019 learned_addr learned my addr 172.21.15.138:0/2139749019 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:07.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.544+0000 7f76caa00640 1 --2- 172.21.15.138:0/2139749019 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5602e4aaa910 0x5602e4a91010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:07.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.544+0000 7f76ca000640 1 --2- 172.21.15.138:0/2139749019 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5602e49d2930 0x5602e4aaaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:07.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.544+0000 7f76c9600640 1 -- 172.21.15.138:0/2139749019 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5602e4aaa910 msgr2=0x5602e4a91010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:07.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.544+0000 7f76c9600640 1 --2- 172.21.15.138:0/2139749019 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5602e4aaa910 0x5602e4a91010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:07.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.544+0000 7f76c9600640 1 -- 172.21.15.138:0/2139749019 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5602e49d2930 msgr2=0x5602e4aaaf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:07.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.544+0000 7f76c9600640 1 --2- 172.21.15.138:0/2139749019 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5602e49d2930 0x5602e4aaaf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:07.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.544+0000 7f76c9600640 1 -- 172.21.15.138:0/2139749019 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602e4a92ed0 con 0x5602e4aa9e20 2024-04-26T20:58:07.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.544+0000 7f76c9600640 1 --2- 172.21.15.138:0/2139749019 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5602e4aa9e20 0x5602e4a90ad0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f76b800b2d0 tx=0x7f76b800b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfae36760e3d3390 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:07.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.544+0000 7f76c3e00640 1 -- 172.21.15.138:0/2139749019 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b800d510 con 0x5602e4aa9e20 2024-04-26T20:58:07.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.544+0000 7f76c3e00640 1 -- 172.21.15.138:0/2139749019 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76b8008070 con 0x5602e4aa9e20 2024-04-26T20:58:07.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.544+0000 7f76c3e00640 1 -- 172.21.15.138:0/2139749019 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b800d8d0 con 0x5602e4aa9e20 2024-04-26T20:58:07.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.544+0000 7f76ccecf080 1 -- 172.21.15.138:0/2139749019 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5602e4aa9e20 msgr2=0x5602e4a90ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:07.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.544+0000 7f76ccecf080 1 --2- 172.21.15.138:0/2139749019 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5602e4aa9e20 0x5602e4a90ad0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f76b800b2d0 tx=0x7f76b800b790 comp rx=0 tx=0).stop 2024-04-26T20:58:07.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.544+0000 7f76ccecf080 1 -- 172.21.15.138:0/2139749019 shutdown_connections 2024-04-26T20:58:07.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.544+0000 7f76ccecf080 1 --2- 172.21.15.138:0/2139749019 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5602e4aaa910 0x5602e4a91010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:07.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.544+0000 7f76ccecf080 1 --2- 172.21.15.138:0/2139749019 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5602e4aa9e20 0x5602e4a90ad0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:07.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.544+0000 7f76ccecf080 1 --2- 172.21.15.138:0/2139749019 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5602e49d2930 0x5602e4aaaf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:07.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.544+0000 7f76ccecf080 1 -- 172.21.15.138:0/2139749019 >> 172.21.15.138:0/2139749019 conn(0x5602e49d8cf0 msgr2=0x5602e49d1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:07.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.544+0000 7f76ccecf080 1 -- 172.21.15.138:0/2139749019 shutdown_connections 2024-04-26T20:58:07.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.544+0000 7f76ccecf080 1 -- 172.21.15.138:0/2139749019 wait complete. 2024-04-26T20:58:07.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.544+0000 7f76ccecf080 1 Processor -- start 2024-04-26T20:58:07.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.544+0000 7f76ccecf080 1 -- start start 2024-04-26T20:58:07.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.548+0000 7f76ccecf080 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5602e49d2930 0x5602e4a972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:07.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.548+0000 7f76ccecf080 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5602e4aa9e20 0x5602e4a959e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:07.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.548+0000 7f76ccecf080 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5602e4aaa910 0x5602e4aac7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:07.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.548+0000 7f76ccecf080 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5602e4a93170 con 0x5602e49d2930 2024-04-26T20:58:07.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.548+0000 7f76ccecf080 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x5602e4a93410 con 0x5602e4aa9e20 2024-04-26T20:58:07.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.548+0000 7f76ccecf080 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x5602e4a15ae0 con 0x5602e4aaa910 2024-04-26T20:58:07.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.548+0000 7f76ca000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5602e49d2930 0x5602e4a972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:07.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.548+0000 7f76ca000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5602e49d2930 0x5602e4a972f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:59100/0 (socket says 172.21.15.138:59100) 2024-04-26T20:58:07.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.548+0000 7f76ca000640 1 -- 172.21.15.138:0/2876611835 learned_addr learned my addr 172.21.15.138:0/2876611835 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:07.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.548+0000 7f76c9600640 1 --2- 172.21.15.138:0/2876611835 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5602e4aa9e20 0x5602e4a959e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:07.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.548+0000 7f76caa00640 1 --2- 172.21.15.138:0/2876611835 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5602e4aaa910 0x5602e4aac7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:07.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.548+0000 7f76ca000640 1 -- 172.21.15.138:0/2876611835 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5602e4aaa910 msgr2=0x5602e4aac7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:07.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.548+0000 7f76ca000640 1 --2- 172.21.15.138:0/2876611835 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5602e4aaa910 0x5602e4aac7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:07.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.548+0000 7f76ca000640 1 -- 172.21.15.138:0/2876611835 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5602e4aa9e20 msgr2=0x5602e4a959e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:07.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.548+0000 7f76ca000640 1 --2- 172.21.15.138:0/2876611835 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5602e4aa9e20 0x5602e4a959e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:07.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.548+0000 7f76ca000640 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602e4a963d0 con 0x5602e49d2930 2024-04-26T20:58:07.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.548+0000 7f76ca000640 1 --2- 172.21.15.138:0/2876611835 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5602e49d2930 0x5602e4a972f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f76bc0b2040 tx=0x7f76bc01aa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:07.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.548+0000 7f76c2a00640 1 -- 172.21.15.138:0/2876611835 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76bc0b4040 con 0x5602e49d2930 2024-04-26T20:58:07.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.548+0000 7f76c2a00640 1 -- 172.21.15.138:0/2876611835 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76bc0c2070 con 0x5602e49d2930 2024-04-26T20:58:07.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.548+0000 7f76c2a00640 1 -- 172.21.15.138:0/2876611835 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76bc0bb6a0 con 0x5602e49d2930 2024-04-26T20:58:07.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.548+0000 7f76ccecf080 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5602e4a96670 con 0x5602e49d2930 2024-04-26T20:58:07.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.548+0000 7f76ccecf080 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602e4a96bb0 con 0x5602e49d2930 2024-04-26T20:58:07.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.548+0000 7f76c2a00640 1 -- 172.21.15.138:0/2876611835 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f76bc0bb840 con 0x5602e49d2930 2024-04-26T20:58:07.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.552+0000 7f76c2a00640 1 --2- 172.21.15.138:0/2876611835 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f76ac066d90 0x7f76ac069250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:07.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.552+0000 7f76c2a00640 1 -- 172.21.15.138:0/2876611835 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6187+0+0 (secure 0 0 0) 0x7f76bc124910 con 0x5602e49d2930 2024-04-26T20:58:07.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.552+0000 7f76c9600640 1 --2- 172.21.15.138:0/2876611835 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f76ac066d90 0x7f76ac069250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:07.553 INFO:teuthology.orchestra.run.smithi138.stdout:Warning: using slow linear search 2024-04-26T20:58:07.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.552+0000 7f76ccecf080 1 --2- 172.21.15.138:0/2876611835 >> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] conn(0x5602e4aacce0 0x5602e4b4cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:07.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.552+0000 7f76ccecf080 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:1 5.0 5:00000000:%01:::head [pgnls start_epoch 42 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e42) -- 0x5602e4a95f20 con 0x5602e4aacce0 2024-04-26T20:58:07.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.552+0000 7f76caa00640 1 --2- 172.21.15.138:0/2876611835 >> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] conn(0x5602e4aacce0 0x5602e4b4cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:07.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.552+0000 7f76caa00640 1 --2- 172.21.15.138:0/2876611835 >> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] conn(0x5602e4aacce0 0x5602e4b4cb00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:07.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.552+0000 7f76c9600640 1 --2- 172.21.15.138:0/2876611835 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f76ac066d90 0x7f76ac069250 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f76b800b7d0 tx=0x7f76b8008000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:07.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.556+0000 7f76caa00640 1 -- 172.21.15.138:0/2876611835 <== osd.4 v2:172.21.15.143:6800/2942056312 1 ==== osd_op_reply(1 [pgnls start_epoch 42 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76c4002ae0 con 0x5602e4aacce0 2024-04-26T20:58:07.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.556+0000 7f76caa00640 1 --2- 172.21.15.138:0/2876611835 >> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] conn(0x7f76c4014040 0x7f76c40133b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:07.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.556+0000 7f76caa00640 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] -- osd_op(unknown.0.0:2 5.10 5:08000000:%01:::head [pgnls start_epoch 42 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e42) -- 0x5602e4a95f20 con 0x7f76c4014040 2024-04-26T20:58:07.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.556+0000 7f76ca000640 1 --2- 172.21.15.138:0/2876611835 >> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] conn(0x7f76c4014040 0x7f76c40133b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:07.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.556+0000 7f76ca000640 1 --2- 172.21.15.138:0/2876611835 >> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] conn(0x7f76c4014040 0x7f76c40133b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:07.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.560+0000 7f76ca000640 1 -- 172.21.15.138:0/2876611835 <== osd.2 v2:172.21.15.138:6808/4273721573 1 ==== osd_op_reply(2 [pgnls start_epoch 42 out=177b] v41'10 uv10 ondisk = 1) ==== 144+0+177 (crc 0 0 0) 0x7f76bc0f0d70 con 0x7f76c4014040 2024-04-26T20:58:07.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.560+0000 7f76ca000640 1 --2- 172.21.15.138:0/2876611835 >> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] conn(0x7f76bc0a7c20 0x7f76bc0f35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:07.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.560+0000 7f76ca000640 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] -- osd_op(unknown.0.0:3 5.8 5:10000000:%01:::head [pgnls start_epoch 42 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e42) -- 0x5602e4a95f20 con 0x7f76bc0a7c20 2024-04-26T20:58:07.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.560+0000 7f76c9600640 1 --2- 172.21.15.138:0/2876611835 >> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] conn(0x7f76bc0a7c20 0x7f76bc0f35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:07.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.560+0000 7f76c9600640 1 --2- 172.21.15.138:0/2876611835 >> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] conn(0x7f76bc0a7c20 0x7f76bc0f35c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:07.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.560+0000 7f76c9600640 1 -- 172.21.15.138:0/2876611835 <== osd.6 v2:172.21.15.143:6816/1082239825 1 ==== osd_op_reply(3 [pgnls start_epoch 42 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76b800d850 con 0x7f76bc0a7c20 2024-04-26T20:58:07.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.560+0000 7f76c9600640 1 --2- 172.21.15.138:0/2876611835 >> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] conn(0x7f76b801dad0 0x7f76b800f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:07.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.560+0000 7f76c9600640 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] -- osd_op(unknown.0.0:4 5.18 5:18000000:%01:::head [pgnls start_epoch 42 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e42) -- 0x5602e4a95f20 con 0x7f76b801dad0 2024-04-26T20:58:07.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.560+0000 7f76caa00640 1 --2- 172.21.15.138:0/2876611835 >> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] conn(0x7f76b801dad0 0x7f76b800f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:07.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.564+0000 7f76caa00640 1 --2- 172.21.15.138:0/2876611835 >> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] conn(0x7f76b801dad0 0x7f76b800f400 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:07.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.564+0000 7f76caa00640 1 -- 172.21.15.138:0/2876611835 <== osd.1 v2:172.21.15.138:6816/1427635773 1 ==== osd_op_reply(4 [pgnls start_epoch 42 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76c4002ae0 con 0x7f76b801dad0 2024-04-26T20:58:07.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.564+0000 7f76caa00640 1 --2- 172.21.15.138:0/2876611835 >> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] conn(0x7f76c4022910 0x7f76c4021390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:07.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.564+0000 7f76caa00640 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] -- osd_op(unknown.0.0:5 5.4 5:20000000:%01:::head [pgnls start_epoch 42 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e42) -- 0x5602e4a95f20 con 0x7f76c4022910 2024-04-26T20:58:07.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.564+0000 7f76ca000640 1 --2- 172.21.15.138:0/2876611835 >> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] conn(0x7f76c4022910 0x7f76c4021390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:07.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.564+0000 7f76ca000640 1 --2- 172.21.15.138:0/2876611835 >> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] conn(0x7f76c4022910 0x7f76c4021390 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:07.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.564+0000 7f76ca000640 1 -- 172.21.15.138:0/2876611835 <== osd.0 v2:172.21.15.138:6800/3534772245 1 ==== osd_op_reply(5 [pgnls start_epoch 42 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76bc0f0d70 con 0x7f76c4022910 2024-04-26T20:58:07.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.564+0000 7f76ca000640 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:6 5.14 5:28000000:%01:::head [pgnls start_epoch 42 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e42) -- 0x5602e4a95f20 con 0x5602e4aacce0 2024-04-26T20:58:07.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.564+0000 7f76caa00640 1 -- 172.21.15.138:0/2876611835 <== osd.4 v2:172.21.15.143:6800/2942056312 2 ==== osd_op_reply(6 [pgnls start_epoch 42 out=149b] v41'19 uv19 ondisk = 1) ==== 144+0+149 (crc 0 0 0) 0x7f76c4002ae0 con 0x5602e4aacce0 2024-04-26T20:58:07.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.564+0000 7f76caa00640 1 --2- 172.21.15.138:0/2876611835 >> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] conn(0x7f76c4020320 0x7f76c40207a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:07.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.564+0000 7f76caa00640 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] -- osd_op(unknown.0.0:7 5.c 5:30000000:%01:::head [pgnls start_epoch 42 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e42) -- 0x5602e4a95f20 con 0x7f76c4020320 2024-04-26T20:58:07.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.564+0000 7f76c9600640 1 --2- 172.21.15.138:0/2876611835 >> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] conn(0x7f76c4020320 0x7f76c40207a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:07.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.564+0000 7f76c9600640 1 --2- 172.21.15.138:0/2876611835 >> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] conn(0x7f76c4020320 0x7f76c40207a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:07.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.568+0000 7f76c9600640 1 -- 172.21.15.138:0/2876611835 <== osd.5 v2:172.21.15.143:6808/1910222887 1 ==== osd_op_reply(7 [pgnls start_epoch 42 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76b800d850 con 0x7f76c4020320 2024-04-26T20:58:07.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.568+0000 7f76c9600640 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] -- osd_op(unknown.0.0:8 5.1c 5:38000000:%01:::head [pgnls start_epoch 42 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e42) -- 0x5602e4a95f20 con 0x7f76c4014040 2024-04-26T20:58:07.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.568+0000 7f76ca000640 1 -- 172.21.15.138:0/2876611835 <== osd.2 v2:172.21.15.138:6808/4273721573 2 ==== osd_op_reply(8 [pgnls start_epoch 42 out=73b] v40'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f76bc0f0d70 con 0x7f76c4014040 2024-04-26T20:58:07.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.568+0000 7f76ca000640 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] -- osd_op(unknown.0.0:9 5.2 5:40000000:%01:::head [pgnls start_epoch 42 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e42) -- 0x5602e4a95f20 con 0x7f76c4022910 2024-04-26T20:58:07.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.568+0000 7f76ca000640 1 -- 172.21.15.138:0/2876611835 <== osd.0 v2:172.21.15.138:6800/3534772245 2 ==== osd_op_reply(9 [pgnls start_epoch 42 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76bc0f0d70 con 0x7f76c4022910 2024-04-26T20:58:07.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.568+0000 7f76ca000640 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] -- osd_op(unknown.0.0:10 5.12 5:48000000:%01:::head [pgnls start_epoch 42 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e42) -- 0x5602e4a95f20 con 0x7f76bc0a7c20 2024-04-26T20:58:07.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.568+0000 7f76c9600640 1 -- 172.21.15.138:0/2876611835 <== osd.6 v2:172.21.15.143:6816/1082239825 2 ==== osd_op_reply(10 [pgnls start_epoch 42 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76b800d850 con 0x7f76bc0a7c20 2024-04-26T20:58:07.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.568+0000 7f76c9600640 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] -- osd_op(unknown.0.0:11 5.a 5:50000000:%01:::head [pgnls start_epoch 42 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e42) -- 0x5602e4a95f20 con 0x7f76bc0a7c20 2024-04-26T20:58:07.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.572+0000 7f76c9600640 1 -- 172.21.15.138:0/2876611835 <== osd.6 v2:172.21.15.143:6816/1082239825 3 ==== osd_op_reply(11 [pgnls start_epoch 42 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76b800d850 con 0x7f76bc0a7c20 2024-04-26T20:58:07.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.572+0000 7f76c9600640 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] -- osd_op(unknown.0.0:12 5.1a 5:58000000:%01:::head [pgnls start_epoch 42 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e42) -- 0x5602e4a95f20 con 0x7f76b801dad0 2024-04-26T20:58:07.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.572+0000 7f76caa00640 1 -- 172.21.15.138:0/2876611835 <== osd.1 v2:172.21.15.138:6816/1427635773 2 ==== osd_op_reply(12 [pgnls start_epoch 42 out=49b] v40'1 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76c4002ae0 con 0x7f76b801dad0 2024-04-26T20:58:07.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.572+0000 7f76caa00640 1 --2- 172.21.15.138:0/2876611835 >> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] conn(0x7f76c4011840 0x7f76c4010320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:07.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.572+0000 7f76caa00640 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- osd_op(unknown.0.0:13 5.6 5:60000000:%01:::head [pgnls start_epoch 42 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e42) -- 0x5602e4a95f20 con 0x7f76c4011840 2024-04-26T20:58:07.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.572+0000 7f76caa00640 1 --2- 172.21.15.138:0/2876611835 >> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] conn(0x7f76c4011840 0x7f76c4010320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:07.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.572+0000 7f76caa00640 1 --2- 172.21.15.138:0/2876611835 >> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] conn(0x7f76c4011840 0x7f76c4010320 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:07.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.576+0000 7f76caa00640 1 -- 172.21.15.138:0/2876611835 <== osd.7 v2:172.21.15.143:6824/3295508495 1 ==== osd_op_reply(13 [pgnls start_epoch 42 out=77b] v41'4 uv4 ondisk = 1) ==== 144+0+77 (crc 0 0 0) 0x7f76c4002ae0 con 0x7f76c4011840 2024-04-26T20:58:07.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.576+0000 7f76caa00640 1 --2- 172.21.15.138:0/2876611835 >> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] conn(0x7f76c4034930 0x7f76c4032400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:07.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.576+0000 7f76caa00640 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:14 5.16 5:68000000:%01:::head [pgnls start_epoch 42 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e42) -- 0x5602e4a95f20 con 0x7f76c4034930 2024-04-26T20:58:07.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.576+0000 7f76ca000640 1 --2- 172.21.15.138:0/2876611835 >> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] conn(0x7f76c4034930 0x7f76c4032400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:07.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.576+0000 7f76ca000640 1 --2- 172.21.15.138:0/2876611835 >> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] conn(0x7f76c4034930 0x7f76c4032400 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:07.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.576+0000 7f76ca000640 1 -- 172.21.15.138:0/2876611835 <== osd.3 v2:172.21.15.138:6824/3098242154 1 ==== osd_op_reply(14 [pgnls start_epoch 42 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76bc0f0d70 con 0x7f76c4034930 2024-04-26T20:58:07.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.576+0000 7f76ca000640 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:15 5.e 5:70000000:%01:::head [pgnls start_epoch 42 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e42) -- 0x5602e4a95f20 con 0x7f76c4034930 2024-04-26T20:58:07.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.576+0000 7f76ca000640 1 -- 172.21.15.138:0/2876611835 <== osd.3 v2:172.21.15.138:6824/3098242154 2 ==== osd_op_reply(15 [pgnls start_epoch 42 out=73b] v40'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f76bc0f0d70 con 0x7f76c4034930 2024-04-26T20:58:07.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.576+0000 7f76ca000640 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] -- osd_op(unknown.0.0:16 5.1e 5:78000000:%01:::head [pgnls start_epoch 42 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e42) -- 0x5602e4a95f20 con 0x7f76bc0a7c20 2024-04-26T20:58:07.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.576+0000 7f76c9600640 1 -- 172.21.15.138:0/2876611835 <== osd.6 v2:172.21.15.143:6816/1082239825 4 ==== osd_op_reply(16 [pgnls start_epoch 42 out=49b] v40'1 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76b800d850 con 0x7f76bc0a7c20 2024-04-26T20:58:07.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.576+0000 7f76c9600640 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:17 5.1 5:80000000:%01:::head [pgnls start_epoch 42 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e42) -- 0x5602e4a95f20 con 0x7f76c4034930 2024-04-26T20:58:07.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.576+0000 7f76ca000640 1 -- 172.21.15.138:0/2876611835 <== osd.3 v2:172.21.15.138:6824/3098242154 3 ==== osd_op_reply(17 [pgnls start_epoch 42 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76bc0f0d70 con 0x7f76c4034930 2024-04-26T20:58:07.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.576+0000 7f76ca000640 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:18 5.11 5:88000000:%01:::head [pgnls start_epoch 42 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e42) -- 0x5602e4a95f20 con 0x7f76c4034930 2024-04-26T20:58:07.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.580+0000 7f76ca000640 1 -- 172.21.15.138:0/2876611835 <== osd.3 v2:172.21.15.138:6824/3098242154 4 ==== osd_op_reply(18 [pgnls start_epoch 42 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76bc0f0d70 con 0x7f76c4034930 2024-04-26T20:58:07.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.580+0000 7f76ca000640 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] -- osd_op(unknown.0.0:19 5.9 5:90000000:%01:::head [pgnls start_epoch 42 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e42) -- 0x5602e4a95f20 con 0x7f76b801dad0 2024-04-26T20:58:07.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.580+0000 7f76caa00640 1 -- 172.21.15.138:0/2876611835 <== osd.1 v2:172.21.15.138:6816/1427635773 3 ==== osd_op_reply(19 [pgnls start_epoch 42 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76c4002ae0 con 0x7f76b801dad0 2024-04-26T20:58:07.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.580+0000 7f76caa00640 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:20 5.19 5:98000000:%01:::head [pgnls start_epoch 42 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e42) -- 0x5602e4a95f20 con 0x5602e4aacce0 2024-04-26T20:58:07.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.580+0000 7f76caa00640 1 -- 172.21.15.138:0/2876611835 <== osd.4 v2:172.21.15.143:6800/2942056312 3 ==== osd_op_reply(20 [pgnls start_epoch 42 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76c4002ae0 con 0x5602e4aacce0 2024-04-26T20:58:07.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.580+0000 7f76caa00640 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- osd_op(unknown.0.0:21 5.5 5:a0000000:%01:::head [pgnls start_epoch 42 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e42) -- 0x5602e4a95f20 con 0x7f76c4011840 2024-04-26T20:58:07.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.580+0000 7f76caa00640 1 -- 172.21.15.138:0/2876611835 <== osd.7 v2:172.21.15.143:6824/3295508495 2 ==== osd_op_reply(21 [pgnls start_epoch 42 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76c4002ae0 con 0x7f76c4011840 2024-04-26T20:58:07.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.580+0000 7f76caa00640 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:22 5.15 5:a8000000:%01:::head [pgnls start_epoch 42 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e42) -- 0x5602e4a95f20 con 0x7f76c4034930 2024-04-26T20:58:07.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.580+0000 7f76ca000640 1 -- 172.21.15.138:0/2876611835 <== osd.3 v2:172.21.15.138:6824/3098242154 5 ==== osd_op_reply(22 [pgnls start_epoch 42 out=97b] v40'3 uv3 ondisk = 1) ==== 144+0+97 (crc 0 0 0) 0x7f76bc0f0d70 con 0x7f76c4034930 2024-04-26T20:58:07.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.580+0000 7f76ca000640 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- osd_op(unknown.0.0:23 5.d 5:b0000000:%01:::head [pgnls start_epoch 42 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e42) -- 0x5602e4a95f20 con 0x7f76c4011840 2024-04-26T20:58:07.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.580+0000 7f76caa00640 1 -- 172.21.15.138:0/2876611835 <== osd.7 v2:172.21.15.143:6824/3295508495 3 ==== osd_op_reply(23 [pgnls start_epoch 42 out=74b] v40'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f76c4002ae0 con 0x7f76c4011840 2024-04-26T20:58:07.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.580+0000 7f76caa00640 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:24 5.1d 5:b8000000:%01:::head [pgnls start_epoch 42 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e42) -- 0x5602e4a95f20 con 0x5602e4aacce0 2024-04-26T20:58:07.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.580+0000 7f76caa00640 1 -- 172.21.15.138:0/2876611835 <== osd.4 v2:172.21.15.143:6800/2942056312 4 ==== osd_op_reply(24 [pgnls start_epoch 42 out=73b] v40'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f76c4002ae0 con 0x5602e4aacce0 2024-04-26T20:58:07.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.580+0000 7f76caa00640 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:25 5.3 5:c0000000:%01:::head [pgnls start_epoch 42 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e42) -- 0x5602e4a95f20 con 0x5602e4aacce0 2024-04-26T20:58:07.583 INFO:tasks.ceph.mds.b.smithi143.stdout:starting mds.b at 2024-04-26T20:58:07.584 INFO:tasks.ceph.mds.d.smithi143.stdout:starting mds.d at 2024-04-26T20:58:07.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.580+0000 7f76caa00640 1 -- 172.21.15.138:0/2876611835 <== osd.4 v2:172.21.15.143:6800/2942056312 5 ==== osd_op_reply(25 [pgnls start_epoch 42 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76c4002ae0 con 0x5602e4aacce0 2024-04-26T20:58:07.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.580+0000 7f76caa00640 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:26 5.13 5:c8000000:%01:::head [pgnls start_epoch 42 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e42) -- 0x5602e4a95f20 con 0x5602e4aacce0 2024-04-26T20:58:07.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.584+0000 7f76caa00640 1 -- 172.21.15.138:0/2876611835 <== osd.4 v2:172.21.15.143:6800/2942056312 6 ==== osd_op_reply(26 [pgnls start_epoch 42 out=98b] v41'3 uv3 ondisk = 1) ==== 144+0+98 (crc 0 0 0) 0x7f76c4002ae0 con 0x5602e4aacce0 2024-04-26T20:58:07.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.584+0000 7f76caa00640 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] -- osd_op(unknown.0.0:27 5.b 5:d0000000:%01:::head [pgnls start_epoch 42 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e42) -- 0x5602e4a95f20 con 0x7f76c4020320 2024-04-26T20:58:07.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.584+0000 7f76c9600640 1 -- 172.21.15.138:0/2876611835 <== osd.5 v2:172.21.15.143:6808/1910222887 2 ==== osd_op_reply(27 [pgnls start_epoch 42 out=76b] v41'3 uv3 ondisk = 1) ==== 144+0+76 (crc 0 0 0) 0x7f76b800d850 con 0x7f76c4020320 2024-04-26T20:58:07.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.584+0000 7f76c9600640 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] -- osd_op(unknown.0.0:28 5.1b 5:d8000000:%01:::head [pgnls start_epoch 42 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e42) -- 0x5602e4a95f20 con 0x7f76c4014040 2024-04-26T20:58:07.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.584+0000 7f76ca000640 1 -- 172.21.15.138:0/2876611835 <== osd.2 v2:172.21.15.138:6808/4273721573 3 ==== osd_op_reply(28 [pgnls start_epoch 42 out=49b] v40'1 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76bc0f0d70 con 0x7f76c4014040 2024-04-26T20:58:07.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.584+0000 7f76ca000640 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:29 5.7 5:e0000000:%01:::head [pgnls start_epoch 42 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e42) -- 0x5602e4a95f20 con 0x7f76c4034930 2024-04-26T20:58:07.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.584+0000 7f76ca000640 1 -- 172.21.15.138:0/2876611835 <== osd.3 v2:172.21.15.138:6824/3098242154 6 ==== osd_op_reply(29 [pgnls start_epoch 42 out=73b] v40'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f76bc0f0d70 con 0x7f76c4034930 2024-04-26T20:58:07.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.584+0000 7f76ca000640 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:30 5.17 5:e8000000:%01:::head [pgnls start_epoch 42 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e42) -- 0x5602e4a95f20 con 0x5602e4aacce0 2024-04-26T20:58:07.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.584+0000 7f76caa00640 1 -- 172.21.15.138:0/2876611835 <== osd.4 v2:172.21.15.143:6800/2942056312 7 ==== osd_op_reply(30 [pgnls start_epoch 42 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76c4002ae0 con 0x5602e4aacce0 2024-04-26T20:58:07.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.584+0000 7f76caa00640 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] -- osd_op(unknown.0.0:31 5.f 5:f0000000:%01:::head [pgnls start_epoch 42 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e42) -- 0x5602e4a95f20 con 0x7f76b801dad0 2024-04-26T20:58:07.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.584+0000 7f76caa00640 1 -- 172.21.15.138:0/2876611835 <== osd.1 v2:172.21.15.138:6816/1427635773 4 ==== osd_op_reply(31 [pgnls start_epoch 42 out=73b] v40'1 uv1 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f76c4002ae0 con 0x7f76b801dad0 2024-04-26T20:58:07.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.584+0000 7f76caa00640 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] -- osd_op(unknown.0.0:32 5.1f 5:f8000000:%01:::head [pgnls start_epoch 42 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e42) -- 0x5602e4a95f20 con 0x7f76c4014040 2024-04-26T20:58:07.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.584+0000 7f76ca000640 1 -- 172.21.15.138:0/2876611835 <== osd.2 v2:172.21.15.138:6808/4273721573 4 ==== osd_op_reply(32 [pgnls start_epoch 42 out=101b] v41'6 uv6 ondisk = 1) ==== 144+0+101 (crc 0 0 0) 0x7f76bc0f0d70 con 0x7f76c4014040 2024-04-26T20:58:07.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.584+0000 7f76ccecf080 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] -- osd_op(unknown.0.0:33 5.10 5:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e42) -- 0x5602e4b438a0 con 0x7f76c4014040 2024-04-26T20:58:07.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.584+0000 7f76ccecf080 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] -- osd_op(unknown.0.0:34 5.10 5:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e42) -- 0x5602e4b4d040 con 0x7f76c4014040 2024-04-26T20:58:07.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.584+0000 7f76ccecf080 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] -- osd_op(unknown.0.0:35 5.10 5:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e42) -- 0x5602e4b4d890 con 0x7f76c4014040 2024-04-26T20:58:07.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.584+0000 7f76ccecf080 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] -- osd_op(unknown.0.0:36 5.10 5:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e42) -- 0x5602e4b4e0e0 con 0x7f76c4014040 2024-04-26T20:58:07.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.584+0000 7f76ccecf080 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] -- osd_op(unknown.0.0:37 5.10 5:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e42) -- 0x5602e4b4e930 con 0x7f76c4014040 2024-04-26T20:58:07.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.584+0000 7f76ccecf080 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:38 5.14 5:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e42) -- 0x5602e4b4f180 con 0x5602e4aacce0 2024-04-26T20:58:07.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.584+0000 7f76ccecf080 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:39 5.14 5:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e42) -- 0x5602e4b4f9d0 con 0x5602e4aacce0 2024-04-26T20:58:07.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.584+0000 7f76ccecf080 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:40 5.14 5:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e42) -- 0x5602e4b50220 con 0x5602e4aacce0 2024-04-26T20:58:07.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.584+0000 7f76ccecf080 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:41 5.14 5:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e42) -- 0x5602e4b50a70 con 0x5602e4aacce0 2024-04-26T20:58:07.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.584+0000 7f76ccecf080 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] -- osd_op(unknown.0.0:42 5.1c 5:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e42) -- 0x5602e4b51490 con 0x7f76c4014040 2024-04-26T20:58:07.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.584+0000 7f76ccecf080 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- osd_op(unknown.0.0:43 5.6 5:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e42) -- 0x5602e4b52010 con 0x7f76c4011840 2024-04-26T20:58:07.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.584+0000 7f76ccecf080 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:44 5.e 5:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e42) -- 0x5602e4b52ab0 con 0x7f76c4034930 2024-04-26T20:58:07.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.584+0000 7f76ccecf080 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:45 5.15 5:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e42) -- 0x5602e4b535d0 con 0x7f76c4034930 2024-04-26T20:58:07.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.584+0000 7f76ccecf080 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:46 5.15 5:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e42) -- 0x5602e4b54110 con 0x7f76c4034930 2024-04-26T20:58:07.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.584+0000 7f76ccecf080 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- osd_op(unknown.0.0:47 5.d 5:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e42) -- 0x5602e4b54960 con 0x7f76c4011840 2024-04-26T20:58:07.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.584+0000 7f76ccecf080 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:48 5.1d 5:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e42) -- 0x5602e4b553c0 con 0x5602e4aacce0 2024-04-26T20:58:07.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.588+0000 7f76caa00640 1 -- 172.21.15.138:0/2876611835 <== osd.7 v2:172.21.15.143:6824/3295508495 4 ==== osd_op_reply(47 mds_snaptable [delete] v42'2 uv2 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f76c4002ae0 con 0x7f76c4011840 2024-04-26T20:58:07.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.588+0000 7f76caa00640 1 -- 172.21.15.138:0/2876611835 <== osd.7 v2:172.21.15.143:6824/3295508495 5 ==== osd_op_reply(43 mds0_openfiles.0 [delete] v42'5 uv5 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f76c4002ae0 con 0x7f76c4011840 2024-04-26T20:58:07.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.588+0000 7f76ccecf080 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:49 5.13 5:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e42) -- 0x5602e4b54110 con 0x5602e4aacce0 2024-04-26T20:58:07.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.588+0000 7f76ccecf080 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:50 5.13 5:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e42) -- 0x5602e4b54530 con 0x5602e4aacce0 2024-04-26T20:58:07.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.588+0000 7f76caa00640 1 -- 172.21.15.138:0/2876611835 <== osd.4 v2:172.21.15.143:6800/2942056312 8 ==== osd_op_reply(48 605.00000000 [delete] v42'3 uv3 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f76c4002ae0 con 0x5602e4aacce0 2024-04-26T20:58:07.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.588+0000 7f76caa00640 1 -- 172.21.15.138:0/2876611835 <== osd.4 v2:172.21.15.143:6800/2942056312 9 ==== osd_op_reply(38 1.00000000.inode [delete] v42'20 uv20 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f76c4002ae0 con 0x5602e4aacce0 2024-04-26T20:58:07.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.588+0000 7f76ccecf080 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] -- osd_op(unknown.0.0:51 5.b 5:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e42) -- 0x5602e4b54530 con 0x7f76c4020320 2024-04-26T20:58:07.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.588+0000 7f76ccecf080 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:52 5.7 5:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e42) -- 0x5602e4b54110 con 0x7f76c4034930 2024-04-26T20:58:07.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.588+0000 7f76caa00640 1 -- 172.21.15.138:0/2876611835 <== osd.4 v2:172.21.15.143:6800/2942056312 10 ==== osd_op_reply(39 200.00000000 [delete] v42'21 uv21 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f76c4002ae0 con 0x5602e4aacce0 2024-04-26T20:58:07.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.588+0000 7f76ccecf080 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] -- osd_op(unknown.0.0:53 5.f 5:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e42) -- 0x5602e4b55c10 con 0x7f76b801dad0 2024-04-26T20:58:07.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.588+0000 7f76ca000640 1 -- 172.21.15.138:0/2876611835 <== osd.2 v2:172.21.15.138:6808/4273721573 5 ==== osd_op_reply(42 607.00000000 [delete] v42'3 uv3 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f76bc0f0d70 con 0x7f76c4014040 2024-04-26T20:58:07.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.588+0000 7f76ca000640 1 -- 172.21.15.138:0/2876611835 <== osd.2 v2:172.21.15.138:6808/4273721573 6 ==== osd_op_reply(33 601.00000000 [delete] v42'11 uv11 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f76bc0f0d70 con 0x7f76c4014040 2024-04-26T20:58:07.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.588+0000 7f76ccecf080 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] -- osd_op(unknown.0.0:54 5.1f 5:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e42) -- 0x5602e4b44320 con 0x7f76c4014040 2024-04-26T20:58:07.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.588+0000 7f76ca000640 1 -- 172.21.15.138:0/2876611835 <== osd.3 v2:172.21.15.138:6824/3098242154 7 ==== osd_op_reply(45 604.00000000 [delete] v42'4 uv4 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f76bc0f0d70 con 0x7f76c4034930 2024-04-26T20:58:07.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.588+0000 7f76ccecf080 1 -- 172.21.15.138:0/2876611835 --> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] -- osd_op(unknown.0.0:55 5.1f 5:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e42) -- 0x5602e4b56100 con 0x7f76c4014040 2024-04-26T20:58:07.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.588+0000 7f76caa00640 1 -- 172.21.15.138:0/2876611835 <== osd.4 v2:172.21.15.143:6800/2942056312 11 ==== osd_op_reply(40 200.00000001 [delete] v42'22 uv22 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f76c4002ae0 con 0x5602e4aacce0 2024-04-26T20:58:07.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.592+0000 7f76ca000640 1 -- 172.21.15.138:0/2876611835 <== osd.2 v2:172.21.15.138:6808/4273721573 7 ==== osd_op_reply(34 602.00000000 [delete] v42'12 uv12 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f76bc0f0d70 con 0x7f76c4014040 2024-04-26T20:58:07.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.592+0000 7f76caa00640 1 -- 172.21.15.138:0/2876611835 <== osd.4 v2:172.21.15.143:6800/2942056312 12 ==== osd_op_reply(41 606.00000000 [delete] v42'23 uv23 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f76c4002ae0 con 0x5602e4aacce0 2024-04-26T20:58:07.593 INFO:tasks.ceph.mds.a.smithi138.stdout:starting mds.a at 2024-04-26T20:58:07.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.592+0000 7f76ca000640 1 -- 172.21.15.138:0/2876611835 <== osd.2 v2:172.21.15.138:6808/4273721573 8 ==== osd_op_reply(35 10000000000.00000000 [delete] v42'13 uv13 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f76bc0f0d70 con 0x7f76c4014040 2024-04-26T20:58:07.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.592+0000 7f76ca000640 1 -- 172.21.15.138:0/2876611835 <== osd.2 v2:172.21.15.138:6808/4273721573 9 ==== osd_op_reply(36 600.00000000 [delete] v42'14 uv14 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f76bc0f0d70 con 0x7f76c4014040 2024-04-26T20:58:07.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.592+0000 7f76ca000640 1 -- 172.21.15.138:0/2876611835 <== osd.3 v2:172.21.15.138:6824/3098242154 8 ==== osd_op_reply(44 608.00000000 [delete] v42'3 uv3 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f76bc0f0d70 con 0x7f76c4034930 2024-04-26T20:58:07.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.592+0000 7f76caa00640 1 -- 172.21.15.138:0/2876611835 <== osd.4 v2:172.21.15.143:6800/2942056312 13 ==== osd_op_reply(49 mds0_inotable [delete] v42'4 uv4 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f76c4002ae0 con 0x5602e4aacce0 2024-04-26T20:58:07.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.592+0000 7f76c9600640 1 -- 172.21.15.138:0/2876611835 <== osd.5 v2:172.21.15.143:6808/1910222887 3 ==== osd_op_reply(51 mds0_sessionmap [delete] v42'4 uv4 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f76b800d850 con 0x7f76c4020320 2024-04-26T20:58:07.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.592+0000 7f76caa00640 1 -- 172.21.15.138:0/2876611835 <== osd.4 v2:172.21.15.143:6800/2942056312 14 ==== osd_op_reply(50 100.00000000 [delete] v42'5 uv5 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f76c4002ae0 con 0x5602e4aacce0 2024-04-26T20:58:07.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.592+0000 7f76ca000640 1 -- 172.21.15.138:0/2876611835 <== osd.2 v2:172.21.15.138:6808/4273721573 10 ==== osd_op_reply(37 603.00000000 [delete] v42'15 uv15 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f76bc0f0d70 con 0x7f76c4014040 2024-04-26T20:58:07.594 INFO:tasks.ceph.mds.c.smithi138.stdout:starting mds.c at 2024-04-26T20:58:07.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.592+0000 7f76ca000640 1 -- 172.21.15.138:0/2876611835 <== osd.3 v2:172.21.15.138:6824/3098242154 9 ==== osd_op_reply(46 500.00000000 [delete] v42'5 uv5 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f76bc0f0d70 con 0x7f76c4034930 2024-04-26T20:58:07.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.592+0000 7f76ca000640 1 -- 172.21.15.138:0/2876611835 <== osd.2 v2:172.21.15.138:6808/4273721573 11 ==== osd_op_reply(54 100.00000000.inode [delete] v42'7 uv7 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f76bc0f0d70 con 0x7f76c4014040 2024-04-26T20:58:07.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.596+0000 7f76ca000640 1 -- 172.21.15.138:0/2876611835 <== osd.3 v2:172.21.15.138:6824/3098242154 10 ==== osd_op_reply(52 609.00000000 [delete] v42'3 uv3 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f76bc0f0d70 con 0x7f76c4034930 2024-04-26T20:58:07.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.596+0000 7f76caa00640 1 -- 172.21.15.138:0/2876611835 <== osd.1 v2:172.21.15.138:6816/1427635773 5 ==== osd_op_reply(53 400.00000000 [delete] v42'2 uv2 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f76c4002ae0 con 0x7f76b801dad0 2024-04-26T20:58:07.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.596+0000 7f76ca000640 1 -- 172.21.15.138:0/2876611835 <== osd.2 v2:172.21.15.138:6808/4273721573 12 ==== osd_op_reply(55 1.00000000 [delete] v42'8 uv8 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f76bc0f0d70 con 0x7f76c4014040 2024-04-26T20:58:07.596 INFO:teuthology.orchestra.run.smithi138.stdout:Removed 23 objects 2024-04-26T20:58:07.596 INFO:teuthology.orchestra.run.smithi138.stdout:successfully purged pool cephfs_metadata 2024-04-26T20:58:07.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.596+0000 7f76ccecf080 1 -- 172.21.15.138:0/2876611835 >> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] conn(0x7f76c4022910 msgr2=0x7f76c4021390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:07.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.596+0000 7f76ccecf080 1 --2- 172.21.15.138:0/2876611835 >> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] conn(0x7f76c4022910 0x7f76c4021390 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:07.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.596+0000 7f76ccecf080 1 -- 172.21.15.138:0/2876611835 >> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] conn(0x7f76b801dad0 msgr2=0x7f76b800f400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:07.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.596+0000 7f76ccecf080 1 --2- 172.21.15.138:0/2876611835 >> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] conn(0x7f76b801dad0 0x7f76b800f400 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:07.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.596+0000 7f76ccecf080 1 -- 172.21.15.138:0/2876611835 >> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] conn(0x7f76c4014040 msgr2=0x7f76c40133b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:07.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.596+0000 7f76ccecf080 1 --2- 172.21.15.138:0/2876611835 >> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] conn(0x7f76c4014040 0x7f76c40133b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:07.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.596+0000 7f76ccecf080 1 -- 172.21.15.138:0/2876611835 >> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] conn(0x7f76c4034930 msgr2=0x7f76c4032400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:07.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.596+0000 7f76ccecf080 1 --2- 172.21.15.138:0/2876611835 >> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] conn(0x7f76c4034930 0x7f76c4032400 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:07.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.596+0000 7f76ccecf080 1 -- 172.21.15.138:0/2876611835 >> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] conn(0x5602e4aacce0 msgr2=0x5602e4b4cb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:07.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.596+0000 7f76ccecf080 1 --2- 172.21.15.138:0/2876611835 >> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] conn(0x5602e4aacce0 0x5602e4b4cb00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:07.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.596+0000 7f76ccecf080 1 -- 172.21.15.138:0/2876611835 >> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] conn(0x7f76c4020320 msgr2=0x7f76c40207a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:07.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.596+0000 7f76ccecf080 1 --2- 172.21.15.138:0/2876611835 >> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] conn(0x7f76c4020320 0x7f76c40207a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:07.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.596+0000 7f76ccecf080 1 -- 172.21.15.138:0/2876611835 >> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] conn(0x7f76bc0a7c20 msgr2=0x7f76bc0f35c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:07.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.596+0000 7f76ccecf080 1 --2- 172.21.15.138:0/2876611835 >> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] conn(0x7f76bc0a7c20 0x7f76bc0f35c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:07.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.596+0000 7f76ccecf080 1 -- 172.21.15.138:0/2876611835 >> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] conn(0x7f76c4011840 msgr2=0x7f76c4010320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:07.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.596+0000 7f76ccecf080 1 --2- 172.21.15.138:0/2876611835 >> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] conn(0x7f76c4011840 0x7f76c4010320 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:07.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.596+0000 7f76caa00640 1 -- 172.21.15.138:0/2876611835 reap_dead start 2024-04-26T20:58:07.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.596+0000 7f76caa00640 1 -- 172.21.15.138:0/2876611835 reap_dead start 2024-04-26T20:58:07.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.596+0000 7f76caa00640 1 -- 172.21.15.138:0/2876611835 reap_dead start 2024-04-26T20:58:07.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.596+0000 7f76ccecf080 1 -- 172.21.15.138:0/2876611835 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f76ac066d90 msgr2=0x7f76ac069250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:07.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.596+0000 7f76ccecf080 1 --2- 172.21.15.138:0/2876611835 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f76ac066d90 0x7f76ac069250 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f76b800b7d0 tx=0x7f76b8008000 comp rx=0 tx=0).stop 2024-04-26T20:58:07.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.596+0000 7f76ccecf080 1 -- 172.21.15.138:0/2876611835 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5602e49d2930 msgr2=0x5602e4a972f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:07.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.596+0000 7f76ccecf080 1 --2- 172.21.15.138:0/2876611835 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5602e49d2930 0x5602e4a972f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f76bc0b2040 tx=0x7f76bc01aa00 comp rx=0 tx=0).stop 2024-04-26T20:58:07.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.596+0000 7f76ccecf080 1 -- 172.21.15.138:0/2876611835 shutdown_connections 2024-04-26T20:58:07.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.596+0000 7f76ccecf080 1 --2- 172.21.15.138:0/2876611835 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f76ac066d90 0x7f76ac069250 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:07.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.596+0000 7f76ccecf080 1 --2- 172.21.15.138:0/2876611835 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5602e49d2930 0x5602e4a972f0 secure :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f76bc0b2040 tx=0x7f76bc01aa00 comp rx=0 tx=0).stop 2024-04-26T20:58:07.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.596+0000 7f76ccecf080 1 -- 172.21.15.138:0/2876611835 >> 172.21.15.138:0/2876611835 conn(0x5602e49d8cf0 msgr2=0x5602e4a1faa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:07.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.596+0000 7f76ccecf080 1 -- 172.21.15.138:0/2876611835 shutdown_connections 2024-04-26T20:58:07.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.596+0000 7f76ccecf080 1 -- 172.21.15.138:0/2876611835 wait complete. 2024-04-26T20:58:07.603 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:58:07.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.780+0000 7f80dda00640 1 Processor -- start 2024-04-26T20:58:07.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.780+0000 7f80dda00640 1 -- start start 2024-04-26T20:58:07.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.784+0000 7f80dda00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f80d815ce20 0x7f80d8161340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:07.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.784+0000 7f80dda00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f80d80cca00 0x7f80d80cce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:07.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.784+0000 7f80dda00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80d8073b70 con 0x7f80d815e0c0 2024-04-26T20:58:07.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.784+0000 7f80dda00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f80d80cd390 con 0x7f80d80cca00 2024-04-26T20:58:07.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.784+0000 7f80dda00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f80d8073e10 con 0x7f80d815ce20 2024-04-26T20:58:07.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.784+0000 7f80cfe00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f80d815e0c0 0x7f80d8071ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:44394/0 (socket says 172.21.15.138:44394) 2024-04-26T20:58:07.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.784+0000 7f80cfe00640 1 -- 172.21.15.138:0/1113938124 learned_addr learned my addr 172.21.15.138:0/1113938124 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:07.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.784+0000 7f80d7400640 1 --2- 172.21.15.138:0/1113938124 >> v2:172.21.15.143:3300/0 conn(0x7f80d80cca00 0x7f80d80cce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:07.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.784+0000 7f80d6a00640 1 --2- 172.21.15.138:0/1113938124 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f80d815ce20 0x7f80d8161340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:07.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.784+0000 7f80d6000640 1 -- 172.21.15.138:0/1113938124 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3484895379 0 0) 0x7f80d8073b70 con 0x7f80d815e0c0 2024-04-26T20:58:07.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.784+0000 7f80d6000640 1 -- 172.21.15.138:0/1113938124 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80bc003530 con 0x7f80d815e0c0 2024-04-26T20:58:07.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.784+0000 7f80d6a00640 1 -- 172.21.15.138:0/1113938124 >> v2:172.21.15.143:3300/0 conn(0x7f80d80cca00 msgr2=0x7f80d80cce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:07.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.784+0000 7f80d6a00640 1 --2- 172.21.15.138:0/1113938124 >> v2:172.21.15.143:3300/0 conn(0x7f80d80cca00 0x7f80d80cce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:07.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.784+0000 7f80d6a00640 1 -- 172.21.15.138:0/1113938124 >> v1:172.21.15.138:6789/0 conn(0x7f80d815e0c0 legacy=0x7f80d8071ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:07.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.784+0000 7f80d6a00640 1 -- 172.21.15.138:0/1113938124 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80d80740f0 con 0x7f80d815ce20 2024-04-26T20:58:07.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.784+0000 7f80d7400640 1 --2- 172.21.15.138:0/1113938124 >> v2:172.21.15.143:3300/0 conn(0x7f80d80cca00 0x7f80d80cce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:58:07.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.788+0000 7f80d6a00640 1 --2- 172.21.15.138:0/1113938124 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f80d815ce20 0x7f80d8161340 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f80c80097c0 tx=0x7f80c801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3dfc8178218f1e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:07.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.788+0000 7f80d6000640 1 -- 172.21.15.138:0/1113938124 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80c80b0070 con 0x7f80d815ce20 2024-04-26T20:58:07.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.788+0000 7f80d6000640 1 -- 172.21.15.138:0/1113938124 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80c80ab600 con 0x7f80d815ce20 2024-04-26T20:58:07.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.788+0000 7f80d6000640 1 -- 172.21.15.138:0/1113938124 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80c80ab9b0 con 0x7f80d815ce20 2024-04-26T20:58:07.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.788+0000 7f80dda00640 1 -- 172.21.15.138:0/1113938124 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f80d815ce20 msgr2=0x7f80d8161340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:07.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.788+0000 7f80dda00640 1 --2- 172.21.15.138:0/1113938124 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f80d815ce20 0x7f80d8161340 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f80c80097c0 tx=0x7f80c801c4a0 comp rx=0 tx=0).stop 2024-04-26T20:58:07.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.788+0000 7f80dda00640 1 -- 172.21.15.138:0/1113938124 shutdown_connections 2024-04-26T20:58:07.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.788+0000 7f80dda00640 1 --2- 172.21.15.138:0/1113938124 >> v2:172.21.15.143:3300/0 conn(0x7f80d80cca00 0x7f80d80cce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:07.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.788+0000 7f80dda00640 1 --2- 172.21.15.138:0/1113938124 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f80d815ce20 0x7f80d8161340 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:07.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.788+0000 7f80dda00640 1 -- 172.21.15.138:0/1113938124 >> 172.21.15.138:0/1113938124 conn(0x7f80d80d0b20 msgr2=0x7f80d80d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:07.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.788+0000 7f80dda00640 1 -- 172.21.15.138:0/1113938124 shutdown_connections 2024-04-26T20:58:07.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.788+0000 7f80dda00640 1 -- 172.21.15.138:0/1113938124 wait complete. 2024-04-26T20:58:07.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.788+0000 7f80dda00640 1 Processor -- start 2024-04-26T20:58:07.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.788+0000 7f80dda00640 1 -- start start 2024-04-26T20:58:07.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.792+0000 7f80dda00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f80d80cca00 0x7f80d80b16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:07.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.792+0000 7f80dda00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80d815ce20 0x7f80d80b1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:07.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.792+0000 7f80dda00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f80d815e0c0 0x7f80d80ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:07.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.792+0000 7f80dda00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f80d815d380 con 0x7f80d815ce20 2024-04-26T20:58:07.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.792+0000 7f80dda00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f80d815d200 con 0x7f80d80cca00 2024-04-26T20:58:07.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.792+0000 7f80dda00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f80d806e680 con 0x7f80d815e0c0 2024-04-26T20:58:07.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.792+0000 7f80cfe00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80d815ce20 0x7f80d80b1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:07.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.792+0000 7f80cfe00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80d815ce20 0x7f80d80b1c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:59142/0 (socket says 172.21.15.138:59142) 2024-04-26T20:58:07.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.792+0000 7f80cfe00640 1 -- 172.21.15.138:0/1099246132 learned_addr learned my addr 172.21.15.138:0/1099246132 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:07.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.792+0000 7f80d6a00640 1 --2- 172.21.15.138:0/1099246132 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f80d80cca00 0x7f80d80b16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:07.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.792+0000 7f80cfe00640 1 -- 172.21.15.138:0/1099246132 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f80d815e0c0 msgr2=0x7f80d80ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:07.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.792+0000 7f80cfe00640 1 --2- 172.21.15.138:0/1099246132 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f80d815e0c0 0x7f80d80ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:07.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.792+0000 7f80cfe00640 1 -- 172.21.15.138:0/1099246132 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f80d80cca00 msgr2=0x7f80d80b16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:07.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.792+0000 7f80cfe00640 1 --2- 172.21.15.138:0/1099246132 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f80d80cca00 0x7f80d80b16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:07.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.792+0000 7f80cfe00640 1 -- 172.21.15.138:0/1099246132 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80d80c5fb0 con 0x7f80d815ce20 2024-04-26T20:58:07.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.792+0000 7f80d6a00640 1 --2- 172.21.15.138:0/1099246132 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f80d80cca00 0x7f80d80b16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:58:07.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.792+0000 7f80cfe00640 1 --2- 172.21.15.138:0/1099246132 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80d815ce20 0x7f80d80b1c10 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f80c00010f0 tx=0x7f80c000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:07.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.792+0000 7f80cea00640 1 -- 172.21.15.138:0/1099246132 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80c0017070 con 0x7f80d815ce20 2024-04-26T20:58:07.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.792+0000 7f80cea00640 1 -- 172.21.15.138:0/1099246132 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80c0005d10 con 0x7f80d815ce20 2024-04-26T20:58:07.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.792+0000 7f80cea00640 1 -- 172.21.15.138:0/1099246132 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80c0007310 con 0x7f80d815ce20 2024-04-26T20:58:07.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.792+0000 7f80dda00640 1 -- 172.21.15.138:0/1099246132 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80d80c6250 con 0x7f80d815ce20 2024-04-26T20:58:07.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.792+0000 7f80dda00640 1 -- 172.21.15.138:0/1099246132 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80d80c6810 con 0x7f80d815ce20 2024-04-26T20:58:07.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.792+0000 7f80dda00640 1 -- 172.21.15.138:0/1099246132 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80d8069510 con 0x7f80d815ce20 2024-04-26T20:58:07.795 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:58:07.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.792+0000 7f80cea00640 1 -- 172.21.15.138:0/1099246132 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f80c001a070 con 0x7f80d815ce20 2024-04-26T20:58:07.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.796+0000 7f80cea00640 1 --2- 172.21.15.138:0/1099246132 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f80b4068380 0x7f80b406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:07.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.796+0000 7f80cea00640 1 -- 172.21.15.138:0/1099246132 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6187+0+0 (secure 0 0 0) 0x7f80c0085f40 con 0x7f80d815ce20 2024-04-26T20:58:07.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.796+0000 7f80d6a00640 1 --2- 172.21.15.138:0/1099246132 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f80b4068380 0x7f80b406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:07.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.796+0000 7f80d6a00640 1 --2- 172.21.15.138:0/1099246132 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f80b4068380 0x7f80b406a840 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f80c80ad000 tx=0x7f80c80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:07.799 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:58:07.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.800+0000 7f80cea00640 1 -- 172.21.15.138:0/1099246132 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f80c0056310 con 0x7f80d815ce20 2024-04-26T20:58:07.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.956+0000 7f80dda00640 1 -- 172.21.15.138:0/1099246132 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f80d80caed0 con 0x7f80d815ce20 2024-04-26T20:58:07.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.956+0000 7f80cea00640 1 -- 172.21.15.138:0/1099246132 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) ==== 74+0+17131 (secure 0 0 0) 0x7f80c0055c10 con 0x7f80d815ce20 2024-04-26T20:58:07.959 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:07.959 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":46,"fsid":"c22b4730-12cc-4558-8535-b965384398c0","created":"2024-04-26T20:56:14.182475+0000","modified":"2024-04-26T20:58:07.647676+0000","last_up_change":"2024-04-26T20:56:26.013243+0000","last_in_change":"2024-04-26T20:56:16.714055+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:56:27.265834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:57:49.597600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-26T20:57:50.901951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3f9a2e34-3199-466f-a6cf-57927318121e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6801","nonce":3534772245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6803","nonce":3534772245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6807","nonce":3534772245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6805","nonce":3534772245}]},"public_addr":"172.21.15.138:6801/3534772245","cluster_addr":"172.21.15.138:6803/3534772245","heartbeat_back_addr":"172.21.15.138:6807/3534772245","heartbeat_front_addr":"172.21.15.138:6805/3534772245","state":["exists","up"]},{"osd":1,"uuid":"e881fcf6-3248-4696-a2ef-95d206d77712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6817","nonce":1427635773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6819","nonce":1427635773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6823","nonce":1427635773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6821","nonce":1427635773}]},"public_addr":"172.21.15.138:6817/1427635773","cluster_addr":"172.21.15.138:6819/1427635773","heartbeat_back_addr":"172.21.15.138:6823/1427635773","heartbeat_front_addr":"172.21.15.138:6821/1427635773","state":["exists","up"]},{"osd":2,"uuid":"f7d1db33-7672-4699-ae47-9f1e0a8e4222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6809","nonce":4273721573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6811","nonce":4273721573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6815","nonce":4273721573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6813","nonce":4273721573}]},"public_addr":"172.21.15.138:6809/4273721573","cluster_addr":"172.21.15.138:6811/4273721573","heartbeat_back_addr":"172.21.15.138:6815/4273721573","heartbeat_front_addr":"172.21.15.138:6813/4273721573","state":["exists","up"]},{"osd":3,"uuid":"2f4e0a9a-b8f6-4468-844a-a4501cd85054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6825","nonce":3098242154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6827","nonce":3098242154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6831","nonce":3098242154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6829","nonce":3098242154}]},"public_addr":"172.21.15.138:6825/3098242154","cluster_addr":"172.21.15.138:6827/3098242154","heartbeat_back_addr":"172.21.15.138:6831/3098242154","heartbeat_front_addr":"172.21.15.138:6829/3098242154","state":["exists","up"]},{"osd":4,"uuid":"c85df99b-3624-410e-866b-86830af2cfe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6801","nonce":2942056312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6803","nonce":2942056312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6807","nonce":2942056312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6805","nonce":2942056312}]},"public_addr":"172.21.15.143:6801/2942056312","cluster_addr":"172.21.15.143:6803/2942056312","heartbeat_back_addr":"172.21.15.143:6807/2942056312","heartbeat_front_addr":"172.21.15.143:6805/2942056312","state":["exists","up"]},{"osd":5,"uuid":"9af1efb5-c416-4808-b5ef-de0679ab9705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6809","nonce":1910222887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6811","nonce":1910222887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6815","nonce":1910222887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6813","nonce":1910222887}]},"public_addr":"172.21.15.143:6809/1910222887","cluster_addr":"172.21.15.143:6811/1910222887","heartbeat_back_addr":"172.21.15.143:6815/1910222887","heartbeat_front_addr":"172.21.15.143:6813/1910222887","state":["exists","up"]},{"osd":6,"uuid":"d7138615-8838-45ff-9072-2fd0683362f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6817","nonce":1082239825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6819","nonce":1082239825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6823","nonce":1082239825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6821","nonce":1082239825}]},"public_addr":"172.21.15.143:6817/1082239825","cluster_addr":"172.21.15.143:6819/1082239825","heartbeat_back_addr":"172.21.15.143:6823/1082239825","heartbeat_front_addr":"172.21.15.143:6821/1082239825","state":["exists","up"]},{"osd":7,"uuid":"0c27172b-35c4-49ec-ba0b-0137b8ff0010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6825","nonce":3295508495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6827","nonce":3295508495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6831","nonce":3295508495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6829","nonce":3295508495}]},"public_addr":"172.21.15.143:6825/3295508495","cluster_addr":"172.21.15.143:6827/3295508495","heartbeat_back_addr":"172.21.15.143:6831/3295508495","heartbeat_front_addr":"172.21.15.143:6829/3295508495","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.326627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.396119+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.433915+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.414179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.216947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.329272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.503073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.436382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.143:6836/483370849":"2024-04-27T20:58:07.183664+0000","172.21.15.143:6834/483370849":"2024-04-27T20:58:07.183664+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:58:07.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.960+0000 7f80dda00640 1 -- 172.21.15.138:0/1099246132 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f80b4068380 msgr2=0x7f80b406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:07.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.960+0000 7f80dda00640 1 --2- 172.21.15.138:0/1099246132 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f80b4068380 0x7f80b406a840 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f80c80ad000 tx=0x7f80c80a6000 comp rx=0 tx=0).stop 2024-04-26T20:58:07.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.960+0000 7f80dda00640 1 -- 172.21.15.138:0/1099246132 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80d815ce20 msgr2=0x7f80d80b1c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:07.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.960+0000 7f80dda00640 1 --2- 172.21.15.138:0/1099246132 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80d815ce20 0x7f80d80b1c10 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f80c00010f0 tx=0x7f80c000c810 comp rx=0 tx=0).stop 2024-04-26T20:58:07.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.960+0000 7f80dda00640 1 -- 172.21.15.138:0/1099246132 shutdown_connections 2024-04-26T20:58:07.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.960+0000 7f80dda00640 1 --2- 172.21.15.138:0/1099246132 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f80b4068380 0x7f80b406a840 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:07.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.960+0000 7f80dda00640 1 --2- 172.21.15.138:0/1099246132 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f80d815e0c0 0x7f80d80ce6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:07.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.960+0000 7f80dda00640 1 --2- 172.21.15.138:0/1099246132 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80d815ce20 0x7f80d80b1c10 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:07.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.960+0000 7f80dda00640 1 --2- 172.21.15.138:0/1099246132 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f80d80cca00 0x7f80d80b16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:07.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.960+0000 7f80dda00640 1 -- 172.21.15.138:0/1099246132 >> 172.21.15.138:0/1099246132 conn(0x7f80d80d0b20 msgr2=0x7f80d814bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:07.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.960+0000 7f80dda00640 1 -- 172.21.15.138:0/1099246132 shutdown_connections 2024-04-26T20:58:07.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:07.960+0000 7f80dda00640 1 -- 172.21.15.138:0/1099246132 wait complete. 2024-04-26T20:58:07.981 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:56:27.265834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T20:57:49.597600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T20:57:50.901951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T20:58:07.981 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T20:58:08.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.120+0000 7f2923200640 1 Processor -- start 2024-04-26T20:58:08.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.120+0000 7f2923200640 1 -- start start 2024-04-26T20:58:08.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.120+0000 7f2923200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f291c157630 0x7f291c15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:08.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.120+0000 7f2923200640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f291c06ca10 0x7f291c0cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:08.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.120+0000 7f2923200640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f291c15e400 con 0x7f291c160aa0 2024-04-26T20:58:08.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.120+0000 7f2923200640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f291c161480 con 0x7f291c06ca10 2024-04-26T20:58:08.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.120+0000 7f2923200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f291c161760 con 0x7f291c157630 2024-04-26T20:58:08.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.120+0000 7f2921200640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f291c06ca10 0x7f291c0cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:08.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.120+0000 7f2913400640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f291c160aa0 0x7f291c06c300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:44404/0 (socket says 172.21.15.138:44404) 2024-04-26T20:58:08.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.120+0000 7f2913400640 1 -- 172.21.15.138:0/4031927396 learned_addr learned my addr 172.21.15.138:0/4031927396 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:08.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.120+0000 7f291be00640 1 --2- 172.21.15.138:0/4031927396 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f291c157630 0x7f291c15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:08.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.120+0000 7f2921200640 1 -- 172.21.15.138:0/4031927396 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f291c157630 msgr2=0x7f291c15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:08.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.120+0000 7f2921200640 1 --2- 172.21.15.138:0/4031927396 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f291c157630 0x7f291c15dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:08.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.120+0000 7f2921200640 1 -- 172.21.15.138:0/4031927396 >> v1:172.21.15.138:6789/0 conn(0x7f291c160aa0 legacy=0x7f291c06c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:08.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.120+0000 7f291b400640 1 -- 172.21.15.138:0/4031927396 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3701668912 0 0) 0x7f2904001120 con 0x7f291c160aa0 2024-04-26T20:58:08.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.120+0000 7f2921200640 1 -- 172.21.15.138:0/4031927396 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f291c15d6c0 con 0x7f291c06ca10 2024-04-26T20:58:08.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.124+0000 7f2921200640 1 --2- 172.21.15.138:0/4031927396 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f291c06ca10 0x7f291c0cc2b0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f2914009d90 tx=0x7f291401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a697a876430dcc2e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:08.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.124+0000 7f291b400640 1 -- 172.21.15.138:0/4031927396 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29140b2070 con 0x7f291c06ca10 2024-04-26T20:58:08.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.124+0000 7f291b400640 1 -- 172.21.15.138:0/4031927396 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29140a58c0 con 0x7f291c06ca10 2024-04-26T20:58:08.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.124+0000 7f291b400640 1 -- 172.21.15.138:0/4031927396 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29140a5c90 con 0x7f291c06ca10 2024-04-26T20:58:08.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.124+0000 7f2923200640 1 -- 172.21.15.138:0/4031927396 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f291c06ca10 msgr2=0x7f291c0cc2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:08.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.124+0000 7f2923200640 1 --2- 172.21.15.138:0/4031927396 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f291c06ca10 0x7f291c0cc2b0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f2914009d90 tx=0x7f291401c970 comp rx=0 tx=0).stop 2024-04-26T20:58:08.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.124+0000 7f2923200640 1 -- 172.21.15.138:0/4031927396 shutdown_connections 2024-04-26T20:58:08.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.124+0000 7f2923200640 1 --2- 172.21.15.138:0/4031927396 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f291c06ca10 0x7f291c0cc2b0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:08.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.124+0000 7f2923200640 1 --2- 172.21.15.138:0/4031927396 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f291c157630 0x7f291c15dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:08.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.124+0000 7f2923200640 1 -- 172.21.15.138:0/4031927396 >> 172.21.15.138:0/4031927396 conn(0x7f291c0d1c60 msgr2=0x7f291c0d2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:08.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.124+0000 7f2923200640 1 -- 172.21.15.138:0/4031927396 shutdown_connections 2024-04-26T20:58:08.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.124+0000 7f2923200640 1 -- 172.21.15.138:0/4031927396 wait complete. 2024-04-26T20:58:08.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.128+0000 7f2923200640 1 Processor -- start 2024-04-26T20:58:08.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.128+0000 7f2923200640 1 -- start start 2024-04-26T20:58:08.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.128+0000 7f2923200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f291c06ca10 0x7f291c0d1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:08.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.128+0000 7f2923200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f291c157630 0x7f291c0b2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:08.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.128+0000 7f2923200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f291c160aa0 0x7f291c0b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:08.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.128+0000 7f2923200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f291c16a1d0 con 0x7f291c157630 2024-04-26T20:58:08.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.128+0000 7f2923200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f291c16a050 con 0x7f291c160aa0 2024-04-26T20:58:08.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.128+0000 7f2923200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f291c16a350 con 0x7f291c06ca10 2024-04-26T20:58:08.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.128+0000 7f2913400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f291c157630 0x7f291c0b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:08.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.128+0000 7f2913400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f291c157630 0x7f291c0b2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:59162/0 (socket says 172.21.15.138:59162) 2024-04-26T20:58:08.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.128+0000 7f2913400640 1 -- 172.21.15.138:0/3983035332 learned_addr learned my addr 172.21.15.138:0/3983035332 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:08.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.128+0000 7f291be00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f291c06ca10 0x7f291c0d1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:08.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.128+0000 7f2921200640 1 --2- 172.21.15.138:0/3983035332 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f291c160aa0 0x7f291c0b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:08.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.128+0000 7f2913400640 1 -- 172.21.15.138:0/3983035332 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f291c06ca10 msgr2=0x7f291c0d1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:08.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.128+0000 7f2913400640 1 --2- 172.21.15.138:0/3983035332 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f291c06ca10 0x7f291c0d1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:08.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.128+0000 7f2913400640 1 -- 172.21.15.138:0/3983035332 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f291c160aa0 msgr2=0x7f291c0b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:08.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.128+0000 7f2913400640 1 --2- 172.21.15.138:0/3983035332 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f291c160aa0 0x7f291c0b2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:08.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.128+0000 7f2913400640 1 -- 172.21.15.138:0/3983035332 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f291c0ca020 con 0x7f291c157630 2024-04-26T20:58:08.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.128+0000 7f2913400640 1 --2- 172.21.15.138:0/3983035332 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f291c157630 0x7f291c0b2770 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f290400c4b0 tx=0x7f290400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:08.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.128+0000 7f2918c00640 1 -- 172.21.15.138:0/3983035332 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2904018070 con 0x7f291c157630 2024-04-26T20:58:08.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.128+0000 7f2918c00640 1 -- 172.21.15.138:0/3983035332 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2904007500 con 0x7f291c157630 2024-04-26T20:58:08.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.128+0000 7f2918c00640 1 -- 172.21.15.138:0/3983035332 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2904004a30 con 0x7f291c157630 2024-04-26T20:58:08.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.128+0000 7f2923200640 1 -- 172.21.15.138:0/3983035332 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f291c0c8f80 con 0x7f291c157630 2024-04-26T20:58:08.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.128+0000 7f2923200640 1 -- 172.21.15.138:0/3983035332 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f291c0c9540 con 0x7f291c157630 2024-04-26T20:58:08.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.128+0000 7f2923200640 1 -- 172.21.15.138:0/3983035332 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f291c0c8d10 con 0x7f291c157630 2024-04-26T20:58:08.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.132+0000 7f2918c00640 1 -- 172.21.15.138:0/3983035332 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f290401b070 con 0x7f291c157630 2024-04-26T20:58:08.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.132+0000 7f2918c00640 1 --2- 172.21.15.138:0/3983035332 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f28f8068380 0x7f28f806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:08.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.132+0000 7f2918c00640 1 -- 172.21.15.138:0/3983035332 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6187+0+0 (secure 0 0 0) 0x7f2904085e20 con 0x7f291c157630 2024-04-26T20:58:08.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.132+0000 7f291be00640 1 --2- 172.21.15.138:0/3983035332 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f28f8068380 0x7f28f806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:08.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.132+0000 7f291be00640 1 --2- 172.21.15.138:0/3983035332 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f28f8068380 0x7f28f806a840 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f290c007a60 tx=0x7f290c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:08.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.136+0000 7f2918c00640 1 -- 172.21.15.138:0/3983035332 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f291c15e400 con 0x7f291c157630 2024-04-26T20:58:08.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.300+0000 7f2923200640 1 -- 172.21.15.138:0/3983035332 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f291c069430 con 0x7f291c157630 2024-04-26T20:58:08.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.300+0000 7f2918c00640 1 -- 172.21.15.138:0/3983035332 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) ==== 93+0+10 (secure 0 0 0) 0x7f2904055b10 con 0x7f291c157630 2024-04-26T20:58:08.301 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 1 2024-04-26T20:58:08.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.300+0000 7f2923200640 1 -- 172.21.15.138:0/3983035332 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f28f8068380 msgr2=0x7f28f806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:08.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.300+0000 7f2923200640 1 --2- 172.21.15.138:0/3983035332 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f28f8068380 0x7f28f806a840 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f290c007a60 tx=0x7f290c008040 comp rx=0 tx=0).stop 2024-04-26T20:58:08.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.300+0000 7f2923200640 1 -- 172.21.15.138:0/3983035332 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f291c157630 msgr2=0x7f291c0b2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:08.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.300+0000 7f2923200640 1 --2- 172.21.15.138:0/3983035332 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f291c157630 0x7f291c0b2770 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f290400c4b0 tx=0x7f290400c970 comp rx=0 tx=0).stop 2024-04-26T20:58:08.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.300+0000 7f2923200640 1 -- 172.21.15.138:0/3983035332 shutdown_connections 2024-04-26T20:58:08.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.300+0000 7f2923200640 1 --2- 172.21.15.138:0/3983035332 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f28f8068380 0x7f28f806a840 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:08.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.300+0000 7f2923200640 1 --2- 172.21.15.138:0/3983035332 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f291c160aa0 0x7f291c0b2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:08.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.300+0000 7f2923200640 1 --2- 172.21.15.138:0/3983035332 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f291c157630 0x7f291c0b2770 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:08.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.300+0000 7f2923200640 1 --2- 172.21.15.138:0/3983035332 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f291c06ca10 0x7f291c0d1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:08.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.300+0000 7f2923200640 1 -- 172.21.15.138:0/3983035332 >> 172.21.15.138:0/3983035332 conn(0x7f291c0d1c60 msgr2=0x7f291c1568f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:08.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.300+0000 7f2923200640 1 -- 172.21.15.138:0/3983035332 shutdown_connections 2024-04-26T20:58:08.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.300+0000 7f2923200640 1 -- 172.21.15.138:0/3983035332 wait complete. 2024-04-26T20:58:08.324 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T20:58:08.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.460+0000 7fd0f5800640 1 Processor -- start 2024-04-26T20:58:08.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.460+0000 7fd0f5800640 1 -- start start 2024-04-26T20:58:08.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.464+0000 7fd0f5800640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd0f015bdc0 0x7fd0f015f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:08.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.464+0000 7fd0f5800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd0f0073d70 0x7fd0f015fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:08.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.464+0000 7fd0f5800640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0f006dee0 con 0x7fd0f006f880 2024-04-26T20:58:08.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.464+0000 7fd0f5800640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fd0f015c1a0 con 0x7fd0f015bdc0 2024-04-26T20:58:08.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.464+0000 7fd0f5800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fd0f006e180 con 0x7fd0f0073d70 2024-04-26T20:58:08.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.464+0000 7fd0e6000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd0f0073d70 0x7fd0f015fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:08.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.464+0000 7fd0eea00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd0f015bdc0 0x7fd0f015f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:08.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.464+0000 7fd0ef400640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fd0f006f880 0x7fd0f00cb6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.138:39388/0 (socket says 172.21.15.138:39388) 2024-04-26T20:58:08.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.464+0000 7fd0ef400640 1 -- 172.21.15.138:0/2239608835 learned_addr learned my addr 172.21.15.138:0/2239608835 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:08.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.464+0000 7fd0ee000640 1 -- 172.21.15.138:0/2239608835 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 966231600 0 0) 0x7fd0f006dee0 con 0x7fd0f006f880 2024-04-26T20:58:08.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.464+0000 7fd0ee000640 1 -- 172.21.15.138:0/2239608835 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0d4005740 con 0x7fd0f006f880 2024-04-26T20:58:08.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.464+0000 7fd0eea00640 1 -- 172.21.15.138:0/2239608835 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd0f0073d70 msgr2=0x7fd0f015fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:08.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.464+0000 7fd0eea00640 1 --2- 172.21.15.138:0/2239608835 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd0f0073d70 0x7fd0f015fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:08.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.464+0000 7fd0eea00640 1 -- 172.21.15.138:0/2239608835 >> v1:172.21.15.143:6789/0 conn(0x7fd0f006f880 legacy=0x7fd0f00cb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:08.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.464+0000 7fd0eea00640 1 -- 172.21.15.138:0/2239608835 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0f006e460 con 0x7fd0f015bdc0 2024-04-26T20:58:08.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.468+0000 7fd0eea00640 1 --2- 172.21.15.138:0/2239608835 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd0f015bdc0 0x7fd0f015f930 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd0e00097c0 tx=0x7fd0e001c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f01ecd612c03c97a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:08.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.468+0000 7fd0ee000640 1 -- 172.21.15.138:0/2239608835 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e00b0070 con 0x7fd0f015bdc0 2024-04-26T20:58:08.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.468+0000 7fd0ee000640 1 -- 172.21.15.138:0/2239608835 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0e00ab600 con 0x7fd0f015bdc0 2024-04-26T20:58:08.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.468+0000 7fd0ee000640 1 -- 172.21.15.138:0/2239608835 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e00ab9d0 con 0x7fd0f015bdc0 2024-04-26T20:58:08.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.468+0000 7fd0f5800640 1 -- 172.21.15.138:0/2239608835 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd0f015bdc0 msgr2=0x7fd0f015f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:08.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.468+0000 7fd0f5800640 1 --2- 172.21.15.138:0/2239608835 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd0f015bdc0 0x7fd0f015f930 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd0e00097c0 tx=0x7fd0e001c410 comp rx=0 tx=0).stop 2024-04-26T20:58:08.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.468+0000 7fd0f5800640 1 -- 172.21.15.138:0/2239608835 shutdown_connections 2024-04-26T20:58:08.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.468+0000 7fd0f5800640 1 --2- 172.21.15.138:0/2239608835 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd0f0073d70 0x7fd0f015fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:08.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.468+0000 7fd0f5800640 1 --2- 172.21.15.138:0/2239608835 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd0f015bdc0 0x7fd0f015f930 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:08.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.468+0000 7fd0f5800640 1 -- 172.21.15.138:0/2239608835 >> 172.21.15.138:0/2239608835 conn(0x7fd0f00d0bb0 msgr2=0x7fd0f00d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:08.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.468+0000 7fd0f5800640 1 -- 172.21.15.138:0/2239608835 shutdown_connections 2024-04-26T20:58:08.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.468+0000 7fd0f5800640 1 -- 172.21.15.138:0/2239608835 wait complete. 2024-04-26T20:58:08.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.468+0000 7fd0f5800640 1 Processor -- start 2024-04-26T20:58:08.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.468+0000 7fd0f5800640 1 -- start start 2024-04-26T20:58:08.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.472+0000 7fd0f5800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0f006f880 0x7fd0f014ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:08.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.472+0000 7fd0f5800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd0f0073d70 0x7fd0f00c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:08.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.472+0000 7fd0f5800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd0f015bdc0 0x7fd0f00c6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:08.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.472+0000 7fd0f5800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd0f006eb00 con 0x7fd0f006f880 2024-04-26T20:58:08.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.472+0000 7fd0f5800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fd0f006e980 con 0x7fd0f015bdc0 2024-04-26T20:58:08.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.472+0000 7fd0f5800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fd0f006ec80 con 0x7fd0f0073d70 2024-04-26T20:58:08.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.472+0000 7fd0eea00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0f006f880 0x7fd0f014ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:08.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.472+0000 7fd0eea00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0f006f880 0x7fd0f014ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:59164/0 (socket says 172.21.15.138:59164) 2024-04-26T20:58:08.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.472+0000 7fd0eea00640 1 -- 172.21.15.138:0/1728648718 learned_addr learned my addr 172.21.15.138:0/1728648718 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:08.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.472+0000 7fd0ef400640 1 --2- 172.21.15.138:0/1728648718 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd0f015bdc0 0x7fd0f00c6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:08.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.472+0000 7fd0e6000640 1 --2- 172.21.15.138:0/1728648718 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd0f0073d70 0x7fd0f00c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:08.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.472+0000 7fd0eea00640 1 -- 172.21.15.138:0/1728648718 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd0f0073d70 msgr2=0x7fd0f00c66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:08.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.472+0000 7fd0eea00640 1 --2- 172.21.15.138:0/1728648718 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd0f0073d70 0x7fd0f00c66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:08.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.472+0000 7fd0eea00640 1 -- 172.21.15.138:0/1728648718 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd0f015bdc0 msgr2=0x7fd0f00c6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:08.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.472+0000 7fd0eea00640 1 --2- 172.21.15.138:0/1728648718 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd0f015bdc0 0x7fd0f00c6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:08.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.472+0000 7fd0eea00640 1 -- 172.21.15.138:0/1728648718 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0f00b6170 con 0x7fd0f006f880 2024-04-26T20:58:08.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.472+0000 7fd0eea00640 1 --2- 172.21.15.138:0/1728648718 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0f006f880 0x7fd0f014ebd0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fd0e001a040 tx=0x7fd0e001ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:08.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.472+0000 7fd0e7400640 1 -- 172.21.15.138:0/1728648718 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e00b0050 con 0x7fd0f006f880 2024-04-26T20:58:08.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.472+0000 7fd0e7400640 1 -- 172.21.15.138:0/1728648718 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0e00bc070 con 0x7fd0f006f880 2024-04-26T20:58:08.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.472+0000 7fd0e7400640 1 -- 172.21.15.138:0/1728648718 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e0006e20 con 0x7fd0f006f880 2024-04-26T20:58:08.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.472+0000 7fd0f5800640 1 -- 172.21.15.138:0/1728648718 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0f015ce10 con 0x7fd0f006f880 2024-04-26T20:58:08.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.472+0000 7fd0f5800640 1 -- 172.21.15.138:0/1728648718 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0f015d3d0 con 0x7fd0f006f880 2024-04-26T20:58:08.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.472+0000 7fd0f5800640 1 -- 172.21.15.138:0/1728648718 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0f0069430 con 0x7fd0f006f880 2024-04-26T20:58:08.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.472+0000 7fd0e7400640 1 -- 172.21.15.138:0/1728648718 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd0e00b5830 con 0x7fd0f006f880 2024-04-26T20:58:08.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.476+0000 7fd0e7400640 1 --2- 172.21.15.138:0/1728648718 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd0cc0683b0 0x7fd0cc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:08.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.476+0000 7fd0e7400640 1 -- 172.21.15.138:0/1728648718 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6187+0+0 (secure 0 0 0) 0x7fd0e0120f70 con 0x7fd0f006f880 2024-04-26T20:58:08.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.476+0000 7fd0e6000640 1 --2- 172.21.15.138:0/1728648718 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd0cc0683b0 0x7fd0cc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:08.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.476+0000 7fd0e6000640 1 --2- 172.21.15.138:0/1728648718 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd0cc0683b0 0x7fd0cc06a870 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd0f00cf100 tx=0x7fd0d8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:08.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.480+0000 7fd0e7400640 1 -- 172.21.15.138:0/1728648718 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd0e0016090 con 0x7fd0f006f880 2024-04-26T20:58:08.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.644+0000 7fd0f5800640 1 -- 172.21.15.138:0/1728648718 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd0f00d19c0 con 0x7fd0f006f880 2024-04-26T20:58:08.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.644+0000 7fd0e7400640 1 -- 172.21.15.138:0/1728648718 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v46) ==== 104+0+11 (secure 0 0 0) 0x7fd0e00f0eb0 con 0x7fd0f006f880 2024-04-26T20:58:08.648 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 32 2024-04-26T20:58:08.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.648+0000 7fd0f5800640 1 -- 172.21.15.138:0/1728648718 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd0cc0683b0 msgr2=0x7fd0cc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:08.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.648+0000 7fd0f5800640 1 --2- 172.21.15.138:0/1728648718 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd0cc0683b0 0x7fd0cc06a870 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd0f00cf100 tx=0x7fd0d8009190 comp rx=0 tx=0).stop 2024-04-26T20:58:08.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.648+0000 7fd0f5800640 1 -- 172.21.15.138:0/1728648718 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0f006f880 msgr2=0x7fd0f014ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:08.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.648+0000 7fd0f5800640 1 --2- 172.21.15.138:0/1728648718 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0f006f880 0x7fd0f014ebd0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fd0e001a040 tx=0x7fd0e001ac50 comp rx=0 tx=0).stop 2024-04-26T20:58:08.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.648+0000 7fd0f5800640 1 -- 172.21.15.138:0/1728648718 shutdown_connections 2024-04-26T20:58:08.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.648+0000 7fd0f5800640 1 --2- 172.21.15.138:0/1728648718 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd0cc0683b0 0x7fd0cc06a870 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:08.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.648+0000 7fd0f5800640 1 --2- 172.21.15.138:0/1728648718 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd0f015bdc0 0x7fd0f00c6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:08.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.648+0000 7fd0f5800640 1 --2- 172.21.15.138:0/1728648718 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd0f0073d70 0x7fd0f00c66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:08.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.648+0000 7fd0f5800640 1 --2- 172.21.15.138:0/1728648718 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0f006f880 0x7fd0f014ebd0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:08.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.648+0000 7fd0f5800640 1 -- 172.21.15.138:0/1728648718 >> 172.21.15.138:0/1728648718 conn(0x7fd0f00d0bb0 msgr2=0x7fd0f0072740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:08.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.648+0000 7fd0f5800640 1 -- 172.21.15.138:0/1728648718 shutdown_connections 2024-04-26T20:58:08.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.648+0000 7fd0f5800640 1 -- 172.21.15.138:0/1728648718 wait complete. 2024-04-26T20:58:08.668 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T20:58:08.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.804+0000 7ff8fe600640 1 Processor -- start 2024-04-26T20:58:08.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.804+0000 7ff8fe600640 1 -- start start 2024-04-26T20:58:08.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.808+0000 7ff8fe600640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff8f8073d70 0x7ff8f8160040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:08.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.808+0000 7ff8fe600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff8f806f880 0x7ff8f80ce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:08.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.808+0000 7ff8fe600640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8f806dee0 con 0x7ff8f815bdc0 2024-04-26T20:58:08.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.808+0000 7ff8fe600640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7ff8f815c1a0 con 0x7ff8f8073d70 2024-04-26T20:58:08.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.808+0000 7ff8fe600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ff8f806e180 con 0x7ff8f806f880 2024-04-26T20:58:08.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.808+0000 7ff8efe00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff8f8073d70 0x7ff8f8160040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:08.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.808+0000 7ff8f7400640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7ff8f815bdc0 0x7ff8f815f930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:44416/0 (socket says 172.21.15.138:44416) 2024-04-26T20:58:08.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.808+0000 7ff8f7400640 1 -- 172.21.15.138:0/1348600062 learned_addr learned my addr 172.21.15.138:0/1348600062 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:08.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.808+0000 7ff8efe00640 1 -- 172.21.15.138:0/1348600062 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff8f806f880 msgr2=0x7ff8f80ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:08.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.808+0000 7ff8f7e00640 1 --2- 172.21.15.138:0/1348600062 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff8f806f880 0x7ff8f80ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:08.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.808+0000 7ff8efe00640 1 --2- 172.21.15.138:0/1348600062 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff8f806f880 0x7ff8f80ce780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:08.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.808+0000 7ff8efe00640 1 -- 172.21.15.138:0/1348600062 >> v1:172.21.15.138:6789/0 conn(0x7ff8f815bdc0 legacy=0x7ff8f815f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:08.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.808+0000 7ff8f6a00640 1 -- 172.21.15.138:0/1348600062 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3611536521 0 0) 0x7ff8f806dee0 con 0x7ff8f815bdc0 2024-04-26T20:58:08.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.808+0000 7ff8efe00640 1 -- 172.21.15.138:0/1348600062 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8f806e460 con 0x7ff8f8073d70 2024-04-26T20:58:08.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.808+0000 7ff8f7e00640 1 --2- 172.21.15.138:0/1348600062 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff8f806f880 0x7ff8f80ce780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:58:08.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.812+0000 7ff8efe00640 1 --2- 172.21.15.138:0/1348600062 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff8f8073d70 0x7ff8f8160040 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff8e00097c0 tx=0x7ff8e001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cd0ca662bee5aef server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:08.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.812+0000 7ff8f6a00640 1 -- 172.21.15.138:0/1348600062 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e00b0070 con 0x7ff8f8073d70 2024-04-26T20:58:08.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.812+0000 7ff8f6a00640 1 -- 172.21.15.138:0/1348600062 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8e00ab600 con 0x7ff8f8073d70 2024-04-26T20:58:08.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.812+0000 7ff8f6a00640 1 -- 172.21.15.138:0/1348600062 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e00ab9d0 con 0x7ff8f8073d70 2024-04-26T20:58:08.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.812+0000 7ff8fe600640 1 -- 172.21.15.138:0/1348600062 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff8f8073d70 msgr2=0x7ff8f8160040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:08.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.812+0000 7ff8fe600640 1 --2- 172.21.15.138:0/1348600062 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff8f8073d70 0x7ff8f8160040 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff8e00097c0 tx=0x7ff8e001c410 comp rx=0 tx=0).stop 2024-04-26T20:58:08.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.812+0000 7ff8fe600640 1 -- 172.21.15.138:0/1348600062 shutdown_connections 2024-04-26T20:58:08.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.812+0000 7ff8fe600640 1 --2- 172.21.15.138:0/1348600062 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff8f806f880 0x7ff8f80ce780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:08.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.812+0000 7ff8fe600640 1 --2- 172.21.15.138:0/1348600062 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff8f8073d70 0x7ff8f8160040 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:08.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.812+0000 7ff8fe600640 1 -- 172.21.15.138:0/1348600062 >> 172.21.15.138:0/1348600062 conn(0x7ff8f80d0bb0 msgr2=0x7ff8f80d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:08.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.812+0000 7ff8fe600640 1 -- 172.21.15.138:0/1348600062 shutdown_connections 2024-04-26T20:58:08.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.812+0000 7ff8fe600640 1 -- 172.21.15.138:0/1348600062 wait complete. 2024-04-26T20:58:08.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.812+0000 7ff8fe600640 1 Processor -- start 2024-04-26T20:58:08.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.812+0000 7ff8fe600640 1 -- start start 2024-04-26T20:58:08.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.812+0000 7ff8fe600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff8f806f880 0x7ff8f815d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:08.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.816+0000 7ff8fe600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff8f8073d70 0x7ff8f8156d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:08.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.816+0000 7ff8fe600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff8f815bdc0 0x7ff8f815fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:08.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.816+0000 7ff8fe600640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f8168e50 con 0x7ff8f815bdc0 2024-04-26T20:58:08.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.816+0000 7ff8fe600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f8168cd0 con 0x7ff8f8073d70 2024-04-26T20:58:08.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.816+0000 7ff8fe600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ff8f8168fd0 con 0x7ff8f806f880 2024-04-26T20:58:08.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.816+0000 7ff8f7e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff8f815bdc0 0x7ff8f815fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:08.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.816+0000 7ff8f7e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff8f815bdc0 0x7ff8f815fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:59184/0 (socket says 172.21.15.138:59184) 2024-04-26T20:58:08.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.816+0000 7ff8f7e00640 1 -- 172.21.15.138:0/1822228240 learned_addr learned my addr 172.21.15.138:0/1822228240 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:08.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.816+0000 7ff8f7400640 1 --2- 172.21.15.138:0/1822228240 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff8f806f880 0x7ff8f815d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:08.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.816+0000 7ff8efe00640 1 --2- 172.21.15.138:0/1822228240 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff8f8073d70 0x7ff8f8156d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:08.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.816+0000 7ff8f7e00640 1 -- 172.21.15.138:0/1822228240 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff8f806f880 msgr2=0x7ff8f815d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:08.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.816+0000 7ff8f7e00640 1 --2- 172.21.15.138:0/1822228240 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff8f806f880 0x7ff8f815d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:08.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.816+0000 7ff8f7e00640 1 -- 172.21.15.138:0/1822228240 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff8f8073d70 msgr2=0x7ff8f8156d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:08.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.816+0000 7ff8f7e00640 1 --2- 172.21.15.138:0/1822228240 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff8f8073d70 0x7ff8f8156d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:08.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.816+0000 7ff8f7e00640 1 -- 172.21.15.138:0/1822228240 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8f80c8180 con 0x7ff8f815bdc0 2024-04-26T20:58:08.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.816+0000 7ff8f7e00640 1 --2- 172.21.15.138:0/1822228240 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff8f815bdc0 0x7ff8f815fca0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff8f000cef0 tx=0x7ff8f000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:08.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.816+0000 7ff8ef400640 1 -- 172.21.15.138:0/1822228240 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f001a070 con 0x7ff8f815bdc0 2024-04-26T20:58:08.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.816+0000 7ff8ef400640 1 -- 172.21.15.138:0/1822228240 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8f000d860 con 0x7ff8f815bdc0 2024-04-26T20:58:08.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.816+0000 7ff8ef400640 1 -- 172.21.15.138:0/1822228240 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f000dc50 con 0x7ff8f815bdc0 2024-04-26T20:58:08.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.816+0000 7ff8fe600640 1 -- 172.21.15.138:0/1822228240 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8f80b5010 con 0x7ff8f815bdc0 2024-04-26T20:58:08.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.816+0000 7ff8fe600640 1 -- 172.21.15.138:0/1822228240 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8f81572b0 con 0x7ff8f815bdc0 2024-04-26T20:58:08.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.816+0000 7ff8fe600640 1 -- 172.21.15.138:0/1822228240 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8f8069430 con 0x7ff8f815bdc0 2024-04-26T20:58:08.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.816+0000 7ff8ef400640 1 -- 172.21.15.138:0/1822228240 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff8f001d070 con 0x7ff8f815bdc0 2024-04-26T20:58:08.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.820+0000 7ff8ef400640 1 --2- 172.21.15.138:0/1822228240 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff8d4068380 0x7ff8d406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:08.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.820+0000 7ff8ef400640 1 -- 172.21.15.138:0/1822228240 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6187+0+0 (secure 0 0 0) 0x7ff8f00873c0 con 0x7ff8f815bdc0 2024-04-26T20:58:08.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.820+0000 7ff8f7400640 1 --2- 172.21.15.138:0/1822228240 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff8d4068380 0x7ff8d406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:08.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.820+0000 7ff8f7400640 1 --2- 172.21.15.138:0/1822228240 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff8d4068380 0x7ff8d406a840 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff8e8000f70 tx=0x7ff8e8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:08.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.824+0000 7ff8ef400640 1 -- 172.21.15.138:0/1822228240 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff8f0057200 con 0x7ff8f815bdc0 2024-04-26T20:58:08.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.976+0000 7ff8fe600640 1 -- 172.21.15.138:0/1822228240 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff8f8160790 con 0x7ff8f815bdc0 2024-04-26T20:58:08.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.976+0000 7ff8ef400640 1 -- 172.21.15.138:0/1822228240 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v46) ==== 100+0+11 (secure 0 0 0) 0x7ff8f005b500 con 0x7ff8f815bdc0 2024-04-26T20:58:08.979 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 64 2024-04-26T20:58:08.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.980+0000 7ff8fe600640 1 -- 172.21.15.138:0/1822228240 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff8d4068380 msgr2=0x7ff8d406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:08.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.980+0000 7ff8fe600640 1 --2- 172.21.15.138:0/1822228240 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff8d4068380 0x7ff8d406a840 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff8e8000f70 tx=0x7ff8e8009040 comp rx=0 tx=0).stop 2024-04-26T20:58:08.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.980+0000 7ff8fe600640 1 -- 172.21.15.138:0/1822228240 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff8f815bdc0 msgr2=0x7ff8f815fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:08.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.980+0000 7ff8fe600640 1 --2- 172.21.15.138:0/1822228240 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff8f815bdc0 0x7ff8f815fca0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff8f000cef0 tx=0x7ff8f000a710 comp rx=0 tx=0).stop 2024-04-26T20:58:08.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.980+0000 7ff8fe600640 1 -- 172.21.15.138:0/1822228240 shutdown_connections 2024-04-26T20:58:08.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.980+0000 7ff8fe600640 1 --2- 172.21.15.138:0/1822228240 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff8d4068380 0x7ff8d406a840 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:08.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.980+0000 7ff8fe600640 1 --2- 172.21.15.138:0/1822228240 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff8f815bdc0 0x7ff8f815fca0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:08.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.980+0000 7ff8fe600640 1 --2- 172.21.15.138:0/1822228240 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff8f8073d70 0x7ff8f8156d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:08.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.980+0000 7ff8fe600640 1 --2- 172.21.15.138:0/1822228240 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff8f806f880 0x7ff8f815d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:08.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.980+0000 7ff8fe600640 1 -- 172.21.15.138:0/1822228240 >> 172.21.15.138:0/1822228240 conn(0x7ff8f80d0bb0 msgr2=0x7ff8f806e770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:08.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.980+0000 7ff8fe600640 1 -- 172.21.15.138:0/1822228240 shutdown_connections 2024-04-26T20:58:08.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:08.980+0000 7ff8fe600640 1 -- 172.21.15.138:0/1822228240 wait complete. 2024-04-26T20:58:09.000 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'recovery_fs' 2024-04-26T20:58:09.000 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create recovery_fs_metadata --pg_num_min 64 2024-04-26T20:58:09.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.136+0000 7f9d82800640 1 Processor -- start 2024-04-26T20:58:09.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.140+0000 7f9d82800640 1 -- start start 2024-04-26T20:58:09.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.140+0000 7f9d82800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f9d7c163820 0x7f9d7c15e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:09.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.140+0000 7f9d82800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9d7c15ed90 0x7f9d7c15f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:09.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.140+0000 7f9d82800640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d7c06df50 con 0x7f9d7c162d30 2024-04-26T20:58:09.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.140+0000 7f9d82800640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f9d7c163c80 con 0x7f9d7c163820 2024-04-26T20:58:09.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.140+0000 7f9d82800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f9d7c06da00 con 0x7f9d7c15ed90 2024-04-26T20:58:09.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.140+0000 7f9d80a00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f9d7c163820 0x7f9d7c15e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:09.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.140+0000 7f9d80a00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f9d7c163820 0x7f9d7c15e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:59192/0 (socket says 172.21.15.138:59192) 2024-04-26T20:58:09.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.140+0000 7f9d80a00640 1 -- 172.21.15.138:0/976432501 learned_addr learned my addr 172.21.15.138:0/976432501 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:09.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.140+0000 7f9d81e00640 1 --2- 172.21.15.138:0/976432501 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9d7c15ed90 0x7f9d7c15f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:09.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.140+0000 7f9d80a00640 1 -- 172.21.15.138:0/976432501 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9d7c15ed90 msgr2=0x7f9d7c15f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:09.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.140+0000 7f9d80a00640 1 --2- 172.21.15.138:0/976432501 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9d7c15ed90 0x7f9d7c15f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:09.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.140+0000 7f9d80a00640 1 -- 172.21.15.138:0/976432501 >> v1:172.21.15.143:6789/0 conn(0x7f9d7c162d30 legacy=0x7f9d7c163110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:09.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.140+0000 7f9d80a00640 1 -- 172.21.15.138:0/976432501 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d7c06e230 con 0x7f9d7c163820 2024-04-26T20:58:09.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.144+0000 7f9d80a00640 1 --2- 172.21.15.138:0/976432501 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9d7c163820 0x7f9d7c15e850 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f9d68009870 tx=0x7f9d6801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1a5203a393bb1c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:09.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.144+0000 7f9d7be00640 1 -- 172.21.15.138:0/976432501 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d680b1070 con 0x7f9d7c163820 2024-04-26T20:58:09.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.144+0000 7f9d7be00640 1 -- 172.21.15.138:0/976432501 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d680a8050 con 0x7f9d7c163820 2024-04-26T20:58:09.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.144+0000 7f9d7be00640 1 -- 172.21.15.138:0/976432501 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d680ac860 con 0x7f9d7c163820 2024-04-26T20:58:09.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.144+0000 7f9d82800640 1 -- 172.21.15.138:0/976432501 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9d7c163820 msgr2=0x7f9d7c15e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:09.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.144+0000 7f9d82800640 1 --2- 172.21.15.138:0/976432501 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9d7c163820 0x7f9d7c15e850 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f9d68009870 tx=0x7f9d6801c4d0 comp rx=0 tx=0).stop 2024-04-26T20:58:09.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.144+0000 7f9d82800640 1 -- 172.21.15.138:0/976432501 shutdown_connections 2024-04-26T20:58:09.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.144+0000 7f9d82800640 1 --2- 172.21.15.138:0/976432501 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9d7c15ed90 0x7f9d7c15f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:09.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.144+0000 7f9d82800640 1 --2- 172.21.15.138:0/976432501 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9d7c163820 0x7f9d7c15e850 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:09.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.144+0000 7f9d82800640 1 -- 172.21.15.138:0/976432501 >> 172.21.15.138:0/976432501 conn(0x7f9d7c0d2be0 msgr2=0x7f9d7c0d2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:09.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.144+0000 7f9d82800640 1 -- 172.21.15.138:0/976432501 shutdown_connections 2024-04-26T20:58:09.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.144+0000 7f9d82800640 1 -- 172.21.15.138:0/976432501 wait complete. 2024-04-26T20:58:09.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.144+0000 7f9d82800640 1 Processor -- start 2024-04-26T20:58:09.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.144+0000 7f9d82800640 1 -- start start 2024-04-26T20:58:09.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.148+0000 7f9d82800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9d7c15ed90 0x7f9d7c0cc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:09.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.148+0000 7f9d82800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9d7c162d30 0x7f9d7c15f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:09.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.148+0000 7f9d82800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9d7c163820 0x7f9d7c158450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:09.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.148+0000 7f9d82800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f9d7c0d2290 con 0x7f9d7c163820 2024-04-26T20:58:09.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.148+0000 7f9d82800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f9d7c0d2110 con 0x7f9d7c15ed90 2024-04-26T20:58:09.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.148+0000 7f9d82800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f9d7c0ce9f0 con 0x7f9d7c162d30 2024-04-26T20:58:09.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.148+0000 7f9d81e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9d7c163820 0x7f9d7c158450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:09.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.148+0000 7f9d81e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9d7c163820 0x7f9d7c158450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:59208/0 (socket says 172.21.15.138:59208) 2024-04-26T20:58:09.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.148+0000 7f9d81e00640 1 -- 172.21.15.138:0/398846287 learned_addr learned my addr 172.21.15.138:0/398846287 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:09.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.148+0000 7f9d80a00640 1 --2- 172.21.15.138:0/398846287 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9d7c162d30 0x7f9d7c15f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:09.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.148+0000 7f9d81400640 1 --2- 172.21.15.138:0/398846287 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9d7c15ed90 0x7f9d7c0cc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:09.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.148+0000 7f9d81e00640 1 -- 172.21.15.138:0/398846287 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9d7c162d30 msgr2=0x7f9d7c15f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:09.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.148+0000 7f9d81e00640 1 --2- 172.21.15.138:0/398846287 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9d7c162d30 0x7f9d7c15f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:09.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.148+0000 7f9d81e00640 1 -- 172.21.15.138:0/398846287 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9d7c15ed90 msgr2=0x7f9d7c0cc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:09.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.148+0000 7f9d81e00640 1 --2- 172.21.15.138:0/398846287 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9d7c15ed90 0x7f9d7c0cc8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:09.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.148+0000 7f9d81e00640 1 -- 172.21.15.138:0/398846287 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d7c15f760 con 0x7f9d7c163820 2024-04-26T20:58:09.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.148+0000 7f9d81400640 1 --2- 172.21.15.138:0/398846287 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9d7c15ed90 0x7f9d7c0cc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:58:09.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.148+0000 7f9d81e00640 1 --2- 172.21.15.138:0/398846287 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9d7c163820 0x7f9d7c158450 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f9d74007e40 tx=0x7f9d7400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:09.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.148+0000 7f9d79600640 1 -- 172.21.15.138:0/398846287 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d74014620 con 0x7f9d7c163820 2024-04-26T20:58:09.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.148+0000 7f9d79600640 1 -- 172.21.15.138:0/398846287 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d74019070 con 0x7f9d7c163820 2024-04-26T20:58:09.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.148+0000 7f9d79600640 1 -- 172.21.15.138:0/398846287 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d74014a20 con 0x7f9d7c163820 2024-04-26T20:58:09.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.148+0000 7f9d82800640 1 -- 172.21.15.138:0/398846287 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d7c15fa30 con 0x7f9d7c163820 2024-04-26T20:58:09.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.148+0000 7f9d82800640 1 -- 172.21.15.138:0/398846287 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d7c15fff0 con 0x7f9d7c163820 2024-04-26T20:58:09.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.148+0000 7f9d82800640 1 -- 172.21.15.138:0/398846287 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d7c069430 con 0x7f9d7c163820 2024-04-26T20:58:09.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.148+0000 7f9d79600640 1 -- 172.21.15.138:0/398846287 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9d74014bc0 con 0x7f9d7c163820 2024-04-26T20:58:09.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.152+0000 7f9d79600640 1 --2- 172.21.15.138:0/398846287 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9d5c0683b0 0x7f9d5c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:09.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.152+0000 7f9d79600640 1 -- 172.21.15.138:0/398846287 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6187+0+0 (secure 0 0 0) 0x7f9d74087320 con 0x7f9d7c163820 2024-04-26T20:58:09.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.152+0000 7f9d81400640 1 --2- 172.21.15.138:0/398846287 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9d5c0683b0 0x7f9d5c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:09.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.152+0000 7f9d81400640 1 --2- 172.21.15.138:0/398846287 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9d5c0683b0 0x7f9d5c06a870 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9d70001710 tx=0x7f9d70009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:09.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.156+0000 7f9d79600640 1 -- 172.21.15.138:0/398846287 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9d74057790 con 0x7f9d7c163820 2024-04-26T20:58:09.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.316+0000 7f9d82800640 1 -- 172.21.15.138:0/398846287 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "recovery_fs_metadata", "pg_num_min": 64} v 0) -- 0x7f9d7c06dc00 con 0x7f9d7c163820 2024-04-26T20:58:09.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.640+0000 7f9d79600640 1 -- 172.21.15.138:0/398846287 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "recovery_fs_metadata", "pg_num_min": 64}]=0 pool 'recovery_fs_metadata' created v47) ==== 148+0+0 (secure 0 0 0) 0x7f9d74057090 con 0x7f9d7c163820 2024-04-26T20:58:09.643 INFO:teuthology.orchestra.run.smithi138.stderr:pool 'recovery_fs_metadata' created 2024-04-26T20:58:09.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.644+0000 7f9d82800640 1 -- 172.21.15.138:0/398846287 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9d5c0683b0 msgr2=0x7f9d5c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:09.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.644+0000 7f9d82800640 1 --2- 172.21.15.138:0/398846287 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9d5c0683b0 0x7f9d5c06a870 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9d70001710 tx=0x7f9d70009040 comp rx=0 tx=0).stop 2024-04-26T20:58:09.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.644+0000 7f9d82800640 1 -- 172.21.15.138:0/398846287 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9d7c163820 msgr2=0x7f9d7c158450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:09.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.644+0000 7f9d82800640 1 --2- 172.21.15.138:0/398846287 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9d7c163820 0x7f9d7c158450 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f9d74007e40 tx=0x7f9d7400e4b0 comp rx=0 tx=0).stop 2024-04-26T20:58:09.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.644+0000 7f9d82800640 1 -- 172.21.15.138:0/398846287 shutdown_connections 2024-04-26T20:58:09.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.644+0000 7f9d82800640 1 --2- 172.21.15.138:0/398846287 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9d5c0683b0 0x7f9d5c06a870 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:09.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.644+0000 7f9d82800640 1 --2- 172.21.15.138:0/398846287 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9d7c163820 0x7f9d7c158450 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:09.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.644+0000 7f9d82800640 1 --2- 172.21.15.138:0/398846287 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9d7c162d30 0x7f9d7c15f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:09.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.644+0000 7f9d82800640 1 --2- 172.21.15.138:0/398846287 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9d7c15ed90 0x7f9d7c0cc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:09.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.644+0000 7f9d82800640 1 -- 172.21.15.138:0/398846287 >> 172.21.15.138:0/398846287 conn(0x7f9d7c0d2be0 msgr2=0x7f9d7c0711a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:09.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.644+0000 7f9d82800640 1 -- 172.21.15.138:0/398846287 shutdown_connections 2024-04-26T20:58:09.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.644+0000 7f9d82800640 1 -- 172.21.15.138:0/398846287 wait complete. 2024-04-26T20:58:09.671 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-26T20:58:09.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.812+0000 7f6e43e00640 1 Processor -- start 2024-04-26T20:58:09.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.812+0000 7f6e43e00640 1 -- start start 2024-04-26T20:58:09.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.812+0000 7f6e43e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f6e3c0cb910 0x7f6e3c0b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:09.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.812+0000 7f6e43e00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e3c0cd210 con 0x7f6e3c15aa60 2024-04-26T20:58:09.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.812+0000 7f6e43e00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e3c15d6a0 con 0x7f6e3c15e180 2024-04-26T20:58:09.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.812+0000 7f6e43e00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f6e3c15d980 con 0x7f6e3c0cb910 2024-04-26T20:58:09.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.812+0000 7f6e41400640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f6e3c15aa60 0x7f6e3c0cc7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:44418/0 (socket says 172.21.15.138:44418) 2024-04-26T20:58:09.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.812+0000 7f6e41e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f6e3c0cb910 0x7f6e3c0b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:09.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.812+0000 7f6e41400640 1 -- 172.21.15.138:0/3222720120 learned_addr learned my addr 172.21.15.138:0/3222720120 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:09.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.816+0000 7f6e41e00640 1 -- 172.21.15.138:0/3222720120 >> v1:172.21.15.143:6789/0 conn(0x7f6e3c15e180 legacy=0x7f6e3c0cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:09.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.816+0000 7f6e41e00640 1 -- 172.21.15.138:0/3222720120 >> v1:172.21.15.138:6789/0 conn(0x7f6e3c15aa60 legacy=0x7f6e3c0cc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:09.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.816+0000 7f6e41e00640 1 -- 172.21.15.138:0/3222720120 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e3c15dc60 con 0x7f6e3c0cb910 2024-04-26T20:58:09.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.816+0000 7f6e41e00640 1 --2- 172.21.15.138:0/3222720120 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e3c0cb910 0x7f6e3c0b5aa0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f6e34009d90 tx=0x7f6e3401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea0140d1c88bb339 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:09.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.816+0000 7f6e3be00640 1 -- 172.21.15.138:0/3222720120 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e340b2070 con 0x7f6e3c0cb910 2024-04-26T20:58:09.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.816+0000 7f6e3be00640 1 -- 172.21.15.138:0/3222720120 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e340a5830 con 0x7f6e3c0cb910 2024-04-26T20:58:09.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.816+0000 7f6e3be00640 1 -- 172.21.15.138:0/3222720120 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e340a5c00 con 0x7f6e3c0cb910 2024-04-26T20:58:09.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.816+0000 7f6e43e00640 1 -- 172.21.15.138:0/3222720120 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e3c0cb910 msgr2=0x7f6e3c0b5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:09.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.816+0000 7f6e43e00640 1 --2- 172.21.15.138:0/3222720120 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e3c0cb910 0x7f6e3c0b5aa0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f6e34009d90 tx=0x7f6e3401c970 comp rx=0 tx=0).stop 2024-04-26T20:58:09.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.816+0000 7f6e43e00640 1 -- 172.21.15.138:0/3222720120 shutdown_connections 2024-04-26T20:58:09.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.816+0000 7f6e43e00640 1 --2- 172.21.15.138:0/3222720120 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e3c0cb910 0x7f6e3c0b5aa0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:09.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.816+0000 7f6e43e00640 1 -- 172.21.15.138:0/3222720120 >> 172.21.15.138:0/3222720120 conn(0x7f6e3c0d0bb0 msgr2=0x7f6e3c0d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:09.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.816+0000 7f6e43e00640 1 -- 172.21.15.138:0/3222720120 shutdown_connections 2024-04-26T20:58:09.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.816+0000 7f6e43e00640 1 -- 172.21.15.138:0/3222720120 wait complete. 2024-04-26T20:58:09.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.820+0000 7f6e43e00640 1 Processor -- start 2024-04-26T20:58:09.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.820+0000 7f6e43e00640 1 -- start start 2024-04-26T20:58:09.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.820+0000 7f6e43e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e3c0cb910 0x7f6e3c15a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:09.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.820+0000 7f6e43e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e3c15aa60 0x7f6e3c0c4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:09.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.820+0000 7f6e43e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6e3c15e180 0x7f6e3c0c4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:09.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.820+0000 7f6e43e00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3c16ae30 con 0x7f6e3c15aa60 2024-04-26T20:58:09.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.820+0000 7f6e43e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3c072240 con 0x7f6e3c0cb910 2024-04-26T20:58:09.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.820+0000 7f6e43e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f6e3c16afb0 con 0x7f6e3c15e180 2024-04-26T20:58:09.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.820+0000 7f6e40a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e3c15aa60 0x7f6e3c0c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:09.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.820+0000 7f6e40a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e3c15aa60 0x7f6e3c0c4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:59228/0 (socket says 172.21.15.138:59228) 2024-04-26T20:58:09.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.820+0000 7f6e40a00640 1 -- 172.21.15.138:0/703899821 learned_addr learned my addr 172.21.15.138:0/703899821 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:09.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.820+0000 7f6e41400640 1 --2- 172.21.15.138:0/703899821 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e3c0cb910 0x7f6e3c15a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:09.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.820+0000 7f6e41e00640 1 --2- 172.21.15.138:0/703899821 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6e3c15e180 0x7f6e3c0c4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:09.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.820+0000 7f6e40a00640 1 -- 172.21.15.138:0/703899821 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6e3c15e180 msgr2=0x7f6e3c0c4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:09.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.820+0000 7f6e40a00640 1 --2- 172.21.15.138:0/703899821 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6e3c15e180 0x7f6e3c0c4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:09.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.820+0000 7f6e40a00640 1 -- 172.21.15.138:0/703899821 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e3c0cb910 msgr2=0x7f6e3c15a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:09.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.820+0000 7f6e40a00640 1 --2- 172.21.15.138:0/703899821 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e3c0cb910 0x7f6e3c15a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:09.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.820+0000 7f6e40a00640 1 -- 172.21.15.138:0/703899821 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e3c0c54c0 con 0x7f6e3c15aa60 2024-04-26T20:58:09.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.820+0000 7f6e40a00640 1 --2- 172.21.15.138:0/703899821 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e3c15aa60 0x7f6e3c0c4750 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6e2800c420 tx=0x7f6e2800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:09.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.820+0000 7f6e39600640 1 -- 172.21.15.138:0/703899821 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e280052d0 con 0x7f6e3c15aa60 2024-04-26T20:58:09.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.820+0000 7f6e39600640 1 -- 172.21.15.138:0/703899821 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e28005470 con 0x7f6e3c15aa60 2024-04-26T20:58:09.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.820+0000 7f6e43e00640 1 -- 172.21.15.138:0/703899821 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e3c0c57a0 con 0x7f6e3c15aa60 2024-04-26T20:58:09.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.820+0000 7f6e39600640 1 -- 172.21.15.138:0/703899821 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e28007260 con 0x7f6e3c15aa60 2024-04-26T20:58:09.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.820+0000 7f6e43e00640 1 -- 172.21.15.138:0/703899821 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e3c0c5d60 con 0x7f6e3c15aa60 2024-04-26T20:58:09.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.824+0000 7f6e43e00640 1 -- 172.21.15.138:0/703899821 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e3c069430 con 0x7f6e3c15aa60 2024-04-26T20:58:09.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.824+0000 7f6e39600640 1 -- 172.21.15.138:0/703899821 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6e28007400 con 0x7f6e3c15aa60 2024-04-26T20:58:09.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.824+0000 7f6e39600640 1 --2- 172.21.15.138:0/703899821 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6e1c068380 0x7f6e1c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:09.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.824+0000 7f6e39600640 1 -- 172.21.15.138:0/703899821 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6562+0+0 (secure 0 0 0) 0x7f6e28086190 con 0x7f6e3c15aa60 2024-04-26T20:58:09.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.824+0000 7f6e41400640 1 --2- 172.21.15.138:0/703899821 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6e1c068380 0x7f6e1c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:09.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.828+0000 7f6e41400640 1 --2- 172.21.15.138:0/703899821 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6e1c068380 0x7f6e1c06a840 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6e30005890 tx=0x7f6e30009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:09.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.828+0000 7f6e39600640 1 -- 172.21.15.138:0/703899821 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6e28055da0 con 0x7f6e3c15aa60 2024-04-26T20:58:09.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.984+0000 7f6e43e00640 1 -- 172.21.15.138:0/703899821 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f6e3c06fbd0 con 0x7f6e3c15aa60 2024-04-26T20:58:09.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.984+0000 7f6e39600640 1 -- 172.21.15.138:0/703899821 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' already exists v47) ==== 177+0+0 (secure 0 0 0) 0x7f6e2805a0a0 con 0x7f6e3c15aa60 2024-04-26T20:58:09.987 INFO:teuthology.orchestra.run.smithi138.stderr:pool 'cephfs_data' already exists 2024-04-26T20:58:09.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.988+0000 7f6e43e00640 1 -- 172.21.15.138:0/703899821 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6e1c068380 msgr2=0x7f6e1c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:09.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.988+0000 7f6e43e00640 1 --2- 172.21.15.138:0/703899821 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6e1c068380 0x7f6e1c06a840 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6e30005890 tx=0x7f6e30009040 comp rx=0 tx=0).stop 2024-04-26T20:58:09.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.988+0000 7f6e43e00640 1 -- 172.21.15.138:0/703899821 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e3c15aa60 msgr2=0x7f6e3c0c4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:09.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.988+0000 7f6e43e00640 1 --2- 172.21.15.138:0/703899821 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e3c15aa60 0x7f6e3c0c4750 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6e2800c420 tx=0x7f6e2800c8e0 comp rx=0 tx=0).stop 2024-04-26T20:58:09.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.988+0000 7f6e43e00640 1 -- 172.21.15.138:0/703899821 shutdown_connections 2024-04-26T20:58:09.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.988+0000 7f6e43e00640 1 --2- 172.21.15.138:0/703899821 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6e1c068380 0x7f6e1c06a840 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:09.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.988+0000 7f6e43e00640 1 --2- 172.21.15.138:0/703899821 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6e3c15e180 0x7f6e3c0c4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:09.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.988+0000 7f6e43e00640 1 --2- 172.21.15.138:0/703899821 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e3c15aa60 0x7f6e3c0c4750 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:09.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.988+0000 7f6e43e00640 1 --2- 172.21.15.138:0/703899821 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e3c0cb910 0x7f6e3c15a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:09.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.988+0000 7f6e43e00640 1 -- 172.21.15.138:0/703899821 >> 172.21.15.138:0/703899821 conn(0x7f6e3c0d0bb0 msgr2=0x7f6e3c0af020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:09.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.988+0000 7f6e43e00640 1 -- 172.21.15.138:0/703899821 shutdown_connections 2024-04-26T20:58:09.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:09.988+0000 7f6e43e00640 1 -- 172.21.15.138:0/703899821 wait complete. 2024-04-26T20:58:10.008 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new recovery_fs recovery_fs_metadata cephfs_data --recover --allow-dangerous-metadata-overlay 2024-04-26T20:58:10.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.148+0000 7f0fc0e00640 1 Processor -- start 2024-04-26T20:58:10.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.148+0000 7f0fc0e00640 1 -- start start 2024-04-26T20:58:10.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.148+0000 7f0fc0e00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f0fbc0cc2e0 0x7f0fbc073e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:10.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.148+0000 7f0fc0e00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fbc06e1a0 con 0x7f0fbc15c020 2024-04-26T20:58:10.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.148+0000 7f0fc0e00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fbc06e480 con 0x7f0fbc15bc40 2024-04-26T20:58:10.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.148+0000 7f0fc0e00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f0fbc073380 con 0x7f0fbc0cc2e0 2024-04-26T20:58:10.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.148+0000 7f0fba800640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f0fbc15c020 0x7f0fbc0ce720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:44434/0 (socket says 172.21.15.138:44434) 2024-04-26T20:58:10.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.148+0000 7f0fba800640 1 -- 172.21.15.138:0/1116621293 learned_addr learned my addr 172.21.15.138:0/1116621293 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:10.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.148+0000 7f0fb1400640 1 --2- 172.21.15.138:0/1116621293 >> v2:172.21.15.143:3300/0 conn(0x7f0fbc0cc2e0 0x7f0fbc073e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:10.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.148+0000 7f0fb9400640 1 -- 172.21.15.138:0/1116621293 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 872010200 0 0) 0x7f0fbc06e1a0 con 0x7f0fbc15c020 2024-04-26T20:58:10.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.148+0000 7f0fb9400640 1 -- 172.21.15.138:0/1116621293 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0fa0003530 con 0x7f0fbc15c020 2024-04-26T20:58:10.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.148+0000 7f0fb9400640 1 -- 172.21.15.138:0/1116621293 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1088293335 0 0) 0x7f0fbc06e480 con 0x7f0fbc15bc40 2024-04-26T20:58:10.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.148+0000 7f0fb9400640 1 -- 172.21.15.138:0/1116621293 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0fbc06e1a0 con 0x7f0fbc15bc40 2024-04-26T20:58:10.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.148+0000 7f0fb1400640 1 -- 172.21.15.138:0/1116621293 >> v1:172.21.15.143:6789/0 conn(0x7f0fbc15bc40 legacy=0x7f0fbc0cbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:10.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.148+0000 7f0fb9400640 1 -- 172.21.15.138:0/1116621293 <== mon.0 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2261524855 0 0) 0x7f0fa0003530 con 0x7f0fbc15c020 2024-04-26T20:58:10.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.148+0000 7f0fb1400640 1 -- 172.21.15.138:0/1116621293 >> v1:172.21.15.138:6789/0 conn(0x7f0fbc15c020 legacy=0x7f0fbc0ce720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:10.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.148+0000 7f0fb1400640 1 -- 172.21.15.138:0/1116621293 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fbc073660 con 0x7f0fbc0cc2e0 2024-04-26T20:58:10.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.152+0000 7f0fb1400640 1 --2- 172.21.15.138:0/1116621293 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0fbc0cc2e0 0x7f0fbc073e60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0fa40097c0 tx=0x7f0fa401c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee0d017ef78a3207 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:10.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.152+0000 7f0fb9400640 1 -- 172.21.15.138:0/1116621293 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa40b0070 con 0x7f0fbc0cc2e0 2024-04-26T20:58:10.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.152+0000 7f0fb9400640 1 -- 172.21.15.138:0/1116621293 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fa40ab400 con 0x7f0fbc0cc2e0 2024-04-26T20:58:10.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.152+0000 7f0fb9400640 1 -- 172.21.15.138:0/1116621293 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb4001680 con 0x7f0fbc0cc2e0 2024-04-26T20:58:10.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.152+0000 7f0fc0e00640 1 -- 172.21.15.138:0/1116621293 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0fbc0cc2e0 msgr2=0x7f0fbc073e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:10.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.152+0000 7f0fc0e00640 1 --2- 172.21.15.138:0/1116621293 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0fbc0cc2e0 0x7f0fbc073e60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0fa40097c0 tx=0x7f0fa401c3c0 comp rx=0 tx=0).stop 2024-04-26T20:58:10.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.152+0000 7f0fc0e00640 1 -- 172.21.15.138:0/1116621293 shutdown_connections 2024-04-26T20:58:10.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.152+0000 7f0fc0e00640 1 --2- 172.21.15.138:0/1116621293 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0fbc0cc2e0 0x7f0fbc073e60 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:10.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.152+0000 7f0fc0e00640 1 -- 172.21.15.138:0/1116621293 >> 172.21.15.138:0/1116621293 conn(0x7f0fbc0d0b50 msgr2=0x7f0fbc0d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:10.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.152+0000 7f0fc0e00640 1 -- 172.21.15.138:0/1116621293 shutdown_connections 2024-04-26T20:58:10.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.152+0000 7f0fc0e00640 1 -- 172.21.15.138:0/1116621293 wait complete. 2024-04-26T20:58:10.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.156+0000 7f0fc0e00640 1 Processor -- start 2024-04-26T20:58:10.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.156+0000 7f0fc0e00640 1 -- start start 2024-04-26T20:58:10.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.156+0000 7f0fc0e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0fbc0cc2e0 0x7f0fbc154c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:10.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.156+0000 7f0fc0e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0fbc15bc40 0x7f0fbc155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:10.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.156+0000 7f0fc0e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0fbc15c020 0x7f0fbc0afbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:10.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.156+0000 7f0fc0e00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f0fbc06eab0 con 0x7f0fbc15c020 2024-04-26T20:58:10.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.156+0000 7f0fc0e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f0fbc06e930 con 0x7f0fbc15bc40 2024-04-26T20:58:10.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.156+0000 7f0fc0e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f0fbc06ec30 con 0x7f0fbc0cc2e0 2024-04-26T20:58:10.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.156+0000 7f0fba800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0fbc15c020 0x7f0fbc0afbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:10.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.156+0000 7f0fba800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0fbc15c020 0x7f0fbc0afbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:59240/0 (socket says 172.21.15.138:59240) 2024-04-26T20:58:10.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.156+0000 7f0fba800640 1 -- 172.21.15.138:0/2386915796 learned_addr learned my addr 172.21.15.138:0/2386915796 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:10.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.156+0000 7f0fb1400640 1 --2- 172.21.15.138:0/2386915796 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0fbc15bc40 0x7f0fbc155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:10.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.156+0000 7f0fb9e00640 1 --2- 172.21.15.138:0/2386915796 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0fbc0cc2e0 0x7f0fbc154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:10.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.156+0000 7f0fba800640 1 -- 172.21.15.138:0/2386915796 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0fbc0cc2e0 msgr2=0x7f0fbc154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:10.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.156+0000 7f0fba800640 1 --2- 172.21.15.138:0/2386915796 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0fbc0cc2e0 0x7f0fbc154c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:10.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.156+0000 7f0fba800640 1 -- 172.21.15.138:0/2386915796 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0fbc15bc40 msgr2=0x7f0fbc155400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:10.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.156+0000 7f0fba800640 1 --2- 172.21.15.138:0/2386915796 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0fbc15bc40 0x7f0fbc155400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:10.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.156+0000 7f0fba800640 1 -- 172.21.15.138:0/2386915796 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fbc0aeb10 con 0x7f0fbc15c020 2024-04-26T20:58:10.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.156+0000 7f0fba800640 1 --2- 172.21.15.138:0/2386915796 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0fbc15c020 0x7f0fbc0afbb0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f0fb400c530 tx=0x7f0fb400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:10.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.156+0000 7f0fb2a00640 1 -- 172.21.15.138:0/2386915796 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb4017070 con 0x7f0fbc15c020 2024-04-26T20:58:10.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.156+0000 7f0fb2a00640 1 -- 172.21.15.138:0/2386915796 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fb4005cf0 con 0x7f0fbc15c020 2024-04-26T20:58:10.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.156+0000 7f0fc0e00640 1 -- 172.21.15.138:0/2386915796 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fbc0aedf0 con 0x7f0fbc15c020 2024-04-26T20:58:10.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.156+0000 7f0fb2a00640 1 -- 172.21.15.138:0/2386915796 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb4007290 con 0x7f0fbc15c020 2024-04-26T20:58:10.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.156+0000 7f0fc0e00640 1 -- 172.21.15.138:0/2386915796 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fbc0af3b0 con 0x7f0fbc15c020 2024-04-26T20:58:10.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.160+0000 7f0fc0e00640 1 -- 172.21.15.138:0/2386915796 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fbc069510 con 0x7f0fbc15c020 2024-04-26T20:58:10.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.160+0000 7f0fb2a00640 1 -- 172.21.15.138:0/2386915796 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0fb401a070 con 0x7f0fbc15c020 2024-04-26T20:58:10.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.160+0000 7f0fb2a00640 1 --2- 172.21.15.138:0/2386915796 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0f98068380 0x7f0f9806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:10.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.160+0000 7f0fb2a00640 1 -- 172.21.15.138:0/2386915796 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6562+0+0 (secure 0 0 0) 0x7f0fb4086190 con 0x7f0fbc15c020 2024-04-26T20:58:10.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.160+0000 7f0fb9e00640 1 --2- 172.21.15.138:0/2386915796 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0f98068380 0x7f0f9806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:10.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.160+0000 7f0fb9e00640 1 --2- 172.21.15.138:0/2386915796 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0f98068380 0x7f0f9806a840 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0fac001570 tx=0x7f0fac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:10.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.164+0000 7f0fb2a00640 1 -- 172.21.15.138:0/2386915796 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0fb4055d00 con 0x7f0fbc15c020 2024-04-26T20:58:10.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.356+0000 7f0fc0e00640 1 -- 172.21.15.138:0/2386915796 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "recovery_fs", "metadata": "recovery_fs_metadata", "data": "cephfs_data", "recover": true, "allow_dangerous_metadata_overlay": true} v 0) -- 0x7f0fbc0cae70 con 0x7f0fbc15c020 2024-04-26T20:58:10.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.644+0000 7f0fb2a00640 1 -- 172.21.15.138:0/2386915796 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "recovery_fs", "metadata": "recovery_fs_metadata", "data": "cephfs_data", "recover": true, "allow_dangerous_metadata_overlay": true}]=0 new fs with metadata pool 7 and data pool 6 v21) ==== 241+0+0 (secure 0 0 0) 0x7f0fb405a000 con 0x7f0fbc15c020 2024-04-26T20:58:10.645 INFO:teuthology.orchestra.run.smithi138.stderr:new fs with metadata pool 7 and data pool 6 2024-04-26T20:58:10.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.644+0000 7f0fc0e00640 1 -- 172.21.15.138:0/2386915796 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0f98068380 msgr2=0x7f0f9806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:10.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.644+0000 7f0fc0e00640 1 --2- 172.21.15.138:0/2386915796 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0f98068380 0x7f0f9806a840 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0fac001570 tx=0x7f0fac009040 comp rx=0 tx=0).stop 2024-04-26T20:58:10.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.644+0000 7f0fc0e00640 1 -- 172.21.15.138:0/2386915796 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0fbc15c020 msgr2=0x7f0fbc0afbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:10.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.644+0000 7f0fc0e00640 1 --2- 172.21.15.138:0/2386915796 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0fbc15c020 0x7f0fbc0afbb0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f0fb400c530 tx=0x7f0fb400c9f0 comp rx=0 tx=0).stop 2024-04-26T20:58:10.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.648+0000 7f0fc0e00640 1 -- 172.21.15.138:0/2386915796 shutdown_connections 2024-04-26T20:58:10.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.648+0000 7f0fc0e00640 1 --2- 172.21.15.138:0/2386915796 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0f98068380 0x7f0f9806a840 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:10.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.648+0000 7f0fc0e00640 1 --2- 172.21.15.138:0/2386915796 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0fbc15c020 0x7f0fbc0afbb0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:10.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.648+0000 7f0fc0e00640 1 --2- 172.21.15.138:0/2386915796 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0fbc15bc40 0x7f0fbc155400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:10.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.648+0000 7f0fc0e00640 1 --2- 172.21.15.138:0/2386915796 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0fbc0cc2e0 0x7f0fbc154c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:10.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.648+0000 7f0fc0e00640 1 -- 172.21.15.138:0/2386915796 >> 172.21.15.138:0/2386915796 conn(0x7f0fbc0d0b50 msgr2=0x7f0fbc075930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:10.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.648+0000 7f0fc0e00640 1 -- 172.21.15.138:0/2386915796 shutdown_connections 2024-04-26T20:58:10.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.648+0000 7f0fc0e00640 1 -- 172.21.15.138:0/2386915796 wait complete. 2024-04-26T20:58:10.682 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:58:10.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.816+0000 7f23e0a00640 1 Processor -- start 2024-04-26T20:58:10.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.816+0000 7f23e0a00640 1 -- start start 2024-04-26T20:58:10.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.816+0000 7f23e0a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f23dc15d0f0 0x7f23dc0d1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:10.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.816+0000 7f23e0a00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f23dc0b2280 0x7f23dc0d1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:10.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.816+0000 7f23e0a00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23dc0ce540 con 0x7f23dc0d0950 2024-04-26T20:58:10.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.816+0000 7f23e0a00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f23dc0d0e50 con 0x7f23dc0b2280 2024-04-26T20:58:10.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.816+0000 7f23e0a00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f23dc0b26e0 con 0x7f23dc15d0f0 2024-04-26T20:58:10.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.816+0000 7f23d9400640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f23dc0b2280 0x7f23dc0d1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:10.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.816+0000 7f23d9e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f23dc15d0f0 0x7f23dc0d1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:10.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.816+0000 7f23d9400640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f23dc0b2280 0x7f23dc0d1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.138:57198/0 (socket says 172.21.15.138:57198) 2024-04-26T20:58:10.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.816+0000 7f23d9400640 1 -- 172.21.15.138:0/2221398361 learned_addr learned my addr 172.21.15.138:0/2221398361 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:10.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.816+0000 7f23d9e00640 1 -- 172.21.15.138:0/2221398361 >> v2:172.21.15.143:3300/0 conn(0x7f23dc0b2280 msgr2=0x7f23dc0d1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:10.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.816+0000 7f23d9e00640 1 --2- 172.21.15.138:0/2221398361 >> v2:172.21.15.143:3300/0 conn(0x7f23dc0b2280 0x7f23dc0d1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:10.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.816+0000 7f23d9e00640 1 -- 172.21.15.138:0/2221398361 >> v1:172.21.15.143:6789/0 conn(0x7f23dc0d0950 legacy=0x7f23dc0cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:10.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.816+0000 7f23d9e00640 1 -- 172.21.15.138:0/2221398361 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23dc0ce820 con 0x7f23dc15d0f0 2024-04-26T20:58:10.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.816+0000 7f23d9400640 1 --2- 172.21.15.138:0/2221398361 >> v2:172.21.15.143:3300/0 conn(0x7f23dc0b2280 0x7f23dc0d1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:58:10.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.820+0000 7f23d9e00640 1 --2- 172.21.15.138:0/2221398361 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f23dc15d0f0 0x7f23dc0d1010 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f23cc0097c0 tx=0x7f23cc01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e1e6f34c7b6b20e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:10.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.820+0000 7f23d8a00640 1 -- 172.21.15.138:0/2221398361 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23cc0b0070 con 0x7f23dc15d0f0 2024-04-26T20:58:10.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.820+0000 7f23d8a00640 1 -- 172.21.15.138:0/2221398361 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23cc0ab600 con 0x7f23dc15d0f0 2024-04-26T20:58:10.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.820+0000 7f23d8a00640 1 -- 172.21.15.138:0/2221398361 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23cc0ab9d0 con 0x7f23dc15d0f0 2024-04-26T20:58:10.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.820+0000 7f23e0a00640 1 -- 172.21.15.138:0/2221398361 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f23dc15d0f0 msgr2=0x7f23dc0d1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:10.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.820+0000 7f23e0a00640 1 --2- 172.21.15.138:0/2221398361 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f23dc15d0f0 0x7f23dc0d1010 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f23cc0097c0 tx=0x7f23cc01c4a0 comp rx=0 tx=0).stop 2024-04-26T20:58:10.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.820+0000 7f23e0a00640 1 -- 172.21.15.138:0/2221398361 shutdown_connections 2024-04-26T20:58:10.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.820+0000 7f23e0a00640 1 --2- 172.21.15.138:0/2221398361 >> v2:172.21.15.143:3300/0 conn(0x7f23dc0b2280 0x7f23dc0d1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:10.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.820+0000 7f23e0a00640 1 --2- 172.21.15.138:0/2221398361 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f23dc15d0f0 0x7f23dc0d1010 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:10.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.820+0000 7f23e0a00640 1 -- 172.21.15.138:0/2221398361 >> 172.21.15.138:0/2221398361 conn(0x7f23dc0d2d80 msgr2=0x7f23dc0d3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:10.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.820+0000 7f23e0a00640 1 -- 172.21.15.138:0/2221398361 shutdown_connections 2024-04-26T20:58:10.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.820+0000 7f23e0a00640 1 -- 172.21.15.138:0/2221398361 wait complete. 2024-04-26T20:58:10.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.824+0000 7f23e0a00640 1 Processor -- start 2024-04-26T20:58:10.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.824+0000 7f23e0a00640 1 -- start start 2024-04-26T20:58:10.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.824+0000 7f23e0a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f23dc0b2280 0x7f23dc09ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:10.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.824+0000 7f23e0a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23dc0d0950 0x7f23dc1586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:10.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.824+0000 7f23e0a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23dc15d0f0 0x7f23dc158be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:10.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.824+0000 7f23e0a00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f23dc16a040 con 0x7f23dc15d0f0 2024-04-26T20:58:10.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.824+0000 7f23e0a00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f23dc169ec0 con 0x7f23dc0d0950 2024-04-26T20:58:10.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.824+0000 7f23e0a00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f23dc16a1c0 con 0x7f23dc0b2280 2024-04-26T20:58:10.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.824+0000 7f23da800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23dc15d0f0 0x7f23dc158be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:10.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.824+0000 7f23d9e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f23dc0b2280 0x7f23dc09ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:10.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.824+0000 7f23d9400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23dc0d0950 0x7f23dc1586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:10.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.824+0000 7f23d9e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f23dc0b2280 0x7f23dc09ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.138:49244/0 (socket says 172.21.15.138:49244) 2024-04-26T20:58:10.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.824+0000 7f23d9e00640 1 -- 172.21.15.138:0/2689766061 learned_addr learned my addr 172.21.15.138:0/2689766061 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:10.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.824+0000 7f23d9e00640 1 -- 172.21.15.138:0/2689766061 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23dc0d0950 msgr2=0x7f23dc1586a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:10.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.824+0000 7f23d9e00640 1 --2- 172.21.15.138:0/2689766061 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23dc0d0950 0x7f23dc1586a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:10.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.824+0000 7f23d9e00640 1 -- 172.21.15.138:0/2689766061 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23dc15d0f0 msgr2=0x7f23dc158be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:10.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.824+0000 7f23d9e00640 1 --2- 172.21.15.138:0/2689766061 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23dc15d0f0 0x7f23dc158be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:10.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.824+0000 7f23d9e00640 1 -- 172.21.15.138:0/2689766061 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23dc09cbe0 con 0x7f23dc0b2280 2024-04-26T20:58:10.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.824+0000 7f23da800640 1 --2- 172.21.15.138:0/2689766061 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23dc15d0f0 0x7f23dc158be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:58:10.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.824+0000 7f23d9e00640 1 --2- 172.21.15.138:0/2689766061 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f23dc0b2280 0x7f23dc09ece0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f23cc0ae040 tx=0x7f23cc01ace0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:10.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.824+0000 7f23d2000640 1 -- 172.21.15.138:0/2689766061 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23cc0b0050 con 0x7f23dc0b2280 2024-04-26T20:58:10.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.824+0000 7f23d2000640 1 -- 172.21.15.138:0/2689766061 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23cc0bc070 con 0x7f23dc0b2280 2024-04-26T20:58:10.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.824+0000 7f23e0a00640 1 -- 172.21.15.138:0/2689766061 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23dc09cec0 con 0x7f23dc0b2280 2024-04-26T20:58:10.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.824+0000 7f23d2000640 1 -- 172.21.15.138:0/2689766061 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23cc0b5870 con 0x7f23dc0b2280 2024-04-26T20:58:10.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.824+0000 7f23e0a00640 1 -- 172.21.15.138:0/2689766061 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f23dc09d480 con 0x7f23dc0b2280 2024-04-26T20:58:10.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.828+0000 7f23e0a00640 1 -- 172.21.15.138:0/2689766061 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23dc069510 con 0x7f23dc0b2280 2024-04-26T20:58:10.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.828+0000 7f23d2000640 1 -- 172.21.15.138:0/2689766061 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f23cc0b5a10 con 0x7f23dc0b2280 2024-04-26T20:58:10.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.828+0000 7f23d2000640 1 --2- 172.21.15.138:0/2689766061 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f23bc068380 0x7f23bc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:10.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.828+0000 7f23d2000640 1 -- 172.21.15.138:0/2689766061 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(48..48 src has 1..48) ==== 6640+0+0 (secure 0 0 0) 0x7f23cc121de0 con 0x7f23dc0b2280 2024-04-26T20:58:10.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.828+0000 7f23d9400640 1 --2- 172.21.15.138:0/2689766061 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f23bc068380 0x7f23bc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:10.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.828+0000 7f23d9400640 1 --2- 172.21.15.138:0/2689766061 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f23bc068380 0x7f23bc06a840 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f23dc0b1730 tx=0x7f23c8009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:10.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.832+0000 7f23d2000640 1 -- 172.21.15.138:0/2689766061 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f23cc016090 con 0x7f23dc0b2280 2024-04-26T20:58:10.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.988+0000 7f23e0a00640 1 -- 172.21.15.138:0/2689766061 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f23dc070e70 con 0x7f23dc0b2280 2024-04-26T20:58:10.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.992+0000 7f23d2000640 1 -- 172.21.15.138:0/2689766061 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) ==== 74+0+19022 (secure 0 0 0) 0x7f23cc0f19b0 con 0x7f23dc0b2280 2024-04-26T20:58:10.992 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:10.993 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":48,"fsid":"c22b4730-12cc-4558-8535-b965384398c0","created":"2024-04-26T20:56:14.182475+0000","modified":"2024-04-26T20:58:10.360199+0000","last_up_change":"2024-04-26T20:56:26.013243+0000","last_in_change":"2024-04-26T20:56:16.714055+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:56:27.265834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:57:49.597600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-26T20:57:50.901951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"recovery_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"recovery_fs_metadata","create_time":"2024-04-26T20:58:09.327192+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"recovery_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3f9a2e34-3199-466f-a6cf-57927318121e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6801","nonce":3534772245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6803","nonce":3534772245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6807","nonce":3534772245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6805","nonce":3534772245}]},"public_addr":"172.21.15.138:6801/3534772245","cluster_addr":"172.21.15.138:6803/3534772245","heartbeat_back_addr":"172.21.15.138:6807/3534772245","heartbeat_front_addr":"172.21.15.138:6805/3534772245","state":["exists","up"]},{"osd":1,"uuid":"e881fcf6-3248-4696-a2ef-95d206d77712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6817","nonce":1427635773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6819","nonce":1427635773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6823","nonce":1427635773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6821","nonce":1427635773}]},"public_addr":"172.21.15.138:6817/1427635773","cluster_addr":"172.21.15.138:6819/1427635773","heartbeat_back_addr":"172.21.15.138:6823/1427635773","heartbeat_front_addr":"172.21.15.138:6821/1427635773","state":["exists","up"]},{"osd":2,"uuid":"f7d1db33-7672-4699-ae47-9f1e0a8e4222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6809","nonce":4273721573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6811","nonce":4273721573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6815","nonce":4273721573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6813","nonce":4273721573}]},"public_addr":"172.21.15.138:6809/4273721573","cluster_addr":"172.21.15.138:6811/4273721573","heartbeat_back_addr":"172.21.15.138:6815/4273721573","heartbeat_front_addr":"172.21.15.138:6813/4273721573","state":["exists","up"]},{"osd":3,"uuid":"2f4e0a9a-b8f6-4468-844a-a4501cd85054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6825","nonce":3098242154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6827","nonce":3098242154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6831","nonce":3098242154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6829","nonce":3098242154}]},"public_addr":"172.21.15.138:6825/3098242154","cluster_addr":"172.21.15.138:6827/3098242154","heartbeat_back_addr":"172.21.15.138:6831/3098242154","heartbeat_front_addr":"172.21.15.138:6829/3098242154","state":["exists","up"]},{"osd":4,"uuid":"c85df99b-3624-410e-866b-86830af2cfe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6801","nonce":2942056312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6803","nonce":2942056312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6807","nonce":2942056312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6805","nonce":2942056312}]},"public_addr":"172.21.15.143:6801/2942056312","cluster_addr":"172.21.15.143:6803/2942056312","heartbeat_back_addr":"172.21.15.143:6807/2942056312","heartbeat_front_addr":"172.21.15.143:6805/2942056312","state":["exists","up"]},{"osd":5,"uuid":"9af1efb5-c416-4808-b5ef-de0679ab9705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6809","nonce":1910222887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6811","nonce":1910222887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6815","nonce":1910222887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6813","nonce":1910222887}]},"public_addr":"172.21.15.143:6809/1910222887","cluster_addr":"172.21.15.143:6811/1910222887","heartbeat_back_addr":"172.21.15.143:6815/1910222887","heartbeat_front_addr":"172.21.15.143:6813/1910222887","state":["exists","up"]},{"osd":6,"uuid":"d7138615-8838-45ff-9072-2fd0683362f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6817","nonce":1082239825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6819","nonce":1082239825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6823","nonce":1082239825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6821","nonce":1082239825}]},"public_addr":"172.21.15.143:6817/1082239825","cluster_addr":"172.21.15.143:6819/1082239825","heartbeat_back_addr":"172.21.15.143:6823/1082239825","heartbeat_front_addr":"172.21.15.143:6821/1082239825","state":["exists","up"]},{"osd":7,"uuid":"0c27172b-35c4-49ec-ba0b-0137b8ff0010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6825","nonce":3295508495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6827","nonce":3295508495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6831","nonce":3295508495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6829","nonce":3295508495}]},"public_addr":"172.21.15.143:6825/3295508495","cluster_addr":"172.21.15.143:6827/3295508495","heartbeat_back_addr":"172.21.15.143:6831/3295508495","heartbeat_front_addr":"172.21.15.143:6829/3295508495","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.326627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.396119+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.433915+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.414179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.216947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.329272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.503073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.436382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.143:6836/483370849":"2024-04-27T20:58:07.183664+0000","172.21.15.143:6834/483370849":"2024-04-27T20:58:07.183664+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:58:10.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.992+0000 7f23e0a00640 1 -- 172.21.15.138:0/2689766061 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f23bc068380 msgr2=0x7f23bc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:10.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.992+0000 7f23e0a00640 1 --2- 172.21.15.138:0/2689766061 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f23bc068380 0x7f23bc06a840 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f23dc0b1730 tx=0x7f23c8009240 comp rx=0 tx=0).stop 2024-04-26T20:58:10.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.992+0000 7f23e0a00640 1 -- 172.21.15.138:0/2689766061 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f23dc0b2280 msgr2=0x7f23dc09ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:10.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.992+0000 7f23e0a00640 1 --2- 172.21.15.138:0/2689766061 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f23dc0b2280 0x7f23dc09ece0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f23cc0ae040 tx=0x7f23cc01ace0 comp rx=0 tx=0).stop 2024-04-26T20:58:10.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.992+0000 7f23e0a00640 1 -- 172.21.15.138:0/2689766061 shutdown_connections 2024-04-26T20:58:10.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.992+0000 7f23e0a00640 1 --2- 172.21.15.138:0/2689766061 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f23bc068380 0x7f23bc06a840 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:10.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.992+0000 7f23e0a00640 1 --2- 172.21.15.138:0/2689766061 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23dc15d0f0 0x7f23dc158be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:10.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.992+0000 7f23e0a00640 1 --2- 172.21.15.138:0/2689766061 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23dc0d0950 0x7f23dc1586a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:10.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.992+0000 7f23e0a00640 1 --2- 172.21.15.138:0/2689766061 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f23dc0b2280 0x7f23dc09ece0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:10.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.992+0000 7f23e0a00640 1 -- 172.21.15.138:0/2689766061 >> 172.21.15.138:0/2689766061 conn(0x7f23dc0d2d80 msgr2=0x7f23dc0cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:10.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.992+0000 7f23e0a00640 1 -- 172.21.15.138:0/2689766061 shutdown_connections 2024-04-26T20:58:10.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:10.992+0000 7f23e0a00640 1 -- 172.21.15.138:0/2689766061 wait complete. 2024-04-26T20:58:11.013 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:58:11.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.148+0000 7f7bfa400640 1 Processor -- start 2024-04-26T20:58:11.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.148+0000 7f7bfa400640 1 -- start start 2024-04-26T20:58:11.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.148+0000 7f7bfa400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f7bf41604f0 0x7f7bf40d11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:11.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.148+0000 7f7bfa400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7bf40cfbc0 0x7f7bf40b3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:11.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.148+0000 7f7bfa400640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bf40b26c0 con 0x7f7bf40d1700 2024-04-26T20:58:11.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.148+0000 7f7bfa400640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f7bf40d1c10 con 0x7f7bf41604f0 2024-04-26T20:58:11.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.148+0000 7f7bfa400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f7bf40b2960 con 0x7f7bf40cfbc0 2024-04-26T20:58:11.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.148+0000 7f7bf9000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f7bf41604f0 0x7f7bf40d11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:11.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.148+0000 7f7bf9000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f7bf41604f0 0x7f7bf40d11c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:59244/0 (socket says 172.21.15.138:59244) 2024-04-26T20:58:11.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.148+0000 7f7bf9000640 1 -- 172.21.15.138:0/4147985179 learned_addr learned my addr 172.21.15.138:0/4147985179 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:11.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.148+0000 7f7bf9a00640 1 --2- 172.21.15.138:0/4147985179 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7bf40cfbc0 0x7f7bf40b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:11.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.148+0000 7f7bf9000640 1 -- 172.21.15.138:0/4147985179 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7bf40cfbc0 msgr2=0x7f7bf40b3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:11.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.148+0000 7f7bf9000640 1 --2- 172.21.15.138:0/4147985179 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7bf40cfbc0 0x7f7bf40b3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:11.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.148+0000 7f7bf9000640 1 -- 172.21.15.138:0/4147985179 >> v1:172.21.15.143:6789/0 conn(0x7f7bf40d1700 legacy=0x7f7bf40cf4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:11.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.148+0000 7f7bf9000640 1 -- 172.21.15.138:0/4147985179 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bf40b2c40 con 0x7f7bf41604f0 2024-04-26T20:58:11.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.152+0000 7f7bf9000640 1 --2- 172.21.15.138:0/4147985179 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7bf41604f0 0x7f7bf40d11c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f7be4009870 tx=0x7f7be401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9352c335efd6c7c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:11.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.152+0000 7f7bf3e00640 1 -- 172.21.15.138:0/4147985179 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be40b1070 con 0x7f7bf41604f0 2024-04-26T20:58:11.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.152+0000 7f7bf3e00640 1 -- 172.21.15.138:0/4147985179 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7be40a8050 con 0x7f7bf41604f0 2024-04-26T20:58:11.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.152+0000 7f7bf3e00640 1 -- 172.21.15.138:0/4147985179 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be40ac860 con 0x7f7bf41604f0 2024-04-26T20:58:11.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.152+0000 7f7bfa400640 1 -- 172.21.15.138:0/4147985179 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7bf41604f0 msgr2=0x7f7bf40d11c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:11.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.152+0000 7f7bfa400640 1 --2- 172.21.15.138:0/4147985179 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7bf41604f0 0x7f7bf40d11c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f7be4009870 tx=0x7f7be401c4d0 comp rx=0 tx=0).stop 2024-04-26T20:58:11.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.152+0000 7f7bfa400640 1 -- 172.21.15.138:0/4147985179 shutdown_connections 2024-04-26T20:58:11.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.152+0000 7f7bfa400640 1 --2- 172.21.15.138:0/4147985179 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7bf40cfbc0 0x7f7bf40b3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:11.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.152+0000 7f7bfa400640 1 --2- 172.21.15.138:0/4147985179 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7bf41604f0 0x7f7bf40d11c0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:11.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.152+0000 7f7bfa400640 1 -- 172.21.15.138:0/4147985179 >> 172.21.15.138:0/4147985179 conn(0x7f7bf40d2be0 msgr2=0x7f7bf40d2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:11.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.152+0000 7f7bfa400640 1 -- 172.21.15.138:0/4147985179 shutdown_connections 2024-04-26T20:58:11.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.152+0000 7f7bfa400640 1 -- 172.21.15.138:0/4147985179 wait complete. 2024-04-26T20:58:11.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.156+0000 7f7bfa400640 1 Processor -- start 2024-04-26T20:58:11.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.156+0000 7f7bfa400640 1 -- start start 2024-04-26T20:58:11.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.156+0000 7f7bfa400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7bf40cfbc0 0x7f7bf4155220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:11.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.156+0000 7f7bfa400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7bf40d1700 0x7f7bf4166790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:11.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.156+0000 7f7bfa400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7bf41604f0 0x7f7bf4164df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:11.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.156+0000 7f7bfa400640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf40b4310 con 0x7f7bf41604f0 2024-04-26T20:58:11.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.156+0000 7f7bfa400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf40b4190 con 0x7f7bf40cfbc0 2024-04-26T20:58:11.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.156+0000 7f7bfa400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f7bf40b4490 con 0x7f7bf40d1700 2024-04-26T20:58:11.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.156+0000 7f7bf9000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7bf40cfbc0 0x7f7bf4155220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:11.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.156+0000 7f7bf9a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7bf41604f0 0x7f7bf4164df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:11.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.156+0000 7f7bf9000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7bf40cfbc0 0x7f7bf4155220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.138:57216/0 (socket says 172.21.15.138:57216) 2024-04-26T20:58:11.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.156+0000 7f7bf9a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7bf41604f0 0x7f7bf4164df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:59256/0 (socket says 172.21.15.138:59256) 2024-04-26T20:58:11.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.156+0000 7f7bf9000640 1 -- 172.21.15.138:0/4108311418 learned_addr learned my addr 172.21.15.138:0/4108311418 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:11.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.156+0000 7f7bebe00640 1 --2- 172.21.15.138:0/4108311418 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7bf40d1700 0x7f7bf4166790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:11.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.156+0000 7f7bf9a00640 1 -- 172.21.15.138:0/4108311418 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7bf40d1700 msgr2=0x7f7bf4166790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:11.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.156+0000 7f7bf9a00640 1 --2- 172.21.15.138:0/4108311418 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7bf40d1700 0x7f7bf4166790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:11.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.156+0000 7f7bf9a00640 1 -- 172.21.15.138:0/4108311418 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7bf40cfbc0 msgr2=0x7f7bf4155220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:11.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.156+0000 7f7bf9a00640 1 --2- 172.21.15.138:0/4108311418 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7bf40cfbc0 0x7f7bf4155220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:11.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.156+0000 7f7bf9a00640 1 -- 172.21.15.138:0/4108311418 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bf41656f0 con 0x7f7bf41604f0 2024-04-26T20:58:11.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.156+0000 7f7bf9000640 1 --2- 172.21.15.138:0/4108311418 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7bf40cfbc0 0x7f7bf4155220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:58:11.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.156+0000 7f7bf9a00640 1 --2- 172.21.15.138:0/4108311418 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7bf41604f0 0x7f7bf4164df0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f7bec00ebd0 tx=0x7f7bec00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:11.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.156+0000 7f7bf1600640 1 -- 172.21.15.138:0/4108311418 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bec018020 con 0x7f7bf41604f0 2024-04-26T20:58:11.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.156+0000 7f7bf1600640 1 -- 172.21.15.138:0/4108311418 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bec00cd20 con 0x7f7bf41604f0 2024-04-26T20:58:11.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.156+0000 7f7bf1600640 1 -- 172.21.15.138:0/4108311418 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bec0146c0 con 0x7f7bf41604f0 2024-04-26T20:58:11.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.156+0000 7f7bfa400640 1 -- 172.21.15.138:0/4108311418 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bf41659d0 con 0x7f7bf41604f0 2024-04-26T20:58:11.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.156+0000 7f7bfa400640 1 -- 172.21.15.138:0/4108311418 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bf4165f90 con 0x7f7bf41604f0 2024-04-26T20:58:11.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.156+0000 7f7bfa400640 1 -- 172.21.15.138:0/4108311418 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bf4069b40 con 0x7f7bf41604f0 2024-04-26T20:58:11.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.160+0000 7f7bf1600640 1 -- 172.21.15.138:0/4108311418 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7bec01b020 con 0x7f7bf41604f0 2024-04-26T20:58:11.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.160+0000 7f7bf1600640 1 --2- 172.21.15.138:0/4108311418 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7bd0068380 0x7f7bd006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:11.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.160+0000 7f7bf1600640 1 -- 172.21.15.138:0/4108311418 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6640+0+0 (secure 0 0 0) 0x7f7bec0878d0 con 0x7f7bf41604f0 2024-04-26T20:58:11.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.160+0000 7f7bf9000640 1 --2- 172.21.15.138:0/4108311418 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7bd0068380 0x7f7bd006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:11.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.160+0000 7f7bf9000640 1 --2- 172.21.15.138:0/4108311418 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7bd0068380 0x7f7bd006a840 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7be4009870 tx=0x7f7be40a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:11.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.164+0000 7f7bf1600640 1 -- 172.21.15.138:0/4108311418 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7bec022030 con 0x7f7bf41604f0 2024-04-26T20:58:11.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.324+0000 7f7bfa400640 1 -- 172.21.15.138:0/4108311418 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7bf415e1a0 con 0x7f7bf41604f0 2024-04-26T20:58:11.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.328+0000 7f7bf1600640 1 -- 172.21.15.138:0/4108311418 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) ==== 74+0+19022 (secure 0 0 0) 0x7f7bec010040 con 0x7f7bf41604f0 2024-04-26T20:58:11.329 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:11.329 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":48,"fsid":"c22b4730-12cc-4558-8535-b965384398c0","created":"2024-04-26T20:56:14.182475+0000","modified":"2024-04-26T20:58:10.360199+0000","last_up_change":"2024-04-26T20:56:26.013243+0000","last_in_change":"2024-04-26T20:56:16.714055+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:56:27.265834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:57:49.597600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-26T20:57:50.901951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"recovery_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"recovery_fs_metadata","create_time":"2024-04-26T20:58:09.327192+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"recovery_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3f9a2e34-3199-466f-a6cf-57927318121e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6801","nonce":3534772245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6803","nonce":3534772245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6807","nonce":3534772245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6805","nonce":3534772245}]},"public_addr":"172.21.15.138:6801/3534772245","cluster_addr":"172.21.15.138:6803/3534772245","heartbeat_back_addr":"172.21.15.138:6807/3534772245","heartbeat_front_addr":"172.21.15.138:6805/3534772245","state":["exists","up"]},{"osd":1,"uuid":"e881fcf6-3248-4696-a2ef-95d206d77712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6817","nonce":1427635773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6819","nonce":1427635773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6823","nonce":1427635773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6821","nonce":1427635773}]},"public_addr":"172.21.15.138:6817/1427635773","cluster_addr":"172.21.15.138:6819/1427635773","heartbeat_back_addr":"172.21.15.138:6823/1427635773","heartbeat_front_addr":"172.21.15.138:6821/1427635773","state":["exists","up"]},{"osd":2,"uuid":"f7d1db33-7672-4699-ae47-9f1e0a8e4222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6809","nonce":4273721573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6811","nonce":4273721573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6815","nonce":4273721573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6813","nonce":4273721573}]},"public_addr":"172.21.15.138:6809/4273721573","cluster_addr":"172.21.15.138:6811/4273721573","heartbeat_back_addr":"172.21.15.138:6815/4273721573","heartbeat_front_addr":"172.21.15.138:6813/4273721573","state":["exists","up"]},{"osd":3,"uuid":"2f4e0a9a-b8f6-4468-844a-a4501cd85054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6825","nonce":3098242154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6827","nonce":3098242154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6831","nonce":3098242154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6829","nonce":3098242154}]},"public_addr":"172.21.15.138:6825/3098242154","cluster_addr":"172.21.15.138:6827/3098242154","heartbeat_back_addr":"172.21.15.138:6831/3098242154","heartbeat_front_addr":"172.21.15.138:6829/3098242154","state":["exists","up"]},{"osd":4,"uuid":"c85df99b-3624-410e-866b-86830af2cfe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6801","nonce":2942056312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6803","nonce":2942056312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6807","nonce":2942056312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6805","nonce":2942056312}]},"public_addr":"172.21.15.143:6801/2942056312","cluster_addr":"172.21.15.143:6803/2942056312","heartbeat_back_addr":"172.21.15.143:6807/2942056312","heartbeat_front_addr":"172.21.15.143:6805/2942056312","state":["exists","up"]},{"osd":5,"uuid":"9af1efb5-c416-4808-b5ef-de0679ab9705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6809","nonce":1910222887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6811","nonce":1910222887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6815","nonce":1910222887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6813","nonce":1910222887}]},"public_addr":"172.21.15.143:6809/1910222887","cluster_addr":"172.21.15.143:6811/1910222887","heartbeat_back_addr":"172.21.15.143:6815/1910222887","heartbeat_front_addr":"172.21.15.143:6813/1910222887","state":["exists","up"]},{"osd":6,"uuid":"d7138615-8838-45ff-9072-2fd0683362f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6817","nonce":1082239825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6819","nonce":1082239825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6823","nonce":1082239825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6821","nonce":1082239825}]},"public_addr":"172.21.15.143:6817/1082239825","cluster_addr":"172.21.15.143:6819/1082239825","heartbeat_back_addr":"172.21.15.143:6823/1082239825","heartbeat_front_addr":"172.21.15.143:6821/1082239825","state":["exists","up"]},{"osd":7,"uuid":"0c27172b-35c4-49ec-ba0b-0137b8ff0010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6825","nonce":3295508495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6827","nonce":3295508495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6831","nonce":3295508495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6829","nonce":3295508495}]},"public_addr":"172.21.15.143:6825/3295508495","cluster_addr":"172.21.15.143:6827/3295508495","heartbeat_back_addr":"172.21.15.143:6831/3295508495","heartbeat_front_addr":"172.21.15.143:6829/3295508495","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.326627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.396119+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.433915+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.414179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.216947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.329272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.503073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.436382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.143:6836/483370849":"2024-04-27T20:58:07.183664+0000","172.21.15.143:6834/483370849":"2024-04-27T20:58:07.183664+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:58:11.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.328+0000 7f7bfa400640 1 -- 172.21.15.138:0/4108311418 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7bd0068380 msgr2=0x7f7bd006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:11.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.328+0000 7f7bfa400640 1 --2- 172.21.15.138:0/4108311418 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7bd0068380 0x7f7bd006a840 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7be4009870 tx=0x7f7be40a7000 comp rx=0 tx=0).stop 2024-04-26T20:58:11.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.328+0000 7f7bfa400640 1 -- 172.21.15.138:0/4108311418 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7bf41604f0 msgr2=0x7f7bf4164df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:11.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.328+0000 7f7bfa400640 1 --2- 172.21.15.138:0/4108311418 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7bf41604f0 0x7f7bf4164df0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f7bec00ebd0 tx=0x7f7bec00c490 comp rx=0 tx=0).stop 2024-04-26T20:58:11.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.328+0000 7f7bfa400640 1 -- 172.21.15.138:0/4108311418 shutdown_connections 2024-04-26T20:58:11.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.328+0000 7f7bfa400640 1 --2- 172.21.15.138:0/4108311418 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7bd0068380 0x7f7bd006a840 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:11.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.328+0000 7f7bfa400640 1 --2- 172.21.15.138:0/4108311418 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7bf41604f0 0x7f7bf4164df0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:11.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.328+0000 7f7bfa400640 1 --2- 172.21.15.138:0/4108311418 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7bf40d1700 0x7f7bf4166790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:11.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.328+0000 7f7bfa400640 1 --2- 172.21.15.138:0/4108311418 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7bf40cfbc0 0x7f7bf4155220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:11.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.328+0000 7f7bfa400640 1 -- 172.21.15.138:0/4108311418 >> 172.21.15.138:0/4108311418 conn(0x7f7bf40d2be0 msgr2=0x7f7bf4075930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:11.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.328+0000 7f7bfa400640 1 -- 172.21.15.138:0/4108311418 shutdown_connections 2024-04-26T20:58:11.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.328+0000 7f7bfa400640 1 -- 172.21.15.138:0/4108311418 wait complete. 2024-04-26T20:58:11.351 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set recovery_fs standby_count_wanted 0 2024-04-26T20:58:11.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.488+0000 7f0326e00640 1 Processor -- start 2024-04-26T20:58:11.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.488+0000 7f0326e00640 1 -- start start 2024-04-26T20:58:11.491 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.488+0000 7f0326e00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f03200cd6d0 0x7f032006c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:11.491 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.488+0000 7f0326e00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03200cbab0 con 0x7f032015efe0 2024-04-26T20:58:11.491 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.488+0000 7f0326e00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0320163940 con 0x7f03200cf950 2024-04-26T20:58:11.491 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.488+0000 7f0326e00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f03200cbd30 con 0x7f03200cd6d0 2024-04-26T20:58:11.491 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.488+0000 7f031fe00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f032015efe0 0x7f03200cf240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:44438/0 (socket says 172.21.15.138:44438) 2024-04-26T20:58:11.491 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.488+0000 7f031fe00640 1 -- 172.21.15.138:0/1769284161 learned_addr learned my addr 172.21.15.138:0/1769284161 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:11.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.492+0000 7f0324e00640 1 --2- 172.21.15.138:0/1769284161 >> v2:172.21.15.143:3300/0 conn(0x7f03200cd6d0 0x7f032006c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:11.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.492+0000 7f031f400640 1 -- 172.21.15.138:0/1769284161 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 710435620 0 0) 0x7f0310001120 con 0x7f032015efe0 2024-04-26T20:58:11.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.492+0000 7f031f400640 1 -- 172.21.15.138:0/1769284161 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0304003530 con 0x7f032015efe0 2024-04-26T20:58:11.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.492+0000 7f031f400640 1 -- 172.21.15.138:0/1769284161 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1400185761 0 0) 0x7f0320163940 con 0x7f03200cf950 2024-04-26T20:58:11.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.492+0000 7f031f400640 1 -- 172.21.15.138:0/1769284161 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0310001120 con 0x7f03200cf950 2024-04-26T20:58:11.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.492+0000 7f031f400640 1 -- 172.21.15.138:0/1769284161 <== mon.0 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3832803547 0 0) 0x7f0304003530 con 0x7f032015efe0 2024-04-26T20:58:11.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.492+0000 7f031f400640 1 -- 172.21.15.138:0/1769284161 >> v2:172.21.15.143:3300/0 conn(0x7f03200cd6d0 msgr2=0x7f032006c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:11.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.492+0000 7f031f400640 1 --2- 172.21.15.138:0/1769284161 >> v2:172.21.15.143:3300/0 conn(0x7f03200cd6d0 0x7f032006c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:11.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.492+0000 7f031f400640 1 -- 172.21.15.138:0/1769284161 >> v1:172.21.15.143:6789/0 conn(0x7f03200cf950 legacy=0x7f03200cc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:11.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.492+0000 7f031f400640 1 -- 172.21.15.138:0/1769284161 --> v1:172.21.15.138:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03200cc010 con 0x7f032015efe0 2024-04-26T20:58:11.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.492+0000 7f031f400640 1 -- 172.21.15.138:0/1769284161 <== mon.0 v1:172.21.15.138:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2715389689 0 0) 0x7f0310001850 con 0x7f032015efe0 2024-04-26T20:58:11.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.492+0000 7f0324e00640 1 --2- 172.21.15.138:0/1769284161 >> v2:172.21.15.143:3300/0 conn(0x7f03200cd6d0 0x7f032006c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:58:11.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.492+0000 7f031f400640 1 -- 172.21.15.138:0/1769284161 >> v1:172.21.15.138:6789/0 conn(0x7f032015efe0 legacy=0x7f03200cf240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:11.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.492+0000 7f031f400640 1 --2- 172.21.15.138:0/1769284161 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0304003bc0 0x7f0304003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:11.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.492+0000 7f031f400640 1 --2- 172.21.15.138:0/1769284161 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0304004810 0x7f0304004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:11.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.492+0000 7f031f400640 1 --2- 172.21.15.138:0/1769284161 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f03040051d0 0x7f030400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:11.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.492+0000 7f031f400640 1 -- 172.21.15.138:0/1769284161 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f03200cbd30 con 0x7f0304003bc0 2024-04-26T20:58:11.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.492+0000 7f031f400640 1 -- 172.21.15.138:0/1769284161 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f030400c0d0 con 0x7f0304004810 2024-04-26T20:58:11.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.492+0000 7f031f400640 1 -- 172.21.15.138:0/1769284161 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f030400c2d0 con 0x7f03040051d0 2024-04-26T20:58:11.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.492+0000 7f031fe00640 1 --2- 172.21.15.138:0/1769284161 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0304003bc0 0x7f0304003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:11.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.492+0000 7f0317400640 1 --2- 172.21.15.138:0/1769284161 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0304004810 0x7f0304004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:11.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.492+0000 7f0324e00640 1 --2- 172.21.15.138:0/1769284161 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f03040051d0 0x7f030400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:11.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.492+0000 7f031fe00640 1 -- 172.21.15.138:0/1769284161 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f03040051d0 msgr2=0x7f030400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:11.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.492+0000 7f031fe00640 1 --2- 172.21.15.138:0/1769284161 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f03040051d0 0x7f030400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:11.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.492+0000 7f031fe00640 1 -- 172.21.15.138:0/1769284161 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0304004810 msgr2=0x7f0304004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:11.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.492+0000 7f031fe00640 1 --2- 172.21.15.138:0/1769284161 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0304004810 0x7f0304004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:11.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.492+0000 7f031fe00640 1 -- 172.21.15.138:0/1769284161 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0304003530 con 0x7f0304003bc0 2024-04-26T20:58:11.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.492+0000 7f0324e00640 1 -- 172.21.15.138:0/1769284161 reap_dead start 2024-04-26T20:58:11.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.496+0000 7f031fe00640 1 --2- 172.21.15.138:0/1769284161 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0304003bc0 0x7f0304003fc0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f031000c4c0 tx=0x7f031001cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13e15a3d9051e452 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:11.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.496+0000 7f031f400640 1 -- 172.21.15.138:0/1769284161 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f031000c0e0 con 0x7f0304003bc0 2024-04-26T20:58:11.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.496+0000 7f031f400640 1 -- 172.21.15.138:0/1769284161 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03100a9020 con 0x7f0304003bc0 2024-04-26T20:58:11.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.496+0000 7f031f400640 1 -- 172.21.15.138:0/1769284161 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0310005b00 con 0x7f0304003bc0 2024-04-26T20:58:11.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.496+0000 7f0326e00640 1 -- 172.21.15.138:0/1769284161 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0304003bc0 msgr2=0x7f0304003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:11.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.496+0000 7f0326e00640 1 --2- 172.21.15.138:0/1769284161 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0304003bc0 0x7f0304003fc0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f031000c4c0 tx=0x7f031001cc00 comp rx=0 tx=0).stop 2024-04-26T20:58:11.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.496+0000 7f0326e00640 1 -- 172.21.15.138:0/1769284161 shutdown_connections 2024-04-26T20:58:11.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.496+0000 7f0326e00640 1 --2- 172.21.15.138:0/1769284161 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0304003bc0 0x7f0304003fc0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:11.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.496+0000 7f0326e00640 1 -- 172.21.15.138:0/1769284161 >> 172.21.15.138:0/1769284161 conn(0x7f03200cdee0 msgr2=0x7f03200ce2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:11.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.496+0000 7f0326e00640 1 -- 172.21.15.138:0/1769284161 shutdown_connections 2024-04-26T20:58:11.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.496+0000 7f0326e00640 1 -- 172.21.15.138:0/1769284161 wait complete. 2024-04-26T20:58:11.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.496+0000 7f0326e00640 1 Processor -- start 2024-04-26T20:58:11.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.496+0000 7f0326e00640 1 -- start start 2024-04-26T20:58:11.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.496+0000 7f0326e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0304003bc0 0x7f032014eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:11.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.496+0000 7f0326e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f032015f720 0x7f03200b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:11.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.496+0000 7f0326e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f032015fba0 0x7f03200b52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:11.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.496+0000 7f0326e00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f032015f3c0 con 0x7f032015fba0 2024-04-26T20:58:11.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.496+0000 7f0326e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f0320163630 con 0x7f032015f720 2024-04-26T20:58:11.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.496+0000 7f0326e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f032015f540 con 0x7f0304003bc0 2024-04-26T20:58:11.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.500+0000 7f0324e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f032015fba0 0x7f03200b52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:11.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.500+0000 7f0324e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f032015fba0 0x7f03200b52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:59272/0 (socket says 172.21.15.138:59272) 2024-04-26T20:58:11.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.500+0000 7f0324e00640 1 -- 172.21.15.138:0/1702177195 learned_addr learned my addr 172.21.15.138:0/1702177195 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:11.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.500+0000 7f031fe00640 1 --2- 172.21.15.138:0/1702177195 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0304003bc0 0x7f032014eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:11.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.500+0000 7f0317400640 1 --2- 172.21.15.138:0/1702177195 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f032015f720 0x7f03200b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:11.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.500+0000 7f0324e00640 1 -- 172.21.15.138:0/1702177195 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0304003bc0 msgr2=0x7f032014eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:11.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.500+0000 7f0324e00640 1 --2- 172.21.15.138:0/1702177195 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0304003bc0 0x7f032014eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:11.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.500+0000 7f0324e00640 1 -- 172.21.15.138:0/1702177195 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f032015f720 msgr2=0x7f03200b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:11.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.500+0000 7f0324e00640 1 --2- 172.21.15.138:0/1702177195 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f032015f720 0x7f03200b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:11.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.500+0000 7f0324e00640 1 -- 172.21.15.138:0/1702177195 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0320160170 con 0x7f032015fba0 2024-04-26T20:58:11.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.500+0000 7f0324e00640 1 --2- 172.21.15.138:0/1702177195 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f032015fba0 0x7f03200b52b0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f03200d1150 tx=0x7f031800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:11.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.500+0000 7f031cc00640 1 -- 172.21.15.138:0/1702177195 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f031800fdc0 con 0x7f032015fba0 2024-04-26T20:58:11.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.500+0000 7f031cc00640 1 -- 172.21.15.138:0/1702177195 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03180039a0 con 0x7f032015fba0 2024-04-26T20:58:11.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.500+0000 7f0326e00640 1 -- 172.21.15.138:0/1702177195 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0320160450 con 0x7f032015fba0 2024-04-26T20:58:11.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.500+0000 7f031cc00640 1 -- 172.21.15.138:0/1702177195 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0318003d90 con 0x7f032015fba0 2024-04-26T20:58:11.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.500+0000 7f0326e00640 1 -- 172.21.15.138:0/1702177195 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03201611e0 con 0x7f032015fba0 2024-04-26T20:58:11.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.500+0000 7f0326e00640 1 -- 172.21.15.138:0/1702177195 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03201613e0 con 0x7f032015fba0 2024-04-26T20:58:11.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.500+0000 7f031cc00640 1 -- 172.21.15.138:0/1702177195 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f031801f030 con 0x7f032015fba0 2024-04-26T20:58:11.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.504+0000 7f031cc00640 1 --2- 172.21.15.138:0/1702177195 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f02fc0683b0 0x7f02fc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:11.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.504+0000 7f031cc00640 1 -- 172.21.15.138:0/1702177195 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6640+0+0 (secure 0 0 0) 0x7f0318087330 con 0x7f032015fba0 2024-04-26T20:58:11.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.504+0000 7f031fe00640 1 --2- 172.21.15.138:0/1702177195 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f02fc0683b0 0x7f02fc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:11.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.504+0000 7f031fe00640 1 --2- 172.21.15.138:0/1702177195 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f02fc0683b0 0x7f02fc06a870 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f03100aa000 tx=0x7f0320163b10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:11.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.508+0000 7f031cc00640 1 -- 172.21.15.138:0/1702177195 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f03201613e0 con 0x7f032015fba0 2024-04-26T20:58:11.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:11.704+0000 7f0326e00640 1 -- 172.21.15.138:0/1702177195 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "recovery_fs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f0320069430 con 0x7f032015fba0 2024-04-26T20:58:12.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.668+0000 7f031cc00640 1 -- 172.21.15.138:0/1702177195 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "recovery_fs", "var": "standby_count_wanted", "val": "0"}]=0 v22) ==== 123+0+0 (secure 0 0 0) 0x7f0318026020 con 0x7f032015fba0 2024-04-26T20:58:12.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.668+0000 7f0326e00640 1 -- 172.21.15.138:0/1702177195 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f02fc0683b0 msgr2=0x7f02fc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:12.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.668+0000 7f0326e00640 1 --2- 172.21.15.138:0/1702177195 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f02fc0683b0 0x7f02fc06a870 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f03100aa000 tx=0x7f0320163b10 comp rx=0 tx=0).stop 2024-04-26T20:58:12.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.668+0000 7f0326e00640 1 -- 172.21.15.138:0/1702177195 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f032015fba0 msgr2=0x7f03200b52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:12.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.668+0000 7f0326e00640 1 --2- 172.21.15.138:0/1702177195 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f032015fba0 0x7f03200b52b0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f03200d1150 tx=0x7f031800f580 comp rx=0 tx=0).stop 2024-04-26T20:58:12.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.668+0000 7f0326e00640 1 -- 172.21.15.138:0/1702177195 shutdown_connections 2024-04-26T20:58:12.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.668+0000 7f0326e00640 1 --2- 172.21.15.138:0/1702177195 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f02fc0683b0 0x7f02fc06a870 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:12.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.668+0000 7f0326e00640 1 --2- 172.21.15.138:0/1702177195 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f032015fba0 0x7f03200b52b0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:12.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.668+0000 7f0326e00640 1 --2- 172.21.15.138:0/1702177195 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f032015f720 0x7f03200b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:12.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.668+0000 7f0326e00640 1 --2- 172.21.15.138:0/1702177195 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0304003bc0 0x7f032014eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:12.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.668+0000 7f0326e00640 1 -- 172.21.15.138:0/1702177195 >> 172.21.15.138:0/1702177195 conn(0x7f03200cdee0 msgr2=0x7f03200b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:12.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.668+0000 7f0326e00640 1 -- 172.21.15.138:0/1702177195 shutdown_connections 2024-04-26T20:58:12.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.668+0000 7f0326e00640 1 -- 172.21.15.138:0/1702177195 wait complete. 2024-04-26T20:58:12.694 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-26T20:58:12.694 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set recovery_fs allow_standby_replay false 2024-04-26T20:58:12.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.832+0000 7f02de000640 1 Processor -- start 2024-04-26T20:58:12.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.832+0000 7f02de000640 1 -- start start 2024-04-26T20:58:12.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.832+0000 7f02de000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f02d8073d70 0x7f02d8160040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:12.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.832+0000 7f02de000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f02d806f880 0x7f02d80ce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:12.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.832+0000 7f02de000640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02d806dee0 con 0x7f02d815bdc0 2024-04-26T20:58:12.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.832+0000 7f02de000640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f02d815c1a0 con 0x7f02d8073d70 2024-04-26T20:58:12.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.832+0000 7f02de000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f02d806e180 con 0x7f02d806f880 2024-04-26T20:58:12.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.832+0000 7f02cfe00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f02d8073d70 0x7f02d8160040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:12.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.832+0000 7f02cfe00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f02d8073d70 0x7f02d8160040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:59276/0 (socket says 172.21.15.138:59276) 2024-04-26T20:58:12.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.832+0000 7f02cfe00640 1 -- 172.21.15.138:0/872248563 learned_addr learned my addr 172.21.15.138:0/872248563 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:12.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.832+0000 7f02d7e00640 1 --2- 172.21.15.138:0/872248563 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f02d806f880 0x7f02d80ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:12.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.832+0000 7f02cfe00640 1 -- 172.21.15.138:0/872248563 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f02d806f880 msgr2=0x7f02d80ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:12.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.832+0000 7f02cfe00640 1 --2- 172.21.15.138:0/872248563 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f02d806f880 0x7f02d80ce780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:12.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.832+0000 7f02cfe00640 1 -- 172.21.15.138:0/872248563 >> v1:172.21.15.143:6789/0 conn(0x7f02d815bdc0 legacy=0x7f02d815f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:12.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.832+0000 7f02cfe00640 1 -- 172.21.15.138:0/872248563 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02d806e460 con 0x7f02d8073d70 2024-04-26T20:58:12.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.836+0000 7f02cfe00640 1 --2- 172.21.15.138:0/872248563 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02d8073d70 0x7f02d8160040 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f02c0009870 tx=0x7f02c001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d7b95b5235741fd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:12.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.836+0000 7f02d6a00640 1 -- 172.21.15.138:0/872248563 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c00b1070 con 0x7f02d8073d70 2024-04-26T20:58:12.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.836+0000 7f02d6a00640 1 -- 172.21.15.138:0/872248563 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02c00ac620 con 0x7f02d8073d70 2024-04-26T20:58:12.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.836+0000 7f02d6a00640 1 -- 172.21.15.138:0/872248563 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c00ac9f0 con 0x7f02d8073d70 2024-04-26T20:58:12.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.836+0000 7f02de000640 1 -- 172.21.15.138:0/872248563 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02d8073d70 msgr2=0x7f02d8160040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:12.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.836+0000 7f02de000640 1 --2- 172.21.15.138:0/872248563 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02d8073d70 0x7f02d8160040 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f02c0009870 tx=0x7f02c001c4d0 comp rx=0 tx=0).stop 2024-04-26T20:58:12.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.836+0000 7f02de000640 1 -- 172.21.15.138:0/872248563 shutdown_connections 2024-04-26T20:58:12.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.836+0000 7f02de000640 1 --2- 172.21.15.138:0/872248563 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f02d806f880 0x7f02d80ce780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:12.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.836+0000 7f02de000640 1 --2- 172.21.15.138:0/872248563 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02d8073d70 0x7f02d8160040 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:12.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.836+0000 7f02de000640 1 -- 172.21.15.138:0/872248563 >> 172.21.15.138:0/872248563 conn(0x7f02d80d0bb0 msgr2=0x7f02d80d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:12.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.836+0000 7f02de000640 1 -- 172.21.15.138:0/872248563 shutdown_connections 2024-04-26T20:58:12.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.836+0000 7f02de000640 1 -- 172.21.15.138:0/872248563 wait complete. 2024-04-26T20:58:12.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.840+0000 7f02de000640 1 Processor -- start 2024-04-26T20:58:12.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.840+0000 7f02de000640 1 -- start start 2024-04-26T20:58:12.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.840+0000 7f02de000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02d806f880 0x7f02d81448e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:12.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.840+0000 7f02de000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02d8073d70 0x7f02d80c9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:12.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.840+0000 7f02de000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f02d815bdc0 0x7f02d80c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:12.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.840+0000 7f02de000640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f02d8168e50 con 0x7f02d8073d70 2024-04-26T20:58:12.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.840+0000 7f02de000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f02d8168cd0 con 0x7f02d806f880 2024-04-26T20:58:12.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.840+0000 7f02de000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f02d8168fd0 con 0x7f02d815bdc0 2024-04-26T20:58:12.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.840+0000 7f02cfe00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02d8073d70 0x7f02d80c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:12.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.840+0000 7f02d7400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02d806f880 0x7f02d81448e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:12.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.840+0000 7f02cfe00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02d8073d70 0x7f02d80c9770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:59290/0 (socket says 172.21.15.138:59290) 2024-04-26T20:58:12.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.840+0000 7f02cfe00640 1 -- 172.21.15.138:0/3702614899 learned_addr learned my addr 172.21.15.138:0/3702614899 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:12.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.840+0000 7f02d7e00640 1 --2- 172.21.15.138:0/3702614899 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f02d815bdc0 0x7f02d80c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:12.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.840+0000 7f02cfe00640 1 -- 172.21.15.138:0/3702614899 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f02d815bdc0 msgr2=0x7f02d80c9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:12.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.840+0000 7f02cfe00640 1 --2- 172.21.15.138:0/3702614899 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f02d815bdc0 0x7f02d80c9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:12.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.840+0000 7f02cfe00640 1 -- 172.21.15.138:0/3702614899 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02d806f880 msgr2=0x7f02d81448e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:12.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.840+0000 7f02cfe00640 1 --2- 172.21.15.138:0/3702614899 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02d806f880 0x7f02d81448e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:12.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.840+0000 7f02cfe00640 1 -- 172.21.15.138:0/3702614899 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02d8166650 con 0x7f02d8073d70 2024-04-26T20:58:12.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.840+0000 7f02cfe00640 1 --2- 172.21.15.138:0/3702614899 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02d8073d70 0x7f02d80c9770 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f02c00af040 tx=0x7f02c0019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:12.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.840+0000 7f02cf400640 1 -- 172.21.15.138:0/3702614899 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c00b1040 con 0x7f02d8073d70 2024-04-26T20:58:12.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.840+0000 7f02cf400640 1 -- 172.21.15.138:0/3702614899 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02c00ac420 con 0x7f02d8073d70 2024-04-26T20:58:12.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.840+0000 7f02de000640 1 -- 172.21.15.138:0/3702614899 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02d8166930 con 0x7f02d8073d70 2024-04-26T20:58:12.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.840+0000 7f02cf400640 1 -- 172.21.15.138:0/3702614899 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c00b5680 con 0x7f02d8073d70 2024-04-26T20:58:12.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.840+0000 7f02de000640 1 -- 172.21.15.138:0/3702614899 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02d8155f30 con 0x7f02d8073d70 2024-04-26T20:58:12.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.840+0000 7f02de000640 1 -- 172.21.15.138:0/3702614899 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02d8155a40 con 0x7f02d8073d70 2024-04-26T20:58:12.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.844+0000 7f02cf400640 1 -- 172.21.15.138:0/3702614899 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f02c00bc020 con 0x7f02d8073d70 2024-04-26T20:58:12.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.844+0000 7f02cf400640 1 --2- 172.21.15.138:0/3702614899 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f02b4068380 0x7f02b406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:12.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.844+0000 7f02cf400640 1 -- 172.21.15.138:0/3702614899 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6640+0+0 (secure 0 0 0) 0x7f02c01200e0 con 0x7f02d8073d70 2024-04-26T20:58:12.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.844+0000 7f02d7400640 1 --2- 172.21.15.138:0/3702614899 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f02b4068380 0x7f02b406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:12.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.844+0000 7f02d7400640 1 --2- 172.21.15.138:0/3702614899 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f02b4068380 0x7f02b406a840 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f02c8007fd0 tx=0x7f02c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:12.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:12.848+0000 7f02cf400640 1 -- 172.21.15.138:0/3702614899 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f02c00c3020 con 0x7f02d8073d70 2024-04-26T20:58:13.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.040+0000 7f02de000640 1 -- 172.21.15.138:0/3702614899 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "recovery_fs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f02d8069430 con 0x7f02d8073d70 2024-04-26T20:58:13.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.680+0000 7f02cf400640 1 -- 172.21.15.138:0/3702614899 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "recovery_fs", "var": "allow_standby_replay", "val": "false"}]=0 v23) ==== 127+0+0 (secure 0 0 0) 0x7f02c0016150 con 0x7f02d8073d70 2024-04-26T20:58:13.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.684+0000 7f02de000640 1 -- 172.21.15.138:0/3702614899 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f02b4068380 msgr2=0x7f02b406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:13.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.684+0000 7f02de000640 1 --2- 172.21.15.138:0/3702614899 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f02b4068380 0x7f02b406a840 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f02c8007fd0 tx=0x7f02c8009040 comp rx=0 tx=0).stop 2024-04-26T20:58:13.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.684+0000 7f02de000640 1 -- 172.21.15.138:0/3702614899 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02d8073d70 msgr2=0x7f02d80c9770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:13.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.684+0000 7f02de000640 1 --2- 172.21.15.138:0/3702614899 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02d8073d70 0x7f02d80c9770 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f02c00af040 tx=0x7f02c0019270 comp rx=0 tx=0).stop 2024-04-26T20:58:13.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.684+0000 7f02de000640 1 -- 172.21.15.138:0/3702614899 shutdown_connections 2024-04-26T20:58:13.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.684+0000 7f02de000640 1 --2- 172.21.15.138:0/3702614899 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f02b4068380 0x7f02b406a840 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:13.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.684+0000 7f02de000640 1 --2- 172.21.15.138:0/3702614899 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f02d815bdc0 0x7f02d80c9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:13.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.684+0000 7f02de000640 1 --2- 172.21.15.138:0/3702614899 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02d8073d70 0x7f02d80c9770 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:13.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.684+0000 7f02de000640 1 --2- 172.21.15.138:0/3702614899 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02d806f880 0x7f02d81448e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:13.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.684+0000 7f02de000640 1 -- 172.21.15.138:0/3702614899 >> 172.21.15.138:0/3702614899 conn(0x7f02d80d0bb0 msgr2=0x7f02d80ca670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:13.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.684+0000 7f02de000640 1 -- 172.21.15.138:0/3702614899 shutdown_connections 2024-04-26T20:58:13.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.684+0000 7f02de000640 1 -- 172.21.15.138:0/3702614899 wait complete. 2024-04-26T20:58:13.706 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'recovery_fs' 2024-04-26T20:58:13.706 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:58:13.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.840+0000 7f0cd6a00640 1 Processor -- start 2024-04-26T20:58:13.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.840+0000 7f0cd6a00640 1 -- start start 2024-04-26T20:58:13.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.844+0000 7f0cd6a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0cd015cf80 0x7f0cd0073b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:13.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.844+0000 7f0cd6a00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f0cd00cc1e0 0x7f0cd00ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:13.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.844+0000 7f0cd6a00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cd00727f0 con 0x7f0cd00cbe00 2024-04-26T20:58:13.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.844+0000 7f0cd6a00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f0cd0073680 con 0x7f0cd00cc1e0 2024-04-26T20:58:13.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.844+0000 7f0cd6a00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f0cd0072a70 con 0x7f0cd015cf80 2024-04-26T20:58:13.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.844+0000 7f0ccfe00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f0cd00cbe00 0x7f0cd006de70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:60966/0 (socket says 172.21.15.138:60966) 2024-04-26T20:58:13.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.844+0000 7f0ccfe00640 1 -- 172.21.15.138:0/3026298635 learned_addr learned my addr 172.21.15.138:0/3026298635 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:13.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.844+0000 7f0cd4a00640 1 --2- 172.21.15.138:0/3026298635 >> v2:172.21.15.138:3300/0 conn(0x7f0cd00cc1e0 0x7f0cd00ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:13.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.844+0000 7f0cc7400640 1 --2- 172.21.15.138:0/3026298635 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0cd015cf80 0x7f0cd0073b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:13.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.844+0000 7f0cd4a00640 1 -- 172.21.15.138:0/3026298635 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0cd015cf80 msgr2=0x7f0cd0073b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:13.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.844+0000 7f0cd4a00640 1 --2- 172.21.15.138:0/3026298635 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0cd015cf80 0x7f0cd0073b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:13.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.844+0000 7f0cd4a00640 1 -- 172.21.15.138:0/3026298635 >> v1:172.21.15.138:6789/0 conn(0x7f0cd00cbe00 legacy=0x7f0cd006de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:13.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.844+0000 7f0ccf400640 1 -- 172.21.15.138:0/3026298635 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2979103556 0 0) 0x7f0cc00014a0 con 0x7f0cd00cbe00 2024-04-26T20:58:13.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.844+0000 7f0cd4a00640 1 -- 172.21.15.138:0/3026298635 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cd0072d50 con 0x7f0cd00cc1e0 2024-04-26T20:58:13.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.848+0000 7f0cd4a00640 1 --2- 172.21.15.138:0/3026298635 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0cd00cc1e0 0x7f0cd00ce6f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f0cc80097c0 tx=0x7f0cc801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=911dcc81b245c254 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:13.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.848+0000 7f0ccf400640 1 -- 172.21.15.138:0/3026298635 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc80b0070 con 0x7f0cd00cc1e0 2024-04-26T20:58:13.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.848+0000 7f0ccf400640 1 -- 172.21.15.138:0/3026298635 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cc80ab600 con 0x7f0cd00cc1e0 2024-04-26T20:58:13.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.848+0000 7f0ccf400640 1 -- 172.21.15.138:0/3026298635 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc80ab9d0 con 0x7f0cd00cc1e0 2024-04-26T20:58:13.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.848+0000 7f0cd6a00640 1 -- 172.21.15.138:0/3026298635 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0cd00cc1e0 msgr2=0x7f0cd00ce6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:13.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.848+0000 7f0cd6a00640 1 --2- 172.21.15.138:0/3026298635 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0cd00cc1e0 0x7f0cd00ce6f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f0cc80097c0 tx=0x7f0cc801c4a0 comp rx=0 tx=0).stop 2024-04-26T20:58:13.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.848+0000 7f0cd6a00640 1 -- 172.21.15.138:0/3026298635 shutdown_connections 2024-04-26T20:58:13.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.848+0000 7f0cd6a00640 1 --2- 172.21.15.138:0/3026298635 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0cd00cc1e0 0x7f0cd00ce6f0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:13.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.848+0000 7f0cd6a00640 1 --2- 172.21.15.138:0/3026298635 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0cd015cf80 0x7f0cd0073b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:13.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.848+0000 7f0cd6a00640 1 -- 172.21.15.138:0/3026298635 >> 172.21.15.138:0/3026298635 conn(0x7f0cd00d0b20 msgr2=0x7f0cd00d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:13.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.848+0000 7f0cd6a00640 1 -- 172.21.15.138:0/3026298635 shutdown_connections 2024-04-26T20:58:13.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.848+0000 7f0cd6a00640 1 -- 172.21.15.138:0/3026298635 wait complete. 2024-04-26T20:58:13.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.848+0000 7f0cd6a00640 1 Processor -- start 2024-04-26T20:58:13.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.848+0000 7f0cd6a00640 1 -- start start 2024-04-26T20:58:13.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.848+0000 7f0cd6a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0cd00cbe00 0x7f0cd00ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:13.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.848+0000 7f0cd6a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0cd00cc1e0 0x7f0cd014b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:13.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.848+0000 7f0cd6a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0cd015cf80 0x7f0cd00c7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:13.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.848+0000 7f0cd6a00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd00741d0 con 0x7f0cd00cc1e0 2024-04-26T20:58:13.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.848+0000 7f0cd6a00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd0074050 con 0x7f0cd015cf80 2024-04-26T20:58:13.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.848+0000 7f0cd6a00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f0cd00d0780 con 0x7f0cd00cbe00 2024-04-26T20:58:13.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.852+0000 7f0cc7400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0cd00cc1e0 0x7f0cd014b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:13.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.852+0000 7f0cc7400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0cd00cc1e0 0x7f0cd014b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:54148/0 (socket says 172.21.15.138:54148) 2024-04-26T20:58:13.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.852+0000 7f0cc7400640 1 -- 172.21.15.138:0/54752837 learned_addr learned my addr 172.21.15.138:0/54752837 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:13.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.852+0000 7f0ccfe00640 1 --2- 172.21.15.138:0/54752837 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0cd00cbe00 0x7f0cd00ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:13.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.852+0000 7f0cd4a00640 1 --2- 172.21.15.138:0/54752837 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0cd015cf80 0x7f0cd00c7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:13.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.852+0000 7f0cc7400640 1 -- 172.21.15.138:0/54752837 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0cd00cbe00 msgr2=0x7f0cd00ca6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:13.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.852+0000 7f0cc7400640 1 --2- 172.21.15.138:0/54752837 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0cd00cbe00 0x7f0cd00ca6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:13.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.852+0000 7f0cc7400640 1 -- 172.21.15.138:0/54752837 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0cd015cf80 msgr2=0x7f0cd00c7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:13.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.852+0000 7f0cc7400640 1 --2- 172.21.15.138:0/54752837 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0cd015cf80 0x7f0cd00c7bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:13.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.852+0000 7f0cc7400640 1 -- 172.21.15.138:0/54752837 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cd00cac10 con 0x7f0cd00cc1e0 2024-04-26T20:58:13.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.852+0000 7f0ccfe00640 1 --2- 172.21.15.138:0/54752837 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0cd00cbe00 0x7f0cd00ca6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:58:13.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.852+0000 7f0cd4a00640 1 --2- 172.21.15.138:0/54752837 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0cd015cf80 0x7f0cd00c7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:58:13.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.852+0000 7f0cc7400640 1 --2- 172.21.15.138:0/54752837 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0cd00cc1e0 0x7f0cd014b8e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f0cb800e960 tx=0x7f0cb800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:13.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.852+0000 7f0cccc00640 1 -- 172.21.15.138:0/54752837 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb8017070 con 0x7f0cd00cc1e0 2024-04-26T20:58:13.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.852+0000 7f0cccc00640 1 -- 172.21.15.138:0/54752837 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cb800ca00 con 0x7f0cd00cc1e0 2024-04-26T20:58:13.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.852+0000 7f0cd6a00640 1 -- 172.21.15.138:0/54752837 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cd00c8c20 con 0x7f0cd00cc1e0 2024-04-26T20:58:13.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.852+0000 7f0cccc00640 1 -- 172.21.15.138:0/54752837 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb800cdb0 con 0x7f0cd00cc1e0 2024-04-26T20:58:13.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.852+0000 7f0cd6a00640 1 -- 172.21.15.138:0/54752837 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cd0150580 con 0x7f0cd00cc1e0 2024-04-26T20:58:13.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.852+0000 7f0cd6a00640 1 -- 172.21.15.138:0/54752837 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cd0069510 con 0x7f0cd00cc1e0 2024-04-26T20:58:13.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.852+0000 7f0cccc00640 1 -- 172.21.15.138:0/54752837 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0cb801a070 con 0x7f0cd00cc1e0 2024-04-26T20:58:13.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.852+0000 7f0cccc00640 1 --2- 172.21.15.138:0/54752837 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0cac068380 0x7f0cac06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:13.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.856+0000 7f0cccc00640 1 -- 172.21.15.138:0/54752837 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6640+0+0 (secure 0 0 0) 0x7f0cb8086dc0 con 0x7f0cd00cc1e0 2024-04-26T20:58:13.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.856+0000 7f0ccfe00640 1 --2- 172.21.15.138:0/54752837 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0cac068380 0x7f0cac06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:13.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.856+0000 7f0ccfe00640 1 --2- 172.21.15.138:0/54752837 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0cac068380 0x7f0cac06a840 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0007fd0 tx=0x7f0cc0005b80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:13.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:13.860+0000 7f0cccc00640 1 -- 172.21.15.138:0/54752837 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0cb8056f60 con 0x7f0cd00cc1e0 2024-04-26T20:58:13.967 INFO:tasks.ceph.mon.a.smithi138.stderr:2024-04-26T20:58:13.964+0000 7f20e1600640 -1 log_channel(cluster) log [ERR] : Health check update: 2 filesystems are offline (MDS_ALL_DOWN) 2024-04-26T20:58:14.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.048+0000 7f0cd6a00640 1 -- 172.21.15.138:0/54752837 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0cd0157250 con 0x7f0cd00cc1e0 2024-04-26T20:58:14.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.048+0000 7f0cccc00640 1 -- 172.21.15.138:0/54752837 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+6474 (secure 0 0 0) 0x7f0cb8056860 con 0x7f0cd00cc1e0 2024-04-26T20:58:14.050 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:14.050 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":23,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5048,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/255610168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":255610168},{"type":"v1","addr":"172.21.15.143:6836","nonce":255610168}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5051,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/799063831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":799063831},{"type":"v1","addr":"172.21.15.143:6837","nonce":799063831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5410,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/976248149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":976248149},{"type":"v1","addr":"172.21.15.138:6835","nonce":976248149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/2450256246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2450256246},{"type":"v1","addr":"172.21.15.138:6834","nonce":2450256246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:57:51.937789+0000","modified":"2024-04-26T20:58:07.183899+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":42,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2},{"mdsmap":{"epoch":23,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:58:10.360154+0000","modified":"2024-04-26T20:58:13.044102+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":7,"enabled":true,"fs_name":"recovery_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":3}]} 2024-04-26T20:58:14.050 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 23 2024-04-26T20:58:14.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.052+0000 7f0cd6a00640 1 -- 172.21.15.138:0/54752837 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0cac068380 msgr2=0x7f0cac06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:14.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.052+0000 7f0cd6a00640 1 --2- 172.21.15.138:0/54752837 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0cac068380 0x7f0cac06a840 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0007fd0 tx=0x7f0cc0005b80 comp rx=0 tx=0).stop 2024-04-26T20:58:14.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.052+0000 7f0cd6a00640 1 -- 172.21.15.138:0/54752837 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0cd00cc1e0 msgr2=0x7f0cd014b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:14.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.052+0000 7f0cd6a00640 1 --2- 172.21.15.138:0/54752837 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0cd00cc1e0 0x7f0cd014b8e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f0cb800e960 tx=0x7f0cb800ee20 comp rx=0 tx=0).stop 2024-04-26T20:58:14.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.052+0000 7f0cd6a00640 1 -- 172.21.15.138:0/54752837 shutdown_connections 2024-04-26T20:58:14.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.052+0000 7f0cd6a00640 1 --2- 172.21.15.138:0/54752837 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0cac068380 0x7f0cac06a840 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:14.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.052+0000 7f0cd6a00640 1 --2- 172.21.15.138:0/54752837 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0cd015cf80 0x7f0cd00c7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:14.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.052+0000 7f0cd6a00640 1 --2- 172.21.15.138:0/54752837 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0cd00cc1e0 0x7f0cd014b8e0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:14.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.052+0000 7f0cd6a00640 1 --2- 172.21.15.138:0/54752837 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0cd00cbe00 0x7f0cd00ca6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:14.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.052+0000 7f0cd6a00640 1 -- 172.21.15.138:0/54752837 >> 172.21.15.138:0/54752837 conn(0x7f0cd00d0b20 msgr2=0x7f0cd006e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:14.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.052+0000 7f0cd6a00640 1 -- 172.21.15.138:0/54752837 shutdown_connections 2024-04-26T20:58:14.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.052+0000 7f0cd6a00640 1 -- 172.21.15.138:0/54752837 wait complete. 2024-04-26T20:58:14.071 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:58:14.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.204+0000 7fbe37e00640 1 Processor -- start 2024-04-26T20:58:14.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.204+0000 7fbe37e00640 1 -- start start 2024-04-26T20:58:14.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.208+0000 7fbe37e00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fbe380d0040 0x7fbe38169f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:14.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.208+0000 7fbe37e00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe3806d660 con 0x7fbe3806e420 2024-04-26T20:58:14.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.208+0000 7fbe37e00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe3806d940 con 0x7fbe3815f190 2024-04-26T20:58:14.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.208+0000 7fbe37e00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fbe380d0450 con 0x7fbe380d0040 2024-04-26T20:58:14.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.208+0000 7fbe36000640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fbe3806e420 0x7fbe38163330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:60974/0 (socket says 172.21.15.138:60974) 2024-04-26T20:58:14.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.208+0000 7fbe36000640 1 -- 172.21.15.138:0/2070566183 learned_addr learned my addr 172.21.15.138:0/2070566183 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:14.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.208+0000 7fbe37400640 1 --2- 172.21.15.138:0/2070566183 >> v2:172.21.15.143:3300/0 conn(0x7fbe380d0040 0x7fbe38169f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:14.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.208+0000 7fbe35600640 1 -- 172.21.15.138:0/2070566183 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1866463614 0 0) 0x7fbe3806d660 con 0x7fbe3806e420 2024-04-26T20:58:14.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.208+0000 7fbe35600640 1 -- 172.21.15.138:0/2070566183 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe1c003530 con 0x7fbe3806e420 2024-04-26T20:58:14.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.208+0000 7fbe35600640 1 -- 172.21.15.138:0/2070566183 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3801478796 0 0) 0x7fbe3806d940 con 0x7fbe3815f190 2024-04-26T20:58:14.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.208+0000 7fbe35600640 1 -- 172.21.15.138:0/2070566183 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe3806d660 con 0x7fbe3815f190 2024-04-26T20:58:14.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.208+0000 7fbe37400640 1 -- 172.21.15.138:0/2070566183 >> v1:172.21.15.143:6789/0 conn(0x7fbe3815f190 legacy=0x7fbe38162c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:14.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.208+0000 7fbe37400640 1 -- 172.21.15.138:0/2070566183 >> v1:172.21.15.138:6789/0 conn(0x7fbe3806e420 legacy=0x7fbe38163330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:14.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.208+0000 7fbe37400640 1 -- 172.21.15.138:0/2070566183 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe3806dc20 con 0x7fbe380d0040 2024-04-26T20:58:14.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.212+0000 7fbe37400640 1 --2- 172.21.15.138:0/2070566183 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbe380d0040 0x7fbe38169f50 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbe30009d90 tx=0x7fbe3001c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba6f371b4d5bcce0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:14.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.212+0000 7fbe35600640 1 -- 172.21.15.138:0/2070566183 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe300b2070 con 0x7fbe380d0040 2024-04-26T20:58:14.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.212+0000 7fbe35600640 1 -- 172.21.15.138:0/2070566183 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe300a57a0 con 0x7fbe380d0040 2024-04-26T20:58:14.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.212+0000 7fbe35600640 1 -- 172.21.15.138:0/2070566183 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe300a5b70 con 0x7fbe380d0040 2024-04-26T20:58:14.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.212+0000 7fbe37e00640 1 -- 172.21.15.138:0/2070566183 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbe380d0040 msgr2=0x7fbe38169f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:14.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.212+0000 7fbe37e00640 1 --2- 172.21.15.138:0/2070566183 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbe380d0040 0x7fbe38169f50 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbe30009d90 tx=0x7fbe3001c8e0 comp rx=0 tx=0).stop 2024-04-26T20:58:14.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.212+0000 7fbe37e00640 1 -- 172.21.15.138:0/2070566183 shutdown_connections 2024-04-26T20:58:14.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.212+0000 7fbe37e00640 1 --2- 172.21.15.138:0/2070566183 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbe380d0040 0x7fbe38169f50 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:14.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.212+0000 7fbe37e00640 1 -- 172.21.15.138:0/2070566183 >> 172.21.15.138:0/2070566183 conn(0x7fbe380d2c40 msgr2=0x7fbe380d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:14.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.212+0000 7fbe37e00640 1 -- 172.21.15.138:0/2070566183 shutdown_connections 2024-04-26T20:58:14.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.212+0000 7fbe37e00640 1 -- 172.21.15.138:0/2070566183 wait complete. 2024-04-26T20:58:14.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.212+0000 7fbe37e00640 1 Processor -- start 2024-04-26T20:58:14.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.212+0000 7fbe37e00640 1 -- start start 2024-04-26T20:58:14.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.216+0000 7fbe37e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbe3806e420 0x7fbe380c6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:14.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.216+0000 7fbe37e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbe380d0040 0x7fbe380b1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:14.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.216+0000 7fbe37e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbe3815f190 0x7fbe3814d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:14.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.216+0000 7fbe37e00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fbe38160580 con 0x7fbe3806e420 2024-04-26T20:58:14.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.216+0000 7fbe37e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fbe3806d410 con 0x7fbe380d0040 2024-04-26T20:58:14.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.216+0000 7fbe37e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fbe3816cec0 con 0x7fbe3815f190 2024-04-26T20:58:14.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.216+0000 7fbe36a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbe3806e420 0x7fbe380c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:14.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.216+0000 7fbe36a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbe3806e420 0x7fbe380c6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:54158/0 (socket says 172.21.15.138:54158) 2024-04-26T20:58:14.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.216+0000 7fbe36a00640 1 -- 172.21.15.138:0/1142748717 learned_addr learned my addr 172.21.15.138:0/1142748717 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:14.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.216+0000 7fbe36a00640 1 -- 172.21.15.138:0/1142748717 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbe3815f190 msgr2=0x7fbe3814d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:14.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.216+0000 7fbe36a00640 1 --2- 172.21.15.138:0/1142748717 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbe3815f190 0x7fbe3814d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:14.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.216+0000 7fbe36a00640 1 -- 172.21.15.138:0/1142748717 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbe380d0040 msgr2=0x7fbe380b1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:14.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.216+0000 7fbe36a00640 1 --2- 172.21.15.138:0/1142748717 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbe380d0040 0x7fbe380b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:14.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.216+0000 7fbe36a00640 1 -- 172.21.15.138:0/1142748717 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe380c6d10 con 0x7fbe3806e420 2024-04-26T20:58:14.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.216+0000 7fbe36a00640 1 --2- 172.21.15.138:0/1142748717 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbe3806e420 0x7fbe380c6730 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fbe2800c460 tx=0x7fbe2800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:14.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.216+0000 7fbe2ea00640 1 -- 172.21.15.138:0/1142748717 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe28017070 con 0x7fbe3806e420 2024-04-26T20:58:14.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.216+0000 7fbe2ea00640 1 -- 172.21.15.138:0/1142748717 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe280052f0 con 0x7fbe3806e420 2024-04-26T20:58:14.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.216+0000 7fbe2ea00640 1 -- 172.21.15.138:0/1142748717 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe28003840 con 0x7fbe3806e420 2024-04-26T20:58:14.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.216+0000 7fbe37e00640 1 -- 172.21.15.138:0/1142748717 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe380c6ff0 con 0x7fbe3806e420 2024-04-26T20:58:14.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.216+0000 7fbe37e00640 1 -- 172.21.15.138:0/1142748717 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe380afc00 con 0x7fbe3806e420 2024-04-26T20:58:14.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.216+0000 7fbe37e00640 1 -- 172.21.15.138:0/1142748717 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe38069430 con 0x7fbe3806e420 2024-04-26T20:58:14.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.216+0000 7fbe2ea00640 1 -- 172.21.15.138:0/1142748717 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbe2801a070 con 0x7fbe3806e420 2024-04-26T20:58:14.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.220+0000 7fbe2ea00640 1 --2- 172.21.15.138:0/1142748717 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fbe18068380 0x7fbe1806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:14.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.220+0000 7fbe2ea00640 1 -- 172.21.15.138:0/1142748717 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6640+0+0 (secure 0 0 0) 0x7fbe28086190 con 0x7fbe3806e420 2024-04-26T20:58:14.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.220+0000 7fbe36000640 1 --2- 172.21.15.138:0/1142748717 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fbe18068380 0x7fbe1806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:14.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.220+0000 7fbe36000640 1 --2- 172.21.15.138:0/1142748717 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fbe18068380 0x7fbe1806a840 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fbe24007fd0 tx=0x7fbe24007940 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:14.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.224+0000 7fbe2ea00640 1 -- 172.21.15.138:0/1142748717 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fbe28056330 con 0x7fbe3806e420 2024-04-26T20:58:14.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.380+0000 7fbe37e00640 1 -- 172.21.15.138:0/1142748717 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbe380d3970 con 0x7fbe3806e420 2024-04-26T20:58:14.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.380+0000 7fbe2ea00640 1 -- 172.21.15.138:0/1142748717 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) ==== 74+0+19009 (secure 0 0 0) 0x7fbe28055c30 con 0x7fbe3806e420 2024-04-26T20:58:14.383 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:14.383 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":49,"fsid":"c22b4730-12cc-4558-8535-b965384398c0","created":"2024-04-26T20:56:14.182475+0000","modified":"2024-04-26T20:58:11.656532+0000","last_up_change":"2024-04-26T20:56:26.013243+0000","last_in_change":"2024-04-26T20:56:16.714055+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:56:27.265834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:57:49.597600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-26T20:57:50.901951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"recovery_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"recovery_fs_metadata","create_time":"2024-04-26T20:58:09.327192+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"recovery_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3f9a2e34-3199-466f-a6cf-57927318121e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6801","nonce":3534772245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6803","nonce":3534772245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6807","nonce":3534772245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6805","nonce":3534772245}]},"public_addr":"172.21.15.138:6801/3534772245","cluster_addr":"172.21.15.138:6803/3534772245","heartbeat_back_addr":"172.21.15.138:6807/3534772245","heartbeat_front_addr":"172.21.15.138:6805/3534772245","state":["exists","up"]},{"osd":1,"uuid":"e881fcf6-3248-4696-a2ef-95d206d77712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6817","nonce":1427635773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6819","nonce":1427635773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6823","nonce":1427635773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6821","nonce":1427635773}]},"public_addr":"172.21.15.138:6817/1427635773","cluster_addr":"172.21.15.138:6819/1427635773","heartbeat_back_addr":"172.21.15.138:6823/1427635773","heartbeat_front_addr":"172.21.15.138:6821/1427635773","state":["exists","up"]},{"osd":2,"uuid":"f7d1db33-7672-4699-ae47-9f1e0a8e4222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6809","nonce":4273721573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6811","nonce":4273721573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6815","nonce":4273721573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6813","nonce":4273721573}]},"public_addr":"172.21.15.138:6809/4273721573","cluster_addr":"172.21.15.138:6811/4273721573","heartbeat_back_addr":"172.21.15.138:6815/4273721573","heartbeat_front_addr":"172.21.15.138:6813/4273721573","state":["exists","up"]},{"osd":3,"uuid":"2f4e0a9a-b8f6-4468-844a-a4501cd85054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6825","nonce":3098242154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6827","nonce":3098242154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6831","nonce":3098242154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6829","nonce":3098242154}]},"public_addr":"172.21.15.138:6825/3098242154","cluster_addr":"172.21.15.138:6827/3098242154","heartbeat_back_addr":"172.21.15.138:6831/3098242154","heartbeat_front_addr":"172.21.15.138:6829/3098242154","state":["exists","up"]},{"osd":4,"uuid":"c85df99b-3624-410e-866b-86830af2cfe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6801","nonce":2942056312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6803","nonce":2942056312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6807","nonce":2942056312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6805","nonce":2942056312}]},"public_addr":"172.21.15.143:6801/2942056312","cluster_addr":"172.21.15.143:6803/2942056312","heartbeat_back_addr":"172.21.15.143:6807/2942056312","heartbeat_front_addr":"172.21.15.143:6805/2942056312","state":["exists","up"]},{"osd":5,"uuid":"9af1efb5-c416-4808-b5ef-de0679ab9705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6809","nonce":1910222887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6811","nonce":1910222887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6815","nonce":1910222887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6813","nonce":1910222887}]},"public_addr":"172.21.15.143:6809/1910222887","cluster_addr":"172.21.15.143:6811/1910222887","heartbeat_back_addr":"172.21.15.143:6815/1910222887","heartbeat_front_addr":"172.21.15.143:6813/1910222887","state":["exists","up"]},{"osd":6,"uuid":"d7138615-8838-45ff-9072-2fd0683362f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6817","nonce":1082239825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6819","nonce":1082239825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6823","nonce":1082239825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6821","nonce":1082239825}]},"public_addr":"172.21.15.143:6817/1082239825","cluster_addr":"172.21.15.143:6819/1082239825","heartbeat_back_addr":"172.21.15.143:6823/1082239825","heartbeat_front_addr":"172.21.15.143:6821/1082239825","state":["exists","up"]},{"osd":7,"uuid":"0c27172b-35c4-49ec-ba0b-0137b8ff0010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6825","nonce":3295508495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6827","nonce":3295508495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6831","nonce":3295508495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6829","nonce":3295508495}]},"public_addr":"172.21.15.143:6825/3295508495","cluster_addr":"172.21.15.143:6827/3295508495","heartbeat_back_addr":"172.21.15.143:6831/3295508495","heartbeat_front_addr":"172.21.15.143:6829/3295508495","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.326627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.396119+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.433915+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.414179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.216947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.329272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.503073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.436382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.143:6836/483370849":"2024-04-27T20:58:07.183664+0000","172.21.15.143:6834/483370849":"2024-04-27T20:58:07.183664+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:58:14.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.384+0000 7fbe37e00640 1 -- 172.21.15.138:0/1142748717 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fbe18068380 msgr2=0x7fbe1806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:14.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.384+0000 7fbe37e00640 1 --2- 172.21.15.138:0/1142748717 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fbe18068380 0x7fbe1806a840 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fbe24007fd0 tx=0x7fbe24007940 comp rx=0 tx=0).stop 2024-04-26T20:58:14.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.384+0000 7fbe37e00640 1 -- 172.21.15.138:0/1142748717 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbe3806e420 msgr2=0x7fbe380c6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:14.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.384+0000 7fbe37e00640 1 --2- 172.21.15.138:0/1142748717 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbe3806e420 0x7fbe380c6730 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fbe2800c460 tx=0x7fbe2800c920 comp rx=0 tx=0).stop 2024-04-26T20:58:14.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.384+0000 7fbe37e00640 1 -- 172.21.15.138:0/1142748717 shutdown_connections 2024-04-26T20:58:14.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.384+0000 7fbe37e00640 1 --2- 172.21.15.138:0/1142748717 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fbe18068380 0x7fbe1806a840 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:14.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.384+0000 7fbe37e00640 1 --2- 172.21.15.138:0/1142748717 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbe3815f190 0x7fbe3814d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:14.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.384+0000 7fbe37e00640 1 --2- 172.21.15.138:0/1142748717 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbe380d0040 0x7fbe380b1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:14.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.384+0000 7fbe37e00640 1 --2- 172.21.15.138:0/1142748717 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbe3806e420 0x7fbe380c6730 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:14.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.384+0000 7fbe37e00640 1 -- 172.21.15.138:0/1142748717 >> 172.21.15.138:0/1142748717 conn(0x7fbe380d2c40 msgr2=0x7fbe38160ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:14.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.384+0000 7fbe37e00640 1 -- 172.21.15.138:0/1142748717 shutdown_connections 2024-04-26T20:58:14.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.384+0000 7fbe37e00640 1 -- 172.21.15.138:0/1142748717 wait complete. 2024-04-26T20:58:14.404 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-26T20:58:14.404 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T20:58:14.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.540+0000 7f9e72400640 1 Processor -- start 2024-04-26T20:58:14.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.540+0000 7f9e72400640 1 -- start start 2024-04-26T20:58:14.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.540+0000 7f9e72400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e6c160530 0x7f9e6c06ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:14.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.540+0000 7f9e72400640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e6c070cf0 con 0x7f9e6c071340 2024-04-26T20:58:14.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.540+0000 7f9e72400640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e6c070fd0 con 0x7f9e6c0d3760 2024-04-26T20:58:14.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.540+0000 7f9e72400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f9e6c0d1220 con 0x7f9e6c160530 2024-04-26T20:58:14.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.540+0000 7f9e71a00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f9e6c071340 0x7f9e6c0b13d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:60982/0 (socket says 172.21.15.138:60982) 2024-04-26T20:58:14.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.540+0000 7f9e71a00640 1 -- 172.21.15.138:0/1448479174 learned_addr learned my addr 172.21.15.138:0/1448479174 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:14.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.540+0000 7f9e71000640 1 --2- 172.21.15.138:0/1448479174 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e6c160530 0x7f9e6c06ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:14.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.540+0000 7f9e6be00640 1 -- 172.21.15.138:0/1448479174 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1589305124 0 0) 0x7f9e6c070cf0 con 0x7f9e6c071340 2024-04-26T20:58:14.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.540+0000 7f9e6be00640 1 -- 172.21.15.138:0/1448479174 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e50003530 con 0x7f9e6c071340 2024-04-26T20:58:14.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.540+0000 7f9e6be00640 1 -- 172.21.15.138:0/1448479174 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1224035873 0 0) 0x7f9e6c070fd0 con 0x7f9e6c0d3760 2024-04-26T20:58:14.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.540+0000 7f9e71000640 1 -- 172.21.15.138:0/1448479174 >> v1:172.21.15.143:6789/0 conn(0x7f9e6c0d3760 legacy=0x7f9e6c0704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:14.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.540+0000 7f9e71000640 1 -- 172.21.15.138:0/1448479174 >> v1:172.21.15.138:6789/0 conn(0x7f9e6c071340 legacy=0x7f9e6c0b13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:14.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.540+0000 7f9e71000640 1 -- 172.21.15.138:0/1448479174 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e6c0d1470 con 0x7f9e6c160530 2024-04-26T20:58:14.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.544+0000 7f9e71000640 1 --2- 172.21.15.138:0/1448479174 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e6c160530 0x7f9e6c06ff70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c0097f0 tx=0x7f9e5c01c300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=461b2701a8d05971 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:14.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.544+0000 7f9e6be00640 1 -- 172.21.15.138:0/1448479174 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e5c0b0070 con 0x7f9e6c160530 2024-04-26T20:58:14.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.544+0000 7f9e6be00640 1 -- 172.21.15.138:0/1448479174 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e5c0ab600 con 0x7f9e6c160530 2024-04-26T20:58:14.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.544+0000 7f9e6be00640 1 -- 172.21.15.138:0/1448479174 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e5c0ab9d0 con 0x7f9e6c160530 2024-04-26T20:58:14.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.544+0000 7f9e72400640 1 -- 172.21.15.138:0/1448479174 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e6c160530 msgr2=0x7f9e6c06ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:14.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.544+0000 7f9e72400640 1 --2- 172.21.15.138:0/1448479174 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e6c160530 0x7f9e6c06ff70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c0097f0 tx=0x7f9e5c01c300 comp rx=0 tx=0).stop 2024-04-26T20:58:14.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.544+0000 7f9e72400640 1 -- 172.21.15.138:0/1448479174 shutdown_connections 2024-04-26T20:58:14.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.544+0000 7f9e72400640 1 --2- 172.21.15.138:0/1448479174 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e6c160530 0x7f9e6c06ff70 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:14.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.544+0000 7f9e72400640 1 -- 172.21.15.138:0/1448479174 >> 172.21.15.138:0/1448479174 conn(0x7f9e6c0d2c40 msgr2=0x7f9e6c0d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:14.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.544+0000 7f9e72400640 1 -- 172.21.15.138:0/1448479174 shutdown_connections 2024-04-26T20:58:14.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.544+0000 7f9e72400640 1 -- 172.21.15.138:0/1448479174 wait complete. 2024-04-26T20:58:14.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.548+0000 7f9e72400640 1 Processor -- start 2024-04-26T20:58:14.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.548+0000 7f9e72400640 1 -- start start 2024-04-26T20:58:14.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.548+0000 7f9e72400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9e6c071340 0x7f9e6c0cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:14.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.548+0000 7f9e72400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e6c0d3760 0x7f9e6c157610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:14.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.548+0000 7f9e72400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9e6c160530 0x7f9e6c15ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:14.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.548+0000 7f9e72400640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f9e6c16af10 con 0x7f9e6c160530 2024-04-26T20:58:14.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.548+0000 7f9e72400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f9e6c16ad90 con 0x7f9e6c071340 2024-04-26T20:58:14.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.548+0000 7f9e72400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f9e6c16b090 con 0x7f9e6c0d3760 2024-04-26T20:58:14.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.548+0000 7f9e71a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9e6c160530 0x7f9e6c15ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:14.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.548+0000 7f9e71a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9e6c160530 0x7f9e6c15ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:54162/0 (socket says 172.21.15.138:54162) 2024-04-26T20:58:14.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.548+0000 7f9e71a00640 1 -- 172.21.15.138:0/3069685430 learned_addr learned my addr 172.21.15.138:0/3069685430 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:14.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.548+0000 7f9e63e00640 1 --2- 172.21.15.138:0/3069685430 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e6c0d3760 0x7f9e6c157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:14.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.548+0000 7f9e71000640 1 --2- 172.21.15.138:0/3069685430 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9e6c071340 0x7f9e6c0cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:14.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.548+0000 7f9e71a00640 1 -- 172.21.15.138:0/3069685430 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e6c0d3760 msgr2=0x7f9e6c157610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:14.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.548+0000 7f9e71a00640 1 --2- 172.21.15.138:0/3069685430 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e6c0d3760 0x7f9e6c157610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:14.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.548+0000 7f9e71a00640 1 -- 172.21.15.138:0/3069685430 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9e6c071340 msgr2=0x7f9e6c0cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:14.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.548+0000 7f9e71a00640 1 --2- 172.21.15.138:0/3069685430 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9e6c071340 0x7f9e6c0cfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:14.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.548+0000 7f9e71a00640 1 -- 172.21.15.138:0/3069685430 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e6c15dc60 con 0x7f9e6c160530 2024-04-26T20:58:14.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.548+0000 7f9e71a00640 1 --2- 172.21.15.138:0/3069685430 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9e6c160530 0x7f9e6c15ef80 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f9e6400caa0 tx=0x7f9e6400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:14.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.548+0000 7f9e69600640 1 -- 172.21.15.138:0/3069685430 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e64017070 con 0x7f9e6c160530 2024-04-26T20:58:14.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.548+0000 7f9e69600640 1 -- 172.21.15.138:0/3069685430 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e6400ac00 con 0x7f9e6c160530 2024-04-26T20:58:14.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.548+0000 7f9e69600640 1 -- 172.21.15.138:0/3069685430 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e64012400 con 0x7f9e6c160530 2024-04-26T20:58:14.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.548+0000 7f9e72400640 1 -- 172.21.15.138:0/3069685430 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e6c15dee0 con 0x7f9e6c160530 2024-04-26T20:58:14.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.548+0000 7f9e72400640 1 -- 172.21.15.138:0/3069685430 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e6c15e4a0 con 0x7f9e6c160530 2024-04-26T20:58:14.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.548+0000 7f9e72400640 1 -- 172.21.15.138:0/3069685430 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e6c069430 con 0x7f9e6c160530 2024-04-26T20:58:14.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.552+0000 7f9e69600640 1 -- 172.21.15.138:0/3069685430 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9e6401a070 con 0x7f9e6c160530 2024-04-26T20:58:14.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.552+0000 7f9e69600640 1 --2- 172.21.15.138:0/3069685430 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9e480683b0 0x7f9e4806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:14.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.552+0000 7f9e69600640 1 -- 172.21.15.138:0/3069685430 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6640+0+0 (secure 0 0 0) 0x7f9e64086b70 con 0x7f9e6c160530 2024-04-26T20:58:14.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.552+0000 7f9e71000640 1 --2- 172.21.15.138:0/3069685430 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9e480683b0 0x7f9e4806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:14.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.552+0000 7f9e71000640 1 --2- 172.21.15.138:0/3069685430 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9e480683b0 0x7f9e4806a870 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c0ad000 tx=0x7f9e5c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:14.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.556+0000 7f9e69600640 1 -- 172.21.15.138:0/3069685430 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9e6c15dc60 con 0x7f9e6c160530 2024-04-26T20:58:14.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.708+0000 7f9e72400640 1 -- 172.21.15.138:0/3069685430 --> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9e6c14f690 con 0x7f9e480683b0 2024-04-26T20:58:14.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.720+0000 7f9e69600640 1 -- 172.21.15.138:0/3069685430 <== mgr.4100 v2:172.21.15.143:6832/4275464198 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+331713 (secure 0 0 0) 0x7f9e6c14f690 con 0x7f9e480683b0 2024-04-26T20:58:14.724 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:14.725 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-04-26T20:58:14.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.724+0000 7f9e72400640 1 -- 172.21.15.138:0/3069685430 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9e480683b0 msgr2=0x7f9e4806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:14.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.724+0000 7f9e72400640 1 --2- 172.21.15.138:0/3069685430 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9e480683b0 0x7f9e4806a870 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c0ad000 tx=0x7f9e5c0a6000 comp rx=0 tx=0).stop 2024-04-26T20:58:14.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.724+0000 7f9e72400640 1 -- 172.21.15.138:0/3069685430 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9e6c160530 msgr2=0x7f9e6c15ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:14.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.724+0000 7f9e72400640 1 --2- 172.21.15.138:0/3069685430 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9e6c160530 0x7f9e6c15ef80 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f9e6400caa0 tx=0x7f9e6400cf60 comp rx=0 tx=0).stop 2024-04-26T20:58:14.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.724+0000 7f9e72400640 1 -- 172.21.15.138:0/3069685430 shutdown_connections 2024-04-26T20:58:14.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.724+0000 7f9e72400640 1 --2- 172.21.15.138:0/3069685430 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9e480683b0 0x7f9e4806a870 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:14.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.724+0000 7f9e72400640 1 --2- 172.21.15.138:0/3069685430 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9e6c160530 0x7f9e6c15ef80 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:14.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.724+0000 7f9e72400640 1 --2- 172.21.15.138:0/3069685430 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e6c0d3760 0x7f9e6c157610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:14.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.724+0000 7f9e72400640 1 --2- 172.21.15.138:0/3069685430 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9e6c071340 0x7f9e6c0cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:14.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.724+0000 7f9e72400640 1 -- 172.21.15.138:0/3069685430 >> 172.21.15.138:0/3069685430 conn(0x7f9e6c0d2c40 msgr2=0x7f9e6c0cb3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:14.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.724+0000 7f9e72400640 1 -- 172.21.15.138:0/3069685430 shutdown_connections 2024-04-26T20:58:14.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.724+0000 7f9e72400640 1 -- 172.21.15.138:0/3069685430 wait complete. 2024-04-26T20:58:14.744 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":97,"stamp":"2024-04-26T20:58:13.263262+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6881824,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":117,"num_read_kb":100,"num_write":260,"num_write_kb":8602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":705,"ondisk_log_size":705,"up":248,"acting":248,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":222,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":233960,"kb_used_data":17732,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754740760,"statfs":{"total":773094113280,"available":772854538240,"internally_reserved":0,"allocated":18157568,"data_stored":15713195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2410,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":52,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.611411"},"pg_stats":[{"pgid":"6.3f","version":"41'8","reported_seq":28,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T20:58:07.654713+0000","last_change":"2024-04-26T20:57:52.581808+0000","last_active":"2024-04-26T20:58:07.654713+0000","last_peered":"2024-04-26T20:58:07.654713+0000","last_clean":"2024-04-26T20:58:07.654713+0000","last_became_active":"2024-04-26T20:57:52.581483+0000","last_became_peered":"2024-04-26T20:57:52.581483+0000","last_unstale":"2024-04-26T20:58:07.654713+0000","last_undegraded":"2024-04-26T20:58:07.654713+0000","last_fullsized":"2024-04-26T20:58:07.654713+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:59:31.726648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"41'4","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.658178+0000","last_change":"2024-04-26T20:57:52.584136+0000","last_active":"2024-04-26T20:58:10.658178+0000","last_peered":"2024-04-26T20:58:10.658178+0000","last_clean":"2024-04-26T20:58:10.658178+0000","last_became_active":"2024-04-26T20:57:52.583831+0000","last_became_peered":"2024-04-26T20:57:52.583831+0000","last_unstale":"2024-04-26T20:58:10.658178+0000","last_undegraded":"2024-04-26T20:58:10.658178+0000","last_fullsized":"2024-04-26T20:58:10.658178+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:47:10.436783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"41'7","reported_seq":27,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T20:58:07.654479+0000","last_change":"2024-04-26T20:57:52.589332+0000","last_active":"2024-04-26T20:58:07.654479+0000","last_peered":"2024-04-26T20:58:07.654479+0000","last_clean":"2024-04-26T20:58:07.654479+0000","last_became_active":"2024-04-26T20:57:52.589025+0000","last_became_peered":"2024-04-26T20:57:52.589025+0000","last_unstale":"2024-04-26T20:58:07.654479+0000","last_undegraded":"2024-04-26T20:58:07.654479+0000","last_fullsized":"2024-04-26T20:58:07.654479+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:32:30.418094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"41'8","reported_seq":28,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T20:58:07.654904+0000","last_change":"2024-04-26T20:57:52.577582+0000","last_active":"2024-04-26T20:58:07.654904+0000","last_peered":"2024-04-26T20:58:07.654904+0000","last_clean":"2024-04-26T20:58:07.654904+0000","last_became_active":"2024-04-26T20:57:52.576872+0000","last_became_peered":"2024-04-26T20:57:52.576872+0000","last_unstale":"2024-04-26T20:58:07.654904+0000","last_undegraded":"2024-04-26T20:58:07.654904+0000","last_fullsized":"2024-04-26T20:58:07.654904+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:54.444509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"41'4","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.660374+0000","last_change":"2024-04-26T20:57:52.590233+0000","last_active":"2024-04-26T20:58:10.660374+0000","last_peered":"2024-04-26T20:58:10.660374+0000","last_clean":"2024-04-26T20:58:10.660374+0000","last_became_active":"2024-04-26T20:57:52.589943+0000","last_became_peered":"2024-04-26T20:57:52.589943+0000","last_unstale":"2024-04-26T20:58:10.660374+0000","last_undegraded":"2024-04-26T20:58:10.660374+0000","last_fullsized":"2024-04-26T20:58:10.660374+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:12.952743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"41'6","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.657623+0000","last_change":"2024-04-26T20:57:52.586359+0000","last_active":"2024-04-26T20:58:10.657623+0000","last_peered":"2024-04-26T20:58:10.657623+0000","last_clean":"2024-04-26T20:58:10.657623+0000","last_became_active":"2024-04-26T20:57:52.586013+0000","last_became_peered":"2024-04-26T20:57:52.586013+0000","last_unstale":"2024-04-26T20:58:10.657623+0000","last_undegraded":"2024-04-26T20:58:10.657623+0000","last_fullsized":"2024-04-26T20:58:10.657623+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:52:00.840874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"41'5","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.648157+0000","last_change":"2024-04-26T20:57:52.578308+0000","last_active":"2024-04-26T20:58:10.648157+0000","last_peered":"2024-04-26T20:58:10.648157+0000","last_clean":"2024-04-26T20:58:10.648157+0000","last_became_active":"2024-04-26T20:57:52.578063+0000","last_became_peered":"2024-04-26T20:57:52.578063+0000","last_unstale":"2024-04-26T20:58:10.648157+0000","last_undegraded":"2024-04-26T20:58:10.648157+0000","last_fullsized":"2024-04-26T20:58:10.648157+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:12.952743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"41'9","reported_seq":29,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T20:58:07.654133+0000","last_change":"2024-04-26T20:57:52.583828+0000","last_active":"2024-04-26T20:58:07.654133+0000","last_peered":"2024-04-26T20:58:07.654133+0000","last_clean":"2024-04-26T20:58:07.654133+0000","last_became_active":"2024-04-26T20:57:52.582894+0000","last_became_peered":"2024-04-26T20:57:52.582894+0000","last_unstale":"2024-04-26T20:58:07.654133+0000","last_undegraded":"2024-04-26T20:58:07.654133+0000","last_fullsized":"2024-04-26T20:58:07.654133+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:07:20.480071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"41'11","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.661672+0000","last_change":"2024-04-26T20:57:52.590616+0000","last_active":"2024-04-26T20:58:10.661672+0000","last_peered":"2024-04-26T20:58:10.661672+0000","last_clean":"2024-04-26T20:58:10.661672+0000","last_became_active":"2024-04-26T20:57:52.589972+0000","last_became_peered":"2024-04-26T20:57:52.589972+0000","last_unstale":"2024-04-26T20:58:10.661672+0000","last_undegraded":"2024-04-26T20:58:10.661672+0000","last_fullsized":"2024-04-26T20:58:10.661672+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:55.128152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"41'15","reported_seq":39,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.649095+0000","last_change":"2024-04-26T20:57:52.575175+0000","last_active":"2024-04-26T20:58:10.649095+0000","last_peered":"2024-04-26T20:58:10.649095+0000","last_clean":"2024-04-26T20:58:10.649095+0000","last_became_active":"2024-04-26T20:57:52.574917+0000","last_became_peered":"2024-04-26T20:57:52.574917+0000","last_unstale":"2024-04-26T20:58:10.649095+0000","last_undegraded":"2024-04-26T20:58:10.649095+0000","last_fullsized":"2024-04-26T20:58:10.649095+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:28:20.157680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"41'6","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.652083+0000","last_change":"2024-04-26T20:57:52.579280+0000","last_active":"2024-04-26T20:58:10.652083+0000","last_peered":"2024-04-26T20:58:10.652083+0000","last_clean":"2024-04-26T20:58:10.652083+0000","last_became_active":"2024-04-26T20:57:52.578799+0000","last_became_peered":"2024-04-26T20:57:52.578799+0000","last_unstale":"2024-04-26T20:58:10.652083+0000","last_undegraded":"2024-04-26T20:58:10.652083+0000","last_fullsized":"2024-04-26T20:58:10.652083+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:24.709956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"41'7","reported_seq":32,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.662261+0000","last_change":"2024-04-26T20:57:52.585045+0000","last_active":"2024-04-26T20:58:10.662261+0000","last_peered":"2024-04-26T20:58:10.662261+0000","last_clean":"2024-04-26T20:58:10.662261+0000","last_became_active":"2024-04-26T20:57:52.584748+0000","last_became_peered":"2024-04-26T20:57:52.584748+0000","last_unstale":"2024-04-26T20:58:10.662261+0000","last_undegraded":"2024-04-26T20:58:10.662261+0000","last_fullsized":"2024-04-26T20:58:10.662261+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:16.143937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"41'10","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.649429+0000","last_change":"2024-04-26T20:57:52.583032+0000","last_active":"2024-04-26T20:58:10.649429+0000","last_peered":"2024-04-26T20:58:10.649429+0000","last_clean":"2024-04-26T20:58:10.649429+0000","last_became_active":"2024-04-26T20:57:52.582788+0000","last_became_peered":"2024-04-26T20:57:52.582788+0000","last_unstale":"2024-04-26T20:58:10.649429+0000","last_undegraded":"2024-04-26T20:58:10.649429+0000","last_fullsized":"2024-04-26T20:58:10.649429+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:12:05.356796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"41'8","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.654536+0000","last_change":"2024-04-26T20:57:52.577582+0000","last_active":"2024-04-26T20:58:10.654536+0000","last_peered":"2024-04-26T20:58:10.654536+0000","last_clean":"2024-04-26T20:58:10.654536+0000","last_became_active":"2024-04-26T20:57:52.577366+0000","last_became_peered":"2024-04-26T20:57:52.577366+0000","last_unstale":"2024-04-26T20:58:10.654536+0000","last_undegraded":"2024-04-26T20:58:10.654536+0000","last_fullsized":"2024-04-26T20:58:10.654536+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:16.143937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"41'7","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.652283+0000","last_change":"2024-04-26T20:57:52.586188+0000","last_active":"2024-04-26T20:58:10.652283+0000","last_peered":"2024-04-26T20:58:10.652283+0000","last_clean":"2024-04-26T20:58:10.652283+0000","last_became_active":"2024-04-26T20:57:52.585816+0000","last_became_peered":"2024-04-26T20:57:52.585816+0000","last_unstale":"2024-04-26T20:58:10.652283+0000","last_undegraded":"2024-04-26T20:58:10.652283+0000","last_fullsized":"2024-04-26T20:58:10.652283+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:34:47.231759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"41'9","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.648219+0000","last_change":"2024-04-26T20:57:52.587967+0000","last_active":"2024-04-26T20:58:10.648219+0000","last_peered":"2024-04-26T20:58:10.648219+0000","last_clean":"2024-04-26T20:58:10.648219+0000","last_became_active":"2024-04-26T20:57:52.587598+0000","last_became_peered":"2024-04-26T20:57:52.587598+0000","last_unstale":"2024-04-26T20:58:10.648219+0000","last_undegraded":"2024-04-26T20:58:10.648219+0000","last_fullsized":"2024-04-26T20:58:10.648219+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:55.128152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"41'9","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.653716+0000","last_change":"2024-04-26T20:57:52.582167+0000","last_active":"2024-04-26T20:58:10.653716+0000","last_peered":"2024-04-26T20:58:10.653716+0000","last_clean":"2024-04-26T20:58:10.653716+0000","last_became_active":"2024-04-26T20:57:52.581896+0000","last_became_peered":"2024-04-26T20:57:52.581896+0000","last_unstale":"2024-04-26T20:58:10.653716+0000","last_undegraded":"2024-04-26T20:58:10.653716+0000","last_fullsized":"2024-04-26T20:58:10.653716+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:34:07.377749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"41'10","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.653336+0000","last_change":"2024-04-26T20:57:52.582700+0000","last_active":"2024-04-26T20:58:10.653336+0000","last_peered":"2024-04-26T20:58:10.653336+0000","last_clean":"2024-04-26T20:58:10.653336+0000","last_became_active":"2024-04-26T20:57:52.582355+0000","last_became_peered":"2024-04-26T20:57:52.582355+0000","last_unstale":"2024-04-26T20:58:10.653336+0000","last_undegraded":"2024-04-26T20:58:10.653336+0000","last_fullsized":"2024-04-26T20:58:10.653336+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:36:31.798469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"41'7","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.664703+0000","last_change":"2024-04-26T20:57:52.593273+0000","last_active":"2024-04-26T20:58:10.664703+0000","last_peered":"2024-04-26T20:58:10.664703+0000","last_clean":"2024-04-26T20:58:10.664703+0000","last_became_active":"2024-04-26T20:57:52.592960+0000","last_became_peered":"2024-04-26T20:57:52.592960+0000","last_unstale":"2024-04-26T20:58:10.664703+0000","last_undegraded":"2024-04-26T20:58:10.664703+0000","last_fullsized":"2024-04-26T20:58:10.664703+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:49:19.250429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"41'8","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.651801+0000","last_change":"2024-04-26T20:57:52.569599+0000","last_active":"2024-04-26T20:58:10.651801+0000","last_peered":"2024-04-26T20:58:10.651801+0000","last_clean":"2024-04-26T20:58:10.651801+0000","last_became_active":"2024-04-26T20:57:52.569345+0000","last_became_peered":"2024-04-26T20:57:52.569345+0000","last_unstale":"2024-04-26T20:58:10.651801+0000","last_undegraded":"2024-04-26T20:58:10.651801+0000","last_fullsized":"2024-04-26T20:58:10.651801+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:31:38.044176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"41'11","reported_seq":38,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.651569+0000","last_change":"2024-04-26T20:57:52.592270+0000","last_active":"2024-04-26T20:58:10.651569+0000","last_peered":"2024-04-26T20:58:10.651569+0000","last_clean":"2024-04-26T20:58:10.651569+0000","last_became_active":"2024-04-26T20:57:52.591984+0000","last_became_peered":"2024-04-26T20:57:52.591984+0000","last_unstale":"2024-04-26T20:58:10.651569+0000","last_undegraded":"2024-04-26T20:58:10.651569+0000","last_fullsized":"2024-04-26T20:58:10.651569+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:16:22.565146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"41'9","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.651342+0000","last_change":"2024-04-26T20:57:52.576852+0000","last_active":"2024-04-26T20:58:10.651342+0000","last_peered":"2024-04-26T20:58:10.651342+0000","last_clean":"2024-04-26T20:58:10.651342+0000","last_became_active":"2024-04-26T20:57:52.575571+0000","last_became_peered":"2024-04-26T20:57:52.575571+0000","last_unstale":"2024-04-26T20:58:10.651342+0000","last_undegraded":"2024-04-26T20:58:10.651342+0000","last_fullsized":"2024-04-26T20:58:10.651342+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:45.313671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"41'8","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.652443+0000","last_change":"2024-04-26T20:57:52.586306+0000","last_active":"2024-04-26T20:58:10.652443+0000","last_peered":"2024-04-26T20:58:10.652443+0000","last_clean":"2024-04-26T20:58:10.652443+0000","last_became_active":"2024-04-26T20:57:52.585992+0000","last_became_peered":"2024-04-26T20:57:52.585992+0000","last_unstale":"2024-04-26T20:58:10.652443+0000","last_undegraded":"2024-04-26T20:58:10.652443+0000","last_fullsized":"2024-04-26T20:58:10.652443+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:30:40.828807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"41'6","reported_seq":26,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T20:58:07.654280+0000","last_change":"2024-04-26T20:57:52.584019+0000","last_active":"2024-04-26T20:58:07.654280+0000","last_peered":"2024-04-26T20:58:07.654280+0000","last_clean":"2024-04-26T20:58:07.654280+0000","last_became_active":"2024-04-26T20:57:52.583140+0000","last_became_peered":"2024-04-26T20:57:52.583140+0000","last_unstale":"2024-04-26T20:58:07.654280+0000","last_undegraded":"2024-04-26T20:58:07.654280+0000","last_fullsized":"2024-04-26T20:58:07.654280+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:25.562628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"41'2","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.654410+0000","last_change":"2024-04-26T20:57:52.579168+0000","last_active":"2024-04-26T20:58:10.654410+0000","last_peered":"2024-04-26T20:58:10.654410+0000","last_clean":"2024-04-26T20:58:10.654410+0000","last_became_active":"2024-04-26T20:57:52.578943+0000","last_became_peered":"2024-04-26T20:57:52.578943+0000","last_unstale":"2024-04-26T20:58:10.654410+0000","last_undegraded":"2024-04-26T20:58:10.654410+0000","last_fullsized":"2024-04-26T20:58:10.654410+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:55.128152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"41'15","reported_seq":35,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T20:58:07.654941+0000","last_change":"2024-04-26T20:57:52.585325+0000","last_active":"2024-04-26T20:58:07.654941+0000","last_peered":"2024-04-26T20:58:07.654941+0000","last_clean":"2024-04-26T20:58:07.654941+0000","last_became_active":"2024-04-26T20:57:52.585083+0000","last_became_peered":"2024-04-26T20:57:52.585083+0000","last_unstale":"2024-04-26T20:58:07.654941+0000","last_undegraded":"2024-04-26T20:58:07.654941+0000","last_fullsized":"2024-04-26T20:58:07.654941+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:00:42.689944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"41'6","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.652239+0000","last_change":"2024-04-26T20:57:52.578861+0000","last_active":"2024-04-26T20:58:10.652239+0000","last_peered":"2024-04-26T20:58:10.652239+0000","last_clean":"2024-04-26T20:58:10.652239+0000","last_became_active":"2024-04-26T20:57:52.578454+0000","last_became_peered":"2024-04-26T20:57:52.578454+0000","last_unstale":"2024-04-26T20:58:10.652239+0000","last_undegraded":"2024-04-26T20:58:10.652239+0000","last_fullsized":"2024-04-26T20:58:10.652239+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:36:12.618358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"41'4","reported_seq":28,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.648653+0000","last_change":"2024-04-26T20:57:52.577688+0000","last_active":"2024-04-26T20:58:10.648653+0000","last_peered":"2024-04-26T20:58:10.648653+0000","last_clean":"2024-04-26T20:58:10.648653+0000","last_became_active":"2024-04-26T20:57:52.577426+0000","last_became_peered":"2024-04-26T20:57:52.577426+0000","last_unstale":"2024-04-26T20:58:10.648653+0000","last_undegraded":"2024-04-26T20:58:10.648653+0000","last_fullsized":"2024-04-26T20:58:10.648653+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:16.143937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"41'7","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.652633+0000","last_change":"2024-04-26T20:57:52.583932+0000","last_active":"2024-04-26T20:58:10.652633+0000","last_peered":"2024-04-26T20:58:10.652633+0000","last_clean":"2024-04-26T20:58:10.652633+0000","last_became_active":"2024-04-26T20:57:52.583671+0000","last_became_peered":"2024-04-26T20:57:52.583671+0000","last_unstale":"2024-04-26T20:58:10.652633+0000","last_undegraded":"2024-04-26T20:58:10.652633+0000","last_fullsized":"2024-04-26T20:58:10.652633+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:17:49.866989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"41'8","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.652722+0000","last_change":"2024-04-26T20:57:52.569868+0000","last_active":"2024-04-26T20:58:10.652722+0000","last_peered":"2024-04-26T20:58:10.652722+0000","last_clean":"2024-04-26T20:58:10.652722+0000","last_became_active":"2024-04-26T20:57:52.569591+0000","last_became_peered":"2024-04-26T20:57:52.569591+0000","last_unstale":"2024-04-26T20:58:10.652722+0000","last_undegraded":"2024-04-26T20:58:10.652722+0000","last_fullsized":"2024-04-26T20:58:10.652722+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:16.617166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"41'12","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.648340+0000","last_change":"2024-04-26T20:57:52.581841+0000","last_active":"2024-04-26T20:58:10.648340+0000","last_peered":"2024-04-26T20:58:10.648340+0000","last_clean":"2024-04-26T20:58:10.648340+0000","last_became_active":"2024-04-26T20:57:52.581591+0000","last_became_peered":"2024-04-26T20:57:52.581591+0000","last_unstale":"2024-04-26T20:58:10.648340+0000","last_undegraded":"2024-04-26T20:58:10.648340+0000","last_fullsized":"2024-04-26T20:58:10.648340+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:37:58.253968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"41'9","reported_seq":29,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T20:58:07.654421+0000","last_change":"2024-04-26T20:57:52.583636+0000","last_active":"2024-04-26T20:58:07.654421+0000","last_peered":"2024-04-26T20:58:07.654421+0000","last_clean":"2024-04-26T20:58:07.654421+0000","last_became_active":"2024-04-26T20:57:52.582497+0000","last_became_peered":"2024-04-26T20:57:52.582497+0000","last_unstale":"2024-04-26T20:58:07.654421+0000","last_undegraded":"2024-04-26T20:58:07.654421+0000","last_fullsized":"2024-04-26T20:58:07.654421+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:06:47.714849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.672853+0000","last_change":"2024-04-26T20:58:10.666436+0000","last_active":"2024-04-26T20:58:10.672853+0000","last_peered":"2024-04-26T20:58:10.672853+0000","last_clean":"2024-04-26T20:58:10.672853+0000","last_became_active":"2024-04-26T20:58:10.666048+0000","last_became_peered":"2024-04-26T20:58:10.666048+0000","last_unstale":"2024-04-26T20:58:10.672853+0000","last_undegraded":"2024-04-26T20:58:10.672853+0000","last_fullsized":"2024-04-26T20:58:10.672853+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:47:28.530714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"41'9","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.653238+0000","last_change":"2024-04-26T20:57:52.569273+0000","last_active":"2024-04-26T20:58:10.653238+0000","last_peered":"2024-04-26T20:58:10.653238+0000","last_clean":"2024-04-26T20:58:10.653238+0000","last_became_active":"2024-04-26T20:57:52.568195+0000","last_became_peered":"2024-04-26T20:57:52.568195+0000","last_unstale":"2024-04-26T20:58:10.653238+0000","last_undegraded":"2024-04-26T20:58:10.653238+0000","last_fullsized":"2024-04-26T20:58:10.653238+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:05:37.693355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"42'8","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.654475+0000","last_change":"2024-04-26T20:57:51.572743+0000","last_active":"2024-04-26T20:58:10.654475+0000","last_peered":"2024-04-26T20:58:10.654475+0000","last_clean":"2024-04-26T20:58:10.654475+0000","last_became_active":"2024-04-26T20:57:51.572350+0000","last_became_peered":"2024-04-26T20:57:51.572350+0000","last_unstale":"2024-04-26T20:58:10.654475+0000","last_undegraded":"2024-04-26T20:58:10.654475+0000","last_fullsized":"2024-04-26T20:58:10.654475+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:50:32.238625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.668622+0000","last_change":"2024-04-26T20:58:10.667265+0000","last_active":"2024-04-26T20:58:10.668622+0000","last_peered":"2024-04-26T20:58:10.668622+0000","last_clean":"2024-04-26T20:58:10.668622+0000","last_became_active":"2024-04-26T20:58:10.667057+0000","last_became_peered":"2024-04-26T20:58:10.667057+0000","last_unstale":"2024-04-26T20:58:10.668622+0000","last_undegraded":"2024-04-26T20:58:10.668622+0000","last_fullsized":"2024-04-26T20:58:10.668622+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:44.950848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"41'15","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.657903+0000","last_change":"2024-04-26T20:57:52.587288+0000","last_active":"2024-04-26T20:58:10.657903+0000","last_peered":"2024-04-26T20:58:10.657903+0000","last_clean":"2024-04-26T20:58:10.657903+0000","last_became_active":"2024-04-26T20:57:52.586875+0000","last_became_peered":"2024-04-26T20:57:52.586875+0000","last_unstale":"2024-04-26T20:58:10.657903+0000","last_undegraded":"2024-04-26T20:58:10.657903+0000","last_fullsized":"2024-04-26T20:58:10.657903+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:44:03.294510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":27,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.658255+0000","last_change":"2024-04-26T20:57:51.566643+0000","last_active":"2024-04-26T20:58:10.658255+0000","last_peered":"2024-04-26T20:58:10.658255+0000","last_clean":"2024-04-26T20:58:10.658255+0000","last_became_active":"2024-04-26T20:57:51.566309+0000","last_became_peered":"2024-04-26T20:57:51.566309+0000","last_unstale":"2024-04-26T20:58:10.658255+0000","last_undegraded":"2024-04-26T20:58:10.658255+0000","last_fullsized":"2024-04-26T20:58:10.658255+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:50:32.238625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.671298+0000","last_change":"2024-04-26T20:58:10.669263+0000","last_active":"2024-04-26T20:58:10.671298+0000","last_peered":"2024-04-26T20:58:10.671298+0000","last_clean":"2024-04-26T20:58:10.671298+0000","last_became_active":"2024-04-26T20:58:10.668918+0000","last_became_peered":"2024-04-26T20:58:10.668918+0000","last_unstale":"2024-04-26T20:58:10.671298+0000","last_undegraded":"2024-04-26T20:58:10.671298+0000","last_fullsized":"2024-04-26T20:58:10.671298+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:19:35.479464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"41'5","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.653575+0000","last_change":"2024-04-26T20:57:52.566380+0000","last_active":"2024-04-26T20:58:10.653575+0000","last_peered":"2024-04-26T20:58:10.653575+0000","last_clean":"2024-04-26T20:58:10.653575+0000","last_became_active":"2024-04-26T20:57:52.566143+0000","last_became_peered":"2024-04-26T20:57:52.566143+0000","last_unstale":"2024-04-26T20:58:10.653575+0000","last_undegraded":"2024-04-26T20:58:10.653575+0000","last_fullsized":"2024-04-26T20:58:10.653575+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:49:48.199988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"42'3","reported_seq":25,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T20:58:07.654803+0000","last_change":"2024-04-26T20:57:51.573664+0000","last_active":"2024-04-26T20:58:07.654803+0000","last_peered":"2024-04-26T20:58:07.654803+0000","last_clean":"2024-04-26T20:58:07.654803+0000","last_became_active":"2024-04-26T20:57:51.572927+0000","last_became_peered":"2024-04-26T20:57:51.572927+0000","last_unstale":"2024-04-26T20:58:07.654803+0000","last_undegraded":"2024-04-26T20:58:07.654803+0000","last_fullsized":"2024-04-26T20:58:07.654803+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:04:55.596385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.678783+0000","last_change":"2024-04-26T20:58:10.676452+0000","last_active":"2024-04-26T20:58:10.678783+0000","last_peered":"2024-04-26T20:58:10.678783+0000","last_clean":"2024-04-26T20:58:10.678783+0000","last_became_active":"2024-04-26T20:58:10.676145+0000","last_became_peered":"2024-04-26T20:58:10.676145+0000","last_unstale":"2024-04-26T20:58:10.678783+0000","last_undegraded":"2024-04-26T20:58:10.678783+0000","last_fullsized":"2024-04-26T20:58:10.678783+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:54:11.593416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"41'6","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.658964+0000","last_change":"2024-04-26T20:57:52.585801+0000","last_active":"2024-04-26T20:58:10.658964+0000","last_peered":"2024-04-26T20:58:10.658964+0000","last_clean":"2024-04-26T20:58:10.658964+0000","last_became_active":"2024-04-26T20:57:52.584731+0000","last_became_peered":"2024-04-26T20:57:52.584731+0000","last_unstale":"2024-04-26T20:58:10.658964+0000","last_undegraded":"2024-04-26T20:58:10.658964+0000","last_fullsized":"2024-04-26T20:58:10.658964+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:39:52.141275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"42'3","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.654149+0000","last_change":"2024-04-26T20:57:51.574013+0000","last_active":"2024-04-26T20:58:10.654149+0000","last_peered":"2024-04-26T20:58:10.654149+0000","last_clean":"2024-04-26T20:58:10.654149+0000","last_became_active":"2024-04-26T20:57:51.573800+0000","last_became_peered":"2024-04-26T20:57:51.573800+0000","last_unstale":"2024-04-26T20:58:10.654149+0000","last_undegraded":"2024-04-26T20:58:10.654149+0000","last_fullsized":"2024-04-26T20:58:10.654149+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:43:07.969141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.666603+0000","last_change":"2024-04-26T20:58:10.665186+0000","last_active":"2024-04-26T20:58:10.666603+0000","last_peered":"2024-04-26T20:58:10.666603+0000","last_clean":"2024-04-26T20:58:10.666603+0000","last_became_active":"2024-04-26T20:58:10.664923+0000","last_became_peered":"2024-04-26T20:58:10.664923+0000","last_unstale":"2024-04-26T20:58:10.666603+0000","last_undegraded":"2024-04-26T20:58:10.666603+0000","last_fullsized":"2024-04-26T20:58:10.666603+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:14:23.512332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"41'8","reported_seq":28,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T20:58:07.654427+0000","last_change":"2024-04-26T20:57:52.587538+0000","last_active":"2024-04-26T20:58:07.654427+0000","last_peered":"2024-04-26T20:58:07.654427+0000","last_clean":"2024-04-26T20:58:07.654427+0000","last_became_active":"2024-04-26T20:57:52.587138+0000","last_became_peered":"2024-04-26T20:57:52.587138+0000","last_unstale":"2024-04-26T20:58:07.654427+0000","last_undegraded":"2024-04-26T20:58:07.654427+0000","last_fullsized":"2024-04-26T20:58:07.654427+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:41:24.188302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.654368+0000","last_change":"2024-04-26T20:57:51.570397+0000","last_active":"2024-04-26T20:58:10.654368+0000","last_peered":"2024-04-26T20:58:10.654368+0000","last_clean":"2024-04-26T20:58:10.654368+0000","last_became_active":"2024-04-26T20:57:51.570089+0000","last_became_peered":"2024-04-26T20:57:51.570089+0000","last_unstale":"2024-04-26T20:58:10.654368+0000","last_undegraded":"2024-04-26T20:58:10.654368+0000","last_fullsized":"2024-04-26T20:58:10.654368+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:55:41.720506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:58:09.636100+0000","last_change":"2024-04-26T20:58:09.636100+0000","last_active":"2024-04-26T20:58:09.636100+0000","last_peered":"2024-04-26T20:58:09.636100+0000","last_clean":"2024-04-26T20:58:09.636100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:58:09.636100+0000","last_undegraded":"2024-04-26T20:58:09.636100+0000","last_fullsized":"2024-04-26T20:58:09.636100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"41'10","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.651301+0000","last_change":"2024-04-26T20:57:52.585311+0000","last_active":"2024-04-26T20:58:10.651301+0000","last_peered":"2024-04-26T20:58:10.651301+0000","last_clean":"2024-04-26T20:58:10.651301+0000","last_became_active":"2024-04-26T20:57:52.585061+0000","last_became_peered":"2024-04-26T20:57:52.585061+0000","last_unstale":"2024-04-26T20:58:10.651301+0000","last_undegraded":"2024-04-26T20:58:10.651301+0000","last_fullsized":"2024-04-26T20:58:10.651301+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:18.275862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":26,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.649645+0000","last_change":"2024-04-26T20:57:51.571733+0000","last_active":"2024-04-26T20:58:10.649645+0000","last_peered":"2024-04-26T20:58:10.649645+0000","last_clean":"2024-04-26T20:58:10.649645+0000","last_became_active":"2024-04-26T20:57:51.571446+0000","last_became_peered":"2024-04-26T20:57:51.571446+0000","last_unstale":"2024-04-26T20:58:10.649645+0000","last_undegraded":"2024-04-26T20:58:10.649645+0000","last_fullsized":"2024-04-26T20:58:10.649645+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:07.815468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:58:09.636100+0000","last_change":"2024-04-26T20:58:09.636100+0000","last_active":"2024-04-26T20:58:09.636100+0000","last_peered":"2024-04-26T20:58:09.636100+0000","last_clean":"2024-04-26T20:58:09.636100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:58:09.636100+0000","last_undegraded":"2024-04-26T20:58:09.636100+0000","last_fullsized":"2024-04-26T20:58:09.636100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"41'7","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.652878+0000","last_change":"2024-04-26T20:57:52.570641+0000","last_active":"2024-04-26T20:58:10.652878+0000","last_peered":"2024-04-26T20:58:10.652878+0000","last_clean":"2024-04-26T20:58:10.652878+0000","last_became_active":"2024-04-26T20:57:52.570421+0000","last_became_peered":"2024-04-26T20:57:52.570421+0000","last_unstale":"2024-04-26T20:58:10.652878+0000","last_undegraded":"2024-04-26T20:58:10.652878+0000","last_fullsized":"2024-04-26T20:58:10.652878+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:27.330795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":22,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T20:58:07.654131+0000","last_change":"2024-04-26T20:57:51.574572+0000","last_active":"2024-04-26T20:58:07.654131+0000","last_peered":"2024-04-26T20:58:07.654131+0000","last_clean":"2024-04-26T20:58:07.654131+0000","last_became_active":"2024-04-26T20:57:51.574213+0000","last_became_peered":"2024-04-26T20:57:51.574213+0000","last_unstale":"2024-04-26T20:58:07.654131+0000","last_undegraded":"2024-04-26T20:58:07.654131+0000","last_fullsized":"2024-04-26T20:58:07.654131+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:10:26.507698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.659841+0000","last_change":"2024-04-26T20:58:10.657768+0000","last_active":"2024-04-26T20:58:10.659841+0000","last_peered":"2024-04-26T20:58:10.659841+0000","last_clean":"2024-04-26T20:58:10.659841+0000","last_became_active":"2024-04-26T20:58:10.657396+0000","last_became_peered":"2024-04-26T20:58:10.657396+0000","last_unstale":"2024-04-26T20:58:10.659841+0000","last_undegraded":"2024-04-26T20:58:10.659841+0000","last_fullsized":"2024-04-26T20:58:10.659841+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:43:54.225992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"41'8","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.660451+0000","last_change":"2024-04-26T20:57:52.586106+0000","last_active":"2024-04-26T20:58:10.660451+0000","last_peered":"2024-04-26T20:58:10.660451+0000","last_clean":"2024-04-26T20:58:10.660451+0000","last_became_active":"2024-04-26T20:57:52.585860+0000","last_became_peered":"2024-04-26T20:57:52.585860+0000","last_unstale":"2024-04-26T20:58:10.660451+0000","last_undegraded":"2024-04-26T20:58:10.660451+0000","last_fullsized":"2024-04-26T20:58:10.660451+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:16:22.565146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":25,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.648327+0000","last_change":"2024-04-26T20:57:51.573590+0000","last_active":"2024-04-26T20:58:10.648327+0000","last_peered":"2024-04-26T20:58:10.648327+0000","last_clean":"2024-04-26T20:58:10.648327+0000","last_became_active":"2024-04-26T20:57:51.573293+0000","last_became_peered":"2024-04-26T20:57:51.573293+0000","last_unstale":"2024-04-26T20:58:10.648327+0000","last_undegraded":"2024-04-26T20:58:10.648327+0000","last_fullsized":"2024-04-26T20:58:10.648327+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:55:23.008549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.672085+0000","last_change":"2024-04-26T20:58:10.670768+0000","last_active":"2024-04-26T20:58:10.672085+0000","last_peered":"2024-04-26T20:58:10.672085+0000","last_clean":"2024-04-26T20:58:10.672085+0000","last_became_active":"2024-04-26T20:58:10.670520+0000","last_became_peered":"2024-04-26T20:58:10.670520+0000","last_unstale":"2024-04-26T20:58:10.672085+0000","last_undegraded":"2024-04-26T20:58:10.672085+0000","last_fullsized":"2024-04-26T20:58:10.672085+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:52:06.081700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"41'11","reported_seq":31,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T20:58:07.655036+0000","last_change":"2024-04-26T20:57:52.575008+0000","last_active":"2024-04-26T20:58:07.655036+0000","last_peered":"2024-04-26T20:58:07.655036+0000","last_clean":"2024-04-26T20:58:07.655036+0000","last_became_active":"2024-04-26T20:57:52.574553+0000","last_became_peered":"2024-04-26T20:57:52.574553+0000","last_unstale":"2024-04-26T20:58:07.655036+0000","last_undegraded":"2024-04-26T20:58:07.655036+0000","last_fullsized":"2024-04-26T20:58:07.655036+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:07:44.096701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":22,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T20:58:07.654799+0000","last_change":"2024-04-26T20:57:51.576675+0000","last_active":"2024-04-26T20:58:07.654799+0000","last_peered":"2024-04-26T20:58:07.654799+0000","last_clean":"2024-04-26T20:58:07.654799+0000","last_became_active":"2024-04-26T20:57:51.576394+0000","last_became_peered":"2024-04-26T20:57:51.576394+0000","last_unstale":"2024-04-26T20:58:07.654799+0000","last_undegraded":"2024-04-26T20:58:07.654799+0000","last_fullsized":"2024-04-26T20:58:07.654799+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:44:14.717022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.674082+0000","last_change":"2024-04-26T20:58:10.671102+0000","last_active":"2024-04-26T20:58:10.674082+0000","last_peered":"2024-04-26T20:58:10.674082+0000","last_clean":"2024-04-26T20:58:10.674082+0000","last_became_active":"2024-04-26T20:58:10.670829+0000","last_became_peered":"2024-04-26T20:58:10.670829+0000","last_unstale":"2024-04-26T20:58:10.674082+0000","last_undegraded":"2024-04-26T20:58:10.674082+0000","last_fullsized":"2024-04-26T20:58:10.674082+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:16:40.659077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"41'6","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.654015+0000","last_change":"2024-04-26T20:57:52.576139+0000","last_active":"2024-04-26T20:58:10.654015+0000","last_peered":"2024-04-26T20:58:10.654015+0000","last_clean":"2024-04-26T20:58:10.654015+0000","last_became_active":"2024-04-26T20:57:52.575825+0000","last_became_peered":"2024-04-26T20:57:52.575825+0000","last_unstale":"2024-04-26T20:58:10.654015+0000","last_undegraded":"2024-04-26T20:58:10.654015+0000","last_fullsized":"2024-04-26T20:58:10.654015+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:37:58.253968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":27,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.653435+0000","last_change":"2024-04-26T20:57:51.566363+0000","last_active":"2024-04-26T20:58:10.653435+0000","last_peered":"2024-04-26T20:58:10.653435+0000","last_clean":"2024-04-26T20:58:10.653435+0000","last_became_active":"2024-04-26T20:57:51.566020+0000","last_became_peered":"2024-04-26T20:57:51.566020+0000","last_unstale":"2024-04-26T20:58:10.653435+0000","last_undegraded":"2024-04-26T20:58:10.653435+0000","last_fullsized":"2024-04-26T20:58:10.653435+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:51:59.832838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.658001+0000","last_change":"2024-04-26T20:58:10.656874+0000","last_active":"2024-04-26T20:58:10.658001+0000","last_peered":"2024-04-26T20:58:10.658001+0000","last_clean":"2024-04-26T20:58:10.658001+0000","last_became_active":"2024-04-26T20:58:10.656106+0000","last_became_peered":"2024-04-26T20:58:10.656106+0000","last_unstale":"2024-04-26T20:58:10.658001+0000","last_undegraded":"2024-04-26T20:58:10.658001+0000","last_fullsized":"2024-04-26T20:58:10.658001+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:54:11.593416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"41'10","reported_seq":30,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T20:58:07.655020+0000","last_change":"2024-04-26T20:57:52.593299+0000","last_active":"2024-04-26T20:58:07.655020+0000","last_peered":"2024-04-26T20:58:07.655020+0000","last_clean":"2024-04-26T20:58:07.655020+0000","last_became_active":"2024-04-26T20:57:52.591280+0000","last_became_peered":"2024-04-26T20:57:52.591280+0000","last_unstale":"2024-04-26T20:58:07.655020+0000","last_undegraded":"2024-04-26T20:58:07.655020+0000","last_fullsized":"2024-04-26T20:58:07.655020+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:45:53.756909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"42'5","reported_seq":32,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.653766+0000","last_change":"2024-04-26T20:57:51.569668+0000","last_active":"2024-04-26T20:58:10.653766+0000","last_peered":"2024-04-26T20:58:10.653766+0000","last_clean":"2024-04-26T20:58:10.653766+0000","last_became_active":"2024-04-26T20:57:51.569384+0000","last_became_peered":"2024-04-26T20:57:51.569384+0000","last_unstale":"2024-04-26T20:58:10.653766+0000","last_undegraded":"2024-04-26T20:58:10.653766+0000","last_fullsized":"2024-04-26T20:58:10.653766+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:49:18.242393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.669541+0000","last_change":"2024-04-26T20:58:10.668231+0000","last_active":"2024-04-26T20:58:10.669541+0000","last_peered":"2024-04-26T20:58:10.669541+0000","last_clean":"2024-04-26T20:58:10.669541+0000","last_became_active":"2024-04-26T20:58:10.668007+0000","last_became_peered":"2024-04-26T20:58:10.668007+0000","last_unstale":"2024-04-26T20:58:10.669541+0000","last_undegraded":"2024-04-26T20:58:10.669541+0000","last_fullsized":"2024-04-26T20:58:10.669541+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:10.473443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"41'9","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.649099+0000","last_change":"2024-04-26T20:57:52.577388+0000","last_active":"2024-04-26T20:58:10.649099+0000","last_peered":"2024-04-26T20:58:10.649099+0000","last_clean":"2024-04-26T20:58:10.649099+0000","last_became_active":"2024-04-26T20:57:52.577116+0000","last_became_peered":"2024-04-26T20:57:52.577116+0000","last_unstale":"2024-04-26T20:58:10.649099+0000","last_undegraded":"2024-04-26T20:58:10.649099+0000","last_fullsized":"2024-04-26T20:58:10.649099+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:26.856916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"42'23","reported_seq":45,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T20:58:07.655160+0000","last_change":"2024-04-26T20:57:51.574348+0000","last_active":"2024-04-26T20:58:07.655160+0000","last_peered":"2024-04-26T20:58:07.655160+0000","last_clean":"2024-04-26T20:58:07.655160+0000","last_became_active":"2024-04-26T20:57:51.574023+0000","last_became_peered":"2024-04-26T20:57:51.574023+0000","last_unstale":"2024-04-26T20:58:07.655160+0000","last_undegraded":"2024-04-26T20:58:07.655160+0000","last_fullsized":"2024-04-26T20:58:07.655160+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:29:31.014100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.659792+0000","last_change":"2024-04-26T20:58:10.657279+0000","last_active":"2024-04-26T20:58:10.659792+0000","last_peered":"2024-04-26T20:58:10.659792+0000","last_clean":"2024-04-26T20:58:10.659792+0000","last_became_active":"2024-04-26T20:58:10.656680+0000","last_became_peered":"2024-04-26T20:58:10.656680+0000","last_unstale":"2024-04-26T20:58:10.659792+0000","last_undegraded":"2024-04-26T20:58:10.659792+0000","last_fullsized":"2024-04-26T20:58:10.659792+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:31.277054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"41'6","reported_seq":26,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T20:58:07.654577+0000","last_change":"2024-04-26T20:57:52.583405+0000","last_active":"2024-04-26T20:58:07.654577+0000","last_peered":"2024-04-26T20:58:07.654577+0000","last_clean":"2024-04-26T20:58:07.654577+0000","last_became_active":"2024-04-26T20:57:52.582257+0000","last_became_peered":"2024-04-26T20:57:52.582257+0000","last_unstale":"2024-04-26T20:58:07.654577+0000","last_undegraded":"2024-04-26T20:58:07.654577+0000","last_fullsized":"2024-04-26T20:58:07.654577+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:39.396387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"42'5","reported_seq":27,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T20:58:07.654555+0000","last_change":"2024-04-26T20:57:51.572541+0000","last_active":"2024-04-26T20:58:07.654555+0000","last_peered":"2024-04-26T20:58:07.654555+0000","last_clean":"2024-04-26T20:58:07.654555+0000","last_became_active":"2024-04-26T20:57:51.571967+0000","last_became_peered":"2024-04-26T20:57:51.571967+0000","last_unstale":"2024-04-26T20:58:07.654555+0000","last_undegraded":"2024-04-26T20:58:07.654555+0000","last_fullsized":"2024-04-26T20:58:07.654555+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:11:04.894675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.675770+0000","last_change":"2024-04-26T20:58:10.671439+0000","last_active":"2024-04-26T20:58:10.675770+0000","last_peered":"2024-04-26T20:58:10.675770+0000","last_clean":"2024-04-26T20:58:10.675770+0000","last_became_active":"2024-04-26T20:58:10.671079+0000","last_became_peered":"2024-04-26T20:58:10.671079+0000","last_unstale":"2024-04-26T20:58:10.675770+0000","last_undegraded":"2024-04-26T20:58:10.675770+0000","last_fullsized":"2024-04-26T20:58:10.675770+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:28:38.251611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"41'6","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.658248+0000","last_change":"2024-04-26T20:57:52.581005+0000","last_active":"2024-04-26T20:58:10.658248+0000","last_peered":"2024-04-26T20:58:10.658248+0000","last_clean":"2024-04-26T20:58:10.658248+0000","last_became_active":"2024-04-26T20:57:52.580685+0000","last_became_peered":"2024-04-26T20:57:52.580685+0000","last_unstale":"2024-04-26T20:58:10.658248+0000","last_undegraded":"2024-04-26T20:58:10.658248+0000","last_fullsized":"2024-04-26T20:58:10.658248+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:18.275862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":26,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.657736+0000","last_change":"2024-04-26T20:57:51.571181+0000","last_active":"2024-04-26T20:58:10.657736+0000","last_peered":"2024-04-26T20:58:10.657736+0000","last_clean":"2024-04-26T20:58:10.657736+0000","last_became_active":"2024-04-26T20:57:51.570305+0000","last_became_peered":"2024-04-26T20:57:51.570305+0000","last_unstale":"2024-04-26T20:58:10.657736+0000","last_undegraded":"2024-04-26T20:58:10.657736+0000","last_fullsized":"2024-04-26T20:58:10.657736+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:43:07.969141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.675913+0000","last_change":"2024-04-26T20:58:10.671520+0000","last_active":"2024-04-26T20:58:10.675913+0000","last_peered":"2024-04-26T20:58:10.675913+0000","last_clean":"2024-04-26T20:58:10.675913+0000","last_became_active":"2024-04-26T20:58:10.671157+0000","last_became_peered":"2024-04-26T20:58:10.671157+0000","last_unstale":"2024-04-26T20:58:10.675913+0000","last_undegraded":"2024-04-26T20:58:10.675913+0000","last_fullsized":"2024-04-26T20:58:10.675913+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:44.950848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"41'10","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.651790+0000","last_change":"2024-04-26T20:57:52.584791+0000","last_active":"2024-04-26T20:58:10.651790+0000","last_peered":"2024-04-26T20:58:10.651790+0000","last_clean":"2024-04-26T20:58:10.651790+0000","last_became_active":"2024-04-26T20:57:52.575922+0000","last_became_peered":"2024-04-26T20:57:52.575922+0000","last_unstale":"2024-04-26T20:58:10.651790+0000","last_undegraded":"2024-04-26T20:58:10.651790+0000","last_fullsized":"2024-04-26T20:58:10.651790+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:50:20.927595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":27,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.652641+0000","last_change":"2024-04-26T20:57:51.563498+0000","last_active":"2024-04-26T20:58:10.652641+0000","last_peered":"2024-04-26T20:58:10.652641+0000","last_clean":"2024-04-26T20:58:10.652641+0000","last_became_active":"2024-04-26T20:57:51.563243+0000","last_became_peered":"2024-04-26T20:57:51.563243+0000","last_unstale":"2024-04-26T20:58:10.652641+0000","last_undegraded":"2024-04-26T20:58:10.652641+0000","last_fullsized":"2024-04-26T20:58:10.652641+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:47:09.428746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.668897+0000","last_change":"2024-04-26T20:58:10.665998+0000","last_active":"2024-04-26T20:58:10.668897+0000","last_peered":"2024-04-26T20:58:10.668897+0000","last_clean":"2024-04-26T20:58:10.668897+0000","last_became_active":"2024-04-26T20:58:10.665637+0000","last_became_peered":"2024-04-26T20:58:10.665637+0000","last_unstale":"2024-04-26T20:58:10.668897+0000","last_undegraded":"2024-04-26T20:58:10.668897+0000","last_fullsized":"2024-04-26T20:58:10.668897+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:02.739631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"41'15","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.660521+0000","last_change":"2024-04-26T20:57:52.584930+0000","last_active":"2024-04-26T20:58:10.660521+0000","last_peered":"2024-04-26T20:58:10.660521+0000","last_clean":"2024-04-26T20:58:10.660521+0000","last_became_active":"2024-04-26T20:57:52.584641+0000","last_became_peered":"2024-04-26T20:57:52.584641+0000","last_unstale":"2024-04-26T20:58:10.660521+0000","last_undegraded":"2024-04-26T20:58:10.660521+0000","last_fullsized":"2024-04-26T20:58:10.660521+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:37:58.253968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"42'15","reported_seq":43,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.653626+0000","last_change":"2024-04-26T20:57:51.567931+0000","last_active":"2024-04-26T20:58:10.653626+0000","last_peered":"2024-04-26T20:58:10.653626+0000","last_clean":"2024-04-26T20:58:10.653626+0000","last_became_active":"2024-04-26T20:57:51.567552+0000","last_became_peered":"2024-04-26T20:57:51.567552+0000","last_unstale":"2024-04-26T20:58:10.653626+0000","last_undegraded":"2024-04-26T20:58:10.653626+0000","last_fullsized":"2024-04-26T20:58:10.653626+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:32.553314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.664571+0000","last_change":"2024-04-26T20:58:10.663370+0000","last_active":"2024-04-26T20:58:10.664571+0000","last_peered":"2024-04-26T20:58:10.664571+0000","last_clean":"2024-04-26T20:58:10.664571+0000","last_became_active":"2024-04-26T20:58:10.663079+0000","last_became_peered":"2024-04-26T20:58:10.663079+0000","last_unstale":"2024-04-26T20:58:10.664571+0000","last_undegraded":"2024-04-26T20:58:10.664571+0000","last_fullsized":"2024-04-26T20:58:10.664571+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:43:59.225293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"41'6","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.657455+0000","last_change":"2024-04-26T20:57:52.581758+0000","last_active":"2024-04-26T20:58:10.657455+0000","last_peered":"2024-04-26T20:58:10.657455+0000","last_clean":"2024-04-26T20:58:10.657455+0000","last_became_active":"2024-04-26T20:57:52.581085+0000","last_became_peered":"2024-04-26T20:57:52.581085+0000","last_unstale":"2024-04-26T20:58:10.657455+0000","last_undegraded":"2024-04-26T20:58:10.657455+0000","last_fullsized":"2024-04-26T20:58:10.657455+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:49:19.250429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"42'2","reported_seq":27,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.649194+0000","last_change":"2024-04-26T20:57:51.575710+0000","last_active":"2024-04-26T20:58:10.649194+0000","last_peered":"2024-04-26T20:58:10.649194+0000","last_clean":"2024-04-26T20:58:10.649194+0000","last_became_active":"2024-04-26T20:57:51.575446+0000","last_became_peered":"2024-04-26T20:57:51.575446+0000","last_unstale":"2024-04-26T20:58:10.649194+0000","last_undegraded":"2024-04-26T20:58:10.649194+0000","last_fullsized":"2024-04-26T20:58:10.649194+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:05.463288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.672682+0000","last_change":"2024-04-26T20:58:10.670833+0000","last_active":"2024-04-26T20:58:10.672682+0000","last_peered":"2024-04-26T20:58:10.672682+0000","last_clean":"2024-04-26T20:58:10.672682+0000","last_became_active":"2024-04-26T20:58:10.670522+0000","last_became_peered":"2024-04-26T20:58:10.670522+0000","last_unstale":"2024-04-26T20:58:10.672682+0000","last_undegraded":"2024-04-26T20:58:10.672682+0000","last_fullsized":"2024-04-26T20:58:10.672682+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:06:19.339683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"41'7","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.648935+0000","last_change":"2024-04-26T20:57:52.585080+0000","last_active":"2024-04-26T20:58:10.648935+0000","last_peered":"2024-04-26T20:58:10.648935+0000","last_clean":"2024-04-26T20:58:10.648935+0000","last_became_active":"2024-04-26T20:57:52.584794+0000","last_became_peered":"2024-04-26T20:57:52.584794+0000","last_unstale":"2024-04-26T20:58:10.648935+0000","last_undegraded":"2024-04-26T20:58:10.648935+0000","last_fullsized":"2024-04-26T20:58:10.648935+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:13.183123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"42'3","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.653661+0000","last_change":"2024-04-26T20:57:51.569389+0000","last_active":"2024-04-26T20:58:10.653661+0000","last_peered":"2024-04-26T20:58:10.653661+0000","last_clean":"2024-04-26T20:58:10.653661+0000","last_became_active":"2024-04-26T20:57:51.569128+0000","last_became_peered":"2024-04-26T20:57:51.569128+0000","last_unstale":"2024-04-26T20:58:10.653661+0000","last_undegraded":"2024-04-26T20:58:10.653661+0000","last_fullsized":"2024-04-26T20:58:10.653661+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:44.305635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.678143+0000","last_change":"2024-04-26T20:58:10.673866+0000","last_active":"2024-04-26T20:58:10.678143+0000","last_peered":"2024-04-26T20:58:10.678143+0000","last_clean":"2024-04-26T20:58:10.678143+0000","last_became_active":"2024-04-26T20:58:10.673565+0000","last_became_peered":"2024-04-26T20:58:10.673565+0000","last_unstale":"2024-04-26T20:58:10.678143+0000","last_undegraded":"2024-04-26T20:58:10.678143+0000","last_fullsized":"2024-04-26T20:58:10.678143+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:12:23.450727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"41'5","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.649298+0000","last_change":"2024-04-26T20:57:52.580234+0000","last_active":"2024-04-26T20:58:10.649298+0000","last_peered":"2024-04-26T20:58:10.649298+0000","last_clean":"2024-04-26T20:58:10.649298+0000","last_became_active":"2024-04-26T20:57:52.579929+0000","last_became_peered":"2024-04-26T20:57:52.579929+0000","last_unstale":"2024-04-26T20:58:10.649298+0000","last_undegraded":"2024-04-26T20:58:10.649298+0000","last_fullsized":"2024-04-26T20:58:10.649298+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:06:01.245752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"42'2","reported_seq":28,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.661236+0000","last_change":"2024-04-26T20:57:51.577610+0000","last_active":"2024-04-26T20:58:10.661236+0000","last_peered":"2024-04-26T20:58:10.661236+0000","last_clean":"2024-04-26T20:58:10.661236+0000","last_became_active":"2024-04-26T20:57:51.577352+0000","last_became_peered":"2024-04-26T20:57:51.577352+0000","last_unstale":"2024-04-26T20:58:10.661236+0000","last_undegraded":"2024-04-26T20:58:10.661236+0000","last_fullsized":"2024-04-26T20:58:10.661236+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:05:01.247112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.675950+0000","last_change":"2024-04-26T20:58:10.672457+0000","last_active":"2024-04-26T20:58:10.675950+0000","last_peered":"2024-04-26T20:58:10.675950+0000","last_clean":"2024-04-26T20:58:10.675950+0000","last_became_active":"2024-04-26T20:58:10.671871+0000","last_became_peered":"2024-04-26T20:58:10.671871+0000","last_unstale":"2024-04-26T20:58:10.675950+0000","last_undegraded":"2024-04-26T20:58:10.675950+0000","last_fullsized":"2024-04-26T20:58:10.675950+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:06:19.339683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"41'9","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.666797+0000","last_change":"2024-04-26T20:57:52.593107+0000","last_active":"2024-04-26T20:58:10.666797+0000","last_peered":"2024-04-26T20:58:10.666797+0000","last_clean":"2024-04-26T20:58:10.666797+0000","last_became_active":"2024-04-26T20:57:52.592849+0000","last_became_peered":"2024-04-26T20:57:52.592849+0000","last_unstale":"2024-04-26T20:58:10.666797+0000","last_undegraded":"2024-04-26T20:58:10.666797+0000","last_fullsized":"2024-04-26T20:58:10.666797+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:18.275862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":25,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.663053+0000","last_change":"2024-04-26T20:57:51.573218+0000","last_active":"2024-04-26T20:58:10.663053+0000","last_peered":"2024-04-26T20:58:10.663053+0000","last_clean":"2024-04-26T20:58:10.663053+0000","last_became_active":"2024-04-26T20:57:51.572070+0000","last_became_peered":"2024-04-26T20:57:51.572070+0000","last_unstale":"2024-04-26T20:58:10.663053+0000","last_undegraded":"2024-04-26T20:58:10.663053+0000","last_fullsized":"2024-04-26T20:58:10.663053+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:43.209710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.673771+0000","last_change":"2024-04-26T20:58:10.669638+0000","last_active":"2024-04-26T20:58:10.673771+0000","last_peered":"2024-04-26T20:58:10.673771+0000","last_clean":"2024-04-26T20:58:10.673771+0000","last_became_active":"2024-04-26T20:58:10.669290+0000","last_became_peered":"2024-04-26T20:58:10.669290+0000","last_unstale":"2024-04-26T20:58:10.673771+0000","last_undegraded":"2024-04-26T20:58:10.673771+0000","last_fullsized":"2024-04-26T20:58:10.673771+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:40:10.235206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"41'9","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.652124+0000","last_change":"2024-04-26T20:57:52.580620+0000","last_active":"2024-04-26T20:58:10.652124+0000","last_peered":"2024-04-26T20:58:10.652124+0000","last_clean":"2024-04-26T20:58:10.652124+0000","last_became_active":"2024-04-26T20:57:52.580262+0000","last_became_peered":"2024-04-26T20:57:52.580262+0000","last_unstale":"2024-04-26T20:58:10.652124+0000","last_undegraded":"2024-04-26T20:58:10.652124+0000","last_fullsized":"2024-04-26T20:58:10.652124+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:17:36.055479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"42'4","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.663095+0000","last_change":"2024-04-26T20:57:51.572477+0000","last_active":"2024-04-26T20:58:10.663095+0000","last_peered":"2024-04-26T20:58:10.663095+0000","last_clean":"2024-04-26T20:58:10.663095+0000","last_became_active":"2024-04-26T20:57:51.572200+0000","last_became_peered":"2024-04-26T20:57:51.572200+0000","last_unstale":"2024-04-26T20:58:10.663095+0000","last_undegraded":"2024-04-26T20:58:10.663095+0000","last_fullsized":"2024-04-26T20:58:10.663095+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:03:39.964597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.672417+0000","last_change":"2024-04-26T20:58:10.666288+0000","last_active":"2024-04-26T20:58:10.672417+0000","last_peered":"2024-04-26T20:58:10.672417+0000","last_clean":"2024-04-26T20:58:10.672417+0000","last_became_active":"2024-04-26T20:58:10.665961+0000","last_became_peered":"2024-04-26T20:58:10.665961+0000","last_unstale":"2024-04-26T20:58:10.672417+0000","last_undegraded":"2024-04-26T20:58:10.672417+0000","last_fullsized":"2024-04-26T20:58:10.672417+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:44:21.388441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"41'2","reported_seq":22,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T20:58:07.654114+0000","last_change":"2024-04-26T20:57:52.570952+0000","last_active":"2024-04-26T20:58:07.654114+0000","last_peered":"2024-04-26T20:58:07.654114+0000","last_clean":"2024-04-26T20:58:07.654114+0000","last_became_active":"2024-04-26T20:57:52.570601+0000","last_became_peered":"2024-04-26T20:57:52.570601+0000","last_unstale":"2024-04-26T20:58:07.654114+0000","last_undegraded":"2024-04-26T20:58:07.654114+0000","last_fullsized":"2024-04-26T20:58:07.654114+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:05.767731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":26,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.657844+0000","last_change":"2024-04-26T20:57:51.575051+0000","last_active":"2024-04-26T20:58:10.657844+0000","last_peered":"2024-04-26T20:58:10.657844+0000","last_clean":"2024-04-26T20:58:10.657844+0000","last_became_active":"2024-04-26T20:57:51.574755+0000","last_became_peered":"2024-04-26T20:57:51.574755+0000","last_unstale":"2024-04-26T20:58:10.657844+0000","last_undegraded":"2024-04-26T20:58:10.657844+0000","last_fullsized":"2024-04-26T20:58:10.657844+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:32.553314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.678816+0000","last_change":"2024-04-26T20:58:10.676156+0000","last_active":"2024-04-26T20:58:10.678816+0000","last_peered":"2024-04-26T20:58:10.678816+0000","last_clean":"2024-04-26T20:58:10.678816+0000","last_became_active":"2024-04-26T20:58:10.674594+0000","last_became_peered":"2024-04-26T20:58:10.674594+0000","last_unstale":"2024-04-26T20:58:10.678816+0000","last_undegraded":"2024-04-26T20:58:10.678816+0000","last_fullsized":"2024-04-26T20:58:10.678816+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:23.447610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"41'5","reported_seq":32,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.651508+0000","last_change":"2024-04-26T20:57:52.584567+0000","last_active":"2024-04-26T20:58:10.651508+0000","last_peered":"2024-04-26T20:58:10.651508+0000","last_clean":"2024-04-26T20:58:10.651508+0000","last_became_active":"2024-04-26T20:57:52.584136+0000","last_became_peered":"2024-04-26T20:57:52.584136+0000","last_unstale":"2024-04-26T20:58:10.651508+0000","last_undegraded":"2024-04-26T20:58:10.651508+0000","last_fullsized":"2024-04-26T20:58:10.651508+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:39:52.141275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":25,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.648436+0000","last_change":"2024-04-26T20:57:51.573894+0000","last_active":"2024-04-26T20:58:10.648436+0000","last_peered":"2024-04-26T20:58:10.648436+0000","last_clean":"2024-04-26T20:58:10.648436+0000","last_became_active":"2024-04-26T20:57:51.573467+0000","last_became_peered":"2024-04-26T20:57:51.573467+0000","last_unstale":"2024-04-26T20:58:10.648436+0000","last_undegraded":"2024-04-26T20:58:10.648436+0000","last_fullsized":"2024-04-26T20:58:10.648436+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:53.725346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:58:09.636100+0000","last_change":"2024-04-26T20:58:09.636100+0000","last_active":"2024-04-26T20:58:09.636100+0000","last_peered":"2024-04-26T20:58:09.636100+0000","last_clean":"2024-04-26T20:58:09.636100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:58:09.636100+0000","last_undegraded":"2024-04-26T20:58:09.636100+0000","last_fullsized":"2024-04-26T20:58:09.636100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"41'8","reported_seq":28,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T20:58:07.654320+0000","last_change":"2024-04-26T20:57:52.570583+0000","last_active":"2024-04-26T20:58:07.654320+0000","last_peered":"2024-04-26T20:58:07.654320+0000","last_clean":"2024-04-26T20:58:07.654320+0000","last_became_active":"2024-04-26T20:57:52.570303+0000","last_became_peered":"2024-04-26T20:57:52.570303+0000","last_unstale":"2024-04-26T20:58:07.654320+0000","last_undegraded":"2024-04-26T20:58:07.654320+0000","last_fullsized":"2024-04-26T20:58:07.654320+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:45.016039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":26,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.657330+0000","last_change":"2024-04-26T20:57:51.571920+0000","last_active":"2024-04-26T20:58:10.657330+0000","last_peered":"2024-04-26T20:58:10.657330+0000","last_clean":"2024-04-26T20:58:10.657330+0000","last_became_active":"2024-04-26T20:57:51.571644+0000","last_became_peered":"2024-04-26T20:57:51.571644+0000","last_unstale":"2024-04-26T20:58:10.657330+0000","last_undegraded":"2024-04-26T20:58:10.657330+0000","last_fullsized":"2024-04-26T20:58:10.657330+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:55:41.720506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.672105+0000","last_change":"2024-04-26T20:58:10.670799+0000","last_active":"2024-04-26T20:58:10.672105+0000","last_peered":"2024-04-26T20:58:10.672105+0000","last_clean":"2024-04-26T20:58:10.672105+0000","last_became_active":"2024-04-26T20:58:10.670514+0000","last_became_peered":"2024-04-26T20:58:10.670514+0000","last_unstale":"2024-04-26T20:58:10.672105+0000","last_undegraded":"2024-04-26T20:58:10.672105+0000","last_fullsized":"2024-04-26T20:58:10.672105+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:54:02.371720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"41'9","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.662414+0000","last_change":"2024-04-26T20:57:52.593531+0000","last_active":"2024-04-26T20:58:10.662414+0000","last_peered":"2024-04-26T20:58:10.662414+0000","last_clean":"2024-04-26T20:58:10.662414+0000","last_became_active":"2024-04-26T20:57:52.592602+0000","last_became_peered":"2024-04-26T20:57:52.592602+0000","last_unstale":"2024-04-26T20:58:10.662414+0000","last_undegraded":"2024-04-26T20:58:10.662414+0000","last_fullsized":"2024-04-26T20:58:10.662414+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:13.183123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"42'3","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.653774+0000","last_change":"2024-04-26T20:57:51.570771+0000","last_active":"2024-04-26T20:58:10.653774+0000","last_peered":"2024-04-26T20:58:10.653774+0000","last_clean":"2024-04-26T20:58:10.653774+0000","last_became_active":"2024-04-26T20:57:51.570488+0000","last_became_peered":"2024-04-26T20:57:51.570488+0000","last_unstale":"2024-04-26T20:58:10.653774+0000","last_undegraded":"2024-04-26T20:58:10.653774+0000","last_fullsized":"2024-04-26T20:58:10.653774+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:44:02.286474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:58:09.636100+0000","last_change":"2024-04-26T20:58:09.636100+0000","last_active":"2024-04-26T20:58:09.636100+0000","last_peered":"2024-04-26T20:58:09.636100+0000","last_clean":"2024-04-26T20:58:09.636100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:58:09.636100+0000","last_undegraded":"2024-04-26T20:58:09.636100+0000","last_fullsized":"2024-04-26T20:58:09.636100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"41'5","reported_seq":32,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.652315+0000","last_change":"2024-04-26T20:57:52.579072+0000","last_active":"2024-04-26T20:58:10.652315+0000","last_peered":"2024-04-26T20:58:10.652315+0000","last_clean":"2024-04-26T20:58:10.652315+0000","last_became_active":"2024-04-26T20:57:52.578605+0000","last_became_peered":"2024-04-26T20:57:52.578605+0000","last_unstale":"2024-04-26T20:58:10.652315+0000","last_undegraded":"2024-04-26T20:58:10.652315+0000","last_fullsized":"2024-04-26T20:58:10.652315+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:29:56.009862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"42'5","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.664616+0000","last_change":"2024-04-26T20:57:51.577840+0000","last_active":"2024-04-26T20:58:10.664616+0000","last_peered":"2024-04-26T20:58:10.664616+0000","last_clean":"2024-04-26T20:58:10.664616+0000","last_became_active":"2024-04-26T20:57:51.577584+0000","last_became_peered":"2024-04-26T20:57:51.577584+0000","last_unstale":"2024-04-26T20:58:10.664616+0000","last_undegraded":"2024-04-26T20:58:10.664616+0000","last_fullsized":"2024-04-26T20:58:10.664616+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:41:35.733249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.669904+0000","last_change":"2024-04-26T20:58:10.668616+0000","last_active":"2024-04-26T20:58:10.669904+0000","last_peered":"2024-04-26T20:58:10.669904+0000","last_clean":"2024-04-26T20:58:10.669904+0000","last_became_active":"2024-04-26T20:58:10.668030+0000","last_became_peered":"2024-04-26T20:58:10.668030+0000","last_unstale":"2024-04-26T20:58:10.669904+0000","last_undegraded":"2024-04-26T20:58:10.669904+0000","last_fullsized":"2024-04-26T20:58:10.669904+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:55:04.636924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"41'7","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.665649+0000","last_change":"2024-04-26T20:57:52.580763+0000","last_active":"2024-04-26T20:58:10.665649+0000","last_peered":"2024-04-26T20:58:10.665649+0000","last_clean":"2024-04-26T20:58:10.665649+0000","last_became_active":"2024-04-26T20:57:52.580489+0000","last_became_peered":"2024-04-26T20:57:52.580489+0000","last_unstale":"2024-04-26T20:58:10.665649+0000","last_undegraded":"2024-04-26T20:58:10.665649+0000","last_fullsized":"2024-04-26T20:58:10.665649+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:52:00.840874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":26,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.661342+0000","last_change":"2024-04-26T20:57:51.574263+0000","last_active":"2024-04-26T20:58:10.661342+0000","last_peered":"2024-04-26T20:58:10.661342+0000","last_clean":"2024-04-26T20:58:10.661342+0000","last_became_active":"2024-04-26T20:57:51.573941+0000","last_became_peered":"2024-04-26T20:57:51.573941+0000","last_unstale":"2024-04-26T20:58:10.661342+0000","last_undegraded":"2024-04-26T20:58:10.661342+0000","last_fullsized":"2024-04-26T20:58:10.661342+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:38.596761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.659812+0000","last_change":"2024-04-26T20:58:10.657492+0000","last_active":"2024-04-26T20:58:10.659812+0000","last_peered":"2024-04-26T20:58:10.659812+0000","last_clean":"2024-04-26T20:58:10.659812+0000","last_became_active":"2024-04-26T20:58:10.657039+0000","last_became_peered":"2024-04-26T20:58:10.657039+0000","last_unstale":"2024-04-26T20:58:10.659812+0000","last_undegraded":"2024-04-26T20:58:10.659812+0000","last_fullsized":"2024-04-26T20:58:10.659812+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:28:38.251611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"41'8","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.659974+0000","last_change":"2024-04-26T20:57:52.592217+0000","last_active":"2024-04-26T20:58:10.659974+0000","last_peered":"2024-04-26T20:58:10.659974+0000","last_clean":"2024-04-26T20:58:10.659974+0000","last_became_active":"2024-04-26T20:57:52.591954+0000","last_became_peered":"2024-04-26T20:57:52.591954+0000","last_unstale":"2024-04-26T20:58:10.659974+0000","last_undegraded":"2024-04-26T20:58:10.659974+0000","last_fullsized":"2024-04-26T20:58:10.659974+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:23:22.653755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":22,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T20:58:07.654567+0000","last_change":"2024-04-26T20:57:51.571206+0000","last_active":"2024-04-26T20:58:07.654567+0000","last_peered":"2024-04-26T20:58:07.654567+0000","last_clean":"2024-04-26T20:58:07.654567+0000","last_became_active":"2024-04-26T20:57:51.570877+0000","last_became_peered":"2024-04-26T20:57:51.570877+0000","last_unstale":"2024-04-26T20:58:07.654567+0000","last_undegraded":"2024-04-26T20:58:07.654567+0000","last_fullsized":"2024-04-26T20:58:07.654567+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:49:38.164099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.667620+0000","last_change":"2024-04-26T20:58:10.665973+0000","last_active":"2024-04-26T20:58:10.667620+0000","last_peered":"2024-04-26T20:58:10.667620+0000","last_clean":"2024-04-26T20:58:10.667620+0000","last_became_active":"2024-04-26T20:58:10.665680+0000","last_became_peered":"2024-04-26T20:58:10.665680+0000","last_unstale":"2024-04-26T20:58:10.667620+0000","last_undegraded":"2024-04-26T20:58:10.667620+0000","last_fullsized":"2024-04-26T20:58:10.667620+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:06:56.528347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"41'5","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.658435+0000","last_change":"2024-04-26T20:57:52.594833+0000","last_active":"2024-04-26T20:58:10.658435+0000","last_peered":"2024-04-26T20:58:10.658435+0000","last_clean":"2024-04-26T20:58:10.658435+0000","last_became_active":"2024-04-26T20:57:52.594522+0000","last_became_peered":"2024-04-26T20:57:52.594522+0000","last_unstale":"2024-04-26T20:58:10.658435+0000","last_undegraded":"2024-04-26T20:58:10.658435+0000","last_fullsized":"2024-04-26T20:58:10.658435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:45.313671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":28,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.651880+0000","last_change":"2024-04-26T20:57:51.574086+0000","last_active":"2024-04-26T20:58:10.651880+0000","last_peered":"2024-04-26T20:58:10.651880+0000","last_clean":"2024-04-26T20:58:10.651880+0000","last_became_active":"2024-04-26T20:57:51.573834+0000","last_became_peered":"2024-04-26T20:57:51.573834+0000","last_unstale":"2024-04-26T20:58:10.651880+0000","last_undegraded":"2024-04-26T20:58:10.651880+0000","last_fullsized":"2024-04-26T20:58:10.651880+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:50:32.238625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.672714+0000","last_change":"2024-04-26T20:58:10.667021+0000","last_active":"2024-04-26T20:58:10.672714+0000","last_peered":"2024-04-26T20:58:10.672714+0000","last_clean":"2024-04-26T20:58:10.672714+0000","last_became_active":"2024-04-26T20:58:10.666042+0000","last_became_peered":"2024-04-26T20:58:10.666042+0000","last_unstale":"2024-04-26T20:58:10.672714+0000","last_undegraded":"2024-04-26T20:58:10.672714+0000","last_fullsized":"2024-04-26T20:58:10.672714+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:03.407602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"41'8","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.653027+0000","last_change":"2024-04-26T20:57:52.588655+0000","last_active":"2024-04-26T20:58:10.653027+0000","last_peered":"2024-04-26T20:58:10.653027+0000","last_clean":"2024-04-26T20:58:10.653027+0000","last_became_active":"2024-04-26T20:57:52.588356+0000","last_became_peered":"2024-04-26T20:57:52.588356+0000","last_unstale":"2024-04-26T20:58:10.653027+0000","last_undegraded":"2024-04-26T20:58:10.653027+0000","last_fullsized":"2024-04-26T20:58:10.653027+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:23.034777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":27,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.652745+0000","last_change":"2024-04-26T20:57:51.567675+0000","last_active":"2024-04-26T20:58:10.652745+0000","last_peered":"2024-04-26T20:58:10.652745+0000","last_clean":"2024-04-26T20:58:10.652745+0000","last_became_active":"2024-04-26T20:57:51.567464+0000","last_became_peered":"2024-04-26T20:57:51.567464+0000","last_unstale":"2024-04-26T20:58:10.652745+0000","last_undegraded":"2024-04-26T20:58:10.652745+0000","last_fullsized":"2024-04-26T20:58:10.652745+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:17.267826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:58:09.636100+0000","last_change":"2024-04-26T20:58:09.636100+0000","last_active":"2024-04-26T20:58:09.636100+0000","last_peered":"2024-04-26T20:58:09.636100+0000","last_clean":"2024-04-26T20:58:09.636100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:58:09.636100+0000","last_undegraded":"2024-04-26T20:58:09.636100+0000","last_fullsized":"2024-04-26T20:58:09.636100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"41'7","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.651737+0000","last_change":"2024-04-26T20:57:52.587210+0000","last_active":"2024-04-26T20:58:10.651737+0000","last_peered":"2024-04-26T20:58:10.651737+0000","last_clean":"2024-04-26T20:58:10.651737+0000","last_became_active":"2024-04-26T20:57:52.587015+0000","last_became_peered":"2024-04-26T20:57:52.587015+0000","last_unstale":"2024-04-26T20:58:10.651737+0000","last_undegraded":"2024-04-26T20:58:10.651737+0000","last_fullsized":"2024-04-26T20:58:10.651737+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:05.353679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":22,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T20:58:07.654660+0000","last_change":"2024-04-26T20:57:51.579142+0000","last_active":"2024-04-26T20:58:07.654660+0000","last_peered":"2024-04-26T20:58:07.654660+0000","last_clean":"2024-04-26T20:58:07.654660+0000","last_became_active":"2024-04-26T20:57:51.578834+0000","last_became_peered":"2024-04-26T20:57:51.578834+0000","last_unstale":"2024-04-26T20:58:07.654660+0000","last_undegraded":"2024-04-26T20:58:07.654660+0000","last_fullsized":"2024-04-26T20:58:07.654660+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:48:04.831644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.673957+0000","last_change":"2024-04-26T20:58:10.671508+0000","last_active":"2024-04-26T20:58:10.673957+0000","last_peered":"2024-04-26T20:58:10.673957+0000","last_clean":"2024-04-26T20:58:10.673957+0000","last_became_active":"2024-04-26T20:58:10.671203+0000","last_became_peered":"2024-04-26T20:58:10.671203+0000","last_unstale":"2024-04-26T20:58:10.673957+0000","last_undegraded":"2024-04-26T20:58:10.673957+0000","last_fullsized":"2024-04-26T20:58:10.673957+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:23.447610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"41'8","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.653562+0000","last_change":"2024-04-26T20:57:52.569231+0000","last_active":"2024-04-26T20:58:10.653562+0000","last_peered":"2024-04-26T20:58:10.653562+0000","last_clean":"2024-04-26T20:58:10.653562+0000","last_became_active":"2024-04-26T20:57:52.568915+0000","last_became_peered":"2024-04-26T20:57:52.568915+0000","last_unstale":"2024-04-26T20:58:10.653562+0000","last_undegraded":"2024-04-26T20:58:10.653562+0000","last_fullsized":"2024-04-26T20:58:10.653562+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:48.878142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":28,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.651893+0000","last_change":"2024-04-26T20:57:51.574337+0000","last_active":"2024-04-26T20:58:10.651893+0000","last_peered":"2024-04-26T20:58:10.651893+0000","last_clean":"2024-04-26T20:58:10.651893+0000","last_became_active":"2024-04-26T20:57:51.573114+0000","last_became_peered":"2024-04-26T20:57:51.573114+0000","last_unstale":"2024-04-26T20:58:10.651893+0000","last_undegraded":"2024-04-26T20:58:10.651893+0000","last_fullsized":"2024-04-26T20:58:10.651893+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:36:54.823396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":215,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.648435+0000","last_change":"2024-04-26T20:56:29.347462+0000","last_active":"2024-04-26T20:58:10.648435+0000","last_peered":"2024-04-26T20:58:10.648435+0000","last_clean":"2024-04-26T20:58:10.648435+0000","last_became_active":"2024-04-26T20:56:29.346224+0000","last_became_peered":"2024-04-26T20:56:29.346224+0000","last_unstale":"2024-04-26T20:58:10.648435+0000","last_undegraded":"2024-04-26T20:58:10.648435+0000","last_fullsized":"2024-04-26T20:58:10.648435+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:28.079105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:28.079105+0000","last_clean_scrub_stamp":"2024-04-26T20:56:28.079105+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:13.693525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":7},{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":504,"ondisk_log_size":504,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":97,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":84,"ondisk_log_size":84,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509465,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":552960,"data_stored":246517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509464,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":552960,"data_stored":246517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509465,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32240,"kb_used_data":5216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":5341184,"data_stored":5031189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509465,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33708,"kb_used_data":6672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94338132,"statfs":{"total":96636764160,"available":96602247168,"internally_reserved":0,"allocated":6832128,"data_stored":6530257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509465,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":552960,"data_stored":246517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509464,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28144,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343696,"statfs":{"total":96636764160,"available":96607944704,"internally_reserved":0,"allocated":1146880,"data_stored":836885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509463,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29612,"kb_used_data":2588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342228,"statfs":{"total":96636764160,"available":96606441472,"internally_reserved":0,"allocated":2650112,"data_stored":2343669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27576,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344264,"statfs":{"total":96636764160,"available":96608526336,"internally_reserved":0,"allocated":528384,"data_stored":231644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T20:58:14.749 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T20:58:14.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.928+0000 7f5cb3e00640 1 Processor -- start 2024-04-26T20:58:14.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.928+0000 7f5cb3e00640 1 -- start start 2024-04-26T20:58:14.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.928+0000 7f5cb3e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f5cb4160530 0x7f5cb406ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:14.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.928+0000 7f5cb3e00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cb4070cf0 con 0x7f5cb40d3760 2024-04-26T20:58:14.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.928+0000 7f5cb3e00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cb4070fd0 con 0x7f5cb4071340 2024-04-26T20:58:14.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.928+0000 7f5cb3e00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f5cb40d1220 con 0x7f5cb4160530 2024-04-26T20:58:14.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.928+0000 7f5cb2a00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f5cb4160530 0x7f5cb406ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:14.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.928+0000 7f5cabe00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f5cb40d3760 0x7f5cb40704b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:60986/0 (socket says 172.21.15.138:60986) 2024-04-26T20:58:14.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.928+0000 7f5cabe00640 1 -- 172.21.15.138:0/211299750 learned_addr learned my addr 172.21.15.138:0/211299750 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:14.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.928+0000 7f5cb2a00640 1 -- 172.21.15.138:0/211299750 >> v1:172.21.15.143:6789/0 conn(0x7f5cb4071340 legacy=0x7f5cb40b13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:14.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.928+0000 7f5cb2a00640 1 -- 172.21.15.138:0/211299750 >> v1:172.21.15.138:6789/0 conn(0x7f5cb40d3760 legacy=0x7f5cb40704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:14.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.928+0000 7f5cb2a00640 1 -- 172.21.15.138:0/211299750 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cb40d1470 con 0x7f5cb4160530 2024-04-26T20:58:14.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.928+0000 7f5cb2000640 1 -- 172.21.15.138:0/211299750 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3382941368 0 0) 0x7f5cb4070cf0 con 0x7f5cb40d3760 2024-04-26T20:58:14.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.932+0000 7f5cb2a00640 1 --2- 172.21.15.138:0/211299750 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5cb4160530 0x7f5cb406ff70 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f5ca40097c0 tx=0x7f5ca401c280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b246381bf7055026 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:14.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.932+0000 7f5cb2000640 1 -- 172.21.15.138:0/211299750 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ca40b0070 con 0x7f5cb4160530 2024-04-26T20:58:14.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.932+0000 7f5cb2000640 1 -- 172.21.15.138:0/211299750 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ca40ab600 con 0x7f5cb4160530 2024-04-26T20:58:14.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.932+0000 7f5cb2000640 1 -- 172.21.15.138:0/211299750 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ca40ab9d0 con 0x7f5cb4160530 2024-04-26T20:58:14.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.932+0000 7f5cb3e00640 1 -- 172.21.15.138:0/211299750 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5cb4160530 msgr2=0x7f5cb406ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:14.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.932+0000 7f5cb3e00640 1 --2- 172.21.15.138:0/211299750 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5cb4160530 0x7f5cb406ff70 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f5ca40097c0 tx=0x7f5ca401c280 comp rx=0 tx=0).stop 2024-04-26T20:58:14.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.932+0000 7f5cb3e00640 1 -- 172.21.15.138:0/211299750 shutdown_connections 2024-04-26T20:58:14.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.932+0000 7f5cb3e00640 1 --2- 172.21.15.138:0/211299750 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5cb4160530 0x7f5cb406ff70 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:14.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.932+0000 7f5cb3e00640 1 -- 172.21.15.138:0/211299750 >> 172.21.15.138:0/211299750 conn(0x7f5cb40d2c40 msgr2=0x7f5cb40d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:14.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.932+0000 7f5cb3e00640 1 -- 172.21.15.138:0/211299750 shutdown_connections 2024-04-26T20:58:14.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.932+0000 7f5cb3e00640 1 -- 172.21.15.138:0/211299750 wait complete. 2024-04-26T20:58:14.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.932+0000 7f5cb3e00640 1 Processor -- start 2024-04-26T20:58:14.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.936+0000 7f5cb3e00640 1 -- start start 2024-04-26T20:58:14.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.936+0000 7f5cb3e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5cb4071340 0x7f5cb41497f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:14.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.936+0000 7f5cb3e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5cb40d3760 0x7f5cb4148f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:14.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.936+0000 7f5cb3e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5cb4160530 0x7f5cb40cfe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:14.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.936+0000 7f5cb3e00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb416ad90 con 0x7f5cb4071340 2024-04-26T20:58:14.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.936+0000 7f5cb3e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb4160b20 con 0x7f5cb40d3760 2024-04-26T20:58:14.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.936+0000 7f5cb3e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f5cb416af10 con 0x7f5cb4160530 2024-04-26T20:58:14.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.936+0000 7f5cb2a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5cb4071340 0x7f5cb41497f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:14.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.936+0000 7f5cb2a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5cb4071340 0x7f5cb41497f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:54180/0 (socket says 172.21.15.138:54180) 2024-04-26T20:58:14.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.936+0000 7f5cb2a00640 1 -- 172.21.15.138:0/214760099 learned_addr learned my addr 172.21.15.138:0/214760099 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:14.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.936+0000 7f5cabe00640 1 --2- 172.21.15.138:0/214760099 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5cb40d3760 0x7f5cb4148f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:14.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.936+0000 7f5cb3400640 1 --2- 172.21.15.138:0/214760099 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5cb4160530 0x7f5cb40cfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:14.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.936+0000 7f5cb2a00640 1 -- 172.21.15.138:0/214760099 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5cb4160530 msgr2=0x7f5cb40cfe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:14.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.936+0000 7f5cb2a00640 1 --2- 172.21.15.138:0/214760099 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5cb4160530 0x7f5cb40cfe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:14.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.936+0000 7f5cb2a00640 1 -- 172.21.15.138:0/214760099 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5cb40d3760 msgr2=0x7f5cb4148f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:14.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.936+0000 7f5cb2a00640 1 --2- 172.21.15.138:0/214760099 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5cb40d3760 0x7f5cb4148f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:14.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.936+0000 7f5cb2a00640 1 -- 172.21.15.138:0/214760099 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cb4153fe0 con 0x7f5cb4071340 2024-04-26T20:58:14.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.936+0000 7f5cabe00640 1 --2- 172.21.15.138:0/214760099 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5cb40d3760 0x7f5cb4148f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:58:14.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.936+0000 7f5cb3400640 1 --2- 172.21.15.138:0/214760099 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5cb4160530 0x7f5cb40cfe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:58:14.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.936+0000 7f5cb2a00640 1 --2- 172.21.15.138:0/214760099 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5cb4071340 0x7f5cb41497f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f5ca40ae040 tx=0x7f5ca401aac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:14.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.936+0000 7f5caaa00640 1 -- 172.21.15.138:0/214760099 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ca40b0050 con 0x7f5cb4071340 2024-04-26T20:58:14.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.936+0000 7f5caaa00640 1 -- 172.21.15.138:0/214760099 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ca40b1040 con 0x7f5cb4071340 2024-04-26T20:58:14.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.936+0000 7f5caaa00640 1 -- 172.21.15.138:0/214760099 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ca4004220 con 0x7f5cb4071340 2024-04-26T20:58:14.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.936+0000 7f5cb3e00640 1 -- 172.21.15.138:0/214760099 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cb40cf360 con 0x7f5cb4071340 2024-04-26T20:58:14.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.936+0000 7f5cb3e00640 1 -- 172.21.15.138:0/214760099 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cb40cf920 con 0x7f5cb4071340 2024-04-26T20:58:14.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.936+0000 7f5cb3e00640 1 -- 172.21.15.138:0/214760099 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cb4069430 con 0x7f5cb4071340 2024-04-26T20:58:14.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.940+0000 7f5caaa00640 1 -- 172.21.15.138:0/214760099 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5ca40be060 con 0x7f5cb4071340 2024-04-26T20:58:14.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.940+0000 7f5caaa00640 1 --2- 172.21.15.138:0/214760099 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5c90068380 0x7f5c9006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:14.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.940+0000 7f5caaa00640 1 -- 172.21.15.138:0/214760099 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6640+0+0 (secure 0 0 0) 0x7f5ca4120740 con 0x7f5cb4071340 2024-04-26T20:58:14.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.940+0000 7f5cabe00640 1 --2- 172.21.15.138:0/214760099 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5c90068380 0x7f5c9006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:14.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.940+0000 7f5cabe00640 1 --2- 172.21.15.138:0/214760099 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5c90068380 0x7f5c9006a840 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c007fd0 tx=0x7f5c9c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:14.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:14.944+0000 7f5caaa00640 1 -- 172.21.15.138:0/214760099 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5ca4016050 con 0x7f5cb4071340 2024-04-26T20:58:15.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.096+0000 7f5cb3e00640 1 -- 172.21.15.138:0/214760099 --> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5cb40cbd40 con 0x7f5c90068380 2024-04-26T20:58:15.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.104+0000 7f5caaa00640 1 -- 172.21.15.138:0/214760099 <== mgr.4100 v2:172.21.15.143:6832/4275464198 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+331713 (secure 0 0 0) 0x7f5cb40cbd40 con 0x7f5c90068380 2024-04-26T20:58:15.109 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:15.111 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-04-26T20:58:15.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.108+0000 7f5cb3e00640 1 -- 172.21.15.138:0/214760099 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5c90068380 msgr2=0x7f5c9006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:15.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.108+0000 7f5cb3e00640 1 --2- 172.21.15.138:0/214760099 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5c90068380 0x7f5c9006a840 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c007fd0 tx=0x7f5c9c009040 comp rx=0 tx=0).stop 2024-04-26T20:58:15.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.108+0000 7f5cb3e00640 1 -- 172.21.15.138:0/214760099 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5cb4071340 msgr2=0x7f5cb41497f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:15.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.108+0000 7f5cb3e00640 1 --2- 172.21.15.138:0/214760099 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5cb4071340 0x7f5cb41497f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f5ca40ae040 tx=0x7f5ca401aac0 comp rx=0 tx=0).stop 2024-04-26T20:58:15.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.108+0000 7f5cb3e00640 1 -- 172.21.15.138:0/214760099 shutdown_connections 2024-04-26T20:58:15.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.108+0000 7f5cb3e00640 1 --2- 172.21.15.138:0/214760099 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5c90068380 0x7f5c9006a840 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:15.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.108+0000 7f5cb3e00640 1 --2- 172.21.15.138:0/214760099 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5cb4160530 0x7f5cb40cfe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:15.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.108+0000 7f5cb3e00640 1 --2- 172.21.15.138:0/214760099 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5cb40d3760 0x7f5cb4148f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:15.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.108+0000 7f5cb3e00640 1 --2- 172.21.15.138:0/214760099 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5cb4071340 0x7f5cb41497f0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:15.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.108+0000 7f5cb3e00640 1 -- 172.21.15.138:0/214760099 >> 172.21.15.138:0/214760099 conn(0x7f5cb40d2c40 msgr2=0x7f5cb4157890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:15.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.108+0000 7f5cb3e00640 1 -- 172.21.15.138:0/214760099 shutdown_connections 2024-04-26T20:58:15.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.108+0000 7f5cb3e00640 1 -- 172.21.15.138:0/214760099 wait complete. 2024-04-26T20:58:15.129 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":97,"stamp":"2024-04-26T20:58:13.263262+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6881824,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":117,"num_read_kb":100,"num_write":260,"num_write_kb":8602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":705,"ondisk_log_size":705,"up":248,"acting":248,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":222,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":233960,"kb_used_data":17732,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754740760,"statfs":{"total":773094113280,"available":772854538240,"internally_reserved":0,"allocated":18157568,"data_stored":15713195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2410,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":52,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.611411"},"pg_stats":[{"pgid":"6.3f","version":"41'8","reported_seq":28,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T20:58:07.654713+0000","last_change":"2024-04-26T20:57:52.581808+0000","last_active":"2024-04-26T20:58:07.654713+0000","last_peered":"2024-04-26T20:58:07.654713+0000","last_clean":"2024-04-26T20:58:07.654713+0000","last_became_active":"2024-04-26T20:57:52.581483+0000","last_became_peered":"2024-04-26T20:57:52.581483+0000","last_unstale":"2024-04-26T20:58:07.654713+0000","last_undegraded":"2024-04-26T20:58:07.654713+0000","last_fullsized":"2024-04-26T20:58:07.654713+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:59:31.726648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"41'4","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.658178+0000","last_change":"2024-04-26T20:57:52.584136+0000","last_active":"2024-04-26T20:58:10.658178+0000","last_peered":"2024-04-26T20:58:10.658178+0000","last_clean":"2024-04-26T20:58:10.658178+0000","last_became_active":"2024-04-26T20:57:52.583831+0000","last_became_peered":"2024-04-26T20:57:52.583831+0000","last_unstale":"2024-04-26T20:58:10.658178+0000","last_undegraded":"2024-04-26T20:58:10.658178+0000","last_fullsized":"2024-04-26T20:58:10.658178+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:47:10.436783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"41'7","reported_seq":27,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T20:58:07.654479+0000","last_change":"2024-04-26T20:57:52.589332+0000","last_active":"2024-04-26T20:58:07.654479+0000","last_peered":"2024-04-26T20:58:07.654479+0000","last_clean":"2024-04-26T20:58:07.654479+0000","last_became_active":"2024-04-26T20:57:52.589025+0000","last_became_peered":"2024-04-26T20:57:52.589025+0000","last_unstale":"2024-04-26T20:58:07.654479+0000","last_undegraded":"2024-04-26T20:58:07.654479+0000","last_fullsized":"2024-04-26T20:58:07.654479+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:32:30.418094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"41'8","reported_seq":28,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T20:58:07.654904+0000","last_change":"2024-04-26T20:57:52.577582+0000","last_active":"2024-04-26T20:58:07.654904+0000","last_peered":"2024-04-26T20:58:07.654904+0000","last_clean":"2024-04-26T20:58:07.654904+0000","last_became_active":"2024-04-26T20:57:52.576872+0000","last_became_peered":"2024-04-26T20:57:52.576872+0000","last_unstale":"2024-04-26T20:58:07.654904+0000","last_undegraded":"2024-04-26T20:58:07.654904+0000","last_fullsized":"2024-04-26T20:58:07.654904+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:54.444509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"41'4","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.660374+0000","last_change":"2024-04-26T20:57:52.590233+0000","last_active":"2024-04-26T20:58:10.660374+0000","last_peered":"2024-04-26T20:58:10.660374+0000","last_clean":"2024-04-26T20:58:10.660374+0000","last_became_active":"2024-04-26T20:57:52.589943+0000","last_became_peered":"2024-04-26T20:57:52.589943+0000","last_unstale":"2024-04-26T20:58:10.660374+0000","last_undegraded":"2024-04-26T20:58:10.660374+0000","last_fullsized":"2024-04-26T20:58:10.660374+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:12.952743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"41'6","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.657623+0000","last_change":"2024-04-26T20:57:52.586359+0000","last_active":"2024-04-26T20:58:10.657623+0000","last_peered":"2024-04-26T20:58:10.657623+0000","last_clean":"2024-04-26T20:58:10.657623+0000","last_became_active":"2024-04-26T20:57:52.586013+0000","last_became_peered":"2024-04-26T20:57:52.586013+0000","last_unstale":"2024-04-26T20:58:10.657623+0000","last_undegraded":"2024-04-26T20:58:10.657623+0000","last_fullsized":"2024-04-26T20:58:10.657623+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:52:00.840874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"41'5","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.648157+0000","last_change":"2024-04-26T20:57:52.578308+0000","last_active":"2024-04-26T20:58:10.648157+0000","last_peered":"2024-04-26T20:58:10.648157+0000","last_clean":"2024-04-26T20:58:10.648157+0000","last_became_active":"2024-04-26T20:57:52.578063+0000","last_became_peered":"2024-04-26T20:57:52.578063+0000","last_unstale":"2024-04-26T20:58:10.648157+0000","last_undegraded":"2024-04-26T20:58:10.648157+0000","last_fullsized":"2024-04-26T20:58:10.648157+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:12.952743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"41'9","reported_seq":29,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T20:58:07.654133+0000","last_change":"2024-04-26T20:57:52.583828+0000","last_active":"2024-04-26T20:58:07.654133+0000","last_peered":"2024-04-26T20:58:07.654133+0000","last_clean":"2024-04-26T20:58:07.654133+0000","last_became_active":"2024-04-26T20:57:52.582894+0000","last_became_peered":"2024-04-26T20:57:52.582894+0000","last_unstale":"2024-04-26T20:58:07.654133+0000","last_undegraded":"2024-04-26T20:58:07.654133+0000","last_fullsized":"2024-04-26T20:58:07.654133+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:07:20.480071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"41'11","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.661672+0000","last_change":"2024-04-26T20:57:52.590616+0000","last_active":"2024-04-26T20:58:10.661672+0000","last_peered":"2024-04-26T20:58:10.661672+0000","last_clean":"2024-04-26T20:58:10.661672+0000","last_became_active":"2024-04-26T20:57:52.589972+0000","last_became_peered":"2024-04-26T20:57:52.589972+0000","last_unstale":"2024-04-26T20:58:10.661672+0000","last_undegraded":"2024-04-26T20:58:10.661672+0000","last_fullsized":"2024-04-26T20:58:10.661672+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:55.128152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"41'15","reported_seq":39,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.649095+0000","last_change":"2024-04-26T20:57:52.575175+0000","last_active":"2024-04-26T20:58:10.649095+0000","last_peered":"2024-04-26T20:58:10.649095+0000","last_clean":"2024-04-26T20:58:10.649095+0000","last_became_active":"2024-04-26T20:57:52.574917+0000","last_became_peered":"2024-04-26T20:57:52.574917+0000","last_unstale":"2024-04-26T20:58:10.649095+0000","last_undegraded":"2024-04-26T20:58:10.649095+0000","last_fullsized":"2024-04-26T20:58:10.649095+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:28:20.157680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"41'6","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.652083+0000","last_change":"2024-04-26T20:57:52.579280+0000","last_active":"2024-04-26T20:58:10.652083+0000","last_peered":"2024-04-26T20:58:10.652083+0000","last_clean":"2024-04-26T20:58:10.652083+0000","last_became_active":"2024-04-26T20:57:52.578799+0000","last_became_peered":"2024-04-26T20:57:52.578799+0000","last_unstale":"2024-04-26T20:58:10.652083+0000","last_undegraded":"2024-04-26T20:58:10.652083+0000","last_fullsized":"2024-04-26T20:58:10.652083+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:24.709956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"41'7","reported_seq":32,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.662261+0000","last_change":"2024-04-26T20:57:52.585045+0000","last_active":"2024-04-26T20:58:10.662261+0000","last_peered":"2024-04-26T20:58:10.662261+0000","last_clean":"2024-04-26T20:58:10.662261+0000","last_became_active":"2024-04-26T20:57:52.584748+0000","last_became_peered":"2024-04-26T20:57:52.584748+0000","last_unstale":"2024-04-26T20:58:10.662261+0000","last_undegraded":"2024-04-26T20:58:10.662261+0000","last_fullsized":"2024-04-26T20:58:10.662261+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:16.143937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"41'10","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.649429+0000","last_change":"2024-04-26T20:57:52.583032+0000","last_active":"2024-04-26T20:58:10.649429+0000","last_peered":"2024-04-26T20:58:10.649429+0000","last_clean":"2024-04-26T20:58:10.649429+0000","last_became_active":"2024-04-26T20:57:52.582788+0000","last_became_peered":"2024-04-26T20:57:52.582788+0000","last_unstale":"2024-04-26T20:58:10.649429+0000","last_undegraded":"2024-04-26T20:58:10.649429+0000","last_fullsized":"2024-04-26T20:58:10.649429+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:12:05.356796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"41'8","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.654536+0000","last_change":"2024-04-26T20:57:52.577582+0000","last_active":"2024-04-26T20:58:10.654536+0000","last_peered":"2024-04-26T20:58:10.654536+0000","last_clean":"2024-04-26T20:58:10.654536+0000","last_became_active":"2024-04-26T20:57:52.577366+0000","last_became_peered":"2024-04-26T20:57:52.577366+0000","last_unstale":"2024-04-26T20:58:10.654536+0000","last_undegraded":"2024-04-26T20:58:10.654536+0000","last_fullsized":"2024-04-26T20:58:10.654536+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:16.143937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"41'7","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.652283+0000","last_change":"2024-04-26T20:57:52.586188+0000","last_active":"2024-04-26T20:58:10.652283+0000","last_peered":"2024-04-26T20:58:10.652283+0000","last_clean":"2024-04-26T20:58:10.652283+0000","last_became_active":"2024-04-26T20:57:52.585816+0000","last_became_peered":"2024-04-26T20:57:52.585816+0000","last_unstale":"2024-04-26T20:58:10.652283+0000","last_undegraded":"2024-04-26T20:58:10.652283+0000","last_fullsized":"2024-04-26T20:58:10.652283+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:34:47.231759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"41'9","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.648219+0000","last_change":"2024-04-26T20:57:52.587967+0000","last_active":"2024-04-26T20:58:10.648219+0000","last_peered":"2024-04-26T20:58:10.648219+0000","last_clean":"2024-04-26T20:58:10.648219+0000","last_became_active":"2024-04-26T20:57:52.587598+0000","last_became_peered":"2024-04-26T20:57:52.587598+0000","last_unstale":"2024-04-26T20:58:10.648219+0000","last_undegraded":"2024-04-26T20:58:10.648219+0000","last_fullsized":"2024-04-26T20:58:10.648219+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:55.128152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"41'9","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.653716+0000","last_change":"2024-04-26T20:57:52.582167+0000","last_active":"2024-04-26T20:58:10.653716+0000","last_peered":"2024-04-26T20:58:10.653716+0000","last_clean":"2024-04-26T20:58:10.653716+0000","last_became_active":"2024-04-26T20:57:52.581896+0000","last_became_peered":"2024-04-26T20:57:52.581896+0000","last_unstale":"2024-04-26T20:58:10.653716+0000","last_undegraded":"2024-04-26T20:58:10.653716+0000","last_fullsized":"2024-04-26T20:58:10.653716+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:34:07.377749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"41'10","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.653336+0000","last_change":"2024-04-26T20:57:52.582700+0000","last_active":"2024-04-26T20:58:10.653336+0000","last_peered":"2024-04-26T20:58:10.653336+0000","last_clean":"2024-04-26T20:58:10.653336+0000","last_became_active":"2024-04-26T20:57:52.582355+0000","last_became_peered":"2024-04-26T20:57:52.582355+0000","last_unstale":"2024-04-26T20:58:10.653336+0000","last_undegraded":"2024-04-26T20:58:10.653336+0000","last_fullsized":"2024-04-26T20:58:10.653336+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:36:31.798469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"41'7","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.664703+0000","last_change":"2024-04-26T20:57:52.593273+0000","last_active":"2024-04-26T20:58:10.664703+0000","last_peered":"2024-04-26T20:58:10.664703+0000","last_clean":"2024-04-26T20:58:10.664703+0000","last_became_active":"2024-04-26T20:57:52.592960+0000","last_became_peered":"2024-04-26T20:57:52.592960+0000","last_unstale":"2024-04-26T20:58:10.664703+0000","last_undegraded":"2024-04-26T20:58:10.664703+0000","last_fullsized":"2024-04-26T20:58:10.664703+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:49:19.250429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"41'8","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.651801+0000","last_change":"2024-04-26T20:57:52.569599+0000","last_active":"2024-04-26T20:58:10.651801+0000","last_peered":"2024-04-26T20:58:10.651801+0000","last_clean":"2024-04-26T20:58:10.651801+0000","last_became_active":"2024-04-26T20:57:52.569345+0000","last_became_peered":"2024-04-26T20:57:52.569345+0000","last_unstale":"2024-04-26T20:58:10.651801+0000","last_undegraded":"2024-04-26T20:58:10.651801+0000","last_fullsized":"2024-04-26T20:58:10.651801+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:31:38.044176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"41'11","reported_seq":38,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.651569+0000","last_change":"2024-04-26T20:57:52.592270+0000","last_active":"2024-04-26T20:58:10.651569+0000","last_peered":"2024-04-26T20:58:10.651569+0000","last_clean":"2024-04-26T20:58:10.651569+0000","last_became_active":"2024-04-26T20:57:52.591984+0000","last_became_peered":"2024-04-26T20:57:52.591984+0000","last_unstale":"2024-04-26T20:58:10.651569+0000","last_undegraded":"2024-04-26T20:58:10.651569+0000","last_fullsized":"2024-04-26T20:58:10.651569+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:16:22.565146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"41'9","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.651342+0000","last_change":"2024-04-26T20:57:52.576852+0000","last_active":"2024-04-26T20:58:10.651342+0000","last_peered":"2024-04-26T20:58:10.651342+0000","last_clean":"2024-04-26T20:58:10.651342+0000","last_became_active":"2024-04-26T20:57:52.575571+0000","last_became_peered":"2024-04-26T20:57:52.575571+0000","last_unstale":"2024-04-26T20:58:10.651342+0000","last_undegraded":"2024-04-26T20:58:10.651342+0000","last_fullsized":"2024-04-26T20:58:10.651342+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:45.313671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"41'8","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.652443+0000","last_change":"2024-04-26T20:57:52.586306+0000","last_active":"2024-04-26T20:58:10.652443+0000","last_peered":"2024-04-26T20:58:10.652443+0000","last_clean":"2024-04-26T20:58:10.652443+0000","last_became_active":"2024-04-26T20:57:52.585992+0000","last_became_peered":"2024-04-26T20:57:52.585992+0000","last_unstale":"2024-04-26T20:58:10.652443+0000","last_undegraded":"2024-04-26T20:58:10.652443+0000","last_fullsized":"2024-04-26T20:58:10.652443+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:30:40.828807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"41'6","reported_seq":26,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T20:58:07.654280+0000","last_change":"2024-04-26T20:57:52.584019+0000","last_active":"2024-04-26T20:58:07.654280+0000","last_peered":"2024-04-26T20:58:07.654280+0000","last_clean":"2024-04-26T20:58:07.654280+0000","last_became_active":"2024-04-26T20:57:52.583140+0000","last_became_peered":"2024-04-26T20:57:52.583140+0000","last_unstale":"2024-04-26T20:58:07.654280+0000","last_undegraded":"2024-04-26T20:58:07.654280+0000","last_fullsized":"2024-04-26T20:58:07.654280+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:25.562628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"41'2","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.654410+0000","last_change":"2024-04-26T20:57:52.579168+0000","last_active":"2024-04-26T20:58:10.654410+0000","last_peered":"2024-04-26T20:58:10.654410+0000","last_clean":"2024-04-26T20:58:10.654410+0000","last_became_active":"2024-04-26T20:57:52.578943+0000","last_became_peered":"2024-04-26T20:57:52.578943+0000","last_unstale":"2024-04-26T20:58:10.654410+0000","last_undegraded":"2024-04-26T20:58:10.654410+0000","last_fullsized":"2024-04-26T20:58:10.654410+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:55.128152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"41'15","reported_seq":35,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T20:58:07.654941+0000","last_change":"2024-04-26T20:57:52.585325+0000","last_active":"2024-04-26T20:58:07.654941+0000","last_peered":"2024-04-26T20:58:07.654941+0000","last_clean":"2024-04-26T20:58:07.654941+0000","last_became_active":"2024-04-26T20:57:52.585083+0000","last_became_peered":"2024-04-26T20:57:52.585083+0000","last_unstale":"2024-04-26T20:58:07.654941+0000","last_undegraded":"2024-04-26T20:58:07.654941+0000","last_fullsized":"2024-04-26T20:58:07.654941+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:00:42.689944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"41'6","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.652239+0000","last_change":"2024-04-26T20:57:52.578861+0000","last_active":"2024-04-26T20:58:10.652239+0000","last_peered":"2024-04-26T20:58:10.652239+0000","last_clean":"2024-04-26T20:58:10.652239+0000","last_became_active":"2024-04-26T20:57:52.578454+0000","last_became_peered":"2024-04-26T20:57:52.578454+0000","last_unstale":"2024-04-26T20:58:10.652239+0000","last_undegraded":"2024-04-26T20:58:10.652239+0000","last_fullsized":"2024-04-26T20:58:10.652239+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:36:12.618358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"41'4","reported_seq":28,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.648653+0000","last_change":"2024-04-26T20:57:52.577688+0000","last_active":"2024-04-26T20:58:10.648653+0000","last_peered":"2024-04-26T20:58:10.648653+0000","last_clean":"2024-04-26T20:58:10.648653+0000","last_became_active":"2024-04-26T20:57:52.577426+0000","last_became_peered":"2024-04-26T20:57:52.577426+0000","last_unstale":"2024-04-26T20:58:10.648653+0000","last_undegraded":"2024-04-26T20:58:10.648653+0000","last_fullsized":"2024-04-26T20:58:10.648653+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:16.143937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"41'7","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.652633+0000","last_change":"2024-04-26T20:57:52.583932+0000","last_active":"2024-04-26T20:58:10.652633+0000","last_peered":"2024-04-26T20:58:10.652633+0000","last_clean":"2024-04-26T20:58:10.652633+0000","last_became_active":"2024-04-26T20:57:52.583671+0000","last_became_peered":"2024-04-26T20:57:52.583671+0000","last_unstale":"2024-04-26T20:58:10.652633+0000","last_undegraded":"2024-04-26T20:58:10.652633+0000","last_fullsized":"2024-04-26T20:58:10.652633+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:17:49.866989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"41'8","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.652722+0000","last_change":"2024-04-26T20:57:52.569868+0000","last_active":"2024-04-26T20:58:10.652722+0000","last_peered":"2024-04-26T20:58:10.652722+0000","last_clean":"2024-04-26T20:58:10.652722+0000","last_became_active":"2024-04-26T20:57:52.569591+0000","last_became_peered":"2024-04-26T20:57:52.569591+0000","last_unstale":"2024-04-26T20:58:10.652722+0000","last_undegraded":"2024-04-26T20:58:10.652722+0000","last_fullsized":"2024-04-26T20:58:10.652722+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:16.617166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"41'12","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.648340+0000","last_change":"2024-04-26T20:57:52.581841+0000","last_active":"2024-04-26T20:58:10.648340+0000","last_peered":"2024-04-26T20:58:10.648340+0000","last_clean":"2024-04-26T20:58:10.648340+0000","last_became_active":"2024-04-26T20:57:52.581591+0000","last_became_peered":"2024-04-26T20:57:52.581591+0000","last_unstale":"2024-04-26T20:58:10.648340+0000","last_undegraded":"2024-04-26T20:58:10.648340+0000","last_fullsized":"2024-04-26T20:58:10.648340+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:37:58.253968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"41'9","reported_seq":29,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T20:58:07.654421+0000","last_change":"2024-04-26T20:57:52.583636+0000","last_active":"2024-04-26T20:58:07.654421+0000","last_peered":"2024-04-26T20:58:07.654421+0000","last_clean":"2024-04-26T20:58:07.654421+0000","last_became_active":"2024-04-26T20:57:52.582497+0000","last_became_peered":"2024-04-26T20:57:52.582497+0000","last_unstale":"2024-04-26T20:58:07.654421+0000","last_undegraded":"2024-04-26T20:58:07.654421+0000","last_fullsized":"2024-04-26T20:58:07.654421+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:06:47.714849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.672853+0000","last_change":"2024-04-26T20:58:10.666436+0000","last_active":"2024-04-26T20:58:10.672853+0000","last_peered":"2024-04-26T20:58:10.672853+0000","last_clean":"2024-04-26T20:58:10.672853+0000","last_became_active":"2024-04-26T20:58:10.666048+0000","last_became_peered":"2024-04-26T20:58:10.666048+0000","last_unstale":"2024-04-26T20:58:10.672853+0000","last_undegraded":"2024-04-26T20:58:10.672853+0000","last_fullsized":"2024-04-26T20:58:10.672853+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:47:28.530714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"41'9","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.653238+0000","last_change":"2024-04-26T20:57:52.569273+0000","last_active":"2024-04-26T20:58:10.653238+0000","last_peered":"2024-04-26T20:58:10.653238+0000","last_clean":"2024-04-26T20:58:10.653238+0000","last_became_active":"2024-04-26T20:57:52.568195+0000","last_became_peered":"2024-04-26T20:57:52.568195+0000","last_unstale":"2024-04-26T20:58:10.653238+0000","last_undegraded":"2024-04-26T20:58:10.653238+0000","last_fullsized":"2024-04-26T20:58:10.653238+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:05:37.693355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"42'8","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.654475+0000","last_change":"2024-04-26T20:57:51.572743+0000","last_active":"2024-04-26T20:58:10.654475+0000","last_peered":"2024-04-26T20:58:10.654475+0000","last_clean":"2024-04-26T20:58:10.654475+0000","last_became_active":"2024-04-26T20:57:51.572350+0000","last_became_peered":"2024-04-26T20:57:51.572350+0000","last_unstale":"2024-04-26T20:58:10.654475+0000","last_undegraded":"2024-04-26T20:58:10.654475+0000","last_fullsized":"2024-04-26T20:58:10.654475+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:50:32.238625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.668622+0000","last_change":"2024-04-26T20:58:10.667265+0000","last_active":"2024-04-26T20:58:10.668622+0000","last_peered":"2024-04-26T20:58:10.668622+0000","last_clean":"2024-04-26T20:58:10.668622+0000","last_became_active":"2024-04-26T20:58:10.667057+0000","last_became_peered":"2024-04-26T20:58:10.667057+0000","last_unstale":"2024-04-26T20:58:10.668622+0000","last_undegraded":"2024-04-26T20:58:10.668622+0000","last_fullsized":"2024-04-26T20:58:10.668622+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:44.950848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"41'15","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.657903+0000","last_change":"2024-04-26T20:57:52.587288+0000","last_active":"2024-04-26T20:58:10.657903+0000","last_peered":"2024-04-26T20:58:10.657903+0000","last_clean":"2024-04-26T20:58:10.657903+0000","last_became_active":"2024-04-26T20:57:52.586875+0000","last_became_peered":"2024-04-26T20:57:52.586875+0000","last_unstale":"2024-04-26T20:58:10.657903+0000","last_undegraded":"2024-04-26T20:58:10.657903+0000","last_fullsized":"2024-04-26T20:58:10.657903+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:44:03.294510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":27,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.658255+0000","last_change":"2024-04-26T20:57:51.566643+0000","last_active":"2024-04-26T20:58:10.658255+0000","last_peered":"2024-04-26T20:58:10.658255+0000","last_clean":"2024-04-26T20:58:10.658255+0000","last_became_active":"2024-04-26T20:57:51.566309+0000","last_became_peered":"2024-04-26T20:57:51.566309+0000","last_unstale":"2024-04-26T20:58:10.658255+0000","last_undegraded":"2024-04-26T20:58:10.658255+0000","last_fullsized":"2024-04-26T20:58:10.658255+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:50:32.238625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.671298+0000","last_change":"2024-04-26T20:58:10.669263+0000","last_active":"2024-04-26T20:58:10.671298+0000","last_peered":"2024-04-26T20:58:10.671298+0000","last_clean":"2024-04-26T20:58:10.671298+0000","last_became_active":"2024-04-26T20:58:10.668918+0000","last_became_peered":"2024-04-26T20:58:10.668918+0000","last_unstale":"2024-04-26T20:58:10.671298+0000","last_undegraded":"2024-04-26T20:58:10.671298+0000","last_fullsized":"2024-04-26T20:58:10.671298+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:19:35.479464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"41'5","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.653575+0000","last_change":"2024-04-26T20:57:52.566380+0000","last_active":"2024-04-26T20:58:10.653575+0000","last_peered":"2024-04-26T20:58:10.653575+0000","last_clean":"2024-04-26T20:58:10.653575+0000","last_became_active":"2024-04-26T20:57:52.566143+0000","last_became_peered":"2024-04-26T20:57:52.566143+0000","last_unstale":"2024-04-26T20:58:10.653575+0000","last_undegraded":"2024-04-26T20:58:10.653575+0000","last_fullsized":"2024-04-26T20:58:10.653575+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:49:48.199988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"42'3","reported_seq":25,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T20:58:07.654803+0000","last_change":"2024-04-26T20:57:51.573664+0000","last_active":"2024-04-26T20:58:07.654803+0000","last_peered":"2024-04-26T20:58:07.654803+0000","last_clean":"2024-04-26T20:58:07.654803+0000","last_became_active":"2024-04-26T20:57:51.572927+0000","last_became_peered":"2024-04-26T20:57:51.572927+0000","last_unstale":"2024-04-26T20:58:07.654803+0000","last_undegraded":"2024-04-26T20:58:07.654803+0000","last_fullsized":"2024-04-26T20:58:07.654803+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:04:55.596385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.678783+0000","last_change":"2024-04-26T20:58:10.676452+0000","last_active":"2024-04-26T20:58:10.678783+0000","last_peered":"2024-04-26T20:58:10.678783+0000","last_clean":"2024-04-26T20:58:10.678783+0000","last_became_active":"2024-04-26T20:58:10.676145+0000","last_became_peered":"2024-04-26T20:58:10.676145+0000","last_unstale":"2024-04-26T20:58:10.678783+0000","last_undegraded":"2024-04-26T20:58:10.678783+0000","last_fullsized":"2024-04-26T20:58:10.678783+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:54:11.593416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"41'6","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.658964+0000","last_change":"2024-04-26T20:57:52.585801+0000","last_active":"2024-04-26T20:58:10.658964+0000","last_peered":"2024-04-26T20:58:10.658964+0000","last_clean":"2024-04-26T20:58:10.658964+0000","last_became_active":"2024-04-26T20:57:52.584731+0000","last_became_peered":"2024-04-26T20:57:52.584731+0000","last_unstale":"2024-04-26T20:58:10.658964+0000","last_undegraded":"2024-04-26T20:58:10.658964+0000","last_fullsized":"2024-04-26T20:58:10.658964+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:39:52.141275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"42'3","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.654149+0000","last_change":"2024-04-26T20:57:51.574013+0000","last_active":"2024-04-26T20:58:10.654149+0000","last_peered":"2024-04-26T20:58:10.654149+0000","last_clean":"2024-04-26T20:58:10.654149+0000","last_became_active":"2024-04-26T20:57:51.573800+0000","last_became_peered":"2024-04-26T20:57:51.573800+0000","last_unstale":"2024-04-26T20:58:10.654149+0000","last_undegraded":"2024-04-26T20:58:10.654149+0000","last_fullsized":"2024-04-26T20:58:10.654149+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:43:07.969141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.666603+0000","last_change":"2024-04-26T20:58:10.665186+0000","last_active":"2024-04-26T20:58:10.666603+0000","last_peered":"2024-04-26T20:58:10.666603+0000","last_clean":"2024-04-26T20:58:10.666603+0000","last_became_active":"2024-04-26T20:58:10.664923+0000","last_became_peered":"2024-04-26T20:58:10.664923+0000","last_unstale":"2024-04-26T20:58:10.666603+0000","last_undegraded":"2024-04-26T20:58:10.666603+0000","last_fullsized":"2024-04-26T20:58:10.666603+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:14:23.512332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"41'8","reported_seq":28,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T20:58:07.654427+0000","last_change":"2024-04-26T20:57:52.587538+0000","last_active":"2024-04-26T20:58:07.654427+0000","last_peered":"2024-04-26T20:58:07.654427+0000","last_clean":"2024-04-26T20:58:07.654427+0000","last_became_active":"2024-04-26T20:57:52.587138+0000","last_became_peered":"2024-04-26T20:57:52.587138+0000","last_unstale":"2024-04-26T20:58:07.654427+0000","last_undegraded":"2024-04-26T20:58:07.654427+0000","last_fullsized":"2024-04-26T20:58:07.654427+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:41:24.188302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.654368+0000","last_change":"2024-04-26T20:57:51.570397+0000","last_active":"2024-04-26T20:58:10.654368+0000","last_peered":"2024-04-26T20:58:10.654368+0000","last_clean":"2024-04-26T20:58:10.654368+0000","last_became_active":"2024-04-26T20:57:51.570089+0000","last_became_peered":"2024-04-26T20:57:51.570089+0000","last_unstale":"2024-04-26T20:58:10.654368+0000","last_undegraded":"2024-04-26T20:58:10.654368+0000","last_fullsized":"2024-04-26T20:58:10.654368+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:55:41.720506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:58:09.636100+0000","last_change":"2024-04-26T20:58:09.636100+0000","last_active":"2024-04-26T20:58:09.636100+0000","last_peered":"2024-04-26T20:58:09.636100+0000","last_clean":"2024-04-26T20:58:09.636100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:58:09.636100+0000","last_undegraded":"2024-04-26T20:58:09.636100+0000","last_fullsized":"2024-04-26T20:58:09.636100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"41'10","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.651301+0000","last_change":"2024-04-26T20:57:52.585311+0000","last_active":"2024-04-26T20:58:10.651301+0000","last_peered":"2024-04-26T20:58:10.651301+0000","last_clean":"2024-04-26T20:58:10.651301+0000","last_became_active":"2024-04-26T20:57:52.585061+0000","last_became_peered":"2024-04-26T20:57:52.585061+0000","last_unstale":"2024-04-26T20:58:10.651301+0000","last_undegraded":"2024-04-26T20:58:10.651301+0000","last_fullsized":"2024-04-26T20:58:10.651301+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:18.275862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":26,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.649645+0000","last_change":"2024-04-26T20:57:51.571733+0000","last_active":"2024-04-26T20:58:10.649645+0000","last_peered":"2024-04-26T20:58:10.649645+0000","last_clean":"2024-04-26T20:58:10.649645+0000","last_became_active":"2024-04-26T20:57:51.571446+0000","last_became_peered":"2024-04-26T20:57:51.571446+0000","last_unstale":"2024-04-26T20:58:10.649645+0000","last_undegraded":"2024-04-26T20:58:10.649645+0000","last_fullsized":"2024-04-26T20:58:10.649645+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:07.815468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:58:09.636100+0000","last_change":"2024-04-26T20:58:09.636100+0000","last_active":"2024-04-26T20:58:09.636100+0000","last_peered":"2024-04-26T20:58:09.636100+0000","last_clean":"2024-04-26T20:58:09.636100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:58:09.636100+0000","last_undegraded":"2024-04-26T20:58:09.636100+0000","last_fullsized":"2024-04-26T20:58:09.636100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"41'7","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.652878+0000","last_change":"2024-04-26T20:57:52.570641+0000","last_active":"2024-04-26T20:58:10.652878+0000","last_peered":"2024-04-26T20:58:10.652878+0000","last_clean":"2024-04-26T20:58:10.652878+0000","last_became_active":"2024-04-26T20:57:52.570421+0000","last_became_peered":"2024-04-26T20:57:52.570421+0000","last_unstale":"2024-04-26T20:58:10.652878+0000","last_undegraded":"2024-04-26T20:58:10.652878+0000","last_fullsized":"2024-04-26T20:58:10.652878+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:27.330795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":22,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T20:58:07.654131+0000","last_change":"2024-04-26T20:57:51.574572+0000","last_active":"2024-04-26T20:58:07.654131+0000","last_peered":"2024-04-26T20:58:07.654131+0000","last_clean":"2024-04-26T20:58:07.654131+0000","last_became_active":"2024-04-26T20:57:51.574213+0000","last_became_peered":"2024-04-26T20:57:51.574213+0000","last_unstale":"2024-04-26T20:58:07.654131+0000","last_undegraded":"2024-04-26T20:58:07.654131+0000","last_fullsized":"2024-04-26T20:58:07.654131+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:10:26.507698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.659841+0000","last_change":"2024-04-26T20:58:10.657768+0000","last_active":"2024-04-26T20:58:10.659841+0000","last_peered":"2024-04-26T20:58:10.659841+0000","last_clean":"2024-04-26T20:58:10.659841+0000","last_became_active":"2024-04-26T20:58:10.657396+0000","last_became_peered":"2024-04-26T20:58:10.657396+0000","last_unstale":"2024-04-26T20:58:10.659841+0000","last_undegraded":"2024-04-26T20:58:10.659841+0000","last_fullsized":"2024-04-26T20:58:10.659841+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:43:54.225992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"41'8","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.660451+0000","last_change":"2024-04-26T20:57:52.586106+0000","last_active":"2024-04-26T20:58:10.660451+0000","last_peered":"2024-04-26T20:58:10.660451+0000","last_clean":"2024-04-26T20:58:10.660451+0000","last_became_active":"2024-04-26T20:57:52.585860+0000","last_became_peered":"2024-04-26T20:57:52.585860+0000","last_unstale":"2024-04-26T20:58:10.660451+0000","last_undegraded":"2024-04-26T20:58:10.660451+0000","last_fullsized":"2024-04-26T20:58:10.660451+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:16:22.565146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":25,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.648327+0000","last_change":"2024-04-26T20:57:51.573590+0000","last_active":"2024-04-26T20:58:10.648327+0000","last_peered":"2024-04-26T20:58:10.648327+0000","last_clean":"2024-04-26T20:58:10.648327+0000","last_became_active":"2024-04-26T20:57:51.573293+0000","last_became_peered":"2024-04-26T20:57:51.573293+0000","last_unstale":"2024-04-26T20:58:10.648327+0000","last_undegraded":"2024-04-26T20:58:10.648327+0000","last_fullsized":"2024-04-26T20:58:10.648327+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:55:23.008549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.672085+0000","last_change":"2024-04-26T20:58:10.670768+0000","last_active":"2024-04-26T20:58:10.672085+0000","last_peered":"2024-04-26T20:58:10.672085+0000","last_clean":"2024-04-26T20:58:10.672085+0000","last_became_active":"2024-04-26T20:58:10.670520+0000","last_became_peered":"2024-04-26T20:58:10.670520+0000","last_unstale":"2024-04-26T20:58:10.672085+0000","last_undegraded":"2024-04-26T20:58:10.672085+0000","last_fullsized":"2024-04-26T20:58:10.672085+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:52:06.081700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"41'11","reported_seq":31,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T20:58:07.655036+0000","last_change":"2024-04-26T20:57:52.575008+0000","last_active":"2024-04-26T20:58:07.655036+0000","last_peered":"2024-04-26T20:58:07.655036+0000","last_clean":"2024-04-26T20:58:07.655036+0000","last_became_active":"2024-04-26T20:57:52.574553+0000","last_became_peered":"2024-04-26T20:57:52.574553+0000","last_unstale":"2024-04-26T20:58:07.655036+0000","last_undegraded":"2024-04-26T20:58:07.655036+0000","last_fullsized":"2024-04-26T20:58:07.655036+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:07:44.096701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":22,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T20:58:07.654799+0000","last_change":"2024-04-26T20:57:51.576675+0000","last_active":"2024-04-26T20:58:07.654799+0000","last_peered":"2024-04-26T20:58:07.654799+0000","last_clean":"2024-04-26T20:58:07.654799+0000","last_became_active":"2024-04-26T20:57:51.576394+0000","last_became_peered":"2024-04-26T20:57:51.576394+0000","last_unstale":"2024-04-26T20:58:07.654799+0000","last_undegraded":"2024-04-26T20:58:07.654799+0000","last_fullsized":"2024-04-26T20:58:07.654799+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:44:14.717022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.674082+0000","last_change":"2024-04-26T20:58:10.671102+0000","last_active":"2024-04-26T20:58:10.674082+0000","last_peered":"2024-04-26T20:58:10.674082+0000","last_clean":"2024-04-26T20:58:10.674082+0000","last_became_active":"2024-04-26T20:58:10.670829+0000","last_became_peered":"2024-04-26T20:58:10.670829+0000","last_unstale":"2024-04-26T20:58:10.674082+0000","last_undegraded":"2024-04-26T20:58:10.674082+0000","last_fullsized":"2024-04-26T20:58:10.674082+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:16:40.659077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"41'6","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.654015+0000","last_change":"2024-04-26T20:57:52.576139+0000","last_active":"2024-04-26T20:58:10.654015+0000","last_peered":"2024-04-26T20:58:10.654015+0000","last_clean":"2024-04-26T20:58:10.654015+0000","last_became_active":"2024-04-26T20:57:52.575825+0000","last_became_peered":"2024-04-26T20:57:52.575825+0000","last_unstale":"2024-04-26T20:58:10.654015+0000","last_undegraded":"2024-04-26T20:58:10.654015+0000","last_fullsized":"2024-04-26T20:58:10.654015+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:37:58.253968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":27,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.653435+0000","last_change":"2024-04-26T20:57:51.566363+0000","last_active":"2024-04-26T20:58:10.653435+0000","last_peered":"2024-04-26T20:58:10.653435+0000","last_clean":"2024-04-26T20:58:10.653435+0000","last_became_active":"2024-04-26T20:57:51.566020+0000","last_became_peered":"2024-04-26T20:57:51.566020+0000","last_unstale":"2024-04-26T20:58:10.653435+0000","last_undegraded":"2024-04-26T20:58:10.653435+0000","last_fullsized":"2024-04-26T20:58:10.653435+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:51:59.832838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.658001+0000","last_change":"2024-04-26T20:58:10.656874+0000","last_active":"2024-04-26T20:58:10.658001+0000","last_peered":"2024-04-26T20:58:10.658001+0000","last_clean":"2024-04-26T20:58:10.658001+0000","last_became_active":"2024-04-26T20:58:10.656106+0000","last_became_peered":"2024-04-26T20:58:10.656106+0000","last_unstale":"2024-04-26T20:58:10.658001+0000","last_undegraded":"2024-04-26T20:58:10.658001+0000","last_fullsized":"2024-04-26T20:58:10.658001+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:54:11.593416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"41'10","reported_seq":30,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T20:58:07.655020+0000","last_change":"2024-04-26T20:57:52.593299+0000","last_active":"2024-04-26T20:58:07.655020+0000","last_peered":"2024-04-26T20:58:07.655020+0000","last_clean":"2024-04-26T20:58:07.655020+0000","last_became_active":"2024-04-26T20:57:52.591280+0000","last_became_peered":"2024-04-26T20:57:52.591280+0000","last_unstale":"2024-04-26T20:58:07.655020+0000","last_undegraded":"2024-04-26T20:58:07.655020+0000","last_fullsized":"2024-04-26T20:58:07.655020+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:45:53.756909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"42'5","reported_seq":32,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.653766+0000","last_change":"2024-04-26T20:57:51.569668+0000","last_active":"2024-04-26T20:58:10.653766+0000","last_peered":"2024-04-26T20:58:10.653766+0000","last_clean":"2024-04-26T20:58:10.653766+0000","last_became_active":"2024-04-26T20:57:51.569384+0000","last_became_peered":"2024-04-26T20:57:51.569384+0000","last_unstale":"2024-04-26T20:58:10.653766+0000","last_undegraded":"2024-04-26T20:58:10.653766+0000","last_fullsized":"2024-04-26T20:58:10.653766+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:49:18.242393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.669541+0000","last_change":"2024-04-26T20:58:10.668231+0000","last_active":"2024-04-26T20:58:10.669541+0000","last_peered":"2024-04-26T20:58:10.669541+0000","last_clean":"2024-04-26T20:58:10.669541+0000","last_became_active":"2024-04-26T20:58:10.668007+0000","last_became_peered":"2024-04-26T20:58:10.668007+0000","last_unstale":"2024-04-26T20:58:10.669541+0000","last_undegraded":"2024-04-26T20:58:10.669541+0000","last_fullsized":"2024-04-26T20:58:10.669541+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:10.473443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"41'9","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.649099+0000","last_change":"2024-04-26T20:57:52.577388+0000","last_active":"2024-04-26T20:58:10.649099+0000","last_peered":"2024-04-26T20:58:10.649099+0000","last_clean":"2024-04-26T20:58:10.649099+0000","last_became_active":"2024-04-26T20:57:52.577116+0000","last_became_peered":"2024-04-26T20:57:52.577116+0000","last_unstale":"2024-04-26T20:58:10.649099+0000","last_undegraded":"2024-04-26T20:58:10.649099+0000","last_fullsized":"2024-04-26T20:58:10.649099+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:26.856916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"42'23","reported_seq":45,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T20:58:07.655160+0000","last_change":"2024-04-26T20:57:51.574348+0000","last_active":"2024-04-26T20:58:07.655160+0000","last_peered":"2024-04-26T20:58:07.655160+0000","last_clean":"2024-04-26T20:58:07.655160+0000","last_became_active":"2024-04-26T20:57:51.574023+0000","last_became_peered":"2024-04-26T20:57:51.574023+0000","last_unstale":"2024-04-26T20:58:07.655160+0000","last_undegraded":"2024-04-26T20:58:07.655160+0000","last_fullsized":"2024-04-26T20:58:07.655160+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:29:31.014100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.659792+0000","last_change":"2024-04-26T20:58:10.657279+0000","last_active":"2024-04-26T20:58:10.659792+0000","last_peered":"2024-04-26T20:58:10.659792+0000","last_clean":"2024-04-26T20:58:10.659792+0000","last_became_active":"2024-04-26T20:58:10.656680+0000","last_became_peered":"2024-04-26T20:58:10.656680+0000","last_unstale":"2024-04-26T20:58:10.659792+0000","last_undegraded":"2024-04-26T20:58:10.659792+0000","last_fullsized":"2024-04-26T20:58:10.659792+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:31.277054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"41'6","reported_seq":26,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T20:58:07.654577+0000","last_change":"2024-04-26T20:57:52.583405+0000","last_active":"2024-04-26T20:58:07.654577+0000","last_peered":"2024-04-26T20:58:07.654577+0000","last_clean":"2024-04-26T20:58:07.654577+0000","last_became_active":"2024-04-26T20:57:52.582257+0000","last_became_peered":"2024-04-26T20:57:52.582257+0000","last_unstale":"2024-04-26T20:58:07.654577+0000","last_undegraded":"2024-04-26T20:58:07.654577+0000","last_fullsized":"2024-04-26T20:58:07.654577+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:39.396387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"42'5","reported_seq":27,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T20:58:07.654555+0000","last_change":"2024-04-26T20:57:51.572541+0000","last_active":"2024-04-26T20:58:07.654555+0000","last_peered":"2024-04-26T20:58:07.654555+0000","last_clean":"2024-04-26T20:58:07.654555+0000","last_became_active":"2024-04-26T20:57:51.571967+0000","last_became_peered":"2024-04-26T20:57:51.571967+0000","last_unstale":"2024-04-26T20:58:07.654555+0000","last_undegraded":"2024-04-26T20:58:07.654555+0000","last_fullsized":"2024-04-26T20:58:07.654555+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:11:04.894675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.675770+0000","last_change":"2024-04-26T20:58:10.671439+0000","last_active":"2024-04-26T20:58:10.675770+0000","last_peered":"2024-04-26T20:58:10.675770+0000","last_clean":"2024-04-26T20:58:10.675770+0000","last_became_active":"2024-04-26T20:58:10.671079+0000","last_became_peered":"2024-04-26T20:58:10.671079+0000","last_unstale":"2024-04-26T20:58:10.675770+0000","last_undegraded":"2024-04-26T20:58:10.675770+0000","last_fullsized":"2024-04-26T20:58:10.675770+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:28:38.251611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"41'6","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.658248+0000","last_change":"2024-04-26T20:57:52.581005+0000","last_active":"2024-04-26T20:58:10.658248+0000","last_peered":"2024-04-26T20:58:10.658248+0000","last_clean":"2024-04-26T20:58:10.658248+0000","last_became_active":"2024-04-26T20:57:52.580685+0000","last_became_peered":"2024-04-26T20:57:52.580685+0000","last_unstale":"2024-04-26T20:58:10.658248+0000","last_undegraded":"2024-04-26T20:58:10.658248+0000","last_fullsized":"2024-04-26T20:58:10.658248+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:18.275862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":26,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.657736+0000","last_change":"2024-04-26T20:57:51.571181+0000","last_active":"2024-04-26T20:58:10.657736+0000","last_peered":"2024-04-26T20:58:10.657736+0000","last_clean":"2024-04-26T20:58:10.657736+0000","last_became_active":"2024-04-26T20:57:51.570305+0000","last_became_peered":"2024-04-26T20:57:51.570305+0000","last_unstale":"2024-04-26T20:58:10.657736+0000","last_undegraded":"2024-04-26T20:58:10.657736+0000","last_fullsized":"2024-04-26T20:58:10.657736+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:43:07.969141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.675913+0000","last_change":"2024-04-26T20:58:10.671520+0000","last_active":"2024-04-26T20:58:10.675913+0000","last_peered":"2024-04-26T20:58:10.675913+0000","last_clean":"2024-04-26T20:58:10.675913+0000","last_became_active":"2024-04-26T20:58:10.671157+0000","last_became_peered":"2024-04-26T20:58:10.671157+0000","last_unstale":"2024-04-26T20:58:10.675913+0000","last_undegraded":"2024-04-26T20:58:10.675913+0000","last_fullsized":"2024-04-26T20:58:10.675913+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:44.950848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"41'10","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.651790+0000","last_change":"2024-04-26T20:57:52.584791+0000","last_active":"2024-04-26T20:58:10.651790+0000","last_peered":"2024-04-26T20:58:10.651790+0000","last_clean":"2024-04-26T20:58:10.651790+0000","last_became_active":"2024-04-26T20:57:52.575922+0000","last_became_peered":"2024-04-26T20:57:52.575922+0000","last_unstale":"2024-04-26T20:58:10.651790+0000","last_undegraded":"2024-04-26T20:58:10.651790+0000","last_fullsized":"2024-04-26T20:58:10.651790+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:50:20.927595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":27,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.652641+0000","last_change":"2024-04-26T20:57:51.563498+0000","last_active":"2024-04-26T20:58:10.652641+0000","last_peered":"2024-04-26T20:58:10.652641+0000","last_clean":"2024-04-26T20:58:10.652641+0000","last_became_active":"2024-04-26T20:57:51.563243+0000","last_became_peered":"2024-04-26T20:57:51.563243+0000","last_unstale":"2024-04-26T20:58:10.652641+0000","last_undegraded":"2024-04-26T20:58:10.652641+0000","last_fullsized":"2024-04-26T20:58:10.652641+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:47:09.428746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.668897+0000","last_change":"2024-04-26T20:58:10.665998+0000","last_active":"2024-04-26T20:58:10.668897+0000","last_peered":"2024-04-26T20:58:10.668897+0000","last_clean":"2024-04-26T20:58:10.668897+0000","last_became_active":"2024-04-26T20:58:10.665637+0000","last_became_peered":"2024-04-26T20:58:10.665637+0000","last_unstale":"2024-04-26T20:58:10.668897+0000","last_undegraded":"2024-04-26T20:58:10.668897+0000","last_fullsized":"2024-04-26T20:58:10.668897+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:02.739631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"41'15","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.660521+0000","last_change":"2024-04-26T20:57:52.584930+0000","last_active":"2024-04-26T20:58:10.660521+0000","last_peered":"2024-04-26T20:58:10.660521+0000","last_clean":"2024-04-26T20:58:10.660521+0000","last_became_active":"2024-04-26T20:57:52.584641+0000","last_became_peered":"2024-04-26T20:57:52.584641+0000","last_unstale":"2024-04-26T20:58:10.660521+0000","last_undegraded":"2024-04-26T20:58:10.660521+0000","last_fullsized":"2024-04-26T20:58:10.660521+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:37:58.253968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"42'15","reported_seq":43,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.653626+0000","last_change":"2024-04-26T20:57:51.567931+0000","last_active":"2024-04-26T20:58:10.653626+0000","last_peered":"2024-04-26T20:58:10.653626+0000","last_clean":"2024-04-26T20:58:10.653626+0000","last_became_active":"2024-04-26T20:57:51.567552+0000","last_became_peered":"2024-04-26T20:57:51.567552+0000","last_unstale":"2024-04-26T20:58:10.653626+0000","last_undegraded":"2024-04-26T20:58:10.653626+0000","last_fullsized":"2024-04-26T20:58:10.653626+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:32.553314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.664571+0000","last_change":"2024-04-26T20:58:10.663370+0000","last_active":"2024-04-26T20:58:10.664571+0000","last_peered":"2024-04-26T20:58:10.664571+0000","last_clean":"2024-04-26T20:58:10.664571+0000","last_became_active":"2024-04-26T20:58:10.663079+0000","last_became_peered":"2024-04-26T20:58:10.663079+0000","last_unstale":"2024-04-26T20:58:10.664571+0000","last_undegraded":"2024-04-26T20:58:10.664571+0000","last_fullsized":"2024-04-26T20:58:10.664571+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:43:59.225293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"41'6","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.657455+0000","last_change":"2024-04-26T20:57:52.581758+0000","last_active":"2024-04-26T20:58:10.657455+0000","last_peered":"2024-04-26T20:58:10.657455+0000","last_clean":"2024-04-26T20:58:10.657455+0000","last_became_active":"2024-04-26T20:57:52.581085+0000","last_became_peered":"2024-04-26T20:57:52.581085+0000","last_unstale":"2024-04-26T20:58:10.657455+0000","last_undegraded":"2024-04-26T20:58:10.657455+0000","last_fullsized":"2024-04-26T20:58:10.657455+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:49:19.250429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"42'2","reported_seq":27,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.649194+0000","last_change":"2024-04-26T20:57:51.575710+0000","last_active":"2024-04-26T20:58:10.649194+0000","last_peered":"2024-04-26T20:58:10.649194+0000","last_clean":"2024-04-26T20:58:10.649194+0000","last_became_active":"2024-04-26T20:57:51.575446+0000","last_became_peered":"2024-04-26T20:57:51.575446+0000","last_unstale":"2024-04-26T20:58:10.649194+0000","last_undegraded":"2024-04-26T20:58:10.649194+0000","last_fullsized":"2024-04-26T20:58:10.649194+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:05.463288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.672682+0000","last_change":"2024-04-26T20:58:10.670833+0000","last_active":"2024-04-26T20:58:10.672682+0000","last_peered":"2024-04-26T20:58:10.672682+0000","last_clean":"2024-04-26T20:58:10.672682+0000","last_became_active":"2024-04-26T20:58:10.670522+0000","last_became_peered":"2024-04-26T20:58:10.670522+0000","last_unstale":"2024-04-26T20:58:10.672682+0000","last_undegraded":"2024-04-26T20:58:10.672682+0000","last_fullsized":"2024-04-26T20:58:10.672682+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:06:19.339683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"41'7","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.648935+0000","last_change":"2024-04-26T20:57:52.585080+0000","last_active":"2024-04-26T20:58:10.648935+0000","last_peered":"2024-04-26T20:58:10.648935+0000","last_clean":"2024-04-26T20:58:10.648935+0000","last_became_active":"2024-04-26T20:57:52.584794+0000","last_became_peered":"2024-04-26T20:57:52.584794+0000","last_unstale":"2024-04-26T20:58:10.648935+0000","last_undegraded":"2024-04-26T20:58:10.648935+0000","last_fullsized":"2024-04-26T20:58:10.648935+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:13.183123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"42'3","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.653661+0000","last_change":"2024-04-26T20:57:51.569389+0000","last_active":"2024-04-26T20:58:10.653661+0000","last_peered":"2024-04-26T20:58:10.653661+0000","last_clean":"2024-04-26T20:58:10.653661+0000","last_became_active":"2024-04-26T20:57:51.569128+0000","last_became_peered":"2024-04-26T20:57:51.569128+0000","last_unstale":"2024-04-26T20:58:10.653661+0000","last_undegraded":"2024-04-26T20:58:10.653661+0000","last_fullsized":"2024-04-26T20:58:10.653661+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:44.305635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.678143+0000","last_change":"2024-04-26T20:58:10.673866+0000","last_active":"2024-04-26T20:58:10.678143+0000","last_peered":"2024-04-26T20:58:10.678143+0000","last_clean":"2024-04-26T20:58:10.678143+0000","last_became_active":"2024-04-26T20:58:10.673565+0000","last_became_peered":"2024-04-26T20:58:10.673565+0000","last_unstale":"2024-04-26T20:58:10.678143+0000","last_undegraded":"2024-04-26T20:58:10.678143+0000","last_fullsized":"2024-04-26T20:58:10.678143+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:12:23.450727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"41'5","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.649298+0000","last_change":"2024-04-26T20:57:52.580234+0000","last_active":"2024-04-26T20:58:10.649298+0000","last_peered":"2024-04-26T20:58:10.649298+0000","last_clean":"2024-04-26T20:58:10.649298+0000","last_became_active":"2024-04-26T20:57:52.579929+0000","last_became_peered":"2024-04-26T20:57:52.579929+0000","last_unstale":"2024-04-26T20:58:10.649298+0000","last_undegraded":"2024-04-26T20:58:10.649298+0000","last_fullsized":"2024-04-26T20:58:10.649298+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:06:01.245752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"42'2","reported_seq":28,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.661236+0000","last_change":"2024-04-26T20:57:51.577610+0000","last_active":"2024-04-26T20:58:10.661236+0000","last_peered":"2024-04-26T20:58:10.661236+0000","last_clean":"2024-04-26T20:58:10.661236+0000","last_became_active":"2024-04-26T20:57:51.577352+0000","last_became_peered":"2024-04-26T20:57:51.577352+0000","last_unstale":"2024-04-26T20:58:10.661236+0000","last_undegraded":"2024-04-26T20:58:10.661236+0000","last_fullsized":"2024-04-26T20:58:10.661236+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:05:01.247112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.675950+0000","last_change":"2024-04-26T20:58:10.672457+0000","last_active":"2024-04-26T20:58:10.675950+0000","last_peered":"2024-04-26T20:58:10.675950+0000","last_clean":"2024-04-26T20:58:10.675950+0000","last_became_active":"2024-04-26T20:58:10.671871+0000","last_became_peered":"2024-04-26T20:58:10.671871+0000","last_unstale":"2024-04-26T20:58:10.675950+0000","last_undegraded":"2024-04-26T20:58:10.675950+0000","last_fullsized":"2024-04-26T20:58:10.675950+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:06:19.339683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"41'9","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.666797+0000","last_change":"2024-04-26T20:57:52.593107+0000","last_active":"2024-04-26T20:58:10.666797+0000","last_peered":"2024-04-26T20:58:10.666797+0000","last_clean":"2024-04-26T20:58:10.666797+0000","last_became_active":"2024-04-26T20:57:52.592849+0000","last_became_peered":"2024-04-26T20:57:52.592849+0000","last_unstale":"2024-04-26T20:58:10.666797+0000","last_undegraded":"2024-04-26T20:58:10.666797+0000","last_fullsized":"2024-04-26T20:58:10.666797+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:18.275862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":25,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.663053+0000","last_change":"2024-04-26T20:57:51.573218+0000","last_active":"2024-04-26T20:58:10.663053+0000","last_peered":"2024-04-26T20:58:10.663053+0000","last_clean":"2024-04-26T20:58:10.663053+0000","last_became_active":"2024-04-26T20:57:51.572070+0000","last_became_peered":"2024-04-26T20:57:51.572070+0000","last_unstale":"2024-04-26T20:58:10.663053+0000","last_undegraded":"2024-04-26T20:58:10.663053+0000","last_fullsized":"2024-04-26T20:58:10.663053+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:43.209710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.673771+0000","last_change":"2024-04-26T20:58:10.669638+0000","last_active":"2024-04-26T20:58:10.673771+0000","last_peered":"2024-04-26T20:58:10.673771+0000","last_clean":"2024-04-26T20:58:10.673771+0000","last_became_active":"2024-04-26T20:58:10.669290+0000","last_became_peered":"2024-04-26T20:58:10.669290+0000","last_unstale":"2024-04-26T20:58:10.673771+0000","last_undegraded":"2024-04-26T20:58:10.673771+0000","last_fullsized":"2024-04-26T20:58:10.673771+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:40:10.235206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"41'9","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.652124+0000","last_change":"2024-04-26T20:57:52.580620+0000","last_active":"2024-04-26T20:58:10.652124+0000","last_peered":"2024-04-26T20:58:10.652124+0000","last_clean":"2024-04-26T20:58:10.652124+0000","last_became_active":"2024-04-26T20:57:52.580262+0000","last_became_peered":"2024-04-26T20:57:52.580262+0000","last_unstale":"2024-04-26T20:58:10.652124+0000","last_undegraded":"2024-04-26T20:58:10.652124+0000","last_fullsized":"2024-04-26T20:58:10.652124+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:17:36.055479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"42'4","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.663095+0000","last_change":"2024-04-26T20:57:51.572477+0000","last_active":"2024-04-26T20:58:10.663095+0000","last_peered":"2024-04-26T20:58:10.663095+0000","last_clean":"2024-04-26T20:58:10.663095+0000","last_became_active":"2024-04-26T20:57:51.572200+0000","last_became_peered":"2024-04-26T20:57:51.572200+0000","last_unstale":"2024-04-26T20:58:10.663095+0000","last_undegraded":"2024-04-26T20:58:10.663095+0000","last_fullsized":"2024-04-26T20:58:10.663095+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:03:39.964597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.672417+0000","last_change":"2024-04-26T20:58:10.666288+0000","last_active":"2024-04-26T20:58:10.672417+0000","last_peered":"2024-04-26T20:58:10.672417+0000","last_clean":"2024-04-26T20:58:10.672417+0000","last_became_active":"2024-04-26T20:58:10.665961+0000","last_became_peered":"2024-04-26T20:58:10.665961+0000","last_unstale":"2024-04-26T20:58:10.672417+0000","last_undegraded":"2024-04-26T20:58:10.672417+0000","last_fullsized":"2024-04-26T20:58:10.672417+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:44:21.388441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"41'2","reported_seq":22,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T20:58:07.654114+0000","last_change":"2024-04-26T20:57:52.570952+0000","last_active":"2024-04-26T20:58:07.654114+0000","last_peered":"2024-04-26T20:58:07.654114+0000","last_clean":"2024-04-26T20:58:07.654114+0000","last_became_active":"2024-04-26T20:57:52.570601+0000","last_became_peered":"2024-04-26T20:57:52.570601+0000","last_unstale":"2024-04-26T20:58:07.654114+0000","last_undegraded":"2024-04-26T20:58:07.654114+0000","last_fullsized":"2024-04-26T20:58:07.654114+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:05.767731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":26,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.657844+0000","last_change":"2024-04-26T20:57:51.575051+0000","last_active":"2024-04-26T20:58:10.657844+0000","last_peered":"2024-04-26T20:58:10.657844+0000","last_clean":"2024-04-26T20:58:10.657844+0000","last_became_active":"2024-04-26T20:57:51.574755+0000","last_became_peered":"2024-04-26T20:57:51.574755+0000","last_unstale":"2024-04-26T20:58:10.657844+0000","last_undegraded":"2024-04-26T20:58:10.657844+0000","last_fullsized":"2024-04-26T20:58:10.657844+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:32.553314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.678816+0000","last_change":"2024-04-26T20:58:10.676156+0000","last_active":"2024-04-26T20:58:10.678816+0000","last_peered":"2024-04-26T20:58:10.678816+0000","last_clean":"2024-04-26T20:58:10.678816+0000","last_became_active":"2024-04-26T20:58:10.674594+0000","last_became_peered":"2024-04-26T20:58:10.674594+0000","last_unstale":"2024-04-26T20:58:10.678816+0000","last_undegraded":"2024-04-26T20:58:10.678816+0000","last_fullsized":"2024-04-26T20:58:10.678816+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:23.447610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"41'5","reported_seq":32,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.651508+0000","last_change":"2024-04-26T20:57:52.584567+0000","last_active":"2024-04-26T20:58:10.651508+0000","last_peered":"2024-04-26T20:58:10.651508+0000","last_clean":"2024-04-26T20:58:10.651508+0000","last_became_active":"2024-04-26T20:57:52.584136+0000","last_became_peered":"2024-04-26T20:57:52.584136+0000","last_unstale":"2024-04-26T20:58:10.651508+0000","last_undegraded":"2024-04-26T20:58:10.651508+0000","last_fullsized":"2024-04-26T20:58:10.651508+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:39:52.141275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":25,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.648436+0000","last_change":"2024-04-26T20:57:51.573894+0000","last_active":"2024-04-26T20:58:10.648436+0000","last_peered":"2024-04-26T20:58:10.648436+0000","last_clean":"2024-04-26T20:58:10.648436+0000","last_became_active":"2024-04-26T20:57:51.573467+0000","last_became_peered":"2024-04-26T20:57:51.573467+0000","last_unstale":"2024-04-26T20:58:10.648436+0000","last_undegraded":"2024-04-26T20:58:10.648436+0000","last_fullsized":"2024-04-26T20:58:10.648436+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:53.725346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:58:09.636100+0000","last_change":"2024-04-26T20:58:09.636100+0000","last_active":"2024-04-26T20:58:09.636100+0000","last_peered":"2024-04-26T20:58:09.636100+0000","last_clean":"2024-04-26T20:58:09.636100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:58:09.636100+0000","last_undegraded":"2024-04-26T20:58:09.636100+0000","last_fullsized":"2024-04-26T20:58:09.636100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"41'8","reported_seq":28,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T20:58:07.654320+0000","last_change":"2024-04-26T20:57:52.570583+0000","last_active":"2024-04-26T20:58:07.654320+0000","last_peered":"2024-04-26T20:58:07.654320+0000","last_clean":"2024-04-26T20:58:07.654320+0000","last_became_active":"2024-04-26T20:57:52.570303+0000","last_became_peered":"2024-04-26T20:57:52.570303+0000","last_unstale":"2024-04-26T20:58:07.654320+0000","last_undegraded":"2024-04-26T20:58:07.654320+0000","last_fullsized":"2024-04-26T20:58:07.654320+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:45.016039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":26,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.657330+0000","last_change":"2024-04-26T20:57:51.571920+0000","last_active":"2024-04-26T20:58:10.657330+0000","last_peered":"2024-04-26T20:58:10.657330+0000","last_clean":"2024-04-26T20:58:10.657330+0000","last_became_active":"2024-04-26T20:57:51.571644+0000","last_became_peered":"2024-04-26T20:57:51.571644+0000","last_unstale":"2024-04-26T20:58:10.657330+0000","last_undegraded":"2024-04-26T20:58:10.657330+0000","last_fullsized":"2024-04-26T20:58:10.657330+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:55:41.720506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.672105+0000","last_change":"2024-04-26T20:58:10.670799+0000","last_active":"2024-04-26T20:58:10.672105+0000","last_peered":"2024-04-26T20:58:10.672105+0000","last_clean":"2024-04-26T20:58:10.672105+0000","last_became_active":"2024-04-26T20:58:10.670514+0000","last_became_peered":"2024-04-26T20:58:10.670514+0000","last_unstale":"2024-04-26T20:58:10.672105+0000","last_undegraded":"2024-04-26T20:58:10.672105+0000","last_fullsized":"2024-04-26T20:58:10.672105+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:54:02.371720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"41'9","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.662414+0000","last_change":"2024-04-26T20:57:52.593531+0000","last_active":"2024-04-26T20:58:10.662414+0000","last_peered":"2024-04-26T20:58:10.662414+0000","last_clean":"2024-04-26T20:58:10.662414+0000","last_became_active":"2024-04-26T20:57:52.592602+0000","last_became_peered":"2024-04-26T20:57:52.592602+0000","last_unstale":"2024-04-26T20:58:10.662414+0000","last_undegraded":"2024-04-26T20:58:10.662414+0000","last_fullsized":"2024-04-26T20:58:10.662414+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:13.183123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"42'3","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.653774+0000","last_change":"2024-04-26T20:57:51.570771+0000","last_active":"2024-04-26T20:58:10.653774+0000","last_peered":"2024-04-26T20:58:10.653774+0000","last_clean":"2024-04-26T20:58:10.653774+0000","last_became_active":"2024-04-26T20:57:51.570488+0000","last_became_peered":"2024-04-26T20:57:51.570488+0000","last_unstale":"2024-04-26T20:58:10.653774+0000","last_undegraded":"2024-04-26T20:58:10.653774+0000","last_fullsized":"2024-04-26T20:58:10.653774+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:44:02.286474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:58:09.636100+0000","last_change":"2024-04-26T20:58:09.636100+0000","last_active":"2024-04-26T20:58:09.636100+0000","last_peered":"2024-04-26T20:58:09.636100+0000","last_clean":"2024-04-26T20:58:09.636100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:58:09.636100+0000","last_undegraded":"2024-04-26T20:58:09.636100+0000","last_fullsized":"2024-04-26T20:58:09.636100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"41'5","reported_seq":32,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.652315+0000","last_change":"2024-04-26T20:57:52.579072+0000","last_active":"2024-04-26T20:58:10.652315+0000","last_peered":"2024-04-26T20:58:10.652315+0000","last_clean":"2024-04-26T20:58:10.652315+0000","last_became_active":"2024-04-26T20:57:52.578605+0000","last_became_peered":"2024-04-26T20:57:52.578605+0000","last_unstale":"2024-04-26T20:58:10.652315+0000","last_undegraded":"2024-04-26T20:58:10.652315+0000","last_fullsized":"2024-04-26T20:58:10.652315+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:29:56.009862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"42'5","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.664616+0000","last_change":"2024-04-26T20:57:51.577840+0000","last_active":"2024-04-26T20:58:10.664616+0000","last_peered":"2024-04-26T20:58:10.664616+0000","last_clean":"2024-04-26T20:58:10.664616+0000","last_became_active":"2024-04-26T20:57:51.577584+0000","last_became_peered":"2024-04-26T20:57:51.577584+0000","last_unstale":"2024-04-26T20:58:10.664616+0000","last_undegraded":"2024-04-26T20:58:10.664616+0000","last_fullsized":"2024-04-26T20:58:10.664616+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:41:35.733249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.669904+0000","last_change":"2024-04-26T20:58:10.668616+0000","last_active":"2024-04-26T20:58:10.669904+0000","last_peered":"2024-04-26T20:58:10.669904+0000","last_clean":"2024-04-26T20:58:10.669904+0000","last_became_active":"2024-04-26T20:58:10.668030+0000","last_became_peered":"2024-04-26T20:58:10.668030+0000","last_unstale":"2024-04-26T20:58:10.669904+0000","last_undegraded":"2024-04-26T20:58:10.669904+0000","last_fullsized":"2024-04-26T20:58:10.669904+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:55:04.636924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"41'7","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.665649+0000","last_change":"2024-04-26T20:57:52.580763+0000","last_active":"2024-04-26T20:58:10.665649+0000","last_peered":"2024-04-26T20:58:10.665649+0000","last_clean":"2024-04-26T20:58:10.665649+0000","last_became_active":"2024-04-26T20:57:52.580489+0000","last_became_peered":"2024-04-26T20:57:52.580489+0000","last_unstale":"2024-04-26T20:58:10.665649+0000","last_undegraded":"2024-04-26T20:58:10.665649+0000","last_fullsized":"2024-04-26T20:58:10.665649+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:52:00.840874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":26,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.661342+0000","last_change":"2024-04-26T20:57:51.574263+0000","last_active":"2024-04-26T20:58:10.661342+0000","last_peered":"2024-04-26T20:58:10.661342+0000","last_clean":"2024-04-26T20:58:10.661342+0000","last_became_active":"2024-04-26T20:57:51.573941+0000","last_became_peered":"2024-04-26T20:57:51.573941+0000","last_unstale":"2024-04-26T20:58:10.661342+0000","last_undegraded":"2024-04-26T20:58:10.661342+0000","last_fullsized":"2024-04-26T20:58:10.661342+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:38.596761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.659812+0000","last_change":"2024-04-26T20:58:10.657492+0000","last_active":"2024-04-26T20:58:10.659812+0000","last_peered":"2024-04-26T20:58:10.659812+0000","last_clean":"2024-04-26T20:58:10.659812+0000","last_became_active":"2024-04-26T20:58:10.657039+0000","last_became_peered":"2024-04-26T20:58:10.657039+0000","last_unstale":"2024-04-26T20:58:10.659812+0000","last_undegraded":"2024-04-26T20:58:10.659812+0000","last_fullsized":"2024-04-26T20:58:10.659812+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:28:38.251611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"41'8","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.659974+0000","last_change":"2024-04-26T20:57:52.592217+0000","last_active":"2024-04-26T20:58:10.659974+0000","last_peered":"2024-04-26T20:58:10.659974+0000","last_clean":"2024-04-26T20:58:10.659974+0000","last_became_active":"2024-04-26T20:57:52.591954+0000","last_became_peered":"2024-04-26T20:57:52.591954+0000","last_unstale":"2024-04-26T20:58:10.659974+0000","last_undegraded":"2024-04-26T20:58:10.659974+0000","last_fullsized":"2024-04-26T20:58:10.659974+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:23:22.653755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":22,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T20:58:07.654567+0000","last_change":"2024-04-26T20:57:51.571206+0000","last_active":"2024-04-26T20:58:07.654567+0000","last_peered":"2024-04-26T20:58:07.654567+0000","last_clean":"2024-04-26T20:58:07.654567+0000","last_became_active":"2024-04-26T20:57:51.570877+0000","last_became_peered":"2024-04-26T20:57:51.570877+0000","last_unstale":"2024-04-26T20:58:07.654567+0000","last_undegraded":"2024-04-26T20:58:07.654567+0000","last_fullsized":"2024-04-26T20:58:07.654567+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:49:38.164099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.667620+0000","last_change":"2024-04-26T20:58:10.665973+0000","last_active":"2024-04-26T20:58:10.667620+0000","last_peered":"2024-04-26T20:58:10.667620+0000","last_clean":"2024-04-26T20:58:10.667620+0000","last_became_active":"2024-04-26T20:58:10.665680+0000","last_became_peered":"2024-04-26T20:58:10.665680+0000","last_unstale":"2024-04-26T20:58:10.667620+0000","last_undegraded":"2024-04-26T20:58:10.667620+0000","last_fullsized":"2024-04-26T20:58:10.667620+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:06:56.528347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"41'5","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.658435+0000","last_change":"2024-04-26T20:57:52.594833+0000","last_active":"2024-04-26T20:58:10.658435+0000","last_peered":"2024-04-26T20:58:10.658435+0000","last_clean":"2024-04-26T20:58:10.658435+0000","last_became_active":"2024-04-26T20:57:52.594522+0000","last_became_peered":"2024-04-26T20:57:52.594522+0000","last_unstale":"2024-04-26T20:58:10.658435+0000","last_undegraded":"2024-04-26T20:58:10.658435+0000","last_fullsized":"2024-04-26T20:58:10.658435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:45.313671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":28,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.651880+0000","last_change":"2024-04-26T20:57:51.574086+0000","last_active":"2024-04-26T20:58:10.651880+0000","last_peered":"2024-04-26T20:58:10.651880+0000","last_clean":"2024-04-26T20:58:10.651880+0000","last_became_active":"2024-04-26T20:57:51.573834+0000","last_became_peered":"2024-04-26T20:57:51.573834+0000","last_unstale":"2024-04-26T20:58:10.651880+0000","last_undegraded":"2024-04-26T20:58:10.651880+0000","last_fullsized":"2024-04-26T20:58:10.651880+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:50:32.238625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.672714+0000","last_change":"2024-04-26T20:58:10.667021+0000","last_active":"2024-04-26T20:58:10.672714+0000","last_peered":"2024-04-26T20:58:10.672714+0000","last_clean":"2024-04-26T20:58:10.672714+0000","last_became_active":"2024-04-26T20:58:10.666042+0000","last_became_peered":"2024-04-26T20:58:10.666042+0000","last_unstale":"2024-04-26T20:58:10.672714+0000","last_undegraded":"2024-04-26T20:58:10.672714+0000","last_fullsized":"2024-04-26T20:58:10.672714+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:03.407602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"41'8","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.653027+0000","last_change":"2024-04-26T20:57:52.588655+0000","last_active":"2024-04-26T20:58:10.653027+0000","last_peered":"2024-04-26T20:58:10.653027+0000","last_clean":"2024-04-26T20:58:10.653027+0000","last_became_active":"2024-04-26T20:57:52.588356+0000","last_became_peered":"2024-04-26T20:57:52.588356+0000","last_unstale":"2024-04-26T20:58:10.653027+0000","last_undegraded":"2024-04-26T20:58:10.653027+0000","last_fullsized":"2024-04-26T20:58:10.653027+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:23.034777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":27,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.652745+0000","last_change":"2024-04-26T20:57:51.567675+0000","last_active":"2024-04-26T20:58:10.652745+0000","last_peered":"2024-04-26T20:58:10.652745+0000","last_clean":"2024-04-26T20:58:10.652745+0000","last_became_active":"2024-04-26T20:57:51.567464+0000","last_became_peered":"2024-04-26T20:57:51.567464+0000","last_unstale":"2024-04-26T20:58:10.652745+0000","last_undegraded":"2024-04-26T20:58:10.652745+0000","last_fullsized":"2024-04-26T20:58:10.652745+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:17.267826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T20:58:09.636100+0000","last_change":"2024-04-26T20:58:09.636100+0000","last_active":"2024-04-26T20:58:09.636100+0000","last_peered":"2024-04-26T20:58:09.636100+0000","last_clean":"2024-04-26T20:58:09.636100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T20:58:09.636100+0000","last_undegraded":"2024-04-26T20:58:09.636100+0000","last_fullsized":"2024-04-26T20:58:09.636100+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"41'7","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.651737+0000","last_change":"2024-04-26T20:57:52.587210+0000","last_active":"2024-04-26T20:58:10.651737+0000","last_peered":"2024-04-26T20:58:10.651737+0000","last_clean":"2024-04-26T20:58:10.651737+0000","last_became_active":"2024-04-26T20:57:52.587015+0000","last_became_peered":"2024-04-26T20:57:52.587015+0000","last_unstale":"2024-04-26T20:58:10.651737+0000","last_undegraded":"2024-04-26T20:58:10.651737+0000","last_fullsized":"2024-04-26T20:58:10.651737+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:05.353679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":22,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T20:58:07.654660+0000","last_change":"2024-04-26T20:57:51.579142+0000","last_active":"2024-04-26T20:58:07.654660+0000","last_peered":"2024-04-26T20:58:07.654660+0000","last_clean":"2024-04-26T20:58:07.654660+0000","last_became_active":"2024-04-26T20:57:51.578834+0000","last_became_peered":"2024-04-26T20:57:51.578834+0000","last_unstale":"2024-04-26T20:58:07.654660+0000","last_undegraded":"2024-04-26T20:58:07.654660+0000","last_fullsized":"2024-04-26T20:58:07.654660+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:48:04.831644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.673957+0000","last_change":"2024-04-26T20:58:10.671508+0000","last_active":"2024-04-26T20:58:10.673957+0000","last_peered":"2024-04-26T20:58:10.673957+0000","last_clean":"2024-04-26T20:58:10.673957+0000","last_became_active":"2024-04-26T20:58:10.671203+0000","last_became_peered":"2024-04-26T20:58:10.671203+0000","last_unstale":"2024-04-26T20:58:10.673957+0000","last_undegraded":"2024-04-26T20:58:10.673957+0000","last_fullsized":"2024-04-26T20:58:10.673957+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:23.447610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"41'8","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.653562+0000","last_change":"2024-04-26T20:57:52.569231+0000","last_active":"2024-04-26T20:58:10.653562+0000","last_peered":"2024-04-26T20:58:10.653562+0000","last_clean":"2024-04-26T20:58:10.653562+0000","last_became_active":"2024-04-26T20:57:52.568915+0000","last_became_peered":"2024-04-26T20:57:52.568915+0000","last_unstale":"2024-04-26T20:58:10.653562+0000","last_undegraded":"2024-04-26T20:58:10.653562+0000","last_fullsized":"2024-04-26T20:58:10.653562+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:48.878142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":28,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.651893+0000","last_change":"2024-04-26T20:57:51.574337+0000","last_active":"2024-04-26T20:58:10.651893+0000","last_peered":"2024-04-26T20:58:10.651893+0000","last_clean":"2024-04-26T20:58:10.651893+0000","last_became_active":"2024-04-26T20:57:51.573114+0000","last_became_peered":"2024-04-26T20:57:51.573114+0000","last_unstale":"2024-04-26T20:58:10.651893+0000","last_undegraded":"2024-04-26T20:58:10.651893+0000","last_fullsized":"2024-04-26T20:58:10.651893+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:36:54.823396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":215,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.648435+0000","last_change":"2024-04-26T20:56:29.347462+0000","last_active":"2024-04-26T20:58:10.648435+0000","last_peered":"2024-04-26T20:58:10.648435+0000","last_clean":"2024-04-26T20:58:10.648435+0000","last_became_active":"2024-04-26T20:56:29.346224+0000","last_became_peered":"2024-04-26T20:56:29.346224+0000","last_unstale":"2024-04-26T20:58:10.648435+0000","last_undegraded":"2024-04-26T20:58:10.648435+0000","last_fullsized":"2024-04-26T20:58:10.648435+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:28.079105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:28.079105+0000","last_clean_scrub_stamp":"2024-04-26T20:56:28.079105+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:13.693525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":7},{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":504,"ondisk_log_size":504,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":97,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":84,"ondisk_log_size":84,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509465,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":552960,"data_stored":246517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509464,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":552960,"data_stored":246517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509465,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32240,"kb_used_data":5216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":5341184,"data_stored":5031189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509465,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33708,"kb_used_data":6672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94338132,"statfs":{"total":96636764160,"available":96602247168,"internally_reserved":0,"allocated":6832128,"data_stored":6530257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509465,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":552960,"data_stored":246517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509464,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28144,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343696,"statfs":{"total":96636764160,"available":96607944704,"internally_reserved":0,"allocated":1146880,"data_stored":836885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509463,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29612,"kb_used_data":2588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342228,"statfs":{"total":96636764160,"available":96606441472,"internally_reserved":0,"allocated":2650112,"data_stored":2343669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27576,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344264,"statfs":{"total":96636764160,"available":96608526336,"internally_reserved":0,"allocated":528384,"data_stored":231644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T20:58:15.134 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T20:58:15.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.308+0000 7fb3e9000640 1 Processor -- start 2024-04-26T20:58:15.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.308+0000 7fb3e9000640 1 -- start start 2024-04-26T20:58:15.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.308+0000 7fb3e9000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb3e40cc1e0 0x7fb3e40ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:15.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.308+0000 7fb3e9000640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3e40727f0 con 0x7fb3e415cf80 2024-04-26T20:58:15.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.308+0000 7fb3e9000640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3e4072a70 con 0x7fb3e40cbe00 2024-04-26T20:58:15.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.308+0000 7fb3e9000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb3e4074220 con 0x7fb3e40cc1e0 2024-04-26T20:58:15.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.312+0000 7fb3d9400640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fb3e415cf80 0x7fb3e4073b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:60998/0 (socket says 172.21.15.138:60998) 2024-04-26T20:58:15.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.312+0000 7fb3d9400640 1 -- 172.21.15.138:0/3085533017 learned_addr learned my addr 172.21.15.138:0/3085533017 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:15.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.312+0000 7fb3e2800640 1 --2- 172.21.15.138:0/3085533017 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb3e40cc1e0 0x7fb3e40ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:15.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.312+0000 7fb3e1400640 1 -- 172.21.15.138:0/3085533017 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3101652656 0 0) 0x7fb3cc001120 con 0x7fb3e415cf80 2024-04-26T20:58:15.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.312+0000 7fb3e1400640 1 -- 172.21.15.138:0/3085533017 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3c8003530 con 0x7fb3e415cf80 2024-04-26T20:58:15.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.312+0000 7fb3e1400640 1 -- 172.21.15.138:0/3085533017 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 409868838 0 0) 0x7fb3e4072a70 con 0x7fb3e40cbe00 2024-04-26T20:58:15.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.312+0000 7fb3e1400640 1 -- 172.21.15.138:0/3085533017 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3cc001120 con 0x7fb3e40cbe00 2024-04-26T20:58:15.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.312+0000 7fb3e2800640 1 -- 172.21.15.138:0/3085533017 >> v1:172.21.15.143:6789/0 conn(0x7fb3e40cbe00 legacy=0x7fb3e406de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:15.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.312+0000 7fb3e2800640 1 -- 172.21.15.138:0/3085533017 >> v1:172.21.15.138:6789/0 conn(0x7fb3e415cf80 legacy=0x7fb3e4073b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:15.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.312+0000 7fb3e2800640 1 -- 172.21.15.138:0/3085533017 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3e4072d50 con 0x7fb3e40cc1e0 2024-04-26T20:58:15.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.312+0000 7fb3e2800640 1 --2- 172.21.15.138:0/3085533017 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb3e40cc1e0 0x7fb3e40ce6f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc009dc0 tx=0x7fb3dc01c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ded8b0ef4d3a228 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:15.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.316+0000 7fb3e1400640 1 -- 172.21.15.138:0/3085533017 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc0b2070 con 0x7fb3e40cc1e0 2024-04-26T20:58:15.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.316+0000 7fb3e1400640 1 -- 172.21.15.138:0/3085533017 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3dc0a5850 con 0x7fb3e40cc1e0 2024-04-26T20:58:15.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.316+0000 7fb3e1400640 1 -- 172.21.15.138:0/3085533017 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc0a5c20 con 0x7fb3e40cc1e0 2024-04-26T20:58:15.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.316+0000 7fb3e9000640 1 -- 172.21.15.138:0/3085533017 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb3e40cc1e0 msgr2=0x7fb3e40ce6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:15.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.316+0000 7fb3e9000640 1 --2- 172.21.15.138:0/3085533017 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb3e40cc1e0 0x7fb3e40ce6f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc009dc0 tx=0x7fb3dc01c990 comp rx=0 tx=0).stop 2024-04-26T20:58:15.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.316+0000 7fb3e9000640 1 -- 172.21.15.138:0/3085533017 shutdown_connections 2024-04-26T20:58:15.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.316+0000 7fb3e9000640 1 --2- 172.21.15.138:0/3085533017 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb3e40cc1e0 0x7fb3e40ce6f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:15.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.316+0000 7fb3e9000640 1 -- 172.21.15.138:0/3085533017 >> 172.21.15.138:0/3085533017 conn(0x7fb3e40d0b20 msgr2=0x7fb3e40d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:15.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.316+0000 7fb3e9000640 1 -- 172.21.15.138:0/3085533017 shutdown_connections 2024-04-26T20:58:15.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.316+0000 7fb3e9000640 1 -- 172.21.15.138:0/3085533017 wait complete. 2024-04-26T20:58:15.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.316+0000 7fb3e9000640 1 Processor -- start 2024-04-26T20:58:15.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.316+0000 7fb3e9000640 1 -- start start 2024-04-26T20:58:15.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.316+0000 7fb3e9000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb3e40cbe00 0x7fb3e4152fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:15.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.316+0000 7fb3e9000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb3e40cc1e0 0x7fb3e414b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:15.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.316+0000 7fb3e9000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb3e415cf80 0x7fb3e406e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:15.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.316+0000 7fb3e9000640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e40d0780 con 0x7fb3e40cbe00 2024-04-26T20:58:15.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.316+0000 7fb3e9000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e4073680 con 0x7fb3e415cf80 2024-04-26T20:58:15.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.316+0000 7fb3e9000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb3e40d0900 con 0x7fb3e40cc1e0 2024-04-26T20:58:15.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.320+0000 7fb3e1e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb3e40cbe00 0x7fb3e4152fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:15.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.320+0000 7fb3e1e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb3e40cbe00 0x7fb3e4152fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:54192/0 (socket says 172.21.15.138:54192) 2024-04-26T20:58:15.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.320+0000 7fb3e1e00640 1 -- 172.21.15.138:0/2977344494 learned_addr learned my addr 172.21.15.138:0/2977344494 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:15.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.320+0000 7fb3d9400640 1 --2- 172.21.15.138:0/2977344494 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb3e40cc1e0 0x7fb3e414b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:15.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.320+0000 7fb3e2800640 1 --2- 172.21.15.138:0/2977344494 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb3e415cf80 0x7fb3e406e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:15.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.320+0000 7fb3e1e00640 1 -- 172.21.15.138:0/2977344494 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb3e40cc1e0 msgr2=0x7fb3e414b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:15.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.320+0000 7fb3e1e00640 1 --2- 172.21.15.138:0/2977344494 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb3e40cc1e0 0x7fb3e414b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:15.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.320+0000 7fb3e1e00640 1 -- 172.21.15.138:0/2977344494 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb3e415cf80 msgr2=0x7fb3e406e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:15.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.320+0000 7fb3e1e00640 1 --2- 172.21.15.138:0/2977344494 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb3e415cf80 0x7fb3e406e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:15.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.320+0000 7fb3e1e00640 1 -- 172.21.15.138:0/2977344494 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3e40c98f0 con 0x7fb3e40cbe00 2024-04-26T20:58:15.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.320+0000 7fb3e1e00640 1 --2- 172.21.15.138:0/2977344494 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb3e40cbe00 0x7fb3e4152fc0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fb3d400c430 tx=0x7fb3d400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:15.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.320+0000 7fb3daa00640 1 -- 172.21.15.138:0/2977344494 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d4017070 con 0x7fb3e40cbe00 2024-04-26T20:58:15.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.320+0000 7fb3daa00640 1 -- 172.21.15.138:0/2977344494 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3d40052f0 con 0x7fb3e40cbe00 2024-04-26T20:58:15.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.320+0000 7fb3daa00640 1 -- 172.21.15.138:0/2977344494 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d4003840 con 0x7fb3e40cbe00 2024-04-26T20:58:15.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.320+0000 7fb3e9000640 1 -- 172.21.15.138:0/2977344494 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3e40c9bd0 con 0x7fb3e40cbe00 2024-04-26T20:58:15.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.320+0000 7fb3e9000640 1 -- 172.21.15.138:0/2977344494 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3e40ca190 con 0x7fb3e40cbe00 2024-04-26T20:58:15.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.320+0000 7fb3e9000640 1 -- 172.21.15.138:0/2977344494 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3e4069510 con 0x7fb3e40cbe00 2024-04-26T20:58:15.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.320+0000 7fb3daa00640 1 -- 172.21.15.138:0/2977344494 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb3d401a070 con 0x7fb3e40cbe00 2024-04-26T20:58:15.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.320+0000 7fb3daa00640 1 --2- 172.21.15.138:0/2977344494 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb3c0068380 0x7fb3c006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:15.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.324+0000 7fb3daa00640 1 -- 172.21.15.138:0/2977344494 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6640+0+0 (secure 0 0 0) 0x7fb3d4086120 con 0x7fb3e40cbe00 2024-04-26T20:58:15.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.324+0000 7fb3d9400640 1 --2- 172.21.15.138:0/2977344494 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb3c0068380 0x7fb3c006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:15.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.324+0000 7fb3d9400640 1 --2- 172.21.15.138:0/2977344494 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb3c0068380 0x7fb3c006a840 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb3e40cb120 tx=0x7fb3cc007d40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:15.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.324+0000 7fb3daa00640 1 -- 172.21.15.138:0/2977344494 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb3d4055c80 con 0x7fb3e40cbe00 2024-04-26T20:58:15.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.480+0000 7fb3e9000640 1 -- 172.21.15.138:0/2977344494 --> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb3e4151040 con 0x7fb3c0068380 2024-04-26T20:58:15.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.488+0000 7fb3daa00640 1 -- 172.21.15.138:0/2977344494 <== mgr.4100 v2:172.21.15.143:6832/4275464198 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332510 (secure 0 0 0) 0x7fb3e4151040 con 0x7fb3c0068380 2024-04-26T20:58:15.491 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:15.497 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-04-26T20:58:15.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.492+0000 7fb3e9000640 1 -- 172.21.15.138:0/2977344494 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb3c0068380 msgr2=0x7fb3c006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:15.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.492+0000 7fb3e9000640 1 --2- 172.21.15.138:0/2977344494 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb3c0068380 0x7fb3c006a840 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb3e40cb120 tx=0x7fb3cc007d40 comp rx=0 tx=0).stop 2024-04-26T20:58:15.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.492+0000 7fb3e9000640 1 -- 172.21.15.138:0/2977344494 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb3e40cbe00 msgr2=0x7fb3e4152fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:15.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.492+0000 7fb3e9000640 1 --2- 172.21.15.138:0/2977344494 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb3e40cbe00 0x7fb3e4152fc0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fb3d400c430 tx=0x7fb3d400c8f0 comp rx=0 tx=0).stop 2024-04-26T20:58:15.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.492+0000 7fb3e9000640 1 -- 172.21.15.138:0/2977344494 shutdown_connections 2024-04-26T20:58:15.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.492+0000 7fb3e9000640 1 --2- 172.21.15.138:0/2977344494 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb3c0068380 0x7fb3c006a840 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:15.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.492+0000 7fb3e9000640 1 --2- 172.21.15.138:0/2977344494 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb3e415cf80 0x7fb3e406e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:15.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.492+0000 7fb3e9000640 1 --2- 172.21.15.138:0/2977344494 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb3e40cc1e0 0x7fb3e414b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:15.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.492+0000 7fb3e9000640 1 --2- 172.21.15.138:0/2977344494 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb3e40cbe00 0x7fb3e4152fc0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:15.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.492+0000 7fb3e9000640 1 -- 172.21.15.138:0/2977344494 >> 172.21.15.138:0/2977344494 conn(0x7fb3e40d0b20 msgr2=0x7fb3e40b37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:15.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.492+0000 7fb3e9000640 1 -- 172.21.15.138:0/2977344494 shutdown_connections 2024-04-26T20:58:15.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.492+0000 7fb3e9000640 1 -- 172.21.15.138:0/2977344494 wait complete. 2024-04-26T20:58:15.514 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":98,"stamp":"2024-04-26T20:58:15.263753+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6881824,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":117,"num_read_kb":100,"num_write":260,"num_write_kb":8602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":705,"ondisk_log_size":705,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":234,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":233956,"kb_used_data":17768,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754740764,"statfs":{"total":773094113280,"available":772854542336,"internally_reserved":0,"allocated":18194432,"data_stored":15735324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-764,"num_objects":-15,"num_object_clones":0,"num_object_copies":-30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-15,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":31,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001306"},"pg_stats":[{"pgid":"6.3f","version":"41'8","reported_seq":35,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.698258+0000","last_change":"2024-04-26T20:57:52.581808+0000","last_active":"2024-04-26T20:58:12.698258+0000","last_peered":"2024-04-26T20:58:12.698258+0000","last_clean":"2024-04-26T20:58:12.698258+0000","last_became_active":"2024-04-26T20:57:52.581483+0000","last_became_peered":"2024-04-26T20:57:52.581483+0000","last_unstale":"2024-04-26T20:58:12.698258+0000","last_undegraded":"2024-04-26T20:58:12.698258+0000","last_fullsized":"2024-04-26T20:58:12.698258+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:11:15.960274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"41'4","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.658178+0000","last_change":"2024-04-26T20:57:52.584136+0000","last_active":"2024-04-26T20:58:10.658178+0000","last_peered":"2024-04-26T20:58:10.658178+0000","last_clean":"2024-04-26T20:58:10.658178+0000","last_became_active":"2024-04-26T20:57:52.583831+0000","last_became_peered":"2024-04-26T20:57:52.583831+0000","last_unstale":"2024-04-26T20:58:10.658178+0000","last_undegraded":"2024-04-26T20:58:10.658178+0000","last_fullsized":"2024-04-26T20:58:10.658178+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:47:10.436783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"41'7","reported_seq":34,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.698006+0000","last_change":"2024-04-26T20:57:52.589332+0000","last_active":"2024-04-26T20:58:12.698006+0000","last_peered":"2024-04-26T20:58:12.698006+0000","last_clean":"2024-04-26T20:58:12.698006+0000","last_became_active":"2024-04-26T20:57:52.589025+0000","last_became_peered":"2024-04-26T20:57:52.589025+0000","last_unstale":"2024-04-26T20:58:12.698006+0000","last_undegraded":"2024-04-26T20:58:12.698006+0000","last_fullsized":"2024-04-26T20:58:12.698006+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:36.442218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"41'8","reported_seq":35,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.698133+0000","last_change":"2024-04-26T20:57:52.577582+0000","last_active":"2024-04-26T20:58:12.698133+0000","last_peered":"2024-04-26T20:58:12.698133+0000","last_clean":"2024-04-26T20:58:12.698133+0000","last_became_active":"2024-04-26T20:57:52.576872+0000","last_became_peered":"2024-04-26T20:57:52.576872+0000","last_unstale":"2024-04-26T20:58:12.698133+0000","last_undegraded":"2024-04-26T20:58:12.698133+0000","last_fullsized":"2024-04-26T20:58:12.698133+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:57:10.605998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"41'4","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.660374+0000","last_change":"2024-04-26T20:57:52.590233+0000","last_active":"2024-04-26T20:58:10.660374+0000","last_peered":"2024-04-26T20:58:10.660374+0000","last_clean":"2024-04-26T20:58:10.660374+0000","last_became_active":"2024-04-26T20:57:52.589943+0000","last_became_peered":"2024-04-26T20:57:52.589943+0000","last_unstale":"2024-04-26T20:58:10.660374+0000","last_undegraded":"2024-04-26T20:58:10.660374+0000","last_fullsized":"2024-04-26T20:58:10.660374+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:12.952743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"41'6","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.657623+0000","last_change":"2024-04-26T20:57:52.586359+0000","last_active":"2024-04-26T20:58:10.657623+0000","last_peered":"2024-04-26T20:58:10.657623+0000","last_clean":"2024-04-26T20:58:10.657623+0000","last_became_active":"2024-04-26T20:57:52.586013+0000","last_became_peered":"2024-04-26T20:57:52.586013+0000","last_unstale":"2024-04-26T20:58:10.657623+0000","last_undegraded":"2024-04-26T20:58:10.657623+0000","last_fullsized":"2024-04-26T20:58:10.657623+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:52:00.840874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"41'5","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.648157+0000","last_change":"2024-04-26T20:57:52.578308+0000","last_active":"2024-04-26T20:58:10.648157+0000","last_peered":"2024-04-26T20:58:10.648157+0000","last_clean":"2024-04-26T20:58:10.648157+0000","last_became_active":"2024-04-26T20:57:52.578063+0000","last_became_peered":"2024-04-26T20:57:52.578063+0000","last_unstale":"2024-04-26T20:58:10.648157+0000","last_undegraded":"2024-04-26T20:58:10.648157+0000","last_fullsized":"2024-04-26T20:58:10.648157+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:12.952743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"41'9","reported_seq":36,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.697413+0000","last_change":"2024-04-26T20:57:52.583828+0000","last_active":"2024-04-26T20:58:12.697413+0000","last_peered":"2024-04-26T20:58:12.697413+0000","last_clean":"2024-04-26T20:58:12.697413+0000","last_became_active":"2024-04-26T20:57:52.582894+0000","last_became_peered":"2024-04-26T20:57:52.582894+0000","last_unstale":"2024-04-26T20:58:12.697413+0000","last_undegraded":"2024-04-26T20:58:12.697413+0000","last_fullsized":"2024-04-26T20:58:12.697413+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:49:03.544125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"41'11","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.661672+0000","last_change":"2024-04-26T20:57:52.590616+0000","last_active":"2024-04-26T20:58:10.661672+0000","last_peered":"2024-04-26T20:58:10.661672+0000","last_clean":"2024-04-26T20:58:10.661672+0000","last_became_active":"2024-04-26T20:57:52.589972+0000","last_became_peered":"2024-04-26T20:57:52.589972+0000","last_unstale":"2024-04-26T20:58:10.661672+0000","last_undegraded":"2024-04-26T20:58:10.661672+0000","last_fullsized":"2024-04-26T20:58:10.661672+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:55.128152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"41'15","reported_seq":39,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.649095+0000","last_change":"2024-04-26T20:57:52.575175+0000","last_active":"2024-04-26T20:58:10.649095+0000","last_peered":"2024-04-26T20:58:10.649095+0000","last_clean":"2024-04-26T20:58:10.649095+0000","last_became_active":"2024-04-26T20:57:52.574917+0000","last_became_peered":"2024-04-26T20:57:52.574917+0000","last_unstale":"2024-04-26T20:58:10.649095+0000","last_undegraded":"2024-04-26T20:58:10.649095+0000","last_fullsized":"2024-04-26T20:58:10.649095+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:28:20.157680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"41'6","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.652083+0000","last_change":"2024-04-26T20:57:52.579280+0000","last_active":"2024-04-26T20:58:10.652083+0000","last_peered":"2024-04-26T20:58:10.652083+0000","last_clean":"2024-04-26T20:58:10.652083+0000","last_became_active":"2024-04-26T20:57:52.578799+0000","last_became_peered":"2024-04-26T20:57:52.578799+0000","last_unstale":"2024-04-26T20:58:10.652083+0000","last_undegraded":"2024-04-26T20:58:10.652083+0000","last_fullsized":"2024-04-26T20:58:10.652083+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:24.709956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"41'7","reported_seq":32,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.662261+0000","last_change":"2024-04-26T20:57:52.585045+0000","last_active":"2024-04-26T20:58:10.662261+0000","last_peered":"2024-04-26T20:58:10.662261+0000","last_clean":"2024-04-26T20:58:10.662261+0000","last_became_active":"2024-04-26T20:57:52.584748+0000","last_became_peered":"2024-04-26T20:57:52.584748+0000","last_unstale":"2024-04-26T20:58:10.662261+0000","last_undegraded":"2024-04-26T20:58:10.662261+0000","last_fullsized":"2024-04-26T20:58:10.662261+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:16.143937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"41'10","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.649429+0000","last_change":"2024-04-26T20:57:52.583032+0000","last_active":"2024-04-26T20:58:10.649429+0000","last_peered":"2024-04-26T20:58:10.649429+0000","last_clean":"2024-04-26T20:58:10.649429+0000","last_became_active":"2024-04-26T20:57:52.582788+0000","last_became_peered":"2024-04-26T20:57:52.582788+0000","last_unstale":"2024-04-26T20:58:10.649429+0000","last_undegraded":"2024-04-26T20:58:10.649429+0000","last_fullsized":"2024-04-26T20:58:10.649429+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:12:05.356796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"41'8","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.654536+0000","last_change":"2024-04-26T20:57:52.577582+0000","last_active":"2024-04-26T20:58:10.654536+0000","last_peered":"2024-04-26T20:58:10.654536+0000","last_clean":"2024-04-26T20:58:10.654536+0000","last_became_active":"2024-04-26T20:57:52.577366+0000","last_became_peered":"2024-04-26T20:57:52.577366+0000","last_unstale":"2024-04-26T20:58:10.654536+0000","last_undegraded":"2024-04-26T20:58:10.654536+0000","last_fullsized":"2024-04-26T20:58:10.654536+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:16.143937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"41'7","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.652283+0000","last_change":"2024-04-26T20:57:52.586188+0000","last_active":"2024-04-26T20:58:10.652283+0000","last_peered":"2024-04-26T20:58:10.652283+0000","last_clean":"2024-04-26T20:58:10.652283+0000","last_became_active":"2024-04-26T20:57:52.585816+0000","last_became_peered":"2024-04-26T20:57:52.585816+0000","last_unstale":"2024-04-26T20:58:10.652283+0000","last_undegraded":"2024-04-26T20:58:10.652283+0000","last_fullsized":"2024-04-26T20:58:10.652283+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:34:47.231759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"41'9","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.648219+0000","last_change":"2024-04-26T20:57:52.587967+0000","last_active":"2024-04-26T20:58:10.648219+0000","last_peered":"2024-04-26T20:58:10.648219+0000","last_clean":"2024-04-26T20:58:10.648219+0000","last_became_active":"2024-04-26T20:57:52.587598+0000","last_became_peered":"2024-04-26T20:57:52.587598+0000","last_unstale":"2024-04-26T20:58:10.648219+0000","last_undegraded":"2024-04-26T20:58:10.648219+0000","last_fullsized":"2024-04-26T20:58:10.648219+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:55.128152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"41'9","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.653716+0000","last_change":"2024-04-26T20:57:52.582167+0000","last_active":"2024-04-26T20:58:10.653716+0000","last_peered":"2024-04-26T20:58:10.653716+0000","last_clean":"2024-04-26T20:58:10.653716+0000","last_became_active":"2024-04-26T20:57:52.581896+0000","last_became_peered":"2024-04-26T20:57:52.581896+0000","last_unstale":"2024-04-26T20:58:10.653716+0000","last_undegraded":"2024-04-26T20:58:10.653716+0000","last_fullsized":"2024-04-26T20:58:10.653716+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:34:07.377749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"41'10","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.653336+0000","last_change":"2024-04-26T20:57:52.582700+0000","last_active":"2024-04-26T20:58:10.653336+0000","last_peered":"2024-04-26T20:58:10.653336+0000","last_clean":"2024-04-26T20:58:10.653336+0000","last_became_active":"2024-04-26T20:57:52.582355+0000","last_became_peered":"2024-04-26T20:57:52.582355+0000","last_unstale":"2024-04-26T20:58:10.653336+0000","last_undegraded":"2024-04-26T20:58:10.653336+0000","last_fullsized":"2024-04-26T20:58:10.653336+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:36:31.798469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"41'7","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.664703+0000","last_change":"2024-04-26T20:57:52.593273+0000","last_active":"2024-04-26T20:58:10.664703+0000","last_peered":"2024-04-26T20:58:10.664703+0000","last_clean":"2024-04-26T20:58:10.664703+0000","last_became_active":"2024-04-26T20:57:52.592960+0000","last_became_peered":"2024-04-26T20:57:52.592960+0000","last_unstale":"2024-04-26T20:58:10.664703+0000","last_undegraded":"2024-04-26T20:58:10.664703+0000","last_fullsized":"2024-04-26T20:58:10.664703+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:49:19.250429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"41'8","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.651801+0000","last_change":"2024-04-26T20:57:52.569599+0000","last_active":"2024-04-26T20:58:10.651801+0000","last_peered":"2024-04-26T20:58:10.651801+0000","last_clean":"2024-04-26T20:58:10.651801+0000","last_became_active":"2024-04-26T20:57:52.569345+0000","last_became_peered":"2024-04-26T20:57:52.569345+0000","last_unstale":"2024-04-26T20:58:10.651801+0000","last_undegraded":"2024-04-26T20:58:10.651801+0000","last_fullsized":"2024-04-26T20:58:10.651801+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:31:38.044176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"41'11","reported_seq":38,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.651569+0000","last_change":"2024-04-26T20:57:52.592270+0000","last_active":"2024-04-26T20:58:10.651569+0000","last_peered":"2024-04-26T20:58:10.651569+0000","last_clean":"2024-04-26T20:58:10.651569+0000","last_became_active":"2024-04-26T20:57:52.591984+0000","last_became_peered":"2024-04-26T20:57:52.591984+0000","last_unstale":"2024-04-26T20:58:10.651569+0000","last_undegraded":"2024-04-26T20:58:10.651569+0000","last_fullsized":"2024-04-26T20:58:10.651569+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:16:22.565146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"41'9","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.651342+0000","last_change":"2024-04-26T20:57:52.576852+0000","last_active":"2024-04-26T20:58:10.651342+0000","last_peered":"2024-04-26T20:58:10.651342+0000","last_clean":"2024-04-26T20:58:10.651342+0000","last_became_active":"2024-04-26T20:57:52.575571+0000","last_became_peered":"2024-04-26T20:57:52.575571+0000","last_unstale":"2024-04-26T20:58:10.651342+0000","last_undegraded":"2024-04-26T20:58:10.651342+0000","last_fullsized":"2024-04-26T20:58:10.651342+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:45.313671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"41'8","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.652443+0000","last_change":"2024-04-26T20:57:52.586306+0000","last_active":"2024-04-26T20:58:10.652443+0000","last_peered":"2024-04-26T20:58:10.652443+0000","last_clean":"2024-04-26T20:58:10.652443+0000","last_became_active":"2024-04-26T20:57:52.585992+0000","last_became_peered":"2024-04-26T20:57:52.585992+0000","last_unstale":"2024-04-26T20:58:10.652443+0000","last_undegraded":"2024-04-26T20:58:10.652443+0000","last_fullsized":"2024-04-26T20:58:10.652443+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:30:40.828807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"41'6","reported_seq":33,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.697504+0000","last_change":"2024-04-26T20:57:52.584019+0000","last_active":"2024-04-26T20:58:12.697504+0000","last_peered":"2024-04-26T20:58:12.697504+0000","last_clean":"2024-04-26T20:58:12.697504+0000","last_became_active":"2024-04-26T20:57:52.583140+0000","last_became_peered":"2024-04-26T20:57:52.583140+0000","last_unstale":"2024-04-26T20:58:12.697504+0000","last_undegraded":"2024-04-26T20:58:12.697504+0000","last_fullsized":"2024-04-26T20:58:12.697504+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:03:50.493429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"41'2","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.654410+0000","last_change":"2024-04-26T20:57:52.579168+0000","last_active":"2024-04-26T20:58:10.654410+0000","last_peered":"2024-04-26T20:58:10.654410+0000","last_clean":"2024-04-26T20:58:10.654410+0000","last_became_active":"2024-04-26T20:57:52.578943+0000","last_became_peered":"2024-04-26T20:57:52.578943+0000","last_unstale":"2024-04-26T20:58:10.654410+0000","last_undegraded":"2024-04-26T20:58:10.654410+0000","last_fullsized":"2024-04-26T20:58:10.654410+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:55.128152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"41'15","reported_seq":42,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.697957+0000","last_change":"2024-04-26T20:57:52.585325+0000","last_active":"2024-04-26T20:58:12.697957+0000","last_peered":"2024-04-26T20:58:12.697957+0000","last_clean":"2024-04-26T20:58:12.697957+0000","last_became_active":"2024-04-26T20:57:52.585083+0000","last_became_peered":"2024-04-26T20:57:52.585083+0000","last_unstale":"2024-04-26T20:58:12.697957+0000","last_undegraded":"2024-04-26T20:58:12.697957+0000","last_fullsized":"2024-04-26T20:58:12.697957+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:33.562017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"41'6","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.652239+0000","last_change":"2024-04-26T20:57:52.578861+0000","last_active":"2024-04-26T20:58:10.652239+0000","last_peered":"2024-04-26T20:58:10.652239+0000","last_clean":"2024-04-26T20:58:10.652239+0000","last_became_active":"2024-04-26T20:57:52.578454+0000","last_became_peered":"2024-04-26T20:57:52.578454+0000","last_unstale":"2024-04-26T20:58:10.652239+0000","last_undegraded":"2024-04-26T20:58:10.652239+0000","last_fullsized":"2024-04-26T20:58:10.652239+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:36:12.618358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"41'4","reported_seq":28,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.648653+0000","last_change":"2024-04-26T20:57:52.577688+0000","last_active":"2024-04-26T20:58:10.648653+0000","last_peered":"2024-04-26T20:58:10.648653+0000","last_clean":"2024-04-26T20:58:10.648653+0000","last_became_active":"2024-04-26T20:57:52.577426+0000","last_became_peered":"2024-04-26T20:57:52.577426+0000","last_unstale":"2024-04-26T20:58:10.648653+0000","last_undegraded":"2024-04-26T20:58:10.648653+0000","last_fullsized":"2024-04-26T20:58:10.648653+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:16.143937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"41'7","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.652633+0000","last_change":"2024-04-26T20:57:52.583932+0000","last_active":"2024-04-26T20:58:10.652633+0000","last_peered":"2024-04-26T20:58:10.652633+0000","last_clean":"2024-04-26T20:58:10.652633+0000","last_became_active":"2024-04-26T20:57:52.583671+0000","last_became_peered":"2024-04-26T20:57:52.583671+0000","last_unstale":"2024-04-26T20:58:10.652633+0000","last_undegraded":"2024-04-26T20:58:10.652633+0000","last_fullsized":"2024-04-26T20:58:10.652633+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:17:49.866989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"41'8","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.652722+0000","last_change":"2024-04-26T20:57:52.569868+0000","last_active":"2024-04-26T20:58:10.652722+0000","last_peered":"2024-04-26T20:58:10.652722+0000","last_clean":"2024-04-26T20:58:10.652722+0000","last_became_active":"2024-04-26T20:57:52.569591+0000","last_became_peered":"2024-04-26T20:57:52.569591+0000","last_unstale":"2024-04-26T20:58:10.652722+0000","last_undegraded":"2024-04-26T20:58:10.652722+0000","last_fullsized":"2024-04-26T20:58:10.652722+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:16.617166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"41'12","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.648340+0000","last_change":"2024-04-26T20:57:52.581841+0000","last_active":"2024-04-26T20:58:10.648340+0000","last_peered":"2024-04-26T20:58:10.648340+0000","last_clean":"2024-04-26T20:58:10.648340+0000","last_became_active":"2024-04-26T20:57:52.581591+0000","last_became_peered":"2024-04-26T20:57:52.581591+0000","last_unstale":"2024-04-26T20:58:10.648340+0000","last_undegraded":"2024-04-26T20:58:10.648340+0000","last_fullsized":"2024-04-26T20:58:10.648340+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:37:58.253968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"41'9","reported_seq":36,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.697598+0000","last_change":"2024-04-26T20:57:52.583636+0000","last_active":"2024-04-26T20:58:12.697598+0000","last_peered":"2024-04-26T20:58:12.697598+0000","last_clean":"2024-04-26T20:58:12.697598+0000","last_became_active":"2024-04-26T20:57:52.582497+0000","last_became_peered":"2024-04-26T20:57:52.582497+0000","last_unstale":"2024-04-26T20:58:12.697598+0000","last_undegraded":"2024-04-26T20:58:12.697598+0000","last_fullsized":"2024-04-26T20:58:12.697598+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:22:01.188628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.672853+0000","last_change":"2024-04-26T20:58:10.666436+0000","last_active":"2024-04-26T20:58:10.672853+0000","last_peered":"2024-04-26T20:58:10.672853+0000","last_clean":"2024-04-26T20:58:10.672853+0000","last_became_active":"2024-04-26T20:58:10.666048+0000","last_became_peered":"2024-04-26T20:58:10.666048+0000","last_unstale":"2024-04-26T20:58:10.672853+0000","last_undegraded":"2024-04-26T20:58:10.672853+0000","last_fullsized":"2024-04-26T20:58:10.672853+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:47:28.530714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"41'9","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.653238+0000","last_change":"2024-04-26T20:57:52.569273+0000","last_active":"2024-04-26T20:58:10.653238+0000","last_peered":"2024-04-26T20:58:10.653238+0000","last_clean":"2024-04-26T20:58:10.653238+0000","last_became_active":"2024-04-26T20:57:52.568195+0000","last_became_peered":"2024-04-26T20:57:52.568195+0000","last_unstale":"2024-04-26T20:58:10.653238+0000","last_undegraded":"2024-04-26T20:58:10.653238+0000","last_fullsized":"2024-04-26T20:58:10.653238+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:05:37.693355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"42'8","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.654475+0000","last_change":"2024-04-26T20:57:51.572743+0000","last_active":"2024-04-26T20:58:10.654475+0000","last_peered":"2024-04-26T20:58:10.654475+0000","last_clean":"2024-04-26T20:58:10.654475+0000","last_became_active":"2024-04-26T20:57:51.572350+0000","last_became_peered":"2024-04-26T20:57:51.572350+0000","last_unstale":"2024-04-26T20:58:10.654475+0000","last_undegraded":"2024-04-26T20:58:10.654475+0000","last_fullsized":"2024-04-26T20:58:10.654475+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:50:32.238625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.668622+0000","last_change":"2024-04-26T20:58:10.667265+0000","last_active":"2024-04-26T20:58:10.668622+0000","last_peered":"2024-04-26T20:58:10.668622+0000","last_clean":"2024-04-26T20:58:10.668622+0000","last_became_active":"2024-04-26T20:58:10.667057+0000","last_became_peered":"2024-04-26T20:58:10.667057+0000","last_unstale":"2024-04-26T20:58:10.668622+0000","last_undegraded":"2024-04-26T20:58:10.668622+0000","last_fullsized":"2024-04-26T20:58:10.668622+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:44.950848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"41'15","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.657903+0000","last_change":"2024-04-26T20:57:52.587288+0000","last_active":"2024-04-26T20:58:10.657903+0000","last_peered":"2024-04-26T20:58:10.657903+0000","last_clean":"2024-04-26T20:58:10.657903+0000","last_became_active":"2024-04-26T20:57:52.586875+0000","last_became_peered":"2024-04-26T20:57:52.586875+0000","last_unstale":"2024-04-26T20:58:10.657903+0000","last_undegraded":"2024-04-26T20:58:10.657903+0000","last_fullsized":"2024-04-26T20:58:10.657903+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:44:03.294510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":27,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.658255+0000","last_change":"2024-04-26T20:57:51.566643+0000","last_active":"2024-04-26T20:58:10.658255+0000","last_peered":"2024-04-26T20:58:10.658255+0000","last_clean":"2024-04-26T20:58:10.658255+0000","last_became_active":"2024-04-26T20:57:51.566309+0000","last_became_peered":"2024-04-26T20:57:51.566309+0000","last_unstale":"2024-04-26T20:58:10.658255+0000","last_undegraded":"2024-04-26T20:58:10.658255+0000","last_fullsized":"2024-04-26T20:58:10.658255+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:50:32.238625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.671298+0000","last_change":"2024-04-26T20:58:10.669263+0000","last_active":"2024-04-26T20:58:10.671298+0000","last_peered":"2024-04-26T20:58:10.671298+0000","last_clean":"2024-04-26T20:58:10.671298+0000","last_became_active":"2024-04-26T20:58:10.668918+0000","last_became_peered":"2024-04-26T20:58:10.668918+0000","last_unstale":"2024-04-26T20:58:10.671298+0000","last_undegraded":"2024-04-26T20:58:10.671298+0000","last_fullsized":"2024-04-26T20:58:10.671298+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:19:35.479464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"41'5","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.653575+0000","last_change":"2024-04-26T20:57:52.566380+0000","last_active":"2024-04-26T20:58:10.653575+0000","last_peered":"2024-04-26T20:58:10.653575+0000","last_clean":"2024-04-26T20:58:10.653575+0000","last_became_active":"2024-04-26T20:57:52.566143+0000","last_became_peered":"2024-04-26T20:57:52.566143+0000","last_unstale":"2024-04-26T20:58:10.653575+0000","last_undegraded":"2024-04-26T20:58:10.653575+0000","last_fullsized":"2024-04-26T20:58:10.653575+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:49:48.199988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"42'3","reported_seq":31,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.698273+0000","last_change":"2024-04-26T20:57:51.573664+0000","last_active":"2024-04-26T20:58:12.698273+0000","last_peered":"2024-04-26T20:58:12.698273+0000","last_clean":"2024-04-26T20:58:12.698273+0000","last_became_active":"2024-04-26T20:57:51.572927+0000","last_became_peered":"2024-04-26T20:57:51.572927+0000","last_unstale":"2024-04-26T20:58:12.698273+0000","last_undegraded":"2024-04-26T20:58:12.698273+0000","last_fullsized":"2024-04-26T20:58:12.698273+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:04:55.596385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.678783+0000","last_change":"2024-04-26T20:58:10.676452+0000","last_active":"2024-04-26T20:58:10.678783+0000","last_peered":"2024-04-26T20:58:10.678783+0000","last_clean":"2024-04-26T20:58:10.678783+0000","last_became_active":"2024-04-26T20:58:10.676145+0000","last_became_peered":"2024-04-26T20:58:10.676145+0000","last_unstale":"2024-04-26T20:58:10.678783+0000","last_undegraded":"2024-04-26T20:58:10.678783+0000","last_fullsized":"2024-04-26T20:58:10.678783+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:54:11.593416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"41'6","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.658964+0000","last_change":"2024-04-26T20:57:52.585801+0000","last_active":"2024-04-26T20:58:10.658964+0000","last_peered":"2024-04-26T20:58:10.658964+0000","last_clean":"2024-04-26T20:58:10.658964+0000","last_became_active":"2024-04-26T20:57:52.584731+0000","last_became_peered":"2024-04-26T20:57:52.584731+0000","last_unstale":"2024-04-26T20:58:10.658964+0000","last_undegraded":"2024-04-26T20:58:10.658964+0000","last_fullsized":"2024-04-26T20:58:10.658964+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:39:52.141275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"42'3","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.654149+0000","last_change":"2024-04-26T20:57:51.574013+0000","last_active":"2024-04-26T20:58:10.654149+0000","last_peered":"2024-04-26T20:58:10.654149+0000","last_clean":"2024-04-26T20:58:10.654149+0000","last_became_active":"2024-04-26T20:57:51.573800+0000","last_became_peered":"2024-04-26T20:57:51.573800+0000","last_unstale":"2024-04-26T20:58:10.654149+0000","last_undegraded":"2024-04-26T20:58:10.654149+0000","last_fullsized":"2024-04-26T20:58:10.654149+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:43:07.969141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.666603+0000","last_change":"2024-04-26T20:58:10.665186+0000","last_active":"2024-04-26T20:58:10.666603+0000","last_peered":"2024-04-26T20:58:10.666603+0000","last_clean":"2024-04-26T20:58:10.666603+0000","last_became_active":"2024-04-26T20:58:10.664923+0000","last_became_peered":"2024-04-26T20:58:10.664923+0000","last_unstale":"2024-04-26T20:58:10.666603+0000","last_undegraded":"2024-04-26T20:58:10.666603+0000","last_fullsized":"2024-04-26T20:58:10.666603+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:14:23.512332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"41'8","reported_seq":35,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.697661+0000","last_change":"2024-04-26T20:57:52.587538+0000","last_active":"2024-04-26T20:58:12.697661+0000","last_peered":"2024-04-26T20:58:12.697661+0000","last_clean":"2024-04-26T20:58:12.697661+0000","last_became_active":"2024-04-26T20:57:52.587138+0000","last_became_peered":"2024-04-26T20:57:52.587138+0000","last_unstale":"2024-04-26T20:58:12.697661+0000","last_undegraded":"2024-04-26T20:58:12.697661+0000","last_fullsized":"2024-04-26T20:58:12.697661+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:08:03.271594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.654368+0000","last_change":"2024-04-26T20:57:51.570397+0000","last_active":"2024-04-26T20:58:10.654368+0000","last_peered":"2024-04-26T20:58:10.654368+0000","last_clean":"2024-04-26T20:58:10.654368+0000","last_became_active":"2024-04-26T20:57:51.570089+0000","last_became_peered":"2024-04-26T20:57:51.570089+0000","last_unstale":"2024-04-26T20:58:10.654368+0000","last_undegraded":"2024-04-26T20:58:10.654368+0000","last_fullsized":"2024-04-26T20:58:10.654368+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:55:41.720506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.698231+0000","last_change":"2024-04-26T20:58:10.663505+0000","last_active":"2024-04-26T20:58:12.698231+0000","last_peered":"2024-04-26T20:58:12.698231+0000","last_clean":"2024-04-26T20:58:12.698231+0000","last_became_active":"2024-04-26T20:58:10.663246+0000","last_became_peered":"2024-04-26T20:58:10.663246+0000","last_unstale":"2024-04-26T20:58:12.698231+0000","last_undegraded":"2024-04-26T20:58:12.698231+0000","last_fullsized":"2024-04-26T20:58:12.698231+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:46:36.439207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"41'10","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.651301+0000","last_change":"2024-04-26T20:57:52.585311+0000","last_active":"2024-04-26T20:58:10.651301+0000","last_peered":"2024-04-26T20:58:10.651301+0000","last_clean":"2024-04-26T20:58:10.651301+0000","last_became_active":"2024-04-26T20:57:52.585061+0000","last_became_peered":"2024-04-26T20:57:52.585061+0000","last_unstale":"2024-04-26T20:58:10.651301+0000","last_undegraded":"2024-04-26T20:58:10.651301+0000","last_fullsized":"2024-04-26T20:58:10.651301+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:18.275862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":26,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.649645+0000","last_change":"2024-04-26T20:57:51.571733+0000","last_active":"2024-04-26T20:58:10.649645+0000","last_peered":"2024-04-26T20:58:10.649645+0000","last_clean":"2024-04-26T20:58:10.649645+0000","last_became_active":"2024-04-26T20:57:51.571446+0000","last_became_peered":"2024-04-26T20:57:51.571446+0000","last_unstale":"2024-04-26T20:58:10.649645+0000","last_undegraded":"2024-04-26T20:58:10.649645+0000","last_fullsized":"2024-04-26T20:58:10.649645+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:07.815468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.697711+0000","last_change":"2024-04-26T20:58:10.672922+0000","last_active":"2024-04-26T20:58:12.697711+0000","last_peered":"2024-04-26T20:58:12.697711+0000","last_clean":"2024-04-26T20:58:12.697711+0000","last_became_active":"2024-04-26T20:58:10.672653+0000","last_became_peered":"2024-04-26T20:58:10.672653+0000","last_unstale":"2024-04-26T20:58:12.697711+0000","last_undegraded":"2024-04-26T20:58:12.697711+0000","last_fullsized":"2024-04-26T20:58:12.697711+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:57:09.025364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"41'7","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.652878+0000","last_change":"2024-04-26T20:57:52.570641+0000","last_active":"2024-04-26T20:58:10.652878+0000","last_peered":"2024-04-26T20:58:10.652878+0000","last_clean":"2024-04-26T20:58:10.652878+0000","last_became_active":"2024-04-26T20:57:52.570421+0000","last_became_peered":"2024-04-26T20:57:52.570421+0000","last_unstale":"2024-04-26T20:58:10.652878+0000","last_undegraded":"2024-04-26T20:58:10.652878+0000","last_fullsized":"2024-04-26T20:58:10.652878+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:27.330795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":28,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.697515+0000","last_change":"2024-04-26T20:57:51.574572+0000","last_active":"2024-04-26T20:58:12.697515+0000","last_peered":"2024-04-26T20:58:12.697515+0000","last_clean":"2024-04-26T20:58:12.697515+0000","last_became_active":"2024-04-26T20:57:51.574213+0000","last_became_peered":"2024-04-26T20:57:51.574213+0000","last_unstale":"2024-04-26T20:58:12.697515+0000","last_undegraded":"2024-04-26T20:58:12.697515+0000","last_fullsized":"2024-04-26T20:58:12.697515+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:10:26.507698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.659841+0000","last_change":"2024-04-26T20:58:10.657768+0000","last_active":"2024-04-26T20:58:10.659841+0000","last_peered":"2024-04-26T20:58:10.659841+0000","last_clean":"2024-04-26T20:58:10.659841+0000","last_became_active":"2024-04-26T20:58:10.657396+0000","last_became_peered":"2024-04-26T20:58:10.657396+0000","last_unstale":"2024-04-26T20:58:10.659841+0000","last_undegraded":"2024-04-26T20:58:10.659841+0000","last_fullsized":"2024-04-26T20:58:10.659841+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:43:54.225992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"41'8","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.660451+0000","last_change":"2024-04-26T20:57:52.586106+0000","last_active":"2024-04-26T20:58:10.660451+0000","last_peered":"2024-04-26T20:58:10.660451+0000","last_clean":"2024-04-26T20:58:10.660451+0000","last_became_active":"2024-04-26T20:57:52.585860+0000","last_became_peered":"2024-04-26T20:57:52.585860+0000","last_unstale":"2024-04-26T20:58:10.660451+0000","last_undegraded":"2024-04-26T20:58:10.660451+0000","last_fullsized":"2024-04-26T20:58:10.660451+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:16:22.565146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":25,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.648327+0000","last_change":"2024-04-26T20:57:51.573590+0000","last_active":"2024-04-26T20:58:10.648327+0000","last_peered":"2024-04-26T20:58:10.648327+0000","last_clean":"2024-04-26T20:58:10.648327+0000","last_became_active":"2024-04-26T20:57:51.573293+0000","last_became_peered":"2024-04-26T20:57:51.573293+0000","last_unstale":"2024-04-26T20:58:10.648327+0000","last_undegraded":"2024-04-26T20:58:10.648327+0000","last_fullsized":"2024-04-26T20:58:10.648327+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:55:23.008549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.672085+0000","last_change":"2024-04-26T20:58:10.670768+0000","last_active":"2024-04-26T20:58:10.672085+0000","last_peered":"2024-04-26T20:58:10.672085+0000","last_clean":"2024-04-26T20:58:10.672085+0000","last_became_active":"2024-04-26T20:58:10.670520+0000","last_became_peered":"2024-04-26T20:58:10.670520+0000","last_unstale":"2024-04-26T20:58:10.672085+0000","last_undegraded":"2024-04-26T20:58:10.672085+0000","last_fullsized":"2024-04-26T20:58:10.672085+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:52:06.081700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"41'11","reported_seq":38,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.698271+0000","last_change":"2024-04-26T20:57:52.575008+0000","last_active":"2024-04-26T20:58:12.698271+0000","last_peered":"2024-04-26T20:58:12.698271+0000","last_clean":"2024-04-26T20:58:12.698271+0000","last_became_active":"2024-04-26T20:57:52.574553+0000","last_became_peered":"2024-04-26T20:57:52.574553+0000","last_unstale":"2024-04-26T20:58:12.698271+0000","last_undegraded":"2024-04-26T20:58:12.698271+0000","last_fullsized":"2024-04-26T20:58:12.698271+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:42.746367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":28,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.698347+0000","last_change":"2024-04-26T20:57:51.576675+0000","last_active":"2024-04-26T20:58:12.698347+0000","last_peered":"2024-04-26T20:58:12.698347+0000","last_clean":"2024-04-26T20:58:12.698347+0000","last_became_active":"2024-04-26T20:57:51.576394+0000","last_became_peered":"2024-04-26T20:57:51.576394+0000","last_unstale":"2024-04-26T20:58:12.698347+0000","last_undegraded":"2024-04-26T20:58:12.698347+0000","last_fullsized":"2024-04-26T20:58:12.698347+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:44:14.717022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.674082+0000","last_change":"2024-04-26T20:58:10.671102+0000","last_active":"2024-04-26T20:58:10.674082+0000","last_peered":"2024-04-26T20:58:10.674082+0000","last_clean":"2024-04-26T20:58:10.674082+0000","last_became_active":"2024-04-26T20:58:10.670829+0000","last_became_peered":"2024-04-26T20:58:10.670829+0000","last_unstale":"2024-04-26T20:58:10.674082+0000","last_undegraded":"2024-04-26T20:58:10.674082+0000","last_fullsized":"2024-04-26T20:58:10.674082+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:16:40.659077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"41'6","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.654015+0000","last_change":"2024-04-26T20:57:52.576139+0000","last_active":"2024-04-26T20:58:10.654015+0000","last_peered":"2024-04-26T20:58:10.654015+0000","last_clean":"2024-04-26T20:58:10.654015+0000","last_became_active":"2024-04-26T20:57:52.575825+0000","last_became_peered":"2024-04-26T20:57:52.575825+0000","last_unstale":"2024-04-26T20:58:10.654015+0000","last_undegraded":"2024-04-26T20:58:10.654015+0000","last_fullsized":"2024-04-26T20:58:10.654015+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:37:58.253968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":27,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.653435+0000","last_change":"2024-04-26T20:57:51.566363+0000","last_active":"2024-04-26T20:58:10.653435+0000","last_peered":"2024-04-26T20:58:10.653435+0000","last_clean":"2024-04-26T20:58:10.653435+0000","last_became_active":"2024-04-26T20:57:51.566020+0000","last_became_peered":"2024-04-26T20:57:51.566020+0000","last_unstale":"2024-04-26T20:58:10.653435+0000","last_undegraded":"2024-04-26T20:58:10.653435+0000","last_fullsized":"2024-04-26T20:58:10.653435+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:51:59.832838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.658001+0000","last_change":"2024-04-26T20:58:10.656874+0000","last_active":"2024-04-26T20:58:10.658001+0000","last_peered":"2024-04-26T20:58:10.658001+0000","last_clean":"2024-04-26T20:58:10.658001+0000","last_became_active":"2024-04-26T20:58:10.656106+0000","last_became_peered":"2024-04-26T20:58:10.656106+0000","last_unstale":"2024-04-26T20:58:10.658001+0000","last_undegraded":"2024-04-26T20:58:10.658001+0000","last_fullsized":"2024-04-26T20:58:10.658001+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:54:11.593416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"41'10","reported_seq":37,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.698078+0000","last_change":"2024-04-26T20:57:52.593299+0000","last_active":"2024-04-26T20:58:12.698078+0000","last_peered":"2024-04-26T20:58:12.698078+0000","last_clean":"2024-04-26T20:58:12.698078+0000","last_became_active":"2024-04-26T20:57:52.591280+0000","last_became_peered":"2024-04-26T20:57:52.591280+0000","last_unstale":"2024-04-26T20:58:12.698078+0000","last_undegraded":"2024-04-26T20:58:12.698078+0000","last_fullsized":"2024-04-26T20:58:12.698078+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:25.750491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"42'5","reported_seq":32,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.653766+0000","last_change":"2024-04-26T20:57:51.569668+0000","last_active":"2024-04-26T20:58:10.653766+0000","last_peered":"2024-04-26T20:58:10.653766+0000","last_clean":"2024-04-26T20:58:10.653766+0000","last_became_active":"2024-04-26T20:57:51.569384+0000","last_became_peered":"2024-04-26T20:57:51.569384+0000","last_unstale":"2024-04-26T20:58:10.653766+0000","last_undegraded":"2024-04-26T20:58:10.653766+0000","last_fullsized":"2024-04-26T20:58:10.653766+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:49:18.242393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.669541+0000","last_change":"2024-04-26T20:58:10.668231+0000","last_active":"2024-04-26T20:58:10.669541+0000","last_peered":"2024-04-26T20:58:10.669541+0000","last_clean":"2024-04-26T20:58:10.669541+0000","last_became_active":"2024-04-26T20:58:10.668007+0000","last_became_peered":"2024-04-26T20:58:10.668007+0000","last_unstale":"2024-04-26T20:58:10.669541+0000","last_undegraded":"2024-04-26T20:58:10.669541+0000","last_fullsized":"2024-04-26T20:58:10.669541+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:10.473443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"41'9","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.649099+0000","last_change":"2024-04-26T20:57:52.577388+0000","last_active":"2024-04-26T20:58:10.649099+0000","last_peered":"2024-04-26T20:58:10.649099+0000","last_clean":"2024-04-26T20:58:10.649099+0000","last_became_active":"2024-04-26T20:57:52.577116+0000","last_became_peered":"2024-04-26T20:57:52.577116+0000","last_unstale":"2024-04-26T20:58:10.649099+0000","last_undegraded":"2024-04-26T20:58:10.649099+0000","last_fullsized":"2024-04-26T20:58:10.649099+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:26.856916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"42'23","reported_seq":51,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.698406+0000","last_change":"2024-04-26T20:57:51.574348+0000","last_active":"2024-04-26T20:58:12.698406+0000","last_peered":"2024-04-26T20:58:12.698406+0000","last_clean":"2024-04-26T20:58:12.698406+0000","last_became_active":"2024-04-26T20:57:51.574023+0000","last_became_peered":"2024-04-26T20:57:51.574023+0000","last_unstale":"2024-04-26T20:58:12.698406+0000","last_undegraded":"2024-04-26T20:58:12.698406+0000","last_fullsized":"2024-04-26T20:58:12.698406+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:29:31.014100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.659792+0000","last_change":"2024-04-26T20:58:10.657279+0000","last_active":"2024-04-26T20:58:10.659792+0000","last_peered":"2024-04-26T20:58:10.659792+0000","last_clean":"2024-04-26T20:58:10.659792+0000","last_became_active":"2024-04-26T20:58:10.656680+0000","last_became_peered":"2024-04-26T20:58:10.656680+0000","last_unstale":"2024-04-26T20:58:10.659792+0000","last_undegraded":"2024-04-26T20:58:10.659792+0000","last_fullsized":"2024-04-26T20:58:10.659792+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:31.277054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"41'6","reported_seq":33,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.697875+0000","last_change":"2024-04-26T20:57:52.583405+0000","last_active":"2024-04-26T20:58:12.697875+0000","last_peered":"2024-04-26T20:58:12.697875+0000","last_clean":"2024-04-26T20:58:12.697875+0000","last_became_active":"2024-04-26T20:57:52.582257+0000","last_became_peered":"2024-04-26T20:57:52.582257+0000","last_unstale":"2024-04-26T20:58:12.697875+0000","last_undegraded":"2024-04-26T20:58:12.697875+0000","last_fullsized":"2024-04-26T20:58:12.697875+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:15:21.765705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"42'5","reported_seq":33,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.697820+0000","last_change":"2024-04-26T20:57:51.572541+0000","last_active":"2024-04-26T20:58:12.697820+0000","last_peered":"2024-04-26T20:58:12.697820+0000","last_clean":"2024-04-26T20:58:12.697820+0000","last_became_active":"2024-04-26T20:57:51.571967+0000","last_became_peered":"2024-04-26T20:57:51.571967+0000","last_unstale":"2024-04-26T20:58:12.697820+0000","last_undegraded":"2024-04-26T20:58:12.697820+0000","last_fullsized":"2024-04-26T20:58:12.697820+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:11:04.894675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.675770+0000","last_change":"2024-04-26T20:58:10.671439+0000","last_active":"2024-04-26T20:58:10.675770+0000","last_peered":"2024-04-26T20:58:10.675770+0000","last_clean":"2024-04-26T20:58:10.675770+0000","last_became_active":"2024-04-26T20:58:10.671079+0000","last_became_peered":"2024-04-26T20:58:10.671079+0000","last_unstale":"2024-04-26T20:58:10.675770+0000","last_undegraded":"2024-04-26T20:58:10.675770+0000","last_fullsized":"2024-04-26T20:58:10.675770+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:28:38.251611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"41'6","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.658248+0000","last_change":"2024-04-26T20:57:52.581005+0000","last_active":"2024-04-26T20:58:10.658248+0000","last_peered":"2024-04-26T20:58:10.658248+0000","last_clean":"2024-04-26T20:58:10.658248+0000","last_became_active":"2024-04-26T20:57:52.580685+0000","last_became_peered":"2024-04-26T20:57:52.580685+0000","last_unstale":"2024-04-26T20:58:10.658248+0000","last_undegraded":"2024-04-26T20:58:10.658248+0000","last_fullsized":"2024-04-26T20:58:10.658248+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:18.275862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":26,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.657736+0000","last_change":"2024-04-26T20:57:51.571181+0000","last_active":"2024-04-26T20:58:10.657736+0000","last_peered":"2024-04-26T20:58:10.657736+0000","last_clean":"2024-04-26T20:58:10.657736+0000","last_became_active":"2024-04-26T20:57:51.570305+0000","last_became_peered":"2024-04-26T20:57:51.570305+0000","last_unstale":"2024-04-26T20:58:10.657736+0000","last_undegraded":"2024-04-26T20:58:10.657736+0000","last_fullsized":"2024-04-26T20:58:10.657736+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:43:07.969141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.675913+0000","last_change":"2024-04-26T20:58:10.671520+0000","last_active":"2024-04-26T20:58:10.675913+0000","last_peered":"2024-04-26T20:58:10.675913+0000","last_clean":"2024-04-26T20:58:10.675913+0000","last_became_active":"2024-04-26T20:58:10.671157+0000","last_became_peered":"2024-04-26T20:58:10.671157+0000","last_unstale":"2024-04-26T20:58:10.675913+0000","last_undegraded":"2024-04-26T20:58:10.675913+0000","last_fullsized":"2024-04-26T20:58:10.675913+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:44.950848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"41'10","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.651790+0000","last_change":"2024-04-26T20:57:52.584791+0000","last_active":"2024-04-26T20:58:10.651790+0000","last_peered":"2024-04-26T20:58:10.651790+0000","last_clean":"2024-04-26T20:58:10.651790+0000","last_became_active":"2024-04-26T20:57:52.575922+0000","last_became_peered":"2024-04-26T20:57:52.575922+0000","last_unstale":"2024-04-26T20:58:10.651790+0000","last_undegraded":"2024-04-26T20:58:10.651790+0000","last_fullsized":"2024-04-26T20:58:10.651790+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:50:20.927595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":27,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.652641+0000","last_change":"2024-04-26T20:57:51.563498+0000","last_active":"2024-04-26T20:58:10.652641+0000","last_peered":"2024-04-26T20:58:10.652641+0000","last_clean":"2024-04-26T20:58:10.652641+0000","last_became_active":"2024-04-26T20:57:51.563243+0000","last_became_peered":"2024-04-26T20:57:51.563243+0000","last_unstale":"2024-04-26T20:58:10.652641+0000","last_undegraded":"2024-04-26T20:58:10.652641+0000","last_fullsized":"2024-04-26T20:58:10.652641+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:47:09.428746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.668897+0000","last_change":"2024-04-26T20:58:10.665998+0000","last_active":"2024-04-26T20:58:10.668897+0000","last_peered":"2024-04-26T20:58:10.668897+0000","last_clean":"2024-04-26T20:58:10.668897+0000","last_became_active":"2024-04-26T20:58:10.665637+0000","last_became_peered":"2024-04-26T20:58:10.665637+0000","last_unstale":"2024-04-26T20:58:10.668897+0000","last_undegraded":"2024-04-26T20:58:10.668897+0000","last_fullsized":"2024-04-26T20:58:10.668897+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:02.739631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"41'15","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.660521+0000","last_change":"2024-04-26T20:57:52.584930+0000","last_active":"2024-04-26T20:58:10.660521+0000","last_peered":"2024-04-26T20:58:10.660521+0000","last_clean":"2024-04-26T20:58:10.660521+0000","last_became_active":"2024-04-26T20:57:52.584641+0000","last_became_peered":"2024-04-26T20:57:52.584641+0000","last_unstale":"2024-04-26T20:58:10.660521+0000","last_undegraded":"2024-04-26T20:58:10.660521+0000","last_fullsized":"2024-04-26T20:58:10.660521+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:37:58.253968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"42'15","reported_seq":43,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.653626+0000","last_change":"2024-04-26T20:57:51.567931+0000","last_active":"2024-04-26T20:58:10.653626+0000","last_peered":"2024-04-26T20:58:10.653626+0000","last_clean":"2024-04-26T20:58:10.653626+0000","last_became_active":"2024-04-26T20:57:51.567552+0000","last_became_peered":"2024-04-26T20:57:51.567552+0000","last_unstale":"2024-04-26T20:58:10.653626+0000","last_undegraded":"2024-04-26T20:58:10.653626+0000","last_fullsized":"2024-04-26T20:58:10.653626+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:32.553314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.664571+0000","last_change":"2024-04-26T20:58:10.663370+0000","last_active":"2024-04-26T20:58:10.664571+0000","last_peered":"2024-04-26T20:58:10.664571+0000","last_clean":"2024-04-26T20:58:10.664571+0000","last_became_active":"2024-04-26T20:58:10.663079+0000","last_became_peered":"2024-04-26T20:58:10.663079+0000","last_unstale":"2024-04-26T20:58:10.664571+0000","last_undegraded":"2024-04-26T20:58:10.664571+0000","last_fullsized":"2024-04-26T20:58:10.664571+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:43:59.225293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"41'6","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.657455+0000","last_change":"2024-04-26T20:57:52.581758+0000","last_active":"2024-04-26T20:58:10.657455+0000","last_peered":"2024-04-26T20:58:10.657455+0000","last_clean":"2024-04-26T20:58:10.657455+0000","last_became_active":"2024-04-26T20:57:52.581085+0000","last_became_peered":"2024-04-26T20:57:52.581085+0000","last_unstale":"2024-04-26T20:58:10.657455+0000","last_undegraded":"2024-04-26T20:58:10.657455+0000","last_fullsized":"2024-04-26T20:58:10.657455+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:49:19.250429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"42'2","reported_seq":27,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.649194+0000","last_change":"2024-04-26T20:57:51.575710+0000","last_active":"2024-04-26T20:58:10.649194+0000","last_peered":"2024-04-26T20:58:10.649194+0000","last_clean":"2024-04-26T20:58:10.649194+0000","last_became_active":"2024-04-26T20:57:51.575446+0000","last_became_peered":"2024-04-26T20:57:51.575446+0000","last_unstale":"2024-04-26T20:58:10.649194+0000","last_undegraded":"2024-04-26T20:58:10.649194+0000","last_fullsized":"2024-04-26T20:58:10.649194+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:05.463288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.672682+0000","last_change":"2024-04-26T20:58:10.670833+0000","last_active":"2024-04-26T20:58:10.672682+0000","last_peered":"2024-04-26T20:58:10.672682+0000","last_clean":"2024-04-26T20:58:10.672682+0000","last_became_active":"2024-04-26T20:58:10.670522+0000","last_became_peered":"2024-04-26T20:58:10.670522+0000","last_unstale":"2024-04-26T20:58:10.672682+0000","last_undegraded":"2024-04-26T20:58:10.672682+0000","last_fullsized":"2024-04-26T20:58:10.672682+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:06:19.339683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"41'7","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.648935+0000","last_change":"2024-04-26T20:57:52.585080+0000","last_active":"2024-04-26T20:58:10.648935+0000","last_peered":"2024-04-26T20:58:10.648935+0000","last_clean":"2024-04-26T20:58:10.648935+0000","last_became_active":"2024-04-26T20:57:52.584794+0000","last_became_peered":"2024-04-26T20:57:52.584794+0000","last_unstale":"2024-04-26T20:58:10.648935+0000","last_undegraded":"2024-04-26T20:58:10.648935+0000","last_fullsized":"2024-04-26T20:58:10.648935+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:13.183123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"42'3","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.653661+0000","last_change":"2024-04-26T20:57:51.569389+0000","last_active":"2024-04-26T20:58:10.653661+0000","last_peered":"2024-04-26T20:58:10.653661+0000","last_clean":"2024-04-26T20:58:10.653661+0000","last_became_active":"2024-04-26T20:57:51.569128+0000","last_became_peered":"2024-04-26T20:57:51.569128+0000","last_unstale":"2024-04-26T20:58:10.653661+0000","last_undegraded":"2024-04-26T20:58:10.653661+0000","last_fullsized":"2024-04-26T20:58:10.653661+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:44.305635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.678143+0000","last_change":"2024-04-26T20:58:10.673866+0000","last_active":"2024-04-26T20:58:10.678143+0000","last_peered":"2024-04-26T20:58:10.678143+0000","last_clean":"2024-04-26T20:58:10.678143+0000","last_became_active":"2024-04-26T20:58:10.673565+0000","last_became_peered":"2024-04-26T20:58:10.673565+0000","last_unstale":"2024-04-26T20:58:10.678143+0000","last_undegraded":"2024-04-26T20:58:10.678143+0000","last_fullsized":"2024-04-26T20:58:10.678143+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:12:23.450727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"41'5","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.649298+0000","last_change":"2024-04-26T20:57:52.580234+0000","last_active":"2024-04-26T20:58:10.649298+0000","last_peered":"2024-04-26T20:58:10.649298+0000","last_clean":"2024-04-26T20:58:10.649298+0000","last_became_active":"2024-04-26T20:57:52.579929+0000","last_became_peered":"2024-04-26T20:57:52.579929+0000","last_unstale":"2024-04-26T20:58:10.649298+0000","last_undegraded":"2024-04-26T20:58:10.649298+0000","last_fullsized":"2024-04-26T20:58:10.649298+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:06:01.245752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"42'2","reported_seq":28,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.661236+0000","last_change":"2024-04-26T20:57:51.577610+0000","last_active":"2024-04-26T20:58:10.661236+0000","last_peered":"2024-04-26T20:58:10.661236+0000","last_clean":"2024-04-26T20:58:10.661236+0000","last_became_active":"2024-04-26T20:57:51.577352+0000","last_became_peered":"2024-04-26T20:57:51.577352+0000","last_unstale":"2024-04-26T20:58:10.661236+0000","last_undegraded":"2024-04-26T20:58:10.661236+0000","last_fullsized":"2024-04-26T20:58:10.661236+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:05:01.247112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.675950+0000","last_change":"2024-04-26T20:58:10.672457+0000","last_active":"2024-04-26T20:58:10.675950+0000","last_peered":"2024-04-26T20:58:10.675950+0000","last_clean":"2024-04-26T20:58:10.675950+0000","last_became_active":"2024-04-26T20:58:10.671871+0000","last_became_peered":"2024-04-26T20:58:10.671871+0000","last_unstale":"2024-04-26T20:58:10.675950+0000","last_undegraded":"2024-04-26T20:58:10.675950+0000","last_fullsized":"2024-04-26T20:58:10.675950+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:06:19.339683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"41'9","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.666797+0000","last_change":"2024-04-26T20:57:52.593107+0000","last_active":"2024-04-26T20:58:10.666797+0000","last_peered":"2024-04-26T20:58:10.666797+0000","last_clean":"2024-04-26T20:58:10.666797+0000","last_became_active":"2024-04-26T20:57:52.592849+0000","last_became_peered":"2024-04-26T20:57:52.592849+0000","last_unstale":"2024-04-26T20:58:10.666797+0000","last_undegraded":"2024-04-26T20:58:10.666797+0000","last_fullsized":"2024-04-26T20:58:10.666797+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:18.275862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":25,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.663053+0000","last_change":"2024-04-26T20:57:51.573218+0000","last_active":"2024-04-26T20:58:10.663053+0000","last_peered":"2024-04-26T20:58:10.663053+0000","last_clean":"2024-04-26T20:58:10.663053+0000","last_became_active":"2024-04-26T20:57:51.572070+0000","last_became_peered":"2024-04-26T20:57:51.572070+0000","last_unstale":"2024-04-26T20:58:10.663053+0000","last_undegraded":"2024-04-26T20:58:10.663053+0000","last_fullsized":"2024-04-26T20:58:10.663053+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:43.209710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.673771+0000","last_change":"2024-04-26T20:58:10.669638+0000","last_active":"2024-04-26T20:58:10.673771+0000","last_peered":"2024-04-26T20:58:10.673771+0000","last_clean":"2024-04-26T20:58:10.673771+0000","last_became_active":"2024-04-26T20:58:10.669290+0000","last_became_peered":"2024-04-26T20:58:10.669290+0000","last_unstale":"2024-04-26T20:58:10.673771+0000","last_undegraded":"2024-04-26T20:58:10.673771+0000","last_fullsized":"2024-04-26T20:58:10.673771+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:40:10.235206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"41'9","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.652124+0000","last_change":"2024-04-26T20:57:52.580620+0000","last_active":"2024-04-26T20:58:10.652124+0000","last_peered":"2024-04-26T20:58:10.652124+0000","last_clean":"2024-04-26T20:58:10.652124+0000","last_became_active":"2024-04-26T20:57:52.580262+0000","last_became_peered":"2024-04-26T20:57:52.580262+0000","last_unstale":"2024-04-26T20:58:10.652124+0000","last_undegraded":"2024-04-26T20:58:10.652124+0000","last_fullsized":"2024-04-26T20:58:10.652124+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:17:36.055479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"42'4","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.663095+0000","last_change":"2024-04-26T20:57:51.572477+0000","last_active":"2024-04-26T20:58:10.663095+0000","last_peered":"2024-04-26T20:58:10.663095+0000","last_clean":"2024-04-26T20:58:10.663095+0000","last_became_active":"2024-04-26T20:57:51.572200+0000","last_became_peered":"2024-04-26T20:57:51.572200+0000","last_unstale":"2024-04-26T20:58:10.663095+0000","last_undegraded":"2024-04-26T20:58:10.663095+0000","last_fullsized":"2024-04-26T20:58:10.663095+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:03:39.964597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.672417+0000","last_change":"2024-04-26T20:58:10.666288+0000","last_active":"2024-04-26T20:58:10.672417+0000","last_peered":"2024-04-26T20:58:10.672417+0000","last_clean":"2024-04-26T20:58:10.672417+0000","last_became_active":"2024-04-26T20:58:10.665961+0000","last_became_peered":"2024-04-26T20:58:10.665961+0000","last_unstale":"2024-04-26T20:58:10.672417+0000","last_undegraded":"2024-04-26T20:58:10.672417+0000","last_fullsized":"2024-04-26T20:58:10.672417+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:44:21.388441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"41'2","reported_seq":29,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.697429+0000","last_change":"2024-04-26T20:57:52.570952+0000","last_active":"2024-04-26T20:58:12.697429+0000","last_peered":"2024-04-26T20:58:12.697429+0000","last_clean":"2024-04-26T20:58:12.697429+0000","last_became_active":"2024-04-26T20:57:52.570601+0000","last_became_peered":"2024-04-26T20:57:52.570601+0000","last_unstale":"2024-04-26T20:58:12.697429+0000","last_undegraded":"2024-04-26T20:58:12.697429+0000","last_fullsized":"2024-04-26T20:58:12.697429+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:16:47.969442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":26,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.657844+0000","last_change":"2024-04-26T20:57:51.575051+0000","last_active":"2024-04-26T20:58:10.657844+0000","last_peered":"2024-04-26T20:58:10.657844+0000","last_clean":"2024-04-26T20:58:10.657844+0000","last_became_active":"2024-04-26T20:57:51.574755+0000","last_became_peered":"2024-04-26T20:57:51.574755+0000","last_unstale":"2024-04-26T20:58:10.657844+0000","last_undegraded":"2024-04-26T20:58:10.657844+0000","last_fullsized":"2024-04-26T20:58:10.657844+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:32.553314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.678816+0000","last_change":"2024-04-26T20:58:10.676156+0000","last_active":"2024-04-26T20:58:10.678816+0000","last_peered":"2024-04-26T20:58:10.678816+0000","last_clean":"2024-04-26T20:58:10.678816+0000","last_became_active":"2024-04-26T20:58:10.674594+0000","last_became_peered":"2024-04-26T20:58:10.674594+0000","last_unstale":"2024-04-26T20:58:10.678816+0000","last_undegraded":"2024-04-26T20:58:10.678816+0000","last_fullsized":"2024-04-26T20:58:10.678816+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:23.447610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"41'5","reported_seq":32,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.651508+0000","last_change":"2024-04-26T20:57:52.584567+0000","last_active":"2024-04-26T20:58:10.651508+0000","last_peered":"2024-04-26T20:58:10.651508+0000","last_clean":"2024-04-26T20:58:10.651508+0000","last_became_active":"2024-04-26T20:57:52.584136+0000","last_became_peered":"2024-04-26T20:57:52.584136+0000","last_unstale":"2024-04-26T20:58:10.651508+0000","last_undegraded":"2024-04-26T20:58:10.651508+0000","last_fullsized":"2024-04-26T20:58:10.651508+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:39:52.141275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":25,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.648436+0000","last_change":"2024-04-26T20:57:51.573894+0000","last_active":"2024-04-26T20:58:10.648436+0000","last_peered":"2024-04-26T20:58:10.648436+0000","last_clean":"2024-04-26T20:58:10.648436+0000","last_became_active":"2024-04-26T20:57:51.573467+0000","last_became_peered":"2024-04-26T20:57:51.573467+0000","last_unstale":"2024-04-26T20:58:10.648436+0000","last_undegraded":"2024-04-26T20:58:10.648436+0000","last_fullsized":"2024-04-26T20:58:10.648436+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:53.725346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.697637+0000","last_change":"2024-04-26T20:58:10.676542+0000","last_active":"2024-04-26T20:58:12.697637+0000","last_peered":"2024-04-26T20:58:12.697637+0000","last_clean":"2024-04-26T20:58:12.697637+0000","last_became_active":"2024-04-26T20:58:10.676296+0000","last_became_peered":"2024-04-26T20:58:10.676296+0000","last_unstale":"2024-04-26T20:58:12.697637+0000","last_undegraded":"2024-04-26T20:58:12.697637+0000","last_fullsized":"2024-04-26T20:58:12.697637+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:34:52.972239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"41'8","reported_seq":35,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.697627+0000","last_change":"2024-04-26T20:57:52.570583+0000","last_active":"2024-04-26T20:58:12.697627+0000","last_peered":"2024-04-26T20:58:12.697627+0000","last_clean":"2024-04-26T20:58:12.697627+0000","last_became_active":"2024-04-26T20:57:52.570303+0000","last_became_peered":"2024-04-26T20:57:52.570303+0000","last_unstale":"2024-04-26T20:58:12.697627+0000","last_undegraded":"2024-04-26T20:58:12.697627+0000","last_fullsized":"2024-04-26T20:58:12.697627+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:19:58.387596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":26,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.657330+0000","last_change":"2024-04-26T20:57:51.571920+0000","last_active":"2024-04-26T20:58:10.657330+0000","last_peered":"2024-04-26T20:58:10.657330+0000","last_clean":"2024-04-26T20:58:10.657330+0000","last_became_active":"2024-04-26T20:57:51.571644+0000","last_became_peered":"2024-04-26T20:57:51.571644+0000","last_unstale":"2024-04-26T20:58:10.657330+0000","last_undegraded":"2024-04-26T20:58:10.657330+0000","last_fullsized":"2024-04-26T20:58:10.657330+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:55:41.720506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.672105+0000","last_change":"2024-04-26T20:58:10.670799+0000","last_active":"2024-04-26T20:58:10.672105+0000","last_peered":"2024-04-26T20:58:10.672105+0000","last_clean":"2024-04-26T20:58:10.672105+0000","last_became_active":"2024-04-26T20:58:10.670514+0000","last_became_peered":"2024-04-26T20:58:10.670514+0000","last_unstale":"2024-04-26T20:58:10.672105+0000","last_undegraded":"2024-04-26T20:58:10.672105+0000","last_fullsized":"2024-04-26T20:58:10.672105+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:54:02.371720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"41'9","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.662414+0000","last_change":"2024-04-26T20:57:52.593531+0000","last_active":"2024-04-26T20:58:10.662414+0000","last_peered":"2024-04-26T20:58:10.662414+0000","last_clean":"2024-04-26T20:58:10.662414+0000","last_became_active":"2024-04-26T20:57:52.592602+0000","last_became_peered":"2024-04-26T20:57:52.592602+0000","last_unstale":"2024-04-26T20:58:10.662414+0000","last_undegraded":"2024-04-26T20:58:10.662414+0000","last_fullsized":"2024-04-26T20:58:10.662414+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:13.183123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"42'3","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.653774+0000","last_change":"2024-04-26T20:57:51.570771+0000","last_active":"2024-04-26T20:58:10.653774+0000","last_peered":"2024-04-26T20:58:10.653774+0000","last_clean":"2024-04-26T20:58:10.653774+0000","last_became_active":"2024-04-26T20:57:51.570488+0000","last_became_peered":"2024-04-26T20:57:51.570488+0000","last_unstale":"2024-04-26T20:58:10.653774+0000","last_undegraded":"2024-04-26T20:58:10.653774+0000","last_fullsized":"2024-04-26T20:58:10.653774+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:44:02.286474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.698056+0000","last_change":"2024-04-26T20:58:10.668969+0000","last_active":"2024-04-26T20:58:12.698056+0000","last_peered":"2024-04-26T20:58:12.698056+0000","last_clean":"2024-04-26T20:58:12.698056+0000","last_became_active":"2024-04-26T20:58:10.668649+0000","last_became_peered":"2024-04-26T20:58:10.668649+0000","last_unstale":"2024-04-26T20:58:12.698056+0000","last_undegraded":"2024-04-26T20:58:12.698056+0000","last_fullsized":"2024-04-26T20:58:12.698056+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:09:40.826437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"41'5","reported_seq":32,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.652315+0000","last_change":"2024-04-26T20:57:52.579072+0000","last_active":"2024-04-26T20:58:10.652315+0000","last_peered":"2024-04-26T20:58:10.652315+0000","last_clean":"2024-04-26T20:58:10.652315+0000","last_became_active":"2024-04-26T20:57:52.578605+0000","last_became_peered":"2024-04-26T20:57:52.578605+0000","last_unstale":"2024-04-26T20:58:10.652315+0000","last_undegraded":"2024-04-26T20:58:10.652315+0000","last_fullsized":"2024-04-26T20:58:10.652315+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:29:56.009862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"42'5","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.664616+0000","last_change":"2024-04-26T20:57:51.577840+0000","last_active":"2024-04-26T20:58:10.664616+0000","last_peered":"2024-04-26T20:58:10.664616+0000","last_clean":"2024-04-26T20:58:10.664616+0000","last_became_active":"2024-04-26T20:57:51.577584+0000","last_became_peered":"2024-04-26T20:57:51.577584+0000","last_unstale":"2024-04-26T20:58:10.664616+0000","last_undegraded":"2024-04-26T20:58:10.664616+0000","last_fullsized":"2024-04-26T20:58:10.664616+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:41:35.733249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.669904+0000","last_change":"2024-04-26T20:58:10.668616+0000","last_active":"2024-04-26T20:58:10.669904+0000","last_peered":"2024-04-26T20:58:10.669904+0000","last_clean":"2024-04-26T20:58:10.669904+0000","last_became_active":"2024-04-26T20:58:10.668030+0000","last_became_peered":"2024-04-26T20:58:10.668030+0000","last_unstale":"2024-04-26T20:58:10.669904+0000","last_undegraded":"2024-04-26T20:58:10.669904+0000","last_fullsized":"2024-04-26T20:58:10.669904+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:55:04.636924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"41'7","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.665649+0000","last_change":"2024-04-26T20:57:52.580763+0000","last_active":"2024-04-26T20:58:10.665649+0000","last_peered":"2024-04-26T20:58:10.665649+0000","last_clean":"2024-04-26T20:58:10.665649+0000","last_became_active":"2024-04-26T20:57:52.580489+0000","last_became_peered":"2024-04-26T20:57:52.580489+0000","last_unstale":"2024-04-26T20:58:10.665649+0000","last_undegraded":"2024-04-26T20:58:10.665649+0000","last_fullsized":"2024-04-26T20:58:10.665649+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:52:00.840874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":26,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.661342+0000","last_change":"2024-04-26T20:57:51.574263+0000","last_active":"2024-04-26T20:58:10.661342+0000","last_peered":"2024-04-26T20:58:10.661342+0000","last_clean":"2024-04-26T20:58:10.661342+0000","last_became_active":"2024-04-26T20:57:51.573941+0000","last_became_peered":"2024-04-26T20:57:51.573941+0000","last_unstale":"2024-04-26T20:58:10.661342+0000","last_undegraded":"2024-04-26T20:58:10.661342+0000","last_fullsized":"2024-04-26T20:58:10.661342+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:38.596761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.659812+0000","last_change":"2024-04-26T20:58:10.657492+0000","last_active":"2024-04-26T20:58:10.659812+0000","last_peered":"2024-04-26T20:58:10.659812+0000","last_clean":"2024-04-26T20:58:10.659812+0000","last_became_active":"2024-04-26T20:58:10.657039+0000","last_became_peered":"2024-04-26T20:58:10.657039+0000","last_unstale":"2024-04-26T20:58:10.659812+0000","last_undegraded":"2024-04-26T20:58:10.659812+0000","last_fullsized":"2024-04-26T20:58:10.659812+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:28:38.251611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"41'8","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.659974+0000","last_change":"2024-04-26T20:57:52.592217+0000","last_active":"2024-04-26T20:58:10.659974+0000","last_peered":"2024-04-26T20:58:10.659974+0000","last_clean":"2024-04-26T20:58:10.659974+0000","last_became_active":"2024-04-26T20:57:52.591954+0000","last_became_peered":"2024-04-26T20:57:52.591954+0000","last_unstale":"2024-04-26T20:58:10.659974+0000","last_undegraded":"2024-04-26T20:58:10.659974+0000","last_fullsized":"2024-04-26T20:58:10.659974+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:23:22.653755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":28,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.698019+0000","last_change":"2024-04-26T20:57:51.571206+0000","last_active":"2024-04-26T20:58:12.698019+0000","last_peered":"2024-04-26T20:58:12.698019+0000","last_clean":"2024-04-26T20:58:12.698019+0000","last_became_active":"2024-04-26T20:57:51.570877+0000","last_became_peered":"2024-04-26T20:57:51.570877+0000","last_unstale":"2024-04-26T20:58:12.698019+0000","last_undegraded":"2024-04-26T20:58:12.698019+0000","last_fullsized":"2024-04-26T20:58:12.698019+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:49:38.164099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.667620+0000","last_change":"2024-04-26T20:58:10.665973+0000","last_active":"2024-04-26T20:58:10.667620+0000","last_peered":"2024-04-26T20:58:10.667620+0000","last_clean":"2024-04-26T20:58:10.667620+0000","last_became_active":"2024-04-26T20:58:10.665680+0000","last_became_peered":"2024-04-26T20:58:10.665680+0000","last_unstale":"2024-04-26T20:58:10.667620+0000","last_undegraded":"2024-04-26T20:58:10.667620+0000","last_fullsized":"2024-04-26T20:58:10.667620+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:06:56.528347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"41'5","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.658435+0000","last_change":"2024-04-26T20:57:52.594833+0000","last_active":"2024-04-26T20:58:10.658435+0000","last_peered":"2024-04-26T20:58:10.658435+0000","last_clean":"2024-04-26T20:58:10.658435+0000","last_became_active":"2024-04-26T20:57:52.594522+0000","last_became_peered":"2024-04-26T20:57:52.594522+0000","last_unstale":"2024-04-26T20:58:10.658435+0000","last_undegraded":"2024-04-26T20:58:10.658435+0000","last_fullsized":"2024-04-26T20:58:10.658435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:45.313671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":28,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.651880+0000","last_change":"2024-04-26T20:57:51.574086+0000","last_active":"2024-04-26T20:58:10.651880+0000","last_peered":"2024-04-26T20:58:10.651880+0000","last_clean":"2024-04-26T20:58:10.651880+0000","last_became_active":"2024-04-26T20:57:51.573834+0000","last_became_peered":"2024-04-26T20:57:51.573834+0000","last_unstale":"2024-04-26T20:58:10.651880+0000","last_undegraded":"2024-04-26T20:58:10.651880+0000","last_fullsized":"2024-04-26T20:58:10.651880+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:50:32.238625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.672714+0000","last_change":"2024-04-26T20:58:10.667021+0000","last_active":"2024-04-26T20:58:10.672714+0000","last_peered":"2024-04-26T20:58:10.672714+0000","last_clean":"2024-04-26T20:58:10.672714+0000","last_became_active":"2024-04-26T20:58:10.666042+0000","last_became_peered":"2024-04-26T20:58:10.666042+0000","last_unstale":"2024-04-26T20:58:10.672714+0000","last_undegraded":"2024-04-26T20:58:10.672714+0000","last_fullsized":"2024-04-26T20:58:10.672714+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:03.407602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"41'8","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.653027+0000","last_change":"2024-04-26T20:57:52.588655+0000","last_active":"2024-04-26T20:58:10.653027+0000","last_peered":"2024-04-26T20:58:10.653027+0000","last_clean":"2024-04-26T20:58:10.653027+0000","last_became_active":"2024-04-26T20:57:52.588356+0000","last_became_peered":"2024-04-26T20:57:52.588356+0000","last_unstale":"2024-04-26T20:58:10.653027+0000","last_undegraded":"2024-04-26T20:58:10.653027+0000","last_fullsized":"2024-04-26T20:58:10.653027+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:23.034777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":27,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.652745+0000","last_change":"2024-04-26T20:57:51.567675+0000","last_active":"2024-04-26T20:58:10.652745+0000","last_peered":"2024-04-26T20:58:10.652745+0000","last_clean":"2024-04-26T20:58:10.652745+0000","last_became_active":"2024-04-26T20:57:51.567464+0000","last_became_peered":"2024-04-26T20:57:51.567464+0000","last_unstale":"2024-04-26T20:58:10.652745+0000","last_undegraded":"2024-04-26T20:58:10.652745+0000","last_fullsized":"2024-04-26T20:58:10.652745+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:17.267826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.697664+0000","last_change":"2024-04-26T20:58:10.676259+0000","last_active":"2024-04-26T20:58:12.697664+0000","last_peered":"2024-04-26T20:58:12.697664+0000","last_clean":"2024-04-26T20:58:12.697664+0000","last_became_active":"2024-04-26T20:58:10.675987+0000","last_became_peered":"2024-04-26T20:58:10.675987+0000","last_unstale":"2024-04-26T20:58:12.697664+0000","last_undegraded":"2024-04-26T20:58:12.697664+0000","last_fullsized":"2024-04-26T20:58:12.697664+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:36:43.884695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"41'7","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.651737+0000","last_change":"2024-04-26T20:57:52.587210+0000","last_active":"2024-04-26T20:58:10.651737+0000","last_peered":"2024-04-26T20:58:10.651737+0000","last_clean":"2024-04-26T20:58:10.651737+0000","last_became_active":"2024-04-26T20:57:52.587015+0000","last_became_peered":"2024-04-26T20:57:52.587015+0000","last_unstale":"2024-04-26T20:58:10.651737+0000","last_undegraded":"2024-04-26T20:58:10.651737+0000","last_fullsized":"2024-04-26T20:58:10.651737+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:05.353679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":28,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.698218+0000","last_change":"2024-04-26T20:57:51.579142+0000","last_active":"2024-04-26T20:58:12.698218+0000","last_peered":"2024-04-26T20:58:12.698218+0000","last_clean":"2024-04-26T20:58:12.698218+0000","last_became_active":"2024-04-26T20:57:51.578834+0000","last_became_peered":"2024-04-26T20:57:51.578834+0000","last_unstale":"2024-04-26T20:58:12.698218+0000","last_undegraded":"2024-04-26T20:58:12.698218+0000","last_fullsized":"2024-04-26T20:58:12.698218+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:48:04.831644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.673957+0000","last_change":"2024-04-26T20:58:10.671508+0000","last_active":"2024-04-26T20:58:10.673957+0000","last_peered":"2024-04-26T20:58:10.673957+0000","last_clean":"2024-04-26T20:58:10.673957+0000","last_became_active":"2024-04-26T20:58:10.671203+0000","last_became_peered":"2024-04-26T20:58:10.671203+0000","last_unstale":"2024-04-26T20:58:10.673957+0000","last_undegraded":"2024-04-26T20:58:10.673957+0000","last_fullsized":"2024-04-26T20:58:10.673957+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:23.447610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"41'8","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.653562+0000","last_change":"2024-04-26T20:57:52.569231+0000","last_active":"2024-04-26T20:58:10.653562+0000","last_peered":"2024-04-26T20:58:10.653562+0000","last_clean":"2024-04-26T20:58:10.653562+0000","last_became_active":"2024-04-26T20:57:52.568915+0000","last_became_peered":"2024-04-26T20:57:52.568915+0000","last_unstale":"2024-04-26T20:58:10.653562+0000","last_undegraded":"2024-04-26T20:58:10.653562+0000","last_fullsized":"2024-04-26T20:58:10.653562+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:48.878142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":28,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.651893+0000","last_change":"2024-04-26T20:57:51.574337+0000","last_active":"2024-04-26T20:58:10.651893+0000","last_peered":"2024-04-26T20:58:10.651893+0000","last_clean":"2024-04-26T20:58:10.651893+0000","last_became_active":"2024-04-26T20:57:51.573114+0000","last_became_peered":"2024-04-26T20:57:51.573114+0000","last_unstale":"2024-04-26T20:58:10.651893+0000","last_undegraded":"2024-04-26T20:58:10.651893+0000","last_fullsized":"2024-04-26T20:58:10.651893+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:36:54.823396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":215,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.648435+0000","last_change":"2024-04-26T20:56:29.347462+0000","last_active":"2024-04-26T20:58:10.648435+0000","last_peered":"2024-04-26T20:58:10.648435+0000","last_clean":"2024-04-26T20:58:10.648435+0000","last_became_active":"2024-04-26T20:56:29.346224+0000","last_became_peered":"2024-04-26T20:56:29.346224+0000","last_unstale":"2024-04-26T20:58:10.648435+0000","last_undegraded":"2024-04-26T20:58:10.648435+0000","last_fullsized":"2024-04-26T20:58:10.648435+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:28.079105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:28.079105+0000","last_clean_scrub_stamp":"2024-04-26T20:56:28.079105+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:13.693525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":504,"ondisk_log_size":504,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":97,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":84,"ondisk_log_size":84,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509465,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":552960,"data_stored":246517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509464,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":552960,"data_stored":246517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509465,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32240,"kb_used_data":5216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":5341184,"data_stored":5031189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509465,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33708,"kb_used_data":6672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94338132,"statfs":{"total":96636764160,"available":96602247168,"internally_reserved":0,"allocated":6832128,"data_stored":6530257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509465,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":552960,"data_stored":246517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509464,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28144,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343696,"statfs":{"total":96636764160,"available":96607944704,"internally_reserved":0,"allocated":1146880,"data_stored":836885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509463,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29612,"kb_used_data":2588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342228,"statfs":{"total":96636764160,"available":96606441472,"internally_reserved":0,"allocated":2650112,"data_stored":2343669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27572,"kb_used_data":552,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":565248,"data_stored":253773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T20:58:15.521 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-26T20:58:15.698 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.696+0000 7fc58e800640 1 Processor -- start 2024-04-26T20:58:15.698 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.696+0000 7fc58e800640 1 -- start start 2024-04-26T20:58:15.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.696+0000 7fc58e800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc58815ced0 0x7fc5880cb200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:15.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.696+0000 7fc58e800640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc5880cbda0 0x7fc5880cb740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:15.700 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.696+0000 7fc58e800640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5880cd310 con 0x7fc588071ee0 2024-04-26T20:58:15.700 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.696+0000 7fc58e800640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fc58806e2f0 con 0x7fc58815ced0 2024-04-26T20:58:15.700 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.696+0000 7fc58e800640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fc5880ccd50 con 0x7fc5880cbda0 2024-04-26T20:58:15.700 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.696+0000 7fc587400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc58815ced0 0x7fc5880cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:15.700 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.696+0000 7fc587400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc58815ced0 0x7fc5880cb200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:54206/0 (socket says 172.21.15.138:54206) 2024-04-26T20:58:15.700 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.696+0000 7fc587400640 1 -- 172.21.15.138:0/121331901 learned_addr learned my addr 172.21.15.138:0/121331901 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:15.700 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.700+0000 7fc586a00640 1 --2- 172.21.15.138:0/121331901 >> v2:172.21.15.143:3300/0 conn(0x7fc5880cbda0 0x7fc5880cb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:15.700 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.700+0000 7fc587400640 1 -- 172.21.15.138:0/121331901 >> v2:172.21.15.143:3300/0 conn(0x7fc5880cbda0 msgr2=0x7fc5880cb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:15.700 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.700+0000 7fc587400640 1 --2- 172.21.15.138:0/121331901 >> v2:172.21.15.143:3300/0 conn(0x7fc5880cbda0 0x7fc5880cb740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:15.700 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.700+0000 7fc587400640 1 -- 172.21.15.138:0/121331901 >> v1:172.21.15.143:6789/0 conn(0x7fc588071ee0 legacy=0x7fc588160b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:15.700 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.700+0000 7fc587400640 1 -- 172.21.15.138:0/121331901 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5880cd030 con 0x7fc58815ced0 2024-04-26T20:58:15.700 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.700+0000 7fc586a00640 1 --2- 172.21.15.138:0/121331901 >> v2:172.21.15.143:3300/0 conn(0x7fc5880cbda0 0x7fc5880cb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:58:15.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.700+0000 7fc587400640 1 --2- 172.21.15.138:0/121331901 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc58815ced0 0x7fc5880cb200 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fc588074f50 tx=0x7fc57801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f617d42d548d664 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:15.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.700+0000 7fc586000640 1 -- 172.21.15.138:0/121331901 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5780a57c0 con 0x7fc58815ced0 2024-04-26T20:58:15.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.700+0000 7fc586000640 1 -- 172.21.15.138:0/121331901 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5780a5960 con 0x7fc58815ced0 2024-04-26T20:58:15.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.700+0000 7fc586000640 1 -- 172.21.15.138:0/121331901 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5780a5d30 con 0x7fc58815ced0 2024-04-26T20:58:15.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.700+0000 7fc58e800640 1 -- 172.21.15.138:0/121331901 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc58815ced0 msgr2=0x7fc5880cb200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:15.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.700+0000 7fc58e800640 1 --2- 172.21.15.138:0/121331901 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc58815ced0 0x7fc5880cb200 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fc588074f50 tx=0x7fc57801c9c0 comp rx=0 tx=0).stop 2024-04-26T20:58:15.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.704+0000 7fc58e800640 1 -- 172.21.15.138:0/121331901 shutdown_connections 2024-04-26T20:58:15.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.704+0000 7fc58e800640 1 --2- 172.21.15.138:0/121331901 >> v2:172.21.15.143:3300/0 conn(0x7fc5880cbda0 0x7fc5880cb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:15.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.704+0000 7fc58e800640 1 --2- 172.21.15.138:0/121331901 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc58815ced0 0x7fc5880cb200 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:15.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.704+0000 7fc58e800640 1 -- 172.21.15.138:0/121331901 >> 172.21.15.138:0/121331901 conn(0x7fc5880d0bb0 msgr2=0x7fc5880d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:15.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.704+0000 7fc58e800640 1 -- 172.21.15.138:0/121331901 shutdown_connections 2024-04-26T20:58:15.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.704+0000 7fc58e800640 1 -- 172.21.15.138:0/121331901 wait complete. 2024-04-26T20:58:15.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.704+0000 7fc58e800640 1 Processor -- start 2024-04-26T20:58:15.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.704+0000 7fc58e800640 1 -- start start 2024-04-26T20:58:15.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.704+0000 7fc58e800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc588071ee0 0x7fc588153410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:15.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.704+0000 7fc58e800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc5880cbda0 0x7fc5881546b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:15.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.704+0000 7fc58e800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc58815ced0 0x7fc588154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:15.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.704+0000 7fc58e800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc58806f910 con 0x7fc588071ee0 2024-04-26T20:58:15.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.704+0000 7fc58e800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fc58806f790 con 0x7fc58815ced0 2024-04-26T20:58:15.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.704+0000 7fc58e800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fc588169ee0 con 0x7fc5880cbda0 2024-04-26T20:58:15.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.704+0000 7fc587400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc588071ee0 0x7fc588153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:15.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.704+0000 7fc587400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc588071ee0 0x7fc588153410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:54218/0 (socket says 172.21.15.138:54218) 2024-04-26T20:58:15.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.704+0000 7fc587400640 1 -- 172.21.15.138:0/2844925533 learned_addr learned my addr 172.21.15.138:0/2844925533 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:15.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.704+0000 7fc586a00640 1 --2- 172.21.15.138:0/2844925533 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc5880cbda0 0x7fc5881546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:15.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.704+0000 7fc587e00640 1 --2- 172.21.15.138:0/2844925533 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc58815ced0 0x7fc588154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:15.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.704+0000 7fc587400640 1 -- 172.21.15.138:0/2844925533 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc5880cbda0 msgr2=0x7fc5881546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:15.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.704+0000 7fc587400640 1 --2- 172.21.15.138:0/2844925533 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc5880cbda0 0x7fc5881546b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:15.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.704+0000 7fc587400640 1 -- 172.21.15.138:0/2844925533 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc58815ced0 msgr2=0x7fc588154bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:15.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.704+0000 7fc587400640 1 --2- 172.21.15.138:0/2844925533 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc58815ced0 0x7fc588154bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:15.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.704+0000 7fc587400640 1 -- 172.21.15.138:0/2844925533 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc588155390 con 0x7fc588071ee0 2024-04-26T20:58:15.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.704+0000 7fc586a00640 1 --2- 172.21.15.138:0/2844925533 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc5880cbda0 0x7fc5881546b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:58:15.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.704+0000 7fc587400640 1 --2- 172.21.15.138:0/2844925533 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc588071ee0 0x7fc588153410 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fc57801a5f0 tx=0x7fc578019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:15.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.704+0000 7fc57f400640 1 -- 172.21.15.138:0/2844925533 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5780b8670 con 0x7fc588071ee0 2024-04-26T20:58:15.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.704+0000 7fc57f400640 1 -- 172.21.15.138:0/2844925533 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5780be070 con 0x7fc588071ee0 2024-04-26T20:58:15.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.704+0000 7fc57f400640 1 -- 172.21.15.138:0/2844925533 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5780b8a70 con 0x7fc588071ee0 2024-04-26T20:58:15.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.704+0000 7fc58e800640 1 -- 172.21.15.138:0/2844925533 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc58815fe80 con 0x7fc588071ee0 2024-04-26T20:58:15.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.708+0000 7fc58e800640 1 -- 172.21.15.138:0/2844925533 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc588160440 con 0x7fc588071ee0 2024-04-26T20:58:15.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.708+0000 7fc58e800640 1 -- 172.21.15.138:0/2844925533 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc588069510 con 0x7fc588071ee0 2024-04-26T20:58:15.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.708+0000 7fc57f400640 1 -- 172.21.15.138:0/2844925533 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc5780b8c10 con 0x7fc588071ee0 2024-04-26T20:58:15.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.708+0000 7fc57f400640 1 --2- 172.21.15.138:0/2844925533 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc568068380 0x7fc56806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:15.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.708+0000 7fc57f400640 1 -- 172.21.15.138:0/2844925533 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6640+0+0 (secure 0 0 0) 0x7fc578121ea0 con 0x7fc588071ee0 2024-04-26T20:58:15.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.708+0000 7fc586a00640 1 --2- 172.21.15.138:0/2844925533 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc568068380 0x7fc56806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:15.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.708+0000 7fc586a00640 1 --2- 172.21.15.138:0/2844925533 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc568068380 0x7fc56806a840 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc5880b5b90 tx=0x7fc574008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:15.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.712+0000 7fc57f400640 1 -- 172.21.15.138:0/2844925533 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc5780165e0 con 0x7fc588071ee0 2024-04-26T20:58:15.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.924+0000 7fc58e800640 1 -- 172.21.15.138:0/2844925533 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fc5881598b0 con 0x7fc588071ee0 2024-04-26T20:58:15.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.928+0000 7fc57f400640 1 -- 172.21.15.138:0/2844925533 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1652 (secure 0 0 0) 0x7fc5780f2040 con 0x7fc588071ee0 2024-04-26T20:58:15.928 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:15.928 INFO:teuthology.orchestra.run.smithi138.stdout:{"fsid":"c22b4730-12cc-4558-8535-b965384398c0","health":{"status":"HEALTH_ERR","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"2 filesystems are degraded","count":2},"muted":false},"MDS_ALL_DOWN":{"severity":"HEALTH_ERR","summary":{"message":"2 filesystems are offline","count":2},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":121,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":49,"num_osds":8,"num_up_osds":8,"osd_up_since":1714164986,"num_in_osds":8,"osd_in_since":1714164976,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":129}],"num_pgs":129,"num_pools":4,"num_objects":4,"data_bytes":6881824,"bytes_used":239570944,"bytes_avail":772854542336,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":341,"read_op_per_sec":0,"write_op_per_sec":5},"fsmap":{"epoch":23,"id":2,"up":0,"in":1,"max":1,"id":3,"up":0,"in":1,"max":1,"by_rank":[],"up:standby":4,"failed":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2024-04-26T20:58:07.262138+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-26T20:58:15.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.928+0000 7fc58e800640 1 -- 172.21.15.138:0/2844925533 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc568068380 msgr2=0x7fc56806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:15.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.928+0000 7fc58e800640 1 --2- 172.21.15.138:0/2844925533 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc568068380 0x7fc56806a840 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc5880b5b90 tx=0x7fc574008040 comp rx=0 tx=0).stop 2024-04-26T20:58:15.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.928+0000 7fc58e800640 1 -- 172.21.15.138:0/2844925533 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc588071ee0 msgr2=0x7fc588153410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:15.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.928+0000 7fc58e800640 1 --2- 172.21.15.138:0/2844925533 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc588071ee0 0x7fc588153410 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fc57801a5f0 tx=0x7fc578019760 comp rx=0 tx=0).stop 2024-04-26T20:58:15.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.928+0000 7fc58e800640 1 -- 172.21.15.138:0/2844925533 shutdown_connections 2024-04-26T20:58:15.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.928+0000 7fc58e800640 1 --2- 172.21.15.138:0/2844925533 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fc568068380 0x7fc56806a840 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:15.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.928+0000 7fc58e800640 1 --2- 172.21.15.138:0/2844925533 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc58815ced0 0x7fc588154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:15.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.928+0000 7fc58e800640 1 --2- 172.21.15.138:0/2844925533 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc5880cbda0 0x7fc5881546b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:15.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.928+0000 7fc58e800640 1 --2- 172.21.15.138:0/2844925533 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc588071ee0 0x7fc588153410 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:15.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.928+0000 7fc58e800640 1 -- 172.21.15.138:0/2844925533 >> 172.21.15.138:0/2844925533 conn(0x7fc5880d0bb0 msgr2=0x7fc5880d10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:15.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.928+0000 7fc58e800640 1 -- 172.21.15.138:0/2844925533 shutdown_connections 2024-04-26T20:58:15.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:15.928+0000 7fc58e800640 1 -- 172.21.15.138:0/2844925533 wait complete. 2024-04-26T20:58:15.948 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-26T20:58:15.949 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T20:58:16.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.080+0000 7fbf4ca00640 1 Processor -- start 2024-04-26T20:58:16.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.084+0000 7fbf4ca00640 1 -- start start 2024-04-26T20:58:16.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.084+0000 7fbf4ca00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fbf480cbe00 0x7fbf4806de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:16.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.084+0000 7fbf4ca00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fbf480cc1e0 0x7fbf48073b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:16.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.084+0000 7fbf4ca00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbf480ce6f0 0x7fbf480ceb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:16.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.084+0000 7fbf4ca00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fbf48073680 con 0x7fbf480cbe00 2024-04-26T20:58:16.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.084+0000 7fbf4ca00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fbf480727f0 con 0x7fbf480cc1e0 2024-04-26T20:58:16.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.084+0000 7fbf4ca00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fbf48072a70 con 0x7fbf480ce6f0 2024-04-26T20:58:16.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.084+0000 7fbf45e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fbf480cbe00 0x7fbf4806de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:16.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.084+0000 7fbf45e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fbf480cbe00 0x7fbf4806de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:54234/0 (socket says 172.21.15.138:54234) 2024-04-26T20:58:16.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.084+0000 7fbf45e00640 1 -- 172.21.15.138:0/3385245873 learned_addr learned my addr 172.21.15.138:0/3385245873 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:16.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.084+0000 7fbf3d400640 1 --2- 172.21.15.138:0/3385245873 >> v2:172.21.15.143:3300/0 conn(0x7fbf480cc1e0 0x7fbf48073b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:16.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.084+0000 7fbf46800640 1 --2- 172.21.15.138:0/3385245873 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbf480ce6f0 0x7fbf480ceb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:16.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.084+0000 7fbf45e00640 1 -- 172.21.15.138:0/3385245873 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbf480ce6f0 msgr2=0x7fbf480ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:16.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.084+0000 7fbf45e00640 1 --2- 172.21.15.138:0/3385245873 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbf480ce6f0 0x7fbf480ceb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:16.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.084+0000 7fbf45e00640 1 -- 172.21.15.138:0/3385245873 >> v2:172.21.15.143:3300/0 conn(0x7fbf480cc1e0 msgr2=0x7fbf48073b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:16.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.084+0000 7fbf45e00640 1 --2- 172.21.15.138:0/3385245873 >> v2:172.21.15.143:3300/0 conn(0x7fbf480cc1e0 0x7fbf48073b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:16.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.084+0000 7fbf45e00640 1 -- 172.21.15.138:0/3385245873 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf48072d50 con 0x7fbf480cbe00 2024-04-26T20:58:16.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.088+0000 7fbf45e00640 1 --2- 172.21.15.138:0/3385245873 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf480cbe00 0x7fbf4806de70 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fbf480b6c50 tx=0x7fbf3801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=713ee1bee9b3ba9e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:16.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.088+0000 7fbf45400640 1 -- 172.21.15.138:0/3385245873 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf380b0070 con 0x7fbf480cbe00 2024-04-26T20:58:16.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.088+0000 7fbf45400640 1 -- 172.21.15.138:0/3385245873 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf380ab600 con 0x7fbf480cbe00 2024-04-26T20:58:16.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.088+0000 7fbf45400640 1 -- 172.21.15.138:0/3385245873 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf380ab9d0 con 0x7fbf480cbe00 2024-04-26T20:58:16.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.088+0000 7fbf4ca00640 1 -- 172.21.15.138:0/3385245873 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf480cbe00 msgr2=0x7fbf4806de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:16.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.088+0000 7fbf4ca00640 1 --2- 172.21.15.138:0/3385245873 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf480cbe00 0x7fbf4806de70 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fbf480b6c50 tx=0x7fbf3801c520 comp rx=0 tx=0).stop 2024-04-26T20:58:16.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.088+0000 7fbf4ca00640 1 -- 172.21.15.138:0/3385245873 shutdown_connections 2024-04-26T20:58:16.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.088+0000 7fbf4ca00640 1 --2- 172.21.15.138:0/3385245873 >> v2:172.21.15.143:3300/0 conn(0x7fbf480cc1e0 0x7fbf48073b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:16.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.088+0000 7fbf4ca00640 1 --2- 172.21.15.138:0/3385245873 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbf480ce6f0 0x7fbf480ceb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:16.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.088+0000 7fbf4ca00640 1 --2- 172.21.15.138:0/3385245873 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf480cbe00 0x7fbf4806de70 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:16.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.088+0000 7fbf4ca00640 1 -- 172.21.15.138:0/3385245873 >> 172.21.15.138:0/3385245873 conn(0x7fbf480d0b20 msgr2=0x7fbf480d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:16.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.088+0000 7fbf4ca00640 1 -- 172.21.15.138:0/3385245873 shutdown_connections 2024-04-26T20:58:16.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.088+0000 7fbf4ca00640 1 -- 172.21.15.138:0/3385245873 wait complete. 2024-04-26T20:58:16.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.088+0000 7fbf4ca00640 1 Processor -- start 2024-04-26T20:58:16.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.088+0000 7fbf4ca00640 1 -- start start 2024-04-26T20:58:16.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.092+0000 7fbf4ca00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbf480cbe00 0x7fbf480b1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:16.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.092+0000 7fbf4ca00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf480cc1e0 0x7fbf48158b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:16.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.092+0000 7fbf4ca00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbf480ce6f0 0x7fbf48159050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:16.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.092+0000 7fbf4ca00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4806e530 con 0x7fbf480cc1e0 2024-04-26T20:58:16.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.092+0000 7fbf4ca00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4806e3b0 con 0x7fbf480cbe00 2024-04-26T20:58:16.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.092+0000 7fbf4ca00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fbf48074050 con 0x7fbf480ce6f0 2024-04-26T20:58:16.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.092+0000 7fbf3d400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf480cc1e0 0x7fbf48158b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:16.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.092+0000 7fbf3d400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf480cc1e0 0x7fbf48158b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:54236/0 (socket says 172.21.15.138:54236) 2024-04-26T20:58:16.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.092+0000 7fbf3d400640 1 -- 172.21.15.138:0/571043797 learned_addr learned my addr 172.21.15.138:0/571043797 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:16.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.092+0000 7fbf46800640 1 --2- 172.21.15.138:0/571043797 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbf480ce6f0 0x7fbf48159050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:16.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.092+0000 7fbf45e00640 1 --2- 172.21.15.138:0/571043797 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbf480cbe00 0x7fbf480b1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:16.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.092+0000 7fbf3d400640 1 -- 172.21.15.138:0/571043797 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbf480ce6f0 msgr2=0x7fbf48159050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:16.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.092+0000 7fbf3d400640 1 --2- 172.21.15.138:0/571043797 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbf480ce6f0 0x7fbf48159050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:16.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.092+0000 7fbf3d400640 1 -- 172.21.15.138:0/571043797 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbf480cbe00 msgr2=0x7fbf480b1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:16.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.092+0000 7fbf3d400640 1 --2- 172.21.15.138:0/571043797 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbf480cbe00 0x7fbf480b1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:16.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.092+0000 7fbf3d400640 1 -- 172.21.15.138:0/571043797 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf481526a0 con 0x7fbf480cc1e0 2024-04-26T20:58:16.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.092+0000 7fbf3d400640 1 --2- 172.21.15.138:0/571043797 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf480cc1e0 0x7fbf48158b10 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fbf3000e8b0 tx=0x7fbf3000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:16.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.092+0000 7fbf3ea00640 1 -- 172.21.15.138:0/571043797 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf30017070 con 0x7fbf480cc1e0 2024-04-26T20:58:16.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.092+0000 7fbf3ea00640 1 -- 172.21.15.138:0/571043797 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf3000c940 con 0x7fbf480cc1e0 2024-04-26T20:58:16.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.092+0000 7fbf4ca00640 1 -- 172.21.15.138:0/571043797 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf480b24e0 con 0x7fbf480cc1e0 2024-04-26T20:58:16.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.092+0000 7fbf3ea00640 1 -- 172.21.15.138:0/571043797 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf3000cd10 con 0x7fbf480cc1e0 2024-04-26T20:58:16.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.092+0000 7fbf4ca00640 1 -- 172.21.15.138:0/571043797 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf480c9350 con 0x7fbf480cc1e0 2024-04-26T20:58:16.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.092+0000 7fbf4ca00640 1 -- 172.21.15.138:0/571043797 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf48069510 con 0x7fbf480cc1e0 2024-04-26T20:58:16.095 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.092+0000 7fbf3ea00640 1 -- 172.21.15.138:0/571043797 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbf3001a070 con 0x7fbf480cc1e0 2024-04-26T20:58:16.096 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.096+0000 7fbf3ea00640 1 --2- 172.21.15.138:0/571043797 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fbf24068380 0x7fbf2406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:16.096 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.096+0000 7fbf3ea00640 1 -- 172.21.15.138:0/571043797 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6640+0+0 (secure 0 0 0) 0x7fbf30086d90 con 0x7fbf480cc1e0 2024-04-26T20:58:16.096 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.096+0000 7fbf45e00640 1 --2- 172.21.15.138:0/571043797 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fbf24068380 0x7fbf2406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:16.096 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.096+0000 7fbf45e00640 1 --2- 172.21.15.138:0/571043797 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fbf24068380 0x7fbf2406a840 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbf380ad000 tx=0x7fbf38008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:16.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.100+0000 7fbf3ea00640 1 -- 172.21.15.138:0/571043797 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fbf30056fc0 con 0x7fbf480cc1e0 2024-04-26T20:58:16.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.252+0000 7fbf4ca00640 1 -- 172.21.15.138:0/571043797 --> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbf48156de0 con 0x7fbf24068380 2024-04-26T20:58:16.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.260+0000 7fbf3ea00640 1 -- 172.21.15.138:0/571043797 <== mgr.4100 v2:172.21.15.143:6832/4275464198 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332510 (secure 0 0 0) 0x7fbf48156de0 con 0x7fbf24068380 2024-04-26T20:58:16.268 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:16.270 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-04-26T20:58:16.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.268+0000 7fbf4ca00640 1 -- 172.21.15.138:0/571043797 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fbf24068380 msgr2=0x7fbf2406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:16.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.268+0000 7fbf4ca00640 1 --2- 172.21.15.138:0/571043797 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fbf24068380 0x7fbf2406a840 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbf380ad000 tx=0x7fbf38008040 comp rx=0 tx=0).stop 2024-04-26T20:58:16.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.268+0000 7fbf4ca00640 1 -- 172.21.15.138:0/571043797 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf480cc1e0 msgr2=0x7fbf48158b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:16.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.268+0000 7fbf4ca00640 1 --2- 172.21.15.138:0/571043797 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf480cc1e0 0x7fbf48158b10 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fbf3000e8b0 tx=0x7fbf3000ed70 comp rx=0 tx=0).stop 2024-04-26T20:58:16.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.268+0000 7fbf4ca00640 1 -- 172.21.15.138:0/571043797 shutdown_connections 2024-04-26T20:58:16.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.268+0000 7fbf4ca00640 1 --2- 172.21.15.138:0/571043797 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fbf24068380 0x7fbf2406a840 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:16.273 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.268+0000 7fbf4ca00640 1 --2- 172.21.15.138:0/571043797 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbf480ce6f0 0x7fbf48159050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:16.273 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.268+0000 7fbf4ca00640 1 --2- 172.21.15.138:0/571043797 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf480cc1e0 0x7fbf48158b10 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:16.273 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.268+0000 7fbf4ca00640 1 --2- 172.21.15.138:0/571043797 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbf480cbe00 0x7fbf480b1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:16.273 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.268+0000 7fbf4ca00640 1 -- 172.21.15.138:0/571043797 >> 172.21.15.138:0/571043797 conn(0x7fbf480d0b20 msgr2=0x7fbf4806e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:16.273 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.268+0000 7fbf4ca00640 1 -- 172.21.15.138:0/571043797 shutdown_connections 2024-04-26T20:58:16.273 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:16.268+0000 7fbf4ca00640 1 -- 172.21.15.138:0/571043797 wait complete. 2024-04-26T20:58:16.290 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":98,"stamp":"2024-04-26T20:58:15.263753+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6881824,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":117,"num_read_kb":100,"num_write":260,"num_write_kb":8602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":705,"ondisk_log_size":705,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":234,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":233956,"kb_used_data":17768,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754740764,"statfs":{"total":773094113280,"available":772854542336,"internally_reserved":0,"allocated":18194432,"data_stored":15735324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-764,"num_objects":-15,"num_object_clones":0,"num_object_copies":-30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-15,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":31,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001306"},"pg_stats":[{"pgid":"6.3f","version":"41'8","reported_seq":35,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.698258+0000","last_change":"2024-04-26T20:57:52.581808+0000","last_active":"2024-04-26T20:58:12.698258+0000","last_peered":"2024-04-26T20:58:12.698258+0000","last_clean":"2024-04-26T20:58:12.698258+0000","last_became_active":"2024-04-26T20:57:52.581483+0000","last_became_peered":"2024-04-26T20:57:52.581483+0000","last_unstale":"2024-04-26T20:58:12.698258+0000","last_undegraded":"2024-04-26T20:58:12.698258+0000","last_fullsized":"2024-04-26T20:58:12.698258+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:11:15.960274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"41'4","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.658178+0000","last_change":"2024-04-26T20:57:52.584136+0000","last_active":"2024-04-26T20:58:10.658178+0000","last_peered":"2024-04-26T20:58:10.658178+0000","last_clean":"2024-04-26T20:58:10.658178+0000","last_became_active":"2024-04-26T20:57:52.583831+0000","last_became_peered":"2024-04-26T20:57:52.583831+0000","last_unstale":"2024-04-26T20:58:10.658178+0000","last_undegraded":"2024-04-26T20:58:10.658178+0000","last_fullsized":"2024-04-26T20:58:10.658178+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:47:10.436783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"41'7","reported_seq":34,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.698006+0000","last_change":"2024-04-26T20:57:52.589332+0000","last_active":"2024-04-26T20:58:12.698006+0000","last_peered":"2024-04-26T20:58:12.698006+0000","last_clean":"2024-04-26T20:58:12.698006+0000","last_became_active":"2024-04-26T20:57:52.589025+0000","last_became_peered":"2024-04-26T20:57:52.589025+0000","last_unstale":"2024-04-26T20:58:12.698006+0000","last_undegraded":"2024-04-26T20:58:12.698006+0000","last_fullsized":"2024-04-26T20:58:12.698006+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:36.442218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"41'8","reported_seq":35,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.698133+0000","last_change":"2024-04-26T20:57:52.577582+0000","last_active":"2024-04-26T20:58:12.698133+0000","last_peered":"2024-04-26T20:58:12.698133+0000","last_clean":"2024-04-26T20:58:12.698133+0000","last_became_active":"2024-04-26T20:57:52.576872+0000","last_became_peered":"2024-04-26T20:57:52.576872+0000","last_unstale":"2024-04-26T20:58:12.698133+0000","last_undegraded":"2024-04-26T20:58:12.698133+0000","last_fullsized":"2024-04-26T20:58:12.698133+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:57:10.605998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"41'4","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.660374+0000","last_change":"2024-04-26T20:57:52.590233+0000","last_active":"2024-04-26T20:58:10.660374+0000","last_peered":"2024-04-26T20:58:10.660374+0000","last_clean":"2024-04-26T20:58:10.660374+0000","last_became_active":"2024-04-26T20:57:52.589943+0000","last_became_peered":"2024-04-26T20:57:52.589943+0000","last_unstale":"2024-04-26T20:58:10.660374+0000","last_undegraded":"2024-04-26T20:58:10.660374+0000","last_fullsized":"2024-04-26T20:58:10.660374+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:12.952743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"41'6","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.657623+0000","last_change":"2024-04-26T20:57:52.586359+0000","last_active":"2024-04-26T20:58:10.657623+0000","last_peered":"2024-04-26T20:58:10.657623+0000","last_clean":"2024-04-26T20:58:10.657623+0000","last_became_active":"2024-04-26T20:57:52.586013+0000","last_became_peered":"2024-04-26T20:57:52.586013+0000","last_unstale":"2024-04-26T20:58:10.657623+0000","last_undegraded":"2024-04-26T20:58:10.657623+0000","last_fullsized":"2024-04-26T20:58:10.657623+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:52:00.840874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"41'5","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.648157+0000","last_change":"2024-04-26T20:57:52.578308+0000","last_active":"2024-04-26T20:58:10.648157+0000","last_peered":"2024-04-26T20:58:10.648157+0000","last_clean":"2024-04-26T20:58:10.648157+0000","last_became_active":"2024-04-26T20:57:52.578063+0000","last_became_peered":"2024-04-26T20:57:52.578063+0000","last_unstale":"2024-04-26T20:58:10.648157+0000","last_undegraded":"2024-04-26T20:58:10.648157+0000","last_fullsized":"2024-04-26T20:58:10.648157+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:12.952743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"41'9","reported_seq":36,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.697413+0000","last_change":"2024-04-26T20:57:52.583828+0000","last_active":"2024-04-26T20:58:12.697413+0000","last_peered":"2024-04-26T20:58:12.697413+0000","last_clean":"2024-04-26T20:58:12.697413+0000","last_became_active":"2024-04-26T20:57:52.582894+0000","last_became_peered":"2024-04-26T20:57:52.582894+0000","last_unstale":"2024-04-26T20:58:12.697413+0000","last_undegraded":"2024-04-26T20:58:12.697413+0000","last_fullsized":"2024-04-26T20:58:12.697413+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:49:03.544125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"41'11","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.661672+0000","last_change":"2024-04-26T20:57:52.590616+0000","last_active":"2024-04-26T20:58:10.661672+0000","last_peered":"2024-04-26T20:58:10.661672+0000","last_clean":"2024-04-26T20:58:10.661672+0000","last_became_active":"2024-04-26T20:57:52.589972+0000","last_became_peered":"2024-04-26T20:57:52.589972+0000","last_unstale":"2024-04-26T20:58:10.661672+0000","last_undegraded":"2024-04-26T20:58:10.661672+0000","last_fullsized":"2024-04-26T20:58:10.661672+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:55.128152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"41'15","reported_seq":39,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.649095+0000","last_change":"2024-04-26T20:57:52.575175+0000","last_active":"2024-04-26T20:58:10.649095+0000","last_peered":"2024-04-26T20:58:10.649095+0000","last_clean":"2024-04-26T20:58:10.649095+0000","last_became_active":"2024-04-26T20:57:52.574917+0000","last_became_peered":"2024-04-26T20:57:52.574917+0000","last_unstale":"2024-04-26T20:58:10.649095+0000","last_undegraded":"2024-04-26T20:58:10.649095+0000","last_fullsized":"2024-04-26T20:58:10.649095+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:28:20.157680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"41'6","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.652083+0000","last_change":"2024-04-26T20:57:52.579280+0000","last_active":"2024-04-26T20:58:10.652083+0000","last_peered":"2024-04-26T20:58:10.652083+0000","last_clean":"2024-04-26T20:58:10.652083+0000","last_became_active":"2024-04-26T20:57:52.578799+0000","last_became_peered":"2024-04-26T20:57:52.578799+0000","last_unstale":"2024-04-26T20:58:10.652083+0000","last_undegraded":"2024-04-26T20:58:10.652083+0000","last_fullsized":"2024-04-26T20:58:10.652083+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:24.709956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"41'7","reported_seq":32,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.662261+0000","last_change":"2024-04-26T20:57:52.585045+0000","last_active":"2024-04-26T20:58:10.662261+0000","last_peered":"2024-04-26T20:58:10.662261+0000","last_clean":"2024-04-26T20:58:10.662261+0000","last_became_active":"2024-04-26T20:57:52.584748+0000","last_became_peered":"2024-04-26T20:57:52.584748+0000","last_unstale":"2024-04-26T20:58:10.662261+0000","last_undegraded":"2024-04-26T20:58:10.662261+0000","last_fullsized":"2024-04-26T20:58:10.662261+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:16.143937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"41'10","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.649429+0000","last_change":"2024-04-26T20:57:52.583032+0000","last_active":"2024-04-26T20:58:10.649429+0000","last_peered":"2024-04-26T20:58:10.649429+0000","last_clean":"2024-04-26T20:58:10.649429+0000","last_became_active":"2024-04-26T20:57:52.582788+0000","last_became_peered":"2024-04-26T20:57:52.582788+0000","last_unstale":"2024-04-26T20:58:10.649429+0000","last_undegraded":"2024-04-26T20:58:10.649429+0000","last_fullsized":"2024-04-26T20:58:10.649429+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:12:05.356796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"41'8","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.654536+0000","last_change":"2024-04-26T20:57:52.577582+0000","last_active":"2024-04-26T20:58:10.654536+0000","last_peered":"2024-04-26T20:58:10.654536+0000","last_clean":"2024-04-26T20:58:10.654536+0000","last_became_active":"2024-04-26T20:57:52.577366+0000","last_became_peered":"2024-04-26T20:57:52.577366+0000","last_unstale":"2024-04-26T20:58:10.654536+0000","last_undegraded":"2024-04-26T20:58:10.654536+0000","last_fullsized":"2024-04-26T20:58:10.654536+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:16.143937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"41'7","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.652283+0000","last_change":"2024-04-26T20:57:52.586188+0000","last_active":"2024-04-26T20:58:10.652283+0000","last_peered":"2024-04-26T20:58:10.652283+0000","last_clean":"2024-04-26T20:58:10.652283+0000","last_became_active":"2024-04-26T20:57:52.585816+0000","last_became_peered":"2024-04-26T20:57:52.585816+0000","last_unstale":"2024-04-26T20:58:10.652283+0000","last_undegraded":"2024-04-26T20:58:10.652283+0000","last_fullsized":"2024-04-26T20:58:10.652283+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:34:47.231759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"41'9","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.648219+0000","last_change":"2024-04-26T20:57:52.587967+0000","last_active":"2024-04-26T20:58:10.648219+0000","last_peered":"2024-04-26T20:58:10.648219+0000","last_clean":"2024-04-26T20:58:10.648219+0000","last_became_active":"2024-04-26T20:57:52.587598+0000","last_became_peered":"2024-04-26T20:57:52.587598+0000","last_unstale":"2024-04-26T20:58:10.648219+0000","last_undegraded":"2024-04-26T20:58:10.648219+0000","last_fullsized":"2024-04-26T20:58:10.648219+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:55.128152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"41'9","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.653716+0000","last_change":"2024-04-26T20:57:52.582167+0000","last_active":"2024-04-26T20:58:10.653716+0000","last_peered":"2024-04-26T20:58:10.653716+0000","last_clean":"2024-04-26T20:58:10.653716+0000","last_became_active":"2024-04-26T20:57:52.581896+0000","last_became_peered":"2024-04-26T20:57:52.581896+0000","last_unstale":"2024-04-26T20:58:10.653716+0000","last_undegraded":"2024-04-26T20:58:10.653716+0000","last_fullsized":"2024-04-26T20:58:10.653716+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:34:07.377749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"41'10","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.653336+0000","last_change":"2024-04-26T20:57:52.582700+0000","last_active":"2024-04-26T20:58:10.653336+0000","last_peered":"2024-04-26T20:58:10.653336+0000","last_clean":"2024-04-26T20:58:10.653336+0000","last_became_active":"2024-04-26T20:57:52.582355+0000","last_became_peered":"2024-04-26T20:57:52.582355+0000","last_unstale":"2024-04-26T20:58:10.653336+0000","last_undegraded":"2024-04-26T20:58:10.653336+0000","last_fullsized":"2024-04-26T20:58:10.653336+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:36:31.798469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"41'7","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.664703+0000","last_change":"2024-04-26T20:57:52.593273+0000","last_active":"2024-04-26T20:58:10.664703+0000","last_peered":"2024-04-26T20:58:10.664703+0000","last_clean":"2024-04-26T20:58:10.664703+0000","last_became_active":"2024-04-26T20:57:52.592960+0000","last_became_peered":"2024-04-26T20:57:52.592960+0000","last_unstale":"2024-04-26T20:58:10.664703+0000","last_undegraded":"2024-04-26T20:58:10.664703+0000","last_fullsized":"2024-04-26T20:58:10.664703+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:49:19.250429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"41'8","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.651801+0000","last_change":"2024-04-26T20:57:52.569599+0000","last_active":"2024-04-26T20:58:10.651801+0000","last_peered":"2024-04-26T20:58:10.651801+0000","last_clean":"2024-04-26T20:58:10.651801+0000","last_became_active":"2024-04-26T20:57:52.569345+0000","last_became_peered":"2024-04-26T20:57:52.569345+0000","last_unstale":"2024-04-26T20:58:10.651801+0000","last_undegraded":"2024-04-26T20:58:10.651801+0000","last_fullsized":"2024-04-26T20:58:10.651801+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:31:38.044176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"41'11","reported_seq":38,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.651569+0000","last_change":"2024-04-26T20:57:52.592270+0000","last_active":"2024-04-26T20:58:10.651569+0000","last_peered":"2024-04-26T20:58:10.651569+0000","last_clean":"2024-04-26T20:58:10.651569+0000","last_became_active":"2024-04-26T20:57:52.591984+0000","last_became_peered":"2024-04-26T20:57:52.591984+0000","last_unstale":"2024-04-26T20:58:10.651569+0000","last_undegraded":"2024-04-26T20:58:10.651569+0000","last_fullsized":"2024-04-26T20:58:10.651569+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:16:22.565146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"41'9","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.651342+0000","last_change":"2024-04-26T20:57:52.576852+0000","last_active":"2024-04-26T20:58:10.651342+0000","last_peered":"2024-04-26T20:58:10.651342+0000","last_clean":"2024-04-26T20:58:10.651342+0000","last_became_active":"2024-04-26T20:57:52.575571+0000","last_became_peered":"2024-04-26T20:57:52.575571+0000","last_unstale":"2024-04-26T20:58:10.651342+0000","last_undegraded":"2024-04-26T20:58:10.651342+0000","last_fullsized":"2024-04-26T20:58:10.651342+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:45.313671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"41'8","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.652443+0000","last_change":"2024-04-26T20:57:52.586306+0000","last_active":"2024-04-26T20:58:10.652443+0000","last_peered":"2024-04-26T20:58:10.652443+0000","last_clean":"2024-04-26T20:58:10.652443+0000","last_became_active":"2024-04-26T20:57:52.585992+0000","last_became_peered":"2024-04-26T20:57:52.585992+0000","last_unstale":"2024-04-26T20:58:10.652443+0000","last_undegraded":"2024-04-26T20:58:10.652443+0000","last_fullsized":"2024-04-26T20:58:10.652443+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:30:40.828807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"41'6","reported_seq":33,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.697504+0000","last_change":"2024-04-26T20:57:52.584019+0000","last_active":"2024-04-26T20:58:12.697504+0000","last_peered":"2024-04-26T20:58:12.697504+0000","last_clean":"2024-04-26T20:58:12.697504+0000","last_became_active":"2024-04-26T20:57:52.583140+0000","last_became_peered":"2024-04-26T20:57:52.583140+0000","last_unstale":"2024-04-26T20:58:12.697504+0000","last_undegraded":"2024-04-26T20:58:12.697504+0000","last_fullsized":"2024-04-26T20:58:12.697504+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:03:50.493429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"41'2","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.654410+0000","last_change":"2024-04-26T20:57:52.579168+0000","last_active":"2024-04-26T20:58:10.654410+0000","last_peered":"2024-04-26T20:58:10.654410+0000","last_clean":"2024-04-26T20:58:10.654410+0000","last_became_active":"2024-04-26T20:57:52.578943+0000","last_became_peered":"2024-04-26T20:57:52.578943+0000","last_unstale":"2024-04-26T20:58:10.654410+0000","last_undegraded":"2024-04-26T20:58:10.654410+0000","last_fullsized":"2024-04-26T20:58:10.654410+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:55.128152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"41'15","reported_seq":42,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.697957+0000","last_change":"2024-04-26T20:57:52.585325+0000","last_active":"2024-04-26T20:58:12.697957+0000","last_peered":"2024-04-26T20:58:12.697957+0000","last_clean":"2024-04-26T20:58:12.697957+0000","last_became_active":"2024-04-26T20:57:52.585083+0000","last_became_peered":"2024-04-26T20:57:52.585083+0000","last_unstale":"2024-04-26T20:58:12.697957+0000","last_undegraded":"2024-04-26T20:58:12.697957+0000","last_fullsized":"2024-04-26T20:58:12.697957+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:33.562017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"41'6","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.652239+0000","last_change":"2024-04-26T20:57:52.578861+0000","last_active":"2024-04-26T20:58:10.652239+0000","last_peered":"2024-04-26T20:58:10.652239+0000","last_clean":"2024-04-26T20:58:10.652239+0000","last_became_active":"2024-04-26T20:57:52.578454+0000","last_became_peered":"2024-04-26T20:57:52.578454+0000","last_unstale":"2024-04-26T20:58:10.652239+0000","last_undegraded":"2024-04-26T20:58:10.652239+0000","last_fullsized":"2024-04-26T20:58:10.652239+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:36:12.618358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"41'4","reported_seq":28,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.648653+0000","last_change":"2024-04-26T20:57:52.577688+0000","last_active":"2024-04-26T20:58:10.648653+0000","last_peered":"2024-04-26T20:58:10.648653+0000","last_clean":"2024-04-26T20:58:10.648653+0000","last_became_active":"2024-04-26T20:57:52.577426+0000","last_became_peered":"2024-04-26T20:57:52.577426+0000","last_unstale":"2024-04-26T20:58:10.648653+0000","last_undegraded":"2024-04-26T20:58:10.648653+0000","last_fullsized":"2024-04-26T20:58:10.648653+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:16.143937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"41'7","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.652633+0000","last_change":"2024-04-26T20:57:52.583932+0000","last_active":"2024-04-26T20:58:10.652633+0000","last_peered":"2024-04-26T20:58:10.652633+0000","last_clean":"2024-04-26T20:58:10.652633+0000","last_became_active":"2024-04-26T20:57:52.583671+0000","last_became_peered":"2024-04-26T20:57:52.583671+0000","last_unstale":"2024-04-26T20:58:10.652633+0000","last_undegraded":"2024-04-26T20:58:10.652633+0000","last_fullsized":"2024-04-26T20:58:10.652633+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:17:49.866989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"41'8","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.652722+0000","last_change":"2024-04-26T20:57:52.569868+0000","last_active":"2024-04-26T20:58:10.652722+0000","last_peered":"2024-04-26T20:58:10.652722+0000","last_clean":"2024-04-26T20:58:10.652722+0000","last_became_active":"2024-04-26T20:57:52.569591+0000","last_became_peered":"2024-04-26T20:57:52.569591+0000","last_unstale":"2024-04-26T20:58:10.652722+0000","last_undegraded":"2024-04-26T20:58:10.652722+0000","last_fullsized":"2024-04-26T20:58:10.652722+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:16.617166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"41'12","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.648340+0000","last_change":"2024-04-26T20:57:52.581841+0000","last_active":"2024-04-26T20:58:10.648340+0000","last_peered":"2024-04-26T20:58:10.648340+0000","last_clean":"2024-04-26T20:58:10.648340+0000","last_became_active":"2024-04-26T20:57:52.581591+0000","last_became_peered":"2024-04-26T20:57:52.581591+0000","last_unstale":"2024-04-26T20:58:10.648340+0000","last_undegraded":"2024-04-26T20:58:10.648340+0000","last_fullsized":"2024-04-26T20:58:10.648340+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:37:58.253968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"41'9","reported_seq":36,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.697598+0000","last_change":"2024-04-26T20:57:52.583636+0000","last_active":"2024-04-26T20:58:12.697598+0000","last_peered":"2024-04-26T20:58:12.697598+0000","last_clean":"2024-04-26T20:58:12.697598+0000","last_became_active":"2024-04-26T20:57:52.582497+0000","last_became_peered":"2024-04-26T20:57:52.582497+0000","last_unstale":"2024-04-26T20:58:12.697598+0000","last_undegraded":"2024-04-26T20:58:12.697598+0000","last_fullsized":"2024-04-26T20:58:12.697598+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:22:01.188628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.672853+0000","last_change":"2024-04-26T20:58:10.666436+0000","last_active":"2024-04-26T20:58:10.672853+0000","last_peered":"2024-04-26T20:58:10.672853+0000","last_clean":"2024-04-26T20:58:10.672853+0000","last_became_active":"2024-04-26T20:58:10.666048+0000","last_became_peered":"2024-04-26T20:58:10.666048+0000","last_unstale":"2024-04-26T20:58:10.672853+0000","last_undegraded":"2024-04-26T20:58:10.672853+0000","last_fullsized":"2024-04-26T20:58:10.672853+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:47:28.530714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"41'9","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.653238+0000","last_change":"2024-04-26T20:57:52.569273+0000","last_active":"2024-04-26T20:58:10.653238+0000","last_peered":"2024-04-26T20:58:10.653238+0000","last_clean":"2024-04-26T20:58:10.653238+0000","last_became_active":"2024-04-26T20:57:52.568195+0000","last_became_peered":"2024-04-26T20:57:52.568195+0000","last_unstale":"2024-04-26T20:58:10.653238+0000","last_undegraded":"2024-04-26T20:58:10.653238+0000","last_fullsized":"2024-04-26T20:58:10.653238+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:05:37.693355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"42'8","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.654475+0000","last_change":"2024-04-26T20:57:51.572743+0000","last_active":"2024-04-26T20:58:10.654475+0000","last_peered":"2024-04-26T20:58:10.654475+0000","last_clean":"2024-04-26T20:58:10.654475+0000","last_became_active":"2024-04-26T20:57:51.572350+0000","last_became_peered":"2024-04-26T20:57:51.572350+0000","last_unstale":"2024-04-26T20:58:10.654475+0000","last_undegraded":"2024-04-26T20:58:10.654475+0000","last_fullsized":"2024-04-26T20:58:10.654475+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:50:32.238625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.668622+0000","last_change":"2024-04-26T20:58:10.667265+0000","last_active":"2024-04-26T20:58:10.668622+0000","last_peered":"2024-04-26T20:58:10.668622+0000","last_clean":"2024-04-26T20:58:10.668622+0000","last_became_active":"2024-04-26T20:58:10.667057+0000","last_became_peered":"2024-04-26T20:58:10.667057+0000","last_unstale":"2024-04-26T20:58:10.668622+0000","last_undegraded":"2024-04-26T20:58:10.668622+0000","last_fullsized":"2024-04-26T20:58:10.668622+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:44.950848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"41'15","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.657903+0000","last_change":"2024-04-26T20:57:52.587288+0000","last_active":"2024-04-26T20:58:10.657903+0000","last_peered":"2024-04-26T20:58:10.657903+0000","last_clean":"2024-04-26T20:58:10.657903+0000","last_became_active":"2024-04-26T20:57:52.586875+0000","last_became_peered":"2024-04-26T20:57:52.586875+0000","last_unstale":"2024-04-26T20:58:10.657903+0000","last_undegraded":"2024-04-26T20:58:10.657903+0000","last_fullsized":"2024-04-26T20:58:10.657903+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:44:03.294510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":27,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.658255+0000","last_change":"2024-04-26T20:57:51.566643+0000","last_active":"2024-04-26T20:58:10.658255+0000","last_peered":"2024-04-26T20:58:10.658255+0000","last_clean":"2024-04-26T20:58:10.658255+0000","last_became_active":"2024-04-26T20:57:51.566309+0000","last_became_peered":"2024-04-26T20:57:51.566309+0000","last_unstale":"2024-04-26T20:58:10.658255+0000","last_undegraded":"2024-04-26T20:58:10.658255+0000","last_fullsized":"2024-04-26T20:58:10.658255+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:50:32.238625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.671298+0000","last_change":"2024-04-26T20:58:10.669263+0000","last_active":"2024-04-26T20:58:10.671298+0000","last_peered":"2024-04-26T20:58:10.671298+0000","last_clean":"2024-04-26T20:58:10.671298+0000","last_became_active":"2024-04-26T20:58:10.668918+0000","last_became_peered":"2024-04-26T20:58:10.668918+0000","last_unstale":"2024-04-26T20:58:10.671298+0000","last_undegraded":"2024-04-26T20:58:10.671298+0000","last_fullsized":"2024-04-26T20:58:10.671298+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:19:35.479464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"41'5","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.653575+0000","last_change":"2024-04-26T20:57:52.566380+0000","last_active":"2024-04-26T20:58:10.653575+0000","last_peered":"2024-04-26T20:58:10.653575+0000","last_clean":"2024-04-26T20:58:10.653575+0000","last_became_active":"2024-04-26T20:57:52.566143+0000","last_became_peered":"2024-04-26T20:57:52.566143+0000","last_unstale":"2024-04-26T20:58:10.653575+0000","last_undegraded":"2024-04-26T20:58:10.653575+0000","last_fullsized":"2024-04-26T20:58:10.653575+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:49:48.199988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"42'3","reported_seq":31,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.698273+0000","last_change":"2024-04-26T20:57:51.573664+0000","last_active":"2024-04-26T20:58:12.698273+0000","last_peered":"2024-04-26T20:58:12.698273+0000","last_clean":"2024-04-26T20:58:12.698273+0000","last_became_active":"2024-04-26T20:57:51.572927+0000","last_became_peered":"2024-04-26T20:57:51.572927+0000","last_unstale":"2024-04-26T20:58:12.698273+0000","last_undegraded":"2024-04-26T20:58:12.698273+0000","last_fullsized":"2024-04-26T20:58:12.698273+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:04:55.596385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.678783+0000","last_change":"2024-04-26T20:58:10.676452+0000","last_active":"2024-04-26T20:58:10.678783+0000","last_peered":"2024-04-26T20:58:10.678783+0000","last_clean":"2024-04-26T20:58:10.678783+0000","last_became_active":"2024-04-26T20:58:10.676145+0000","last_became_peered":"2024-04-26T20:58:10.676145+0000","last_unstale":"2024-04-26T20:58:10.678783+0000","last_undegraded":"2024-04-26T20:58:10.678783+0000","last_fullsized":"2024-04-26T20:58:10.678783+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:54:11.593416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"41'6","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.658964+0000","last_change":"2024-04-26T20:57:52.585801+0000","last_active":"2024-04-26T20:58:10.658964+0000","last_peered":"2024-04-26T20:58:10.658964+0000","last_clean":"2024-04-26T20:58:10.658964+0000","last_became_active":"2024-04-26T20:57:52.584731+0000","last_became_peered":"2024-04-26T20:57:52.584731+0000","last_unstale":"2024-04-26T20:58:10.658964+0000","last_undegraded":"2024-04-26T20:58:10.658964+0000","last_fullsized":"2024-04-26T20:58:10.658964+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:39:52.141275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"42'3","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.654149+0000","last_change":"2024-04-26T20:57:51.574013+0000","last_active":"2024-04-26T20:58:10.654149+0000","last_peered":"2024-04-26T20:58:10.654149+0000","last_clean":"2024-04-26T20:58:10.654149+0000","last_became_active":"2024-04-26T20:57:51.573800+0000","last_became_peered":"2024-04-26T20:57:51.573800+0000","last_unstale":"2024-04-26T20:58:10.654149+0000","last_undegraded":"2024-04-26T20:58:10.654149+0000","last_fullsized":"2024-04-26T20:58:10.654149+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:43:07.969141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.666603+0000","last_change":"2024-04-26T20:58:10.665186+0000","last_active":"2024-04-26T20:58:10.666603+0000","last_peered":"2024-04-26T20:58:10.666603+0000","last_clean":"2024-04-26T20:58:10.666603+0000","last_became_active":"2024-04-26T20:58:10.664923+0000","last_became_peered":"2024-04-26T20:58:10.664923+0000","last_unstale":"2024-04-26T20:58:10.666603+0000","last_undegraded":"2024-04-26T20:58:10.666603+0000","last_fullsized":"2024-04-26T20:58:10.666603+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:14:23.512332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"41'8","reported_seq":35,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.697661+0000","last_change":"2024-04-26T20:57:52.587538+0000","last_active":"2024-04-26T20:58:12.697661+0000","last_peered":"2024-04-26T20:58:12.697661+0000","last_clean":"2024-04-26T20:58:12.697661+0000","last_became_active":"2024-04-26T20:57:52.587138+0000","last_became_peered":"2024-04-26T20:57:52.587138+0000","last_unstale":"2024-04-26T20:58:12.697661+0000","last_undegraded":"2024-04-26T20:58:12.697661+0000","last_fullsized":"2024-04-26T20:58:12.697661+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:08:03.271594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.654368+0000","last_change":"2024-04-26T20:57:51.570397+0000","last_active":"2024-04-26T20:58:10.654368+0000","last_peered":"2024-04-26T20:58:10.654368+0000","last_clean":"2024-04-26T20:58:10.654368+0000","last_became_active":"2024-04-26T20:57:51.570089+0000","last_became_peered":"2024-04-26T20:57:51.570089+0000","last_unstale":"2024-04-26T20:58:10.654368+0000","last_undegraded":"2024-04-26T20:58:10.654368+0000","last_fullsized":"2024-04-26T20:58:10.654368+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:55:41.720506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.698231+0000","last_change":"2024-04-26T20:58:10.663505+0000","last_active":"2024-04-26T20:58:12.698231+0000","last_peered":"2024-04-26T20:58:12.698231+0000","last_clean":"2024-04-26T20:58:12.698231+0000","last_became_active":"2024-04-26T20:58:10.663246+0000","last_became_peered":"2024-04-26T20:58:10.663246+0000","last_unstale":"2024-04-26T20:58:12.698231+0000","last_undegraded":"2024-04-26T20:58:12.698231+0000","last_fullsized":"2024-04-26T20:58:12.698231+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:46:36.439207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"41'10","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.651301+0000","last_change":"2024-04-26T20:57:52.585311+0000","last_active":"2024-04-26T20:58:10.651301+0000","last_peered":"2024-04-26T20:58:10.651301+0000","last_clean":"2024-04-26T20:58:10.651301+0000","last_became_active":"2024-04-26T20:57:52.585061+0000","last_became_peered":"2024-04-26T20:57:52.585061+0000","last_unstale":"2024-04-26T20:58:10.651301+0000","last_undegraded":"2024-04-26T20:58:10.651301+0000","last_fullsized":"2024-04-26T20:58:10.651301+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:18.275862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":26,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.649645+0000","last_change":"2024-04-26T20:57:51.571733+0000","last_active":"2024-04-26T20:58:10.649645+0000","last_peered":"2024-04-26T20:58:10.649645+0000","last_clean":"2024-04-26T20:58:10.649645+0000","last_became_active":"2024-04-26T20:57:51.571446+0000","last_became_peered":"2024-04-26T20:57:51.571446+0000","last_unstale":"2024-04-26T20:58:10.649645+0000","last_undegraded":"2024-04-26T20:58:10.649645+0000","last_fullsized":"2024-04-26T20:58:10.649645+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:07.815468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.697711+0000","last_change":"2024-04-26T20:58:10.672922+0000","last_active":"2024-04-26T20:58:12.697711+0000","last_peered":"2024-04-26T20:58:12.697711+0000","last_clean":"2024-04-26T20:58:12.697711+0000","last_became_active":"2024-04-26T20:58:10.672653+0000","last_became_peered":"2024-04-26T20:58:10.672653+0000","last_unstale":"2024-04-26T20:58:12.697711+0000","last_undegraded":"2024-04-26T20:58:12.697711+0000","last_fullsized":"2024-04-26T20:58:12.697711+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:57:09.025364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"41'7","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.652878+0000","last_change":"2024-04-26T20:57:52.570641+0000","last_active":"2024-04-26T20:58:10.652878+0000","last_peered":"2024-04-26T20:58:10.652878+0000","last_clean":"2024-04-26T20:58:10.652878+0000","last_became_active":"2024-04-26T20:57:52.570421+0000","last_became_peered":"2024-04-26T20:57:52.570421+0000","last_unstale":"2024-04-26T20:58:10.652878+0000","last_undegraded":"2024-04-26T20:58:10.652878+0000","last_fullsized":"2024-04-26T20:58:10.652878+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:27.330795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":28,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.697515+0000","last_change":"2024-04-26T20:57:51.574572+0000","last_active":"2024-04-26T20:58:12.697515+0000","last_peered":"2024-04-26T20:58:12.697515+0000","last_clean":"2024-04-26T20:58:12.697515+0000","last_became_active":"2024-04-26T20:57:51.574213+0000","last_became_peered":"2024-04-26T20:57:51.574213+0000","last_unstale":"2024-04-26T20:58:12.697515+0000","last_undegraded":"2024-04-26T20:58:12.697515+0000","last_fullsized":"2024-04-26T20:58:12.697515+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:10:26.507698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.659841+0000","last_change":"2024-04-26T20:58:10.657768+0000","last_active":"2024-04-26T20:58:10.659841+0000","last_peered":"2024-04-26T20:58:10.659841+0000","last_clean":"2024-04-26T20:58:10.659841+0000","last_became_active":"2024-04-26T20:58:10.657396+0000","last_became_peered":"2024-04-26T20:58:10.657396+0000","last_unstale":"2024-04-26T20:58:10.659841+0000","last_undegraded":"2024-04-26T20:58:10.659841+0000","last_fullsized":"2024-04-26T20:58:10.659841+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:43:54.225992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"41'8","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.660451+0000","last_change":"2024-04-26T20:57:52.586106+0000","last_active":"2024-04-26T20:58:10.660451+0000","last_peered":"2024-04-26T20:58:10.660451+0000","last_clean":"2024-04-26T20:58:10.660451+0000","last_became_active":"2024-04-26T20:57:52.585860+0000","last_became_peered":"2024-04-26T20:57:52.585860+0000","last_unstale":"2024-04-26T20:58:10.660451+0000","last_undegraded":"2024-04-26T20:58:10.660451+0000","last_fullsized":"2024-04-26T20:58:10.660451+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:16:22.565146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":25,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.648327+0000","last_change":"2024-04-26T20:57:51.573590+0000","last_active":"2024-04-26T20:58:10.648327+0000","last_peered":"2024-04-26T20:58:10.648327+0000","last_clean":"2024-04-26T20:58:10.648327+0000","last_became_active":"2024-04-26T20:57:51.573293+0000","last_became_peered":"2024-04-26T20:57:51.573293+0000","last_unstale":"2024-04-26T20:58:10.648327+0000","last_undegraded":"2024-04-26T20:58:10.648327+0000","last_fullsized":"2024-04-26T20:58:10.648327+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:55:23.008549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.672085+0000","last_change":"2024-04-26T20:58:10.670768+0000","last_active":"2024-04-26T20:58:10.672085+0000","last_peered":"2024-04-26T20:58:10.672085+0000","last_clean":"2024-04-26T20:58:10.672085+0000","last_became_active":"2024-04-26T20:58:10.670520+0000","last_became_peered":"2024-04-26T20:58:10.670520+0000","last_unstale":"2024-04-26T20:58:10.672085+0000","last_undegraded":"2024-04-26T20:58:10.672085+0000","last_fullsized":"2024-04-26T20:58:10.672085+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:52:06.081700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"41'11","reported_seq":38,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.698271+0000","last_change":"2024-04-26T20:57:52.575008+0000","last_active":"2024-04-26T20:58:12.698271+0000","last_peered":"2024-04-26T20:58:12.698271+0000","last_clean":"2024-04-26T20:58:12.698271+0000","last_became_active":"2024-04-26T20:57:52.574553+0000","last_became_peered":"2024-04-26T20:57:52.574553+0000","last_unstale":"2024-04-26T20:58:12.698271+0000","last_undegraded":"2024-04-26T20:58:12.698271+0000","last_fullsized":"2024-04-26T20:58:12.698271+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:42.746367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":28,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.698347+0000","last_change":"2024-04-26T20:57:51.576675+0000","last_active":"2024-04-26T20:58:12.698347+0000","last_peered":"2024-04-26T20:58:12.698347+0000","last_clean":"2024-04-26T20:58:12.698347+0000","last_became_active":"2024-04-26T20:57:51.576394+0000","last_became_peered":"2024-04-26T20:57:51.576394+0000","last_unstale":"2024-04-26T20:58:12.698347+0000","last_undegraded":"2024-04-26T20:58:12.698347+0000","last_fullsized":"2024-04-26T20:58:12.698347+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:44:14.717022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.674082+0000","last_change":"2024-04-26T20:58:10.671102+0000","last_active":"2024-04-26T20:58:10.674082+0000","last_peered":"2024-04-26T20:58:10.674082+0000","last_clean":"2024-04-26T20:58:10.674082+0000","last_became_active":"2024-04-26T20:58:10.670829+0000","last_became_peered":"2024-04-26T20:58:10.670829+0000","last_unstale":"2024-04-26T20:58:10.674082+0000","last_undegraded":"2024-04-26T20:58:10.674082+0000","last_fullsized":"2024-04-26T20:58:10.674082+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:16:40.659077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"41'6","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.654015+0000","last_change":"2024-04-26T20:57:52.576139+0000","last_active":"2024-04-26T20:58:10.654015+0000","last_peered":"2024-04-26T20:58:10.654015+0000","last_clean":"2024-04-26T20:58:10.654015+0000","last_became_active":"2024-04-26T20:57:52.575825+0000","last_became_peered":"2024-04-26T20:57:52.575825+0000","last_unstale":"2024-04-26T20:58:10.654015+0000","last_undegraded":"2024-04-26T20:58:10.654015+0000","last_fullsized":"2024-04-26T20:58:10.654015+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:37:58.253968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":27,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.653435+0000","last_change":"2024-04-26T20:57:51.566363+0000","last_active":"2024-04-26T20:58:10.653435+0000","last_peered":"2024-04-26T20:58:10.653435+0000","last_clean":"2024-04-26T20:58:10.653435+0000","last_became_active":"2024-04-26T20:57:51.566020+0000","last_became_peered":"2024-04-26T20:57:51.566020+0000","last_unstale":"2024-04-26T20:58:10.653435+0000","last_undegraded":"2024-04-26T20:58:10.653435+0000","last_fullsized":"2024-04-26T20:58:10.653435+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:51:59.832838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.658001+0000","last_change":"2024-04-26T20:58:10.656874+0000","last_active":"2024-04-26T20:58:10.658001+0000","last_peered":"2024-04-26T20:58:10.658001+0000","last_clean":"2024-04-26T20:58:10.658001+0000","last_became_active":"2024-04-26T20:58:10.656106+0000","last_became_peered":"2024-04-26T20:58:10.656106+0000","last_unstale":"2024-04-26T20:58:10.658001+0000","last_undegraded":"2024-04-26T20:58:10.658001+0000","last_fullsized":"2024-04-26T20:58:10.658001+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:54:11.593416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"41'10","reported_seq":37,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.698078+0000","last_change":"2024-04-26T20:57:52.593299+0000","last_active":"2024-04-26T20:58:12.698078+0000","last_peered":"2024-04-26T20:58:12.698078+0000","last_clean":"2024-04-26T20:58:12.698078+0000","last_became_active":"2024-04-26T20:57:52.591280+0000","last_became_peered":"2024-04-26T20:57:52.591280+0000","last_unstale":"2024-04-26T20:58:12.698078+0000","last_undegraded":"2024-04-26T20:58:12.698078+0000","last_fullsized":"2024-04-26T20:58:12.698078+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:25.750491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"42'5","reported_seq":32,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.653766+0000","last_change":"2024-04-26T20:57:51.569668+0000","last_active":"2024-04-26T20:58:10.653766+0000","last_peered":"2024-04-26T20:58:10.653766+0000","last_clean":"2024-04-26T20:58:10.653766+0000","last_became_active":"2024-04-26T20:57:51.569384+0000","last_became_peered":"2024-04-26T20:57:51.569384+0000","last_unstale":"2024-04-26T20:58:10.653766+0000","last_undegraded":"2024-04-26T20:58:10.653766+0000","last_fullsized":"2024-04-26T20:58:10.653766+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:49:18.242393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.669541+0000","last_change":"2024-04-26T20:58:10.668231+0000","last_active":"2024-04-26T20:58:10.669541+0000","last_peered":"2024-04-26T20:58:10.669541+0000","last_clean":"2024-04-26T20:58:10.669541+0000","last_became_active":"2024-04-26T20:58:10.668007+0000","last_became_peered":"2024-04-26T20:58:10.668007+0000","last_unstale":"2024-04-26T20:58:10.669541+0000","last_undegraded":"2024-04-26T20:58:10.669541+0000","last_fullsized":"2024-04-26T20:58:10.669541+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:10.473443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"41'9","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.649099+0000","last_change":"2024-04-26T20:57:52.577388+0000","last_active":"2024-04-26T20:58:10.649099+0000","last_peered":"2024-04-26T20:58:10.649099+0000","last_clean":"2024-04-26T20:58:10.649099+0000","last_became_active":"2024-04-26T20:57:52.577116+0000","last_became_peered":"2024-04-26T20:57:52.577116+0000","last_unstale":"2024-04-26T20:58:10.649099+0000","last_undegraded":"2024-04-26T20:58:10.649099+0000","last_fullsized":"2024-04-26T20:58:10.649099+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:26.856916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"42'23","reported_seq":51,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.698406+0000","last_change":"2024-04-26T20:57:51.574348+0000","last_active":"2024-04-26T20:58:12.698406+0000","last_peered":"2024-04-26T20:58:12.698406+0000","last_clean":"2024-04-26T20:58:12.698406+0000","last_became_active":"2024-04-26T20:57:51.574023+0000","last_became_peered":"2024-04-26T20:57:51.574023+0000","last_unstale":"2024-04-26T20:58:12.698406+0000","last_undegraded":"2024-04-26T20:58:12.698406+0000","last_fullsized":"2024-04-26T20:58:12.698406+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:29:31.014100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.659792+0000","last_change":"2024-04-26T20:58:10.657279+0000","last_active":"2024-04-26T20:58:10.659792+0000","last_peered":"2024-04-26T20:58:10.659792+0000","last_clean":"2024-04-26T20:58:10.659792+0000","last_became_active":"2024-04-26T20:58:10.656680+0000","last_became_peered":"2024-04-26T20:58:10.656680+0000","last_unstale":"2024-04-26T20:58:10.659792+0000","last_undegraded":"2024-04-26T20:58:10.659792+0000","last_fullsized":"2024-04-26T20:58:10.659792+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:31.277054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"41'6","reported_seq":33,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.697875+0000","last_change":"2024-04-26T20:57:52.583405+0000","last_active":"2024-04-26T20:58:12.697875+0000","last_peered":"2024-04-26T20:58:12.697875+0000","last_clean":"2024-04-26T20:58:12.697875+0000","last_became_active":"2024-04-26T20:57:52.582257+0000","last_became_peered":"2024-04-26T20:57:52.582257+0000","last_unstale":"2024-04-26T20:58:12.697875+0000","last_undegraded":"2024-04-26T20:58:12.697875+0000","last_fullsized":"2024-04-26T20:58:12.697875+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:15:21.765705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"42'5","reported_seq":33,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.697820+0000","last_change":"2024-04-26T20:57:51.572541+0000","last_active":"2024-04-26T20:58:12.697820+0000","last_peered":"2024-04-26T20:58:12.697820+0000","last_clean":"2024-04-26T20:58:12.697820+0000","last_became_active":"2024-04-26T20:57:51.571967+0000","last_became_peered":"2024-04-26T20:57:51.571967+0000","last_unstale":"2024-04-26T20:58:12.697820+0000","last_undegraded":"2024-04-26T20:58:12.697820+0000","last_fullsized":"2024-04-26T20:58:12.697820+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:11:04.894675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.675770+0000","last_change":"2024-04-26T20:58:10.671439+0000","last_active":"2024-04-26T20:58:10.675770+0000","last_peered":"2024-04-26T20:58:10.675770+0000","last_clean":"2024-04-26T20:58:10.675770+0000","last_became_active":"2024-04-26T20:58:10.671079+0000","last_became_peered":"2024-04-26T20:58:10.671079+0000","last_unstale":"2024-04-26T20:58:10.675770+0000","last_undegraded":"2024-04-26T20:58:10.675770+0000","last_fullsized":"2024-04-26T20:58:10.675770+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:28:38.251611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"41'6","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.658248+0000","last_change":"2024-04-26T20:57:52.581005+0000","last_active":"2024-04-26T20:58:10.658248+0000","last_peered":"2024-04-26T20:58:10.658248+0000","last_clean":"2024-04-26T20:58:10.658248+0000","last_became_active":"2024-04-26T20:57:52.580685+0000","last_became_peered":"2024-04-26T20:57:52.580685+0000","last_unstale":"2024-04-26T20:58:10.658248+0000","last_undegraded":"2024-04-26T20:58:10.658248+0000","last_fullsized":"2024-04-26T20:58:10.658248+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:18.275862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":26,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.657736+0000","last_change":"2024-04-26T20:57:51.571181+0000","last_active":"2024-04-26T20:58:10.657736+0000","last_peered":"2024-04-26T20:58:10.657736+0000","last_clean":"2024-04-26T20:58:10.657736+0000","last_became_active":"2024-04-26T20:57:51.570305+0000","last_became_peered":"2024-04-26T20:57:51.570305+0000","last_unstale":"2024-04-26T20:58:10.657736+0000","last_undegraded":"2024-04-26T20:58:10.657736+0000","last_fullsized":"2024-04-26T20:58:10.657736+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:43:07.969141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.675913+0000","last_change":"2024-04-26T20:58:10.671520+0000","last_active":"2024-04-26T20:58:10.675913+0000","last_peered":"2024-04-26T20:58:10.675913+0000","last_clean":"2024-04-26T20:58:10.675913+0000","last_became_active":"2024-04-26T20:58:10.671157+0000","last_became_peered":"2024-04-26T20:58:10.671157+0000","last_unstale":"2024-04-26T20:58:10.675913+0000","last_undegraded":"2024-04-26T20:58:10.675913+0000","last_fullsized":"2024-04-26T20:58:10.675913+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:44.950848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"41'10","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.651790+0000","last_change":"2024-04-26T20:57:52.584791+0000","last_active":"2024-04-26T20:58:10.651790+0000","last_peered":"2024-04-26T20:58:10.651790+0000","last_clean":"2024-04-26T20:58:10.651790+0000","last_became_active":"2024-04-26T20:57:52.575922+0000","last_became_peered":"2024-04-26T20:57:52.575922+0000","last_unstale":"2024-04-26T20:58:10.651790+0000","last_undegraded":"2024-04-26T20:58:10.651790+0000","last_fullsized":"2024-04-26T20:58:10.651790+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:50:20.927595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":27,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.652641+0000","last_change":"2024-04-26T20:57:51.563498+0000","last_active":"2024-04-26T20:58:10.652641+0000","last_peered":"2024-04-26T20:58:10.652641+0000","last_clean":"2024-04-26T20:58:10.652641+0000","last_became_active":"2024-04-26T20:57:51.563243+0000","last_became_peered":"2024-04-26T20:57:51.563243+0000","last_unstale":"2024-04-26T20:58:10.652641+0000","last_undegraded":"2024-04-26T20:58:10.652641+0000","last_fullsized":"2024-04-26T20:58:10.652641+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:47:09.428746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.668897+0000","last_change":"2024-04-26T20:58:10.665998+0000","last_active":"2024-04-26T20:58:10.668897+0000","last_peered":"2024-04-26T20:58:10.668897+0000","last_clean":"2024-04-26T20:58:10.668897+0000","last_became_active":"2024-04-26T20:58:10.665637+0000","last_became_peered":"2024-04-26T20:58:10.665637+0000","last_unstale":"2024-04-26T20:58:10.668897+0000","last_undegraded":"2024-04-26T20:58:10.668897+0000","last_fullsized":"2024-04-26T20:58:10.668897+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:02.739631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"41'15","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.660521+0000","last_change":"2024-04-26T20:57:52.584930+0000","last_active":"2024-04-26T20:58:10.660521+0000","last_peered":"2024-04-26T20:58:10.660521+0000","last_clean":"2024-04-26T20:58:10.660521+0000","last_became_active":"2024-04-26T20:57:52.584641+0000","last_became_peered":"2024-04-26T20:57:52.584641+0000","last_unstale":"2024-04-26T20:58:10.660521+0000","last_undegraded":"2024-04-26T20:58:10.660521+0000","last_fullsized":"2024-04-26T20:58:10.660521+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:37:58.253968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"42'15","reported_seq":43,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.653626+0000","last_change":"2024-04-26T20:57:51.567931+0000","last_active":"2024-04-26T20:58:10.653626+0000","last_peered":"2024-04-26T20:58:10.653626+0000","last_clean":"2024-04-26T20:58:10.653626+0000","last_became_active":"2024-04-26T20:57:51.567552+0000","last_became_peered":"2024-04-26T20:57:51.567552+0000","last_unstale":"2024-04-26T20:58:10.653626+0000","last_undegraded":"2024-04-26T20:58:10.653626+0000","last_fullsized":"2024-04-26T20:58:10.653626+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:32.553314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.664571+0000","last_change":"2024-04-26T20:58:10.663370+0000","last_active":"2024-04-26T20:58:10.664571+0000","last_peered":"2024-04-26T20:58:10.664571+0000","last_clean":"2024-04-26T20:58:10.664571+0000","last_became_active":"2024-04-26T20:58:10.663079+0000","last_became_peered":"2024-04-26T20:58:10.663079+0000","last_unstale":"2024-04-26T20:58:10.664571+0000","last_undegraded":"2024-04-26T20:58:10.664571+0000","last_fullsized":"2024-04-26T20:58:10.664571+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:43:59.225293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"41'6","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.657455+0000","last_change":"2024-04-26T20:57:52.581758+0000","last_active":"2024-04-26T20:58:10.657455+0000","last_peered":"2024-04-26T20:58:10.657455+0000","last_clean":"2024-04-26T20:58:10.657455+0000","last_became_active":"2024-04-26T20:57:52.581085+0000","last_became_peered":"2024-04-26T20:57:52.581085+0000","last_unstale":"2024-04-26T20:58:10.657455+0000","last_undegraded":"2024-04-26T20:58:10.657455+0000","last_fullsized":"2024-04-26T20:58:10.657455+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:49:19.250429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"42'2","reported_seq":27,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.649194+0000","last_change":"2024-04-26T20:57:51.575710+0000","last_active":"2024-04-26T20:58:10.649194+0000","last_peered":"2024-04-26T20:58:10.649194+0000","last_clean":"2024-04-26T20:58:10.649194+0000","last_became_active":"2024-04-26T20:57:51.575446+0000","last_became_peered":"2024-04-26T20:57:51.575446+0000","last_unstale":"2024-04-26T20:58:10.649194+0000","last_undegraded":"2024-04-26T20:58:10.649194+0000","last_fullsized":"2024-04-26T20:58:10.649194+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:05.463288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.672682+0000","last_change":"2024-04-26T20:58:10.670833+0000","last_active":"2024-04-26T20:58:10.672682+0000","last_peered":"2024-04-26T20:58:10.672682+0000","last_clean":"2024-04-26T20:58:10.672682+0000","last_became_active":"2024-04-26T20:58:10.670522+0000","last_became_peered":"2024-04-26T20:58:10.670522+0000","last_unstale":"2024-04-26T20:58:10.672682+0000","last_undegraded":"2024-04-26T20:58:10.672682+0000","last_fullsized":"2024-04-26T20:58:10.672682+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:06:19.339683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"41'7","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.648935+0000","last_change":"2024-04-26T20:57:52.585080+0000","last_active":"2024-04-26T20:58:10.648935+0000","last_peered":"2024-04-26T20:58:10.648935+0000","last_clean":"2024-04-26T20:58:10.648935+0000","last_became_active":"2024-04-26T20:57:52.584794+0000","last_became_peered":"2024-04-26T20:57:52.584794+0000","last_unstale":"2024-04-26T20:58:10.648935+0000","last_undegraded":"2024-04-26T20:58:10.648935+0000","last_fullsized":"2024-04-26T20:58:10.648935+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:13.183123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"42'3","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.653661+0000","last_change":"2024-04-26T20:57:51.569389+0000","last_active":"2024-04-26T20:58:10.653661+0000","last_peered":"2024-04-26T20:58:10.653661+0000","last_clean":"2024-04-26T20:58:10.653661+0000","last_became_active":"2024-04-26T20:57:51.569128+0000","last_became_peered":"2024-04-26T20:57:51.569128+0000","last_unstale":"2024-04-26T20:58:10.653661+0000","last_undegraded":"2024-04-26T20:58:10.653661+0000","last_fullsized":"2024-04-26T20:58:10.653661+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:44.305635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.678143+0000","last_change":"2024-04-26T20:58:10.673866+0000","last_active":"2024-04-26T20:58:10.678143+0000","last_peered":"2024-04-26T20:58:10.678143+0000","last_clean":"2024-04-26T20:58:10.678143+0000","last_became_active":"2024-04-26T20:58:10.673565+0000","last_became_peered":"2024-04-26T20:58:10.673565+0000","last_unstale":"2024-04-26T20:58:10.678143+0000","last_undegraded":"2024-04-26T20:58:10.678143+0000","last_fullsized":"2024-04-26T20:58:10.678143+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:12:23.450727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"41'5","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.649298+0000","last_change":"2024-04-26T20:57:52.580234+0000","last_active":"2024-04-26T20:58:10.649298+0000","last_peered":"2024-04-26T20:58:10.649298+0000","last_clean":"2024-04-26T20:58:10.649298+0000","last_became_active":"2024-04-26T20:57:52.579929+0000","last_became_peered":"2024-04-26T20:57:52.579929+0000","last_unstale":"2024-04-26T20:58:10.649298+0000","last_undegraded":"2024-04-26T20:58:10.649298+0000","last_fullsized":"2024-04-26T20:58:10.649298+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:06:01.245752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"42'2","reported_seq":28,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.661236+0000","last_change":"2024-04-26T20:57:51.577610+0000","last_active":"2024-04-26T20:58:10.661236+0000","last_peered":"2024-04-26T20:58:10.661236+0000","last_clean":"2024-04-26T20:58:10.661236+0000","last_became_active":"2024-04-26T20:57:51.577352+0000","last_became_peered":"2024-04-26T20:57:51.577352+0000","last_unstale":"2024-04-26T20:58:10.661236+0000","last_undegraded":"2024-04-26T20:58:10.661236+0000","last_fullsized":"2024-04-26T20:58:10.661236+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:05:01.247112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.675950+0000","last_change":"2024-04-26T20:58:10.672457+0000","last_active":"2024-04-26T20:58:10.675950+0000","last_peered":"2024-04-26T20:58:10.675950+0000","last_clean":"2024-04-26T20:58:10.675950+0000","last_became_active":"2024-04-26T20:58:10.671871+0000","last_became_peered":"2024-04-26T20:58:10.671871+0000","last_unstale":"2024-04-26T20:58:10.675950+0000","last_undegraded":"2024-04-26T20:58:10.675950+0000","last_fullsized":"2024-04-26T20:58:10.675950+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:06:19.339683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"41'9","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.666797+0000","last_change":"2024-04-26T20:57:52.593107+0000","last_active":"2024-04-26T20:58:10.666797+0000","last_peered":"2024-04-26T20:58:10.666797+0000","last_clean":"2024-04-26T20:58:10.666797+0000","last_became_active":"2024-04-26T20:57:52.592849+0000","last_became_peered":"2024-04-26T20:57:52.592849+0000","last_unstale":"2024-04-26T20:58:10.666797+0000","last_undegraded":"2024-04-26T20:58:10.666797+0000","last_fullsized":"2024-04-26T20:58:10.666797+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:18.275862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":25,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.663053+0000","last_change":"2024-04-26T20:57:51.573218+0000","last_active":"2024-04-26T20:58:10.663053+0000","last_peered":"2024-04-26T20:58:10.663053+0000","last_clean":"2024-04-26T20:58:10.663053+0000","last_became_active":"2024-04-26T20:57:51.572070+0000","last_became_peered":"2024-04-26T20:57:51.572070+0000","last_unstale":"2024-04-26T20:58:10.663053+0000","last_undegraded":"2024-04-26T20:58:10.663053+0000","last_fullsized":"2024-04-26T20:58:10.663053+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:43.209710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.673771+0000","last_change":"2024-04-26T20:58:10.669638+0000","last_active":"2024-04-26T20:58:10.673771+0000","last_peered":"2024-04-26T20:58:10.673771+0000","last_clean":"2024-04-26T20:58:10.673771+0000","last_became_active":"2024-04-26T20:58:10.669290+0000","last_became_peered":"2024-04-26T20:58:10.669290+0000","last_unstale":"2024-04-26T20:58:10.673771+0000","last_undegraded":"2024-04-26T20:58:10.673771+0000","last_fullsized":"2024-04-26T20:58:10.673771+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:40:10.235206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"41'9","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.652124+0000","last_change":"2024-04-26T20:57:52.580620+0000","last_active":"2024-04-26T20:58:10.652124+0000","last_peered":"2024-04-26T20:58:10.652124+0000","last_clean":"2024-04-26T20:58:10.652124+0000","last_became_active":"2024-04-26T20:57:52.580262+0000","last_became_peered":"2024-04-26T20:57:52.580262+0000","last_unstale":"2024-04-26T20:58:10.652124+0000","last_undegraded":"2024-04-26T20:58:10.652124+0000","last_fullsized":"2024-04-26T20:58:10.652124+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:17:36.055479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"42'4","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.663095+0000","last_change":"2024-04-26T20:57:51.572477+0000","last_active":"2024-04-26T20:58:10.663095+0000","last_peered":"2024-04-26T20:58:10.663095+0000","last_clean":"2024-04-26T20:58:10.663095+0000","last_became_active":"2024-04-26T20:57:51.572200+0000","last_became_peered":"2024-04-26T20:57:51.572200+0000","last_unstale":"2024-04-26T20:58:10.663095+0000","last_undegraded":"2024-04-26T20:58:10.663095+0000","last_fullsized":"2024-04-26T20:58:10.663095+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:03:39.964597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.672417+0000","last_change":"2024-04-26T20:58:10.666288+0000","last_active":"2024-04-26T20:58:10.672417+0000","last_peered":"2024-04-26T20:58:10.672417+0000","last_clean":"2024-04-26T20:58:10.672417+0000","last_became_active":"2024-04-26T20:58:10.665961+0000","last_became_peered":"2024-04-26T20:58:10.665961+0000","last_unstale":"2024-04-26T20:58:10.672417+0000","last_undegraded":"2024-04-26T20:58:10.672417+0000","last_fullsized":"2024-04-26T20:58:10.672417+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:44:21.388441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"41'2","reported_seq":29,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.697429+0000","last_change":"2024-04-26T20:57:52.570952+0000","last_active":"2024-04-26T20:58:12.697429+0000","last_peered":"2024-04-26T20:58:12.697429+0000","last_clean":"2024-04-26T20:58:12.697429+0000","last_became_active":"2024-04-26T20:57:52.570601+0000","last_became_peered":"2024-04-26T20:57:52.570601+0000","last_unstale":"2024-04-26T20:58:12.697429+0000","last_undegraded":"2024-04-26T20:58:12.697429+0000","last_fullsized":"2024-04-26T20:58:12.697429+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:16:47.969442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":26,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.657844+0000","last_change":"2024-04-26T20:57:51.575051+0000","last_active":"2024-04-26T20:58:10.657844+0000","last_peered":"2024-04-26T20:58:10.657844+0000","last_clean":"2024-04-26T20:58:10.657844+0000","last_became_active":"2024-04-26T20:57:51.574755+0000","last_became_peered":"2024-04-26T20:57:51.574755+0000","last_unstale":"2024-04-26T20:58:10.657844+0000","last_undegraded":"2024-04-26T20:58:10.657844+0000","last_fullsized":"2024-04-26T20:58:10.657844+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:32.553314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.678816+0000","last_change":"2024-04-26T20:58:10.676156+0000","last_active":"2024-04-26T20:58:10.678816+0000","last_peered":"2024-04-26T20:58:10.678816+0000","last_clean":"2024-04-26T20:58:10.678816+0000","last_became_active":"2024-04-26T20:58:10.674594+0000","last_became_peered":"2024-04-26T20:58:10.674594+0000","last_unstale":"2024-04-26T20:58:10.678816+0000","last_undegraded":"2024-04-26T20:58:10.678816+0000","last_fullsized":"2024-04-26T20:58:10.678816+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:23.447610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"41'5","reported_seq":32,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.651508+0000","last_change":"2024-04-26T20:57:52.584567+0000","last_active":"2024-04-26T20:58:10.651508+0000","last_peered":"2024-04-26T20:58:10.651508+0000","last_clean":"2024-04-26T20:58:10.651508+0000","last_became_active":"2024-04-26T20:57:52.584136+0000","last_became_peered":"2024-04-26T20:57:52.584136+0000","last_unstale":"2024-04-26T20:58:10.651508+0000","last_undegraded":"2024-04-26T20:58:10.651508+0000","last_fullsized":"2024-04-26T20:58:10.651508+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:39:52.141275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":25,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.648436+0000","last_change":"2024-04-26T20:57:51.573894+0000","last_active":"2024-04-26T20:58:10.648436+0000","last_peered":"2024-04-26T20:58:10.648436+0000","last_clean":"2024-04-26T20:58:10.648436+0000","last_became_active":"2024-04-26T20:57:51.573467+0000","last_became_peered":"2024-04-26T20:57:51.573467+0000","last_unstale":"2024-04-26T20:58:10.648436+0000","last_undegraded":"2024-04-26T20:58:10.648436+0000","last_fullsized":"2024-04-26T20:58:10.648436+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:53.725346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.697637+0000","last_change":"2024-04-26T20:58:10.676542+0000","last_active":"2024-04-26T20:58:12.697637+0000","last_peered":"2024-04-26T20:58:12.697637+0000","last_clean":"2024-04-26T20:58:12.697637+0000","last_became_active":"2024-04-26T20:58:10.676296+0000","last_became_peered":"2024-04-26T20:58:10.676296+0000","last_unstale":"2024-04-26T20:58:12.697637+0000","last_undegraded":"2024-04-26T20:58:12.697637+0000","last_fullsized":"2024-04-26T20:58:12.697637+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:34:52.972239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"41'8","reported_seq":35,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.697627+0000","last_change":"2024-04-26T20:57:52.570583+0000","last_active":"2024-04-26T20:58:12.697627+0000","last_peered":"2024-04-26T20:58:12.697627+0000","last_clean":"2024-04-26T20:58:12.697627+0000","last_became_active":"2024-04-26T20:57:52.570303+0000","last_became_peered":"2024-04-26T20:57:52.570303+0000","last_unstale":"2024-04-26T20:58:12.697627+0000","last_undegraded":"2024-04-26T20:58:12.697627+0000","last_fullsized":"2024-04-26T20:58:12.697627+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:19:58.387596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":26,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.657330+0000","last_change":"2024-04-26T20:57:51.571920+0000","last_active":"2024-04-26T20:58:10.657330+0000","last_peered":"2024-04-26T20:58:10.657330+0000","last_clean":"2024-04-26T20:58:10.657330+0000","last_became_active":"2024-04-26T20:57:51.571644+0000","last_became_peered":"2024-04-26T20:57:51.571644+0000","last_unstale":"2024-04-26T20:58:10.657330+0000","last_undegraded":"2024-04-26T20:58:10.657330+0000","last_fullsized":"2024-04-26T20:58:10.657330+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:55:41.720506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.672105+0000","last_change":"2024-04-26T20:58:10.670799+0000","last_active":"2024-04-26T20:58:10.672105+0000","last_peered":"2024-04-26T20:58:10.672105+0000","last_clean":"2024-04-26T20:58:10.672105+0000","last_became_active":"2024-04-26T20:58:10.670514+0000","last_became_peered":"2024-04-26T20:58:10.670514+0000","last_unstale":"2024-04-26T20:58:10.672105+0000","last_undegraded":"2024-04-26T20:58:10.672105+0000","last_fullsized":"2024-04-26T20:58:10.672105+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:54:02.371720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"41'9","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.662414+0000","last_change":"2024-04-26T20:57:52.593531+0000","last_active":"2024-04-26T20:58:10.662414+0000","last_peered":"2024-04-26T20:58:10.662414+0000","last_clean":"2024-04-26T20:58:10.662414+0000","last_became_active":"2024-04-26T20:57:52.592602+0000","last_became_peered":"2024-04-26T20:57:52.592602+0000","last_unstale":"2024-04-26T20:58:10.662414+0000","last_undegraded":"2024-04-26T20:58:10.662414+0000","last_fullsized":"2024-04-26T20:58:10.662414+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:13.183123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"42'3","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.653774+0000","last_change":"2024-04-26T20:57:51.570771+0000","last_active":"2024-04-26T20:58:10.653774+0000","last_peered":"2024-04-26T20:58:10.653774+0000","last_clean":"2024-04-26T20:58:10.653774+0000","last_became_active":"2024-04-26T20:57:51.570488+0000","last_became_peered":"2024-04-26T20:57:51.570488+0000","last_unstale":"2024-04-26T20:58:10.653774+0000","last_undegraded":"2024-04-26T20:58:10.653774+0000","last_fullsized":"2024-04-26T20:58:10.653774+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:44:02.286474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.698056+0000","last_change":"2024-04-26T20:58:10.668969+0000","last_active":"2024-04-26T20:58:12.698056+0000","last_peered":"2024-04-26T20:58:12.698056+0000","last_clean":"2024-04-26T20:58:12.698056+0000","last_became_active":"2024-04-26T20:58:10.668649+0000","last_became_peered":"2024-04-26T20:58:10.668649+0000","last_unstale":"2024-04-26T20:58:12.698056+0000","last_undegraded":"2024-04-26T20:58:12.698056+0000","last_fullsized":"2024-04-26T20:58:12.698056+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:09:40.826437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"41'5","reported_seq":32,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.652315+0000","last_change":"2024-04-26T20:57:52.579072+0000","last_active":"2024-04-26T20:58:10.652315+0000","last_peered":"2024-04-26T20:58:10.652315+0000","last_clean":"2024-04-26T20:58:10.652315+0000","last_became_active":"2024-04-26T20:57:52.578605+0000","last_became_peered":"2024-04-26T20:57:52.578605+0000","last_unstale":"2024-04-26T20:58:10.652315+0000","last_undegraded":"2024-04-26T20:58:10.652315+0000","last_fullsized":"2024-04-26T20:58:10.652315+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:29:56.009862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"42'5","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.664616+0000","last_change":"2024-04-26T20:57:51.577840+0000","last_active":"2024-04-26T20:58:10.664616+0000","last_peered":"2024-04-26T20:58:10.664616+0000","last_clean":"2024-04-26T20:58:10.664616+0000","last_became_active":"2024-04-26T20:57:51.577584+0000","last_became_peered":"2024-04-26T20:57:51.577584+0000","last_unstale":"2024-04-26T20:58:10.664616+0000","last_undegraded":"2024-04-26T20:58:10.664616+0000","last_fullsized":"2024-04-26T20:58:10.664616+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:41:35.733249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.669904+0000","last_change":"2024-04-26T20:58:10.668616+0000","last_active":"2024-04-26T20:58:10.669904+0000","last_peered":"2024-04-26T20:58:10.669904+0000","last_clean":"2024-04-26T20:58:10.669904+0000","last_became_active":"2024-04-26T20:58:10.668030+0000","last_became_peered":"2024-04-26T20:58:10.668030+0000","last_unstale":"2024-04-26T20:58:10.669904+0000","last_undegraded":"2024-04-26T20:58:10.669904+0000","last_fullsized":"2024-04-26T20:58:10.669904+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:55:04.636924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"41'7","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.665649+0000","last_change":"2024-04-26T20:57:52.580763+0000","last_active":"2024-04-26T20:58:10.665649+0000","last_peered":"2024-04-26T20:58:10.665649+0000","last_clean":"2024-04-26T20:58:10.665649+0000","last_became_active":"2024-04-26T20:57:52.580489+0000","last_became_peered":"2024-04-26T20:57:52.580489+0000","last_unstale":"2024-04-26T20:58:10.665649+0000","last_undegraded":"2024-04-26T20:58:10.665649+0000","last_fullsized":"2024-04-26T20:58:10.665649+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:52:00.840874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":26,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.661342+0000","last_change":"2024-04-26T20:57:51.574263+0000","last_active":"2024-04-26T20:58:10.661342+0000","last_peered":"2024-04-26T20:58:10.661342+0000","last_clean":"2024-04-26T20:58:10.661342+0000","last_became_active":"2024-04-26T20:57:51.573941+0000","last_became_peered":"2024-04-26T20:57:51.573941+0000","last_unstale":"2024-04-26T20:58:10.661342+0000","last_undegraded":"2024-04-26T20:58:10.661342+0000","last_fullsized":"2024-04-26T20:58:10.661342+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:38.596761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.659812+0000","last_change":"2024-04-26T20:58:10.657492+0000","last_active":"2024-04-26T20:58:10.659812+0000","last_peered":"2024-04-26T20:58:10.659812+0000","last_clean":"2024-04-26T20:58:10.659812+0000","last_became_active":"2024-04-26T20:58:10.657039+0000","last_became_peered":"2024-04-26T20:58:10.657039+0000","last_unstale":"2024-04-26T20:58:10.659812+0000","last_undegraded":"2024-04-26T20:58:10.659812+0000","last_fullsized":"2024-04-26T20:58:10.659812+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:28:38.251611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"41'8","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.659974+0000","last_change":"2024-04-26T20:57:52.592217+0000","last_active":"2024-04-26T20:58:10.659974+0000","last_peered":"2024-04-26T20:58:10.659974+0000","last_clean":"2024-04-26T20:58:10.659974+0000","last_became_active":"2024-04-26T20:57:52.591954+0000","last_became_peered":"2024-04-26T20:57:52.591954+0000","last_unstale":"2024-04-26T20:58:10.659974+0000","last_undegraded":"2024-04-26T20:58:10.659974+0000","last_fullsized":"2024-04-26T20:58:10.659974+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:23:22.653755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":28,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.698019+0000","last_change":"2024-04-26T20:57:51.571206+0000","last_active":"2024-04-26T20:58:12.698019+0000","last_peered":"2024-04-26T20:58:12.698019+0000","last_clean":"2024-04-26T20:58:12.698019+0000","last_became_active":"2024-04-26T20:57:51.570877+0000","last_became_peered":"2024-04-26T20:57:51.570877+0000","last_unstale":"2024-04-26T20:58:12.698019+0000","last_undegraded":"2024-04-26T20:58:12.698019+0000","last_fullsized":"2024-04-26T20:58:12.698019+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:49:38.164099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.667620+0000","last_change":"2024-04-26T20:58:10.665973+0000","last_active":"2024-04-26T20:58:10.667620+0000","last_peered":"2024-04-26T20:58:10.667620+0000","last_clean":"2024-04-26T20:58:10.667620+0000","last_became_active":"2024-04-26T20:58:10.665680+0000","last_became_peered":"2024-04-26T20:58:10.665680+0000","last_unstale":"2024-04-26T20:58:10.667620+0000","last_undegraded":"2024-04-26T20:58:10.667620+0000","last_fullsized":"2024-04-26T20:58:10.667620+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:06:56.528347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"41'5","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.658435+0000","last_change":"2024-04-26T20:57:52.594833+0000","last_active":"2024-04-26T20:58:10.658435+0000","last_peered":"2024-04-26T20:58:10.658435+0000","last_clean":"2024-04-26T20:58:10.658435+0000","last_became_active":"2024-04-26T20:57:52.594522+0000","last_became_peered":"2024-04-26T20:57:52.594522+0000","last_unstale":"2024-04-26T20:58:10.658435+0000","last_undegraded":"2024-04-26T20:58:10.658435+0000","last_fullsized":"2024-04-26T20:58:10.658435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:45.313671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":28,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.651880+0000","last_change":"2024-04-26T20:57:51.574086+0000","last_active":"2024-04-26T20:58:10.651880+0000","last_peered":"2024-04-26T20:58:10.651880+0000","last_clean":"2024-04-26T20:58:10.651880+0000","last_became_active":"2024-04-26T20:57:51.573834+0000","last_became_peered":"2024-04-26T20:57:51.573834+0000","last_unstale":"2024-04-26T20:58:10.651880+0000","last_undegraded":"2024-04-26T20:58:10.651880+0000","last_fullsized":"2024-04-26T20:58:10.651880+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:50:32.238625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.672714+0000","last_change":"2024-04-26T20:58:10.667021+0000","last_active":"2024-04-26T20:58:10.672714+0000","last_peered":"2024-04-26T20:58:10.672714+0000","last_clean":"2024-04-26T20:58:10.672714+0000","last_became_active":"2024-04-26T20:58:10.666042+0000","last_became_peered":"2024-04-26T20:58:10.666042+0000","last_unstale":"2024-04-26T20:58:10.672714+0000","last_undegraded":"2024-04-26T20:58:10.672714+0000","last_fullsized":"2024-04-26T20:58:10.672714+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:03.407602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"41'8","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.653027+0000","last_change":"2024-04-26T20:57:52.588655+0000","last_active":"2024-04-26T20:58:10.653027+0000","last_peered":"2024-04-26T20:58:10.653027+0000","last_clean":"2024-04-26T20:58:10.653027+0000","last_became_active":"2024-04-26T20:57:52.588356+0000","last_became_peered":"2024-04-26T20:57:52.588356+0000","last_unstale":"2024-04-26T20:58:10.653027+0000","last_undegraded":"2024-04-26T20:58:10.653027+0000","last_fullsized":"2024-04-26T20:58:10.653027+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:23.034777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":27,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.652745+0000","last_change":"2024-04-26T20:57:51.567675+0000","last_active":"2024-04-26T20:58:10.652745+0000","last_peered":"2024-04-26T20:58:10.652745+0000","last_clean":"2024-04-26T20:58:10.652745+0000","last_became_active":"2024-04-26T20:57:51.567464+0000","last_became_peered":"2024-04-26T20:57:51.567464+0000","last_unstale":"2024-04-26T20:58:10.652745+0000","last_undegraded":"2024-04-26T20:58:10.652745+0000","last_fullsized":"2024-04-26T20:58:10.652745+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:17.267826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.697664+0000","last_change":"2024-04-26T20:58:10.676259+0000","last_active":"2024-04-26T20:58:12.697664+0000","last_peered":"2024-04-26T20:58:12.697664+0000","last_clean":"2024-04-26T20:58:12.697664+0000","last_became_active":"2024-04-26T20:58:10.675987+0000","last_became_peered":"2024-04-26T20:58:10.675987+0000","last_unstale":"2024-04-26T20:58:12.697664+0000","last_undegraded":"2024-04-26T20:58:12.697664+0000","last_fullsized":"2024-04-26T20:58:12.697664+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:36:43.884695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"41'7","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.651737+0000","last_change":"2024-04-26T20:57:52.587210+0000","last_active":"2024-04-26T20:58:10.651737+0000","last_peered":"2024-04-26T20:58:10.651737+0000","last_clean":"2024-04-26T20:58:10.651737+0000","last_became_active":"2024-04-26T20:57:52.587015+0000","last_became_peered":"2024-04-26T20:57:52.587015+0000","last_unstale":"2024-04-26T20:58:10.651737+0000","last_undegraded":"2024-04-26T20:58:10.651737+0000","last_fullsized":"2024-04-26T20:58:10.651737+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:05.353679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":28,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.698218+0000","last_change":"2024-04-26T20:57:51.579142+0000","last_active":"2024-04-26T20:58:12.698218+0000","last_peered":"2024-04-26T20:58:12.698218+0000","last_clean":"2024-04-26T20:58:12.698218+0000","last_became_active":"2024-04-26T20:57:51.578834+0000","last_became_peered":"2024-04-26T20:57:51.578834+0000","last_unstale":"2024-04-26T20:58:12.698218+0000","last_undegraded":"2024-04-26T20:58:12.698218+0000","last_fullsized":"2024-04-26T20:58:12.698218+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:48:04.831644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.673957+0000","last_change":"2024-04-26T20:58:10.671508+0000","last_active":"2024-04-26T20:58:10.673957+0000","last_peered":"2024-04-26T20:58:10.673957+0000","last_clean":"2024-04-26T20:58:10.673957+0000","last_became_active":"2024-04-26T20:58:10.671203+0000","last_became_peered":"2024-04-26T20:58:10.671203+0000","last_unstale":"2024-04-26T20:58:10.673957+0000","last_undegraded":"2024-04-26T20:58:10.673957+0000","last_fullsized":"2024-04-26T20:58:10.673957+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:23.447610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"41'8","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.653562+0000","last_change":"2024-04-26T20:57:52.569231+0000","last_active":"2024-04-26T20:58:10.653562+0000","last_peered":"2024-04-26T20:58:10.653562+0000","last_clean":"2024-04-26T20:58:10.653562+0000","last_became_active":"2024-04-26T20:57:52.568915+0000","last_became_peered":"2024-04-26T20:57:52.568915+0000","last_unstale":"2024-04-26T20:58:10.653562+0000","last_undegraded":"2024-04-26T20:58:10.653562+0000","last_fullsized":"2024-04-26T20:58:10.653562+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:48.878142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":28,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.651893+0000","last_change":"2024-04-26T20:57:51.574337+0000","last_active":"2024-04-26T20:58:10.651893+0000","last_peered":"2024-04-26T20:58:10.651893+0000","last_clean":"2024-04-26T20:58:10.651893+0000","last_became_active":"2024-04-26T20:57:51.573114+0000","last_became_peered":"2024-04-26T20:57:51.573114+0000","last_unstale":"2024-04-26T20:58:10.651893+0000","last_undegraded":"2024-04-26T20:58:10.651893+0000","last_fullsized":"2024-04-26T20:58:10.651893+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:36:54.823396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":215,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-26T20:58:10.648435+0000","last_change":"2024-04-26T20:56:29.347462+0000","last_active":"2024-04-26T20:58:10.648435+0000","last_peered":"2024-04-26T20:58:10.648435+0000","last_clean":"2024-04-26T20:58:10.648435+0000","last_became_active":"2024-04-26T20:56:29.346224+0000","last_became_peered":"2024-04-26T20:56:29.346224+0000","last_unstale":"2024-04-26T20:58:10.648435+0000","last_undegraded":"2024-04-26T20:58:10.648435+0000","last_fullsized":"2024-04-26T20:58:10.648435+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:28.079105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:28.079105+0000","last_clean_scrub_stamp":"2024-04-26T20:56:28.079105+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:13.693525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":504,"ondisk_log_size":504,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":97,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":84,"ondisk_log_size":84,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509465,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":552960,"data_stored":246517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509464,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":552960,"data_stored":246517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509465,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32240,"kb_used_data":5216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":5341184,"data_stored":5031189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509465,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33708,"kb_used_data":6672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94338132,"statfs":{"total":96636764160,"available":96602247168,"internally_reserved":0,"allocated":6832128,"data_stored":6530257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509465,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":552960,"data_stored":246517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509464,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28144,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343696,"statfs":{"total":96636764160,"available":96607944704,"internally_reserved":0,"allocated":1146880,"data_stored":836885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509463,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29612,"kb_used_data":2588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342228,"statfs":{"total":96636764160,"available":96606441472,"internally_reserved":0,"allocated":2650112,"data_stored":2343669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27572,"kb_used_data":552,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":565248,"data_stored":253773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T20:58:19.297 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T20:58:19.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.440+0000 7fa003200640 1 Processor -- start 2024-04-26T20:58:19.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.440+0000 7fa003200640 1 -- start start 2024-04-26T20:58:19.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.440+0000 7fa003200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9ffc0cc460 0x7f9ffc0cb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:19.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.440+0000 7fa003200640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ffc15d5c0 con 0x7f9ffc15d1e0 2024-04-26T20:58:19.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.440+0000 7fa003200640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ffc0ccc20 con 0x7f9ffc0cd0a0 2024-04-26T20:58:19.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.440+0000 7fa003200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f9ffc0cc9d0 con 0x7f9ffc0cc460 2024-04-26T20:58:19.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.440+0000 7fa001e00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f9ffc15d1e0 0x7f9ffc071cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:32772/0 (socket says 172.21.15.138:32772) 2024-04-26T20:58:19.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.440+0000 7fa001e00640 1 -- 172.21.15.138:0/763854599 learned_addr learned my addr 172.21.15.138:0/763854599 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:19.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.440+0000 7fa001400640 1 --2- 172.21.15.138:0/763854599 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9ffc0cc460 0x7f9ffc0cb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:19.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.440+0000 7fa000a00640 1 -- 172.21.15.138:0/763854599 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1576911626 0 0) 0x7f9ffc15d5c0 con 0x7f9ffc15d1e0 2024-04-26T20:58:19.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.440+0000 7fa000a00640 1 -- 172.21.15.138:0/763854599 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9fe4003530 con 0x7f9ffc15d1e0 2024-04-26T20:58:19.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.440+0000 7fa000a00640 1 -- 172.21.15.138:0/763854599 <== mon.0 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3916824519 0 0) 0x7f9fe4003530 con 0x7f9ffc15d1e0 2024-04-26T20:58:19.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.440+0000 7fa000a00640 1 -- 172.21.15.138:0/763854599 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9ffc0cc460 msgr2=0x7f9ffc0cb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:19.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.440+0000 7fa000a00640 1 --2- 172.21.15.138:0/763854599 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9ffc0cc460 0x7f9ffc0cb0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:19.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.440+0000 7fa000a00640 1 -- 172.21.15.138:0/763854599 >> v1:172.21.15.143:6789/0 conn(0x7f9ffc0cd0a0 legacy=0x7f9ffc0cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:19.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.440+0000 7fa000a00640 1 -- 172.21.15.138:0/763854599 --> v1:172.21.15.138:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ffc0d1590 con 0x7f9ffc15d1e0 2024-04-26T20:58:19.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.440+0000 7fa000a00640 1 -- 172.21.15.138:0/763854599 <== mon.0 v1:172.21.15.138:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2715389689 0 0) 0x7f9ff0001680 con 0x7f9ffc15d1e0 2024-04-26T20:58:19.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.440+0000 7fa000a00640 1 -- 172.21.15.138:0/763854599 >> v1:172.21.15.138:6789/0 conn(0x7f9ffc15d1e0 legacy=0x7f9ffc071cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:19.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.440+0000 7fa000a00640 1 --2- 172.21.15.138:0/763854599 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9fe40039f0 0x7f9fe4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:19.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.440+0000 7fa000a00640 1 --2- 172.21.15.138:0/763854599 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9fe4004810 0x7f9fe4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:19.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.440+0000 7fa000a00640 1 --2- 172.21.15.138:0/763854599 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9fe4005190 0x7f9fe400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:19.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.440+0000 7fa000a00640 1 -- 172.21.15.138:0/763854599 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f9ffc0cc9d0 con 0x7f9fe4005190 2024-04-26T20:58:19.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.440+0000 7fa000a00640 1 -- 172.21.15.138:0/763854599 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe400bf10 con 0x7f9fe40039f0 2024-04-26T20:58:19.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.440+0000 7fa000a00640 1 -- 172.21.15.138:0/763854599 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f9fe400c090 con 0x7f9fe4004810 2024-04-26T20:58:19.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.444+0000 7fa001400640 1 --2- 172.21.15.138:0/763854599 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9fe4004810 0x7f9fe4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:19.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.444+0000 7fa002800640 1 --2- 172.21.15.138:0/763854599 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9fe4005190 0x7f9fe400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:19.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.444+0000 7fa001e00640 1 --2- 172.21.15.138:0/763854599 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9fe40039f0 0x7f9fe4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:19.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.444+0000 7fa001400640 1 -- 172.21.15.138:0/763854599 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9fe40039f0 msgr2=0x7f9fe4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:19.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.444+0000 7fa001400640 1 --2- 172.21.15.138:0/763854599 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9fe40039f0 0x7f9fe4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:19.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.444+0000 7fa001400640 1 -- 172.21.15.138:0/763854599 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9fe4005190 msgr2=0x7f9fe400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:19.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.444+0000 7fa001400640 1 --2- 172.21.15.138:0/763854599 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9fe4005190 0x7f9fe400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:19.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.444+0000 7fa001400640 1 -- 172.21.15.138:0/763854599 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fe4003530 con 0x7f9fe4004810 2024-04-26T20:58:19.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.444+0000 7fa001400640 1 --2- 172.21.15.138:0/763854599 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9fe4004810 0x7f9fe4004c50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9fec009ab0 tx=0x7f9fec01ca90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=821339216fccb781 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:19.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.444+0000 7fa000a00640 1 -- 172.21.15.138:0/763854599 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fec0b2070 con 0x7f9fe4004810 2024-04-26T20:58:19.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.444+0000 7fa000a00640 1 -- 172.21.15.138:0/763854599 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fec0a5680 con 0x7f9fe4004810 2024-04-26T20:58:19.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.444+0000 7fa000a00640 1 -- 172.21.15.138:0/763854599 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fec0096b0 con 0x7f9fe4004810 2024-04-26T20:58:19.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.448+0000 7fa003200640 1 -- 172.21.15.138:0/763854599 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9fe4004810 msgr2=0x7f9fe4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:19.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.448+0000 7fa003200640 1 --2- 172.21.15.138:0/763854599 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9fe4004810 0x7f9fe4004c50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9fec009ab0 tx=0x7f9fec01ca90 comp rx=0 tx=0).stop 2024-04-26T20:58:19.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.448+0000 7fa002800640 1 -- 172.21.15.138:0/763854599 reap_dead start 2024-04-26T20:58:19.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.448+0000 7fa003200640 1 -- 172.21.15.138:0/763854599 shutdown_connections 2024-04-26T20:58:19.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.448+0000 7fa003200640 1 -- 172.21.15.138:0/763854599 >> 172.21.15.138:0/763854599 conn(0x7f9ffc0d0a70 msgr2=0x7f9ffc0d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:19.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.448+0000 7fa003200640 1 -- 172.21.15.138:0/763854599 shutdown_connections 2024-04-26T20:58:19.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.448+0000 7fa003200640 1 -- 172.21.15.138:0/763854599 wait complete. 2024-04-26T20:58:19.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.448+0000 7fa003200640 1 Processor -- start 2024-04-26T20:58:19.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.448+0000 7fa003200640 1 -- start start 2024-04-26T20:58:19.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.448+0000 7fa003200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9fe4004810 0x7f9ffc15ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:19.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.448+0000 7fa003200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9ffc0c6fd0 0x7f9ffc15b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:19.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.448+0000 7fa003200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ffc1f4940 0x7f9ffc0c4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:19.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.448+0000 7fa003200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f9ffc073f10 con 0x7f9ffc0c6fd0 2024-04-26T20:58:19.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.448+0000 7fa003200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f9ffc072400 con 0x7f9ffc1f4940 2024-04-26T20:58:19.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.448+0000 7fa003200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f9ffc0738f0 con 0x7f9fe4004810 2024-04-26T20:58:19.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.448+0000 7fa001400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9ffc0c6fd0 0x7f9ffc15b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:19.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.448+0000 7fa001400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9ffc0c6fd0 0x7f9ffc15b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:54262/0 (socket says 172.21.15.138:54262) 2024-04-26T20:58:19.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.448+0000 7fa001400640 1 -- 172.21.15.138:0/1212649053 learned_addr learned my addr 172.21.15.138:0/1212649053 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:19.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.448+0000 7fa001400640 1 -- 172.21.15.138:0/1212649053 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9fe4004810 msgr2=0x7f9ffc15ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:19.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.448+0000 7fa001400640 1 --2- 172.21.15.138:0/1212649053 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9fe4004810 0x7f9ffc15ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:19.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.448+0000 7fa001400640 1 -- 172.21.15.138:0/1212649053 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ffc1f4940 msgr2=0x7f9ffc0c4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:19.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.448+0000 7fa001400640 1 --2- 172.21.15.138:0/1212649053 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ffc1f4940 0x7f9ffc0c4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:19.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.448+0000 7fa001400640 1 -- 172.21.15.138:0/1212649053 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ffc1f5250 con 0x7f9ffc0c6fd0 2024-04-26T20:58:19.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.452+0000 7fa001400640 1 --2- 172.21.15.138:0/1212649053 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9ffc0c6fd0 0x7f9ffc15b130 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f9fec009ab0 tx=0x7f9fe4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:19.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.452+0000 7f9ff6000640 1 -- 172.21.15.138:0/1212649053 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fec0b2040 con 0x7f9ffc0c6fd0 2024-04-26T20:58:19.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.452+0000 7f9ff6000640 1 -- 172.21.15.138:0/1212649053 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fec0ad440 con 0x7f9ffc0c6fd0 2024-04-26T20:58:19.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.452+0000 7fa003200640 1 -- 172.21.15.138:0/1212649053 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ffc1f5530 con 0x7f9ffc0c6fd0 2024-04-26T20:58:19.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.452+0000 7f9ff6000640 1 -- 172.21.15.138:0/1212649053 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fec0ad7f0 con 0x7f9ffc0c6fd0 2024-04-26T20:58:19.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.452+0000 7fa003200640 1 -- 172.21.15.138:0/1212649053 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ffc15dbe0 con 0x7f9ffc0c6fd0 2024-04-26T20:58:19.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.452+0000 7fa003200640 1 -- 172.21.15.138:0/1212649053 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ffc069430 con 0x7f9ffc0c6fd0 2024-04-26T20:58:19.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.452+0000 7f9ff6000640 1 -- 172.21.15.138:0/1212649053 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9fec0ad990 con 0x7f9ffc0c6fd0 2024-04-26T20:58:19.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.452+0000 7f9ff6000640 1 --2- 172.21.15.138:0/1212649053 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9fe00683b0 0x7f9fe006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:19.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.452+0000 7f9ff6000640 1 -- 172.21.15.138:0/1212649053 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6640+0+0 (secure 0 0 0) 0x7f9fec121680 con 0x7f9ffc0c6fd0 2024-04-26T20:58:19.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.452+0000 7fa001e00640 1 --2- 172.21.15.138:0/1212649053 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9fe00683b0 0x7f9fe006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:19.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.456+0000 7fa001e00640 1 --2- 172.21.15.138:0/1212649053 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9fe00683b0 0x7f9fe006a870 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9ff0001cd0 tx=0x7f9ff0001c60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:19.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.456+0000 7f9ff6000640 1 -- 172.21.15.138:0/1212649053 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9fec0167a0 con 0x7f9ffc0c6fd0 2024-04-26T20:58:19.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.612+0000 7fa003200640 1 -- 172.21.15.138:0/1212649053 --> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9ffc0ca2c0 con 0x7f9fe00683b0 2024-04-26T20:58:19.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.620+0000 7f9ff6000640 1 -- 172.21.15.138:0/1212649053 <== mgr.4100 v2:172.21.15.143:6832/4275464198 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332522 (secure 0 0 0) 0x7f9ffc0ca2c0 con 0x7f9fe00683b0 2024-04-26T20:58:19.626 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:19.628 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-04-26T20:58:19.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.624+0000 7fa003200640 1 -- 172.21.15.138:0/1212649053 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9fe00683b0 msgr2=0x7f9fe006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:19.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.624+0000 7fa003200640 1 --2- 172.21.15.138:0/1212649053 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9fe00683b0 0x7f9fe006a870 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9ff0001cd0 tx=0x7f9ff0001c60 comp rx=0 tx=0).stop 2024-04-26T20:58:19.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.624+0000 7fa003200640 1 -- 172.21.15.138:0/1212649053 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9ffc0c6fd0 msgr2=0x7f9ffc15b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:19.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.624+0000 7fa003200640 1 --2- 172.21.15.138:0/1212649053 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9ffc0c6fd0 0x7f9ffc15b130 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f9fec009ab0 tx=0x7f9fe4005840 comp rx=0 tx=0).stop 2024-04-26T20:58:19.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.624+0000 7fa003200640 1 -- 172.21.15.138:0/1212649053 shutdown_connections 2024-04-26T20:58:19.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.624+0000 7fa003200640 1 --2- 172.21.15.138:0/1212649053 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9fe00683b0 0x7f9fe006a870 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:19.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.624+0000 7fa003200640 1 --2- 172.21.15.138:0/1212649053 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ffc1f4940 0x7f9ffc0c4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:19.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.624+0000 7fa003200640 1 --2- 172.21.15.138:0/1212649053 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9ffc0c6fd0 0x7f9ffc15b130 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:19.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.624+0000 7fa003200640 1 --2- 172.21.15.138:0/1212649053 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9fe4004810 0x7f9ffc15ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:19.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.624+0000 7fa003200640 1 -- 172.21.15.138:0/1212649053 >> 172.21.15.138:0/1212649053 conn(0x7f9ffc0d0a70 msgr2=0x7f9ffc06e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:19.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.624+0000 7fa003200640 1 -- 172.21.15.138:0/1212649053 shutdown_connections 2024-04-26T20:58:19.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.624+0000 7fa003200640 1 -- 172.21.15.138:0/1212649053 wait complete. 2024-04-26T20:58:19.646 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":100,"stamp":"2024-04-26T20:58:19.264804+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6881824,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":117,"num_read_kb":100,"num_write":260,"num_write_kb":8602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":705,"ondisk_log_size":705,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":258,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234060,"kb_used_data":17864,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754740660,"statfs":{"total":773094113280,"available":772854435840,"internally_reserved":0,"allocated":18292736,"data_stored":15793832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-764,"num_objects":-15,"num_object_clones":0,"num_object_copies":-30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-15,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":31,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.614810"},"pg_stats":[{"pgid":"6.3f","version":"41'8","reported_seq":35,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.698258+0000","last_change":"2024-04-26T20:57:52.581808+0000","last_active":"2024-04-26T20:58:12.698258+0000","last_peered":"2024-04-26T20:58:12.698258+0000","last_clean":"2024-04-26T20:58:12.698258+0000","last_became_active":"2024-04-26T20:57:52.581483+0000","last_became_peered":"2024-04-26T20:57:52.581483+0000","last_unstale":"2024-04-26T20:58:12.698258+0000","last_undegraded":"2024-04-26T20:58:12.698258+0000","last_fullsized":"2024-04-26T20:58:12.698258+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:11:15.960274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"41'4","reported_seq":31,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.186339+0000","last_change":"2024-04-26T20:57:52.584136+0000","last_active":"2024-04-26T20:58:12.186339+0000","last_peered":"2024-04-26T20:58:12.186339+0000","last_clean":"2024-04-26T20:58:12.186339+0000","last_became_active":"2024-04-26T20:57:52.583831+0000","last_became_peered":"2024-04-26T20:57:52.583831+0000","last_unstale":"2024-04-26T20:58:12.186339+0000","last_undegraded":"2024-04-26T20:58:12.186339+0000","last_fullsized":"2024-04-26T20:58:12.186339+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:47:10.436783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"41'7","reported_seq":34,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.698006+0000","last_change":"2024-04-26T20:57:52.589332+0000","last_active":"2024-04-26T20:58:12.698006+0000","last_peered":"2024-04-26T20:58:12.698006+0000","last_clean":"2024-04-26T20:58:12.698006+0000","last_became_active":"2024-04-26T20:57:52.589025+0000","last_became_peered":"2024-04-26T20:57:52.589025+0000","last_unstale":"2024-04-26T20:58:12.698006+0000","last_undegraded":"2024-04-26T20:58:12.698006+0000","last_fullsized":"2024-04-26T20:58:12.698006+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:36.442218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"41'8","reported_seq":35,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.698133+0000","last_change":"2024-04-26T20:57:52.577582+0000","last_active":"2024-04-26T20:58:12.698133+0000","last_peered":"2024-04-26T20:58:12.698133+0000","last_clean":"2024-04-26T20:58:12.698133+0000","last_became_active":"2024-04-26T20:57:52.576872+0000","last_became_peered":"2024-04-26T20:57:52.576872+0000","last_unstale":"2024-04-26T20:58:12.698133+0000","last_undegraded":"2024-04-26T20:58:12.698133+0000","last_fullsized":"2024-04-26T20:58:12.698133+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:57:10.605998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"41'4","reported_seq":31,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:13.402298+0000","last_change":"2024-04-26T20:57:52.590233+0000","last_active":"2024-04-26T20:58:13.402298+0000","last_peered":"2024-04-26T20:58:13.402298+0000","last_clean":"2024-04-26T20:58:13.402298+0000","last_became_active":"2024-04-26T20:57:52.589943+0000","last_became_peered":"2024-04-26T20:57:52.589943+0000","last_unstale":"2024-04-26T20:58:13.402298+0000","last_undegraded":"2024-04-26T20:58:13.402298+0000","last_fullsized":"2024-04-26T20:58:13.402298+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:12.952743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"41'6","reported_seq":33,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.185856+0000","last_change":"2024-04-26T20:57:52.586359+0000","last_active":"2024-04-26T20:58:12.185856+0000","last_peered":"2024-04-26T20:58:12.185856+0000","last_clean":"2024-04-26T20:58:12.185856+0000","last_became_active":"2024-04-26T20:57:52.586013+0000","last_became_peered":"2024-04-26T20:57:52.586013+0000","last_unstale":"2024-04-26T20:58:12.185856+0000","last_undegraded":"2024-04-26T20:58:12.185856+0000","last_fullsized":"2024-04-26T20:58:12.185856+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:52:00.840874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"41'5","reported_seq":31,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.275111+0000","last_change":"2024-04-26T20:57:52.578308+0000","last_active":"2024-04-26T20:58:12.275111+0000","last_peered":"2024-04-26T20:58:12.275111+0000","last_clean":"2024-04-26T20:58:12.275111+0000","last_became_active":"2024-04-26T20:57:52.578063+0000","last_became_peered":"2024-04-26T20:57:52.578063+0000","last_unstale":"2024-04-26T20:58:12.275111+0000","last_undegraded":"2024-04-26T20:58:12.275111+0000","last_fullsized":"2024-04-26T20:58:12.275111+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:12.952743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"41'9","reported_seq":36,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.697413+0000","last_change":"2024-04-26T20:57:52.583828+0000","last_active":"2024-04-26T20:58:12.697413+0000","last_peered":"2024-04-26T20:58:12.697413+0000","last_clean":"2024-04-26T20:58:12.697413+0000","last_became_active":"2024-04-26T20:57:52.582894+0000","last_became_peered":"2024-04-26T20:57:52.582894+0000","last_unstale":"2024-04-26T20:58:12.697413+0000","last_undegraded":"2024-04-26T20:58:12.697413+0000","last_fullsized":"2024-04-26T20:58:12.697413+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:49:03.544125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"41'11","reported_seq":38,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:13.402603+0000","last_change":"2024-04-26T20:57:52.590616+0000","last_active":"2024-04-26T20:58:13.402603+0000","last_peered":"2024-04-26T20:58:13.402603+0000","last_clean":"2024-04-26T20:58:13.402603+0000","last_became_active":"2024-04-26T20:57:52.589972+0000","last_became_peered":"2024-04-26T20:57:52.589972+0000","last_unstale":"2024-04-26T20:58:13.402603+0000","last_undegraded":"2024-04-26T20:58:13.402603+0000","last_fullsized":"2024-04-26T20:58:13.402603+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:55.128152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"41'15","reported_seq":41,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.275615+0000","last_change":"2024-04-26T20:57:52.575175+0000","last_active":"2024-04-26T20:58:12.275615+0000","last_peered":"2024-04-26T20:58:12.275615+0000","last_clean":"2024-04-26T20:58:12.275615+0000","last_became_active":"2024-04-26T20:57:52.574917+0000","last_became_peered":"2024-04-26T20:57:52.574917+0000","last_unstale":"2024-04-26T20:58:12.275615+0000","last_undegraded":"2024-04-26T20:58:12.275615+0000","last_fullsized":"2024-04-26T20:58:12.275615+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:28:20.157680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"41'6","reported_seq":35,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:11.671896+0000","last_change":"2024-04-26T20:57:52.579280+0000","last_active":"2024-04-26T20:58:11.671896+0000","last_peered":"2024-04-26T20:58:11.671896+0000","last_clean":"2024-04-26T20:58:11.671896+0000","last_became_active":"2024-04-26T20:57:52.578799+0000","last_became_peered":"2024-04-26T20:57:52.578799+0000","last_unstale":"2024-04-26T20:58:11.671896+0000","last_undegraded":"2024-04-26T20:58:11.671896+0000","last_fullsized":"2024-04-26T20:58:11.671896+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:24.709956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"41'7","reported_seq":34,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:13.402324+0000","last_change":"2024-04-26T20:57:52.585045+0000","last_active":"2024-04-26T20:58:13.402324+0000","last_peered":"2024-04-26T20:58:13.402324+0000","last_clean":"2024-04-26T20:58:13.402324+0000","last_became_active":"2024-04-26T20:57:52.584748+0000","last_became_peered":"2024-04-26T20:57:52.584748+0000","last_unstale":"2024-04-26T20:58:13.402324+0000","last_undegraded":"2024-04-26T20:58:13.402324+0000","last_fullsized":"2024-04-26T20:58:13.402324+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:16.143937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"41'10","reported_seq":36,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.275221+0000","last_change":"2024-04-26T20:57:52.583032+0000","last_active":"2024-04-26T20:58:12.275221+0000","last_peered":"2024-04-26T20:58:12.275221+0000","last_clean":"2024-04-26T20:58:12.275221+0000","last_became_active":"2024-04-26T20:57:52.582788+0000","last_became_peered":"2024-04-26T20:57:52.582788+0000","last_unstale":"2024-04-26T20:58:12.275221+0000","last_undegraded":"2024-04-26T20:58:12.275221+0000","last_fullsized":"2024-04-26T20:58:12.275221+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:12:05.356796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"41'8","reported_seq":37,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:11.672587+0000","last_change":"2024-04-26T20:57:52.577582+0000","last_active":"2024-04-26T20:58:11.672587+0000","last_peered":"2024-04-26T20:58:11.672587+0000","last_clean":"2024-04-26T20:58:11.672587+0000","last_became_active":"2024-04-26T20:57:52.577366+0000","last_became_peered":"2024-04-26T20:57:52.577366+0000","last_unstale":"2024-04-26T20:58:11.672587+0000","last_undegraded":"2024-04-26T20:58:11.672587+0000","last_fullsized":"2024-04-26T20:58:11.672587+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:16.143937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"41'7","reported_seq":35,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:11.673175+0000","last_change":"2024-04-26T20:57:52.586188+0000","last_active":"2024-04-26T20:58:11.673175+0000","last_peered":"2024-04-26T20:58:11.673175+0000","last_clean":"2024-04-26T20:58:11.673175+0000","last_became_active":"2024-04-26T20:57:52.585816+0000","last_became_peered":"2024-04-26T20:57:52.585816+0000","last_unstale":"2024-04-26T20:58:11.673175+0000","last_undegraded":"2024-04-26T20:58:11.673175+0000","last_fullsized":"2024-04-26T20:58:11.673175+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:34:47.231759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"41'9","reported_seq":35,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.275089+0000","last_change":"2024-04-26T20:57:52.587967+0000","last_active":"2024-04-26T20:58:12.275089+0000","last_peered":"2024-04-26T20:58:12.275089+0000","last_clean":"2024-04-26T20:58:12.275089+0000","last_became_active":"2024-04-26T20:57:52.587598+0000","last_became_peered":"2024-04-26T20:57:52.587598+0000","last_unstale":"2024-04-26T20:58:12.275089+0000","last_undegraded":"2024-04-26T20:58:12.275089+0000","last_fullsized":"2024-04-26T20:58:12.275089+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:55.128152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"41'9","reported_seq":37,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:11.673926+0000","last_change":"2024-04-26T20:57:52.582167+0000","last_active":"2024-04-26T20:58:11.673926+0000","last_peered":"2024-04-26T20:58:11.673926+0000","last_clean":"2024-04-26T20:58:11.673926+0000","last_became_active":"2024-04-26T20:57:52.581896+0000","last_became_peered":"2024-04-26T20:57:52.581896+0000","last_unstale":"2024-04-26T20:58:11.673926+0000","last_undegraded":"2024-04-26T20:58:11.673926+0000","last_fullsized":"2024-04-26T20:58:11.673926+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:34:07.377749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"41'10","reported_seq":38,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:11.673733+0000","last_change":"2024-04-26T20:57:52.582700+0000","last_active":"2024-04-26T20:58:11.673733+0000","last_peered":"2024-04-26T20:58:11.673733+0000","last_clean":"2024-04-26T20:58:11.673733+0000","last_became_active":"2024-04-26T20:57:52.582355+0000","last_became_peered":"2024-04-26T20:57:52.582355+0000","last_unstale":"2024-04-26T20:58:11.673733+0000","last_undegraded":"2024-04-26T20:58:11.673733+0000","last_fullsized":"2024-04-26T20:58:11.673733+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:36:31.798469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"41'7","reported_seq":33,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.221981+0000","last_change":"2024-04-26T20:57:52.593273+0000","last_active":"2024-04-26T20:58:12.221981+0000","last_peered":"2024-04-26T20:58:12.221981+0000","last_clean":"2024-04-26T20:58:12.221981+0000","last_became_active":"2024-04-26T20:57:52.592960+0000","last_became_peered":"2024-04-26T20:57:52.592960+0000","last_unstale":"2024-04-26T20:58:12.221981+0000","last_undegraded":"2024-04-26T20:58:12.221981+0000","last_fullsized":"2024-04-26T20:58:12.221981+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:49:19.250429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"41'8","reported_seq":37,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:11.671836+0000","last_change":"2024-04-26T20:57:52.569599+0000","last_active":"2024-04-26T20:58:11.671836+0000","last_peered":"2024-04-26T20:58:11.671836+0000","last_clean":"2024-04-26T20:58:11.671836+0000","last_became_active":"2024-04-26T20:57:52.569345+0000","last_became_peered":"2024-04-26T20:57:52.569345+0000","last_unstale":"2024-04-26T20:58:11.671836+0000","last_undegraded":"2024-04-26T20:58:11.671836+0000","last_fullsized":"2024-04-26T20:58:11.671836+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:31:38.044176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"41'11","reported_seq":40,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:11.671654+0000","last_change":"2024-04-26T20:57:52.592270+0000","last_active":"2024-04-26T20:58:11.671654+0000","last_peered":"2024-04-26T20:58:11.671654+0000","last_clean":"2024-04-26T20:58:11.671654+0000","last_became_active":"2024-04-26T20:57:52.591984+0000","last_became_peered":"2024-04-26T20:57:52.591984+0000","last_unstale":"2024-04-26T20:58:11.671654+0000","last_undegraded":"2024-04-26T20:58:11.671654+0000","last_fullsized":"2024-04-26T20:58:11.671654+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:16:22.565146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"41'9","reported_seq":38,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:11.671393+0000","last_change":"2024-04-26T20:57:52.576852+0000","last_active":"2024-04-26T20:58:11.671393+0000","last_peered":"2024-04-26T20:58:11.671393+0000","last_clean":"2024-04-26T20:58:11.671393+0000","last_became_active":"2024-04-26T20:57:52.575571+0000","last_became_peered":"2024-04-26T20:57:52.575571+0000","last_unstale":"2024-04-26T20:58:11.671393+0000","last_undegraded":"2024-04-26T20:58:11.671393+0000","last_fullsized":"2024-04-26T20:58:11.671393+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:45.313671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"41'8","reported_seq":36,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:11.672922+0000","last_change":"2024-04-26T20:57:52.586306+0000","last_active":"2024-04-26T20:58:11.672922+0000","last_peered":"2024-04-26T20:58:11.672922+0000","last_clean":"2024-04-26T20:58:11.672922+0000","last_became_active":"2024-04-26T20:57:52.585992+0000","last_became_peered":"2024-04-26T20:57:52.585992+0000","last_unstale":"2024-04-26T20:58:11.672922+0000","last_undegraded":"2024-04-26T20:58:11.672922+0000","last_fullsized":"2024-04-26T20:58:11.672922+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:30:40.828807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"41'6","reported_seq":33,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.697504+0000","last_change":"2024-04-26T20:57:52.584019+0000","last_active":"2024-04-26T20:58:12.697504+0000","last_peered":"2024-04-26T20:58:12.697504+0000","last_clean":"2024-04-26T20:58:12.697504+0000","last_became_active":"2024-04-26T20:57:52.583140+0000","last_became_peered":"2024-04-26T20:57:52.583140+0000","last_unstale":"2024-04-26T20:58:12.697504+0000","last_undegraded":"2024-04-26T20:58:12.697504+0000","last_fullsized":"2024-04-26T20:58:12.697504+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:03:50.493429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"41'2","reported_seq":31,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:11.672695+0000","last_change":"2024-04-26T20:57:52.579168+0000","last_active":"2024-04-26T20:58:11.672695+0000","last_peered":"2024-04-26T20:58:11.672695+0000","last_clean":"2024-04-26T20:58:11.672695+0000","last_became_active":"2024-04-26T20:57:52.578943+0000","last_became_peered":"2024-04-26T20:57:52.578943+0000","last_unstale":"2024-04-26T20:58:11.672695+0000","last_undegraded":"2024-04-26T20:58:11.672695+0000","last_fullsized":"2024-04-26T20:58:11.672695+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:55.128152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"41'15","reported_seq":42,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.697957+0000","last_change":"2024-04-26T20:57:52.585325+0000","last_active":"2024-04-26T20:58:12.697957+0000","last_peered":"2024-04-26T20:58:12.697957+0000","last_clean":"2024-04-26T20:58:12.697957+0000","last_became_active":"2024-04-26T20:57:52.585083+0000","last_became_peered":"2024-04-26T20:57:52.585083+0000","last_unstale":"2024-04-26T20:58:12.697957+0000","last_undegraded":"2024-04-26T20:58:12.697957+0000","last_fullsized":"2024-04-26T20:58:12.697957+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:33.562017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"41'6","reported_seq":35,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:11.671956+0000","last_change":"2024-04-26T20:57:52.578861+0000","last_active":"2024-04-26T20:58:11.671956+0000","last_peered":"2024-04-26T20:58:11.671956+0000","last_clean":"2024-04-26T20:58:11.671956+0000","last_became_active":"2024-04-26T20:57:52.578454+0000","last_became_peered":"2024-04-26T20:57:52.578454+0000","last_unstale":"2024-04-26T20:58:11.671956+0000","last_undegraded":"2024-04-26T20:58:11.671956+0000","last_fullsized":"2024-04-26T20:58:11.671956+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:36:12.618358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"41'4","reported_seq":30,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.275380+0000","last_change":"2024-04-26T20:57:52.577688+0000","last_active":"2024-04-26T20:58:12.275380+0000","last_peered":"2024-04-26T20:58:12.275380+0000","last_clean":"2024-04-26T20:58:12.275380+0000","last_became_active":"2024-04-26T20:57:52.577426+0000","last_became_peered":"2024-04-26T20:57:52.577426+0000","last_unstale":"2024-04-26T20:58:12.275380+0000","last_undegraded":"2024-04-26T20:58:12.275380+0000","last_fullsized":"2024-04-26T20:58:12.275380+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:16.143937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"41'7","reported_seq":35,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:11.673393+0000","last_change":"2024-04-26T20:57:52.583932+0000","last_active":"2024-04-26T20:58:11.673393+0000","last_peered":"2024-04-26T20:58:11.673393+0000","last_clean":"2024-04-26T20:58:11.673393+0000","last_became_active":"2024-04-26T20:57:52.583671+0000","last_became_peered":"2024-04-26T20:57:52.583671+0000","last_unstale":"2024-04-26T20:58:11.673393+0000","last_undegraded":"2024-04-26T20:58:11.673393+0000","last_fullsized":"2024-04-26T20:58:11.673393+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:17:49.866989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"41'8","reported_seq":36,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:11.672990+0000","last_change":"2024-04-26T20:57:52.569868+0000","last_active":"2024-04-26T20:58:11.672990+0000","last_peered":"2024-04-26T20:58:11.672990+0000","last_clean":"2024-04-26T20:58:11.672990+0000","last_became_active":"2024-04-26T20:57:52.569591+0000","last_became_peered":"2024-04-26T20:57:52.569591+0000","last_unstale":"2024-04-26T20:58:11.672990+0000","last_undegraded":"2024-04-26T20:58:11.672990+0000","last_fullsized":"2024-04-26T20:58:11.672990+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:16.617166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"41'12","reported_seq":38,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.275152+0000","last_change":"2024-04-26T20:57:52.581841+0000","last_active":"2024-04-26T20:58:12.275152+0000","last_peered":"2024-04-26T20:58:12.275152+0000","last_clean":"2024-04-26T20:58:12.275152+0000","last_became_active":"2024-04-26T20:57:52.581591+0000","last_became_peered":"2024-04-26T20:57:52.581591+0000","last_unstale":"2024-04-26T20:58:12.275152+0000","last_undegraded":"2024-04-26T20:58:12.275152+0000","last_fullsized":"2024-04-26T20:58:12.275152+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:37:58.253968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"41'9","reported_seq":36,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.697598+0000","last_change":"2024-04-26T20:57:52.583636+0000","last_active":"2024-04-26T20:58:12.697598+0000","last_peered":"2024-04-26T20:58:12.697598+0000","last_clean":"2024-04-26T20:58:12.697598+0000","last_became_active":"2024-04-26T20:57:52.582497+0000","last_became_peered":"2024-04-26T20:57:52.582497+0000","last_unstale":"2024-04-26T20:58:12.697598+0000","last_undegraded":"2024-04-26T20:58:12.697598+0000","last_fullsized":"2024-04-26T20:58:12.697598+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:22:01.188628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.221798+0000","last_change":"2024-04-26T20:58:10.666436+0000","last_active":"2024-04-26T20:58:12.221798+0000","last_peered":"2024-04-26T20:58:12.221798+0000","last_clean":"2024-04-26T20:58:12.221798+0000","last_became_active":"2024-04-26T20:58:10.666048+0000","last_became_peered":"2024-04-26T20:58:10.666048+0000","last_unstale":"2024-04-26T20:58:12.221798+0000","last_undegraded":"2024-04-26T20:58:12.221798+0000","last_fullsized":"2024-04-26T20:58:12.221798+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:55:45.215360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"41'9","reported_seq":37,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:11.673558+0000","last_change":"2024-04-26T20:57:52.569273+0000","last_active":"2024-04-26T20:58:11.673558+0000","last_peered":"2024-04-26T20:58:11.673558+0000","last_clean":"2024-04-26T20:58:11.673558+0000","last_became_active":"2024-04-26T20:57:52.568195+0000","last_became_peered":"2024-04-26T20:57:52.568195+0000","last_unstale":"2024-04-26T20:58:11.673558+0000","last_undegraded":"2024-04-26T20:58:11.673558+0000","last_fullsized":"2024-04-26T20:58:11.673558+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:05:37.693355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"42'8","reported_seq":38,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:11.672747+0000","last_change":"2024-04-26T20:57:51.572743+0000","last_active":"2024-04-26T20:58:11.672747+0000","last_peered":"2024-04-26T20:58:11.672747+0000","last_clean":"2024-04-26T20:58:11.672747+0000","last_became_active":"2024-04-26T20:57:51.572350+0000","last_became_peered":"2024-04-26T20:57:51.572350+0000","last_unstale":"2024-04-26T20:58:11.672747+0000","last_undegraded":"2024-04-26T20:58:11.672747+0000","last_fullsized":"2024-04-26T20:58:11.672747+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:50:32.238625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:11.673018+0000","last_change":"2024-04-26T20:58:10.667265+0000","last_active":"2024-04-26T20:58:11.673018+0000","last_peered":"2024-04-26T20:58:11.673018+0000","last_clean":"2024-04-26T20:58:11.673018+0000","last_became_active":"2024-04-26T20:58:10.667057+0000","last_became_peered":"2024-04-26T20:58:10.667057+0000","last_unstale":"2024-04-26T20:58:11.673018+0000","last_undegraded":"2024-04-26T20:58:11.673018+0000","last_fullsized":"2024-04-26T20:58:11.673018+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:43:59.225293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"41'15","reported_seq":42,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.186128+0000","last_change":"2024-04-26T20:57:52.587288+0000","last_active":"2024-04-26T20:58:12.186128+0000","last_peered":"2024-04-26T20:58:12.186128+0000","last_clean":"2024-04-26T20:58:12.186128+0000","last_became_active":"2024-04-26T20:57:52.586875+0000","last_became_peered":"2024-04-26T20:57:52.586875+0000","last_unstale":"2024-04-26T20:58:12.186128+0000","last_undegraded":"2024-04-26T20:58:12.186128+0000","last_fullsized":"2024-04-26T20:58:12.186128+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:44:03.294510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":29,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.186361+0000","last_change":"2024-04-26T20:57:51.566643+0000","last_active":"2024-04-26T20:58:12.186361+0000","last_peered":"2024-04-26T20:58:12.186361+0000","last_clean":"2024-04-26T20:58:12.186361+0000","last_became_active":"2024-04-26T20:57:51.566309+0000","last_became_peered":"2024-04-26T20:57:51.566309+0000","last_unstale":"2024-04-26T20:58:12.186361+0000","last_undegraded":"2024-04-26T20:58:12.186361+0000","last_fullsized":"2024-04-26T20:58:12.186361+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:50:32.238625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:11.672064+0000","last_change":"2024-04-26T20:58:10.669263+0000","last_active":"2024-04-26T20:58:11.672064+0000","last_peered":"2024-04-26T20:58:11.672064+0000","last_clean":"2024-04-26T20:58:11.672064+0000","last_became_active":"2024-04-26T20:58:10.668918+0000","last_became_peered":"2024-04-26T20:58:10.668918+0000","last_unstale":"2024-04-26T20:58:11.672064+0000","last_undegraded":"2024-04-26T20:58:11.672064+0000","last_fullsized":"2024-04-26T20:58:11.672064+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:42:20.142733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"41'5","reported_seq":33,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:11.673838+0000","last_change":"2024-04-26T20:57:52.566380+0000","last_active":"2024-04-26T20:58:11.673838+0000","last_peered":"2024-04-26T20:58:11.673838+0000","last_clean":"2024-04-26T20:58:11.673838+0000","last_became_active":"2024-04-26T20:57:52.566143+0000","last_became_peered":"2024-04-26T20:57:52.566143+0000","last_unstale":"2024-04-26T20:58:11.673838+0000","last_undegraded":"2024-04-26T20:58:11.673838+0000","last_fullsized":"2024-04-26T20:58:11.673838+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:49:48.199988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"42'3","reported_seq":31,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.698273+0000","last_change":"2024-04-26T20:57:51.573664+0000","last_active":"2024-04-26T20:58:12.698273+0000","last_peered":"2024-04-26T20:58:12.698273+0000","last_clean":"2024-04-26T20:58:12.698273+0000","last_became_active":"2024-04-26T20:57:51.572927+0000","last_became_peered":"2024-04-26T20:57:51.572927+0000","last_unstale":"2024-04-26T20:58:12.698273+0000","last_undegraded":"2024-04-26T20:58:12.698273+0000","last_fullsized":"2024-04-26T20:58:12.698273+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:04:55.596385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:13.402278+0000","last_change":"2024-04-26T20:58:10.676452+0000","last_active":"2024-04-26T20:58:13.402278+0000","last_peered":"2024-04-26T20:58:13.402278+0000","last_clean":"2024-04-26T20:58:13.402278+0000","last_became_active":"2024-04-26T20:58:10.676145+0000","last_became_peered":"2024-04-26T20:58:10.676145+0000","last_unstale":"2024-04-26T20:58:13.402278+0000","last_undegraded":"2024-04-26T20:58:13.402278+0000","last_fullsized":"2024-04-26T20:58:13.402278+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:06:56.528347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"41'6","reported_seq":33,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.186489+0000","last_change":"2024-04-26T20:57:52.585801+0000","last_active":"2024-04-26T20:58:12.186489+0000","last_peered":"2024-04-26T20:58:12.186489+0000","last_clean":"2024-04-26T20:58:12.186489+0000","last_became_active":"2024-04-26T20:57:52.584731+0000","last_became_peered":"2024-04-26T20:57:52.584731+0000","last_unstale":"2024-04-26T20:58:12.186489+0000","last_undegraded":"2024-04-26T20:58:12.186489+0000","last_fullsized":"2024-04-26T20:58:12.186489+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:39:52.141275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"42'3","reported_seq":33,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:11.673238+0000","last_change":"2024-04-26T20:57:51.574013+0000","last_active":"2024-04-26T20:58:11.673238+0000","last_peered":"2024-04-26T20:58:11.673238+0000","last_clean":"2024-04-26T20:58:11.673238+0000","last_became_active":"2024-04-26T20:57:51.573800+0000","last_became_peered":"2024-04-26T20:57:51.573800+0000","last_unstale":"2024-04-26T20:58:11.673238+0000","last_undegraded":"2024-04-26T20:58:11.673238+0000","last_fullsized":"2024-04-26T20:58:11.673238+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:43:07.969141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:11.673247+0000","last_change":"2024-04-26T20:58:10.665186+0000","last_active":"2024-04-26T20:58:11.673247+0000","last_peered":"2024-04-26T20:58:11.673247+0000","last_clean":"2024-04-26T20:58:11.673247+0000","last_became_active":"2024-04-26T20:58:10.664923+0000","last_became_peered":"2024-04-26T20:58:10.664923+0000","last_unstale":"2024-04-26T20:58:11.673247+0000","last_undegraded":"2024-04-26T20:58:11.673247+0000","last_fullsized":"2024-04-26T20:58:11.673247+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:03:53.252155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"41'8","reported_seq":35,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.697661+0000","last_change":"2024-04-26T20:57:52.587538+0000","last_active":"2024-04-26T20:58:12.697661+0000","last_peered":"2024-04-26T20:58:12.697661+0000","last_clean":"2024-04-26T20:58:12.697661+0000","last_became_active":"2024-04-26T20:57:52.587138+0000","last_became_peered":"2024-04-26T20:57:52.587138+0000","last_unstale":"2024-04-26T20:58:12.697661+0000","last_undegraded":"2024-04-26T20:58:12.697661+0000","last_fullsized":"2024-04-26T20:58:12.697661+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:08:03.271594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":31,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:11.673023+0000","last_change":"2024-04-26T20:57:51.570397+0000","last_active":"2024-04-26T20:58:11.673023+0000","last_peered":"2024-04-26T20:58:11.673023+0000","last_clean":"2024-04-26T20:58:11.673023+0000","last_became_active":"2024-04-26T20:57:51.570089+0000","last_became_peered":"2024-04-26T20:57:51.570089+0000","last_unstale":"2024-04-26T20:58:11.673023+0000","last_undegraded":"2024-04-26T20:58:11.673023+0000","last_fullsized":"2024-04-26T20:58:11.673023+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:55:41.720506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.698231+0000","last_change":"2024-04-26T20:58:10.663505+0000","last_active":"2024-04-26T20:58:12.698231+0000","last_peered":"2024-04-26T20:58:12.698231+0000","last_clean":"2024-04-26T20:58:12.698231+0000","last_became_active":"2024-04-26T20:58:10.663246+0000","last_became_peered":"2024-04-26T20:58:10.663246+0000","last_unstale":"2024-04-26T20:58:12.698231+0000","last_undegraded":"2024-04-26T20:58:12.698231+0000","last_fullsized":"2024-04-26T20:58:12.698231+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:46:36.439207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"41'10","reported_seq":39,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:11.671378+0000","last_change":"2024-04-26T20:57:52.585311+0000","last_active":"2024-04-26T20:58:11.671378+0000","last_peered":"2024-04-26T20:58:11.671378+0000","last_clean":"2024-04-26T20:58:11.671378+0000","last_became_active":"2024-04-26T20:57:52.585061+0000","last_became_peered":"2024-04-26T20:57:52.585061+0000","last_unstale":"2024-04-26T20:58:11.671378+0000","last_undegraded":"2024-04-26T20:58:11.671378+0000","last_fullsized":"2024-04-26T20:58:11.671378+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:18.275862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":28,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.275451+0000","last_change":"2024-04-26T20:57:51.571733+0000","last_active":"2024-04-26T20:58:12.275451+0000","last_peered":"2024-04-26T20:58:12.275451+0000","last_clean":"2024-04-26T20:58:12.275451+0000","last_became_active":"2024-04-26T20:57:51.571446+0000","last_became_peered":"2024-04-26T20:57:51.571446+0000","last_unstale":"2024-04-26T20:58:12.275451+0000","last_undegraded":"2024-04-26T20:58:12.275451+0000","last_fullsized":"2024-04-26T20:58:12.275451+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:07.815468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.697711+0000","last_change":"2024-04-26T20:58:10.672922+0000","last_active":"2024-04-26T20:58:12.697711+0000","last_peered":"2024-04-26T20:58:12.697711+0000","last_clean":"2024-04-26T20:58:12.697711+0000","last_became_active":"2024-04-26T20:58:10.672653+0000","last_became_peered":"2024-04-26T20:58:10.672653+0000","last_unstale":"2024-04-26T20:58:12.697711+0000","last_undegraded":"2024-04-26T20:58:12.697711+0000","last_fullsized":"2024-04-26T20:58:12.697711+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:57:09.025364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"41'7","reported_seq":35,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:11.673043+0000","last_change":"2024-04-26T20:57:52.570641+0000","last_active":"2024-04-26T20:58:11.673043+0000","last_peered":"2024-04-26T20:58:11.673043+0000","last_clean":"2024-04-26T20:58:11.673043+0000","last_became_active":"2024-04-26T20:57:52.570421+0000","last_became_peered":"2024-04-26T20:57:52.570421+0000","last_unstale":"2024-04-26T20:58:11.673043+0000","last_undegraded":"2024-04-26T20:58:11.673043+0000","last_fullsized":"2024-04-26T20:58:11.673043+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:27.330795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":28,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.697515+0000","last_change":"2024-04-26T20:57:51.574572+0000","last_active":"2024-04-26T20:58:12.697515+0000","last_peered":"2024-04-26T20:58:12.697515+0000","last_clean":"2024-04-26T20:58:12.697515+0000","last_became_active":"2024-04-26T20:57:51.574213+0000","last_became_peered":"2024-04-26T20:57:51.574213+0000","last_unstale":"2024-04-26T20:58:12.697515+0000","last_undegraded":"2024-04-26T20:58:12.697515+0000","last_fullsized":"2024-04-26T20:58:12.697515+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:10:26.507698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:11.672936+0000","last_change":"2024-04-26T20:58:10.657768+0000","last_active":"2024-04-26T20:58:11.672936+0000","last_peered":"2024-04-26T20:58:11.672936+0000","last_clean":"2024-04-26T20:58:11.672936+0000","last_became_active":"2024-04-26T20:58:10.657396+0000","last_became_peered":"2024-04-26T20:58:10.657396+0000","last_unstale":"2024-04-26T20:58:11.672936+0000","last_undegraded":"2024-04-26T20:58:11.672936+0000","last_fullsized":"2024-04-26T20:58:11.672936+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:46:12.417679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"41'8","reported_seq":35,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.186160+0000","last_change":"2024-04-26T20:57:52.586106+0000","last_active":"2024-04-26T20:58:12.186160+0000","last_peered":"2024-04-26T20:58:12.186160+0000","last_clean":"2024-04-26T20:58:12.186160+0000","last_became_active":"2024-04-26T20:57:52.585860+0000","last_became_peered":"2024-04-26T20:57:52.585860+0000","last_unstale":"2024-04-26T20:58:12.186160+0000","last_undegraded":"2024-04-26T20:58:12.186160+0000","last_fullsized":"2024-04-26T20:58:12.186160+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:16:22.565146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":27,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.275156+0000","last_change":"2024-04-26T20:57:51.573590+0000","last_active":"2024-04-26T20:58:12.275156+0000","last_peered":"2024-04-26T20:58:12.275156+0000","last_clean":"2024-04-26T20:58:12.275156+0000","last_became_active":"2024-04-26T20:57:51.573293+0000","last_became_peered":"2024-04-26T20:57:51.573293+0000","last_unstale":"2024-04-26T20:58:12.275156+0000","last_undegraded":"2024-04-26T20:58:12.275156+0000","last_fullsized":"2024-04-26T20:58:12.275156+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:55:23.008549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:11.673594+0000","last_change":"2024-04-26T20:58:10.670768+0000","last_active":"2024-04-26T20:58:11.673594+0000","last_peered":"2024-04-26T20:58:11.673594+0000","last_clean":"2024-04-26T20:58:11.673594+0000","last_became_active":"2024-04-26T20:58:10.670520+0000","last_became_peered":"2024-04-26T20:58:10.670520+0000","last_unstale":"2024-04-26T20:58:11.673594+0000","last_undegraded":"2024-04-26T20:58:11.673594+0000","last_fullsized":"2024-04-26T20:58:11.673594+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:41:50.934650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"41'11","reported_seq":38,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.698271+0000","last_change":"2024-04-26T20:57:52.575008+0000","last_active":"2024-04-26T20:58:12.698271+0000","last_peered":"2024-04-26T20:58:12.698271+0000","last_clean":"2024-04-26T20:58:12.698271+0000","last_became_active":"2024-04-26T20:57:52.574553+0000","last_became_peered":"2024-04-26T20:57:52.574553+0000","last_unstale":"2024-04-26T20:58:12.698271+0000","last_undegraded":"2024-04-26T20:58:12.698271+0000","last_fullsized":"2024-04-26T20:58:12.698271+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:42.746367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":28,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.698347+0000","last_change":"2024-04-26T20:57:51.576675+0000","last_active":"2024-04-26T20:58:12.698347+0000","last_peered":"2024-04-26T20:58:12.698347+0000","last_clean":"2024-04-26T20:58:12.698347+0000","last_became_active":"2024-04-26T20:57:51.576394+0000","last_became_peered":"2024-04-26T20:57:51.576394+0000","last_unstale":"2024-04-26T20:58:12.698347+0000","last_undegraded":"2024-04-26T20:58:12.698347+0000","last_fullsized":"2024-04-26T20:58:12.698347+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:44:14.717022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.221764+0000","last_change":"2024-04-26T20:58:10.671102+0000","last_active":"2024-04-26T20:58:12.221764+0000","last_peered":"2024-04-26T20:58:12.221764+0000","last_clean":"2024-04-26T20:58:12.221764+0000","last_became_active":"2024-04-26T20:58:10.670829+0000","last_became_peered":"2024-04-26T20:58:10.670829+0000","last_unstale":"2024-04-26T20:58:12.221764+0000","last_undegraded":"2024-04-26T20:58:12.221764+0000","last_fullsized":"2024-04-26T20:58:12.221764+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:42:20.142733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"41'6","reported_seq":35,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:11.672637+0000","last_change":"2024-04-26T20:57:52.576139+0000","last_active":"2024-04-26T20:58:11.672637+0000","last_peered":"2024-04-26T20:58:11.672637+0000","last_clean":"2024-04-26T20:58:11.672637+0000","last_became_active":"2024-04-26T20:57:52.575825+0000","last_became_peered":"2024-04-26T20:57:52.575825+0000","last_unstale":"2024-04-26T20:58:11.672637+0000","last_undegraded":"2024-04-26T20:58:11.672637+0000","last_fullsized":"2024-04-26T20:58:11.672637+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:37:58.253968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:11.673741+0000","last_change":"2024-04-26T20:57:51.566363+0000","last_active":"2024-04-26T20:58:11.673741+0000","last_peered":"2024-04-26T20:58:11.673741+0000","last_clean":"2024-04-26T20:58:11.673741+0000","last_became_active":"2024-04-26T20:57:51.566020+0000","last_became_peered":"2024-04-26T20:57:51.566020+0000","last_unstale":"2024-04-26T20:58:11.673741+0000","last_undegraded":"2024-04-26T20:58:11.673741+0000","last_fullsized":"2024-04-26T20:58:11.673741+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:51:59.832838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.275623+0000","last_change":"2024-04-26T20:58:10.656874+0000","last_active":"2024-04-26T20:58:12.275623+0000","last_peered":"2024-04-26T20:58:12.275623+0000","last_clean":"2024-04-26T20:58:12.275623+0000","last_became_active":"2024-04-26T20:58:10.656106+0000","last_became_peered":"2024-04-26T20:58:10.656106+0000","last_unstale":"2024-04-26T20:58:12.275623+0000","last_undegraded":"2024-04-26T20:58:12.275623+0000","last_fullsized":"2024-04-26T20:58:12.275623+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:03.407602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"41'10","reported_seq":37,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.698078+0000","last_change":"2024-04-26T20:57:52.593299+0000","last_active":"2024-04-26T20:58:12.698078+0000","last_peered":"2024-04-26T20:58:12.698078+0000","last_clean":"2024-04-26T20:58:12.698078+0000","last_became_active":"2024-04-26T20:57:52.591280+0000","last_became_peered":"2024-04-26T20:57:52.591280+0000","last_unstale":"2024-04-26T20:58:12.698078+0000","last_undegraded":"2024-04-26T20:58:12.698078+0000","last_fullsized":"2024-04-26T20:58:12.698078+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:25.750491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"42'5","reported_seq":34,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:11.673689+0000","last_change":"2024-04-26T20:57:51.569668+0000","last_active":"2024-04-26T20:58:11.673689+0000","last_peered":"2024-04-26T20:58:11.673689+0000","last_clean":"2024-04-26T20:58:11.673689+0000","last_became_active":"2024-04-26T20:57:51.569384+0000","last_became_peered":"2024-04-26T20:57:51.569384+0000","last_unstale":"2024-04-26T20:58:11.673689+0000","last_undegraded":"2024-04-26T20:58:11.673689+0000","last_fullsized":"2024-04-26T20:58:11.673689+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:49:18.242393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.275502+0000","last_change":"2024-04-26T20:58:10.668231+0000","last_active":"2024-04-26T20:58:12.275502+0000","last_peered":"2024-04-26T20:58:12.275502+0000","last_clean":"2024-04-26T20:58:12.275502+0000","last_became_active":"2024-04-26T20:58:10.668007+0000","last_became_peered":"2024-04-26T20:58:10.668007+0000","last_unstale":"2024-04-26T20:58:12.275502+0000","last_undegraded":"2024-04-26T20:58:12.275502+0000","last_fullsized":"2024-04-26T20:58:12.275502+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:36.369793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"41'9","reported_seq":35,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.275549+0000","last_change":"2024-04-26T20:57:52.577388+0000","last_active":"2024-04-26T20:58:12.275549+0000","last_peered":"2024-04-26T20:58:12.275549+0000","last_clean":"2024-04-26T20:58:12.275549+0000","last_became_active":"2024-04-26T20:57:52.577116+0000","last_became_peered":"2024-04-26T20:57:52.577116+0000","last_unstale":"2024-04-26T20:58:12.275549+0000","last_undegraded":"2024-04-26T20:58:12.275549+0000","last_fullsized":"2024-04-26T20:58:12.275549+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:26.856916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"42'23","reported_seq":51,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.698406+0000","last_change":"2024-04-26T20:57:51.574348+0000","last_active":"2024-04-26T20:58:12.698406+0000","last_peered":"2024-04-26T20:58:12.698406+0000","last_clean":"2024-04-26T20:58:12.698406+0000","last_became_active":"2024-04-26T20:57:51.574023+0000","last_became_peered":"2024-04-26T20:57:51.574023+0000","last_unstale":"2024-04-26T20:58:12.698406+0000","last_undegraded":"2024-04-26T20:58:12.698406+0000","last_fullsized":"2024-04-26T20:58:12.698406+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:29:31.014100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:11.672807+0000","last_change":"2024-04-26T20:58:10.657279+0000","last_active":"2024-04-26T20:58:11.672807+0000","last_peered":"2024-04-26T20:58:11.672807+0000","last_clean":"2024-04-26T20:58:11.672807+0000","last_became_active":"2024-04-26T20:58:10.656680+0000","last_became_peered":"2024-04-26T20:58:10.656680+0000","last_unstale":"2024-04-26T20:58:11.672807+0000","last_undegraded":"2024-04-26T20:58:11.672807+0000","last_fullsized":"2024-04-26T20:58:11.672807+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:12:23.450727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"41'6","reported_seq":33,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.697875+0000","last_change":"2024-04-26T20:57:52.583405+0000","last_active":"2024-04-26T20:58:12.697875+0000","last_peered":"2024-04-26T20:58:12.697875+0000","last_clean":"2024-04-26T20:58:12.697875+0000","last_became_active":"2024-04-26T20:57:52.582257+0000","last_became_peered":"2024-04-26T20:57:52.582257+0000","last_unstale":"2024-04-26T20:58:12.697875+0000","last_undegraded":"2024-04-26T20:58:12.697875+0000","last_fullsized":"2024-04-26T20:58:12.697875+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:15:21.765705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"42'5","reported_seq":33,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.697820+0000","last_change":"2024-04-26T20:57:51.572541+0000","last_active":"2024-04-26T20:58:12.697820+0000","last_peered":"2024-04-26T20:58:12.697820+0000","last_clean":"2024-04-26T20:58:12.697820+0000","last_became_active":"2024-04-26T20:57:51.571967+0000","last_became_peered":"2024-04-26T20:57:51.571967+0000","last_unstale":"2024-04-26T20:58:12.697820+0000","last_undegraded":"2024-04-26T20:58:12.697820+0000","last_fullsized":"2024-04-26T20:58:12.697820+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:11:04.894675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:13.402086+0000","last_change":"2024-04-26T20:58:10.671439+0000","last_active":"2024-04-26T20:58:13.402086+0000","last_peered":"2024-04-26T20:58:13.402086+0000","last_clean":"2024-04-26T20:58:13.402086+0000","last_became_active":"2024-04-26T20:58:10.671079+0000","last_became_peered":"2024-04-26T20:58:10.671079+0000","last_unstale":"2024-04-26T20:58:13.402086+0000","last_undegraded":"2024-04-26T20:58:13.402086+0000","last_fullsized":"2024-04-26T20:58:13.402086+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:43:59.225293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"41'6","reported_seq":33,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.185853+0000","last_change":"2024-04-26T20:57:52.581005+0000","last_active":"2024-04-26T20:58:12.185853+0000","last_peered":"2024-04-26T20:58:12.185853+0000","last_clean":"2024-04-26T20:58:12.185853+0000","last_became_active":"2024-04-26T20:57:52.580685+0000","last_became_peered":"2024-04-26T20:57:52.580685+0000","last_unstale":"2024-04-26T20:58:12.185853+0000","last_undegraded":"2024-04-26T20:58:12.185853+0000","last_fullsized":"2024-04-26T20:58:12.185853+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:18.275862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":28,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.185933+0000","last_change":"2024-04-26T20:57:51.571181+0000","last_active":"2024-04-26T20:58:12.185933+0000","last_peered":"2024-04-26T20:58:12.185933+0000","last_clean":"2024-04-26T20:58:12.185933+0000","last_became_active":"2024-04-26T20:57:51.570305+0000","last_became_peered":"2024-04-26T20:57:51.570305+0000","last_unstale":"2024-04-26T20:58:12.185933+0000","last_undegraded":"2024-04-26T20:58:12.185933+0000","last_fullsized":"2024-04-26T20:58:12.185933+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:43:07.969141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:13.402453+0000","last_change":"2024-04-26T20:58:10.671520+0000","last_active":"2024-04-26T20:58:13.402453+0000","last_peered":"2024-04-26T20:58:13.402453+0000","last_clean":"2024-04-26T20:58:13.402453+0000","last_became_active":"2024-04-26T20:58:10.671157+0000","last_became_peered":"2024-04-26T20:58:10.671157+0000","last_unstale":"2024-04-26T20:58:13.402453+0000","last_undegraded":"2024-04-26T20:58:13.402453+0000","last_fullsized":"2024-04-26T20:58:13.402453+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:49:37.344360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"41'10","reported_seq":39,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:11.671727+0000","last_change":"2024-04-26T20:57:52.584791+0000","last_active":"2024-04-26T20:58:11.671727+0000","last_peered":"2024-04-26T20:58:11.671727+0000","last_clean":"2024-04-26T20:58:11.671727+0000","last_became_active":"2024-04-26T20:57:52.575922+0000","last_became_peered":"2024-04-26T20:57:52.575922+0000","last_unstale":"2024-04-26T20:58:11.671727+0000","last_undegraded":"2024-04-26T20:58:11.671727+0000","last_fullsized":"2024-04-26T20:58:11.671727+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:50:20.927595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:11.673099+0000","last_change":"2024-04-26T20:57:51.563498+0000","last_active":"2024-04-26T20:58:11.673099+0000","last_peered":"2024-04-26T20:58:11.673099+0000","last_clean":"2024-04-26T20:58:11.673099+0000","last_became_active":"2024-04-26T20:57:51.563243+0000","last_became_peered":"2024-04-26T20:57:51.563243+0000","last_unstale":"2024-04-26T20:58:11.673099+0000","last_undegraded":"2024-04-26T20:58:11.673099+0000","last_fullsized":"2024-04-26T20:58:11.673099+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:47:09.428746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.275245+0000","last_change":"2024-04-26T20:58:10.665998+0000","last_active":"2024-04-26T20:58:12.275245+0000","last_peered":"2024-04-26T20:58:12.275245+0000","last_clean":"2024-04-26T20:58:12.275245+0000","last_became_active":"2024-04-26T20:58:10.665637+0000","last_became_peered":"2024-04-26T20:58:10.665637+0000","last_unstale":"2024-04-26T20:58:12.275245+0000","last_undegraded":"2024-04-26T20:58:12.275245+0000","last_fullsized":"2024-04-26T20:58:12.275245+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:44:21.388441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"41'15","reported_seq":42,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:13.402443+0000","last_change":"2024-04-26T20:57:52.584930+0000","last_active":"2024-04-26T20:58:13.402443+0000","last_peered":"2024-04-26T20:58:13.402443+0000","last_clean":"2024-04-26T20:58:13.402443+0000","last_became_active":"2024-04-26T20:57:52.584641+0000","last_became_peered":"2024-04-26T20:57:52.584641+0000","last_unstale":"2024-04-26T20:58:13.402443+0000","last_undegraded":"2024-04-26T20:58:13.402443+0000","last_fullsized":"2024-04-26T20:58:13.402443+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:37:58.253968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"42'15","reported_seq":45,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:11.672495+0000","last_change":"2024-04-26T20:57:51.567931+0000","last_active":"2024-04-26T20:58:11.672495+0000","last_peered":"2024-04-26T20:58:11.672495+0000","last_clean":"2024-04-26T20:58:11.672495+0000","last_became_active":"2024-04-26T20:57:51.567552+0000","last_became_peered":"2024-04-26T20:57:51.567552+0000","last_unstale":"2024-04-26T20:58:11.672495+0000","last_undegraded":"2024-04-26T20:58:11.672495+0000","last_fullsized":"2024-04-26T20:58:11.672495+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:32.553314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.275376+0000","last_change":"2024-04-26T20:58:10.663370+0000","last_active":"2024-04-26T20:58:12.275376+0000","last_peered":"2024-04-26T20:58:12.275376+0000","last_clean":"2024-04-26T20:58:12.275376+0000","last_became_active":"2024-04-26T20:58:10.663079+0000","last_became_peered":"2024-04-26T20:58:10.663079+0000","last_unstale":"2024-04-26T20:58:12.275376+0000","last_undegraded":"2024-04-26T20:58:12.275376+0000","last_fullsized":"2024-04-26T20:58:12.275376+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:47:28.530714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"41'6","reported_seq":33,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.186048+0000","last_change":"2024-04-26T20:57:52.581758+0000","last_active":"2024-04-26T20:58:12.186048+0000","last_peered":"2024-04-26T20:58:12.186048+0000","last_clean":"2024-04-26T20:58:12.186048+0000","last_became_active":"2024-04-26T20:57:52.581085+0000","last_became_peered":"2024-04-26T20:57:52.581085+0000","last_unstale":"2024-04-26T20:58:12.186048+0000","last_undegraded":"2024-04-26T20:58:12.186048+0000","last_fullsized":"2024-04-26T20:58:12.186048+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:49:19.250429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"42'2","reported_seq":29,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.275622+0000","last_change":"2024-04-26T20:57:51.575710+0000","last_active":"2024-04-26T20:58:12.275622+0000","last_peered":"2024-04-26T20:58:12.275622+0000","last_clean":"2024-04-26T20:58:12.275622+0000","last_became_active":"2024-04-26T20:57:51.575446+0000","last_became_peered":"2024-04-26T20:57:51.575446+0000","last_unstale":"2024-04-26T20:58:12.275622+0000","last_undegraded":"2024-04-26T20:58:12.275622+0000","last_fullsized":"2024-04-26T20:58:12.275622+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:05.463288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:11.673153+0000","last_change":"2024-04-26T20:58:10.670833+0000","last_active":"2024-04-26T20:58:11.673153+0000","last_peered":"2024-04-26T20:58:11.673153+0000","last_clean":"2024-04-26T20:58:11.673153+0000","last_became_active":"2024-04-26T20:58:10.670522+0000","last_became_peered":"2024-04-26T20:58:10.670522+0000","last_unstale":"2024-04-26T20:58:11.673153+0000","last_undegraded":"2024-04-26T20:58:11.673153+0000","last_fullsized":"2024-04-26T20:58:11.673153+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:06:56.528347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"41'7","reported_seq":33,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.275424+0000","last_change":"2024-04-26T20:57:52.585080+0000","last_active":"2024-04-26T20:58:12.275424+0000","last_peered":"2024-04-26T20:58:12.275424+0000","last_clean":"2024-04-26T20:58:12.275424+0000","last_became_active":"2024-04-26T20:57:52.584794+0000","last_became_peered":"2024-04-26T20:57:52.584794+0000","last_unstale":"2024-04-26T20:58:12.275424+0000","last_undegraded":"2024-04-26T20:58:12.275424+0000","last_fullsized":"2024-04-26T20:58:12.275424+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:13.183123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"42'3","reported_seq":32,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:11.673843+0000","last_change":"2024-04-26T20:57:51.569389+0000","last_active":"2024-04-26T20:58:11.673843+0000","last_peered":"2024-04-26T20:58:11.673843+0000","last_clean":"2024-04-26T20:58:11.673843+0000","last_became_active":"2024-04-26T20:57:51.569128+0000","last_became_peered":"2024-04-26T20:57:51.569128+0000","last_unstale":"2024-04-26T20:58:11.673843+0000","last_undegraded":"2024-04-26T20:58:11.673843+0000","last_fullsized":"2024-04-26T20:58:11.673843+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:44.305635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:13.402429+0000","last_change":"2024-04-26T20:58:10.673866+0000","last_active":"2024-04-26T20:58:13.402429+0000","last_peered":"2024-04-26T20:58:13.402429+0000","last_clean":"2024-04-26T20:58:13.402429+0000","last_became_active":"2024-04-26T20:58:10.673565+0000","last_became_peered":"2024-04-26T20:58:10.673565+0000","last_unstale":"2024-04-26T20:58:13.402429+0000","last_undegraded":"2024-04-26T20:58:13.402429+0000","last_fullsized":"2024-04-26T20:58:13.402429+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:10.473443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"41'5","reported_seq":31,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.275695+0000","last_change":"2024-04-26T20:57:52.580234+0000","last_active":"2024-04-26T20:58:12.275695+0000","last_peered":"2024-04-26T20:58:12.275695+0000","last_clean":"2024-04-26T20:58:12.275695+0000","last_became_active":"2024-04-26T20:57:52.579929+0000","last_became_peered":"2024-04-26T20:57:52.579929+0000","last_unstale":"2024-04-26T20:58:12.275695+0000","last_undegraded":"2024-04-26T20:58:12.275695+0000","last_fullsized":"2024-04-26T20:58:12.275695+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:06:01.245752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"42'2","reported_seq":30,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:13.402111+0000","last_change":"2024-04-26T20:57:51.577610+0000","last_active":"2024-04-26T20:58:13.402111+0000","last_peered":"2024-04-26T20:58:13.402111+0000","last_clean":"2024-04-26T20:58:13.402111+0000","last_became_active":"2024-04-26T20:57:51.577352+0000","last_became_peered":"2024-04-26T20:57:51.577352+0000","last_unstale":"2024-04-26T20:58:13.402111+0000","last_undegraded":"2024-04-26T20:58:13.402111+0000","last_fullsized":"2024-04-26T20:58:13.402111+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:05:01.247112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:13.402353+0000","last_change":"2024-04-26T20:58:10.672457+0000","last_active":"2024-04-26T20:58:13.402353+0000","last_peered":"2024-04-26T20:58:13.402353+0000","last_clean":"2024-04-26T20:58:13.402353+0000","last_became_active":"2024-04-26T20:58:10.671871+0000","last_became_peered":"2024-04-26T20:58:10.671871+0000","last_unstale":"2024-04-26T20:58:13.402353+0000","last_undegraded":"2024-04-26T20:58:13.402353+0000","last_fullsized":"2024-04-26T20:58:13.402353+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:02.739631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"41'9","reported_seq":35,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.221862+0000","last_change":"2024-04-26T20:57:52.593107+0000","last_active":"2024-04-26T20:58:12.221862+0000","last_peered":"2024-04-26T20:58:12.221862+0000","last_clean":"2024-04-26T20:58:12.221862+0000","last_became_active":"2024-04-26T20:57:52.592849+0000","last_became_peered":"2024-04-26T20:57:52.592849+0000","last_unstale":"2024-04-26T20:58:12.221862+0000","last_undegraded":"2024-04-26T20:58:12.221862+0000","last_fullsized":"2024-04-26T20:58:12.221862+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:18.275862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":27,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.221800+0000","last_change":"2024-04-26T20:57:51.573218+0000","last_active":"2024-04-26T20:58:12.221800+0000","last_peered":"2024-04-26T20:58:12.221800+0000","last_clean":"2024-04-26T20:58:12.221800+0000","last_became_active":"2024-04-26T20:57:51.572070+0000","last_became_peered":"2024-04-26T20:57:51.572070+0000","last_unstale":"2024-04-26T20:58:12.221800+0000","last_undegraded":"2024-04-26T20:58:12.221800+0000","last_fullsized":"2024-04-26T20:58:12.221800+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:43.209710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.221352+0000","last_change":"2024-04-26T20:58:10.669638+0000","last_active":"2024-04-26T20:58:12.221352+0000","last_peered":"2024-04-26T20:58:12.221352+0000","last_clean":"2024-04-26T20:58:12.221352+0000","last_became_active":"2024-04-26T20:58:10.669290+0000","last_became_peered":"2024-04-26T20:58:10.669290+0000","last_unstale":"2024-04-26T20:58:12.221352+0000","last_undegraded":"2024-04-26T20:58:12.221352+0000","last_fullsized":"2024-04-26T20:58:12.221352+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:36:30.712289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"41'9","reported_seq":37,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:11.672779+0000","last_change":"2024-04-26T20:57:52.580620+0000","last_active":"2024-04-26T20:58:11.672779+0000","last_peered":"2024-04-26T20:58:11.672779+0000","last_clean":"2024-04-26T20:58:11.672779+0000","last_became_active":"2024-04-26T20:57:52.580262+0000","last_became_peered":"2024-04-26T20:57:52.580262+0000","last_unstale":"2024-04-26T20:58:11.672779+0000","last_undegraded":"2024-04-26T20:58:11.672779+0000","last_fullsized":"2024-04-26T20:58:11.672779+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:17:36.055479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"42'4","reported_seq":31,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.221769+0000","last_change":"2024-04-26T20:57:51.572477+0000","last_active":"2024-04-26T20:58:12.221769+0000","last_peered":"2024-04-26T20:58:12.221769+0000","last_clean":"2024-04-26T20:58:12.221769+0000","last_became_active":"2024-04-26T20:57:51.572200+0000","last_became_peered":"2024-04-26T20:57:51.572200+0000","last_unstale":"2024-04-26T20:58:12.221769+0000","last_undegraded":"2024-04-26T20:58:12.221769+0000","last_fullsized":"2024-04-26T20:58:12.221769+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:03:39.964597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.221259+0000","last_change":"2024-04-26T20:58:10.666288+0000","last_active":"2024-04-26T20:58:12.221259+0000","last_peered":"2024-04-26T20:58:12.221259+0000","last_clean":"2024-04-26T20:58:12.221259+0000","last_became_active":"2024-04-26T20:58:10.665961+0000","last_became_peered":"2024-04-26T20:58:10.665961+0000","last_unstale":"2024-04-26T20:58:12.221259+0000","last_undegraded":"2024-04-26T20:58:12.221259+0000","last_fullsized":"2024-04-26T20:58:12.221259+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:42.803887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"41'2","reported_seq":29,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.697429+0000","last_change":"2024-04-26T20:57:52.570952+0000","last_active":"2024-04-26T20:58:12.697429+0000","last_peered":"2024-04-26T20:58:12.697429+0000","last_clean":"2024-04-26T20:58:12.697429+0000","last_became_active":"2024-04-26T20:57:52.570601+0000","last_became_peered":"2024-04-26T20:57:52.570601+0000","last_unstale":"2024-04-26T20:58:12.697429+0000","last_undegraded":"2024-04-26T20:58:12.697429+0000","last_fullsized":"2024-04-26T20:58:12.697429+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:16:47.969442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":28,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.186051+0000","last_change":"2024-04-26T20:57:51.575051+0000","last_active":"2024-04-26T20:58:12.186051+0000","last_peered":"2024-04-26T20:58:12.186051+0000","last_clean":"2024-04-26T20:58:12.186051+0000","last_became_active":"2024-04-26T20:57:51.574755+0000","last_became_peered":"2024-04-26T20:57:51.574755+0000","last_unstale":"2024-04-26T20:58:12.186051+0000","last_undegraded":"2024-04-26T20:58:12.186051+0000","last_fullsized":"2024-04-26T20:58:12.186051+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:32.553314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.185925+0000","last_change":"2024-04-26T20:58:10.676156+0000","last_active":"2024-04-26T20:58:12.185925+0000","last_peered":"2024-04-26T20:58:12.185925+0000","last_clean":"2024-04-26T20:58:12.185925+0000","last_became_active":"2024-04-26T20:58:10.674594+0000","last_became_peered":"2024-04-26T20:58:10.674594+0000","last_unstale":"2024-04-26T20:58:12.185925+0000","last_undegraded":"2024-04-26T20:58:12.185925+0000","last_fullsized":"2024-04-26T20:58:12.185925+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:42.803887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"41'5","reported_seq":34,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:11.671574+0000","last_change":"2024-04-26T20:57:52.584567+0000","last_active":"2024-04-26T20:58:11.671574+0000","last_peered":"2024-04-26T20:58:11.671574+0000","last_clean":"2024-04-26T20:58:11.671574+0000","last_became_active":"2024-04-26T20:57:52.584136+0000","last_became_peered":"2024-04-26T20:57:52.584136+0000","last_unstale":"2024-04-26T20:58:11.671574+0000","last_undegraded":"2024-04-26T20:58:11.671574+0000","last_fullsized":"2024-04-26T20:58:11.671574+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:39:52.141275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":27,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.275482+0000","last_change":"2024-04-26T20:57:51.573894+0000","last_active":"2024-04-26T20:58:12.275482+0000","last_peered":"2024-04-26T20:58:12.275482+0000","last_clean":"2024-04-26T20:58:12.275482+0000","last_became_active":"2024-04-26T20:57:51.573467+0000","last_became_peered":"2024-04-26T20:57:51.573467+0000","last_unstale":"2024-04-26T20:58:12.275482+0000","last_undegraded":"2024-04-26T20:58:12.275482+0000","last_fullsized":"2024-04-26T20:58:12.275482+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:53.725346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.697637+0000","last_change":"2024-04-26T20:58:10.676542+0000","last_active":"2024-04-26T20:58:12.697637+0000","last_peered":"2024-04-26T20:58:12.697637+0000","last_clean":"2024-04-26T20:58:12.697637+0000","last_became_active":"2024-04-26T20:58:10.676296+0000","last_became_peered":"2024-04-26T20:58:10.676296+0000","last_unstale":"2024-04-26T20:58:12.697637+0000","last_undegraded":"2024-04-26T20:58:12.697637+0000","last_fullsized":"2024-04-26T20:58:12.697637+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:34:52.972239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"41'8","reported_seq":35,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.697627+0000","last_change":"2024-04-26T20:57:52.570583+0000","last_active":"2024-04-26T20:58:12.697627+0000","last_peered":"2024-04-26T20:58:12.697627+0000","last_clean":"2024-04-26T20:58:12.697627+0000","last_became_active":"2024-04-26T20:57:52.570303+0000","last_became_peered":"2024-04-26T20:57:52.570303+0000","last_unstale":"2024-04-26T20:58:12.697627+0000","last_undegraded":"2024-04-26T20:58:12.697627+0000","last_fullsized":"2024-04-26T20:58:12.697627+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:19:58.387596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":28,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.185687+0000","last_change":"2024-04-26T20:57:51.571920+0000","last_active":"2024-04-26T20:58:12.185687+0000","last_peered":"2024-04-26T20:58:12.185687+0000","last_clean":"2024-04-26T20:58:12.185687+0000","last_became_active":"2024-04-26T20:57:51.571644+0000","last_became_peered":"2024-04-26T20:57:51.571644+0000","last_unstale":"2024-04-26T20:58:12.185687+0000","last_undegraded":"2024-04-26T20:58:12.185687+0000","last_fullsized":"2024-04-26T20:58:12.185687+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:55:41.720506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:11.673612+0000","last_change":"2024-04-26T20:58:10.670799+0000","last_active":"2024-04-26T20:58:11.673612+0000","last_peered":"2024-04-26T20:58:11.673612+0000","last_clean":"2024-04-26T20:58:11.673612+0000","last_became_active":"2024-04-26T20:58:10.670514+0000","last_became_peered":"2024-04-26T20:58:10.670514+0000","last_unstale":"2024-04-26T20:58:11.673612+0000","last_undegraded":"2024-04-26T20:58:11.673612+0000","last_fullsized":"2024-04-26T20:58:11.673612+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:51:34.013041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"41'9","reported_seq":36,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:13.402182+0000","last_change":"2024-04-26T20:57:52.593531+0000","last_active":"2024-04-26T20:58:13.402182+0000","last_peered":"2024-04-26T20:58:13.402182+0000","last_clean":"2024-04-26T20:58:13.402182+0000","last_became_active":"2024-04-26T20:57:52.592602+0000","last_became_peered":"2024-04-26T20:57:52.592602+0000","last_unstale":"2024-04-26T20:58:13.402182+0000","last_undegraded":"2024-04-26T20:58:13.402182+0000","last_fullsized":"2024-04-26T20:58:13.402182+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:13.183123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"42'3","reported_seq":32,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:11.673953+0000","last_change":"2024-04-26T20:57:51.570771+0000","last_active":"2024-04-26T20:58:11.673953+0000","last_peered":"2024-04-26T20:58:11.673953+0000","last_clean":"2024-04-26T20:58:11.673953+0000","last_became_active":"2024-04-26T20:57:51.570488+0000","last_became_peered":"2024-04-26T20:57:51.570488+0000","last_unstale":"2024-04-26T20:58:11.673953+0000","last_undegraded":"2024-04-26T20:58:11.673953+0000","last_fullsized":"2024-04-26T20:58:11.673953+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:44:02.286474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.698056+0000","last_change":"2024-04-26T20:58:10.668969+0000","last_active":"2024-04-26T20:58:12.698056+0000","last_peered":"2024-04-26T20:58:12.698056+0000","last_clean":"2024-04-26T20:58:12.698056+0000","last_became_active":"2024-04-26T20:58:10.668649+0000","last_became_peered":"2024-04-26T20:58:10.668649+0000","last_unstale":"2024-04-26T20:58:12.698056+0000","last_undegraded":"2024-04-26T20:58:12.698056+0000","last_fullsized":"2024-04-26T20:58:12.698056+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:09:40.826437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"41'5","reported_seq":34,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:11.671978+0000","last_change":"2024-04-26T20:57:52.579072+0000","last_active":"2024-04-26T20:58:11.671978+0000","last_peered":"2024-04-26T20:58:11.671978+0000","last_clean":"2024-04-26T20:58:11.671978+0000","last_became_active":"2024-04-26T20:57:52.578605+0000","last_became_peered":"2024-04-26T20:57:52.578605+0000","last_unstale":"2024-04-26T20:58:11.671978+0000","last_undegraded":"2024-04-26T20:58:11.671978+0000","last_fullsized":"2024-04-26T20:58:11.671978+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:29:56.009862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"42'5","reported_seq":33,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:13.402564+0000","last_change":"2024-04-26T20:57:51.577840+0000","last_active":"2024-04-26T20:58:13.402564+0000","last_peered":"2024-04-26T20:58:13.402564+0000","last_clean":"2024-04-26T20:58:13.402564+0000","last_became_active":"2024-04-26T20:57:51.577584+0000","last_became_peered":"2024-04-26T20:57:51.577584+0000","last_unstale":"2024-04-26T20:58:13.402564+0000","last_undegraded":"2024-04-26T20:58:13.402564+0000","last_fullsized":"2024-04-26T20:58:13.402564+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:41:35.733249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:11.673837+0000","last_change":"2024-04-26T20:58:10.668616+0000","last_active":"2024-04-26T20:58:11.673837+0000","last_peered":"2024-04-26T20:58:11.673837+0000","last_clean":"2024-04-26T20:58:11.673837+0000","last_became_active":"2024-04-26T20:58:10.668030+0000","last_became_peered":"2024-04-26T20:58:10.668030+0000","last_unstale":"2024-04-26T20:58:11.673837+0000","last_undegraded":"2024-04-26T20:58:11.673837+0000","last_fullsized":"2024-04-26T20:58:11.673837+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:11:42.379886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"41'7","reported_seq":33,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.221586+0000","last_change":"2024-04-26T20:57:52.580763+0000","last_active":"2024-04-26T20:58:12.221586+0000","last_peered":"2024-04-26T20:58:12.221586+0000","last_clean":"2024-04-26T20:58:12.221586+0000","last_became_active":"2024-04-26T20:57:52.580489+0000","last_became_peered":"2024-04-26T20:57:52.580489+0000","last_unstale":"2024-04-26T20:58:12.221586+0000","last_undegraded":"2024-04-26T20:58:12.221586+0000","last_fullsized":"2024-04-26T20:58:12.221586+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:52:00.840874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":28,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:13.402179+0000","last_change":"2024-04-26T20:57:51.574263+0000","last_active":"2024-04-26T20:58:13.402179+0000","last_peered":"2024-04-26T20:58:13.402179+0000","last_clean":"2024-04-26T20:58:13.402179+0000","last_became_active":"2024-04-26T20:57:51.573941+0000","last_became_peered":"2024-04-26T20:57:51.573941+0000","last_unstale":"2024-04-26T20:58:13.402179+0000","last_undegraded":"2024-04-26T20:58:13.402179+0000","last_fullsized":"2024-04-26T20:58:13.402179+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:38.596761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:11.672988+0000","last_change":"2024-04-26T20:58:10.657492+0000","last_active":"2024-04-26T20:58:11.672988+0000","last_peered":"2024-04-26T20:58:11.672988+0000","last_clean":"2024-04-26T20:58:11.672988+0000","last_became_active":"2024-04-26T20:58:10.657039+0000","last_became_peered":"2024-04-26T20:58:10.657039+0000","last_unstale":"2024-04-26T20:58:11.672988+0000","last_undegraded":"2024-04-26T20:58:11.672988+0000","last_fullsized":"2024-04-26T20:58:11.672988+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:54:11.593416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"41'8","reported_seq":35,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:13.401982+0000","last_change":"2024-04-26T20:57:52.592217+0000","last_active":"2024-04-26T20:58:13.401982+0000","last_peered":"2024-04-26T20:58:13.401982+0000","last_clean":"2024-04-26T20:58:13.401982+0000","last_became_active":"2024-04-26T20:57:52.591954+0000","last_became_peered":"2024-04-26T20:57:52.591954+0000","last_unstale":"2024-04-26T20:58:13.401982+0000","last_undegraded":"2024-04-26T20:58:13.401982+0000","last_fullsized":"2024-04-26T20:58:13.401982+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:23:22.653755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":28,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.698019+0000","last_change":"2024-04-26T20:57:51.571206+0000","last_active":"2024-04-26T20:58:12.698019+0000","last_peered":"2024-04-26T20:58:12.698019+0000","last_clean":"2024-04-26T20:58:12.698019+0000","last_became_active":"2024-04-26T20:57:51.570877+0000","last_became_peered":"2024-04-26T20:57:51.570877+0000","last_unstale":"2024-04-26T20:58:12.698019+0000","last_undegraded":"2024-04-26T20:58:12.698019+0000","last_fullsized":"2024-04-26T20:58:12.698019+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:49:38.164099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.274976+0000","last_change":"2024-04-26T20:58:10.665973+0000","last_active":"2024-04-26T20:58:12.274976+0000","last_peered":"2024-04-26T20:58:12.274976+0000","last_clean":"2024-04-26T20:58:12.274976+0000","last_became_active":"2024-04-26T20:58:10.665680+0000","last_became_peered":"2024-04-26T20:58:10.665680+0000","last_unstale":"2024-04-26T20:58:12.274976+0000","last_undegraded":"2024-04-26T20:58:12.274976+0000","last_fullsized":"2024-04-26T20:58:12.274976+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:52:18.934805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"41'5","reported_seq":32,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.185939+0000","last_change":"2024-04-26T20:57:52.594833+0000","last_active":"2024-04-26T20:58:12.185939+0000","last_peered":"2024-04-26T20:58:12.185939+0000","last_clean":"2024-04-26T20:58:12.185939+0000","last_became_active":"2024-04-26T20:57:52.594522+0000","last_became_peered":"2024-04-26T20:57:52.594522+0000","last_unstale":"2024-04-26T20:58:12.185939+0000","last_undegraded":"2024-04-26T20:58:12.185939+0000","last_fullsized":"2024-04-26T20:58:12.185939+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:45.313671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:11.671823+0000","last_change":"2024-04-26T20:57:51.574086+0000","last_active":"2024-04-26T20:58:11.671823+0000","last_peered":"2024-04-26T20:58:11.671823+0000","last_clean":"2024-04-26T20:58:11.671823+0000","last_became_active":"2024-04-26T20:57:51.573834+0000","last_became_peered":"2024-04-26T20:57:51.573834+0000","last_unstale":"2024-04-26T20:58:11.671823+0000","last_undegraded":"2024-04-26T20:58:11.671823+0000","last_fullsized":"2024-04-26T20:58:11.671823+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:50:32.238625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.221659+0000","last_change":"2024-04-26T20:58:10.667021+0000","last_active":"2024-04-26T20:58:12.221659+0000","last_peered":"2024-04-26T20:58:12.221659+0000","last_clean":"2024-04-26T20:58:12.221659+0000","last_became_active":"2024-04-26T20:58:10.666042+0000","last_became_peered":"2024-04-26T20:58:10.666042+0000","last_unstale":"2024-04-26T20:58:12.221659+0000","last_undegraded":"2024-04-26T20:58:12.221659+0000","last_fullsized":"2024-04-26T20:58:12.221659+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:19:35.479464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"41'8","reported_seq":36,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:11.673083+0000","last_change":"2024-04-26T20:57:52.588655+0000","last_active":"2024-04-26T20:58:11.673083+0000","last_peered":"2024-04-26T20:58:11.673083+0000","last_clean":"2024-04-26T20:58:11.673083+0000","last_became_active":"2024-04-26T20:57:52.588356+0000","last_became_peered":"2024-04-26T20:57:52.588356+0000","last_unstale":"2024-04-26T20:58:11.673083+0000","last_undegraded":"2024-04-26T20:58:11.673083+0000","last_fullsized":"2024-04-26T20:58:11.673083+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:23.034777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:11.673270+0000","last_change":"2024-04-26T20:57:51.567675+0000","last_active":"2024-04-26T20:58:11.673270+0000","last_peered":"2024-04-26T20:58:11.673270+0000","last_clean":"2024-04-26T20:58:11.673270+0000","last_became_active":"2024-04-26T20:57:51.567464+0000","last_became_peered":"2024-04-26T20:57:51.567464+0000","last_unstale":"2024-04-26T20:58:11.673270+0000","last_undegraded":"2024-04-26T20:58:11.673270+0000","last_fullsized":"2024-04-26T20:58:11.673270+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:17.267826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.697664+0000","last_change":"2024-04-26T20:58:10.676259+0000","last_active":"2024-04-26T20:58:12.697664+0000","last_peered":"2024-04-26T20:58:12.697664+0000","last_clean":"2024-04-26T20:58:12.697664+0000","last_became_active":"2024-04-26T20:58:10.675987+0000","last_became_peered":"2024-04-26T20:58:10.675987+0000","last_unstale":"2024-04-26T20:58:12.697664+0000","last_undegraded":"2024-04-26T20:58:12.697664+0000","last_fullsized":"2024-04-26T20:58:12.697664+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:36:43.884695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"41'7","reported_seq":36,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:11.671719+0000","last_change":"2024-04-26T20:57:52.587210+0000","last_active":"2024-04-26T20:58:11.671719+0000","last_peered":"2024-04-26T20:58:11.671719+0000","last_clean":"2024-04-26T20:58:11.671719+0000","last_became_active":"2024-04-26T20:57:52.587015+0000","last_became_peered":"2024-04-26T20:57:52.587015+0000","last_unstale":"2024-04-26T20:58:11.671719+0000","last_undegraded":"2024-04-26T20:58:11.671719+0000","last_fullsized":"2024-04-26T20:58:11.671719+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:05.353679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":28,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.698218+0000","last_change":"2024-04-26T20:57:51.579142+0000","last_active":"2024-04-26T20:58:12.698218+0000","last_peered":"2024-04-26T20:58:12.698218+0000","last_clean":"2024-04-26T20:58:12.698218+0000","last_became_active":"2024-04-26T20:57:51.578834+0000","last_became_peered":"2024-04-26T20:57:51.578834+0000","last_unstale":"2024-04-26T20:58:12.698218+0000","last_undegraded":"2024-04-26T20:58:12.698218+0000","last_fullsized":"2024-04-26T20:58:12.698218+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:48:04.831644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.221627+0000","last_change":"2024-04-26T20:58:10.671508+0000","last_active":"2024-04-26T20:58:12.221627+0000","last_peered":"2024-04-26T20:58:12.221627+0000","last_clean":"2024-04-26T20:58:12.221627+0000","last_became_active":"2024-04-26T20:58:10.671203+0000","last_became_peered":"2024-04-26T20:58:10.671203+0000","last_unstale":"2024-04-26T20:58:12.221627+0000","last_undegraded":"2024-04-26T20:58:12.221627+0000","last_fullsized":"2024-04-26T20:58:12.221627+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:58:09.636100+0000","last_clean_scrub_stamp":"2024-04-26T20:58:09.636100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:30:14.103794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"41'8","reported_seq":36,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:11.673876+0000","last_change":"2024-04-26T20:57:52.569231+0000","last_active":"2024-04-26T20:58:11.673876+0000","last_peered":"2024-04-26T20:58:11.673876+0000","last_clean":"2024-04-26T20:58:11.673876+0000","last_became_active":"2024-04-26T20:57:52.568915+0000","last_became_peered":"2024-04-26T20:57:52.568915+0000","last_unstale":"2024-04-26T20:58:11.673876+0000","last_undegraded":"2024-04-26T20:58:11.673876+0000","last_fullsized":"2024-04-26T20:58:11.673876+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:51.542169+0000","last_clean_scrub_stamp":"2024-04-26T20:57:51.542169+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:48.878142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:11.671938+0000","last_change":"2024-04-26T20:57:51.574337+0000","last_active":"2024-04-26T20:58:11.671938+0000","last_peered":"2024-04-26T20:58:11.671938+0000","last_clean":"2024-04-26T20:58:11.671938+0000","last_became_active":"2024-04-26T20:57:51.573114+0000","last_became_peered":"2024-04-26T20:57:51.573114+0000","last_unstale":"2024-04-26T20:58:11.671938+0000","last_undegraded":"2024-04-26T20:58:11.671938+0000","last_fullsized":"2024-04-26T20:58:11.671938+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:57:50.534132+0000","last_clean_scrub_stamp":"2024-04-26T20:57:50.534132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:36:54.823396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":217,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T20:58:12.275260+0000","last_change":"2024-04-26T20:56:29.347462+0000","last_active":"2024-04-26T20:58:12.275260+0000","last_peered":"2024-04-26T20:58:12.275260+0000","last_clean":"2024-04-26T20:58:12.275260+0000","last_became_active":"2024-04-26T20:56:29.346224+0000","last_became_peered":"2024-04-26T20:56:29.346224+0000","last_unstale":"2024-04-26T20:58:12.275260+0000","last_undegraded":"2024-04-26T20:58:12.275260+0000","last_fullsized":"2024-04-26T20:58:12.275260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:28.079105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:28.079105+0000","last_clean_scrub_stamp":"2024-04-26T20:56:28.079105+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:13.693525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":504,"ondisk_log_size":504,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":97,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":84,"ondisk_log_size":84,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509466,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27572,"kb_used_data":552,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":565248,"data_stored":253773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509465,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27576,"kb_used_data":552,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344264,"statfs":{"total":96636764160,"available":96608526336,"internally_reserved":0,"allocated":565248,"data_stored":253773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509466,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32256,"kb_used_data":5228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339584,"statfs":{"total":96636764160,"available":96603734016,"internally_reserved":0,"allocated":5353472,"data_stored":5038445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509466,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33720,"kb_used_data":6696,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94338120,"statfs":{"total":96636764160,"available":96602234880,"internally_reserved":0,"allocated":6856704,"data_stored":6545229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509466,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27576,"kb_used_data":552,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344264,"statfs":{"total":96636764160,"available":96608526336,"internally_reserved":0,"allocated":565248,"data_stored":253773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509465,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28160,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343680,"statfs":{"total":96636764160,"available":96607928320,"internally_reserved":0,"allocated":1159168,"data_stored":844141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509464,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29628,"kb_used_data":2600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342212,"statfs":{"total":96636764160,"available":96606425088,"internally_reserved":0,"allocated":2662400,"data_stored":2350925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27572,"kb_used_data":552,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":565248,"data_stored":253773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T20:58:19.651 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-26T20:58:19.651 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -s 2024-04-26T20:58:19.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.824+0000 7fa601400640 1 Processor -- start 2024-04-26T20:58:19.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.824+0000 7fa601400640 1 -- start start 2024-04-26T20:58:19.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.824+0000 7fa601400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa5fc15d2f0 0x7fa5fc0d38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:19.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.824+0000 7fa601400640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa5fc0d1ab0 0x7fa5fc0b2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:19.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.824+0000 7fa601400640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5fc0cec80 con 0x7fa5fc0ce3e0 2024-04-26T20:58:19.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.824+0000 7fa601400640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fa5fc15d6d0 con 0x7fa5fc0d1ab0 2024-04-26T20:58:19.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.824+0000 7fa601400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fa5fc0b29b0 con 0x7fa5fc15d2f0 2024-04-26T20:58:19.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.824+0000 7fa5fb200640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa5fc0d1ab0 0x7fa5fc0b2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:19.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.824+0000 7fa5fb200640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa5fc0d1ab0 0x7fa5fc0b2e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.138:54638/0 (socket says 172.21.15.138:54638) 2024-04-26T20:58:19.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.824+0000 7fa5fb200640 1 -- 172.21.15.138:0/2874822667 learned_addr learned my addr 172.21.15.138:0/2874822667 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:19.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.824+0000 7fa5f9e00640 1 --1- 172.21.15.138:0/2874822667 >> v1:172.21.15.143:6789/0 conn(0x7fa5fc0ce3e0 0x7fa5fc0d13a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.138:36970/0 (socket says 172.21.15.138:36970) 2024-04-26T20:58:19.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.824+0000 7fa5fa800640 1 --2- 172.21.15.138:0/2874822667 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa5fc15d2f0 0x7fa5fc0d38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:19.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.824+0000 7fa5fb200640 1 -- 172.21.15.138:0/2874822667 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa5fc15d2f0 msgr2=0x7fa5fc0d38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:19.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.824+0000 7fa5fb200640 1 --2- 172.21.15.138:0/2874822667 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa5fc15d2f0 0x7fa5fc0d38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:19.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.824+0000 7fa5fb200640 1 -- 172.21.15.138:0/2874822667 >> v1:172.21.15.143:6789/0 conn(0x7fa5fc0ce3e0 legacy=0x7fa5fc0d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:19.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.824+0000 7fa5fb200640 1 -- 172.21.15.138:0/2874822667 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5fc0ce9a0 con 0x7fa5fc0d1ab0 2024-04-26T20:58:19.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.828+0000 7fa5fb200640 1 --2- 172.21.15.138:0/2874822667 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5fc0d1ab0 0x7fa5fc0b2e40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa5f4009e50 tx=0x7fa5f401ca30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8afc75625d0db015 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:19.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.828+0000 7fa5f9400640 1 -- 172.21.15.138:0/2874822667 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f40a5700 con 0x7fa5fc0d1ab0 2024-04-26T20:58:19.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.828+0000 7fa5f9400640 1 -- 172.21.15.138:0/2874822667 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5f40a58a0 con 0x7fa5fc0d1ab0 2024-04-26T20:58:19.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.828+0000 7fa5f9400640 1 -- 172.21.15.138:0/2874822667 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f40a5c70 con 0x7fa5fc0d1ab0 2024-04-26T20:58:19.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.828+0000 7fa601400640 1 -- 172.21.15.138:0/2874822667 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5fc0d1ab0 msgr2=0x7fa5fc0b2e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:19.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.828+0000 7fa601400640 1 --2- 172.21.15.138:0/2874822667 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5fc0d1ab0 0x7fa5fc0b2e40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa5f4009e50 tx=0x7fa5f401ca30 comp rx=0 tx=0).stop 2024-04-26T20:58:19.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.828+0000 7fa601400640 1 -- 172.21.15.138:0/2874822667 shutdown_connections 2024-04-26T20:58:19.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.828+0000 7fa601400640 1 --2- 172.21.15.138:0/2874822667 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5fc0d1ab0 0x7fa5fc0b2e40 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:19.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.828+0000 7fa601400640 1 --2- 172.21.15.138:0/2874822667 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa5fc15d2f0 0x7fa5fc0d38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:19.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.828+0000 7fa601400640 1 -- 172.21.15.138:0/2874822667 >> 172.21.15.138:0/2874822667 conn(0x7fa5fc0d2dc0 msgr2=0x7fa5fc0d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:19.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.828+0000 7fa601400640 1 -- 172.21.15.138:0/2874822667 shutdown_connections 2024-04-26T20:58:19.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.828+0000 7fa601400640 1 -- 172.21.15.138:0/2874822667 wait complete. 2024-04-26T20:58:19.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.832+0000 7fa601400640 1 Processor -- start 2024-04-26T20:58:19.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.832+0000 7fa601400640 1 -- start start 2024-04-26T20:58:19.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.832+0000 7fa601400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5fc0ce3e0 0x7fa5fc150040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:19.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.832+0000 7fa601400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa5fc0d1ab0 0x7fa5fc157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:19.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.832+0000 7fa601400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa5fc15d2f0 0x7fa5fc158420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:19.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.832+0000 7fa601400640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fa5fc0b3d10 con 0x7fa5fc0d1ab0 2024-04-26T20:58:19.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.832+0000 7fa601400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fa5fc0b3b90 con 0x7fa5fc0ce3e0 2024-04-26T20:58:19.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.832+0000 7fa601400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fa5fc0b3e90 con 0x7fa5fc15d2f0 2024-04-26T20:58:19.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.832+0000 7fa5f9e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa5fc0d1ab0 0x7fa5fc157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:19.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.832+0000 7fa5fa800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5fc0ce3e0 0x7fa5fc150040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:19.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.832+0000 7fa5fb200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa5fc15d2f0 0x7fa5fc158420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:19.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.832+0000 7fa5f9e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa5fc0d1ab0 0x7fa5fc157ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:54268/0 (socket says 172.21.15.138:54268) 2024-04-26T20:58:19.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.832+0000 7fa5fa800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5fc0ce3e0 0x7fa5fc150040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.138:54644/0 (socket says 172.21.15.138:54644) 2024-04-26T20:58:19.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.832+0000 7fa5f9e00640 1 -- 172.21.15.138:0/2235335216 learned_addr learned my addr 172.21.15.138:0/2235335216 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:19.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.832+0000 7fa5fa800640 1 -- 172.21.15.138:0/2235335216 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa5fc15d2f0 msgr2=0x7fa5fc158420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:19.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.832+0000 7fa5fa800640 1 --2- 172.21.15.138:0/2235335216 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa5fc15d2f0 0x7fa5fc158420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:19.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.832+0000 7fa5fa800640 1 -- 172.21.15.138:0/2235335216 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa5fc0d1ab0 msgr2=0x7fa5fc157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:19.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.832+0000 7fa5fa800640 1 --2- 172.21.15.138:0/2235335216 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa5fc0d1ab0 0x7fa5fc157ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:19.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.832+0000 7fa5fa800640 1 -- 172.21.15.138:0/2235335216 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5fc14c7e0 con 0x7fa5fc0ce3e0 2024-04-26T20:58:19.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.832+0000 7fa5fa800640 1 --2- 172.21.15.138:0/2235335216 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5fc0ce3e0 0x7fa5fc150040 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec00e870 tx=0x7fa5ec00ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:19.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.832+0000 7fa5f2a00640 1 -- 172.21.15.138:0/2235335216 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec017070 con 0x7fa5fc0ce3e0 2024-04-26T20:58:19.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.832+0000 7fa5f2a00640 1 -- 172.21.15.138:0/2235335216 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5ec00ee60 con 0x7fa5fc0ce3e0 2024-04-26T20:58:19.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.832+0000 7fa5f2a00640 1 -- 172.21.15.138:0/2235335216 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec00cb60 con 0x7fa5fc0ce3e0 2024-04-26T20:58:19.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.832+0000 7fa601400640 1 -- 172.21.15.138:0/2235335216 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5fc1f96e0 con 0x7fa5fc0ce3e0 2024-04-26T20:58:19.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.832+0000 7fa601400640 1 -- 172.21.15.138:0/2235335216 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5fc1f9ca0 con 0x7fa5fc0ce3e0 2024-04-26T20:58:19.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.836+0000 7fa601400640 1 -- 172.21.15.138:0/2235335216 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5fc069510 con 0x7fa5fc0ce3e0 2024-04-26T20:58:19.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.836+0000 7fa5f2a00640 1 -- 172.21.15.138:0/2235335216 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa5ec01a070 con 0x7fa5fc0ce3e0 2024-04-26T20:58:19.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.836+0000 7fa5f2a00640 1 --2- 172.21.15.138:0/2235335216 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fa5dc068380 0x7fa5dc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:19.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.836+0000 7fa5f2a00640 1 -- 172.21.15.138:0/2235335216 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6756+0+0 (secure 0 0 0) 0x7fa5ec086b80 con 0x7fa5fc0ce3e0 2024-04-26T20:58:19.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.836+0000 7fa5f9e00640 1 --2- 172.21.15.138:0/2235335216 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fa5dc068380 0x7fa5dc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:19.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.836+0000 7fa5f9e00640 1 --2- 172.21.15.138:0/2235335216 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fa5dc068380 0x7fa5dc06a840 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc15c5a0 tx=0x7fa5e8007f20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:19.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:19.844+0000 7fa5f2a00640 1 -- 172.21.15.138:0/2235335216 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa5ec0566c0 con 0x7fa5fc0ce3e0 2024-04-26T20:58:20.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.052+0000 7fa601400640 1 -- 172.21.15.138:0/2235335216 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7fa5fc15cb20 con 0x7fa5fc0ce3e0 2024-04-26T20:58:20.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.052+0000 7fa5f2a00640 1 -- 172.21.15.138:0/2235335216 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+611 (secure 0 0 0) 0x7fa5ec05a9c0 con 0x7fa5fc0ce3e0 2024-04-26T20:58:20.054 INFO:teuthology.orchestra.run.smithi138.stdout: cluster: 2024-04-26T20:58:20.054 INFO:teuthology.orchestra.run.smithi138.stdout: id: c22b4730-12cc-4558-8535-b965384398c0 2024-04-26T20:58:20.054 INFO:teuthology.orchestra.run.smithi138.stdout: health: HEALTH_ERR 2024-04-26T20:58:20.054 INFO:teuthology.orchestra.run.smithi138.stdout: 2 filesystems are degraded 2024-04-26T20:58:20.054 INFO:teuthology.orchestra.run.smithi138.stdout: 2 filesystems are offline 2024-04-26T20:58:20.054 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:20.054 INFO:teuthology.orchestra.run.smithi138.stdout: services: 2024-04-26T20:58:20.054 INFO:teuthology.orchestra.run.smithi138.stdout: mon: 3 daemons, quorum a,b,c (age 2m) 2024-04-26T20:58:20.054 INFO:teuthology.orchestra.run.smithi138.stdout: mgr: x(active, since 2m), standbys: y 2024-04-26T20:58:20.054 INFO:teuthology.orchestra.run.smithi138.stdout: mds: 0/2 daemons up (2 failed), 4 standby 2024-04-26T20:58:20.054 INFO:teuthology.orchestra.run.smithi138.stdout: osd: 8 osds: 8 up (since 114s), 8 in (since 2m) 2024-04-26T20:58:20.054 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:20.054 INFO:teuthology.orchestra.run.smithi138.stdout: data: 2024-04-26T20:58:20.054 INFO:teuthology.orchestra.run.smithi138.stdout: volumes: 0/2 healthy, 2 failed 2024-04-26T20:58:20.055 INFO:teuthology.orchestra.run.smithi138.stdout: pools: 4 pools, 129 pgs 2024-04-26T20:58:20.055 INFO:teuthology.orchestra.run.smithi138.stdout: objects: 4 objects, 6.6 MiB 2024-04-26T20:58:20.055 INFO:teuthology.orchestra.run.smithi138.stdout: usage: 229 MiB used, 720 GiB / 720 GiB avail 2024-04-26T20:58:20.055 INFO:teuthology.orchestra.run.smithi138.stdout: pgs: 129 active+clean 2024-04-26T20:58:20.055 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:20.055 INFO:teuthology.orchestra.run.smithi138.stdout: io: 2024-04-26T20:58:20.055 INFO:teuthology.orchestra.run.smithi138.stdout: client: 0 B/s rd, 237 B/s wr, 0 op/s rd, 3 op/s wr 2024-04-26T20:58:20.055 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:20.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.052+0000 7fa601400640 1 -- 172.21.15.138:0/2235335216 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fa5dc068380 msgr2=0x7fa5dc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.052+0000 7fa601400640 1 --2- 172.21.15.138:0/2235335216 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fa5dc068380 0x7fa5dc06a840 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc15c5a0 tx=0x7fa5e8007f20 comp rx=0 tx=0).stop 2024-04-26T20:58:20.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.052+0000 7fa601400640 1 -- 172.21.15.138:0/2235335216 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5fc0ce3e0 msgr2=0x7fa5fc150040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.052+0000 7fa601400640 1 --2- 172.21.15.138:0/2235335216 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5fc0ce3e0 0x7fa5fc150040 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec00e870 tx=0x7fa5ec00ed30 comp rx=0 tx=0).stop 2024-04-26T20:58:20.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.056+0000 7fa601400640 1 -- 172.21.15.138:0/2235335216 shutdown_connections 2024-04-26T20:58:20.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.056+0000 7fa601400640 1 --2- 172.21.15.138:0/2235335216 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fa5dc068380 0x7fa5dc06a840 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.056+0000 7fa601400640 1 --2- 172.21.15.138:0/2235335216 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa5fc15d2f0 0x7fa5fc158420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.056+0000 7fa601400640 1 --2- 172.21.15.138:0/2235335216 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa5fc0d1ab0 0x7fa5fc157ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.056+0000 7fa601400640 1 --2- 172.21.15.138:0/2235335216 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5fc0ce3e0 0x7fa5fc150040 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.056+0000 7fa601400640 1 -- 172.21.15.138:0/2235335216 >> 172.21.15.138:0/2235335216 conn(0x7fa5fc0d2dc0 msgr2=0x7fa5fc0cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:20.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.056+0000 7fa601400640 1 -- 172.21.15.138:0/2235335216 shutdown_connections 2024-04-26T20:58:20.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.056+0000 7fa601400640 1 -- 172.21.15.138:0/2235335216 wait complete. 2024-04-26T20:58:20.075 DEBUG:teuthology.orchestra.run.smithi138:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 init --force-init --filesystem recovery_fs --alternate-pool recovery_fs_metadata 2024-04-26T20:58:20.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.120+0000 7f4465ed18c0 1 -- start start 2024-04-26T20:58:20.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.120+0000 7f4465ed18c0 1 Processor -- start 2024-04-26T20:58:20.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.120+0000 7f4465ed18c0 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5628559a1c00 0x56285677ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.120+0000 7f4465ed18c0 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562856787c00 0x56285677b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.120+0000 7f4465ed18c0 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562856787400 0x56285677b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.120+0000 7f4465ed18c0 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x562856788480 con 0x562856787400 2024-04-26T20:58:20.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.120+0000 7f4465ed18c0 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x562856788600 con 0x562856787c00 2024-04-26T20:58:20.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.120+0000 7f4465ed18c0 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x562856788780 con 0x5628559a1c00 2024-04-26T20:58:20.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.120+0000 7f4464a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562856787400 0x56285677b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.120+0000 7f4464a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562856787400 0x56285677b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:54284/0 (socket says 172.21.15.138:54284) 2024-04-26T20:58:20.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.120+0000 7f4464a00640 1 -- 172.21.15.138:0/647575910 learned_addr learned my addr 172.21.15.138:0/647575910 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:20.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.120+0000 7f4464000640 1 --2- 172.21.15.138:0/647575910 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5628559a1c00 0x56285677ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.120+0000 7f4463600640 1 --2- 172.21.15.138:0/647575910 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562856787c00 0x56285677b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.120+0000 7f4464a00640 1 -- 172.21.15.138:0/647575910 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5628559a1c00 msgr2=0x56285677ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:20.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.120+0000 7f4464a00640 1 --2- 172.21.15.138:0/647575910 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5628559a1c00 0x56285677ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.120+0000 7f4464a00640 1 -- 172.21.15.138:0/647575910 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562856787c00 msgr2=0x56285677b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:20.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.120+0000 7f4464a00640 1 --2- 172.21.15.138:0/647575910 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562856787c00 0x56285677b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.120+0000 7f4464a00640 1 -- 172.21.15.138:0/647575910 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628559c61e0 con 0x562856787400 2024-04-26T20:58:20.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.120+0000 7f4464a00640 1 --2- 172.21.15.138:0/647575910 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562856787400 0x56285677b080 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x562855a842a0 tx=0x562855a86120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64dc1b88c9b87ea8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.120+0000 7f4460e00640 1 -- 172.21.15.138:0/647575910 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5628559d64e0 con 0x562856787400 2024-04-26T20:58:20.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.124+0000 7f4465ed18c0 1 -- 172.21.15.138:0/647575910 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628559c7c20 con 0x562856787400 2024-04-26T20:58:20.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.124+0000 7f4460e00640 1 -- 172.21.15.138:0/647575910 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5628559ea1c0 con 0x562856787400 2024-04-26T20:58:20.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.124+0000 7f4465ed18c0 1 -- 172.21.15.138:0/647575910 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({fsmap=0}) -- 0x5628559c74a0 con 0x562856787400 2024-04-26T20:58:20.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.124+0000 7f4465ed18c0 4 waiting for MDS map... 2024-04-26T20:58:20.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.124+0000 7f4460e00640 1 -- 172.21.15.138:0/647575910 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5628559d69c0 con 0x562856787400 2024-04-26T20:58:20.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.124+0000 7f4460e00640 1 -- 172.21.15.138:0/647575910 <== mon.0 v2:172.21.15.138:3300/0 4 ==== osd_map(50..50 src has 1..50) ==== 6756+0+0 (secure 0 0 0) 0x562856710400 con 0x562856787400 2024-04-26T20:58:20.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.124+0000 7f4460e00640 1 -- 172.21.15.138:0/647575910 <== mon.0 v2:172.21.15.138:3300/0 5 ==== fsmap(e 23) ==== 4135+0+0 (secure 0 0 0) 0x5628559f7180 con 0x562856787400 2024-04-26T20:58:20.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.124+0000 7f4465ed18c0 4 Got MDS map 23 2024-04-26T20:58:20.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.124+0000 7f4465ed18c0 4 datascan.main: Using metadata pool output 2024-04-26T20:58:20.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.124+0000 7f4465ed18c0 4 datascan.main: connecting to RADOS... 2024-04-26T20:58:20.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.124+0000 7f4465ed18c0 1 Processor -- start 2024-04-26T20:58:20.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.124+0000 7f4465ed18c0 1 -- start start 2024-04-26T20:58:20.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.124+0000 7f4465ed18c0 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562856786400 0x56285677c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.124+0000 7f4465ed18c0 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562855c9e000 0x56285677c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.124+0000 7f4465ed18c0 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x562855c9e400 0x56285677cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.124+0000 7f4465ed18c0 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x562855a00180 con 0x562855c9e000 2024-04-26T20:58:20.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.124+0000 7f4465ed18c0 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x562856789200 con 0x562856786400 2024-04-26T20:58:20.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.124+0000 7f4465ed18c0 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x562856789080 con 0x562855c9e400 2024-04-26T20:58:20.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.124+0000 7f4464000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562855c9e000 0x56285677c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.124+0000 7f4464000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562855c9e000 0x56285677c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:54292/0 (socket says 172.21.15.138:54292) 2024-04-26T20:58:20.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.124+0000 7f4464000640 1 -- 172.21.15.138:0/1213840694 learned_addr learned my addr 172.21.15.138:0/1213840694 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:20.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.124+0000 7f4464000640 1 -- 172.21.15.138:0/1213840694 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x562855c9e400 msgr2=0x56285677cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:20.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.124+0000 7f4464000640 1 --2- 172.21.15.138:0/1213840694 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x562855c9e400 0x56285677cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.124+0000 7f4464000640 1 -- 172.21.15.138:0/1213840694 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562856786400 msgr2=0x56285677c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:20.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.124+0000 7f4464000640 1 --2- 172.21.15.138:0/1213840694 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562856786400 0x56285677c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.124+0000 7f4464000640 1 -- 172.21.15.138:0/1213840694 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628559c61e0 con 0x562855c9e000 2024-04-26T20:58:20.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.124+0000 7f4464000640 1 --2- 172.21.15.138:0/1213840694 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562855c9e000 0x56285677c680 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x5628568e2cc0 tx=0x5628568eb800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bed60ef8b39f89f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.124+0000 7f445e600640 1 -- 172.21.15.138:0/1213840694 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5628559d64e0 con 0x562855c9e000 2024-04-26T20:58:20.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.124+0000 7f445e600640 1 -- 172.21.15.138:0/1213840694 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5628559eac40 con 0x562855c9e000 2024-04-26T20:58:20.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.124+0000 7f445e600640 1 -- 172.21.15.138:0/1213840694 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5628559d69c0 con 0x562855c9e000 2024-04-26T20:58:20.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.128+0000 7f4465ed18c0 1 -- 172.21.15.138:0/1213840694 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562855c9e000 msgr2=0x56285677c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.128+0000 7f4465ed18c0 1 --2- 172.21.15.138:0/1213840694 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562855c9e000 0x56285677c680 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x5628568e2cc0 tx=0x5628568eb800 comp rx=0 tx=0).stop 2024-04-26T20:58:20.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.128+0000 7f4465ed18c0 1 -- 172.21.15.138:0/1213840694 shutdown_connections 2024-04-26T20:58:20.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.128+0000 7f4465ed18c0 1 --2- 172.21.15.138:0/1213840694 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x562855c9e400 0x56285677cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.128+0000 7f4465ed18c0 1 --2- 172.21.15.138:0/1213840694 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562855c9e000 0x56285677c680 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.128+0000 7f4465ed18c0 1 --2- 172.21.15.138:0/1213840694 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562856786400 0x56285677c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.128+0000 7f4465ed18c0 1 -- 172.21.15.138:0/1213840694 >> 172.21.15.138:0/1213840694 conn(0x562856787800 msgr2=0x562855c98000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:20.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.128+0000 7f4465ed18c0 1 -- 172.21.15.138:0/1213840694 shutdown_connections 2024-04-26T20:58:20.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.128+0000 7f4465ed18c0 1 -- 172.21.15.138:0/1213840694 wait complete. 2024-04-26T20:58:20.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.128+0000 7f4465ed18c0 1 Processor -- start 2024-04-26T20:58:20.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.128+0000 7f4465ed18c0 1 -- start start 2024-04-26T20:58:20.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.128+0000 7f4465ed18c0 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562856787800 0x56285677c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.128+0000 7f4465ed18c0 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562855c9f000 0x56285677cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.128+0000 7f4465ed18c0 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x562855c9ec00 0x56285677c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.128+0000 7f4465ed18c0 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x562856788180 con 0x562856787800 2024-04-26T20:58:20.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.128+0000 7f4465ed18c0 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x562856788900 con 0x562855c9f000 2024-04-26T20:58:20.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.128+0000 7f4465ed18c0 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x562856788300 con 0x562855c9ec00 2024-04-26T20:58:20.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.128+0000 7f4463600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562856787800 0x56285677c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.128+0000 7f4463600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562856787800 0x56285677c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:54300/0 (socket says 172.21.15.138:54300) 2024-04-26T20:58:20.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.128+0000 7f4463600640 1 -- 172.21.15.138:0/2468920726 learned_addr learned my addr 172.21.15.138:0/2468920726 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:20.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.128+0000 7f4464000640 1 --2- 172.21.15.138:0/2468920726 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562855c9f000 0x56285677cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.128+0000 7f4463600640 1 --2- 172.21.15.138:0/2468920726 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x562855c9ec00 0x56285677c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.128+0000 7f4463600640 1 -- 172.21.15.138:0/2468920726 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x562855c9ec00 msgr2=0x56285677c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.128+0000 7f4463600640 1 --2- 172.21.15.138:0/2468920726 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x562855c9ec00 0x56285677c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.128+0000 7f4463600640 1 -- 172.21.15.138:0/2468920726 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562855c9f000 msgr2=0x56285677cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.128+0000 7f4463600640 1 --2- 172.21.15.138:0/2468920726 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562855c9f000 0x56285677cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.128+0000 7f4463600640 1 -- 172.21.15.138:0/2468920726 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628559c72c0 con 0x562856787800 2024-04-26T20:58:20.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.128+0000 7f4463600640 1 --2- 172.21.15.138:0/2468920726 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562856787800 0x56285677c680 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x5628568e3fb0 tx=0x5628568eb980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.128+0000 7f445c800640 1 -- 172.21.15.138:0/2468920726 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5628559d64e0 con 0x562856787800 2024-04-26T20:58:20.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.128+0000 7f445c800640 1 -- 172.21.15.138:0/2468920726 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5628559eb340 con 0x562856787800 2024-04-26T20:58:20.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.128+0000 7f4465ed18c0 1 -- 172.21.15.138:0/2468920726 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5628559c7e00 con 0x562856787800 2024-04-26T20:58:20.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.128+0000 7f445c800640 1 -- 172.21.15.138:0/2468920726 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5628559d69c0 con 0x562856787800 2024-04-26T20:58:20.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.128+0000 7f4465ed18c0 1 -- 172.21.15.138:0/2468920726 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628559c72c0 con 0x562856787800 2024-04-26T20:58:20.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.128+0000 7f4465ed18c0 4 datascan.init: forcing metadata pool 'recovery_fs_metadata' 2024-04-26T20:58:20.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.132+0000 7f445c800640 1 -- 172.21.15.138:0/2468920726 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x56285692c900 con 0x562856787800 2024-04-26T20:58:20.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.132+0000 7f445c800640 1 --2- 172.21.15.138:0/2468920726 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x562855cb6c00 0x562855d98000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.132+0000 7f445c800640 1 -- 172.21.15.138:0/2468920726 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6756+0+0 (secure 0 0 0) 0x562855ca8c00 con 0x562856787800 2024-04-26T20:58:20.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.132+0000 7f4465ed18c0 1 --2- 172.21.15.138:0/2468920726 >> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] conn(0x562855c9e800 0x56285677d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.132+0000 7f4465ed18c0 1 -- 172.21.15.138:0/2468920726 --> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] -- osd_op(unknown.0.0:1 7.14 7:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50) -- 0x562855c9e400 con 0x562855c9e800 2024-04-26T20:58:20.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.132+0000 7f4464000640 1 --2- 172.21.15.138:0/2468920726 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x562855cb6c00 0x562855d98000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.132+0000 7f4463600640 1 --2- 172.21.15.138:0/2468920726 >> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] conn(0x562855c9e800 0x56285677d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.132+0000 7f4464000640 1 --2- 172.21.15.138:0/2468920726 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x562855cb6c00 0x562855d98000 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x5628568e2cc0 tx=0x562855a828a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.132+0000 7f4463600640 1 --2- 172.21.15.138:0/2468920726 >> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] conn(0x562855c9e800 0x56285677d180 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.132+0000 7f4463600640 1 -- 172.21.15.138:0/2468920726 <== osd.5 v2:172.21.15.143:6808/1910222887 1 ==== osd_op_reply(1 1.00000000.inode [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 160+0+0 (crc 0 0 0) 0x562855a72000 con 0x562855c9e800 2024-04-26T20:58:20.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.132+0000 7f4465ed18c0 1 -- 172.21.15.138:0/2468920726 --> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] -- osd_op(unknown.0.0:2 7.14 7:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) -- 0x562855c9e000 con 0x562855c9e800 2024-04-26T20:58:20.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.136+0000 7f4463600640 1 -- 172.21.15.138:0/2468920726 <== osd.5 v2:172.21.15.143:6808/1910222887 2 ==== osd_op_reply(2 1.00000000.inode [writefull 0~582] v50'1 uv1 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x562855a72000 con 0x562855c9e800 2024-04-26T20:58:20.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.136+0000 7f4465ed18c0 1 --2- 172.21.15.138:0/2468920726 >> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] conn(0x562855cb7000 0x56285677d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.136+0000 7f4465ed18c0 1 -- 172.21.15.138:0/2468920726 --> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] -- osd_op(unknown.0.0:3 7.1f 7:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50) -- 0x562855cb7400 con 0x562855cb7000 2024-04-26T20:58:20.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.136+0000 7f4464a00640 1 --2- 172.21.15.138:0/2468920726 >> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] conn(0x562855cb7000 0x56285677d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.136+0000 7f4464a00640 1 --2- 172.21.15.138:0/2468920726 >> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] conn(0x562855cb7000 0x56285677d700 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.136+0000 7f4464a00640 1 -- 172.21.15.138:0/2468920726 <== osd.0 v2:172.21.15.138:6800/3534772245 1 ==== osd_op_reply(3 100.00000000.inode [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 162+0+0 (crc 0 0 0) 0x562855a72500 con 0x562855cb7000 2024-04-26T20:58:20.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.136+0000 7f4465ed18c0 1 -- 172.21.15.138:0/2468920726 --> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] -- osd_op(unknown.0.0:4 7.1f 7:fe07bba1:::100.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) -- 0x562855cb7800 con 0x562855cb7000 2024-04-26T20:58:20.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.136+0000 7f4464a00640 1 -- 172.21.15.138:0/2468920726 <== osd.0 v2:172.21.15.138:6800/3534772245 2 ==== osd_op_reply(4 100.00000000.inode [writefull 0~582] v50'1 uv1 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x562855a72500 con 0x562855cb7000 2024-04-26T20:58:20.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.136+0000 7f4465ed18c0 1 --2- 172.21.15.138:0/2468920726 >> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] conn(0x562855cb7c00 0x562855d98580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.140+0000 7f4465ed18c0 1 -- 172.21.15.138:0/2468920726 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- osd_op(unknown.0.0:5 7.13 7:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50) -- 0x562855db0000 con 0x562855cb7c00 2024-04-26T20:58:20.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.140+0000 7f4464000640 1 --2- 172.21.15.138:0/2468920726 >> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] conn(0x562855cb7c00 0x562855d98580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.140+0000 7f4464000640 1 --2- 172.21.15.138:0/2468920726 >> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] conn(0x562855cb7c00 0x562855d98580 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.140+0000 7f4464000640 1 -- 172.21.15.138:0/2468920726 <== osd.7 v2:172.21.15.143:6824/3295508495 1 ==== osd_op_reply(5 100.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x562855a72780 con 0x562855cb7c00 2024-04-26T20:58:20.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.140+0000 7f4465ed18c0 10 datascan.find_or_create_dirfrag: read_version = 0 2024-04-26T20:58:20.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.140+0000 7f4465ed18c0 1 -- 172.21.15.138:0/2468920726 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- osd_op(unknown.0.0:6 7.13 7:cd5a64a3:::100.00000000:head [create,omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) -- 0x562855db0400 con 0x562855cb7c00 2024-04-26T20:58:20.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.140+0000 7f4464000640 1 -- 172.21.15.138:0/2468920726 <== osd.7 v2:172.21.15.143:6824/3295508495 2 ==== osd_op_reply(6 100.00000000 [create,omap-set-header] v50'1 uv1 ondisk = 0) ==== 198+0+0 (crc 0 0 0) 0x562855a72780 con 0x562855cb7c00 2024-04-26T20:58:20.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.140+0000 7f4465ed18c0 10 datascan.find_or_create_dirfrag: Created dirfrag: 0x0x100 2024-04-26T20:58:20.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.140+0000 7f4465ed18c0 1 -- 172.21.15.138:0/2468920726 >> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] conn(0x562855cb7000 msgr2=0x56285677d700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.140+0000 7f4465ed18c0 1 --2- 172.21.15.138:0/2468920726 >> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] conn(0x562855cb7000 0x56285677d700 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.140+0000 7f4465ed18c0 1 -- 172.21.15.138:0/2468920726 >> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] conn(0x562855c9e800 msgr2=0x56285677d180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.140+0000 7f4465ed18c0 1 --2- 172.21.15.138:0/2468920726 >> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] conn(0x562855c9e800 0x56285677d180 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.140+0000 7f4465ed18c0 1 -- 172.21.15.138:0/2468920726 >> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] conn(0x562855cb7c00 msgr2=0x562855d98580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.140+0000 7f4465ed18c0 1 --2- 172.21.15.138:0/2468920726 >> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] conn(0x562855cb7c00 0x562855d98580 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.140+0000 7f4464000640 1 -- 172.21.15.138:0/2468920726 reap_dead start 2024-04-26T20:58:20.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.140+0000 7f4465ed18c0 1 -- 172.21.15.138:0/2468920726 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x562855cb6c00 msgr2=0x562855d98000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.140+0000 7f4465ed18c0 1 --2- 172.21.15.138:0/2468920726 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x562855cb6c00 0x562855d98000 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x5628568e2cc0 tx=0x562855a828a0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.140+0000 7f4465ed18c0 1 -- 172.21.15.138:0/2468920726 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562856787800 msgr2=0x56285677c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.140+0000 7f4465ed18c0 1 --2- 172.21.15.138:0/2468920726 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562856787800 0x56285677c680 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x5628568e3fb0 tx=0x5628568eb980 comp rx=0 tx=0).stop 2024-04-26T20:58:20.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.140+0000 7f4465ed18c0 1 -- 172.21.15.138:0/2468920726 shutdown_connections 2024-04-26T20:58:20.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.140+0000 7f4465ed18c0 1 --2- 172.21.15.138:0/2468920726 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x562855cb6c00 0x562855d98000 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.140+0000 7f4465ed18c0 1 --2- 172.21.15.138:0/2468920726 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562856787800 0x56285677c680 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.140+0000 7f4465ed18c0 1 -- 172.21.15.138:0/2468920726 >> 172.21.15.138:0/2468920726 conn(0x562856786400 msgr2=0x562855c98000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:20.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.140+0000 7f4465ed18c0 1 -- 172.21.15.138:0/2468920726 shutdown_connections 2024-04-26T20:58:20.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.140+0000 7f4465ed18c0 1 -- 172.21.15.138:0/2468920726 wait complete. 2024-04-26T20:58:20.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.144+0000 7f4465ed18c0 1 -- 172.21.15.138:0/647575910 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562856787400 msgr2=0x56285677b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.144+0000 7f4465ed18c0 1 --2- 172.21.15.138:0/647575910 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562856787400 0x56285677b080 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x562855a842a0 tx=0x562855a86120 comp rx=0 tx=0).stop 2024-04-26T20:58:20.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.144+0000 7f4465ed18c0 1 -- 172.21.15.138:0/647575910 shutdown_connections 2024-04-26T20:58:20.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.144+0000 7f4465ed18c0 1 --2- 172.21.15.138:0/647575910 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562856787400 0x56285677b080 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.144+0000 7f4465ed18c0 1 --2- 172.21.15.138:0/647575910 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562856787c00 0x56285677b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.144+0000 7f4465ed18c0 1 --2- 172.21.15.138:0/647575910 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5628559a1c00 0x56285677ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.144+0000 7f4465ed18c0 1 -- 172.21.15.138:0/647575910 >> 172.21.15.138:0/647575910 conn(0x5628559a0c00 msgr2=0x5628559cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:20.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.144+0000 7f4465ed18c0 1 -- 172.21.15.138:0/647575910 shutdown_connections 2024-04-26T20:58:20.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.144+0000 7f4465ed18c0 1 -- 172.21.15.138:0/647575910 wait complete. 2024-04-26T20:58:20.148 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'init', '--force-init', '--filesystem', 'recovery_fs', '--alternate-pool', 'recovery_fs_metadata'] in time 0:00:00.073739, result: 2024-04-26T20:58:20.149 DEBUG:teuthology.orchestra.run.smithi138:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 recovery_fs:0 reset session 2024-04-26T20:58:20.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.240+0000 7f0d97a47400 1 -- start start 2024-04-26T20:58:20.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.240+0000 7f0d97a47400 1 Processor -- start 2024-04-26T20:58:20.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.240+0000 7f0d97a47400 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e6a5c31c00 0x55e6a6a05080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.240+0000 7f0d97a47400 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e6a5c31800 0x55e6a6a04b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.240+0000 7f0d97a47400 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e6a6a24400 0x55e6a6a05b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.240+0000 7f0d97a47400 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55e6a6a26480 con 0x55e6a6a24400 2024-04-26T20:58:20.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.240+0000 7f0d97a47400 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55e6a6a26600 con 0x55e6a5c31c00 2024-04-26T20:58:20.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.240+0000 7f0d97a47400 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55e6a6a26780 con 0x55e6a5c31800 2024-04-26T20:58:20.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.240+0000 7f0d95a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e6a6a24400 0x55e6a6a05b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.240+0000 7f0d95a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e6a6a24400 0x55e6a6a05b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:54312/0 (socket says 172.21.15.138:54312) 2024-04-26T20:58:20.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.240+0000 7f0d95a00640 1 -- 172.21.15.138:0/1626117748 learned_addr learned my addr 172.21.15.138:0/1626117748 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:20.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.240+0000 7f0d94600640 1 --2- 172.21.15.138:0/1626117748 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e6a5c31800 0x55e6a6a04b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.240+0000 7f0d95000640 1 --2- 172.21.15.138:0/1626117748 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e6a5c31c00 0x55e6a6a05080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.240+0000 7f0d95a00640 1 -- 172.21.15.138:0/1626117748 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e6a5c31800 msgr2=0x55e6a6a04b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:20.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.240+0000 7f0d95a00640 1 --2- 172.21.15.138:0/1626117748 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e6a5c31800 0x55e6a6a04b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.240+0000 7f0d95a00640 1 -- 172.21.15.138:0/1626117748 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e6a5c31c00 msgr2=0x55e6a6a05080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:20.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.240+0000 7f0d95a00640 1 --2- 172.21.15.138:0/1626117748 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e6a5c31c00 0x55e6a6a05080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.240+0000 7f0d95a00640 1 -- 172.21.15.138:0/1626117748 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6a5d0cb40 con 0x55e6a6a24400 2024-04-26T20:58:20.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.240+0000 7f0d95a00640 1 --2- 172.21.15.138:0/1626117748 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e6a6a24400 0x55e6a6a05b80 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x55e6a6aa7200 tx=0x55e6a5d10180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52d4fab86dde3e65 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.240+0000 7f0d91e00640 1 -- 172.21.15.138:0/1626117748 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e6a5c669c0 con 0x55e6a6a24400 2024-04-26T20:58:20.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.240+0000 7f0d91e00640 1 -- 172.21.15.138:0/1626117748 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55e6a5c7a1c0 con 0x55e6a6a24400 2024-04-26T20:58:20.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.240+0000 7f0d91e00640 1 -- 172.21.15.138:0/1626117748 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e6a5c66b60 con 0x55e6a6a24400 2024-04-26T20:58:20.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.240+0000 7f0d97a47400 1 -- 172.21.15.138:0/1626117748 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6a5d0d0e0 con 0x55e6a6a24400 2024-04-26T20:58:20.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.240+0000 7f0d97a47400 1 -- 172.21.15.138:0/1626117748 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55e6a5d0d2c0 con 0x55e6a6a24400 2024-04-26T20:58:20.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.240+0000 7f0d97a47400 4 waiting for MDS map... 2024-04-26T20:58:20.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.240+0000 7f0d91e00640 1 -- 172.21.15.138:0/1626117748 <== mon.0 v2:172.21.15.138:3300/0 4 ==== osd_map(50..50 src has 1..50) ==== 6756+0+0 (secure 0 0 0) 0x55e6a5d0ba00 con 0x55e6a6a24400 2024-04-26T20:58:20.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.240+0000 7f0d91e00640 1 -- 172.21.15.138:0/1626117748 <== mon.0 v2:172.21.15.138:3300/0 5 ==== fsmap(e 23) ==== 4135+0+0 (secure 0 0 0) 0x55e6a5c87180 con 0x55e6a6a24400 2024-04-26T20:58:20.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.240+0000 7f0d97a47400 4 Got MDS map 23 2024-04-26T20:58:20.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.240+0000 7f0d97a47400 10 main: main 2024-04-26T20:58:20.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.240+0000 7f0d97a47400 4 main: connecting to RADOS... 2024-04-26T20:58:20.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.244+0000 7f0d97a47400 1 Processor -- start 2024-04-26T20:58:20.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.244+0000 7f0d97a47400 1 -- start start 2024-04-26T20:58:20.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.244+0000 7f0d97a47400 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e6a5f2e000 0x55e6a6a05600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.244+0000 7f0d97a47400 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e6a5f2e400 0x55e6a6a04580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.244+0000 7f0d97a47400 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e6a5f2e800 0x55e6a6a06100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.244+0000 7f0d97a47400 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55e6a5c90180 con 0x55e6a5f2e400 2024-04-26T20:58:20.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.244+0000 7f0d97a47400 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55e6a6a27680 con 0x55e6a5f2e000 2024-04-26T20:58:20.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.244+0000 7f0d97a47400 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55e6a6a27500 con 0x55e6a5f2e800 2024-04-26T20:58:20.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.244+0000 7f0d95000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e6a5f2e400 0x55e6a6a04580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.244+0000 7f0d95000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e6a5f2e400 0x55e6a6a04580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:54328/0 (socket says 172.21.15.138:54328) 2024-04-26T20:58:20.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.244+0000 7f0d95000640 1 -- 172.21.15.138:0/700353133 learned_addr learned my addr 172.21.15.138:0/700353133 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:20.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.244+0000 7f0d94600640 1 --2- 172.21.15.138:0/700353133 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e6a5f2e000 0x55e6a6a05600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.244+0000 7f0d94600640 1 --2- 172.21.15.138:0/700353133 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e6a5f2e800 0x55e6a6a06100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.244+0000 7f0d95000640 1 -- 172.21.15.138:0/700353133 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e6a5f2e800 msgr2=0x55e6a6a06100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:20.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.244+0000 7f0d95000640 1 --2- 172.21.15.138:0/700353133 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e6a5f2e800 0x55e6a6a06100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.244+0000 7f0d95000640 1 -- 172.21.15.138:0/700353133 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e6a5f2e000 msgr2=0x55e6a6a05600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:20.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.244+0000 7f0d95000640 1 --2- 172.21.15.138:0/700353133 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e6a5f2e000 0x55e6a6a05600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.244+0000 7f0d95000640 1 -- 172.21.15.138:0/700353133 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6a5d0c1e0 con 0x55e6a5f2e400 2024-04-26T20:58:20.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.244+0000 7f0d94600640 1 --2- 172.21.15.138:0/700353133 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e6a5f2e800 0x55e6a6a06100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:58:20.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.244+0000 7f0d95000640 1 --2- 172.21.15.138:0/700353133 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e6a5f2e400 0x55e6a6a04580 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x55e6a6b748d0 tx=0x55e6a6b7b800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95944d7a2086383d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.244+0000 7f0d8f600640 1 -- 172.21.15.138:0/700353133 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e6a5c669c0 con 0x55e6a5f2e400 2024-04-26T20:58:20.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.244+0000 7f0d8f600640 1 -- 172.21.15.138:0/700353133 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55e6a5c7ac40 con 0x55e6a5f2e400 2024-04-26T20:58:20.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.244+0000 7f0d8f600640 1 -- 172.21.15.138:0/700353133 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e6a5c66b60 con 0x55e6a5f2e400 2024-04-26T20:58:20.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.244+0000 7f0d97a47400 1 -- 172.21.15.138:0/700353133 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e6a5f2e400 msgr2=0x55e6a6a04580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.244+0000 7f0d97a47400 1 --2- 172.21.15.138:0/700353133 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e6a5f2e400 0x55e6a6a04580 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x55e6a6b748d0 tx=0x55e6a6b7b800 comp rx=0 tx=0).stop 2024-04-26T20:58:20.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.244+0000 7f0d97a47400 1 -- 172.21.15.138:0/700353133 shutdown_connections 2024-04-26T20:58:20.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.244+0000 7f0d97a47400 1 --2- 172.21.15.138:0/700353133 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e6a5f2e800 0x55e6a6a06100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.244+0000 7f0d97a47400 1 --2- 172.21.15.138:0/700353133 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e6a5f2e400 0x55e6a6a04580 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.244+0000 7f0d97a47400 1 --2- 172.21.15.138:0/700353133 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e6a5f2e000 0x55e6a6a05600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.244+0000 7f0d97a47400 1 -- 172.21.15.138:0/700353133 >> 172.21.15.138:0/700353133 conn(0x55e6a6a24000 msgr2=0x55e6a5f28000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:20.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.244+0000 7f0d97a47400 1 -- 172.21.15.138:0/700353133 shutdown_connections 2024-04-26T20:58:20.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.244+0000 7f0d97a47400 1 -- 172.21.15.138:0/700353133 wait complete. 2024-04-26T20:58:20.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.244+0000 7f0d97a47400 1 Processor -- start 2024-04-26T20:58:20.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.244+0000 7f0d97a47400 1 -- start start 2024-04-26T20:58:20.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.248+0000 7f0d97a47400 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e6a5f2e000 0x55e6a6a07180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.248+0000 7f0d97a47400 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e6a5f2e400 0x55e6a6a06c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.248+0000 7f0d97a47400 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e6a5f2e800 0x55e6a6a06680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.248+0000 7f0d97a47400 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55e6a6a26900 con 0x55e6a5f2e400 2024-04-26T20:58:20.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.248+0000 7f0d97a47400 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55e6a6a26a80 con 0x55e6a5f2e800 2024-04-26T20:58:20.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.248+0000 7f0d97a47400 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55e6a6a26180 con 0x55e6a5f2e000 2024-04-26T20:58:20.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.248+0000 7f0d95000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e6a5f2e400 0x55e6a6a06c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.248+0000 7f0d95000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e6a5f2e400 0x55e6a6a06c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:54332/0 (socket says 172.21.15.138:54332) 2024-04-26T20:58:20.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.248+0000 7f0d95000640 1 -- 172.21.15.138:0/2333160221 learned_addr learned my addr 172.21.15.138:0/2333160221 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:20.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.248+0000 7f0d95000640 1 -- 172.21.15.138:0/2333160221 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e6a5f2e000 msgr2=0x55e6a6a07180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.248+0000 7f0d95000640 1 --2- 172.21.15.138:0/2333160221 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e6a5f2e000 0x55e6a6a07180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.248+0000 7f0d95000640 1 -- 172.21.15.138:0/2333160221 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e6a5f2e800 msgr2=0x55e6a6a06680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.248+0000 7f0d94600640 1 --2- 172.21.15.138:0/2333160221 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e6a5f2e800 0x55e6a6a06680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.248+0000 7f0d95000640 1 --2- 172.21.15.138:0/2333160221 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e6a5f2e800 0x55e6a6a06680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.248+0000 7f0d95000640 1 -- 172.21.15.138:0/2333160221 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6a5d0dc20 con 0x55e6a5f2e400 2024-04-26T20:58:20.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.248+0000 7f0d94600640 1 --2- 172.21.15.138:0/2333160221 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e6a5f2e800 0x55e6a6a06680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:58:20.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.248+0000 7f0d95000640 1 --2- 172.21.15.138:0/2333160221 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e6a5f2e400 0x55e6a6a06c00 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x55e6a6b75590 tx=0x55e6a5d101e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.248+0000 7f0d8d800640 1 -- 172.21.15.138:0/2333160221 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e6a5c66340 con 0x55e6a5f2e400 2024-04-26T20:58:20.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.248+0000 7f0d8d800640 1 -- 172.21.15.138:0/2333160221 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55e6a5c7aa80 con 0x55e6a5f2e400 2024-04-26T20:58:20.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.248+0000 7f0d97a47400 1 -- 172.21.15.138:0/2333160221 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e6a5d0de00 con 0x55e6a5f2e400 2024-04-26T20:58:20.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.248+0000 7f0d8d800640 1 -- 172.21.15.138:0/2333160221 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e6a5c669c0 con 0x55e6a5f2e400 2024-04-26T20:58:20.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.248+0000 7f0d97a47400 1 -- 172.21.15.138:0/2333160221 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6a5d0dc20 con 0x55e6a5f2e400 2024-04-26T20:58:20.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.248+0000 7f0d97a47400 4 main: resolving pool 7 2024-04-26T20:58:20.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.248+0000 7f0d8d800640 1 -- 172.21.15.138:0/2333160221 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x55e6a5f1c900 con 0x55e6a5f2e400 2024-04-26T20:58:20.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.248+0000 7f0d8d800640 1 --2- 172.21.15.138:0/2333160221 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x55e6a6026000 0x55e6a6a07700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.248+0000 7f0d8d800640 1 -- 172.21.15.138:0/2333160221 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6756+0+0 (secure 0 0 0) 0x55e6a6b5e400 con 0x55e6a5f2e400 2024-04-26T20:58:20.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.248+0000 7f0d97a47400 4 main: creating IoCtx.. 2024-04-26T20:58:20.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.248+0000 7f0d97a47400 1 --2- 172.21.15.138:0/2333160221 >> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] conn(0x55e6a5f2ec00 0x55e6a6a06100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.248+0000 7f0d97a47400 1 -- 172.21.15.138:0/2333160221 --> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] -- osd_op(unknown.0.0:1 7.b 7:d0630e4c:::mds0_sessionmap:head [omap-clear,omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) -- 0x55e6a5f2f000 con 0x55e6a5f2ec00 2024-04-26T20:58:20.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.248+0000 7f0d94600640 1 --2- 172.21.15.138:0/2333160221 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x55e6a6026000 0x55e6a6a07700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.252+0000 7f0d94600640 1 --2- 172.21.15.138:0/2333160221 >> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] conn(0x55e6a5f2ec00 0x55e6a6a06100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.252+0000 7f0d94600640 1 --2- 172.21.15.138:0/2333160221 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x55e6a6026000 0x55e6a6a07700 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x55e6a6aa6d20 tx=0x55e6a5d10ea0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.252+0000 7f0d94600640 1 --2- 172.21.15.138:0/2333160221 >> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] conn(0x55e6a5f2ec00 0x55e6a6a06100 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.252+0000 7f0d94600640 1 -- 172.21.15.138:0/2333160221 <== osd.6 v2:172.21.15.143:6816/1082239825 1 ==== osd_op_reply(1 mds0_sessionmap [omap-clear,omap-set-header] v50'1 uv1 ondisk = 0) ==== 201+0+0 (crc 0 0 0) 0x55e6a69ba000 con 0x55e6a5f2ec00 2024-04-26T20:58:20.257 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-26T20:58:20.257 INFO:teuthology.orchestra.run.smithi138.stdout: "0": { 2024-04-26T20:58:20.257 INFO:teuthology.orchestra.run.smithi138.stdout: "data": {}, 2024-04-26T20:58:20.257 INFO:teuthology.orchestra.run.smithi138.stdout: "result": 0 2024-04-26T20:58:20.257 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-26T20:58:20.257 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-26T20:58:20.257 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:20.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.252+0000 7f0d97a47400 1 -- 172.21.15.138:0/2333160221 >> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] conn(0x55e6a5f2ec00 msgr2=0x55e6a6a06100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.252+0000 7f0d97a47400 1 --2- 172.21.15.138:0/2333160221 >> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] conn(0x55e6a5f2ec00 0x55e6a6a06100 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.252+0000 7f0d97a47400 1 -- 172.21.15.138:0/2333160221 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x55e6a6026000 msgr2=0x55e6a6a07700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.252+0000 7f0d97a47400 1 --2- 172.21.15.138:0/2333160221 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x55e6a6026000 0x55e6a6a07700 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x55e6a6aa6d20 tx=0x55e6a5d10ea0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.252+0000 7f0d97a47400 1 -- 172.21.15.138:0/2333160221 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e6a5f2e400 msgr2=0x55e6a6a06c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.252+0000 7f0d97a47400 1 --2- 172.21.15.138:0/2333160221 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e6a5f2e400 0x55e6a6a06c00 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x55e6a6b75590 tx=0x55e6a5d101e0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.252+0000 7f0d95000640 1 -- 172.21.15.138:0/2333160221 reap_dead start 2024-04-26T20:58:20.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.252+0000 7f0d97a47400 1 -- 172.21.15.138:0/2333160221 shutdown_connections 2024-04-26T20:58:20.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.252+0000 7f0d97a47400 1 -- 172.21.15.138:0/2333160221 >> 172.21.15.138:0/2333160221 conn(0x55e6a6a24000 msgr2=0x55e6a5f28000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:20.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.252+0000 7f0d97a47400 1 -- 172.21.15.138:0/2333160221 shutdown_connections 2024-04-26T20:58:20.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.252+0000 7f0d97a47400 1 -- 172.21.15.138:0/2333160221 wait complete. 2024-04-26T20:58:20.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.252+0000 7f0d97a47400 1 -- 172.21.15.138:0/1626117748 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e6a6a24400 msgr2=0x55e6a6a05b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.252+0000 7f0d97a47400 1 --2- 172.21.15.138:0/1626117748 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e6a6a24400 0x55e6a6a05b80 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x55e6a6aa7200 tx=0x55e6a5d10180 comp rx=0 tx=0).stop 2024-04-26T20:58:20.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.252+0000 7f0d97a47400 1 -- 172.21.15.138:0/1626117748 shutdown_connections 2024-04-26T20:58:20.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.252+0000 7f0d97a47400 1 --2- 172.21.15.138:0/1626117748 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e6a6a24400 0x55e6a6a05b80 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.252+0000 7f0d97a47400 1 --2- 172.21.15.138:0/1626117748 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e6a5c31800 0x55e6a6a04b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.252+0000 7f0d97a47400 1 --2- 172.21.15.138:0/1626117748 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e6a5c31c00 0x55e6a6a05080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.252+0000 7f0d97a47400 1 -- 172.21.15.138:0/1626117748 >> 172.21.15.138:0/1626117748 conn(0x55e6a5c30c00 msgr2=0x55e6a5c5e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:20.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.252+0000 7f0d97a47400 1 -- 172.21.15.138:0/1626117748 shutdown_connections 2024-04-26T20:58:20.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.252+0000 7f0d97a47400 1 -- 172.21.15.138:0/1626117748 wait complete. 2024-04-26T20:58:20.261 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'recovery_fs:0', 'reset', 'session'] in time 0:00:00.112461, result: { "0": { "data": {}, "result": 0 } } 2024-04-26T20:58:20.261 DEBUG:teuthology.orchestra.run.smithi138:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 recovery_fs:0 reset snap 2024-04-26T20:58:20.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.348+0000 7fec5d92f400 1 -- start start 2024-04-26T20:58:20.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.348+0000 7fec5d92f400 1 Processor -- start 2024-04-26T20:58:20.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.348+0000 7fec5d92f400 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559ddf855800 0x559de0622000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.348+0000 7fec5d92f400 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559ddf855400 0x559de0622580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.348+0000 7fec5d92f400 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559ddf855000 0x559de0622b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.348+0000 7fec5d92f400 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x559de0636600 con 0x559ddf855000 2024-04-26T20:58:20.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.348+0000 7fec5d92f400 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x559de0636480 con 0x559ddf855400 2024-04-26T20:58:20.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.348+0000 7fec5d92f400 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x559de0636300 con 0x559ddf855800 2024-04-26T20:58:20.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.348+0000 7fec5c400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559ddf855000 0x559de0622b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.348+0000 7fec5c400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559ddf855000 0x559de0622b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:54354/0 (socket says 172.21.15.138:54354) 2024-04-26T20:58:20.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.348+0000 7fec5c400640 1 -- 172.21.15.138:0/325140210 learned_addr learned my addr 172.21.15.138:0/325140210 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:20.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.352+0000 7fec5b000640 1 --2- 172.21.15.138:0/325140210 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559ddf855400 0x559de0622580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.352+0000 7fec5ba00640 1 --2- 172.21.15.138:0/325140210 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559ddf855800 0x559de0622000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.352+0000 7fec5c400640 1 -- 172.21.15.138:0/325140210 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559ddf855800 msgr2=0x559de0622000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:20.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.352+0000 7fec5c400640 1 --2- 172.21.15.138:0/325140210 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559ddf855800 0x559de0622000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.352+0000 7fec5c400640 1 -- 172.21.15.138:0/325140210 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559ddf855400 msgr2=0x559de0622580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:20.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.352+0000 7fec5c400640 1 --2- 172.21.15.138:0/325140210 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559ddf855400 0x559de0622580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.352+0000 7fec5c400640 1 -- 172.21.15.138:0/325140210 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559de05ca960 con 0x559ddf855000 2024-04-26T20:58:20.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.352+0000 7fec5b000640 1 --2- 172.21.15.138:0/325140210 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559ddf855400 0x559de0622580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:58:20.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.352+0000 7fec5ba00640 1 --2- 172.21.15.138:0/325140210 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559ddf855800 0x559de0622000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:58:20.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.352+0000 7fec5c400640 1 --2- 172.21.15.138:0/325140210 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559ddf855000 0x559de0622b00 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x559de06c5320 tx=0x559ddf935500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbf731f314077d02 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.352+0000 7fec58800640 1 -- 172.21.15.138:0/325140210 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559ddf88a4e0 con 0x559ddf855000 2024-04-26T20:58:20.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.352+0000 7fec58800640 1 -- 172.21.15.138:0/325140210 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x559ddf89e540 con 0x559ddf855000 2024-04-26T20:58:20.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.352+0000 7fec58800640 1 -- 172.21.15.138:0/325140210 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559ddf88ab60 con 0x559ddf855000 2024-04-26T20:58:20.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.352+0000 7fec5d92f400 1 -- 172.21.15.138:0/325140210 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559de05cad20 con 0x559ddf855000 2024-04-26T20:58:20.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.352+0000 7fec5d92f400 1 -- 172.21.15.138:0/325140210 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({fsmap=0}) -- 0x559de05caf00 con 0x559ddf855000 2024-04-26T20:58:20.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.352+0000 7fec5d92f400 4 waiting for MDS map... 2024-04-26T20:58:20.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.352+0000 7fec58800640 1 -- 172.21.15.138:0/325140210 <== mon.0 v2:172.21.15.138:3300/0 4 ==== osd_map(50..50 src has 1..50) ==== 6756+0+0 (secure 0 0 0) 0x559de0778600 con 0x559ddf855000 2024-04-26T20:58:20.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.352+0000 7fec58800640 1 -- 172.21.15.138:0/325140210 <== mon.0 v2:172.21.15.138:3300/0 5 ==== fsmap(e 23) ==== 4135+0+0 (secure 0 0 0) 0x559ddf8ab180 con 0x559ddf855000 2024-04-26T20:58:20.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.352+0000 7fec5d92f400 4 Got MDS map 23 2024-04-26T20:58:20.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.352+0000 7fec5d92f400 10 main: main 2024-04-26T20:58:20.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.352+0000 7fec5d92f400 4 main: connecting to RADOS... 2024-04-26T20:58:20.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.352+0000 7fec5d92f400 1 Processor -- start 2024-04-26T20:58:20.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.352+0000 7fec5d92f400 1 -- start start 2024-04-26T20:58:20.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.352+0000 7fec5d92f400 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559de077d800 0x559de0623080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.352+0000 7fec5d92f400 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559de077dc00 0x559de0623600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.352+0000 7fec5d92f400 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559de07d6000 0x559de0623b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.352+0000 7fec5d92f400 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x559de0636180 con 0x559de07d6000 2024-04-26T20:58:20.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.352+0000 7fec5d92f400 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x559ddf8b4480 con 0x559de077d800 2024-04-26T20:58:20.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.352+0000 7fec5d92f400 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x559ddf8b4900 con 0x559de077dc00 2024-04-26T20:58:20.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.352+0000 7fec5b000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559de07d6000 0x559de0623b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.352+0000 7fec5b000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559de07d6000 0x559de0623b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:54358/0 (socket says 172.21.15.138:54358) 2024-04-26T20:58:20.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.352+0000 7fec5b000640 1 -- 172.21.15.138:0/3392073996 learned_addr learned my addr 172.21.15.138:0/3392073996 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:20.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.352+0000 7fec5ba00640 1 --2- 172.21.15.138:0/3392073996 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559de077dc00 0x559de0623600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.352+0000 7fec5b000640 1 --2- 172.21.15.138:0/3392073996 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559de077d800 0x559de0623080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.352+0000 7fec5b000640 1 -- 172.21.15.138:0/3392073996 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559de077dc00 msgr2=0x559de0623600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:20.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.352+0000 7fec5b000640 1 --2- 172.21.15.138:0/3392073996 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559de077dc00 0x559de0623600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.352+0000 7fec5b000640 1 -- 172.21.15.138:0/3392073996 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559de077d800 msgr2=0x559de0623080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:20.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.352+0000 7fec5b000640 1 --2- 172.21.15.138:0/3392073996 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559de077d800 0x559de0623080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.352+0000 7fec5b000640 1 -- 172.21.15.138:0/3392073996 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559de05cad20 con 0x559de07d6000 2024-04-26T20:58:20.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.352+0000 7fec5b000640 1 --2- 172.21.15.138:0/3392073996 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559de07d6000 0x559de0623b80 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x559de06c49c0 tx=0x559ddf932840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ed115100639008a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.356+0000 7fec56000640 1 -- 172.21.15.138:0/3392073996 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559ddf88a9c0 con 0x559de07d6000 2024-04-26T20:58:20.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.356+0000 7fec56000640 1 -- 172.21.15.138:0/3392073996 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x559ddf89ea80 con 0x559de07d6000 2024-04-26T20:58:20.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.356+0000 7fec56000640 1 -- 172.21.15.138:0/3392073996 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559ddf88a4e0 con 0x559de07d6000 2024-04-26T20:58:20.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.356+0000 7fec5d92f400 1 -- 172.21.15.138:0/3392073996 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559de07d6000 msgr2=0x559de0623b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.356+0000 7fec5d92f400 1 --2- 172.21.15.138:0/3392073996 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559de07d6000 0x559de0623b80 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x559de06c49c0 tx=0x559ddf932840 comp rx=0 tx=0).stop 2024-04-26T20:58:20.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.356+0000 7fec5d92f400 1 -- 172.21.15.138:0/3392073996 shutdown_connections 2024-04-26T20:58:20.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.356+0000 7fec5d92f400 1 --2- 172.21.15.138:0/3392073996 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559de07d6000 0x559de0623b80 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.356+0000 7fec5d92f400 1 --2- 172.21.15.138:0/3392073996 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559de077dc00 0x559de0623600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.356+0000 7fec5d92f400 1 --2- 172.21.15.138:0/3392073996 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559de077d800 0x559de0623080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.356+0000 7fec5d92f400 1 -- 172.21.15.138:0/3392073996 >> 172.21.15.138:0/3392073996 conn(0x559ddf854c00 msgr2=0x559ddf881000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:20.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.356+0000 7fec5d92f400 1 -- 172.21.15.138:0/3392073996 shutdown_connections 2024-04-26T20:58:20.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.356+0000 7fec5d92f400 1 -- 172.21.15.138:0/3392073996 wait complete. 2024-04-26T20:58:20.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.356+0000 7fec5d92f400 1 Processor -- start 2024-04-26T20:58:20.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.356+0000 7fec5d92f400 1 -- start start 2024-04-26T20:58:20.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.356+0000 7fec5d92f400 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559de077dc00 0x559de0623080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.356+0000 7fec5d92f400 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559de077d800 0x559de0623600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.356+0000 7fec5d92f400 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559de07e0000 0x559de0623b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.356+0000 7fec5d92f400 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x559de0637980 con 0x559de077dc00 2024-04-26T20:58:20.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.356+0000 7fec5d92f400 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x559de0636180 con 0x559de077d800 2024-04-26T20:58:20.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.356+0000 7fec5d92f400 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x559de0637800 con 0x559de07e0000 2024-04-26T20:58:20.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.356+0000 7fec5b000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559de077dc00 0x559de0623080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.356+0000 7fec5b000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559de077dc00 0x559de0623080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:54362/0 (socket says 172.21.15.138:54362) 2024-04-26T20:58:20.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.356+0000 7fec5b000640 1 -- 172.21.15.138:0/3510174898 learned_addr learned my addr 172.21.15.138:0/3510174898 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:20.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.356+0000 7fec5ba00640 1 --2- 172.21.15.138:0/3510174898 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559de077d800 0x559de0623600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.356+0000 7fec5b000640 1 --2- 172.21.15.138:0/3510174898 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559de07e0000 0x559de0623b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.356+0000 7fec5b000640 1 -- 172.21.15.138:0/3510174898 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559de07e0000 msgr2=0x559de0623b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.356+0000 7fec5b000640 1 --2- 172.21.15.138:0/3510174898 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559de07e0000 0x559de0623b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.356+0000 7fec5b000640 1 -- 172.21.15.138:0/3510174898 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559de077d800 msgr2=0x559de0623600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.356+0000 7fec5b000640 1 --2- 172.21.15.138:0/3510174898 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559de077d800 0x559de0623600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.356+0000 7fec5b000640 1 -- 172.21.15.138:0/3510174898 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559de05cba40 con 0x559de077dc00 2024-04-26T20:58:20.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.356+0000 7fec5b000640 1 --2- 172.21.15.138:0/3510174898 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559de077dc00 0x559de0623080 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x559de078a7e0 tx=0x559ddf9328a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.356+0000 7fec54200640 1 -- 172.21.15.138:0/3510174898 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559ddf88ab60 con 0x559de077dc00 2024-04-26T20:58:20.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.356+0000 7fec54200640 1 -- 172.21.15.138:0/3510174898 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x559ddf89f340 con 0x559de077dc00 2024-04-26T20:58:20.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.356+0000 7fec54200640 1 -- 172.21.15.138:0/3510174898 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559ddf88a000 con 0x559de077dc00 2024-04-26T20:58:20.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.356+0000 7fec5d92f400 1 -- 172.21.15.138:0/3510174898 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559de05cbc20 con 0x559de077dc00 2024-04-26T20:58:20.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.356+0000 7fec5d92f400 1 -- 172.21.15.138:0/3510174898 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559de05ca1e0 con 0x559de077dc00 2024-04-26T20:58:20.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.356+0000 7fec5d92f400 4 main: resolving pool 7 2024-04-26T20:58:20.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.360+0000 7fec54200640 1 -- 172.21.15.138:0/3510174898 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x559de07be900 con 0x559de077dc00 2024-04-26T20:58:20.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.360+0000 7fec54200640 1 --2- 172.21.15.138:0/3510174898 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x559ddfc3c000 0x559de0624100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.360+0000 7fec54200640 1 -- 172.21.15.138:0/3510174898 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6756+0+0 (secure 0 0 0) 0x559ddfb52600 con 0x559de077dc00 2024-04-26T20:58:20.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.360+0000 7fec5d92f400 4 main: creating IoCtx.. 2024-04-26T20:58:20.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.360+0000 7fec5d92f400 1 --2- 172.21.15.138:0/3510174898 >> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] conn(0x559de07e0400 0x559de0624680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.360+0000 7fec5ba00640 1 --2- 172.21.15.138:0/3510174898 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x559ddfc3c000 0x559de0624100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.360+0000 7fec5d92f400 1 -- 172.21.15.138:0/3510174898 --> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] -- osd_op(unknown.0.0:1 7.d 7:b50e409b:::mds_snaptable:head [writefull 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) -- 0x559de07e0800 con 0x559de07e0400 2024-04-26T20:58:20.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.360+0000 7fec5b000640 1 --2- 172.21.15.138:0/3510174898 >> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] conn(0x559de07e0400 0x559de0624680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.360+0000 7fec5ba00640 1 --2- 172.21.15.138:0/3510174898 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x559ddfc3c000 0x559de0624100 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x559ddf9c87e0 tx=0x559ddfbd4e40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.360+0000 7fec5b000640 1 --2- 172.21.15.138:0/3510174898 >> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] conn(0x559de07e0400 0x559de0624680 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.364+0000 7fec5b000640 1 -- 172.21.15.138:0/3510174898 <== osd.1 v2:172.21.15.138:6816/1427635773 1 ==== osd_op_reply(1 mds_snaptable [writefull 0~70] v50'1 uv1 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x559de05de000 con 0x559de07e0400 2024-04-26T20:58:20.366 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-26T20:58:20.366 INFO:teuthology.orchestra.run.smithi138.stdout: "result": 0 2024-04-26T20:58:20.367 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-26T20:58:20.367 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:20.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.364+0000 7fec5d92f400 1 -- 172.21.15.138:0/3510174898 >> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] conn(0x559de07e0400 msgr2=0x559de0624680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.364+0000 7fec5d92f400 1 --2- 172.21.15.138:0/3510174898 >> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] conn(0x559de07e0400 0x559de0624680 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.364+0000 7fec5d92f400 1 -- 172.21.15.138:0/3510174898 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x559ddfc3c000 msgr2=0x559de0624100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.364+0000 7fec5d92f400 1 --2- 172.21.15.138:0/3510174898 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x559ddfc3c000 0x559de0624100 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x559ddf9c87e0 tx=0x559ddfbd4e40 comp rx=0 tx=0).stop 2024-04-26T20:58:20.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.364+0000 7fec5d92f400 1 -- 172.21.15.138:0/3510174898 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559de077dc00 msgr2=0x559de0623080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.364+0000 7fec5d92f400 1 --2- 172.21.15.138:0/3510174898 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559de077dc00 0x559de0623080 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x559de078a7e0 tx=0x559ddf9328a0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.364+0000 7fec5ba00640 1 -- 172.21.15.138:0/3510174898 reap_dead start 2024-04-26T20:58:20.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.364+0000 7fec5d92f400 1 -- 172.21.15.138:0/3510174898 shutdown_connections 2024-04-26T20:58:20.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.364+0000 7fec5d92f400 1 -- 172.21.15.138:0/3510174898 >> 172.21.15.138:0/3510174898 conn(0x559ddf854c00 msgr2=0x559ddf881000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:20.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.364+0000 7fec5d92f400 1 -- 172.21.15.138:0/3510174898 shutdown_connections 2024-04-26T20:58:20.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.364+0000 7fec5d92f400 1 -- 172.21.15.138:0/3510174898 wait complete. 2024-04-26T20:58:20.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.364+0000 7fec5d92f400 1 -- 172.21.15.138:0/325140210 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559ddf855000 msgr2=0x559de0622b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.364+0000 7fec5d92f400 1 --2- 172.21.15.138:0/325140210 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559ddf855000 0x559de0622b00 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x559de06c5320 tx=0x559ddf935500 comp rx=0 tx=0).stop 2024-04-26T20:58:20.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.364+0000 7fec5d92f400 1 -- 172.21.15.138:0/325140210 shutdown_connections 2024-04-26T20:58:20.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.364+0000 7fec5d92f400 1 --2- 172.21.15.138:0/325140210 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559ddf855000 0x559de0622b00 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.364+0000 7fec5d92f400 1 --2- 172.21.15.138:0/325140210 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559ddf855400 0x559de0622580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.364+0000 7fec5d92f400 1 --2- 172.21.15.138:0/325140210 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559ddf855800 0x559de0622000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.364+0000 7fec5d92f400 1 -- 172.21.15.138:0/325140210 >> 172.21.15.138:0/325140210 conn(0x559ddf855c00 msgr2=0x559ddf881800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:20.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.364+0000 7fec5d92f400 1 -- 172.21.15.138:0/325140210 shutdown_connections 2024-04-26T20:58:20.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.364+0000 7fec5d92f400 1 -- 172.21.15.138:0/325140210 wait complete. 2024-04-26T20:58:20.370 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'recovery_fs:0', 'reset', 'snap'] in time 0:00:00.109044, result: { "result": 0 } 2024-04-26T20:58:20.373 DEBUG:teuthology.orchestra.run.smithi138:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 recovery_fs:0 reset inode 2024-04-26T20:58:20.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.456+0000 7f2c62920400 1 -- start start 2024-04-26T20:58:20.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.456+0000 7f2c62920400 1 Processor -- start 2024-04-26T20:58:20.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.456+0000 7f2c62920400 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560527f17800 0x560528ce0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.456+0000 7f2c62920400 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560527f17400 0x560528ce0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.456+0000 7f2c62920400 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560527f17000 0x560528ce0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.456+0000 7f2c62920400 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x560528cf6180 con 0x560527f17800 2024-04-26T20:58:20.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.456+0000 7f2c62920400 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x560528cf6300 con 0x560527f17400 2024-04-26T20:58:20.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.456+0000 7f2c62920400 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x560528cf6480 con 0x560527f17000 2024-04-26T20:58:20.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.460+0000 7f2c60a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560527f17800 0x560528ce0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.460+0000 7f2c60a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560527f17800 0x560528ce0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:54370/0 (socket says 172.21.15.138:54370) 2024-04-26T20:58:20.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.460+0000 7f2c60a00640 1 -- 172.21.15.138:0/3362124646 learned_addr learned my addr 172.21.15.138:0/3362124646 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:20.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.460+0000 7f2c61400640 1 --2- 172.21.15.138:0/3362124646 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560527f17000 0x560528ce0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.460+0000 7f2c60000640 1 --2- 172.21.15.138:0/3362124646 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560527f17400 0x560528ce0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.460+0000 7f2c60a00640 1 -- 172.21.15.138:0/3362124646 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560527f17000 msgr2=0x560528ce0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:20.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.460+0000 7f2c60a00640 1 --2- 172.21.15.138:0/3362124646 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560527f17000 0x560528ce0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.460+0000 7f2c60a00640 1 -- 172.21.15.138:0/3362124646 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560527f17400 msgr2=0x560528ce0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:20.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.460+0000 7f2c60a00640 1 --2- 172.21.15.138:0/3362124646 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560527f17400 0x560528ce0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.460+0000 7f2c60a00640 1 -- 172.21.15.138:0/3362124646 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560528c8cb40 con 0x560527f17800 2024-04-26T20:58:20.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.460+0000 7f2c61400640 1 --2- 172.21.15.138:0/3362124646 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560527f17000 0x560528ce0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:58:20.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.460+0000 7f2c60000640 1 --2- 172.21.15.138:0/3362124646 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560527f17400 0x560528ce0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:58:20.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.460+0000 7f2c60a00640 1 --2- 172.21.15.138:0/3362124646 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560527f17800 0x560528ce0000 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x560528d8b350 tx=0x560527ff7500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8030700fd78f75a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.460+0000 7f2c5d800640 1 -- 172.21.15.138:0/3362124646 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x560527f4c4e0 con 0x560527f17800 2024-04-26T20:58:20.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.460+0000 7f2c5d800640 1 -- 172.21.15.138:0/3362124646 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x560527f601c0 con 0x560527f17800 2024-04-26T20:58:20.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.460+0000 7f2c5d800640 1 -- 172.21.15.138:0/3362124646 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x560527f4cb60 con 0x560527f17800 2024-04-26T20:58:20.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.460+0000 7f2c62920400 1 -- 172.21.15.138:0/3362124646 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560528c8cd20 con 0x560527f17800 2024-04-26T20:58:20.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.460+0000 7f2c62920400 1 -- 172.21.15.138:0/3362124646 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({fsmap=0}) -- 0x560528c8cf00 con 0x560527f17800 2024-04-26T20:58:20.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.460+0000 7f2c62920400 4 waiting for MDS map... 2024-04-26T20:58:20.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.460+0000 7f2c5d800640 1 -- 172.21.15.138:0/3362124646 <== mon.0 v2:172.21.15.138:3300/0 4 ==== osd_map(50..50 src has 1..50) ==== 6756+0+0 (secure 0 0 0) 0x560528e36600 con 0x560527f17800 2024-04-26T20:58:20.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.460+0000 7f2c5d800640 1 -- 172.21.15.138:0/3362124646 <== mon.0 v2:172.21.15.138:3300/0 5 ==== fsmap(e 23) ==== 4135+0+0 (secure 0 0 0) 0x560527f6d180 con 0x560527f17800 2024-04-26T20:58:20.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.460+0000 7f2c62920400 4 Got MDS map 23 2024-04-26T20:58:20.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.460+0000 7f2c62920400 10 main: main 2024-04-26T20:58:20.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.460+0000 7f2c62920400 4 main: connecting to RADOS... 2024-04-26T20:58:20.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.460+0000 7f2c62920400 1 Processor -- start 2024-04-26T20:58:20.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.460+0000 7f2c62920400 1 -- start start 2024-04-26T20:58:20.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.460+0000 7f2c62920400 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560528e3b800 0x560528ce1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.460+0000 7f2c62920400 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560528e3bc00 0x560528ce1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.460+0000 7f2c62920400 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560528208000 0x560528ce1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.460+0000 7f2c62920400 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x560528cf6600 con 0x560528208000 2024-04-26T20:58:20.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.460+0000 7f2c62920400 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x560528cf6780 con 0x560528e3bc00 2024-04-26T20:58:20.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.460+0000 7f2c62920400 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x560528cf6900 con 0x560528e3b800 2024-04-26T20:58:20.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.460+0000 7f2c60000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560528208000 0x560528ce1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.460+0000 7f2c60000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560528208000 0x560528ce1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:54386/0 (socket says 172.21.15.138:54386) 2024-04-26T20:58:20.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.460+0000 7f2c60000640 1 -- 172.21.15.138:0/143048613 learned_addr learned my addr 172.21.15.138:0/143048613 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:20.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.460+0000 7f2c60a00640 1 --2- 172.21.15.138:0/143048613 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560528e3bc00 0x560528ce1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.460+0000 7f2c61400640 1 --2- 172.21.15.138:0/143048613 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560528e3b800 0x560528ce1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.460+0000 7f2c60000640 1 -- 172.21.15.138:0/143048613 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560528e3b800 msgr2=0x560528ce1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:20.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.460+0000 7f2c60000640 1 --2- 172.21.15.138:0/143048613 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560528e3b800 0x560528ce1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.460+0000 7f2c60000640 1 -- 172.21.15.138:0/143048613 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560528e3bc00 msgr2=0x560528ce1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:20.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.460+0000 7f2c60000640 1 --2- 172.21.15.138:0/143048613 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560528e3bc00 0x560528ce1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.460+0000 7f2c60000640 1 -- 172.21.15.138:0/143048613 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560528c8cd20 con 0x560528208000 2024-04-26T20:58:20.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.464+0000 7f2c60000640 1 --2- 172.21.15.138:0/143048613 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560528208000 0x560528ce1b80 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x560528e48870 tx=0x560528e45b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28cac8580f239e94 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.464+0000 7f2c5b000640 1 -- 172.21.15.138:0/143048613 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x560527f4c4e0 con 0x560528208000 2024-04-26T20:58:20.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.464+0000 7f2c5b000640 1 -- 172.21.15.138:0/143048613 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x560527f60e00 con 0x560528208000 2024-04-26T20:58:20.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.464+0000 7f2c5b000640 1 -- 172.21.15.138:0/143048613 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x560527f4cb60 con 0x560528208000 2024-04-26T20:58:20.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.464+0000 7f2c62920400 1 -- 172.21.15.138:0/143048613 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560528208000 msgr2=0x560528ce1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.464+0000 7f2c62920400 1 --2- 172.21.15.138:0/143048613 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560528208000 0x560528ce1b80 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x560528e48870 tx=0x560528e45b00 comp rx=0 tx=0).stop 2024-04-26T20:58:20.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.464+0000 7f2c62920400 1 -- 172.21.15.138:0/143048613 shutdown_connections 2024-04-26T20:58:20.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.464+0000 7f2c62920400 1 --2- 172.21.15.138:0/143048613 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560528208000 0x560528ce1b80 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.464+0000 7f2c62920400 1 --2- 172.21.15.138:0/143048613 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560528e3bc00 0x560528ce1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.464+0000 7f2c62920400 1 --2- 172.21.15.138:0/143048613 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560528e3b800 0x560528ce1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.464+0000 7f2c62920400 1 -- 172.21.15.138:0/143048613 >> 172.21.15.138:0/143048613 conn(0x560527f16c00 msgr2=0x560527f45800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:20.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.464+0000 7f2c62920400 1 -- 172.21.15.138:0/143048613 shutdown_connections 2024-04-26T20:58:20.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.464+0000 7f2c62920400 1 -- 172.21.15.138:0/143048613 wait complete. 2024-04-26T20:58:20.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.464+0000 7f2c62920400 1 Processor -- start 2024-04-26T20:58:20.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.464+0000 7f2c62920400 1 -- start start 2024-04-26T20:58:20.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.464+0000 7f2c62920400 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560528209800 0x560528ce1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.464+0000 7f2c62920400 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560528209400 0x560528ce1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.464+0000 7f2c62920400 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560528209000 0x560528ce1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.464+0000 7f2c62920400 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x560528cf6900 con 0x560528209800 2024-04-26T20:58:20.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.464+0000 7f2c62920400 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x560528cf6a80 con 0x560528209400 2024-04-26T20:58:20.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.464+0000 7f2c62920400 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x560528cf6780 con 0x560528209000 2024-04-26T20:58:20.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.464+0000 7f2c61400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560528209800 0x560528ce1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.464+0000 7f2c61400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560528209800 0x560528ce1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:54402/0 (socket says 172.21.15.138:54402) 2024-04-26T20:58:20.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.464+0000 7f2c61400640 1 -- 172.21.15.138:0/3301522054 learned_addr learned my addr 172.21.15.138:0/3301522054 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:20.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.464+0000 7f2c60a00640 1 --2- 172.21.15.138:0/3301522054 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560528209400 0x560528ce1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.464+0000 7f2c60000640 1 --2- 172.21.15.138:0/3301522054 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560528209000 0x560528ce1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.464+0000 7f2c61400640 1 -- 172.21.15.138:0/3301522054 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560528209000 msgr2=0x560528ce1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.464+0000 7f2c61400640 1 --2- 172.21.15.138:0/3301522054 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560528209000 0x560528ce1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.464+0000 7f2c61400640 1 -- 172.21.15.138:0/3301522054 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560528209400 msgr2=0x560528ce1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.464+0000 7f2c61400640 1 --2- 172.21.15.138:0/3301522054 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560528209400 0x560528ce1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.464+0000 7f2c61400640 1 -- 172.21.15.138:0/3301522054 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560528c8dc20 con 0x560528209800 2024-04-26T20:58:20.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.464+0000 7f2c61400640 1 --2- 172.21.15.138:0/3301522054 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560528209800 0x560528ce1b80 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x560528d8a960 tx=0x560527ff48a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.464+0000 7f2c59200640 1 -- 172.21.15.138:0/3301522054 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x560527f4c9c0 con 0x560528209800 2024-04-26T20:58:20.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.464+0000 7f2c59200640 1 -- 172.21.15.138:0/3301522054 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x560527f60c40 con 0x560528209800 2024-04-26T20:58:20.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.464+0000 7f2c59200640 1 -- 172.21.15.138:0/3301522054 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x560527f4c4e0 con 0x560528209800 2024-04-26T20:58:20.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.464+0000 7f2c62920400 1 -- 172.21.15.138:0/3301522054 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560528c8de00 con 0x560528209800 2024-04-26T20:58:20.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.464+0000 7f2c62920400 1 -- 172.21.15.138:0/3301522054 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560528c8c1e0 con 0x560528209800 2024-04-26T20:58:20.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.464+0000 7f2c62920400 4 main: resolving pool 7 2024-04-26T20:58:20.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.468+0000 7f2c59200640 1 -- 172.21.15.138:0/3301522054 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x560528e88900 con 0x560528209800 2024-04-26T20:58:20.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.468+0000 7f2c59200640 1 --2- 172.21.15.138:0/3301522054 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x560528216800 0x560528ce2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.468+0000 7f2c59200640 1 -- 172.21.15.138:0/3301522054 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6756+0+0 (secure 0 0 0) 0x560528220600 con 0x560528209800 2024-04-26T20:58:20.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.468+0000 7f2c62920400 4 main: creating IoCtx.. 2024-04-26T20:58:20.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.468+0000 7f2c62920400 1 --2- 172.21.15.138:0/3301522054 >> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] conn(0x560528208c00 0x560528ce2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.468+0000 7f2c62920400 1 -- 172.21.15.138:0/3301522054 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- osd_op(unknown.0.0:1 7.13 7:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) -- 0x560528208800 con 0x560528208c00 2024-04-26T20:58:20.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.468+0000 7f2c60a00640 1 --2- 172.21.15.138:0/3301522054 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x560528216800 0x560528ce2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.468+0000 7f2c60000640 1 --2- 172.21.15.138:0/3301522054 >> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] conn(0x560528208c00 0x560528ce2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.468+0000 7f2c60a00640 1 --2- 172.21.15.138:0/3301522054 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x560528216800 0x560528ce2100 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x560528d8bbc0 tx=0x560527ff7380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.468+0000 7f2c60000640 1 --2- 172.21.15.138:0/3301522054 >> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] conn(0x560528208c00 0x560528ce2680 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.472+0000 7f2c60000640 1 -- 172.21.15.138:0/3301522054 <== osd.7 v2:172.21.15.143:6824/3295508495 1 ==== osd_op_reply(1 mds0_inotable [writefull 0~34] v50'2 uv2 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x560528ca0000 con 0x560528208c00 2024-04-26T20:58:20.474 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-26T20:58:20.474 INFO:teuthology.orchestra.run.smithi138.stdout: "0": { 2024-04-26T20:58:20.474 INFO:teuthology.orchestra.run.smithi138.stdout: "data": {}, 2024-04-26T20:58:20.474 INFO:teuthology.orchestra.run.smithi138.stdout: "result": 0 2024-04-26T20:58:20.474 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-26T20:58:20.474 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-26T20:58:20.474 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:20.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.472+0000 7f2c62920400 1 -- 172.21.15.138:0/3301522054 >> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] conn(0x560528208c00 msgr2=0x560528ce2680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.472+0000 7f2c62920400 1 --2- 172.21.15.138:0/3301522054 >> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] conn(0x560528208c00 0x560528ce2680 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.472+0000 7f2c62920400 1 -- 172.21.15.138:0/3301522054 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x560528216800 msgr2=0x560528ce2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.472+0000 7f2c62920400 1 --2- 172.21.15.138:0/3301522054 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x560528216800 0x560528ce2100 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x560528d8bbc0 tx=0x560527ff7380 comp rx=0 tx=0).stop 2024-04-26T20:58:20.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.472+0000 7f2c62920400 1 -- 172.21.15.138:0/3301522054 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560528209800 msgr2=0x560528ce1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.472+0000 7f2c62920400 1 --2- 172.21.15.138:0/3301522054 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560528209800 0x560528ce1b80 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x560528d8a960 tx=0x560527ff48a0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.472+0000 7f2c60000640 1 -- 172.21.15.138:0/3301522054 reap_dead start 2024-04-26T20:58:20.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.472+0000 7f2c62920400 1 -- 172.21.15.138:0/3301522054 shutdown_connections 2024-04-26T20:58:20.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.472+0000 7f2c62920400 1 -- 172.21.15.138:0/3301522054 >> 172.21.15.138:0/3301522054 conn(0x560527f16c00 msgr2=0x560527f45800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:20.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.472+0000 7f2c62920400 1 -- 172.21.15.138:0/3301522054 shutdown_connections 2024-04-26T20:58:20.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.472+0000 7f2c62920400 1 -- 172.21.15.138:0/3301522054 wait complete. 2024-04-26T20:58:20.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.472+0000 7f2c62920400 1 -- 172.21.15.138:0/3362124646 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560527f17800 msgr2=0x560528ce0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.472+0000 7f2c62920400 1 --2- 172.21.15.138:0/3362124646 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560527f17800 0x560528ce0000 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x560528d8b350 tx=0x560527ff7500 comp rx=0 tx=0).stop 2024-04-26T20:58:20.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.472+0000 7f2c62920400 1 -- 172.21.15.138:0/3362124646 shutdown_connections 2024-04-26T20:58:20.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.472+0000 7f2c62920400 1 --2- 172.21.15.138:0/3362124646 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560527f17000 0x560528ce0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.472+0000 7f2c62920400 1 --2- 172.21.15.138:0/3362124646 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560527f17400 0x560528ce0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.472+0000 7f2c62920400 1 --2- 172.21.15.138:0/3362124646 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560527f17800 0x560528ce0000 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.472+0000 7f2c62920400 1 -- 172.21.15.138:0/3362124646 >> 172.21.15.138:0/3362124646 conn(0x560527f17c00 msgr2=0x560527f45000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:20.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.472+0000 7f2c62920400 1 -- 172.21.15.138:0/3362124646 shutdown_connections 2024-04-26T20:58:20.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.472+0000 7f2c62920400 1 -- 172.21.15.138:0/3362124646 wait complete. 2024-04-26T20:58:20.478 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'recovery_fs:0', 'reset', 'inode'] in time 0:00:00.104549, result: { "0": { "data": {}, "result": 0 } } 2024-04-26T20:58:20.478 DEBUG:teuthology.orchestra.run.smithi138:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_extents --alternate-pool recovery_fs_metadata --filesystem cephfs cephfs_data 2024-04-26T20:58:20.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.564+0000 7fe8347908c0 1 -- start start 2024-04-26T20:58:20.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.564+0000 7fe8347908c0 1 Processor -- start 2024-04-26T20:58:20.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.564+0000 7fe8347908c0 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5594c1f75000 0x5594c2d4a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.564+0000 7fe8347908c0 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5594c1f75400 0x5594c2d4a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.564+0000 7fe8347908c0 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5594c1f75800 0x5594c2d4ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.564+0000 7fe8347908c0 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5594c2e8a180 con 0x5594c1f75800 2024-04-26T20:58:20.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.564+0000 7fe8347908c0 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x5594c2e8a300 con 0x5594c1f75000 2024-04-26T20:58:20.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.564+0000 7fe8347908c0 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x5594c2e8a480 con 0x5594c1f75400 2024-04-26T20:58:20.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.564+0000 7fe833200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5594c1f75800 0x5594c2d4ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.564+0000 7fe833200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5594c1f75800 0x5594c2d4ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:54430/0 (socket says 172.21.15.138:54430) 2024-04-26T20:58:20.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.564+0000 7fe833200640 1 -- 172.21.15.138:0/1882676753 learned_addr learned my addr 172.21.15.138:0/1882676753 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:20.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.564+0000 7fe831e00640 1 --2- 172.21.15.138:0/1882676753 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5594c1f75400 0x5594c2d4a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.564+0000 7fe832800640 1 --2- 172.21.15.138:0/1882676753 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5594c1f75000 0x5594c2d4a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.564+0000 7fe833200640 1 -- 172.21.15.138:0/1882676753 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5594c1f75400 msgr2=0x5594c2d4a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:20.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.564+0000 7fe833200640 1 --2- 172.21.15.138:0/1882676753 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5594c1f75400 0x5594c2d4a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.564+0000 7fe833200640 1 -- 172.21.15.138:0/1882676753 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5594c1f75000 msgr2=0x5594c2d4a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:20.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.564+0000 7fe833200640 1 --2- 172.21.15.138:0/1882676753 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5594c1f75000 0x5594c2d4a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.564+0000 7fe833200640 1 -- 172.21.15.138:0/1882676753 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594c1f9a1e0 con 0x5594c1f75800 2024-04-26T20:58:20.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.564+0000 7fe832800640 1 --2- 172.21.15.138:0/1882676753 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5594c1f75000 0x5594c2d4a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:58:20.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.564+0000 7fe833200640 1 --2- 172.21.15.138:0/1882676753 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5594c1f75800 0x5594c2d4ab00 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x5594c2dd5380 tx=0x5594c205a120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db010970d624fecc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.564+0000 7fe82f600640 1 -- 172.21.15.138:0/1882676753 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5594c1faa9c0 con 0x5594c1f75800 2024-04-26T20:58:20.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.564+0000 7fe82f600640 1 -- 172.21.15.138:0/1882676753 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5594c1fbee00 con 0x5594c1f75800 2024-04-26T20:58:20.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.564+0000 7fe82f600640 1 -- 172.21.15.138:0/1882676753 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5594c1faa4e0 con 0x5594c1f75800 2024-04-26T20:58:20.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.564+0000 7fe8347908c0 1 -- 172.21.15.138:0/1882676753 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594c1f9b2c0 con 0x5594c1f75800 2024-04-26T20:58:20.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.564+0000 7fe8347908c0 1 -- 172.21.15.138:0/1882676753 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({fsmap=0}) -- 0x5594c1f9a3c0 con 0x5594c1f75800 2024-04-26T20:58:20.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.564+0000 7fe8347908c0 4 waiting for MDS map... 2024-04-26T20:58:20.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.564+0000 7fe82f600640 1 -- 172.21.15.138:0/1882676753 <== mon.0 v2:172.21.15.138:3300/0 4 ==== osd_map(50..50 src has 1..50) ==== 6756+0+0 (secure 0 0 0) 0x5594c2d4ea00 con 0x5594c1f75800 2024-04-26T20:58:20.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.564+0000 7fe82f600640 1 -- 172.21.15.138:0/1882676753 <== mon.0 v2:172.21.15.138:3300/0 5 ==== fsmap(e 23) ==== 4135+0+0 (secure 0 0 0) 0x5594c1fcb180 con 0x5594c1f75800 2024-04-26T20:58:20.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.564+0000 7fe8347908c0 4 Got MDS map 23 2024-04-26T20:58:20.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.564+0000 7fe8347908c0 4 datascan.main: Using metadata pool output 2024-04-26T20:58:20.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.564+0000 7fe8347908c0 4 datascan.main: connecting to RADOS... 2024-04-26T20:58:20.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.568+0000 7fe8347908c0 1 Processor -- start 2024-04-26T20:58:20.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.568+0000 7fe8347908c0 1 -- start start 2024-04-26T20:58:20.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.568+0000 7fe8347908c0 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5594c2d63000 0x5594c2d4b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.568+0000 7fe8347908c0 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5594c2d63400 0x5594c2d4b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.568+0000 7fe8347908c0 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5594c2d63800 0x5594c2d4bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.568+0000 7fe8347908c0 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5594c2e8a600 con 0x5594c2d63400 2024-04-26T20:58:20.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.568+0000 7fe8347908c0 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x5594c2e8a780 con 0x5594c2d63000 2024-04-26T20:58:20.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.568+0000 7fe8347908c0 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x5594c2e8a900 con 0x5594c2d63800 2024-04-26T20:58:20.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.568+0000 7fe832800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5594c2d63400 0x5594c2d4b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.568+0000 7fe832800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5594c2d63400 0x5594c2d4b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:54444/0 (socket says 172.21.15.138:54444) 2024-04-26T20:58:20.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.568+0000 7fe832800640 1 -- 172.21.15.138:0/2112288040 learned_addr learned my addr 172.21.15.138:0/2112288040 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:20.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.568+0000 7fe831e00640 1 --2- 172.21.15.138:0/2112288040 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5594c2d63800 0x5594c2d4bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.568+0000 7fe831e00640 1 --2- 172.21.15.138:0/2112288040 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5594c2d63000 0x5594c2d4b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.568+0000 7fe832800640 1 -- 172.21.15.138:0/2112288040 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5594c2d63800 msgr2=0x5594c2d4bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:20.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.568+0000 7fe832800640 1 --2- 172.21.15.138:0/2112288040 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5594c2d63800 0x5594c2d4bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.568+0000 7fe832800640 1 -- 172.21.15.138:0/2112288040 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5594c2d63000 msgr2=0x5594c2d4b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:20.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.568+0000 7fe832800640 1 --2- 172.21.15.138:0/2112288040 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5594c2d63000 0x5594c2d4b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.568+0000 7fe832800640 1 -- 172.21.15.138:0/2112288040 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594c1f9a1e0 con 0x5594c2d63400 2024-04-26T20:58:20.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.568+0000 7fe832800640 1 --2- 172.21.15.138:0/2112288040 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5594c2d63400 0x5594c2d4b600 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x5594c2d5ce70 tx=0x5594c2eab920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e160fc0cc706fa6e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.568+0000 7fe82ce00640 1 -- 172.21.15.138:0/2112288040 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5594c1faa9c0 con 0x5594c2d63400 2024-04-26T20:58:20.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.568+0000 7fe82ce00640 1 -- 172.21.15.138:0/2112288040 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5594c1fbea80 con 0x5594c2d63400 2024-04-26T20:58:20.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.568+0000 7fe82ce00640 1 -- 172.21.15.138:0/2112288040 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5594c1faa4e0 con 0x5594c2d63400 2024-04-26T20:58:20.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.568+0000 7fe8347908c0 1 -- 172.21.15.138:0/2112288040 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5594c2d63400 msgr2=0x5594c2d4b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.568+0000 7fe8347908c0 1 --2- 172.21.15.138:0/2112288040 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5594c2d63400 0x5594c2d4b600 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x5594c2d5ce70 tx=0x5594c2eab920 comp rx=0 tx=0).stop 2024-04-26T20:58:20.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.568+0000 7fe8347908c0 1 -- 172.21.15.138:0/2112288040 shutdown_connections 2024-04-26T20:58:20.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.568+0000 7fe8347908c0 1 --2- 172.21.15.138:0/2112288040 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5594c2d63800 0x5594c2d4bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.568+0000 7fe8347908c0 1 --2- 172.21.15.138:0/2112288040 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5594c2d63400 0x5594c2d4b600 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.568+0000 7fe8347908c0 1 --2- 172.21.15.138:0/2112288040 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5594c2d63000 0x5594c2d4b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.568+0000 7fe8347908c0 1 -- 172.21.15.138:0/2112288040 >> 172.21.15.138:0/2112288040 conn(0x5594c2d62c00 msgr2=0x5594c1fa2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:20.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.568+0000 7fe8347908c0 1 -- 172.21.15.138:0/2112288040 shutdown_connections 2024-04-26T20:58:20.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.568+0000 7fe8347908c0 1 -- 172.21.15.138:0/2112288040 wait complete. 2024-04-26T20:58:20.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.568+0000 7fe8347908c0 1 Processor -- start 2024-04-26T20:58:20.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.568+0000 7fe8347908c0 1 -- start start 2024-04-26T20:58:20.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.568+0000 7fe8347908c0 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5594c2d63000 0x5594c2d4b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.568+0000 7fe8347908c0 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5594c2d63400 0x5594c2d4b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.568+0000 7fe8347908c0 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5594c2d63800 0x5594c2d4bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.568+0000 7fe8347908c0 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5594c2e8b980 con 0x5594c2d63800 2024-04-26T20:58:20.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.568+0000 7fe8347908c0 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x5594c2e8a300 con 0x5594c2d63000 2024-04-26T20:58:20.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.568+0000 7fe8347908c0 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x5594c2e8ac00 con 0x5594c2d63400 2024-04-26T20:58:20.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.572+0000 7fe831e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5594c2d63800 0x5594c2d4bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.572+0000 7fe831e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5594c2d63800 0x5594c2d4bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:54452/0 (socket says 172.21.15.138:54452) 2024-04-26T20:58:20.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.572+0000 7fe831e00640 1 -- 172.21.15.138:0/3792669297 learned_addr learned my addr 172.21.15.138:0/3792669297 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:20.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.572+0000 7fe831e00640 1 --2- 172.21.15.138:0/3792669297 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5594c2d63000 0x5594c2d4b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.572+0000 7fe832800640 1 --2- 172.21.15.138:0/3792669297 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5594c2d63400 0x5594c2d4b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.572+0000 7fe831e00640 1 -- 172.21.15.138:0/3792669297 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5594c2d63400 msgr2=0x5594c2d4b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.572+0000 7fe831e00640 1 --2- 172.21.15.138:0/3792669297 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5594c2d63400 0x5594c2d4b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.572+0000 7fe831e00640 1 -- 172.21.15.138:0/3792669297 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5594c2d63000 msgr2=0x5594c2d4b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.572+0000 7fe831e00640 1 --2- 172.21.15.138:0/3792669297 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5594c2d63000 0x5594c2d4b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.572+0000 7fe831e00640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594c1f9b4a0 con 0x5594c2d63800 2024-04-26T20:58:20.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.572+0000 7fe831e00640 1 --2- 172.21.15.138:0/3792669297 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5594c2d63800 0x5594c2d4bb80 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x5594c22860f0 tx=0x5594c205aea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.572+0000 7fe82b000640 1 -- 172.21.15.138:0/3792669297 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5594c1faa9c0 con 0x5594c2d63800 2024-04-26T20:58:20.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.572+0000 7fe82b000640 1 -- 172.21.15.138:0/3792669297 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5594c1fbe540 con 0x5594c2d63800 2024-04-26T20:58:20.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.572+0000 7fe82b000640 1 -- 172.21.15.138:0/3792669297 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5594c1faa4e0 con 0x5594c2d63800 2024-04-26T20:58:20.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.572+0000 7fe8347908c0 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5594c1f9ba40 con 0x5594c2d63800 2024-04-26T20:58:20.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.572+0000 7fe8347908c0 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594c1f9bc20 con 0x5594c2d63800 2024-04-26T20:58:20.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.572+0000 7fe8347908c0 4 datascan.init: forcing metadata pool 'recovery_fs_metadata' 2024-04-26T20:58:20.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.572+0000 7fe82b000640 1 -- 172.21.15.138:0/3792669297 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x5594c2ef6900 con 0x5594c2d63800 2024-04-26T20:58:20.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.572+0000 7fe82b000640 1 --2- 172.21.15.138:0/3792669297 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x5594c2281400 0x5594c2d4c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.572+0000 7fe82b000640 1 -- 172.21.15.138:0/3792669297 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6756+0+0 (secure 0 0 0) 0x5594c2282c00 con 0x5594c2d63800 2024-04-26T20:58:20.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.572+0000 7fe8347908c0 4 datascan.main: data pool 'cephfs_data' has ID 6 2024-04-26T20:58:20.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.572+0000 7fe8347908c0 4 datascan.main: opening data pool 'cephfs_data' 2024-04-26T20:58:20.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.572+0000 7fe8347908c0 1 --2- 172.21.15.138:0/3792669297 >> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] conn(0x5594c2281800 0x5594c2d4c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.572+0000 7fe8347908c0 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- osd_op(unknown.0.0:1 6.0 6:00000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5594c2281c00 con 0x5594c2281800 2024-04-26T20:58:20.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.572+0000 7fe832800640 1 --2- 172.21.15.138:0/3792669297 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x5594c2281400 0x5594c2d4c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.576+0000 7fe831e00640 1 --2- 172.21.15.138:0/3792669297 >> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] conn(0x5594c2281800 0x5594c2d4c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.576+0000 7fe831e00640 1 --2- 172.21.15.138:0/3792669297 >> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] conn(0x5594c2281800 0x5594c2d4c680 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.576+0000 7fe832800640 1 --2- 172.21.15.138:0/3792669297 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x5594c2281400 0x5594c2d4c100 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x5594c2d5ce70 tx=0x5594c205a060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.576+0000 7fe831e00640 1 -- 172.21.15.138:0/3792669297 <== osd.7 v2:172.21.15.143:6824/3295508495 1 ==== osd_op_reply(1 [pgnls start_epoch 50 out=49b] v41'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e000 con 0x5594c2281800 2024-04-26T20:58:20.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.576+0000 7fe82c400640 1 --2- 172.21.15.138:0/3792669297 >> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] conn(0x5594c2382000 0x5594c2388000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.576+0000 7fe82c400640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:2 6.20 6:04000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5594c2382400 con 0x5594c2382000 2024-04-26T20:58:20.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.576+0000 7fe833200640 1 --2- 172.21.15.138:0/3792669297 >> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] conn(0x5594c2382000 0x5594c2388000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.576+0000 7fe833200640 1 --2- 172.21.15.138:0/3792669297 >> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] conn(0x5594c2382000 0x5594c2388000 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.576+0000 7fe833200640 1 -- 172.21.15.138:0/3792669297 <== osd.4 v2:172.21.15.143:6800/2942056312 1 ==== osd_op_reply(2 [pgnls start_epoch 50 out=49b] v41'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e500 con 0x5594c2382000 2024-04-26T20:58:20.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.576+0000 7fe82ce00640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:3 6.10 6:08000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5594c2382c00 con 0x5594c2382000 2024-04-26T20:58:20.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.576+0000 7fe833200640 1 -- 172.21.15.138:0/3792669297 <== osd.4 v2:172.21.15.143:6800/2942056312 2 ==== osd_op_reply(3 [pgnls start_epoch 50 out=49b] v41'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e500 con 0x5594c2382000 2024-04-26T20:58:20.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.576+0000 7fe82c400640 1 --2- 172.21.15.138:0/3792669297 >> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] conn(0x5594c2382800 0x5594c2388580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.576+0000 7fe82c400640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] -- osd_op(unknown.0.0:4 6.30 6:0c000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5594c2383000 con 0x5594c2382800 2024-04-26T20:58:20.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.576+0000 7fe832800640 1 --2- 172.21.15.138:0/3792669297 >> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] conn(0x5594c2382800 0x5594c2388580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.576+0000 7fe832800640 1 --2- 172.21.15.138:0/3792669297 >> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] conn(0x5594c2382800 0x5594c2388580 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.716+0000 7fe82b000640 1 -- 172.21.15.138:0/3792669297 <== osd.1 v2:172.21.15.138:6816/1427635773 1 ==== osd_map(51..51 src has 1..51) ==== 312+0+0 (crc 0 0 0) 0x5594c2282200 con 0x5594c2382800 2024-04-26T20:58:20.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.716+0000 7fe832800640 1 -- 172.21.15.138:0/3792669297 <== osd.1 v2:172.21.15.138:6816/1427635773 2 ==== osd_op_reply(4 [pgnls start_epoch 50 out=49b] v41'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e780 con 0x5594c2382800 2024-04-26T20:58:20.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.716+0000 7fe82ce00640 1 --2- 172.21.15.138:0/3792669297 >> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] conn(0x5594c2383c00 0x5594c2389080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.716+0000 7fe82ce00640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:5 6.8 6:10000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c23a0000 con 0x5594c2383c00 2024-04-26T20:58:20.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.716+0000 7fe831e00640 1 --2- 172.21.15.138:0/3792669297 >> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] conn(0x5594c2383c00 0x5594c2389080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.716+0000 7fe831e00640 1 --2- 172.21.15.138:0/3792669297 >> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] conn(0x5594c2383c00 0x5594c2389080 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.716+0000 7fe831e00640 1 -- 172.21.15.138:0/3792669297 <== osd.3 v2:172.21.15.138:6824/3098242154 1 ==== osd_op_reply(5 [pgnls start_epoch 51 out=49b] v41'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e000 con 0x5594c2383c00 2024-04-26T20:58:20.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.716+0000 7fe82c400640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:6 6.28 6:14000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c2383400 con 0x5594c2382000 2024-04-26T20:58:20.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.720+0000 7fe833200640 1 -- 172.21.15.138:0/3792669297 <== osd.4 v2:172.21.15.143:6800/2942056312 3 ==== osd_op_reply(6 [pgnls start_epoch 51 out=49b] v41'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e500 con 0x5594c2382000 2024-04-26T20:58:20.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.720+0000 7fe82ce00640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:7 6.18 6:18000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c23a0400 con 0x5594c2382000 2024-04-26T20:58:20.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.720+0000 7fe833200640 1 -- 172.21.15.138:0/3792669297 <== osd.4 v2:172.21.15.143:6800/2942056312 4 ==== osd_op_reply(7 [pgnls start_epoch 51 out=49b] v41'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e500 con 0x5594c2382000 2024-04-26T20:58:20.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.720+0000 7fe82c400640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:8 6.38 6:1c000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c2383800 con 0x5594c2382000 2024-04-26T20:58:20.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.720+0000 7fe833200640 1 -- 172.21.15.138:0/3792669297 <== osd.4 v2:172.21.15.143:6800/2942056312 5 ==== osd_op_reply(8 [pgnls start_epoch 51 out=49b] v41'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e500 con 0x5594c2382000 2024-04-26T20:58:20.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.720+0000 7fe82ce00640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- osd_op(unknown.0.0:9 6.4 6:20000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c23a0800 con 0x5594c2281800 2024-04-26T20:58:20.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.724+0000 7fe831e00640 1 -- 172.21.15.138:0/3792669297 <== osd.7 v2:172.21.15.143:6824/3295508495 2 ==== osd_op_reply(9 [pgnls start_epoch 51 out=49b] v41'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e000 con 0x5594c2281800 2024-04-26T20:58:20.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.724+0000 7fe82c400640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] -- osd_op(unknown.0.0:10 6.24 6:24000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c2382400 con 0x5594c2382800 2024-04-26T20:58:20.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.724+0000 7fe832800640 1 -- 172.21.15.138:0/3792669297 <== osd.1 v2:172.21.15.138:6816/1427635773 3 ==== osd_op_reply(10 [pgnls start_epoch 51 out=49b] v41'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e780 con 0x5594c2382800 2024-04-26T20:58:20.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.724+0000 7fe82ce00640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:11 6.14 6:28000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c23a0400 con 0x5594c2382000 2024-04-26T20:58:20.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.724+0000 7fe833200640 1 -- 172.21.15.138:0/3792669297 <== osd.4 v2:172.21.15.143:6800/2942056312 6 ==== osd_op_reply(11 [pgnls start_epoch 51 out=49b] v41'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e500 con 0x5594c2382000 2024-04-26T20:58:20.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.724+0000 7fe82c400640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- osd_op(unknown.0.0:12 6.34 6:2c000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c2382c00 con 0x5594c2281800 2024-04-26T20:58:20.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.724+0000 7fe831e00640 1 -- 172.21.15.138:0/3792669297 <== osd.7 v2:172.21.15.143:6824/3295508495 3 ==== osd_op_reply(12 [pgnls start_epoch 51 out=49b] v41'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e000 con 0x5594c2281800 2024-04-26T20:58:20.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.724+0000 7fe82ce00640 1 --2- 172.21.15.138:0/3792669297 >> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] conn(0x5594c23a0c00 0x5594c2389600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.724+0000 7fe82ce00640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] -- osd_op(unknown.0.0:13 6.c 6:30000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c23a1000 con 0x5594c23a0c00 2024-04-26T20:58:20.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.724+0000 7fe833200640 1 --2- 172.21.15.138:0/3792669297 >> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] conn(0x5594c23a0c00 0x5594c2389600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.724+0000 7fe833200640 1 --2- 172.21.15.138:0/3792669297 >> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] conn(0x5594c23a0c00 0x5594c2389600 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.728+0000 7fe833200640 1 -- 172.21.15.138:0/3792669297 <== osd.6 v2:172.21.15.143:6816/1082239825 1 ==== osd_op_reply(13 [pgnls start_epoch 51 out=49b] v41'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e500 con 0x5594c23a0c00 2024-04-26T20:58:20.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.728+0000 7fe82c400640 1 --2- 172.21.15.138:0/3792669297 >> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] conn(0x5594c2d69c00 0x5594c2388b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.728+0000 7fe82c400640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] -- osd_op(unknown.0.0:14 6.2c 6:34000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c2d69800 con 0x5594c2d69c00 2024-04-26T20:58:20.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.728+0000 7fe832800640 1 --2- 172.21.15.138:0/3792669297 >> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] conn(0x5594c2d69c00 0x5594c2388b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.728+0000 7fe832800640 1 --2- 172.21.15.138:0/3792669297 >> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] conn(0x5594c2d69c00 0x5594c2388b00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.728+0000 7fe832800640 1 -- 172.21.15.138:0/3792669297 <== osd.0 v2:172.21.15.138:6800/3534772245 1 ==== osd_op_reply(14 [pgnls start_epoch 51 out=49b] v41'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e780 con 0x5594c2d69c00 2024-04-26T20:58:20.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.728+0000 7fe82ce00640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:15 6.1c 6:38000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c2383400 con 0x5594c2383c00 2024-04-26T20:58:20.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.728+0000 7fe831e00640 1 -- 172.21.15.138:0/3792669297 <== osd.3 v2:172.21.15.138:6824/3098242154 2 ==== osd_op_reply(15 [pgnls start_epoch 51 out=49b] v41'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e000 con 0x5594c2383c00 2024-04-26T20:58:20.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.728+0000 7fe82c400640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:16 6.3c 6:3c000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c2383000 con 0x5594c2382000 2024-04-26T20:58:20.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.728+0000 7fe833200640 1 -- 172.21.15.138:0/3792669297 <== osd.4 v2:172.21.15.143:6800/2942056312 7 ==== osd_op_reply(16 [pgnls start_epoch 51 out=49b] v41'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e500 con 0x5594c2382000 2024-04-26T20:58:20.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.728+0000 7fe82ce00640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:17 6.2 6:40000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c23a0000 con 0x5594c2383c00 2024-04-26T20:58:20.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.728+0000 7fe831e00640 1 -- 172.21.15.138:0/3792669297 <== osd.3 v2:172.21.15.138:6824/3098242154 3 ==== osd_op_reply(17 [pgnls start_epoch 51 out=49b] v41'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e000 con 0x5594c2383c00 2024-04-26T20:58:20.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.728+0000 7fe82c400640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:18 6.22 6:44000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c2382400 con 0x5594c2383c00 2024-04-26T20:58:20.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.728+0000 7fe831e00640 1 -- 172.21.15.138:0/3792669297 <== osd.3 v2:172.21.15.138:6824/3098242154 4 ==== osd_op_reply(18 [pgnls start_epoch 51 out=49b] v41'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e000 con 0x5594c2383c00 2024-04-26T20:58:20.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.728+0000 7fe82ce00640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] -- osd_op(unknown.0.0:19 6.12 6:48000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c23a0800 con 0x5594c2d69c00 2024-04-26T20:58:20.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.732+0000 7fe832800640 1 -- 172.21.15.138:0/3792669297 <== osd.0 v2:172.21.15.138:6800/3534772245 2 ==== osd_op_reply(19 [pgnls start_epoch 51 out=49b] v41'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e780 con 0x5594c2d69c00 2024-04-26T20:58:20.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.732+0000 7fe82c400640 1 --2- 172.21.15.138:0/3792669297 >> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] conn(0x5594c2280400 0x5594c238a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.732+0000 7fe82c400640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] -- osd_op(unknown.0.0:20 6.32 6:4c000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c2281c00 con 0x5594c2280400 2024-04-26T20:58:20.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.732+0000 7fe831e00640 1 --2- 172.21.15.138:0/3792669297 >> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] conn(0x5594c2280400 0x5594c238a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.733 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.732+0000 7fe831e00640 1 --2- 172.21.15.138:0/3792669297 >> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] conn(0x5594c2280400 0x5594c238a100 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.732+0000 7fe831e00640 1 -- 172.21.15.138:0/3792669297 <== osd.2 v2:172.21.15.138:6808/4273721573 1 ==== osd_op_reply(20 [pgnls start_epoch 51 out=49b] v41'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e000 con 0x5594c2280400 2024-04-26T20:58:20.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.732+0000 7fe82ce00640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] -- osd_op(unknown.0.0:21 6.a 6:50000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c23a1400 con 0x5594c2d69c00 2024-04-26T20:58:20.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.732+0000 7fe832800640 1 -- 172.21.15.138:0/3792669297 <== osd.0 v2:172.21.15.138:6800/3534772245 3 ==== osd_op_reply(21 [pgnls start_epoch 51 out=49b] v41'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e780 con 0x5594c2d69c00 2024-04-26T20:58:20.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.732+0000 7fe82c400640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] -- osd_op(unknown.0.0:22 6.2a 6:54000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c2d69800 con 0x5594c2d69c00 2024-04-26T20:58:20.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.732+0000 7fe832800640 1 -- 172.21.15.138:0/3792669297 <== osd.0 v2:172.21.15.138:6800/3534772245 4 ==== osd_op_reply(22 [pgnls start_epoch 51 out=49b] v41'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e780 con 0x5594c2d69c00 2024-04-26T20:58:20.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.732+0000 7fe82ce00640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:23 6.1a 6:58000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c23a1800 con 0x5594c2383c00 2024-04-26T20:58:20.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.732+0000 7fe831e00640 1 -- 172.21.15.138:0/3792669297 <== osd.3 v2:172.21.15.138:6824/3098242154 5 ==== osd_op_reply(23 [pgnls start_epoch 51 out=49b] v41'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e000 con 0x5594c2383c00 2024-04-26T20:58:20.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.732+0000 7fe82c400640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] -- osd_op(unknown.0.0:24 6.3a 6:5c000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c23a0000 con 0x5594c23a0c00 2024-04-26T20:58:20.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.732+0000 7fe833200640 1 -- 172.21.15.138:0/3792669297 <== osd.6 v2:172.21.15.143:6816/1082239825 2 ==== osd_op_reply(24 [pgnls start_epoch 51 out=49b] v41'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e500 con 0x5594c23a0c00 2024-04-26T20:58:20.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.732+0000 7fe82ce00640 1 --2- 172.21.15.138:0/3792669297 >> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] conn(0x5594c2382c00 0x5594c2389b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.732+0000 7fe82ce00640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] -- osd_op(unknown.0.0:25 6.6 6:60000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c23b0000 con 0x5594c2382c00 2024-04-26T20:58:20.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.732+0000 7fe833200640 1 --2- 172.21.15.138:0/3792669297 >> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] conn(0x5594c2382c00 0x5594c2389b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.732+0000 7fe833200640 1 --2- 172.21.15.138:0/3792669297 >> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] conn(0x5594c2382c00 0x5594c2389b80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.732+0000 7fe833200640 1 -- 172.21.15.138:0/3792669297 <== osd.5 v2:172.21.15.143:6808/1910222887 1 ==== osd_op_reply(25 [pgnls start_epoch 51 out=49b] v41'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e500 con 0x5594c2382c00 2024-04-26T20:58:20.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.732+0000 7fe82c400640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:26 6.26 6:64000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c23a1800 con 0x5594c2382000 2024-04-26T20:58:20.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.736+0000 7fe833200640 1 -- 172.21.15.138:0/3792669297 <== osd.4 v2:172.21.15.143:6800/2942056312 8 ==== osd_op_reply(26 [pgnls start_epoch 51 out=49b] v41'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e500 con 0x5594c2382000 2024-04-26T20:58:20.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.736+0000 7fe82ce00640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:27 6.16 6:68000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c23b0400 con 0x5594c2382000 2024-04-26T20:58:20.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.736+0000 7fe833200640 1 -- 172.21.15.138:0/3792669297 <== osd.4 v2:172.21.15.143:6800/2942056312 9 ==== osd_op_reply(27 [pgnls start_epoch 51 out=49b] v41'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e500 con 0x5594c2382000 2024-04-26T20:58:20.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.736+0000 7fe82c400640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] -- osd_op(unknown.0.0:28 6.36 6:6c000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c23a1c00 con 0x5594c2382800 2024-04-26T20:58:20.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.736+0000 7fe832800640 1 -- 172.21.15.138:0/3792669297 <== osd.1 v2:172.21.15.138:6816/1427635773 4 ==== osd_op_reply(28 [pgnls start_epoch 51 out=49b] v41'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e780 con 0x5594c2382800 2024-04-26T20:58:20.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.736+0000 7fe82ce00640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] -- osd_op(unknown.0.0:29 6.e 6:70000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c23b0800 con 0x5594c2382800 2024-04-26T20:58:20.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.736+0000 7fe832800640 1 -- 172.21.15.138:0/3792669297 <== osd.1 v2:172.21.15.138:6816/1427635773 5 ==== osd_op_reply(29 [pgnls start_epoch 51 out=49b] v41'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e780 con 0x5594c2382800 2024-04-26T20:58:20.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.736+0000 7fe82c400640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:30 6.2e 6:74000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c2281c00 con 0x5594c2383c00 2024-04-26T20:58:20.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.736+0000 7fe831e00640 1 -- 172.21.15.138:0/3792669297 <== osd.3 v2:172.21.15.138:6824/3098242154 6 ==== osd_op_reply(30 [pgnls start_epoch 51 out=49b] v41'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e000 con 0x5594c2383c00 2024-04-26T20:58:20.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.736+0000 7fe82ce00640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:31 6.1e 6:78000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c23b0c00 con 0x5594c2383c00 2024-04-26T20:58:20.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.736+0000 7fe831e00640 1 -- 172.21.15.138:0/3792669297 <== osd.3 v2:172.21.15.138:6824/3098242154 7 ==== osd_op_reply(31 [pgnls start_epoch 51 out=49b] v41'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e000 con 0x5594c2383c00 2024-04-26T20:58:20.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.736+0000 7fe82c400640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] -- osd_op(unknown.0.0:32 6.3e 6:7c000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c2383400 con 0x5594c23a0c00 2024-04-26T20:58:20.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.736+0000 7fe833200640 1 -- 172.21.15.138:0/3792669297 <== osd.6 v2:172.21.15.143:6816/1082239825 3 ==== osd_op_reply(32 [pgnls start_epoch 51 out=49b] v41'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e500 con 0x5594c23a0c00 2024-04-26T20:58:20.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.736+0000 7fe82ce00640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] -- osd_op(unknown.0.0:33 6.1 6:80000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c23b1000 con 0x5594c23a0c00 2024-04-26T20:58:20.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.736+0000 7fe833200640 1 -- 172.21.15.138:0/3792669297 <== osd.6 v2:172.21.15.143:6816/1082239825 4 ==== osd_op_reply(33 [pgnls start_epoch 51 out=49b] v41'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e500 con 0x5594c23a0c00 2024-04-26T20:58:20.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.736+0000 7fe82c400640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] -- osd_op(unknown.0.0:34 6.21 6:84000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c2382400 con 0x5594c2382800 2024-04-26T20:58:20.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.736+0000 7fe832800640 1 -- 172.21.15.138:0/3792669297 <== osd.1 v2:172.21.15.138:6816/1427635773 6 ==== osd_op_reply(34 [pgnls start_epoch 51 out=49b] v41'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e780 con 0x5594c2382800 2024-04-26T20:58:20.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.736+0000 7fe82ce00640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] -- osd_op(unknown.0.0:35 6.11 6:88000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c23b1400 con 0x5594c23a0c00 2024-04-26T20:58:20.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.736+0000 7fe833200640 1 -- 172.21.15.138:0/3792669297 <== osd.6 v2:172.21.15.143:6816/1082239825 5 ==== osd_op_reply(35 [pgnls start_epoch 51 out=49b] v41'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e500 con 0x5594c23a0c00 2024-04-26T20:58:20.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.736+0000 7fe82c400640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:36 6.31 6:8c000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c23a0800 con 0x5594c2383c00 2024-04-26T20:58:20.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.736+0000 7fe831e00640 1 -- 172.21.15.138:0/3792669297 <== osd.3 v2:172.21.15.138:6824/3098242154 8 ==== osd_op_reply(36 [pgnls start_epoch 51 out=49b] v41'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e000 con 0x5594c2383c00 2024-04-26T20:58:20.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.736+0000 7fe82ce00640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:37 6.9 6:90000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c23b0800 con 0x5594c2382000 2024-04-26T20:58:20.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.740+0000 7fe833200640 1 -- 172.21.15.138:0/3792669297 <== osd.4 v2:172.21.15.143:6800/2942056312 10 ==== osd_op_reply(37 [pgnls start_epoch 51 out=49b] v41'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e500 con 0x5594c2382000 2024-04-26T20:58:20.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.740+0000 7fe82c400640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:38 6.29 6:94000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c23a1400 con 0x5594c2383c00 2024-04-26T20:58:20.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.740+0000 7fe831e00640 1 -- 172.21.15.138:0/3792669297 <== osd.3 v2:172.21.15.138:6824/3098242154 9 ==== osd_op_reply(38 [pgnls start_epoch 51 out=49b] v41'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e000 con 0x5594c2383c00 2024-04-26T20:58:20.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.740+0000 7fe82ce00640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] -- osd_op(unknown.0.0:39 6.19 6:98000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c23b0000 con 0x5594c2d69c00 2024-04-26T20:58:20.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.740+0000 7fe832800640 1 -- 172.21.15.138:0/3792669297 <== osd.0 v2:172.21.15.138:6800/3534772245 5 ==== osd_op_reply(39 [pgnls start_epoch 51 out=49b] v41'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e780 con 0x5594c2d69c00 2024-04-26T20:58:20.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.740+0000 7fe82c400640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] -- osd_op(unknown.0.0:40 6.39 6:9c000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c23a1c00 con 0x5594c2382800 2024-04-26T20:58:20.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.740+0000 7fe832800640 1 -- 172.21.15.138:0/3792669297 <== osd.1 v2:172.21.15.138:6816/1427635773 7 ==== osd_op_reply(40 [pgnls start_epoch 51 out=49b] v41'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e780 con 0x5594c2382800 2024-04-26T20:58:20.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.740+0000 7fe82ce00640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] -- osd_op(unknown.0.0:41 6.5 6:a0000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c23b1800 con 0x5594c2d69c00 2024-04-26T20:58:20.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.740+0000 7fe832800640 1 -- 172.21.15.138:0/3792669297 <== osd.0 v2:172.21.15.138:6800/3534772245 6 ==== osd_op_reply(41 [pgnls start_epoch 51 out=49b] v41'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e780 con 0x5594c2d69c00 2024-04-26T20:58:20.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.740+0000 7fe82c400640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] -- osd_op(unknown.0.0:42 6.25 6:a4000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c23a0400 con 0x5594c2d69c00 2024-04-26T20:58:20.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.740+0000 7fe832800640 1 -- 172.21.15.138:0/3792669297 <== osd.0 v2:172.21.15.138:6800/3534772245 7 ==== osd_op_reply(42 [pgnls start_epoch 51 out=49b] v41'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e780 con 0x5594c2d69c00 2024-04-26T20:58:20.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.740+0000 7fe82ce00640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] -- osd_op(unknown.0.0:43 6.15 6:a8000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c23b1c00 con 0x5594c2280400 2024-04-26T20:58:20.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.740+0000 7fe831e00640 1 -- 172.21.15.138:0/3792669297 <== osd.2 v2:172.21.15.138:6808/4273721573 2 ==== osd_op_reply(43 [pgnls start_epoch 51 out=49b] v41'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e000 con 0x5594c2280400 2024-04-26T20:58:20.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.740+0000 7fe82c400640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] -- osd_op(unknown.0.0:44 6.35 6:ac000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c2383800 con 0x5594c2d69c00 2024-04-26T20:58:20.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.740+0000 7fe832800640 1 -- 172.21.15.138:0/3792669297 <== osd.0 v2:172.21.15.138:6800/3534772245 8 ==== osd_op_reply(44 [pgnls start_epoch 51 out=49b] v41'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e780 con 0x5594c2d69c00 2024-04-26T20:58:20.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.740+0000 7fe82ce00640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] -- osd_op(unknown.0.0:45 6.d 6:b0000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c23a1000 con 0x5594c2280400 2024-04-26T20:58:20.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.740+0000 7fe831e00640 1 -- 172.21.15.138:0/3792669297 <== osd.2 v2:172.21.15.138:6808/4273721573 3 ==== osd_op_reply(45 [pgnls start_epoch 51 out=49b] v41'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e000 con 0x5594c2280400 2024-04-26T20:58:20.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.740+0000 7fe82c400640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] -- osd_op(unknown.0.0:46 6.2d 6:b4000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c2383000 con 0x5594c2382c00 2024-04-26T20:58:20.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.740+0000 7fe833200640 1 -- 172.21.15.138:0/3792669297 <== osd.5 v2:172.21.15.143:6808/1910222887 2 ==== osd_op_reply(46 [pgnls start_epoch 51 out=49b] v41'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e500 con 0x5594c2382c00 2024-04-26T20:58:20.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.740+0000 7fe82ce00640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] -- osd_op(unknown.0.0:47 6.1d 6:b8000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c23a0000 con 0x5594c23a0c00 2024-04-26T20:58:20.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.740+0000 7fe833200640 1 -- 172.21.15.138:0/3792669297 <== osd.6 v2:172.21.15.143:6816/1082239825 6 ==== osd_op_reply(47 [pgnls start_epoch 51 out=49b] v41'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e500 con 0x5594c23a0c00 2024-04-26T20:58:20.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.740+0000 7fe82c400640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:48 6.3d 6:bc000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c2d69800 con 0x5594c2382000 2024-04-26T20:58:20.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.740+0000 7fe833200640 1 -- 172.21.15.138:0/3792669297 <== osd.4 v2:172.21.15.143:6800/2942056312 11 ==== osd_op_reply(48 [pgnls start_epoch 51 out=49b] v41'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e500 con 0x5594c2382000 2024-04-26T20:58:20.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.740+0000 7fe82ce00640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] -- osd_op(unknown.0.0:49 6.3 6:c0000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c23a1800 con 0x5594c2d69c00 2024-04-26T20:58:20.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.740+0000 7fe832800640 1 -- 172.21.15.138:0/3792669297 <== osd.0 v2:172.21.15.138:6800/3534772245 9 ==== osd_op_reply(49 [pgnls start_epoch 51 out=49b] v41'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e780 con 0x5594c2d69c00 2024-04-26T20:58:20.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.740+0000 7fe82c400640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] -- osd_op(unknown.0.0:50 6.23 6:c4000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c23a0000 con 0x5594c2280400 2024-04-26T20:58:20.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.744+0000 7fe831e00640 1 -- 172.21.15.138:0/3792669297 <== osd.2 v2:172.21.15.138:6808/4273721573 4 ==== osd_op_reply(50 [pgnls start_epoch 51 out=49b] v41'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e000 con 0x5594c2280400 2024-04-26T20:58:20.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.744+0000 7fe82ce00640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- osd_op(unknown.0.0:51 6.13 6:c8000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c2383400 con 0x5594c2281800 2024-04-26T20:58:20.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.744+0000 7fe831e00640 1 -- 172.21.15.138:0/3792669297 <== osd.7 v2:172.21.15.143:6824/3295508495 4 ==== osd_op_reply(51 [pgnls start_epoch 51 out=49b] v41'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e000 con 0x5594c2281800 2024-04-26T20:58:20.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.744+0000 7fe82c400640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] -- osd_op(unknown.0.0:52 6.33 6:cc000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c23a0800 con 0x5594c2382800 2024-04-26T20:58:20.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.744+0000 7fe832800640 1 -- 172.21.15.138:0/3792669297 <== osd.1 v2:172.21.15.138:6816/1427635773 8 ==== osd_op_reply(52 [pgnls start_epoch 51 out=49b] v41'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e780 con 0x5594c2382800 2024-04-26T20:58:20.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.744+0000 7fe82ce00640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:53 6.b 6:d0000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c2383000 con 0x5594c2382000 2024-04-26T20:58:20.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.744+0000 7fe833200640 1 -- 172.21.15.138:0/3792669297 <== osd.4 v2:172.21.15.143:6800/2942056312 12 ==== osd_op_reply(53 [pgnls start_epoch 51 out=49b] v41'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e500 con 0x5594c2382000 2024-04-26T20:58:20.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.744+0000 7fe82c400640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] -- osd_op(unknown.0.0:54 6.2b 6:d4000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c23a1400 con 0x5594c2d69c00 2024-04-26T20:58:20.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.744+0000 7fe832800640 1 -- 172.21.15.138:0/3792669297 <== osd.0 v2:172.21.15.138:6800/3534772245 10 ==== osd_op_reply(54 [pgnls start_epoch 51 out=49b] v41'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e780 con 0x5594c2d69c00 2024-04-26T20:58:20.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.744+0000 7fe82ce00640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] -- osd_op(unknown.0.0:55 6.1b 6:d8000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c2382400 con 0x5594c23a0c00 2024-04-26T20:58:20.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.744+0000 7fe833200640 1 -- 172.21.15.138:0/3792669297 <== osd.6 v2:172.21.15.143:6816/1082239825 7 ==== osd_op_reply(55 [pgnls start_epoch 51 out=49b] v41'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e500 con 0x5594c23a0c00 2024-04-26T20:58:20.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.744+0000 7fe82c400640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- osd_op(unknown.0.0:56 6.3b 6:dc000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c23a1000 con 0x5594c2281800 2024-04-26T20:58:20.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.744+0000 7fe831e00640 1 -- 172.21.15.138:0/3792669297 <== osd.7 v2:172.21.15.143:6824/3295508495 5 ==== osd_op_reply(56 [pgnls start_epoch 51 out=49b] v41'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e000 con 0x5594c2281800 2024-04-26T20:58:20.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.744+0000 7fe82ce00640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:57 6.7 6:e0000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c2383800 con 0x5594c2383c00 2024-04-26T20:58:20.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.744+0000 7fe831e00640 1 -- 172.21.15.138:0/3792669297 <== osd.3 v2:172.21.15.138:6824/3098242154 10 ==== osd_op_reply(57 [pgnls start_epoch 51 out=81b] v41'8 uv8 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x5594c208e000 con 0x5594c2383c00 2024-04-26T20:58:20.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.744+0000 7fe8347908c0 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:58 6.7 6:e2e07930:::10000000001.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x5594c23b0000 con 0x5594c2383c00 2024-04-26T20:58:20.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.744+0000 7fe831e00640 1 -- 172.21.15.138:0/3792669297 <== osd.3 v2:172.21.15.138:6824/3098242154 11 ==== osd_op_reply(58 10000000001.00000000 [stat out=16b] v0'0 uv8 ondisk = 0) ==== 164+0+16 (crc 0 0 0) 0x5594c208e000 con 0x5594c2383c00 2024-04-26T20:58:20.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.744+0000 7fe8347908c0 10 datascan.operator(): handling object 1099511627777.0 2024-04-26T20:58:20.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.744+0000 7fe8347908c0 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:59 6.7 6:e2e07930:::10000000001.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x5594c23b0400 con 0x5594c2383c00 2024-04-26T20:58:20.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.748+0000 7fe831e00640 1 -- 172.21.15.138:0/3792669297 <== osd.3 v2:172.21.15.138:6824/3098242154 12 ==== osd_op_reply(59 10000000001.00000000 [call] v51'9 uv9 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5594c208e000 con 0x5594c2383c00 2024-04-26T20:58:20.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.748+0000 7fe8347908c0 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] -- osd_op(unknown.0.0:60 6.27 6:e4000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c23b0800 con 0x5594c2280400 2024-04-26T20:58:20.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.748+0000 7fe831e00640 1 -- 172.21.15.138:0/3792669297 <== osd.2 v2:172.21.15.138:6808/4273721573 5 ==== osd_op_reply(60 [pgnls start_epoch 51 out=49b] v41'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e000 con 0x5594c2280400 2024-04-26T20:58:20.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.748+0000 7fe82ce00640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] -- osd_op(unknown.0.0:61 6.17 6:e8000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c23b0000 con 0x5594c2382800 2024-04-26T20:58:20.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.748+0000 7fe832800640 1 -- 172.21.15.138:0/3792669297 <== osd.1 v2:172.21.15.138:6816/1427635773 9 ==== osd_op_reply(61 [pgnls start_epoch 51 out=49b] v41'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e780 con 0x5594c2382800 2024-04-26T20:58:20.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.748+0000 7fe82c400640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- osd_op(unknown.0.0:62 6.37 6:ec000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c23a1c00 con 0x5594c2281800 2024-04-26T20:58:20.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.748+0000 7fe831e00640 1 -- 172.21.15.138:0/3792669297 <== osd.7 v2:172.21.15.143:6824/3295508495 6 ==== osd_op_reply(62 [pgnls start_epoch 51 out=49b] v41'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e000 con 0x5594c2281800 2024-04-26T20:58:20.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.748+0000 7fe82ce00640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] -- osd_op(unknown.0.0:63 6.f 6:f0000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c23b0400 con 0x5594c2382c00 2024-04-26T20:58:20.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.748+0000 7fe833200640 1 -- 172.21.15.138:0/3792669297 <== osd.5 v2:172.21.15.143:6808/1910222887 3 ==== osd_op_reply(63 [pgnls start_epoch 51 out=49b] v41'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e500 con 0x5594c2382c00 2024-04-26T20:58:20.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.748+0000 7fe82c400640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:64 6.2f 6:f4000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c23a0400 con 0x5594c2383c00 2024-04-26T20:58:20.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.748+0000 7fe831e00640 1 -- 172.21.15.138:0/3792669297 <== osd.3 v2:172.21.15.138:6824/3098242154 13 ==== osd_op_reply(64 [pgnls start_epoch 51 out=81b] v41'9 uv1 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x5594c208e000 con 0x5594c2383c00 2024-04-26T20:58:20.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.748+0000 7fe8347908c0 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:65 6.2f 6:f526278d:::10000000001.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x5594c23b0c00 con 0x5594c2383c00 2024-04-26T20:58:20.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.748+0000 7fe831e00640 1 -- 172.21.15.138:0/3792669297 <== osd.3 v2:172.21.15.138:6824/3098242154 14 ==== osd_op_reply(65 10000000001.00000001 [stat out=16b] v0'0 uv1 ondisk = 0) ==== 164+0+16 (crc 0 0 0) 0x5594c208e000 con 0x5594c2383c00 2024-04-26T20:58:20.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.748+0000 7fe8347908c0 10 datascan.operator(): handling object 1099511627777.1 2024-04-26T20:58:20.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.748+0000 7fe8347908c0 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:66 6.7 6:e2e07930:::10000000001.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x5594c23b1000 con 0x5594c2383c00 2024-04-26T20:58:20.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.752+0000 7fe831e00640 1 -- 172.21.15.138:0/3792669297 <== osd.3 v2:172.21.15.138:6824/3098242154 15 ==== osd_op_reply(66 10000000001.00000000 [call] v51'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5594c208e000 con 0x5594c2383c00 2024-04-26T20:58:20.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.752+0000 7fe8347908c0 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] -- osd_op(unknown.0.0:67 6.1f 6:f8000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c23b1400 con 0x5594c23a0c00 2024-04-26T20:58:20.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.752+0000 7fe833200640 1 -- 172.21.15.138:0/3792669297 <== osd.6 v2:172.21.15.143:6816/1082239825 8 ==== osd_op_reply(67 [pgnls start_epoch 51 out=49b] v41'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e500 con 0x5594c23a0c00 2024-04-26T20:58:20.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.752+0000 7fe82c400640 1 -- 172.21.15.138:0/3792669297 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:68 6.3f 6:fc000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x5594c2281c00 con 0x5594c2382000 2024-04-26T20:58:20.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.752+0000 7fe833200640 1 -- 172.21.15.138:0/3792669297 <== osd.4 v2:172.21.15.143:6800/2942056312 13 ==== osd_op_reply(68 [pgnls start_epoch 51 out=49b] v41'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5594c208e500 con 0x5594c2382000 2024-04-26T20:58:20.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.752+0000 7fe8347908c0 1 -- 172.21.15.138:0/3792669297 >> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] conn(0x5594c2d69c00 msgr2=0x5594c2388b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.752+0000 7fe8347908c0 1 --2- 172.21.15.138:0/3792669297 >> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] conn(0x5594c2d69c00 0x5594c2388b00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.752+0000 7fe8347908c0 1 -- 172.21.15.138:0/3792669297 >> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] conn(0x5594c2382800 msgr2=0x5594c2388580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.752+0000 7fe8347908c0 1 --2- 172.21.15.138:0/3792669297 >> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] conn(0x5594c2382800 0x5594c2388580 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.752+0000 7fe8347908c0 1 -- 172.21.15.138:0/3792669297 >> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] conn(0x5594c2280400 msgr2=0x5594c238a100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.752+0000 7fe8347908c0 1 --2- 172.21.15.138:0/3792669297 >> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] conn(0x5594c2280400 0x5594c238a100 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.752+0000 7fe8347908c0 1 -- 172.21.15.138:0/3792669297 >> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] conn(0x5594c2383c00 msgr2=0x5594c2389080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.752+0000 7fe8347908c0 1 --2- 172.21.15.138:0/3792669297 >> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] conn(0x5594c2383c00 0x5594c2389080 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.752+0000 7fe8347908c0 1 -- 172.21.15.138:0/3792669297 >> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] conn(0x5594c2382000 msgr2=0x5594c2388000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.752+0000 7fe8347908c0 1 --2- 172.21.15.138:0/3792669297 >> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] conn(0x5594c2382000 0x5594c2388000 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.752+0000 7fe8347908c0 1 -- 172.21.15.138:0/3792669297 >> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] conn(0x5594c2382c00 msgr2=0x5594c2389b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.752+0000 7fe8347908c0 1 --2- 172.21.15.138:0/3792669297 >> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] conn(0x5594c2382c00 0x5594c2389b80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.752+0000 7fe8347908c0 1 -- 172.21.15.138:0/3792669297 >> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] conn(0x5594c23a0c00 msgr2=0x5594c2389600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.752+0000 7fe8347908c0 1 --2- 172.21.15.138:0/3792669297 >> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] conn(0x5594c23a0c00 0x5594c2389600 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.752+0000 7fe8347908c0 1 -- 172.21.15.138:0/3792669297 >> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] conn(0x5594c2281800 msgr2=0x5594c2d4c680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.752+0000 7fe8347908c0 1 --2- 172.21.15.138:0/3792669297 >> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] conn(0x5594c2281800 0x5594c2d4c680 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.752+0000 7fe832800640 1 -- 172.21.15.138:0/3792669297 reap_dead start 2024-04-26T20:58:20.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.752+0000 7fe8347908c0 1 -- 172.21.15.138:0/3792669297 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x5594c2281400 msgr2=0x5594c2d4c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.752+0000 7fe8347908c0 1 --2- 172.21.15.138:0/3792669297 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x5594c2281400 0x5594c2d4c100 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x5594c2d5ce70 tx=0x5594c205a060 comp rx=0 tx=0).stop 2024-04-26T20:58:20.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.752+0000 7fe8347908c0 1 -- 172.21.15.138:0/3792669297 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5594c2d63800 msgr2=0x5594c2d4bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.752+0000 7fe8347908c0 1 --2- 172.21.15.138:0/3792669297 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5594c2d63800 0x5594c2d4bb80 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x5594c22860f0 tx=0x5594c205aea0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.752+0000 7fe8347908c0 1 -- 172.21.15.138:0/3792669297 shutdown_connections 2024-04-26T20:58:20.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.752+0000 7fe8347908c0 1 --2- 172.21.15.138:0/3792669297 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x5594c2281400 0x5594c2d4c100 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.752+0000 7fe8347908c0 1 --2- 172.21.15.138:0/3792669297 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5594c2d63800 0x5594c2d4bb80 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.752+0000 7fe8347908c0 1 -- 172.21.15.138:0/3792669297 >> 172.21.15.138:0/3792669297 conn(0x5594c2d62c00 msgr2=0x5594c1fa2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:20.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.752+0000 7fe8347908c0 1 -- 172.21.15.138:0/3792669297 shutdown_connections 2024-04-26T20:58:20.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.752+0000 7fe8347908c0 1 -- 172.21.15.138:0/3792669297 wait complete. 2024-04-26T20:58:20.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.752+0000 7fe8347908c0 1 -- 172.21.15.138:0/1882676753 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5594c1f75800 msgr2=0x5594c2d4ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.752+0000 7fe8347908c0 1 --2- 172.21.15.138:0/1882676753 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5594c1f75800 0x5594c2d4ab00 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x5594c2dd5380 tx=0x5594c205a120 comp rx=0 tx=0).stop 2024-04-26T20:58:20.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.752+0000 7fe8347908c0 1 -- 172.21.15.138:0/1882676753 shutdown_connections 2024-04-26T20:58:20.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.752+0000 7fe8347908c0 1 --2- 172.21.15.138:0/1882676753 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5594c1f75800 0x5594c2d4ab00 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.752+0000 7fe8347908c0 1 --2- 172.21.15.138:0/1882676753 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5594c1f75400 0x5594c2d4a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.752+0000 7fe8347908c0 1 --2- 172.21.15.138:0/1882676753 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5594c1f75000 0x5594c2d4a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.752+0000 7fe8347908c0 1 -- 172.21.15.138:0/1882676753 >> 172.21.15.138:0/1882676753 conn(0x5594c1f74c00 msgr2=0x5594c1fa1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:20.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.752+0000 7fe8347908c0 1 -- 172.21.15.138:0/1882676753 shutdown_connections 2024-04-26T20:58:20.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.752+0000 7fe8347908c0 1 -- 172.21.15.138:0/1882676753 wait complete. 2024-04-26T20:58:20.759 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_extents', '--alternate-pool', 'recovery_fs_metadata', '--filesystem', 'cephfs', 'cephfs_data'] in time 0:00:00.281499, result: 2024-04-26T20:58:20.760 DEBUG:teuthology.orchestra.run.smithi138:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_inodes --alternate-pool recovery_fs_metadata --filesystem cephfs --force-corrupt --force-init cephfs_data 2024-04-26T20:58:20.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.808+0000 7f4ce5bbb8c0 1 -- start start 2024-04-26T20:58:20.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.808+0000 7f4ce5bbb8c0 1 Processor -- start 2024-04-26T20:58:20.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.808+0000 7f4ce5bbb8c0 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x562337135800 0x562337f0e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.808+0000 7f4ce5bbb8c0 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562337135400 0x562337f0e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.808+0000 7f4ce5bbb8c0 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562337135000 0x562337f0eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.808+0000 7f4ce5bbb8c0 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x562337f22600 con 0x562337135400 2024-04-26T20:58:20.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.808+0000 7f4ce5bbb8c0 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x562337f22480 con 0x562337135000 2024-04-26T20:58:20.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.808+0000 7f4ce5bbb8c0 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x562337f22300 con 0x562337135800 2024-04-26T20:58:20.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.808+0000 7f4ce3200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562337135400 0x562337f0e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.808+0000 7f4ce3200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562337135400 0x562337f0e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:54460/0 (socket says 172.21.15.138:54460) 2024-04-26T20:58:20.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.808+0000 7f4ce3200640 1 -- 172.21.15.138:0/659945859 learned_addr learned my addr 172.21.15.138:0/659945859 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:20.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.808+0000 7f4ce3c00640 1 --2- 172.21.15.138:0/659945859 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x562337135800 0x562337f0e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.808+0000 7f4ce4600640 1 --2- 172.21.15.138:0/659945859 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562337135000 0x562337f0eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.808+0000 7f4ce3200640 1 -- 172.21.15.138:0/659945859 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x562337135800 msgr2=0x562337f0e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:20.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.808+0000 7f4ce3200640 1 --2- 172.21.15.138:0/659945859 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x562337135800 0x562337f0e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.808+0000 7f4ce3200640 1 -- 172.21.15.138:0/659945859 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562337135000 msgr2=0x562337f0eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:20.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.808+0000 7f4ce3200640 1 --2- 172.21.15.138:0/659945859 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562337135000 0x562337f0eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.808+0000 7f4ce3200640 1 -- 172.21.15.138:0/659945859 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56233715a1e0 con 0x562337135400 2024-04-26T20:58:20.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.808+0000 7f4ce4600640 1 --2- 172.21.15.138:0/659945859 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562337135000 0x562337f0eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:58:20.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.808+0000 7f4ce3200640 1 --2- 172.21.15.138:0/659945859 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562337135400 0x562337f0e580 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x562337f95350 tx=0x5623372168a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c733e5ae238bcb1e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.808+0000 7f4ce0a00640 1 -- 172.21.15.138:0/659945859 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56233716a9c0 con 0x562337135400 2024-04-26T20:58:20.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.808+0000 7f4ce0a00640 1 -- 172.21.15.138:0/659945859 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56233717ea80 con 0x562337135400 2024-04-26T20:58:20.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.808+0000 7f4ce0a00640 1 -- 172.21.15.138:0/659945859 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56233716a4e0 con 0x562337135400 2024-04-26T20:58:20.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.808+0000 7f4ce5bbb8c0 1 -- 172.21.15.138:0/659945859 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56233715b4a0 con 0x562337135400 2024-04-26T20:58:20.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.808+0000 7f4ce5bbb8c0 1 -- 172.21.15.138:0/659945859 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({fsmap=0}) -- 0x56233715b2c0 con 0x562337135400 2024-04-26T20:58:20.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.808+0000 7f4ce5bbb8c0 4 waiting for MDS map... 2024-04-26T20:58:20.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.808+0000 7f4ce0a00640 1 -- 172.21.15.138:0/659945859 <== mon.0 v2:172.21.15.138:3300/0 4 ==== osd_map(51..51 src has 1..51) ==== 6756+0+0 (secure 0 0 0) 0x562337f1a000 con 0x562337135400 2024-04-26T20:58:20.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.808+0000 7f4ce0a00640 1 -- 172.21.15.138:0/659945859 <== mon.0 v2:172.21.15.138:3300/0 5 ==== fsmap(e 23) ==== 4135+0+0 (secure 0 0 0) 0x56233718b180 con 0x562337135400 2024-04-26T20:58:20.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.808+0000 7f4ce5bbb8c0 4 Got MDS map 23 2024-04-26T20:58:20.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.808+0000 7f4ce5bbb8c0 4 datascan.main: Using metadata pool output 2024-04-26T20:58:20.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.808+0000 7f4ce5bbb8c0 4 datascan.main: connecting to RADOS... 2024-04-26T20:58:20.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.808+0000 7f4ce5bbb8c0 1 Processor -- start 2024-04-26T20:58:20.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.812+0000 7f4ce5bbb8c0 1 -- start start 2024-04-26T20:58:20.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.812+0000 7f4ce5bbb8c0 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562338068c00 0x562337f0f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.812+0000 7f4ce5bbb8c0 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x562338069000 0x562337f0f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.812+0000 7f4ce5bbb8c0 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562338069400 0x562337f0fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.812+0000 7f4ce5bbb8c0 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x562337f22180 con 0x562338068c00 2024-04-26T20:58:20.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.812+0000 7f4ce5bbb8c0 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x562337194480 con 0x562338069400 2024-04-26T20:58:20.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.812+0000 7f4ce5bbb8c0 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x562337194900 con 0x562338069000 2024-04-26T20:58:20.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.812+0000 7f4ce4600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562338068c00 0x562337f0f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.812+0000 7f4ce4600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562338068c00 0x562337f0f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:54462/0 (socket says 172.21.15.138:54462) 2024-04-26T20:58:20.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.812+0000 7f4ce4600640 1 -- 172.21.15.138:0/1905550370 learned_addr learned my addr 172.21.15.138:0/1905550370 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:20.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.812+0000 7f4ce3c00640 1 --2- 172.21.15.138:0/1905550370 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x562338069000 0x562337f0f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.812+0000 7f4ce3200640 1 --2- 172.21.15.138:0/1905550370 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562338069400 0x562337f0fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.812+0000 7f4ce4600640 1 -- 172.21.15.138:0/1905550370 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x562338069000 msgr2=0x562337f0f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:20.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.812+0000 7f4ce4600640 1 --2- 172.21.15.138:0/1905550370 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x562338069000 0x562337f0f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.812+0000 7f4ce4600640 1 -- 172.21.15.138:0/1905550370 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562338069400 msgr2=0x562337f0fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:20.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.812+0000 7f4ce4600640 1 --2- 172.21.15.138:0/1905550370 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562338069400 0x562337f0fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.812+0000 7f4ce4600640 1 -- 172.21.15.138:0/1905550370 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56233715a3c0 con 0x562338068c00 2024-04-26T20:58:20.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.812+0000 7f4ce3200640 1 --2- 172.21.15.138:0/1905550370 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562338069400 0x562337f0fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:58:20.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.812+0000 7f4ce4600640 1 --2- 172.21.15.138:0/1905550370 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562338068c00 0x562337f0f080 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x56233804b170 tx=0x562338065b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99c733e5e3261bc4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.812+0000 7f4cde200640 1 -- 172.21.15.138:0/1905550370 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56233716a9c0 con 0x562338068c00 2024-04-26T20:58:20.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.812+0000 7f4cde200640 1 -- 172.21.15.138:0/1905550370 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56233717e540 con 0x562338068c00 2024-04-26T20:58:20.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.812+0000 7f4cde200640 1 -- 172.21.15.138:0/1905550370 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56233716a4e0 con 0x562338068c00 2024-04-26T20:58:20.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.812+0000 7f4ce5bbb8c0 1 -- 172.21.15.138:0/1905550370 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562338068c00 msgr2=0x562337f0f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.812+0000 7f4ce5bbb8c0 1 --2- 172.21.15.138:0/1905550370 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562338068c00 0x562337f0f080 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x56233804b170 tx=0x562338065b00 comp rx=0 tx=0).stop 2024-04-26T20:58:20.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.812+0000 7f4ce5bbb8c0 1 -- 172.21.15.138:0/1905550370 shutdown_connections 2024-04-26T20:58:20.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.812+0000 7f4ce5bbb8c0 1 --2- 172.21.15.138:0/1905550370 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562338069400 0x562337f0fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.812+0000 7f4ce5bbb8c0 1 --2- 172.21.15.138:0/1905550370 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x562338069000 0x562337f0f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.812+0000 7f4ce5bbb8c0 1 --2- 172.21.15.138:0/1905550370 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562338068c00 0x562337f0f080 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.812+0000 7f4ce5bbb8c0 1 -- 172.21.15.138:0/1905550370 >> 172.21.15.138:0/1905550370 conn(0x562337134c00 msgr2=0x562337161000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:20.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.812+0000 7f4ce5bbb8c0 1 -- 172.21.15.138:0/1905550370 shutdown_connections 2024-04-26T20:58:20.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.812+0000 7f4ce5bbb8c0 1 -- 172.21.15.138:0/1905550370 wait complete. 2024-04-26T20:58:20.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.812+0000 7f4ce5bbb8c0 1 Processor -- start 2024-04-26T20:58:20.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.812+0000 7f4ce5bbb8c0 1 -- start start 2024-04-26T20:58:20.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.812+0000 7f4ce5bbb8c0 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562338068c00 0x562337f0f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.812+0000 7f4ce5bbb8c0 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562338069000 0x562337f0f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.812+0000 7f4ce5bbb8c0 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x562338069400 0x562337f0fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.812+0000 7f4ce5bbb8c0 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x562337f23380 con 0x562338069000 2024-04-26T20:58:20.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.812+0000 7f4ce5bbb8c0 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x562337f22180 con 0x562338068c00 2024-04-26T20:58:20.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.812+0000 7f4ce5bbb8c0 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x562337f22c00 con 0x562338069400 2024-04-26T20:58:20.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.816+0000 7f4ce3c00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562338069000 0x562337f0f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.816+0000 7f4ce3c00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562338069000 0x562337f0f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:54466/0 (socket says 172.21.15.138:54466) 2024-04-26T20:58:20.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.816+0000 7f4ce3c00640 1 -- 172.21.15.138:0/2133476744 learned_addr learned my addr 172.21.15.138:0/2133476744 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:20.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.816+0000 7f4ce4600640 1 --2- 172.21.15.138:0/2133476744 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562338068c00 0x562337f0f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.816+0000 7f4ce3200640 1 --2- 172.21.15.138:0/2133476744 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x562338069400 0x562337f0fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.816+0000 7f4ce3c00640 1 -- 172.21.15.138:0/2133476744 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x562338069400 msgr2=0x562337f0fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.816+0000 7f4ce3c00640 1 --2- 172.21.15.138:0/2133476744 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x562338069400 0x562337f0fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.816+0000 7f4ce3c00640 1 -- 172.21.15.138:0/2133476744 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562338068c00 msgr2=0x562337f0f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.816+0000 7f4ce3c00640 1 --2- 172.21.15.138:0/2133476744 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562338068c00 0x562337f0f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.816+0000 7f4ce3c00640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56233715a1e0 con 0x562338069000 2024-04-26T20:58:20.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.816+0000 7f4ce3c00640 1 --2- 172.21.15.138:0/2133476744 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562338069000 0x562337f0f600 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x56233804be60 tx=0x562338065c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.816+0000 7f4cdc400640 1 -- 172.21.15.138:0/2133476744 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56233716a9c0 con 0x562338069000 2024-04-26T20:58:20.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.816+0000 7f4cdc400640 1 -- 172.21.15.138:0/2133476744 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56233717e1c0 con 0x562338069000 2024-04-26T20:58:20.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.816+0000 7f4ce5bbb8c0 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56233715b4a0 con 0x562338069000 2024-04-26T20:58:20.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.816+0000 7f4cdc400640 1 -- 172.21.15.138:0/2133476744 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56233716a4e0 con 0x562338069000 2024-04-26T20:58:20.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.816+0000 7f4ce5bbb8c0 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56233715b2c0 con 0x562338069000 2024-04-26T20:58:20.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.816+0000 7f4ce5bbb8c0 4 datascan.init: forcing metadata pool 'recovery_fs_metadata' 2024-04-26T20:58:20.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.816+0000 7f4cdc400640 1 -- 172.21.15.138:0/2133476744 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x5623380aa900 con 0x562338069000 2024-04-26T20:58:20.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.816+0000 7f4cdc400640 1 --2- 172.21.15.138:0/2133476744 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x562337425800 0x562337f10100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.816+0000 7f4cdc400640 1 -- 172.21.15.138:0/2133476744 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6756+0+0 (secure 0 0 0) 0x562337427000 con 0x562338069000 2024-04-26T20:58:20.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.816+0000 7f4ce5bbb8c0 4 datascan.main: data pool 'cephfs_data' has ID 6 2024-04-26T20:58:20.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.816+0000 7f4ce5bbb8c0 4 datascan.main: opening data pool 'cephfs_data' 2024-04-26T20:58:20.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.816+0000 7f4ce5bbb8c0 1 --2- 172.21.15.138:0/2133476744 >> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] conn(0x562338069800 0x562337f10680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.816+0000 7f4ce5bbb8c0 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] -- osd_op(unknown.0.0:1 7.14 7:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x562338069c00 con 0x562338069800 2024-04-26T20:58:20.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.816+0000 7f4ce4600640 1 --2- 172.21.15.138:0/2133476744 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x562337425800 0x562337f10100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.816+0000 7f4ce3200640 1 --2- 172.21.15.138:0/2133476744 >> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] conn(0x562338069800 0x562337f10680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.820+0000 7f4ce4600640 1 --2- 172.21.15.138:0/2133476744 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x562337425800 0x562337f10100 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x56233804b170 tx=0x56233721b4a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.820+0000 7f4ce3200640 1 --2- 172.21.15.138:0/2133476744 >> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] conn(0x562338069800 0x562337f10680 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.820+0000 7f4ce3200640 1 -- 172.21.15.138:0/2133476744 <== osd.5 v2:172.21.15.143:6808/1910222887 1 ==== osd_op_reply(1 1.00000000.inode [stat out=16b] v0'0 uv1 ondisk = 0) ==== 160+0+16 (crc 0 0 0) 0x562337206000 con 0x562338069800 2024-04-26T20:58:20.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.820+0000 7f4ce5bbb8c0 1 --2- 172.21.15.138:0/2133476744 >> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] conn(0x562337425c00 0x562337f10c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.820+0000 7f4ce5bbb8c0 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] -- osd_op(unknown.0.0:2 7.1f 7:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x562337534000 con 0x562337425c00 2024-04-26T20:58:20.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.820+0000 7f4ce4600640 1 --2- 172.21.15.138:0/2133476744 >> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] conn(0x562337425c00 0x562337f10c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.820+0000 7f4ce4600640 1 --2- 172.21.15.138:0/2133476744 >> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] conn(0x562337425c00 0x562337f10c00 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.820+0000 7f4ce4600640 1 -- 172.21.15.138:0/2133476744 <== osd.0 v2:172.21.15.138:6800/3534772245 1 ==== osd_op_reply(2 100.00000000.inode [stat out=16b] v0'0 uv1 ondisk = 0) ==== 162+0+16 (crc 0 0 0) 0x562337206500 con 0x562337425c00 2024-04-26T20:58:20.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.820+0000 7f4ce5bbb8c0 1 --2- 172.21.15.138:0/2133476744 >> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] conn(0x562337534400 0x562337f11180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.820+0000 7f4ce5bbb8c0 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- osd_op(unknown.0.0:3 6.0 6:00000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337534800 con 0x562337534400 2024-04-26T20:58:20.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.820+0000 7f4ce3c00640 1 --2- 172.21.15.138:0/2133476744 >> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] conn(0x562337534400 0x562337f11180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.820+0000 7f4ce3c00640 1 --2- 172.21.15.138:0/2133476744 >> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] conn(0x562337534400 0x562337f11180 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.820+0000 7f4ce3c00640 1 -- 172.21.15.138:0/2133476744 <== osd.7 v2:172.21.15.143:6824/3295508495 1 ==== osd_op_reply(3 [pgnls-filter start_epoch 51 out=49b] v41'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206780 con 0x562337534400 2024-04-26T20:58:20.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.820+0000 7f4cdd800640 1 --2- 172.21.15.138:0/2133476744 >> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] conn(0x562337546000 0x56233754c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.820+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:4 6.20 6:04000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337546400 con 0x562337546000 2024-04-26T20:58:20.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.820+0000 7f4ce3200640 1 --2- 172.21.15.138:0/2133476744 >> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] conn(0x562337546000 0x56233754c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.824+0000 7f4ce3200640 1 --2- 172.21.15.138:0/2133476744 >> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] conn(0x562337546000 0x56233754c000 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.824+0000 7f4ce3200640 1 -- 172.21.15.138:0/2133476744 <== osd.4 v2:172.21.15.143:6800/2942056312 1 ==== osd_op_reply(4 [pgnls-filter start_epoch 51 out=49b] v41'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206000 con 0x562337546000 2024-04-26T20:58:20.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.824+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:5 6.10 6:08000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337546c00 con 0x562337546000 2024-04-26T20:58:20.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.824+0000 7f4ce3200640 1 -- 172.21.15.138:0/2133476744 <== osd.4 v2:172.21.15.143:6800/2942056312 2 ==== osd_op_reply(5 [pgnls-filter start_epoch 51 out=49b] v41'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206000 con 0x562337546000 2024-04-26T20:58:20.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.824+0000 7f4cdd800640 1 --2- 172.21.15.138:0/2133476744 >> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] conn(0x562337546800 0x56233754c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.824+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] -- osd_op(unknown.0.0:6 6.30 6:0c000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337547000 con 0x562337546800 2024-04-26T20:58:20.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.824+0000 7f4ce4600640 1 --2- 172.21.15.138:0/2133476744 >> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] conn(0x562337546800 0x56233754c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.824+0000 7f4ce4600640 1 --2- 172.21.15.138:0/2133476744 >> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] conn(0x562337546800 0x56233754c580 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.824+0000 7f4ce4600640 1 -- 172.21.15.138:0/2133476744 <== osd.1 v2:172.21.15.138:6816/1427635773 1 ==== osd_op_reply(6 [pgnls-filter start_epoch 51 out=49b] v41'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206500 con 0x562337546800 2024-04-26T20:58:20.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.824+0000 7f4cde200640 1 --2- 172.21.15.138:0/2133476744 >> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] conn(0x562337547c00 0x56233754d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.824+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:7 6.8 6:10000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337558000 con 0x562337547c00 2024-04-26T20:58:20.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.824+0000 7f4ce3c00640 1 --2- 172.21.15.138:0/2133476744 >> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] conn(0x562337547c00 0x56233754d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.824+0000 7f4ce3c00640 1 --2- 172.21.15.138:0/2133476744 >> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] conn(0x562337547c00 0x56233754d080 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.824+0000 7f4ce3c00640 1 -- 172.21.15.138:0/2133476744 <== osd.3 v2:172.21.15.138:6824/3098242154 1 ==== osd_op_reply(7 [pgnls-filter start_epoch 51 out=49b] v41'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206780 con 0x562337547c00 2024-04-26T20:58:20.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.824+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:8 6.28 6:14000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337547400 con 0x562337546000 2024-04-26T20:58:20.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.824+0000 7f4ce3200640 1 -- 172.21.15.138:0/2133476744 <== osd.4 v2:172.21.15.143:6800/2942056312 3 ==== osd_op_reply(8 [pgnls-filter start_epoch 51 out=49b] v41'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206000 con 0x562337546000 2024-04-26T20:58:20.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.824+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:9 6.18 6:18000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337558400 con 0x562337546000 2024-04-26T20:58:20.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.824+0000 7f4ce3200640 1 -- 172.21.15.138:0/2133476744 <== osd.4 v2:172.21.15.143:6800/2942056312 4 ==== osd_op_reply(9 [pgnls-filter start_epoch 51 out=49b] v41'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206000 con 0x562337546000 2024-04-26T20:58:20.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.824+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:10 6.38 6:1c000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337547800 con 0x562337546000 2024-04-26T20:58:20.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.828+0000 7f4ce3200640 1 -- 172.21.15.138:0/2133476744 <== osd.4 v2:172.21.15.143:6800/2942056312 5 ==== osd_op_reply(10 [pgnls-filter start_epoch 51 out=49b] v41'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206000 con 0x562337546000 2024-04-26T20:58:20.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.828+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- osd_op(unknown.0.0:11 6.4 6:20000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337558800 con 0x562337534400 2024-04-26T20:58:20.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.828+0000 7f4ce3c00640 1 -- 172.21.15.138:0/2133476744 <== osd.7 v2:172.21.15.143:6824/3295508495 2 ==== osd_op_reply(11 [pgnls-filter start_epoch 51 out=49b] v41'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206780 con 0x562337534400 2024-04-26T20:58:20.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.828+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] -- osd_op(unknown.0.0:12 6.24 6:24000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337546400 con 0x562337546800 2024-04-26T20:58:20.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.828+0000 7f4ce4600640 1 -- 172.21.15.138:0/2133476744 <== osd.1 v2:172.21.15.138:6816/1427635773 2 ==== osd_op_reply(12 [pgnls-filter start_epoch 51 out=49b] v41'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206500 con 0x562337546800 2024-04-26T20:58:20.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.828+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:13 6.14 6:28000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337547000 con 0x562337546000 2024-04-26T20:58:20.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.828+0000 7f4ce3200640 1 -- 172.21.15.138:0/2133476744 <== osd.4 v2:172.21.15.143:6800/2942056312 6 ==== osd_op_reply(13 [pgnls-filter start_epoch 51 out=49b] v41'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206000 con 0x562337546000 2024-04-26T20:58:20.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.828+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- osd_op(unknown.0.0:14 6.34 6:2c000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337546c00 con 0x562337534400 2024-04-26T20:58:20.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.828+0000 7f4ce3c00640 1 -- 172.21.15.138:0/2133476744 <== osd.7 v2:172.21.15.143:6824/3295508495 3 ==== osd_op_reply(14 [pgnls-filter start_epoch 51 out=49b] v41'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206780 con 0x562337534400 2024-04-26T20:58:20.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.828+0000 7f4cde200640 1 --2- 172.21.15.138:0/2133476744 >> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] conn(0x562337546400 0x56233754d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.828+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] -- osd_op(unknown.0.0:15 6.c 6:30000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337534000 con 0x562337546400 2024-04-26T20:58:20.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.828+0000 7f4ce3200640 1 --2- 172.21.15.138:0/2133476744 >> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] conn(0x562337546400 0x56233754d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.828+0000 7f4ce3200640 1 --2- 172.21.15.138:0/2133476744 >> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] conn(0x562337546400 0x56233754d600 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.828+0000 7f4ce3200640 1 -- 172.21.15.138:0/2133476744 <== osd.6 v2:172.21.15.143:6816/1082239825 1 ==== osd_op_reply(15 [pgnls-filter start_epoch 51 out=49b] v41'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206000 con 0x562337546400 2024-04-26T20:58:20.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.828+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] -- osd_op(unknown.0.0:16 6.2c 6:34000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562338069c00 con 0x562337425c00 2024-04-26T20:58:20.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.828+0000 7f4ce4600640 1 -- 172.21.15.138:0/2133476744 <== osd.0 v2:172.21.15.138:6800/3534772245 2 ==== osd_op_reply(16 [pgnls-filter start_epoch 51 out=49b] v41'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206500 con 0x562337425c00 2024-04-26T20:58:20.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.828+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:17 6.1c 6:38000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337424800 con 0x562337547c00 2024-04-26T20:58:20.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.828+0000 7f4ce3c00640 1 -- 172.21.15.138:0/2133476744 <== osd.3 v2:172.21.15.138:6824/3098242154 2 ==== osd_op_reply(17 [pgnls-filter start_epoch 51 out=49b] v41'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206780 con 0x562337547c00 2024-04-26T20:58:20.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.828+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:18 6.3c 6:3c000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337f25c00 con 0x562337546000 2024-04-26T20:58:20.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.828+0000 7f4ce3200640 1 -- 172.21.15.138:0/2133476744 <== osd.4 v2:172.21.15.143:6800/2942056312 7 ==== osd_op_reply(18 [pgnls-filter start_epoch 51 out=49b] v41'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206000 con 0x562337546000 2024-04-26T20:58:20.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.828+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:19 6.2 6:40000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337546c00 con 0x562337547c00 2024-04-26T20:58:20.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.828+0000 7f4ce3c00640 1 -- 172.21.15.138:0/2133476744 <== osd.3 v2:172.21.15.138:6824/3098242154 3 ==== osd_op_reply(19 [pgnls-filter start_epoch 51 out=49b] v41'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206780 con 0x562337547c00 2024-04-26T20:58:20.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.828+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:20 6.22 6:44000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337558000 con 0x562337547c00 2024-04-26T20:58:20.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.832+0000 7f4ce3c00640 1 -- 172.21.15.138:0/2133476744 <== osd.3 v2:172.21.15.138:6824/3098242154 4 ==== osd_op_reply(20 [pgnls-filter start_epoch 51 out=49b] v41'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206780 con 0x562337547c00 2024-04-26T20:58:20.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.832+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] -- osd_op(unknown.0.0:21 6.12 6:48000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337547400 con 0x562337425c00 2024-04-26T20:58:20.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.832+0000 7f4ce4600640 1 -- 172.21.15.138:0/2133476744 <== osd.0 v2:172.21.15.138:6800/3534772245 3 ==== osd_op_reply(21 [pgnls-filter start_epoch 51 out=49b] v41'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206500 con 0x562337425c00 2024-04-26T20:58:20.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.832+0000 7f4cdd800640 1 --2- 172.21.15.138:0/2133476744 >> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] conn(0x562337558400 0x56233754cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.832+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] -- osd_op(unknown.0.0:22 6.32 6:4c000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337558800 con 0x562337558400 2024-04-26T20:58:20.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.832+0000 7f4ce4600640 1 --2- 172.21.15.138:0/2133476744 >> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] conn(0x562337558400 0x56233754cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.832+0000 7f4ce4600640 1 --2- 172.21.15.138:0/2133476744 >> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] conn(0x562337558400 0x56233754cb00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.832+0000 7f4ce4600640 1 -- 172.21.15.138:0/2133476744 <== osd.2 v2:172.21.15.138:6808/4273721573 1 ==== osd_op_reply(22 [pgnls-filter start_epoch 51 out=49b] v41'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206500 con 0x562337558400 2024-04-26T20:58:20.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.832+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] -- osd_op(unknown.0.0:23 6.a 6:50000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337534800 con 0x562337425c00 2024-04-26T20:58:20.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.832+0000 7f4ce4600640 1 -- 172.21.15.138:0/2133476744 <== osd.0 v2:172.21.15.138:6800/3534772245 4 ==== osd_op_reply(23 [pgnls-filter start_epoch 51 out=49b] v41'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206500 con 0x562337425c00 2024-04-26T20:58:20.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.832+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] -- osd_op(unknown.0.0:24 6.2a 6:54000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337558c00 con 0x562337425c00 2024-04-26T20:58:20.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.832+0000 7f4ce4600640 1 -- 172.21.15.138:0/2133476744 <== osd.0 v2:172.21.15.138:6800/3534772245 5 ==== osd_op_reply(24 [pgnls-filter start_epoch 51 out=49b] v41'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206500 con 0x562337425c00 2024-04-26T20:58:20.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.832+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:25 6.1a 6:58000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337558800 con 0x562337547c00 2024-04-26T20:58:20.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.832+0000 7f4ce3c00640 1 -- 172.21.15.138:0/2133476744 <== osd.3 v2:172.21.15.138:6824/3098242154 5 ==== osd_op_reply(25 [pgnls-filter start_epoch 51 out=49b] v41'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206780 con 0x562337547c00 2024-04-26T20:58:20.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.832+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] -- osd_op(unknown.0.0:26 6.3a 6:5c000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337559000 con 0x562337546400 2024-04-26T20:58:20.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.832+0000 7f4ce3200640 1 -- 172.21.15.138:0/2133476744 <== osd.6 v2:172.21.15.143:6816/1082239825 2 ==== osd_op_reply(26 [pgnls-filter start_epoch 51 out=49b] v41'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206000 con 0x562337546400 2024-04-26T20:58:20.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.832+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] -- osd_op(unknown.0.0:27 6.6 6:60000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337558c00 con 0x562338069800 2024-04-26T20:58:20.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.832+0000 7f4ce3200640 1 -- 172.21.15.138:0/2133476744 <== osd.5 v2:172.21.15.143:6808/1910222887 2 ==== osd_op_reply(27 [pgnls-filter start_epoch 51 out=49b] v41'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206000 con 0x562338069800 2024-04-26T20:58:20.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.832+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:28 6.26 6:64000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337559800 con 0x562337546000 2024-04-26T20:58:20.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.836+0000 7f4ce3200640 1 -- 172.21.15.138:0/2133476744 <== osd.4 v2:172.21.15.143:6800/2942056312 8 ==== osd_op_reply(28 [pgnls-filter start_epoch 51 out=49b] v41'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206000 con 0x562337546000 2024-04-26T20:58:20.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.836+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:29 6.16 6:68000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337559400 con 0x562337546000 2024-04-26T20:58:20.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.836+0000 7f4ce3200640 1 -- 172.21.15.138:0/2133476744 <== osd.4 v2:172.21.15.143:6800/2942056312 9 ==== osd_op_reply(29 [pgnls-filter start_epoch 51 out=49b] v41'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206000 con 0x562337546000 2024-04-26T20:58:20.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.836+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] -- osd_op(unknown.0.0:30 6.36 6:6c000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337559c00 con 0x562337546800 2024-04-26T20:58:20.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.836+0000 7f4ce4600640 1 -- 172.21.15.138:0/2133476744 <== osd.1 v2:172.21.15.138:6816/1427635773 3 ==== osd_op_reply(30 [pgnls-filter start_epoch 51 out=49b] v41'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206500 con 0x562337546800 2024-04-26T20:58:20.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.836+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] -- osd_op(unknown.0.0:31 6.e 6:70000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337534800 con 0x562337546800 2024-04-26T20:58:20.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.836+0000 7f4ce4600640 1 -- 172.21.15.138:0/2133476744 <== osd.1 v2:172.21.15.138:6816/1427635773 4 ==== osd_op_reply(31 [pgnls-filter start_epoch 51 out=49b] v41'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206500 con 0x562337546800 2024-04-26T20:58:20.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.836+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:32 6.2e 6:74000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337559000 con 0x562337547c00 2024-04-26T20:58:20.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.836+0000 7f4ce3c00640 1 -- 172.21.15.138:0/2133476744 <== osd.3 v2:172.21.15.138:6824/3098242154 6 ==== osd_op_reply(32 [pgnls-filter start_epoch 51 out=49b] v41'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206780 con 0x562337547c00 2024-04-26T20:58:20.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.836+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:33 6.1e 6:78000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337547400 con 0x562337547c00 2024-04-26T20:58:20.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.836+0000 7f4ce3c00640 1 -- 172.21.15.138:0/2133476744 <== osd.3 v2:172.21.15.138:6824/3098242154 7 ==== osd_op_reply(33 [pgnls-filter start_epoch 51 out=49b] v41'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206780 con 0x562337547c00 2024-04-26T20:58:20.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.836+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] -- osd_op(unknown.0.0:34 6.3e 6:7c000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337558c00 con 0x562337546400 2024-04-26T20:58:20.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.836+0000 7f4ce3200640 1 -- 172.21.15.138:0/2133476744 <== osd.6 v2:172.21.15.143:6816/1082239825 3 ==== osd_op_reply(34 [pgnls-filter start_epoch 51 out=49b] v41'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206000 con 0x562337546400 2024-04-26T20:58:20.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.836+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] -- osd_op(unknown.0.0:35 6.1 6:80000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562338069c00 con 0x562337546400 2024-04-26T20:58:20.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.836+0000 7f4ce3200640 1 -- 172.21.15.138:0/2133476744 <== osd.6 v2:172.21.15.143:6816/1082239825 4 ==== osd_op_reply(35 [pgnls-filter start_epoch 51 out=49b] v41'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206000 con 0x562337546400 2024-04-26T20:58:20.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.836+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] -- osd_op(unknown.0.0:36 6.21 6:84000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337559800 con 0x562337546800 2024-04-26T20:58:20.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.836+0000 7f4ce4600640 1 -- 172.21.15.138:0/2133476744 <== osd.1 v2:172.21.15.138:6816/1427635773 5 ==== osd_op_reply(36 [pgnls-filter start_epoch 51 out=49b] v41'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206500 con 0x562337546800 2024-04-26T20:58:20.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.836+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] -- osd_op(unknown.0.0:37 6.11 6:88000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337558000 con 0x562337546400 2024-04-26T20:58:20.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.836+0000 7f4ce3200640 1 -- 172.21.15.138:0/2133476744 <== osd.6 v2:172.21.15.143:6816/1082239825 5 ==== osd_op_reply(37 [pgnls-filter start_epoch 51 out=49b] v41'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206000 con 0x562337546400 2024-04-26T20:58:20.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.836+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:38 6.31 6:8c000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337f25c00 con 0x562337547c00 2024-04-26T20:58:20.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.836+0000 7f4ce3c00640 1 -- 172.21.15.138:0/2133476744 <== osd.3 v2:172.21.15.138:6824/3098242154 8 ==== osd_op_reply(38 [pgnls-filter start_epoch 51 out=49b] v41'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206780 con 0x562337547c00 2024-04-26T20:58:20.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.836+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:39 6.9 6:90000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337558800 con 0x562337546000 2024-04-26T20:58:20.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.836+0000 7f4ce3200640 1 -- 172.21.15.138:0/2133476744 <== osd.4 v2:172.21.15.143:6800/2942056312 10 ==== osd_op_reply(39 [pgnls-filter start_epoch 51 out=49b] v41'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206000 con 0x562337546000 2024-04-26T20:58:20.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.836+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:40 6.29 6:94000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337534000 con 0x562337547c00 2024-04-26T20:58:20.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.840+0000 7f4ce3c00640 1 -- 172.21.15.138:0/2133476744 <== osd.3 v2:172.21.15.138:6824/3098242154 9 ==== osd_op_reply(40 [pgnls-filter start_epoch 51 out=49b] v41'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206780 con 0x562337547c00 2024-04-26T20:58:20.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.840+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] -- osd_op(unknown.0.0:41 6.19 6:98000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337559000 con 0x562337425c00 2024-04-26T20:58:20.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.840+0000 7f4ce4600640 1 -- 172.21.15.138:0/2133476744 <== osd.0 v2:172.21.15.138:6800/3534772245 6 ==== osd_op_reply(41 [pgnls-filter start_epoch 51 out=49b] v41'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206500 con 0x562337425c00 2024-04-26T20:58:20.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.840+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] -- osd_op(unknown.0.0:42 6.39 6:9c000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337547800 con 0x562337546800 2024-04-26T20:58:20.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.840+0000 7f4ce4600640 1 -- 172.21.15.138:0/2133476744 <== osd.1 v2:172.21.15.138:6816/1427635773 6 ==== osd_op_reply(42 [pgnls-filter start_epoch 51 out=49b] v41'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206500 con 0x562337546800 2024-04-26T20:58:20.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.840+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] -- osd_op(unknown.0.0:43 6.5 6:a0000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337546c00 con 0x562337425c00 2024-04-26T20:58:20.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.840+0000 7f4ce4600640 1 -- 172.21.15.138:0/2133476744 <== osd.0 v2:172.21.15.138:6800/3534772245 7 ==== osd_op_reply(43 [pgnls-filter start_epoch 51 out=49b] v41'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206500 con 0x562337425c00 2024-04-26T20:58:20.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.840+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] -- osd_op(unknown.0.0:44 6.25 6:a4000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337547000 con 0x562337425c00 2024-04-26T20:58:20.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.840+0000 7f4ce4600640 1 -- 172.21.15.138:0/2133476744 <== osd.0 v2:172.21.15.138:6800/3534772245 8 ==== osd_op_reply(44 [pgnls-filter start_epoch 51 out=49b] v41'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206500 con 0x562337425c00 2024-04-26T20:58:20.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.840+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] -- osd_op(unknown.0.0:45 6.15 6:a8000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337424800 con 0x562337558400 2024-04-26T20:58:20.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.840+0000 7f4ce4600640 1 -- 172.21.15.138:0/2133476744 <== osd.2 v2:172.21.15.138:6808/4273721573 2 ==== osd_op_reply(45 [pgnls-filter start_epoch 51 out=49b] v41'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206500 con 0x562337558400 2024-04-26T20:58:20.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.840+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] -- osd_op(unknown.0.0:46 6.35 6:ac000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337547800 con 0x562337425c00 2024-04-26T20:58:20.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.840+0000 7f4ce4600640 1 -- 172.21.15.138:0/2133476744 <== osd.0 v2:172.21.15.138:6800/3534772245 9 ==== osd_op_reply(46 [pgnls-filter start_epoch 51 out=49b] v41'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206500 con 0x562337425c00 2024-04-26T20:58:20.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.840+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] -- osd_op(unknown.0.0:47 6.d 6:b0000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337570000 con 0x562337558400 2024-04-26T20:58:20.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.840+0000 7f4ce4600640 1 -- 172.21.15.138:0/2133476744 <== osd.2 v2:172.21.15.138:6808/4273721573 3 ==== osd_op_reply(47 [pgnls-filter start_epoch 51 out=49b] v41'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206500 con 0x562337558400 2024-04-26T20:58:20.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.840+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] -- osd_op(unknown.0.0:48 6.2d 6:b4000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337546c00 con 0x562338069800 2024-04-26T20:58:20.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.840+0000 7f4ce3200640 1 -- 172.21.15.138:0/2133476744 <== osd.5 v2:172.21.15.143:6808/1910222887 3 ==== osd_op_reply(48 [pgnls-filter start_epoch 51 out=49b] v41'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206000 con 0x562338069800 2024-04-26T20:58:20.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.840+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] -- osd_op(unknown.0.0:49 6.1d 6:b8000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337570400 con 0x562337546400 2024-04-26T20:58:20.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.840+0000 7f4ce3200640 1 -- 172.21.15.138:0/2133476744 <== osd.6 v2:172.21.15.143:6816/1082239825 6 ==== osd_op_reply(49 [pgnls-filter start_epoch 51 out=49b] v41'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206000 con 0x562337546400 2024-04-26T20:58:20.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.840+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:50 6.3d 6:bc000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337559c00 con 0x562337546000 2024-04-26T20:58:20.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.840+0000 7f4ce3200640 1 -- 172.21.15.138:0/2133476744 <== osd.4 v2:172.21.15.143:6800/2942056312 11 ==== osd_op_reply(50 [pgnls-filter start_epoch 51 out=49b] v41'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206000 con 0x562337546000 2024-04-26T20:58:20.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.840+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] -- osd_op(unknown.0.0:51 6.3 6:c0000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337570800 con 0x562337425c00 2024-04-26T20:58:20.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.840+0000 7f4ce4600640 1 -- 172.21.15.138:0/2133476744 <== osd.0 v2:172.21.15.138:6800/3534772245 10 ==== osd_op_reply(51 [pgnls-filter start_epoch 51 out=49b] v41'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206500 con 0x562337425c00 2024-04-26T20:58:20.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.840+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] -- osd_op(unknown.0.0:52 6.23 6:c4000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337559800 con 0x562337558400 2024-04-26T20:58:20.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.840+0000 7f4ce4600640 1 -- 172.21.15.138:0/2133476744 <== osd.2 v2:172.21.15.138:6808/4273721573 4 ==== osd_op_reply(52 [pgnls-filter start_epoch 51 out=49b] v41'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206500 con 0x562337558400 2024-04-26T20:58:20.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.840+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- osd_op(unknown.0.0:53 6.13 6:c8000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337570c00 con 0x562337534400 2024-04-26T20:58:20.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.844+0000 7f4ce3c00640 1 -- 172.21.15.138:0/2133476744 <== osd.7 v2:172.21.15.143:6824/3295508495 4 ==== osd_op_reply(53 [pgnls-filter start_epoch 51 out=49b] v41'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206780 con 0x562337534400 2024-04-26T20:58:20.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.844+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] -- osd_op(unknown.0.0:54 6.33 6:cc000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337559000 con 0x562337546800 2024-04-26T20:58:20.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.844+0000 7f4ce4600640 1 -- 172.21.15.138:0/2133476744 <== osd.1 v2:172.21.15.138:6816/1427635773 7 ==== osd_op_reply(54 [pgnls-filter start_epoch 51 out=49b] v41'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206500 con 0x562337546800 2024-04-26T20:58:20.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.844+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:55 6.b 6:d0000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337571000 con 0x562337546000 2024-04-26T20:58:20.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.844+0000 7f4ce3200640 1 -- 172.21.15.138:0/2133476744 <== osd.4 v2:172.21.15.143:6800/2942056312 12 ==== osd_op_reply(55 [pgnls-filter start_epoch 51 out=49b] v41'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206000 con 0x562337546000 2024-04-26T20:58:20.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.844+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] -- osd_op(unknown.0.0:56 6.2b 6:d4000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337534800 con 0x562337425c00 2024-04-26T20:58:20.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.844+0000 7f4ce4600640 1 -- 172.21.15.138:0/2133476744 <== osd.0 v2:172.21.15.138:6800/3534772245 11 ==== osd_op_reply(56 [pgnls-filter start_epoch 51 out=49b] v41'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206500 con 0x562337425c00 2024-04-26T20:58:20.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.844+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] -- osd_op(unknown.0.0:57 6.1b 6:d8000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337571400 con 0x562337546400 2024-04-26T20:58:20.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.844+0000 7f4ce3200640 1 -- 172.21.15.138:0/2133476744 <== osd.6 v2:172.21.15.143:6816/1082239825 7 ==== osd_op_reply(57 [pgnls-filter start_epoch 51 out=49b] v41'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206000 con 0x562337546400 2024-04-26T20:58:20.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.844+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- osd_op(unknown.0.0:58 6.3b 6:dc000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337559800 con 0x562337534400 2024-04-26T20:58:20.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.844+0000 7f4ce3c00640 1 -- 172.21.15.138:0/2133476744 <== osd.7 v2:172.21.15.143:6824/3295508495 5 ==== osd_op_reply(58 [pgnls-filter start_epoch 51 out=49b] v41'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206780 con 0x562337534400 2024-04-26T20:58:20.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.844+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:59 6.7 6:e0000000::::head [pgnls-filter start_epoch 51 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337571800 con 0x562337547c00 2024-04-26T20:58:20.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.844+0000 7f4ce3c00640 1 -- 172.21.15.138:0/2133476744 <== osd.3 v2:172.21.15.138:6824/3098242154 10 ==== osd_op_reply(59 [pgnls-filter start_epoch 51 out=81b] v51'10 uv10 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x562337206780 con 0x562337547c00 2024-04-26T20:58:20.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.844+0000 7f4ce5bbb8c0 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- osd_op(unknown.0.0:60 6.0 6:00000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337534c00 con 0x562337534400 2024-04-26T20:58:20.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.844+0000 7f4ce3c00640 1 -- 172.21.15.138:0/2133476744 <== osd.7 v2:172.21.15.143:6824/3295508495 6 ==== osd_op_reply(60 [pgnls-filter start_epoch 51 out=49b] v41'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206780 con 0x562337534400 2024-04-26T20:58:20.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.844+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:61 6.20 6:04000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337571c00 con 0x562337546000 2024-04-26T20:58:20.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.844+0000 7f4ce3200640 1 -- 172.21.15.138:0/2133476744 <== osd.4 v2:172.21.15.143:6800/2942056312 13 ==== osd_op_reply(61 [pgnls-filter start_epoch 51 out=49b] v41'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206000 con 0x562337546000 2024-04-26T20:58:20.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.844+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:62 6.10 6:08000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337570000 con 0x562337546000 2024-04-26T20:58:20.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.848+0000 7f4ce3200640 1 -- 172.21.15.138:0/2133476744 <== osd.4 v2:172.21.15.143:6800/2942056312 14 ==== osd_op_reply(62 [pgnls-filter start_epoch 51 out=49b] v41'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206000 con 0x562337546000 2024-04-26T20:58:20.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.848+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] -- osd_op(unknown.0.0:63 6.30 6:0c000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337559800 con 0x562337546800 2024-04-26T20:58:20.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.848+0000 7f4ce4600640 1 -- 172.21.15.138:0/2133476744 <== osd.1 v2:172.21.15.138:6816/1427635773 8 ==== osd_op_reply(63 [pgnls-filter start_epoch 51 out=49b] v41'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206500 con 0x562337546800 2024-04-26T20:58:20.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.848+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:64 6.8 6:10000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337570800 con 0x562337547c00 2024-04-26T20:58:20.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.848+0000 7f4ce3c00640 1 -- 172.21.15.138:0/2133476744 <== osd.3 v2:172.21.15.138:6824/3098242154 11 ==== osd_op_reply(64 [pgnls-filter start_epoch 51 out=49b] v41'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206780 con 0x562337547c00 2024-04-26T20:58:20.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.848+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:65 6.28 6:14000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337559000 con 0x562337546000 2024-04-26T20:58:20.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.848+0000 7f4ce3200640 1 -- 172.21.15.138:0/2133476744 <== osd.4 v2:172.21.15.143:6800/2942056312 15 ==== osd_op_reply(65 [pgnls-filter start_epoch 51 out=49b] v41'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206000 con 0x562337546000 2024-04-26T20:58:20.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.848+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:66 6.18 6:18000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337570400 con 0x562337546000 2024-04-26T20:58:20.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.848+0000 7f4ce3200640 1 -- 172.21.15.138:0/2133476744 <== osd.4 v2:172.21.15.143:6800/2942056312 16 ==== osd_op_reply(66 [pgnls-filter start_epoch 51 out=49b] v41'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206000 con 0x562337546000 2024-04-26T20:58:20.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.848+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:67 6.38 6:1c000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337559400 con 0x562337546000 2024-04-26T20:58:20.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.848+0000 7f4ce3200640 1 -- 172.21.15.138:0/2133476744 <== osd.4 v2:172.21.15.143:6800/2942056312 17 ==== osd_op_reply(67 [pgnls-filter start_epoch 51 out=49b] v41'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206000 con 0x562337546000 2024-04-26T20:58:20.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.848+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- osd_op(unknown.0.0:68 6.4 6:20000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337547000 con 0x562337534400 2024-04-26T20:58:20.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.848+0000 7f4ce3c00640 1 -- 172.21.15.138:0/2133476744 <== osd.7 v2:172.21.15.143:6824/3295508495 7 ==== osd_op_reply(68 [pgnls-filter start_epoch 51 out=49b] v41'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206780 con 0x562337534400 2024-04-26T20:58:20.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.848+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] -- osd_op(unknown.0.0:69 6.24 6:24000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337558c00 con 0x562337546800 2024-04-26T20:58:20.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.848+0000 7f4ce4600640 1 -- 172.21.15.138:0/2133476744 <== osd.1 v2:172.21.15.138:6816/1427635773 9 ==== osd_op_reply(69 [pgnls-filter start_epoch 51 out=49b] v41'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206500 con 0x562337546800 2024-04-26T20:58:20.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.848+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:70 6.14 6:28000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337547800 con 0x562337546000 2024-04-26T20:58:20.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.848+0000 7f4ce3200640 1 -- 172.21.15.138:0/2133476744 <== osd.4 v2:172.21.15.143:6800/2942056312 18 ==== osd_op_reply(70 [pgnls-filter start_epoch 51 out=49b] v41'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206000 con 0x562337546000 2024-04-26T20:58:20.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.848+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- osd_op(unknown.0.0:71 6.34 6:2c000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337570c00 con 0x562337534400 2024-04-26T20:58:20.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.848+0000 7f4ce3c00640 1 -- 172.21.15.138:0/2133476744 <== osd.7 v2:172.21.15.143:6824/3295508495 8 ==== osd_op_reply(71 [pgnls-filter start_epoch 51 out=49b] v41'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206780 con 0x562337534400 2024-04-26T20:58:20.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.848+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] -- osd_op(unknown.0.0:72 6.c 6:30000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337546c00 con 0x562337546400 2024-04-26T20:58:20.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.848+0000 7f4ce3200640 1 -- 172.21.15.138:0/2133476744 <== osd.6 v2:172.21.15.143:6816/1082239825 8 ==== osd_op_reply(72 [pgnls-filter start_epoch 51 out=49b] v41'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206000 con 0x562337546400 2024-04-26T20:58:20.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.848+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] -- osd_op(unknown.0.0:73 6.2c 6:34000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337571800 con 0x562337425c00 2024-04-26T20:58:20.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.852+0000 7f4ce4600640 1 -- 172.21.15.138:0/2133476744 <== osd.0 v2:172.21.15.138:6800/3534772245 12 ==== osd_op_reply(73 [pgnls-filter start_epoch 51 out=49b] v41'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206500 con 0x562337425c00 2024-04-26T20:58:20.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.852+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:74 6.1c 6:38000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562338069c00 con 0x562337547c00 2024-04-26T20:58:20.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.852+0000 7f4ce3c00640 1 -- 172.21.15.138:0/2133476744 <== osd.3 v2:172.21.15.138:6824/3098242154 12 ==== osd_op_reply(74 [pgnls-filter start_epoch 51 out=49b] v41'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206780 con 0x562337547c00 2024-04-26T20:58:20.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.852+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:75 6.3c 6:3c000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337534000 con 0x562337546000 2024-04-26T20:58:20.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.852+0000 7f4ce3200640 1 -- 172.21.15.138:0/2133476744 <== osd.4 v2:172.21.15.143:6800/2942056312 19 ==== osd_op_reply(75 [pgnls-filter start_epoch 51 out=49b] v41'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206000 con 0x562337546000 2024-04-26T20:58:20.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.852+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:76 6.2 6:40000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337424800 con 0x562337547c00 2024-04-26T20:58:20.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.852+0000 7f4ce3c00640 1 -- 172.21.15.138:0/2133476744 <== osd.3 v2:172.21.15.138:6824/3098242154 13 ==== osd_op_reply(76 [pgnls-filter start_epoch 51 out=49b] v41'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206780 con 0x562337547c00 2024-04-26T20:58:20.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.852+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:77 6.22 6:44000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337f25c00 con 0x562337547c00 2024-04-26T20:58:20.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.852+0000 7f4ce3c00640 1 -- 172.21.15.138:0/2133476744 <== osd.3 v2:172.21.15.138:6824/3098242154 14 ==== osd_op_reply(77 [pgnls-filter start_epoch 51 out=49b] v41'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206780 con 0x562337547c00 2024-04-26T20:58:20.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.852+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] -- osd_op(unknown.0.0:78 6.12 6:48000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337570800 con 0x562337425c00 2024-04-26T20:58:20.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.852+0000 7f4ce4600640 1 -- 172.21.15.138:0/2133476744 <== osd.0 v2:172.21.15.138:6800/3534772245 13 ==== osd_op_reply(78 [pgnls-filter start_epoch 51 out=49b] v41'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206500 con 0x562337425c00 2024-04-26T20:58:20.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.852+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] -- osd_op(unknown.0.0:79 6.32 6:4c000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337547400 con 0x562337558400 2024-04-26T20:58:20.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.852+0000 7f4ce4600640 1 -- 172.21.15.138:0/2133476744 <== osd.2 v2:172.21.15.138:6808/4273721573 5 ==== osd_op_reply(79 [pgnls-filter start_epoch 51 out=49b] v41'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206500 con 0x562337558400 2024-04-26T20:58:20.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.852+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] -- osd_op(unknown.0.0:80 6.a 6:50000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337570c00 con 0x562337425c00 2024-04-26T20:58:20.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.852+0000 7f4ce4600640 1 -- 172.21.15.138:0/2133476744 <== osd.0 v2:172.21.15.138:6800/3534772245 14 ==== osd_op_reply(80 [pgnls-filter start_epoch 51 out=49b] v41'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206500 con 0x562337425c00 2024-04-26T20:58:20.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.852+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] -- osd_op(unknown.0.0:81 6.2a 6:54000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337559000 con 0x562337425c00 2024-04-26T20:58:20.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.852+0000 7f4ce4600640 1 -- 172.21.15.138:0/2133476744 <== osd.0 v2:172.21.15.138:6800/3534772245 15 ==== osd_op_reply(81 [pgnls-filter start_epoch 51 out=49b] v41'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206500 con 0x562337425c00 2024-04-26T20:58:20.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.852+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:82 6.1a 6:58000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337571000 con 0x562337547c00 2024-04-26T20:58:20.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.852+0000 7f4ce3c00640 1 -- 172.21.15.138:0/2133476744 <== osd.3 v2:172.21.15.138:6824/3098242154 15 ==== osd_op_reply(82 [pgnls-filter start_epoch 51 out=49b] v41'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206780 con 0x562337547c00 2024-04-26T20:58:20.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.852+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] -- osd_op(unknown.0.0:83 6.3a 6:5c000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337559400 con 0x562337546400 2024-04-26T20:58:20.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.852+0000 7f4ce3200640 1 -- 172.21.15.138:0/2133476744 <== osd.6 v2:172.21.15.143:6816/1082239825 9 ==== osd_op_reply(83 [pgnls-filter start_epoch 51 out=49b] v41'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206000 con 0x562337546400 2024-04-26T20:58:20.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.852+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] -- osd_op(unknown.0.0:84 6.6 6:60000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337571400 con 0x562338069800 2024-04-26T20:58:20.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.852+0000 7f4ce3200640 1 -- 172.21.15.138:0/2133476744 <== osd.5 v2:172.21.15.143:6808/1910222887 4 ==== osd_op_reply(84 [pgnls-filter start_epoch 51 out=49b] v41'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206000 con 0x562338069800 2024-04-26T20:58:20.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.852+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:85 6.26 6:64000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337558000 con 0x562337546000 2024-04-26T20:58:20.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.856+0000 7f4ce3200640 1 -- 172.21.15.138:0/2133476744 <== osd.4 v2:172.21.15.143:6800/2942056312 20 ==== osd_op_reply(85 [pgnls-filter start_epoch 51 out=49b] v41'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206000 con 0x562337546000 2024-04-26T20:58:20.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.856+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:86 6.16 6:68000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337571c00 con 0x562337546000 2024-04-26T20:58:20.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.856+0000 7f4ce3200640 1 -- 172.21.15.138:0/2133476744 <== osd.4 v2:172.21.15.143:6800/2942056312 21 ==== osd_op_reply(86 [pgnls-filter start_epoch 51 out=49b] v41'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206000 con 0x562337546000 2024-04-26T20:58:20.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.856+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] -- osd_op(unknown.0.0:87 6.36 6:6c000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337558800 con 0x562337546800 2024-04-26T20:58:20.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.856+0000 7f4ce4600640 1 -- 172.21.15.138:0/2133476744 <== osd.1 v2:172.21.15.138:6816/1427635773 10 ==== osd_op_reply(87 [pgnls-filter start_epoch 51 out=49b] v41'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206500 con 0x562337546800 2024-04-26T20:58:20.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.856+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] -- osd_op(unknown.0.0:88 6.e 6:70000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337570000 con 0x562337546800 2024-04-26T20:58:20.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.856+0000 7f4ce4600640 1 -- 172.21.15.138:0/2133476744 <== osd.1 v2:172.21.15.138:6816/1427635773 11 ==== osd_op_reply(88 [pgnls-filter start_epoch 51 out=49b] v41'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206500 con 0x562337546800 2024-04-26T20:58:20.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.856+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:89 6.2e 6:74000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337559c00 con 0x562337547c00 2024-04-26T20:58:20.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.856+0000 7f4ce3c00640 1 -- 172.21.15.138:0/2133476744 <== osd.3 v2:172.21.15.138:6824/3098242154 16 ==== osd_op_reply(89 [pgnls-filter start_epoch 51 out=49b] v41'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206780 con 0x562337547c00 2024-04-26T20:58:20.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.856+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:90 6.1e 6:78000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337f25c00 con 0x562337547c00 2024-04-26T20:58:20.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.856+0000 7f4ce3c00640 1 -- 172.21.15.138:0/2133476744 <== osd.3 v2:172.21.15.138:6824/3098242154 17 ==== osd_op_reply(90 [pgnls-filter start_epoch 51 out=49b] v41'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206780 con 0x562337547c00 2024-04-26T20:58:20.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.856+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] -- osd_op(unknown.0.0:91 6.3e 6:7c000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337547000 con 0x562337546400 2024-04-26T20:58:20.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.856+0000 7f4ce3200640 1 -- 172.21.15.138:0/2133476744 <== osd.6 v2:172.21.15.143:6816/1082239825 10 ==== osd_op_reply(91 [pgnls-filter start_epoch 51 out=49b] v41'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206000 con 0x562337546400 2024-04-26T20:58:20.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.856+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] -- osd_op(unknown.0.0:92 6.1 6:80000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337424800 con 0x562337546400 2024-04-26T20:58:20.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.856+0000 7f4ce3200640 1 -- 172.21.15.138:0/2133476744 <== osd.6 v2:172.21.15.143:6816/1082239825 11 ==== osd_op_reply(92 [pgnls-filter start_epoch 51 out=49b] v41'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206000 con 0x562337546400 2024-04-26T20:58:20.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.856+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] -- osd_op(unknown.0.0:93 6.21 6:84000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337547800 con 0x562337546800 2024-04-26T20:58:20.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.856+0000 7f4ce4600640 1 -- 172.21.15.138:0/2133476744 <== osd.1 v2:172.21.15.138:6816/1427635773 12 ==== osd_op_reply(93 [pgnls-filter start_epoch 51 out=49b] v41'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206500 con 0x562337546800 2024-04-26T20:58:20.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.856+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] -- osd_op(unknown.0.0:94 6.11 6:88000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562338069c00 con 0x562337546400 2024-04-26T20:58:20.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.856+0000 7f4ce3200640 1 -- 172.21.15.138:0/2133476744 <== osd.6 v2:172.21.15.143:6816/1082239825 12 ==== osd_op_reply(94 [pgnls-filter start_epoch 51 out=49b] v41'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206000 con 0x562337546400 2024-04-26T20:58:20.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.856+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:95 6.31 6:8c000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337546c00 con 0x562337547c00 2024-04-26T20:58:20.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.856+0000 7f4ce3c00640 1 -- 172.21.15.138:0/2133476744 <== osd.3 v2:172.21.15.138:6824/3098242154 18 ==== osd_op_reply(95 [pgnls-filter start_epoch 51 out=49b] v41'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206780 con 0x562337547c00 2024-04-26T20:58:20.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.856+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:96 6.9 6:90000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337534c00 con 0x562337546000 2024-04-26T20:58:20.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.856+0000 7f4ce3200640 1 -- 172.21.15.138:0/2133476744 <== osd.4 v2:172.21.15.143:6800/2942056312 22 ==== osd_op_reply(96 [pgnls-filter start_epoch 51 out=49b] v41'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206000 con 0x562337546000 2024-04-26T20:58:20.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.860+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:97 6.29 6:94000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337570400 con 0x562337547c00 2024-04-26T20:58:20.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.860+0000 7f4ce3c00640 1 -- 172.21.15.138:0/2133476744 <== osd.3 v2:172.21.15.138:6824/3098242154 19 ==== osd_op_reply(97 [pgnls-filter start_epoch 51 out=49b] v41'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206780 con 0x562337547c00 2024-04-26T20:58:20.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.860+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] -- osd_op(unknown.0.0:98 6.19 6:98000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337559800 con 0x562337425c00 2024-04-26T20:58:20.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.860+0000 7f4ce4600640 1 -- 172.21.15.138:0/2133476744 <== osd.0 v2:172.21.15.138:6800/3534772245 16 ==== osd_op_reply(98 [pgnls-filter start_epoch 51 out=49b] v41'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206500 con 0x562337425c00 2024-04-26T20:58:20.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.860+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] -- osd_op(unknown.0.0:99 6.39 6:9c000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x56233757c000 con 0x562337546800 2024-04-26T20:58:20.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.860+0000 7f4ce4600640 1 -- 172.21.15.138:0/2133476744 <== osd.1 v2:172.21.15.138:6816/1427635773 13 ==== osd_op_reply(99 [pgnls-filter start_epoch 51 out=49b] v41'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206500 con 0x562337546800 2024-04-26T20:58:20.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.860+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] -- osd_op(unknown.0.0:100 6.5 6:a0000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337558c00 con 0x562337425c00 2024-04-26T20:58:20.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.860+0000 7f4ce4600640 1 -- 172.21.15.138:0/2133476744 <== osd.0 v2:172.21.15.138:6800/3534772245 17 ==== osd_op_reply(100 [pgnls-filter start_epoch 51 out=49b] v41'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206500 con 0x562337425c00 2024-04-26T20:58:20.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.860+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] -- osd_op(unknown.0.0:101 6.25 6:a4000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x56233757c400 con 0x562337425c00 2024-04-26T20:58:20.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.860+0000 7f4ce4600640 1 -- 172.21.15.138:0/2133476744 <== osd.0 v2:172.21.15.138:6800/3534772245 18 ==== osd_op_reply(101 [pgnls-filter start_epoch 51 out=49b] v41'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206500 con 0x562337425c00 2024-04-26T20:58:20.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.860+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] -- osd_op(unknown.0.0:102 6.15 6:a8000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337559000 con 0x562337558400 2024-04-26T20:58:20.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.860+0000 7f4ce4600640 1 -- 172.21.15.138:0/2133476744 <== osd.2 v2:172.21.15.138:6808/4273721573 6 ==== osd_op_reply(102 [pgnls-filter start_epoch 51 out=49b] v41'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206500 con 0x562337558400 2024-04-26T20:58:20.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.860+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] -- osd_op(unknown.0.0:103 6.35 6:ac000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x56233757c800 con 0x562337425c00 2024-04-26T20:58:20.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.860+0000 7f4ce4600640 1 -- 172.21.15.138:0/2133476744 <== osd.0 v2:172.21.15.138:6800/3534772245 19 ==== osd_op_reply(103 [pgnls-filter start_epoch 51 out=49b] v41'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206500 con 0x562337425c00 2024-04-26T20:58:20.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.860+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] -- osd_op(unknown.0.0:104 6.d 6:b0000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337571800 con 0x562337558400 2024-04-26T20:58:20.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.860+0000 7f4ce4600640 1 -- 172.21.15.138:0/2133476744 <== osd.2 v2:172.21.15.138:6808/4273721573 7 ==== osd_op_reply(104 [pgnls-filter start_epoch 51 out=49b] v41'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206500 con 0x562337558400 2024-04-26T20:58:20.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.860+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] -- osd_op(unknown.0.0:105 6.2d 6:b4000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x56233757cc00 con 0x562338069800 2024-04-26T20:58:20.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.860+0000 7f4ce3200640 1 -- 172.21.15.138:0/2133476744 <== osd.5 v2:172.21.15.143:6808/1910222887 5 ==== osd_op_reply(105 [pgnls-filter start_epoch 51 out=49b] v41'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206000 con 0x562338069800 2024-04-26T20:58:20.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.860+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] -- osd_op(unknown.0.0:106 6.1d 6:b8000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337570800 con 0x562337546400 2024-04-26T20:58:20.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.860+0000 7f4ce3200640 1 -- 172.21.15.138:0/2133476744 <== osd.6 v2:172.21.15.143:6816/1082239825 13 ==== osd_op_reply(106 [pgnls-filter start_epoch 51 out=49b] v41'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206000 con 0x562337546400 2024-04-26T20:58:20.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.860+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:107 6.3d 6:bc000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x56233757d000 con 0x562337546000 2024-04-26T20:58:20.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.860+0000 7f4ce3200640 1 -- 172.21.15.138:0/2133476744 <== osd.4 v2:172.21.15.143:6800/2942056312 23 ==== osd_op_reply(107 [pgnls-filter start_epoch 51 out=49b] v41'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206000 con 0x562337546000 2024-04-26T20:58:20.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.860+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] -- osd_op(unknown.0.0:108 6.3 6:c0000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337570c00 con 0x562337425c00 2024-04-26T20:58:20.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.864+0000 7f4ce4600640 1 -- 172.21.15.138:0/2133476744 <== osd.0 v2:172.21.15.138:6800/3534772245 20 ==== osd_op_reply(108 [pgnls-filter start_epoch 51 out=49b] v41'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206500 con 0x562337425c00 2024-04-26T20:58:20.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.864+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] -- osd_op(unknown.0.0:109 6.23 6:c4000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x56233757d400 con 0x562337558400 2024-04-26T20:58:20.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.864+0000 7f4ce4600640 1 -- 172.21.15.138:0/2133476744 <== osd.2 v2:172.21.15.138:6808/4273721573 8 ==== osd_op_reply(109 [pgnls-filter start_epoch 51 out=49b] v41'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206500 con 0x562337558400 2024-04-26T20:58:20.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.864+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- osd_op(unknown.0.0:110 6.13 6:c8000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337547400 con 0x562337534400 2024-04-26T20:58:20.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.864+0000 7f4ce3c00640 1 -- 172.21.15.138:0/2133476744 <== osd.7 v2:172.21.15.143:6824/3295508495 9 ==== osd_op_reply(110 [pgnls-filter start_epoch 51 out=49b] v41'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206780 con 0x562337534400 2024-04-26T20:58:20.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.864+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] -- osd_op(unknown.0.0:111 6.33 6:cc000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x56233757d800 con 0x562337546800 2024-04-26T20:58:20.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.864+0000 7f4ce4600640 1 -- 172.21.15.138:0/2133476744 <== osd.1 v2:172.21.15.138:6816/1427635773 14 ==== osd_op_reply(111 [pgnls-filter start_epoch 51 out=49b] v41'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206500 con 0x562337546800 2024-04-26T20:58:20.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.864+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:112 6.b 6:d0000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337534800 con 0x562337546000 2024-04-26T20:58:20.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.864+0000 7f4ce3200640 1 -- 172.21.15.138:0/2133476744 <== osd.4 v2:172.21.15.143:6800/2942056312 24 ==== osd_op_reply(112 [pgnls-filter start_epoch 51 out=49b] v41'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206000 con 0x562337546000 2024-04-26T20:58:20.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.864+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] -- osd_op(unknown.0.0:113 6.2b 6:d4000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x56233757dc00 con 0x562337425c00 2024-04-26T20:58:20.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.864+0000 7f4ce4600640 1 -- 172.21.15.138:0/2133476744 <== osd.0 v2:172.21.15.138:6800/3534772245 21 ==== osd_op_reply(113 [pgnls-filter start_epoch 51 out=49b] v41'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206500 con 0x562337425c00 2024-04-26T20:58:20.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.864+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] -- osd_op(unknown.0.0:114 6.1b 6:d8000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337559400 con 0x562337546400 2024-04-26T20:58:20.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.864+0000 7f4ce3200640 1 -- 172.21.15.138:0/2133476744 <== osd.6 v2:172.21.15.143:6816/1082239825 14 ==== osd_op_reply(114 [pgnls-filter start_epoch 51 out=49b] v41'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206000 con 0x562337546400 2024-04-26T20:58:20.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.864+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- osd_op(unknown.0.0:115 6.3b 6:dc000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x56233757cc00 con 0x562337534400 2024-04-26T20:58:20.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.864+0000 7f4ce3c00640 1 -- 172.21.15.138:0/2133476744 <== osd.7 v2:172.21.15.143:6824/3295508495 10 ==== osd_op_reply(115 [pgnls-filter start_epoch 51 out=49b] v41'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206780 con 0x562337534400 2024-04-26T20:58:20.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.864+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:116 6.7 6:e0000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337558000 con 0x562337547c00 2024-04-26T20:58:20.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.864+0000 7f4ce3c00640 1 -- 172.21.15.138:0/2133476744 <== osd.3 v2:172.21.15.138:6824/3098242154 20 ==== osd_op_reply(116 [pgnls-filter start_epoch 51 out=81b] v51'10 uv10 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x562337206780 con 0x562337547c00 2024-04-26T20:58:20.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.864+0000 7f4ce5bbb8c0 20 datascan.forall_objects: OSD matched oid 10000000001.00000000 2024-04-26T20:58:20.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.864+0000 7f4ce5bbb8c0 10 datascan.operator(): handling object 10000000001.0 2024-04-26T20:58:20.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.864+0000 7f4ce5bbb8c0 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:117 6.7 6:e2e07930:::10000000001.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x562337535400 con 0x562337547c00 2024-04-26T20:58:20.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.864+0000 7f4ce3c00640 1 -- 172.21.15.138:0/2133476744 <== osd.3 v2:172.21.15.138:6824/3098242154 21 ==== osd_op_reply(117 10000000001.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (95) out=95b,getxattr (30) out=30b,getxattr] v0'0 uv10 ondisk = 0) ==== 416+0+163 (crc 0 0 0) 0x562337206780 con 0x562337547c00 2024-04-26T20:58:20.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.864+0000 7f4ce5bbb8c0 20 datascan.operator(): loaded layout from xattr: pi: 6 os: 4194304 sc: 1 su: 4194304 2024-04-26T20:58:20.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.864+0000 7f4ce5bbb8c0 10 datascan.inject_with_backtrace: inode: 0x0x10000000001 2024-04-26T20:58:20.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.864+0000 7f4ce5bbb8c0 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/sixmegs 2024-04-26T20:58:20.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.864+0000 7f4ce5bbb8c0 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=sixmegs 2024-04-26T20:58:20.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.864+0000 7f4ce5bbb8c0 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- osd_op(unknown.0.0:118 7.10 7:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x562337535800 con 0x562337534400 2024-04-26T20:58:20.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.864+0000 7f4ce3c00640 1 -- 172.21.15.138:0/2133476744 <== osd.7 v2:172.21.15.143:6824/3295508495 11 ==== osd_op_reply(118 10000000000.00000000 [getxattr] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x562337206780 con 0x562337534400 2024-04-26T20:58:20.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.864+0000 7f4ce5bbb8c0 4 datascan.get_frag_of: Unexpected error on '10000000000.00000000': (2) No such file or directory 2024-04-26T20:58:20.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.864+0000 7f4ce5bbb8c0 20 datascan.inject_with_backtrace: don't know fragment for 0x0x10000000000/sixmegs, will insert to root 2024-04-26T20:58:20.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.864+0000 7f4ce5bbb8c0 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- osd_op(unknown.0.0:119 7.10 7:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x562337535c00 con 0x562337534400 2024-04-26T20:58:20.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.868+0000 7f4ce3c00640 1 -- 172.21.15.138:0/2133476744 <== osd.7 v2:172.21.15.143:6824/3295508495 12 ==== osd_op_reply(119 10000000000.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x562337206780 con 0x562337534400 2024-04-26T20:58:20.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.868+0000 7f4ce5bbb8c0 10 datascan.find_or_create_dirfrag: read_version = 0 2024-04-26T20:58:20.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.868+0000 7f4ce5bbb8c0 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- osd_op(unknown.0.0:120 7.10 7:0cf6ad0f:::10000000000.00000000:head [create,omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x562337559c00 con 0x562337534400 2024-04-26T20:58:20.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.868+0000 7f4ce3c00640 1 -- 172.21.15.138:0/2133476744 <== osd.7 v2:172.21.15.143:6824/3295508495 13 ==== osd_op_reply(120 10000000000.00000000 [create,omap-set-header] v51'1 uv1 ondisk = 0) ==== 206+0+0 (crc 0 0 0) 0x562337206780 con 0x562337534400 2024-04-26T20:58:20.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.868+0000 7f4ce5bbb8c0 10 datascan.find_or_create_dirfrag: Created dirfrag: 0x0x10000000000 2024-04-26T20:58:20.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.868+0000 7f4ce5bbb8c0 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- osd_op(unknown.0.0:121 7.10 7:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x562337558000 con 0x562337534400 2024-04-26T20:58:20.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.868+0000 7f4ce3c00640 1 -- 172.21.15.138:0/2133476744 <== osd.7 v2:172.21.15.143:6824/3295508495 14 ==== osd_op_reply(121 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv1 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x562337206780 con 0x562337534400 2024-04-26T20:58:20.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.868+0000 7f4ce5bbb8c0 20 datascan.read_dentry: oid=10000000000.00000000 dname=sixmegs frag=*, r=0 2024-04-26T20:58:20.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.868+0000 7f4ce5bbb8c0 20 datascan.read_dentry: sixmegs_head not found in result 2024-04-26T20:58:20.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.868+0000 7f4ce5bbb8c0 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000001 at 0x0x10000000000/sixmegs with size=6291456 bytes 2024-04-26T20:58:20.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.868+0000 7f4ce5bbb8c0 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- osd_op(unknown.0.0:122 7.10 7:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=508b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x56233757cc00 con 0x562337534400 2024-04-26T20:58:20.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.868+0000 7f4ce3c00640 1 -- 172.21.15.138:0/2133476744 <== osd.7 v2:172.21.15.143:6824/3295508495 15 ==== osd_op_reply(122 10000000000.00000000 [omap-set-vals] v51'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562337206780 con 0x562337534400 2024-04-26T20:58:20.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.868+0000 7f4ce5bbb8c0 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/sixmegs pointing to 0x0x10000000001 2024-04-26T20:58:20.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.868+0000 7f4ce5bbb8c0 10 datascan.inject_with_backtrace: backptr: 0x0x1/subdir 2024-04-26T20:58:20.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.868+0000 7f4ce5bbb8c0 20 datascan.get_frag_of: dirino=0x1 target_dname=subdir 2024-04-26T20:58:20.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.868+0000 7f4ce5bbb8c0 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] -- osd_op(unknown.0.0:123 7.1f 7:ff5b34d6:::1.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x562337546c00 con 0x562337425c00 2024-04-26T20:58:20.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.872+0000 7f4ce4600640 1 -- 172.21.15.138:0/2133476744 <== osd.0 v2:172.21.15.138:6800/3534772245 22 ==== osd_op_reply(123 1.00000000 [getxattr] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 154+0+0 (crc 0 0 0) 0x562337206500 con 0x562337425c00 2024-04-26T20:58:20.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.872+0000 7f4ce5bbb8c0 4 datascan.get_frag_of: Unexpected error on '1.00000000': (2) No such file or directory 2024-04-26T20:58:20.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.872+0000 7f4ce5bbb8c0 20 datascan.inject_with_backtrace: don't know fragment for 0x0x1/subdir, will insert to root 2024-04-26T20:58:20.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.872+0000 7f4ce5bbb8c0 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] -- osd_op(unknown.0.0:124 7.1f 7:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x562337547400 con 0x562337425c00 2024-04-26T20:58:20.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.872+0000 7f4ce4600640 1 -- 172.21.15.138:0/2133476744 <== osd.0 v2:172.21.15.138:6800/3534772245 23 ==== osd_op_reply(124 1.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 154+0+0 (crc 0 0 0) 0x562337206500 con 0x562337425c00 2024-04-26T20:58:20.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.872+0000 7f4ce5bbb8c0 10 datascan.find_or_create_dirfrag: read_version = 0 2024-04-26T20:58:20.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.872+0000 7f4ce5bbb8c0 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] -- osd_op(unknown.0.0:125 7.1f 7:ff5b34d6:::1.00000000:head [create,omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x562337571000 con 0x562337425c00 2024-04-26T20:58:20.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.872+0000 7f4ce4600640 1 -- 172.21.15.138:0/2133476744 <== osd.0 v2:172.21.15.138:6800/3534772245 24 ==== osd_op_reply(125 1.00000000 [create,omap-set-header] v51'2 uv2 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x562337206500 con 0x562337425c00 2024-04-26T20:58:20.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.872+0000 7f4ce5bbb8c0 10 datascan.find_or_create_dirfrag: Created dirfrag: 0x0x1 2024-04-26T20:58:20.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.872+0000 7f4ce5bbb8c0 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] -- osd_op(unknown.0.0:126 7.1f 7:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x562337570400 con 0x562337425c00 2024-04-26T20:58:20.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.872+0000 7f4ce4600640 1 -- 172.21.15.138:0/2133476744 <== osd.0 v2:172.21.15.138:6800/3534772245 25 ==== osd_op_reply(126 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv2 ondisk = 0) ==== 154+0+4 (crc 0 0 0) 0x562337206500 con 0x562337425c00 2024-04-26T20:58:20.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.872+0000 7f4ce5bbb8c0 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2024-04-26T20:58:20.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.872+0000 7f4ce5bbb8c0 20 datascan.read_dentry: subdir_head not found in result 2024-04-26T20:58:20.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.872+0000 7f4ce5bbb8c0 10 datascan.inject_with_backtrace: Linking ancestor directory of inode 0x0x10000000000 at 0x0x1:subdir 2024-04-26T20:58:20.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.872+0000 7f4ce5bbb8c0 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] -- osd_op(unknown.0.0:127 7.1f 7:ff5b34d6:::1.00000000:head [omap-set-vals in=507b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x562337f25c00 con 0x562337425c00 2024-04-26T20:58:20.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.872+0000 7f4ce4600640 1 -- 172.21.15.138:0/2133476744 <== osd.0 v2:172.21.15.138:6800/3534772245 26 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v51'3 uv3 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x562337206500 con 0x562337425c00 2024-04-26T20:58:20.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.872+0000 7f4ce5bbb8c0 20 datascan.inject_linkage: Injected dentry 0x0x1/subdir pointing to 0x0x10000000000 2024-04-26T20:58:20.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.872+0000 7f4ce5bbb8c0 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] -- osd_op(unknown.0.0:128 6.27 6:e4000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337f25c00 con 0x562337558400 2024-04-26T20:58:20.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.876+0000 7f4ce4600640 1 -- 172.21.15.138:0/2133476744 <== osd.2 v2:172.21.15.138:6808/4273721573 9 ==== osd_op_reply(128 [pgnls-filter start_epoch 51 out=49b] v41'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206500 con 0x562337558400 2024-04-26T20:58:20.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.876+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] -- osd_op(unknown.0.0:129 6.17 6:e8000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337558800 con 0x562337546800 2024-04-26T20:58:20.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.876+0000 7f4ce4600640 1 -- 172.21.15.138:0/2133476744 <== osd.1 v2:172.21.15.138:6816/1427635773 15 ==== osd_op_reply(129 [pgnls-filter start_epoch 51 out=49b] v41'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206500 con 0x562337546800 2024-04-26T20:58:20.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.876+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- osd_op(unknown.0.0:130 6.37 6:ec000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x56233757c000 con 0x562337534400 2024-04-26T20:58:20.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.876+0000 7f4ce3c00640 1 -- 172.21.15.138:0/2133476744 <== osd.7 v2:172.21.15.143:6824/3295508495 16 ==== osd_op_reply(130 [pgnls-filter start_epoch 51 out=49b] v41'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206780 con 0x562337534400 2024-04-26T20:58:20.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.876+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] -- osd_op(unknown.0.0:131 6.f 6:f0000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337547000 con 0x562338069800 2024-04-26T20:58:20.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.876+0000 7f4ce3200640 1 -- 172.21.15.138:0/2133476744 <== osd.5 v2:172.21.15.143:6808/1910222887 6 ==== osd_op_reply(131 [pgnls-filter start_epoch 51 out=49b] v41'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206000 con 0x562338069800 2024-04-26T20:58:20.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.876+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:132 6.2f 6:f4000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x56233757c400 con 0x562337547c00 2024-04-26T20:58:20.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.876+0000 7f4ce3c00640 1 -- 172.21.15.138:0/2133476744 <== osd.3 v2:172.21.15.138:6824/3098242154 22 ==== osd_op_reply(132 [pgnls-filter start_epoch 51 out=49b] v41'9 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206780 con 0x562337547c00 2024-04-26T20:58:20.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.876+0000 7f4cdd800640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] -- osd_op(unknown.0.0:133 6.1f 6:f8000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x562337547800 con 0x562337546400 2024-04-26T20:58:20.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.876+0000 7f4ce3200640 1 -- 172.21.15.138:0/2133476744 <== osd.6 v2:172.21.15.143:6816/1082239825 15 ==== osd_op_reply(133 [pgnls-filter start_epoch 51 out=49b] v41'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206000 con 0x562337546400 2024-04-26T20:58:20.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.876+0000 7f4cde200640 1 -- 172.21.15.138:0/2133476744 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:134 6.3f 6:fc000000::::head [pgnls-filter start_epoch 51 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x56233757c800 con 0x562337546000 2024-04-26T20:58:20.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.876+0000 7f4ce3200640 1 -- 172.21.15.138:0/2133476744 <== osd.4 v2:172.21.15.143:6800/2942056312 25 ==== osd_op_reply(134 [pgnls-filter start_epoch 51 out=49b] v41'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562337206000 con 0x562337546000 2024-04-26T20:58:20.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.876+0000 7f4ce5bbb8c0 1 -- 172.21.15.138:0/2133476744 >> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] conn(0x562337425c00 msgr2=0x562337f10c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.876+0000 7f4ce5bbb8c0 1 --2- 172.21.15.138:0/2133476744 >> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] conn(0x562337425c00 0x562337f10c00 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.876+0000 7f4ce5bbb8c0 1 -- 172.21.15.138:0/2133476744 >> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] conn(0x562337546800 msgr2=0x56233754c580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.876+0000 7f4ce5bbb8c0 1 --2- 172.21.15.138:0/2133476744 >> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] conn(0x562337546800 0x56233754c580 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.876+0000 7f4ce5bbb8c0 1 -- 172.21.15.138:0/2133476744 >> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] conn(0x562337558400 msgr2=0x56233754cb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.876+0000 7f4ce5bbb8c0 1 --2- 172.21.15.138:0/2133476744 >> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] conn(0x562337558400 0x56233754cb00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.876+0000 7f4ce5bbb8c0 1 -- 172.21.15.138:0/2133476744 >> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] conn(0x562337547c00 msgr2=0x56233754d080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.876+0000 7f4ce5bbb8c0 1 --2- 172.21.15.138:0/2133476744 >> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] conn(0x562337547c00 0x56233754d080 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.876+0000 7f4ce3c00640 1 -- 172.21.15.138:0/2133476744 reap_dead start 2024-04-26T20:58:20.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.876+0000 7f4ce5bbb8c0 1 -- 172.21.15.138:0/2133476744 >> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] conn(0x562337546000 msgr2=0x56233754c000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.876+0000 7f4ce5bbb8c0 1 --2- 172.21.15.138:0/2133476744 >> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] conn(0x562337546000 0x56233754c000 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.876+0000 7f4ce5bbb8c0 1 -- 172.21.15.138:0/2133476744 >> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] conn(0x562338069800 msgr2=0x562337f10680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.876+0000 7f4ce5bbb8c0 1 --2- 172.21.15.138:0/2133476744 >> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] conn(0x562338069800 0x562337f10680 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.876+0000 7f4ce5bbb8c0 1 -- 172.21.15.138:0/2133476744 >> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] conn(0x562337546400 msgr2=0x56233754d600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.876+0000 7f4ce5bbb8c0 1 --2- 172.21.15.138:0/2133476744 >> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] conn(0x562337546400 0x56233754d600 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.876+0000 7f4ce5bbb8c0 1 -- 172.21.15.138:0/2133476744 >> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] conn(0x562337534400 msgr2=0x562337f11180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.876+0000 7f4ce5bbb8c0 1 --2- 172.21.15.138:0/2133476744 >> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] conn(0x562337534400 0x562337f11180 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.876+0000 7f4ce3c00640 1 -- 172.21.15.138:0/2133476744 reap_dead start 2024-04-26T20:58:20.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.876+0000 7f4ce5bbb8c0 1 -- 172.21.15.138:0/2133476744 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x562337425800 msgr2=0x562337f10100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.876+0000 7f4ce5bbb8c0 1 --2- 172.21.15.138:0/2133476744 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x562337425800 0x562337f10100 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x56233804b170 tx=0x56233721b4a0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.876+0000 7f4ce5bbb8c0 1 -- 172.21.15.138:0/2133476744 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562338069000 msgr2=0x562337f0f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.876+0000 7f4ce5bbb8c0 1 --2- 172.21.15.138:0/2133476744 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562338069000 0x562337f0f600 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x56233804be60 tx=0x562338065c20 comp rx=0 tx=0).stop 2024-04-26T20:58:20.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.876+0000 7f4ce5bbb8c0 1 -- 172.21.15.138:0/2133476744 shutdown_connections 2024-04-26T20:58:20.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.876+0000 7f4ce5bbb8c0 1 --2- 172.21.15.138:0/2133476744 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x562337425800 0x562337f10100 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.876+0000 7f4ce5bbb8c0 1 --2- 172.21.15.138:0/2133476744 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562338069000 0x562337f0f600 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.876+0000 7f4ce5bbb8c0 1 -- 172.21.15.138:0/2133476744 >> 172.21.15.138:0/2133476744 conn(0x562337134c00 msgr2=0x562337161000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:20.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.876+0000 7f4ce5bbb8c0 1 -- 172.21.15.138:0/2133476744 shutdown_connections 2024-04-26T20:58:20.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.876+0000 7f4ce5bbb8c0 1 -- 172.21.15.138:0/2133476744 wait complete. 2024-04-26T20:58:20.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.876+0000 7f4ce5bbb8c0 1 -- 172.21.15.138:0/659945859 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562337135400 msgr2=0x562337f0e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.876+0000 7f4ce5bbb8c0 1 --2- 172.21.15.138:0/659945859 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562337135400 0x562337f0e580 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x562337f95350 tx=0x5623372168a0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.876+0000 7f4ce5bbb8c0 1 -- 172.21.15.138:0/659945859 shutdown_connections 2024-04-26T20:58:20.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.876+0000 7f4ce5bbb8c0 1 --2- 172.21.15.138:0/659945859 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562337135000 0x562337f0eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.876+0000 7f4ce5bbb8c0 1 --2- 172.21.15.138:0/659945859 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562337135400 0x562337f0e580 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.876+0000 7f4ce5bbb8c0 1 --2- 172.21.15.138:0/659945859 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x562337135800 0x562337f0e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.876+0000 7f4ce5bbb8c0 1 -- 172.21.15.138:0/659945859 >> 172.21.15.138:0/659945859 conn(0x562337135c00 msgr2=0x562337161800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:20.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.880+0000 7f4ce5bbb8c0 1 -- 172.21.15.138:0/659945859 shutdown_connections 2024-04-26T20:58:20.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.880+0000 7f4ce5bbb8c0 1 -- 172.21.15.138:0/659945859 wait complete. 2024-04-26T20:58:20.884 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_inodes', '--alternate-pool', 'recovery_fs_metadata', '--filesystem', 'cephfs', '--force-corrupt', '--force-init', 'cephfs_data'] in time 0:00:00.124731, result: 2024-04-26T20:58:20.885 DEBUG:teuthology.orchestra.run.smithi138:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_links --filesystem recovery_fs 2024-04-26T20:58:20.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.968+0000 7f0a1ae2f8c0 1 -- start start 2024-04-26T20:58:20.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.968+0000 7f0a1ae2f8c0 1 Processor -- start 2024-04-26T20:58:20.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.972+0000 7f0a1ae2f8c0 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559de16c1000 0x559de2496000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.972+0000 7f0a1ae2f8c0 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559de16c1400 0x559de2496580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.972+0000 7f0a1ae2f8c0 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559de16c1800 0x559de2496b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.972+0000 7f0a1ae2f8c0 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x559de24b4780 con 0x559de16c1800 2024-04-26T20:58:20.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.972+0000 7f0a1ae2f8c0 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x559de24b4600 con 0x559de16c1400 2024-04-26T20:58:20.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.972+0000 7f0a1ae2f8c0 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x559de24b4480 con 0x559de16c1000 2024-04-26T20:58:20.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.972+0000 7f0a18800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559de16c1800 0x559de2496b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.972+0000 7f0a18800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559de16c1800 0x559de2496b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:54482/0 (socket says 172.21.15.138:54482) 2024-04-26T20:58:20.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.972+0000 7f0a18800640 1 -- 172.21.15.138:0/1880863784 learned_addr learned my addr 172.21.15.138:0/1880863784 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:20.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.972+0000 7f0a17e00640 1 --2- 172.21.15.138:0/1880863784 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559de16c1000 0x559de2496000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.972+0000 7f0a17400640 1 --2- 172.21.15.138:0/1880863784 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559de16c1400 0x559de2496580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.972+0000 7f0a18800640 1 -- 172.21.15.138:0/1880863784 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559de16c1000 msgr2=0x559de2496000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:20.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.972+0000 7f0a18800640 1 --2- 172.21.15.138:0/1880863784 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559de16c1000 0x559de2496000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.972+0000 7f0a18800640 1 -- 172.21.15.138:0/1880863784 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559de16c1400 msgr2=0x559de2496580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:20.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.972+0000 7f0a18800640 1 --2- 172.21.15.138:0/1880863784 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559de16c1400 0x559de2496580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.972+0000 7f0a18800640 1 -- 172.21.15.138:0/1880863784 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559de16e61e0 con 0x559de16c1800 2024-04-26T20:58:20.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.972+0000 7f0a18800640 1 --2- 172.21.15.138:0/1880863784 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559de16c1800 0x559de2496b00 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x559de2521770 tx=0x559de17a6fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83f177bf3415ad18 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.972+0000 7f0a14c00640 1 -- 172.21.15.138:0/1880863784 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559de16f64e0 con 0x559de16c1800 2024-04-26T20:58:20.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.972+0000 7f0a14c00640 1 -- 172.21.15.138:0/1880863784 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x559de170a540 con 0x559de16c1800 2024-04-26T20:58:20.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.972+0000 7f0a14c00640 1 -- 172.21.15.138:0/1880863784 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559de16f6b60 con 0x559de16c1800 2024-04-26T20:58:20.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.972+0000 7f0a1ae2f8c0 1 -- 172.21.15.138:0/1880863784 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559de16e72c0 con 0x559de16c1800 2024-04-26T20:58:20.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.972+0000 7f0a1ae2f8c0 1 -- 172.21.15.138:0/1880863784 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({fsmap=0}) -- 0x559de16e7a40 con 0x559de16c1800 2024-04-26T20:58:20.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.972+0000 7f0a1ae2f8c0 4 waiting for MDS map... 2024-04-26T20:58:20.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.972+0000 7f0a14c00640 1 -- 172.21.15.138:0/1880863784 <== mon.0 v2:172.21.15.138:3300/0 4 ==== osd_map(51..51 src has 1..51) ==== 6756+0+0 (secure 0 0 0) 0x559de249b000 con 0x559de16c1800 2024-04-26T20:58:20.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.972+0000 7f0a14c00640 1 -- 172.21.15.138:0/1880863784 <== mon.0 v2:172.21.15.138:3300/0 5 ==== fsmap(e 23) ==== 4135+0+0 (secure 0 0 0) 0x559de1717180 con 0x559de16c1800 2024-04-26T20:58:20.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.972+0000 7f0a1ae2f8c0 4 Got MDS map 23 2024-04-26T20:58:20.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.972+0000 7f0a1ae2f8c0 4 datascan.main: Using metadata pool output 2024-04-26T20:58:20.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.972+0000 7f0a1ae2f8c0 4 datascan.main: connecting to RADOS... 2024-04-26T20:58:20.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.972+0000 7f0a1ae2f8c0 1 Processor -- start 2024-04-26T20:58:20.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.972+0000 7f0a1ae2f8c0 1 -- start start 2024-04-26T20:58:20.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.972+0000 7f0a1ae2f8c0 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559de25f7c00 0x559de2497080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.972+0000 7f0a1ae2f8c0 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559de264c000 0x559de2497600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.972+0000 7f0a1ae2f8c0 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559de264c400 0x559de2497b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.972+0000 7f0a1ae2f8c0 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x559de24b4300 con 0x559de264c400 2024-04-26T20:58:20.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.972+0000 7f0a1ae2f8c0 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x559de24b4000 con 0x559de25f7c00 2024-04-26T20:58:20.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.972+0000 7f0a1ae2f8c0 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x559de1720900 con 0x559de264c000 2024-04-26T20:58:20.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.972+0000 7f0a17400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559de264c400 0x559de2497b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.972+0000 7f0a17400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559de264c400 0x559de2497b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:54492/0 (socket says 172.21.15.138:54492) 2024-04-26T20:58:20.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.972+0000 7f0a17400640 1 -- 172.21.15.138:0/483295767 learned_addr learned my addr 172.21.15.138:0/483295767 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:20.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.972+0000 7f0a17e00640 1 --2- 172.21.15.138:0/483295767 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559de264c000 0x559de2497600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.972+0000 7f0a17400640 1 --2- 172.21.15.138:0/483295767 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559de25f7c00 0x559de2497080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.972+0000 7f0a17400640 1 -- 172.21.15.138:0/483295767 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559de264c000 msgr2=0x559de2497600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:20.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.972+0000 7f0a17400640 1 --2- 172.21.15.138:0/483295767 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559de264c000 0x559de2497600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.972+0000 7f0a17400640 1 -- 172.21.15.138:0/483295767 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559de25f7c00 msgr2=0x559de2497080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:20.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.972+0000 7f0a17400640 1 --2- 172.21.15.138:0/483295767 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559de25f7c00 0x559de2497080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.972+0000 7f0a17400640 1 -- 172.21.15.138:0/483295767 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559de16e7c20 con 0x559de264c400 2024-04-26T20:58:20.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.976+0000 7f0a17400640 1 --2- 172.21.15.138:0/483295767 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559de264c400 0x559de2497b80 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x559de25faa80 tx=0x559de26078c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d09122568e9c4f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.976+0000 7f0a12400640 1 -- 172.21.15.138:0/483295767 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559de16f64e0 con 0x559de264c400 2024-04-26T20:58:20.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.976+0000 7f0a12400640 1 -- 172.21.15.138:0/483295767 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x559de170ae00 con 0x559de264c400 2024-04-26T20:58:20.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.976+0000 7f0a12400640 1 -- 172.21.15.138:0/483295767 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559de16f6b60 con 0x559de264c400 2024-04-26T20:58:20.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.976+0000 7f0a1ae2f8c0 1 -- 172.21.15.138:0/483295767 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559de264c400 msgr2=0x559de2497b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.976+0000 7f0a1ae2f8c0 1 --2- 172.21.15.138:0/483295767 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559de264c400 0x559de2497b80 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x559de25faa80 tx=0x559de26078c0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.976+0000 7f0a1ae2f8c0 1 -- 172.21.15.138:0/483295767 shutdown_connections 2024-04-26T20:58:20.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.976+0000 7f0a1ae2f8c0 1 --2- 172.21.15.138:0/483295767 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559de264c400 0x559de2497b80 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.976+0000 7f0a1ae2f8c0 1 --2- 172.21.15.138:0/483295767 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559de264c000 0x559de2497600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.976+0000 7f0a1ae2f8c0 1 --2- 172.21.15.138:0/483295767 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559de25f7c00 0x559de2497080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.976+0000 7f0a1ae2f8c0 1 -- 172.21.15.138:0/483295767 >> 172.21.15.138:0/483295767 conn(0x559de25f7800 msgr2=0x559de16ee000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:20.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.976+0000 7f0a1ae2f8c0 1 -- 172.21.15.138:0/483295767 shutdown_connections 2024-04-26T20:58:20.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.976+0000 7f0a1ae2f8c0 1 -- 172.21.15.138:0/483295767 wait complete. 2024-04-26T20:58:20.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.976+0000 7f0a1ae2f8c0 1 Processor -- start 2024-04-26T20:58:20.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.976+0000 7f0a1ae2f8c0 1 -- start start 2024-04-26T20:58:20.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.976+0000 7f0a1ae2f8c0 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559de25f7800 0x559de2497080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.976+0000 7f0a1ae2f8c0 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559de264d000 0x559de2497600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.976+0000 7f0a1ae2f8c0 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559de264cc00 0x559de2497b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.976+0000 7f0a1ae2f8c0 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x559de24b4000 con 0x559de25f7800 2024-04-26T20:58:20.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.976+0000 7f0a1ae2f8c0 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x559de24b5980 con 0x559de264cc00 2024-04-26T20:58:20.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.976+0000 7f0a1ae2f8c0 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x559de24b4300 con 0x559de264d000 2024-04-26T20:58:20.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.976+0000 7f0a17400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559de25f7800 0x559de2497080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.976+0000 7f0a17400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559de25f7800 0x559de2497080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:54508/0 (socket says 172.21.15.138:54508) 2024-04-26T20:58:20.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.976+0000 7f0a17400640 1 -- 172.21.15.138:0/2589647912 learned_addr learned my addr 172.21.15.138:0/2589647912 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:20.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.976+0000 7f0a17e00640 1 --2- 172.21.15.138:0/2589647912 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559de264d000 0x559de2497600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.976+0000 7f0a17400640 1 --2- 172.21.15.138:0/2589647912 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559de264cc00 0x559de2497b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.976+0000 7f0a17400640 1 -- 172.21.15.138:0/2589647912 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559de264d000 msgr2=0x559de2497600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.976+0000 7f0a17400640 1 --2- 172.21.15.138:0/2589647912 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559de264d000 0x559de2497600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.976+0000 7f0a17400640 1 -- 172.21.15.138:0/2589647912 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559de264cc00 msgr2=0x559de2497b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:20.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.976+0000 7f0a17400640 1 --2- 172.21.15.138:0/2589647912 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559de264cc00 0x559de2497b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:20.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.976+0000 7f0a17400640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559de16e61e0 con 0x559de25f7800 2024-04-26T20:58:20.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.976+0000 7f0a17400640 1 --2- 172.21.15.138:0/2589647912 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559de25f7800 0x559de2497080 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x559de25fbd40 tx=0x559de2607800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.976+0000 7f0a10600640 1 -- 172.21.15.138:0/2589647912 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559de16f6000 con 0x559de25f7800 2024-04-26T20:58:20.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.976+0000 7f0a10600640 1 -- 172.21.15.138:0/2589647912 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x559de170ac40 con 0x559de25f7800 2024-04-26T20:58:20.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.976+0000 7f0a10600640 1 -- 172.21.15.138:0/2589647912 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559de16f64e0 con 0x559de25f7800 2024-04-26T20:58:20.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.976+0000 7f0a1ae2f8c0 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559de16e72c0 con 0x559de25f7800 2024-04-26T20:58:20.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.976+0000 7f0a1ae2f8c0 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559de16e7e00 con 0x559de25f7800 2024-04-26T20:58:20.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.976+0000 7f0a1ae2f8c0 4 datascan.init: resolving metadata pool 7 2024-04-26T20:58:20.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.980+0000 7f0a10600640 1 -- 172.21.15.138:0/2589647912 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x559de263a900 con 0x559de25f7800 2024-04-26T20:58:20.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.980+0000 7f0a10600640 1 --2- 172.21.15.138:0/2589647912 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x559de1ac2000 0x559de2498100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.980+0000 7f0a10600640 1 -- 172.21.15.138:0/2589647912 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6756+0+0 (secure 0 0 0) 0x559de19b4a00 con 0x559de25f7800 2024-04-26T20:58:20.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.980+0000 7f0a1ae2f8c0 4 datascan.init: found metadata pool 'recovery_fs_metadata' 2024-04-26T20:58:20.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.980+0000 7f0a1ae2f8c0 4 datascan.main: resolving metadata pool 7 2024-04-26T20:58:20.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.980+0000 7f0a1ae2f8c0 1 --2- 172.21.15.138:0/2589647912 >> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] conn(0x559de264c800 0x559de2498680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.980+0000 7f0a1ae2f8c0 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] -- osd_op(unknown.0.0:1 7.0 7:00000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de264c400 con 0x559de264c800 2024-04-26T20:58:20.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.980+0000 7f0a17e00640 1 --2- 172.21.15.138:0/2589647912 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x559de1ac2000 0x559de2498100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.980+0000 7f0a17400640 1 --2- 172.21.15.138:0/2589647912 >> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] conn(0x559de264c800 0x559de2498680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.980+0000 7f0a17e00640 1 --2- 172.21.15.138:0/2589647912 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x559de1ac2000 0x559de2498100 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x559de17a4b10 tx=0x559de17a6180 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.980+0000 7f0a17400640 1 --2- 172.21.15.138:0/2589647912 >> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] conn(0x559de264c800 0x559de2498680 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.980+0000 7f0a17400640 1 -- 172.21.15.138:0/2589647912 <== osd.1 v2:172.21.15.138:6816/1427635773 1 ==== osd_op_reply(1 [pgnls start_epoch 51 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x559de17da000 con 0x559de264c800 2024-04-26T20:58:20.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.980+0000 7f0a17400640 1 --2- 172.21.15.138:0/2589647912 >> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] conn(0x559de264c400 0x559de1acc000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.980+0000 7f0a17400640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- osd_op(unknown.0.0:2 7.10 7:08000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1ac2400 con 0x559de264c400 2024-04-26T20:58:20.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.980+0000 7f0a18800640 1 --2- 172.21.15.138:0/2589647912 >> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] conn(0x559de264c400 0x559de1acc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.984+0000 7f0a18800640 1 --2- 172.21.15.138:0/2589647912 >> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] conn(0x559de264c400 0x559de1acc000 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.984+0000 7f0a18800640 1 -- 172.21.15.138:0/2589647912 <== osd.7 v2:172.21.15.143:6824/3295508495 1 ==== osd_op_reply(2 [pgnls start_epoch 51 out=81b] v51'2 uv2 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x559de17da500 con 0x559de264c400 2024-04-26T20:58:20.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.984+0000 7f0a18800640 1 --2- 172.21.15.138:0/2589647912 >> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] conn(0x559de1ac2400 0x559de1acc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.984+0000 7f0a18800640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] -- osd_op(unknown.0.0:3 7.8 7:10000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de25f6800 con 0x559de1ac2400 2024-04-26T20:58:20.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.984+0000 7f0a17e00640 1 --2- 172.21.15.138:0/2589647912 >> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] conn(0x559de1ac2400 0x559de1acc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.984+0000 7f0a17e00640 1 --2- 172.21.15.138:0/2589647912 >> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] conn(0x559de1ac2400 0x559de1acc580 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.984+0000 7f0a17e00640 1 -- 172.21.15.138:0/2589647912 <== osd.5 v2:172.21.15.143:6808/1910222887 1 ==== osd_op_reply(3 [pgnls start_epoch 51 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x559de17da780 con 0x559de1ac2400 2024-04-26T20:58:20.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.984+0000 7f0a17e00640 1 --2- 172.21.15.138:0/2589647912 >> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] conn(0x559de25f6800 0x559de1accb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.984+0000 7f0a17e00640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:4 7.18 7:18000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de24b8c00 con 0x559de25f6800 2024-04-26T20:58:20.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.984+0000 7f0a17400640 1 --2- 172.21.15.138:0/2589647912 >> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] conn(0x559de25f6800 0x559de1accb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.984+0000 7f0a17400640 1 --2- 172.21.15.138:0/2589647912 >> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] conn(0x559de25f6800 0x559de1accb00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.984+0000 7f0a17400640 1 -- 172.21.15.138:0/2589647912 <== osd.4 v2:172.21.15.143:6800/2942056312 1 ==== osd_op_reply(4 [pgnls start_epoch 51 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x559de17da000 con 0x559de25f6800 2024-04-26T20:58:20.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.984+0000 7f0a17400640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:5 7.4 7:20000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de24b8c00 con 0x559de25f6800 2024-04-26T20:58:20.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.984+0000 7f0a17400640 1 -- 172.21.15.138:0/2589647912 <== osd.4 v2:172.21.15.143:6800/2942056312 2 ==== osd_op_reply(5 [pgnls start_epoch 51 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x559de17da000 con 0x559de25f6800 2024-04-26T20:58:20.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.984+0000 7f0a17400640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] -- osd_op(unknown.0.0:6 7.14 7:28000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de24b8c00 con 0x559de1ac2400 2024-04-26T20:58:20.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.988+0000 7f0a17e00640 1 -- 172.21.15.138:0/2589647912 <== osd.5 v2:172.21.15.143:6808/1910222887 2 ==== osd_op_reply(6 [pgnls start_epoch 51 out=77b] v50'1 uv1 ondisk = 1) ==== 144+0+77 (crc 0 0 0) 0x559de17da780 con 0x559de1ac2400 2024-04-26T20:58:20.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.988+0000 7f0a17e00640 1 --2- 172.21.15.138:0/2589647912 >> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] conn(0x559de24b8c00 0x559de1acd080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.988+0000 7f0a17e00640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] -- osd_op(unknown.0.0:7 7.c 7:30000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de24b9000 con 0x559de24b8c00 2024-04-26T20:58:20.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.988+0000 7f0a18800640 1 --2- 172.21.15.138:0/2589647912 >> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] conn(0x559de24b8c00 0x559de1acd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.988+0000 7f0a18800640 1 --2- 172.21.15.138:0/2589647912 >> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] conn(0x559de24b8c00 0x559de1acd080 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.988+0000 7f0a18800640 1 -- 172.21.15.138:0/2589647912 <== osd.2 v2:172.21.15.138:6808/4273721573 1 ==== osd_op_reply(7 [pgnls start_epoch 51 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x559de17da500 con 0x559de24b8c00 2024-04-26T20:58:20.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.988+0000 7f0a18800640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] -- osd_op(unknown.0.0:8 7.1c 7:38000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de24b9000 con 0x559de24b8c00 2024-04-26T20:58:20.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.988+0000 7f0a18800640 1 -- 172.21.15.138:0/2589647912 <== osd.2 v2:172.21.15.138:6808/4273721573 2 ==== osd_op_reply(8 [pgnls start_epoch 51 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x559de17da500 con 0x559de24b8c00 2024-04-26T20:58:20.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.988+0000 7f0a18800640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:9 7.2 7:40000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de24b9000 con 0x559de25f6800 2024-04-26T20:58:20.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.988+0000 7f0a17400640 1 -- 172.21.15.138:0/2589647912 <== osd.4 v2:172.21.15.143:6800/2942056312 3 ==== osd_op_reply(9 [pgnls start_epoch 51 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x559de17da000 con 0x559de25f6800 2024-04-26T20:58:20.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.988+0000 7f0a17400640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] -- osd_op(unknown.0.0:10 7.12 7:48000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de24b9000 con 0x559de264c800 2024-04-26T20:58:20.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.988+0000 7f0a17400640 1 -- 172.21.15.138:0/2589647912 <== osd.1 v2:172.21.15.138:6816/1427635773 2 ==== osd_op_reply(10 [pgnls start_epoch 51 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x559de17da000 con 0x559de264c800 2024-04-26T20:58:20.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.988+0000 7f0a17400640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:11 7.a 7:50000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de24b9000 con 0x559de25f6800 2024-04-26T20:58:20.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.988+0000 7f0a17400640 1 -- 172.21.15.138:0/2589647912 <== osd.4 v2:172.21.15.143:6800/2942056312 4 ==== osd_op_reply(11 [pgnls start_epoch 51 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x559de17da000 con 0x559de25f6800 2024-04-26T20:58:20.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.988+0000 7f0a17400640 1 --2- 172.21.15.138:0/2589647912 >> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] conn(0x559de24b9000 0x559de1acdb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:20.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.988+0000 7f0a17400640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:12 7.1a 7:58000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1ac2800 con 0x559de24b9000 2024-04-26T20:58:20.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.988+0000 7f0a17e00640 1 --2- 172.21.15.138:0/2589647912 >> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] conn(0x559de24b9000 0x559de1acdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:20.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.988+0000 7f0a17e00640 1 --2- 172.21.15.138:0/2589647912 >> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] conn(0x559de24b9000 0x559de1acdb80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:20.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.988+0000 7f0a17e00640 1 -- 172.21.15.138:0/2589647912 <== osd.3 v2:172.21.15.138:6824/3098242154 1 ==== osd_op_reply(12 [pgnls start_epoch 51 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x559de17da780 con 0x559de24b9000 2024-04-26T20:58:20.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.988+0000 7f0a17e00640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] -- osd_op(unknown.0.0:13 7.6 7:60000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1ac2800 con 0x559de1ac2400 2024-04-26T20:58:20.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.988+0000 7f0a17e00640 1 -- 172.21.15.138:0/2589647912 <== osd.5 v2:172.21.15.143:6808/1910222887 3 ==== osd_op_reply(13 [pgnls start_epoch 51 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x559de17da780 con 0x559de1ac2400 2024-04-26T20:58:20.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.988+0000 7f0a17e00640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] -- osd_op(unknown.0.0:14 7.16 7:68000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1ac2800 con 0x559de264c800 2024-04-26T20:58:20.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.992+0000 7f0a17400640 1 -- 172.21.15.138:0/2589647912 <== osd.1 v2:172.21.15.138:6816/1427635773 3 ==== osd_op_reply(14 [pgnls start_epoch 51 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x559de17da000 con 0x559de264c800 2024-04-26T20:58:20.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.992+0000 7f0a17400640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- osd_op(unknown.0.0:15 7.e 7:70000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1ac2800 con 0x559de264c400 2024-04-26T20:58:20.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.992+0000 7f0a18800640 1 -- 172.21.15.138:0/2589647912 <== osd.7 v2:172.21.15.143:6824/3295508495 2 ==== osd_op_reply(15 [pgnls start_epoch 51 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x559de17da500 con 0x559de264c400 2024-04-26T20:58:20.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.992+0000 7f0a18800640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- osd_op(unknown.0.0:16 7.1e 7:78000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1ac2800 con 0x559de264c400 2024-04-26T20:58:20.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.992+0000 7f0a18800640 1 -- 172.21.15.138:0/2589647912 <== osd.7 v2:172.21.15.143:6824/3295508495 3 ==== osd_op_reply(16 [pgnls start_epoch 51 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x559de17da500 con 0x559de264c400 2024-04-26T20:58:20.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.992+0000 7f0a18800640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] -- osd_op(unknown.0.0:17 7.1 7:80000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1ac2800 con 0x559de24b8c00 2024-04-26T20:58:20.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.992+0000 7f0a18800640 1 -- 172.21.15.138:0/2589647912 <== osd.2 v2:172.21.15.138:6808/4273721573 3 ==== osd_op_reply(17 [pgnls start_epoch 51 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x559de17da500 con 0x559de24b8c00 2024-04-26T20:58:20.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.992+0000 7f0a18800640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] -- osd_op(unknown.0.0:18 7.11 7:88000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1ac2800 con 0x559de24b8c00 2024-04-26T20:58:20.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.992+0000 7f0a18800640 1 -- 172.21.15.138:0/2589647912 <== osd.2 v2:172.21.15.138:6808/4273721573 4 ==== osd_op_reply(18 [pgnls start_epoch 51 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x559de17da500 con 0x559de24b8c00 2024-04-26T20:58:20.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.992+0000 7f0a18800640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] -- osd_op(unknown.0.0:19 7.9 7:90000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1ac2800 con 0x559de1ac2400 2024-04-26T20:58:20.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.992+0000 7f0a17e00640 1 -- 172.21.15.138:0/2589647912 <== osd.5 v2:172.21.15.143:6808/1910222887 4 ==== osd_op_reply(19 [pgnls start_epoch 51 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x559de17da780 con 0x559de1ac2400 2024-04-26T20:58:20.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.992+0000 7f0a17e00640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:20 7.19 7:98000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1ac2800 con 0x559de24b9000 2024-04-26T20:58:20.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.992+0000 7f0a17e00640 1 -- 172.21.15.138:0/2589647912 <== osd.3 v2:172.21.15.138:6824/3098242154 2 ==== osd_op_reply(20 [pgnls start_epoch 51 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x559de17da780 con 0x559de24b9000 2024-04-26T20:58:20.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.992+0000 7f0a17e00640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:21 7.5 7:a0000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1ac2800 con 0x559de24b9000 2024-04-26T20:58:20.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.992+0000 7f0a17e00640 1 -- 172.21.15.138:0/2589647912 <== osd.3 v2:172.21.15.138:6824/3098242154 3 ==== osd_op_reply(21 [pgnls start_epoch 51 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x559de17da780 con 0x559de24b9000 2024-04-26T20:58:20.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.992+0000 7f0a17e00640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:22 7.15 7:a8000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1ac2800 con 0x559de24b9000 2024-04-26T20:58:20.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.992+0000 7f0a17e00640 1 -- 172.21.15.138:0/2589647912 <== osd.3 v2:172.21.15.138:6824/3098242154 4 ==== osd_op_reply(22 [pgnls start_epoch 51 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x559de17da780 con 0x559de24b9000 2024-04-26T20:58:20.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.992+0000 7f0a17e00640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] -- osd_op(unknown.0.0:23 7.d 7:b0000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1ac2800 con 0x559de264c800 2024-04-26T20:58:20.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.992+0000 7f0a17400640 1 -- 172.21.15.138:0/2589647912 <== osd.1 v2:172.21.15.138:6816/1427635773 4 ==== osd_op_reply(23 [pgnls start_epoch 51 out=74b] v50'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x559de17da000 con 0x559de264c800 2024-04-26T20:58:21.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.992+0000 7f0a17400640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] -- osd_op(unknown.0.0:24 7.1d 7:b8000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1ac2800 con 0x559de1ac2400 2024-04-26T20:58:21.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.992+0000 7f0a17e00640 1 -- 172.21.15.138:0/2589647912 <== osd.5 v2:172.21.15.143:6808/1910222887 5 ==== osd_op_reply(24 [pgnls start_epoch 51 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x559de17da780 con 0x559de1ac2400 2024-04-26T20:58:21.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.992+0000 7f0a17e00640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] -- osd_op(unknown.0.0:25 7.3 7:c0000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1ac2800 con 0x559de1ac2400 2024-04-26T20:58:21.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.992+0000 7f0a17e00640 1 -- 172.21.15.138:0/2589647912 <== osd.5 v2:172.21.15.143:6808/1910222887 6 ==== osd_op_reply(25 [pgnls start_epoch 51 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x559de17da780 con 0x559de1ac2400 2024-04-26T20:58:21.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.992+0000 7f0a17e00640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- osd_op(unknown.0.0:26 7.13 7:c8000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1ac2800 con 0x559de264c400 2024-04-26T20:58:21.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.992+0000 7f0a18800640 1 -- 172.21.15.138:0/2589647912 <== osd.7 v2:172.21.15.143:6824/3295508495 4 ==== osd_op_reply(26 [pgnls start_epoch 51 out=98b] v50'2 uv2 ondisk = 1) ==== 144+0+98 (crc 0 0 0) 0x559de17da500 con 0x559de264c400 2024-04-26T20:58:21.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.992+0000 7f0a18800640 1 --2- 172.21.15.138:0/2589647912 >> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] conn(0x559de1ac2800 0x559de1ace680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:21.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.992+0000 7f0a18800640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] -- osd_op(unknown.0.0:27 7.b 7:d0000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1ac3000 con 0x559de1ac2800 2024-04-26T20:58:21.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.996+0000 7f0a17400640 1 --2- 172.21.15.138:0/2589647912 >> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] conn(0x559de1ac2800 0x559de1ace680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:21.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.996+0000 7f0a17400640 1 --2- 172.21.15.138:0/2589647912 >> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] conn(0x559de1ac2800 0x559de1ace680 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:21.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.996+0000 7f0a17400640 1 -- 172.21.15.138:0/2589647912 <== osd.6 v2:172.21.15.143:6816/1082239825 1 ==== osd_op_reply(27 [pgnls start_epoch 51 out=76b] v50'1 uv1 ondisk = 1) ==== 144+0+76 (crc 0 0 0) 0x559de17da000 con 0x559de1ac2800 2024-04-26T20:58:21.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.996+0000 7f0a17400640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:28 7.1b 7:d8000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1ac3000 con 0x559de25f6800 2024-04-26T20:58:21.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.996+0000 7f0a17400640 1 -- 172.21.15.138:0/2589647912 <== osd.4 v2:172.21.15.143:6800/2942056312 5 ==== osd_op_reply(28 [pgnls start_epoch 51 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x559de17da000 con 0x559de25f6800 2024-04-26T20:58:21.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.996+0000 7f0a17400640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:29 7.7 7:e0000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1ac3000 con 0x559de24b9000 2024-04-26T20:58:21.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.996+0000 7f0a17e00640 1 -- 172.21.15.138:0/2589647912 <== osd.3 v2:172.21.15.138:6824/3098242154 5 ==== osd_op_reply(29 [pgnls start_epoch 51 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x559de17da780 con 0x559de24b9000 2024-04-26T20:58:21.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.996+0000 7f0a17e00640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] -- osd_op(unknown.0.0:30 7.17 7:e8000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1ac3000 con 0x559de264c800 2024-04-26T20:58:21.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.996+0000 7f0a17400640 1 -- 172.21.15.138:0/2589647912 <== osd.1 v2:172.21.15.138:6816/1427635773 5 ==== osd_op_reply(30 [pgnls start_epoch 51 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x559de17da000 con 0x559de264c800 2024-04-26T20:58:21.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.996+0000 7f0a17400640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- osd_op(unknown.0.0:31 7.f 7:f0000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1ac3000 con 0x559de264c400 2024-04-26T20:58:21.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.996+0000 7f0a18800640 1 -- 172.21.15.138:0/2589647912 <== osd.7 v2:172.21.15.143:6824/3295508495 5 ==== osd_op_reply(31 [pgnls start_epoch 51 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x559de17da500 con 0x559de264c400 2024-04-26T20:58:21.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.996+0000 7f0a18800640 1 --2- 172.21.15.138:0/2589647912 >> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] conn(0x559de1ac3000 0x559de1acec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:21.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.996+0000 7f0a18800640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] -- osd_op(unknown.0.0:32 7.1f 7:f8000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1ac3400 con 0x559de1ac3000 2024-04-26T20:58:21.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.996+0000 7f0a18800640 1 --2- 172.21.15.138:0/2589647912 >> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] conn(0x559de1ac3000 0x559de1acec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:21.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.996+0000 7f0a18800640 1 --2- 172.21.15.138:0/2589647912 >> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] conn(0x559de1ac3000 0x559de1acec00 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:21.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.996+0000 7f0a18800640 1 -- 172.21.15.138:0/2589647912 <== osd.0 v2:172.21.15.138:6800/3534772245 1 ==== osd_op_reply(32 [pgnls start_epoch 51 out=101b] v51'3 uv3 ondisk = 1) ==== 144+0+101 (crc 0 0 0) 0x559de17da500 con 0x559de1ac3000 2024-04-26T20:58:21.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.996+0000 7f0a1ae2f8c0 10 datascan.scan_links: step 1: handling object 10000000000.00000000 2024-04-26T20:58:21.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.996+0000 7f0a1ae2f8c0 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- osd_op(unknown.0.0:33 7.10 7:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x559de264c000 con 0x559de264c400 2024-04-26T20:58:21.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.996+0000 7f0a18800640 1 -- 172.21.15.138:0/2589647912 <== osd.7 v2:172.21.15.143:6824/3295508495 6 ==== osd_op_reply(33 10000000000.00000000 [omap-get-vals out=509b] v0'0 uv2 ondisk = 0) ==== 164+0+509 (crc 0 0 0) 0x559de17da500 con 0x559de264c400 2024-04-26T20:58:21.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:20.996+0000 7f0a1ae2f8c0 20 datascan.scan_links: injected ino detected 2024-04-26T20:58:21.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.000+0000 7f0a1ae2f8c0 10 datascan.scan_links: step 1: handling object 1.00000000.inode 2024-04-26T20:58:21.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.000+0000 7f0a1ae2f8c0 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-04-26T20:58:21.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.000+0000 7f0a1ae2f8c0 10 datascan.scan_links: step 1: handling object mds_snaptable 2024-04-26T20:58:21.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.000+0000 7f0a1ae2f8c0 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-04-26T20:58:21.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.000+0000 7f0a1ae2f8c0 10 datascan.scan_links: step 1: handling object mds0_inotable 2024-04-26T20:58:21.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.000+0000 7f0a1ae2f8c0 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-04-26T20:58:21.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.000+0000 7f0a1ae2f8c0 10 datascan.scan_links: step 1: handling object 100.00000000 2024-04-26T20:58:21.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.000+0000 7f0a1ae2f8c0 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- osd_op(unknown.0.0:34 7.13 7:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x559de1af2000 con 0x559de264c400 2024-04-26T20:58:21.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.000+0000 7f0a18800640 1 -- 172.21.15.138:0/2589647912 <== osd.7 v2:172.21.15.143:6824/3295508495 7 ==== osd_op_reply(34 100.00000000 [omap-get-vals out=5b] v0'0 uv1 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x559de17da500 con 0x559de264c400 2024-04-26T20:58:21.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.000+0000 7f0a1ae2f8c0 10 datascan.scan_links: step 1: handling object mds0_sessionmap 2024-04-26T20:58:21.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.000+0000 7f0a1ae2f8c0 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-04-26T20:58:21.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.000+0000 7f0a1ae2f8c0 10 datascan.scan_links: step 1: handling object 100.00000000.inode 2024-04-26T20:58:21.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.000+0000 7f0a1ae2f8c0 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-04-26T20:58:21.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.000+0000 7f0a1ae2f8c0 10 datascan.scan_links: step 1: handling object 1.00000000 2024-04-26T20:58:21.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.000+0000 7f0a1ae2f8c0 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] -- osd_op(unknown.0.0:35 7.1f 7:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x559de1af2400 con 0x559de1ac3000 2024-04-26T20:58:21.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.000+0000 7f0a18800640 1 -- 172.21.15.138:0/2589647912 <== osd.0 v2:172.21.15.138:6800/3534772245 2 ==== osd_op_reply(35 1.00000000 [omap-get-vals out=508b] v0'0 uv3 ondisk = 0) ==== 154+0+508 (crc 0 0 0) 0x559de17da500 con 0x559de1ac3000 2024-04-26T20:58:21.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.000+0000 7f0a1ae2f8c0 20 datascan.scan_links: injected ino detected 2024-04-26T20:58:21.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.000+0000 7f0a1ae2f8c0 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] -- osd_op(unknown.0.0:36 7.0 7:00000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1af2800 con 0x559de264c800 2024-04-26T20:58:21.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.000+0000 7f0a17400640 1 -- 172.21.15.138:0/2589647912 <== osd.1 v2:172.21.15.138:6816/1427635773 6 ==== osd_op_reply(36 [pgnls start_epoch 51 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x559de17da000 con 0x559de264c800 2024-04-26T20:58:21.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.000+0000 7f0a17400640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- osd_op(unknown.0.0:37 7.10 7:08000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1af2800 con 0x559de264c400 2024-04-26T20:58:21.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.000+0000 7f0a18800640 1 -- 172.21.15.138:0/2589647912 <== osd.7 v2:172.21.15.143:6824/3295508495 8 ==== osd_op_reply(37 [pgnls start_epoch 51 out=81b] v51'2 uv2 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x559de17da500 con 0x559de264c400 2024-04-26T20:58:21.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.000+0000 7f0a18800640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] -- osd_op(unknown.0.0:38 7.8 7:10000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1af2800 con 0x559de1ac2400 2024-04-26T20:58:21.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.000+0000 7f0a17e00640 1 -- 172.21.15.138:0/2589647912 <== osd.5 v2:172.21.15.143:6808/1910222887 7 ==== osd_op_reply(38 [pgnls start_epoch 51 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x559de17da780 con 0x559de1ac2400 2024-04-26T20:58:21.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.000+0000 7f0a17e00640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:39 7.18 7:18000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1af2800 con 0x559de25f6800 2024-04-26T20:58:21.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.000+0000 7f0a17400640 1 -- 172.21.15.138:0/2589647912 <== osd.4 v2:172.21.15.143:6800/2942056312 6 ==== osd_op_reply(39 [pgnls start_epoch 51 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x559de17da000 con 0x559de25f6800 2024-04-26T20:58:21.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.000+0000 7f0a17400640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:40 7.4 7:20000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1af2800 con 0x559de25f6800 2024-04-26T20:58:21.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.000+0000 7f0a17400640 1 -- 172.21.15.138:0/2589647912 <== osd.4 v2:172.21.15.143:6800/2942056312 7 ==== osd_op_reply(40 [pgnls start_epoch 51 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x559de17da000 con 0x559de25f6800 2024-04-26T20:58:21.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.000+0000 7f0a17400640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] -- osd_op(unknown.0.0:41 7.14 7:28000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1af2800 con 0x559de1ac2400 2024-04-26T20:58:21.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.000+0000 7f0a17e00640 1 -- 172.21.15.138:0/2589647912 <== osd.5 v2:172.21.15.143:6808/1910222887 8 ==== osd_op_reply(41 [pgnls start_epoch 51 out=77b] v50'1 uv1 ondisk = 1) ==== 144+0+77 (crc 0 0 0) 0x559de17da780 con 0x559de1ac2400 2024-04-26T20:58:21.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.000+0000 7f0a17e00640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] -- osd_op(unknown.0.0:42 7.c 7:30000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1af2800 con 0x559de24b8c00 2024-04-26T20:58:21.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.000+0000 7f0a18800640 1 -- 172.21.15.138:0/2589647912 <== osd.2 v2:172.21.15.138:6808/4273721573 5 ==== osd_op_reply(42 [pgnls start_epoch 51 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x559de17da500 con 0x559de24b8c00 2024-04-26T20:58:21.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.000+0000 7f0a18800640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] -- osd_op(unknown.0.0:43 7.1c 7:38000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1af2800 con 0x559de24b8c00 2024-04-26T20:58:21.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.000+0000 7f0a18800640 1 -- 172.21.15.138:0/2589647912 <== osd.2 v2:172.21.15.138:6808/4273721573 6 ==== osd_op_reply(43 [pgnls start_epoch 51 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x559de17da500 con 0x559de24b8c00 2024-04-26T20:58:21.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.000+0000 7f0a18800640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:44 7.2 7:40000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1af2800 con 0x559de25f6800 2024-04-26T20:58:21.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.000+0000 7f0a17400640 1 -- 172.21.15.138:0/2589647912 <== osd.4 v2:172.21.15.143:6800/2942056312 8 ==== osd_op_reply(44 [pgnls start_epoch 51 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x559de17da000 con 0x559de25f6800 2024-04-26T20:58:21.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.000+0000 7f0a17400640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] -- osd_op(unknown.0.0:45 7.12 7:48000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1af2800 con 0x559de264c800 2024-04-26T20:58:21.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.004+0000 7f0a17400640 1 -- 172.21.15.138:0/2589647912 <== osd.1 v2:172.21.15.138:6816/1427635773 7 ==== osd_op_reply(45 [pgnls start_epoch 51 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x559de17da000 con 0x559de264c800 2024-04-26T20:58:21.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.004+0000 7f0a17400640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:46 7.a 7:50000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1af2800 con 0x559de25f6800 2024-04-26T20:58:21.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.004+0000 7f0a17400640 1 -- 172.21.15.138:0/2589647912 <== osd.4 v2:172.21.15.143:6800/2942056312 9 ==== osd_op_reply(46 [pgnls start_epoch 51 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x559de17da000 con 0x559de25f6800 2024-04-26T20:58:21.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.004+0000 7f0a17400640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:47 7.1a 7:58000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1af2800 con 0x559de24b9000 2024-04-26T20:58:21.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.004+0000 7f0a17e00640 1 -- 172.21.15.138:0/2589647912 <== osd.3 v2:172.21.15.138:6824/3098242154 6 ==== osd_op_reply(47 [pgnls start_epoch 51 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x559de17da780 con 0x559de24b9000 2024-04-26T20:58:21.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.004+0000 7f0a17e00640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] -- osd_op(unknown.0.0:48 7.6 7:60000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1af2800 con 0x559de1ac2400 2024-04-26T20:58:21.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.004+0000 7f0a17e00640 1 -- 172.21.15.138:0/2589647912 <== osd.5 v2:172.21.15.143:6808/1910222887 9 ==== osd_op_reply(48 [pgnls start_epoch 51 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x559de17da780 con 0x559de1ac2400 2024-04-26T20:58:21.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.004+0000 7f0a17e00640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] -- osd_op(unknown.0.0:49 7.16 7:68000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1af2800 con 0x559de264c800 2024-04-26T20:58:21.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.004+0000 7f0a17400640 1 -- 172.21.15.138:0/2589647912 <== osd.1 v2:172.21.15.138:6816/1427635773 8 ==== osd_op_reply(49 [pgnls start_epoch 51 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x559de17da000 con 0x559de264c800 2024-04-26T20:58:21.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.004+0000 7f0a17400640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- osd_op(unknown.0.0:50 7.e 7:70000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1af2800 con 0x559de264c400 2024-04-26T20:58:21.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.004+0000 7f0a18800640 1 -- 172.21.15.138:0/2589647912 <== osd.7 v2:172.21.15.143:6824/3295508495 9 ==== osd_op_reply(50 [pgnls start_epoch 51 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x559de17da500 con 0x559de264c400 2024-04-26T20:58:21.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.004+0000 7f0a18800640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- osd_op(unknown.0.0:51 7.1e 7:78000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1af2800 con 0x559de264c400 2024-04-26T20:58:21.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.004+0000 7f0a18800640 1 -- 172.21.15.138:0/2589647912 <== osd.7 v2:172.21.15.143:6824/3295508495 10 ==== osd_op_reply(51 [pgnls start_epoch 51 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x559de17da500 con 0x559de264c400 2024-04-26T20:58:21.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.004+0000 7f0a18800640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] -- osd_op(unknown.0.0:52 7.1 7:80000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1af2800 con 0x559de24b8c00 2024-04-26T20:58:21.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.004+0000 7f0a18800640 1 -- 172.21.15.138:0/2589647912 <== osd.2 v2:172.21.15.138:6808/4273721573 7 ==== osd_op_reply(52 [pgnls start_epoch 51 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x559de17da500 con 0x559de24b8c00 2024-04-26T20:58:21.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.004+0000 7f0a18800640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] -- osd_op(unknown.0.0:53 7.11 7:88000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1af2800 con 0x559de24b8c00 2024-04-26T20:58:21.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.004+0000 7f0a18800640 1 -- 172.21.15.138:0/2589647912 <== osd.2 v2:172.21.15.138:6808/4273721573 8 ==== osd_op_reply(53 [pgnls start_epoch 51 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x559de17da500 con 0x559de24b8c00 2024-04-26T20:58:21.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.004+0000 7f0a18800640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] -- osd_op(unknown.0.0:54 7.9 7:90000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1af2800 con 0x559de1ac2400 2024-04-26T20:58:21.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.004+0000 7f0a17e00640 1 -- 172.21.15.138:0/2589647912 <== osd.5 v2:172.21.15.143:6808/1910222887 10 ==== osd_op_reply(54 [pgnls start_epoch 51 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x559de17da780 con 0x559de1ac2400 2024-04-26T20:58:21.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.004+0000 7f0a17e00640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:55 7.19 7:98000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1af2800 con 0x559de24b9000 2024-04-26T20:58:21.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.004+0000 7f0a17e00640 1 -- 172.21.15.138:0/2589647912 <== osd.3 v2:172.21.15.138:6824/3098242154 7 ==== osd_op_reply(55 [pgnls start_epoch 51 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x559de17da780 con 0x559de24b9000 2024-04-26T20:58:21.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.004+0000 7f0a17e00640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:56 7.5 7:a0000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1af2800 con 0x559de24b9000 2024-04-26T20:58:21.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.004+0000 7f0a17e00640 1 -- 172.21.15.138:0/2589647912 <== osd.3 v2:172.21.15.138:6824/3098242154 8 ==== osd_op_reply(56 [pgnls start_epoch 51 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x559de17da780 con 0x559de24b9000 2024-04-26T20:58:21.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.004+0000 7f0a17e00640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:57 7.15 7:a8000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1af2800 con 0x559de24b9000 2024-04-26T20:58:21.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.004+0000 7f0a17e00640 1 -- 172.21.15.138:0/2589647912 <== osd.3 v2:172.21.15.138:6824/3098242154 9 ==== osd_op_reply(57 [pgnls start_epoch 51 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x559de17da780 con 0x559de24b9000 2024-04-26T20:58:21.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.004+0000 7f0a17e00640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] -- osd_op(unknown.0.0:58 7.d 7:b0000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1af2800 con 0x559de264c800 2024-04-26T20:58:21.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.004+0000 7f0a17400640 1 -- 172.21.15.138:0/2589647912 <== osd.1 v2:172.21.15.138:6816/1427635773 9 ==== osd_op_reply(58 [pgnls start_epoch 51 out=74b] v50'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x559de17da000 con 0x559de264c800 2024-04-26T20:58:21.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.004+0000 7f0a17400640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] -- osd_op(unknown.0.0:59 7.1d 7:b8000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1af2800 con 0x559de1ac2400 2024-04-26T20:58:21.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.008+0000 7f0a17e00640 1 -- 172.21.15.138:0/2589647912 <== osd.5 v2:172.21.15.143:6808/1910222887 11 ==== osd_op_reply(59 [pgnls start_epoch 51 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x559de17da780 con 0x559de1ac2400 2024-04-26T20:58:21.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.008+0000 7f0a17e00640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] -- osd_op(unknown.0.0:60 7.3 7:c0000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1af2800 con 0x559de1ac2400 2024-04-26T20:58:21.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.008+0000 7f0a17e00640 1 -- 172.21.15.138:0/2589647912 <== osd.5 v2:172.21.15.143:6808/1910222887 12 ==== osd_op_reply(60 [pgnls start_epoch 51 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x559de17da780 con 0x559de1ac2400 2024-04-26T20:58:21.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.008+0000 7f0a17e00640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- osd_op(unknown.0.0:61 7.13 7:c8000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1af2800 con 0x559de264c400 2024-04-26T20:58:21.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.008+0000 7f0a18800640 1 -- 172.21.15.138:0/2589647912 <== osd.7 v2:172.21.15.143:6824/3295508495 11 ==== osd_op_reply(61 [pgnls start_epoch 51 out=98b] v50'2 uv2 ondisk = 1) ==== 144+0+98 (crc 0 0 0) 0x559de17da500 con 0x559de264c400 2024-04-26T20:58:21.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.008+0000 7f0a18800640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] -- osd_op(unknown.0.0:62 7.b 7:d0000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1af2800 con 0x559de1ac2800 2024-04-26T20:58:21.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.008+0000 7f0a17400640 1 -- 172.21.15.138:0/2589647912 <== osd.6 v2:172.21.15.143:6816/1082239825 2 ==== osd_op_reply(62 [pgnls start_epoch 51 out=76b] v50'1 uv1 ondisk = 1) ==== 144+0+76 (crc 0 0 0) 0x559de17da000 con 0x559de1ac2800 2024-04-26T20:58:21.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.008+0000 7f0a17400640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:63 7.1b 7:d8000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1af2800 con 0x559de25f6800 2024-04-26T20:58:21.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.008+0000 7f0a17400640 1 -- 172.21.15.138:0/2589647912 <== osd.4 v2:172.21.15.143:6800/2942056312 10 ==== osd_op_reply(63 [pgnls start_epoch 51 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x559de17da000 con 0x559de25f6800 2024-04-26T20:58:21.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.008+0000 7f0a17400640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:64 7.7 7:e0000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1af2800 con 0x559de24b9000 2024-04-26T20:58:21.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.008+0000 7f0a17e00640 1 -- 172.21.15.138:0/2589647912 <== osd.3 v2:172.21.15.138:6824/3098242154 10 ==== osd_op_reply(64 [pgnls start_epoch 51 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x559de17da780 con 0x559de24b9000 2024-04-26T20:58:21.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.008+0000 7f0a17e00640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] -- osd_op(unknown.0.0:65 7.17 7:e8000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1af2800 con 0x559de264c800 2024-04-26T20:58:21.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.008+0000 7f0a17400640 1 -- 172.21.15.138:0/2589647912 <== osd.1 v2:172.21.15.138:6816/1427635773 10 ==== osd_op_reply(65 [pgnls start_epoch 51 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x559de17da000 con 0x559de264c800 2024-04-26T20:58:21.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.008+0000 7f0a17400640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- osd_op(unknown.0.0:66 7.f 7:f0000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1af2800 con 0x559de264c400 2024-04-26T20:58:21.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.008+0000 7f0a18800640 1 -- 172.21.15.138:0/2589647912 <== osd.7 v2:172.21.15.143:6824/3295508495 12 ==== osd_op_reply(66 [pgnls start_epoch 51 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x559de17da500 con 0x559de264c400 2024-04-26T20:58:21.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.008+0000 7f0a18800640 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] -- osd_op(unknown.0.0:67 7.1f 7:f8000000::::head [pgnls start_epoch 51 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e51) -- 0x559de1af2800 con 0x559de1ac3000 2024-04-26T20:58:21.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.008+0000 7f0a18800640 1 -- 172.21.15.138:0/2589647912 <== osd.0 v2:172.21.15.138:6800/3534772245 3 ==== osd_op_reply(67 [pgnls start_epoch 51 out=101b] v51'3 uv3 ondisk = 1) ==== 144+0+101 (crc 0 0 0) 0x559de17da500 con 0x559de1ac3000 2024-04-26T20:58:21.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.008+0000 7f0a1ae2f8c0 10 datascan.scan_links: step 2: handling object 10000000000.00000000 2024-04-26T20:58:21.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.008+0000 7f0a1ae2f8c0 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- osd_op(unknown.0.0:68 7.10 7:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x559de1af2c00 con 0x559de264c400 2024-04-26T20:58:21.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.008+0000 7f0a18800640 1 -- 172.21.15.138:0/2589647912 <== osd.7 v2:172.21.15.143:6824/3295508495 13 ==== osd_op_reply(68 10000000000.00000000 [omap-get-vals out=509b] v0'0 uv2 ondisk = 0) ==== 164+0+509 (crc 0 0 0) 0x559de17da500 con 0x559de264c400 2024-04-26T20:58:21.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.008+0000 7f0a1ae2f8c0 20 datascan.scan_links: injected ino detected 2024-04-26T20:58:21.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.008+0000 7f0a1ae2f8c0 20 datascan.scan_links: adding 0x10000000001 for future processing to fix dnfirst 2024-04-26T20:58:21.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.008+0000 7f0a1ae2f8c0 10 datascan.scan_links: step 2: handling object 1.00000000.inode 2024-04-26T20:58:21.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.008+0000 7f0a1ae2f8c0 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-04-26T20:58:21.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.008+0000 7f0a1ae2f8c0 10 datascan.scan_links: step 2: handling object mds_snaptable 2024-04-26T20:58:21.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.008+0000 7f0a1ae2f8c0 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-04-26T20:58:21.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.008+0000 7f0a1ae2f8c0 10 datascan.scan_links: step 2: handling object mds0_inotable 2024-04-26T20:58:21.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.008+0000 7f0a1ae2f8c0 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-04-26T20:58:21.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.008+0000 7f0a1ae2f8c0 10 datascan.scan_links: step 2: handling object 100.00000000 2024-04-26T20:58:21.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.008+0000 7f0a1ae2f8c0 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- osd_op(unknown.0.0:69 7.13 7:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x559de1af3000 con 0x559de264c400 2024-04-26T20:58:21.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.008+0000 7f0a18800640 1 -- 172.21.15.138:0/2589647912 <== osd.7 v2:172.21.15.143:6824/3295508495 14 ==== osd_op_reply(69 100.00000000 [omap-get-vals out=5b] v0'0 uv1 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x559de17da500 con 0x559de264c400 2024-04-26T20:58:21.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.008+0000 7f0a1ae2f8c0 10 datascan.scan_links: step 2: handling object mds0_sessionmap 2024-04-26T20:58:21.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.008+0000 7f0a1ae2f8c0 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-04-26T20:58:21.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.008+0000 7f0a1ae2f8c0 10 datascan.scan_links: step 2: handling object 100.00000000.inode 2024-04-26T20:58:21.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.008+0000 7f0a1ae2f8c0 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-04-26T20:58:21.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.008+0000 7f0a1ae2f8c0 10 datascan.scan_links: step 2: handling object 1.00000000 2024-04-26T20:58:21.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.008+0000 7f0a1ae2f8c0 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] -- osd_op(unknown.0.0:70 7.1f 7:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x559de1af3400 con 0x559de1ac3000 2024-04-26T20:58:21.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.008+0000 7f0a18800640 1 -- 172.21.15.138:0/2589647912 <== osd.0 v2:172.21.15.138:6800/3534772245 4 ==== osd_op_reply(70 1.00000000 [omap-get-vals out=508b] v0'0 uv3 ondisk = 0) ==== 154+0+508 (crc 0 0 0) 0x559de17da500 con 0x559de1ac3000 2024-04-26T20:58:21.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.008+0000 7f0a1ae2f8c0 20 datascan.scan_links: injected ino detected 2024-04-26T20:58:21.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.008+0000 7f0a1ae2f8c0 20 datascan.scan_links: adding 0x10000000000 for future processing to fix dnfirst 2024-04-26T20:58:21.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.008+0000 7f0a1ae2f8c0 10 datascan.scan_links: processing 0 dup_primaries, 0 remote_links 2024-04-26T20:58:21.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.008+0000 7f0a1ae2f8c0 10 datascan.scan_links: removing dup dentries from 0 objects 2024-04-26T20:58:21.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.008+0000 7f0a1ae2f8c0 10 datascan.scan_links: processing 0 bad_nlink_inos 2024-04-26T20:58:21.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.008+0000 7f0a1ae2f8c0 10 datascan.scan_links: processing 2 injected_inos 2024-04-26T20:58:21.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.008+0000 7f0a1ae2f8c0 10 datascan.scan_links: handling injected_ino 0x10000000000 2024-04-26T20:58:21.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.008+0000 7f0a1ae2f8c0 20 datascan.scan_links: fixing linkage (dnfirst) of 0x1:subdir 2024-04-26T20:58:21.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.008+0000 7f0a1ae2f8c0 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] -- osd_op(unknown.0.0:71 7.1f 7:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x559de1af3800 con 0x559de1ac3000 2024-04-26T20:58:21.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.008+0000 7f0a18800640 1 -- 172.21.15.138:0/2589647912 <== osd.0 v2:172.21.15.138:6800/3534772245 5 ==== osd_op_reply(71 1.00000000 [omap-get-vals-by-keys out=507b] v0'0 uv3 ondisk = 0) ==== 154+0+507 (crc 0 0 0) 0x559de17da500 con 0x559de1ac3000 2024-04-26T20:58:21.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.008+0000 7f0a1ae2f8c0 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2024-04-26T20:58:21.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.008+0000 7f0a1ae2f8c0 20 datascan.scan_links: first is now 2 2024-04-26T20:58:21.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.012+0000 7f0a1ae2f8c0 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] -- osd_op(unknown.0.0:72 7.1f 7:ff5b34d6:::1.00000000:head [omap-set-vals in=507b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x559de1af3c00 con 0x559de1ac3000 2024-04-26T20:58:21.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.012+0000 7f0a18800640 1 -- 172.21.15.138:0/2589647912 <== osd.0 v2:172.21.15.138:6800/3534772245 6 ==== osd_op_reply(72 1.00000000 [omap-set-vals] v51'4 uv4 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x559de17da500 con 0x559de1ac3000 2024-04-26T20:58:21.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.012+0000 7f0a1ae2f8c0 20 datascan.inject_linkage: Injected dentry 0x0x1/subdir pointing to 0x0x10000000000 2024-04-26T20:58:21.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.012+0000 7f0a1ae2f8c0 10 datascan.scan_links: handling injected_ino 0x10000000001 2024-04-26T20:58:21.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.012+0000 7f0a1ae2f8c0 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:sixmegs 2024-04-26T20:58:21.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.012+0000 7f0a1ae2f8c0 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- osd_op(unknown.0.0:73 7.10 7:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x559de1af2000 con 0x559de264c400 2024-04-26T20:58:21.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.012+0000 7f0a18800640 1 -- 172.21.15.138:0/2589647912 <== osd.7 v2:172.21.15.143:6824/3295508495 15 ==== osd_op_reply(73 10000000000.00000000 [omap-get-vals-by-keys out=508b] v0'0 uv2 ondisk = 0) ==== 164+0+508 (crc 0 0 0) 0x559de17da500 con 0x559de264c400 2024-04-26T20:58:21.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.012+0000 7f0a1ae2f8c0 20 datascan.read_dentry: oid=10000000000.00000000 dname=sixmegs frag=*, r=0 2024-04-26T20:58:21.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.012+0000 7f0a1ae2f8c0 20 datascan.scan_links: first is now 2 2024-04-26T20:58:21.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.012+0000 7f0a1ae2f8c0 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- osd_op(unknown.0.0:74 7.10 7:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=508b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x559de1af2400 con 0x559de264c400 2024-04-26T20:58:21.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.012+0000 7f0a18800640 1 -- 172.21.15.138:0/2589647912 <== osd.7 v2:172.21.15.143:6824/3295508495 16 ==== osd_op_reply(74 10000000000.00000000 [omap-set-vals] v51'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x559de17da500 con 0x559de264c400 2024-04-26T20:58:21.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.012+0000 7f0a1ae2f8c0 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/sixmegs pointing to 0x0x10000000001 2024-04-26T20:58:21.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.012+0000 7f0a1ae2f8c0 10 datascan.scan_links: updating inotable 2024-04-26T20:58:21.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.012+0000 7f0a1ae2f8c0 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- osd_op(unknown.0.0:75 7.13 7:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x559de264c000 con 0x559de264c400 2024-04-26T20:58:21.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.012+0000 7f0a18800640 1 -- 172.21.15.138:0/2589647912 <== osd.7 v2:172.21.15.143:6824/3295508495 17 ==== osd_op_reply(75 mds0_inotable [read 0~34 out=34b] v0'0 uv2 ondisk = 0) ==== 157+0+34 (crc 0 0 0) 0x559de17da280 con 0x559de264c400 2024-04-26T20:58:21.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.012+0000 7f0a1ae2f8c0 10 mds.0.inotable: skip_inos was [0x10000000000~0x10000000000] 2024-04-26T20:58:21.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.012+0000 7f0a1ae2f8c0 10 mds.0.inotable: skip_inos now [0x10000000002~0xfffffffffe] 2024-04-26T20:58:21.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.012+0000 7f0a1ae2f8c0 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- osd_op(unknown.0.0:76 7.13 7:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x559de1ac3c00 con 0x559de264c400 2024-04-26T20:58:21.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.016+0000 7f0a18800640 1 -- 172.21.15.138:0/2589647912 <== osd.7 v2:172.21.15.143:6824/3295508495 18 ==== osd_op_reply(76 mds0_inotable [writefull 0~34] v51'3 uv3 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x559de17da280 con 0x559de264c400 2024-04-26T20:58:21.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.016+0000 7f0a1ae2f8c0 10 datascan.scan_links: updating snaptable 2024-04-26T20:58:21.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.016+0000 7f0a1ae2f8c0 1 -- 172.21.15.138:0/2589647912 --> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] -- osd_op(unknown.0.0:77 7.d 7:b50e409b:::mds_snaptable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x559de1ac3800 con 0x559de264c800 2024-04-26T20:58:21.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.016+0000 7f0a17400640 1 -- 172.21.15.138:0/2589647912 <== osd.1 v2:172.21.15.138:6816/1427635773 11 ==== osd_op_reply(77 mds_snaptable [read 0~70 out=70b] v0'0 uv1 ondisk = 0) ==== 157+0+70 (crc 0 0 0) 0x559de17da000 con 0x559de264c800 2024-04-26T20:58:21.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.016+0000 7f0a1ae2f8c0 1 -- 172.21.15.138:0/2589647912 >> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] conn(0x559de1ac3000 msgr2=0x559de1acec00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:21.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.016+0000 7f0a1ae2f8c0 1 --2- 172.21.15.138:0/2589647912 >> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] conn(0x559de1ac3000 0x559de1acec00 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.016+0000 7f0a1ae2f8c0 1 -- 172.21.15.138:0/2589647912 >> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] conn(0x559de264c800 msgr2=0x559de2498680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:21.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.016+0000 7f0a1ae2f8c0 1 --2- 172.21.15.138:0/2589647912 >> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] conn(0x559de264c800 0x559de2498680 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.016+0000 7f0a1ae2f8c0 1 -- 172.21.15.138:0/2589647912 >> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] conn(0x559de24b8c00 msgr2=0x559de1acd080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:21.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.016+0000 7f0a1ae2f8c0 1 --2- 172.21.15.138:0/2589647912 >> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] conn(0x559de24b8c00 0x559de1acd080 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.016+0000 7f0a1ae2f8c0 1 -- 172.21.15.138:0/2589647912 >> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] conn(0x559de24b9000 msgr2=0x559de1acdb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:21.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.016+0000 7f0a1ae2f8c0 1 --2- 172.21.15.138:0/2589647912 >> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] conn(0x559de24b9000 0x559de1acdb80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.016+0000 7f0a1ae2f8c0 1 -- 172.21.15.138:0/2589647912 >> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] conn(0x559de25f6800 msgr2=0x559de1accb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:21.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.016+0000 7f0a17e00640 1 -- 172.21.15.138:0/2589647912 reap_dead start 2024-04-26T20:58:21.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.016+0000 7f0a1ae2f8c0 1 --2- 172.21.15.138:0/2589647912 >> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] conn(0x559de25f6800 0x559de1accb00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.016+0000 7f0a17e00640 1 -- 172.21.15.138:0/2589647912 reap_dead start 2024-04-26T20:58:21.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.016+0000 7f0a1ae2f8c0 1 -- 172.21.15.138:0/2589647912 >> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] conn(0x559de1ac2400 msgr2=0x559de1acc580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:21.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.016+0000 7f0a1ae2f8c0 1 --2- 172.21.15.138:0/2589647912 >> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] conn(0x559de1ac2400 0x559de1acc580 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.016+0000 7f0a1ae2f8c0 1 -- 172.21.15.138:0/2589647912 >> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] conn(0x559de1ac2800 msgr2=0x559de1ace680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:21.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.016+0000 7f0a1ae2f8c0 1 --2- 172.21.15.138:0/2589647912 >> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] conn(0x559de1ac2800 0x559de1ace680 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.016+0000 7f0a1ae2f8c0 1 -- 172.21.15.138:0/2589647912 >> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] conn(0x559de264c400 msgr2=0x559de1acc000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:21.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.016+0000 7f0a1ae2f8c0 1 --2- 172.21.15.138:0/2589647912 >> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] conn(0x559de264c400 0x559de1acc000 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.016+0000 7f0a1ae2f8c0 1 -- 172.21.15.138:0/2589647912 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x559de1ac2000 msgr2=0x559de2498100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:21.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.016+0000 7f0a1ae2f8c0 1 --2- 172.21.15.138:0/2589647912 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x559de1ac2000 0x559de2498100 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x559de17a4b10 tx=0x559de17a6180 comp rx=0 tx=0).stop 2024-04-26T20:58:21.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.016+0000 7f0a1ae2f8c0 1 -- 172.21.15.138:0/2589647912 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559de25f7800 msgr2=0x559de2497080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:21.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.016+0000 7f0a1ae2f8c0 1 --2- 172.21.15.138:0/2589647912 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559de25f7800 0x559de2497080 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x559de25fbd40 tx=0x559de2607800 comp rx=0 tx=0).stop 2024-04-26T20:58:21.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.016+0000 7f0a17e00640 1 -- 172.21.15.138:0/2589647912 reap_dead start 2024-04-26T20:58:21.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.016+0000 7f0a1ae2f8c0 1 -- 172.21.15.138:0/2589647912 shutdown_connections 2024-04-26T20:58:21.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.016+0000 7f0a1ae2f8c0 1 --2- 172.21.15.138:0/2589647912 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559de25f7800 0x559de2497080 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.016+0000 7f0a1ae2f8c0 1 -- 172.21.15.138:0/2589647912 >> 172.21.15.138:0/2589647912 conn(0x559de25f7c00 msgr2=0x559de16ee000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:21.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.016+0000 7f0a1ae2f8c0 1 -- 172.21.15.138:0/2589647912 shutdown_connections 2024-04-26T20:58:21.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.016+0000 7f0a1ae2f8c0 1 -- 172.21.15.138:0/2589647912 wait complete. 2024-04-26T20:58:21.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.016+0000 7f0a1ae2f8c0 1 -- 172.21.15.138:0/1880863784 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559de16c1800 msgr2=0x559de2496b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:21.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.016+0000 7f0a1ae2f8c0 1 --2- 172.21.15.138:0/1880863784 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559de16c1800 0x559de2496b00 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x559de2521770 tx=0x559de17a6fc0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.016+0000 7f0a1ae2f8c0 1 -- 172.21.15.138:0/1880863784 shutdown_connections 2024-04-26T20:58:21.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.016+0000 7f0a1ae2f8c0 1 --2- 172.21.15.138:0/1880863784 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559de16c1800 0x559de2496b00 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.016+0000 7f0a1ae2f8c0 1 --2- 172.21.15.138:0/1880863784 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559de16c1400 0x559de2496580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.016+0000 7f0a1ae2f8c0 1 --2- 172.21.15.138:0/1880863784 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559de16c1000 0x559de2496000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.016+0000 7f0a1ae2f8c0 1 -- 172.21.15.138:0/1880863784 >> 172.21.15.138:0/1880863784 conn(0x559de16c0c00 msgr2=0x559de16ed800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:21.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.016+0000 7f0a1ae2f8c0 1 -- 172.21.15.138:0/1880863784 shutdown_connections 2024-04-26T20:58:21.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.016+0000 7f0a1ae2f8c0 1 -- 172.21.15.138:0/1880863784 wait complete. 2024-04-26T20:58:21.024 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_links', '--filesystem', 'recovery_fs'] in time 0:00:00.139752, result: 2024-04-26T20:58:21.025 DEBUG:teuthology.orchestra.run.smithi138:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank recovery_fs:0 event recover_dentries list --alternate-pool recovery_fs_metadata 2024-04-26T20:58:21.114 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.112+0000 7f8655874400 1 -- start start 2024-04-26T20:58:21.114 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.112+0000 7f8655874400 1 Processor -- start 2024-04-26T20:58:21.115 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.112+0000 7f8655874400 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x562f41831800 0x562f425fa000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:21.115 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.112+0000 7f8655874400 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562f41831400 0x562f425fa580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:21.115 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.112+0000 7f8655874400 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562f41831000 0x562f425fab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:21.115 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.112+0000 7f8655874400 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x562f42616780 con 0x562f41831400 2024-04-26T20:58:21.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.112+0000 7f8655874400 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x562f42616600 con 0x562f41831000 2024-04-26T20:58:21.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.112+0000 7f8655874400 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x562f42616480 con 0x562f41831800 2024-04-26T20:58:21.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.116+0000 7f8653a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x562f41831800 0x562f425fa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:21.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.116+0000 7f8653000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562f41831400 0x562f425fa580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:21.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.116+0000 7f8653a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x562f41831800 0x562f425fa000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.138:50428/0 (socket says 172.21.15.138:50428) 2024-04-26T20:58:21.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.116+0000 7f8653a00640 1 -- 172.21.15.138:0/4060027221 learned_addr learned my addr 172.21.15.138:0/4060027221 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:21.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.116+0000 7f8654400640 1 --2- 172.21.15.138:0/4060027221 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562f41831000 0x562f425fab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:21.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.116+0000 7f8653a00640 1 -- 172.21.15.138:0/4060027221 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562f41831000 msgr2=0x562f425fab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:21.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.116+0000 7f8653a00640 1 --2- 172.21.15.138:0/4060027221 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562f41831000 0x562f425fab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.116+0000 7f8653a00640 1 -- 172.21.15.138:0/4060027221 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562f41831400 msgr2=0x562f425fa580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:21.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.116+0000 7f8653a00640 1 --2- 172.21.15.138:0/4060027221 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562f41831400 0x562f425fa580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.116+0000 7f8653a00640 1 -- 172.21.15.138:0/4060027221 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f4259cb40 con 0x562f41831800 2024-04-26T20:58:21.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.116+0000 7f8654400640 1 --2- 172.21.15.138:0/4060027221 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562f41831000 0x562f425fab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:58:21.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.116+0000 7f8653000640 1 --2- 172.21.15.138:0/4060027221 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562f41831400 0x562f425fa580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:58:21.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.116+0000 7f8653a00640 1 --2- 172.21.15.138:0/4060027221 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x562f41831800 0x562f425fa000 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x562f42690ff0 tx=0x562f4190eae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccc56de4b8511415 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:21.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.116+0000 7f8650800640 1 -- 172.21.15.138:0/4060027221 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562f418669c0 con 0x562f41831800 2024-04-26T20:58:21.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.116+0000 7f8650800640 1 -- 172.21.15.138:0/4060027221 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x562f4187ae00 con 0x562f41831800 2024-04-26T20:58:21.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.116+0000 7f8650800640 1 -- 172.21.15.138:0/4060027221 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562f418664e0 con 0x562f41831800 2024-04-26T20:58:21.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.116+0000 7f8655874400 1 -- 172.21.15.138:0/4060027221 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) -- 0x562f4259cd20 con 0x562f41831800 2024-04-26T20:58:21.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.116+0000 7f8655874400 1 -- 172.21.15.138:0/4060027221 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({fsmap=0}) -- 0x562f4259cf00 con 0x562f41831800 2024-04-26T20:58:21.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.116+0000 7f8655874400 4 waiting for MDS map... 2024-04-26T20:58:21.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.116+0000 7f8650800640 1 -- 172.21.15.138:0/4060027221 <== mon.2 v2:172.21.15.143:3301/0 4 ==== osd_map(51..51 src has 1..51) ==== 6756+0+0 (secure 0 0 0) 0x562f42754200 con 0x562f41831800 2024-04-26T20:58:21.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.116+0000 7f8650800640 1 -- 172.21.15.138:0/4060027221 <== mon.2 v2:172.21.15.143:3301/0 5 ==== fsmap(e 23) ==== 4135+0+0 (secure 0 0 0) 0x562f41887180 con 0x562f41831800 2024-04-26T20:58:21.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.116+0000 7f8655874400 4 Got MDS map 23 2024-04-26T20:58:21.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.116+0000 7f8655874400 10 main: JournalTool::main 2024-04-26T20:58:21.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.116+0000 7f8655874400 4 main: JournalTool: connecting to RADOS... 2024-04-26T20:58:21.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.116+0000 7f8655874400 1 Processor -- start 2024-04-26T20:58:21.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.116+0000 7f8655874400 1 -- start start 2024-04-26T20:58:21.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.116+0000 7f8655874400 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x562f4260fc00 0x562f425fb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:21.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.116+0000 7f8655874400 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562f427a6000 0x562f425fb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:21.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.116+0000 7f8655874400 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562f427a6400 0x562f425fbb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:21.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.116+0000 7f8655874400 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x562f42616300 con 0x562f427a6400 2024-04-26T20:58:21.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.116+0000 7f8655874400 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x562f42616000 con 0x562f427a6000 2024-04-26T20:58:21.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.116+0000 7f8655874400 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x562f41890900 con 0x562f4260fc00 2024-04-26T20:58:21.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.116+0000 7f8653000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562f427a6400 0x562f425fbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:21.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.116+0000 7f8653000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562f427a6400 0x562f425fbb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:54522/0 (socket says 172.21.15.138:54522) 2024-04-26T20:58:21.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.116+0000 7f8654400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x562f4260fc00 0x562f425fb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:21.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.116+0000 7f8653000640 1 -- 172.21.15.138:0/905999924 learned_addr learned my addr 172.21.15.138:0/905999924 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:21.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.116+0000 7f8653a00640 1 --2- 172.21.15.138:0/905999924 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562f427a6000 0x562f425fb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:21.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.116+0000 7f8653000640 1 -- 172.21.15.138:0/905999924 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x562f4260fc00 msgr2=0x562f425fb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:21.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.116+0000 7f8653000640 1 --2- 172.21.15.138:0/905999924 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x562f4260fc00 0x562f425fb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.116+0000 7f8653000640 1 -- 172.21.15.138:0/905999924 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562f427a6000 msgr2=0x562f425fb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:21.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.116+0000 7f8653000640 1 --2- 172.21.15.138:0/905999924 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562f427a6000 0x562f425fb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.116+0000 7f8653000640 1 -- 172.21.15.138:0/905999924 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f4259c1e0 con 0x562f427a6400 2024-04-26T20:58:21.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.120+0000 7f8653000640 1 --2- 172.21.15.138:0/905999924 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562f427a6400 0x562f425fbb80 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x562f426108d0 tx=0x562f42615800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0d3bf96f8426938 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:21.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.120+0000 7f864e000640 1 -- 172.21.15.138:0/905999924 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562f418669c0 con 0x562f427a6400 2024-04-26T20:58:21.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.120+0000 7f864e000640 1 -- 172.21.15.138:0/905999924 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x562f4187a540 con 0x562f427a6400 2024-04-26T20:58:21.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.120+0000 7f864e000640 1 -- 172.21.15.138:0/905999924 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562f418664e0 con 0x562f427a6400 2024-04-26T20:58:21.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.120+0000 7f8655874400 1 -- 172.21.15.138:0/905999924 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562f427a6400 msgr2=0x562f425fbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:21.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.120+0000 7f8655874400 1 --2- 172.21.15.138:0/905999924 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562f427a6400 0x562f425fbb80 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x562f426108d0 tx=0x562f42615800 comp rx=0 tx=0).stop 2024-04-26T20:58:21.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.120+0000 7f8655874400 1 -- 172.21.15.138:0/905999924 shutdown_connections 2024-04-26T20:58:21.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.120+0000 7f8655874400 1 --2- 172.21.15.138:0/905999924 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562f427a6400 0x562f425fbb80 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.120+0000 7f8655874400 1 --2- 172.21.15.138:0/905999924 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562f427a6000 0x562f425fb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.120+0000 7f8655874400 1 --2- 172.21.15.138:0/905999924 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x562f4260fc00 0x562f425fb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.120+0000 7f8655874400 1 -- 172.21.15.138:0/905999924 >> 172.21.15.138:0/905999924 conn(0x562f41830c00 msgr2=0x562f4185f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:21.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.120+0000 7f8655874400 1 -- 172.21.15.138:0/905999924 shutdown_connections 2024-04-26T20:58:21.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.120+0000 7f8655874400 1 -- 172.21.15.138:0/905999924 wait complete. 2024-04-26T20:58:21.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.120+0000 7f8655874400 1 Processor -- start 2024-04-26T20:58:21.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.120+0000 7f8655874400 1 -- start start 2024-04-26T20:58:21.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.120+0000 7f8655874400 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x562f4260fc00 0x562f425fb080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:21.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.120+0000 7f8655874400 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562f427a7800 0x562f425fb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:21.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.120+0000 7f8655874400 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562f427a7400 0x562f425fbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:21.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.120+0000 7f8655874400 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x562f42616300 con 0x562f427a7400 2024-04-26T20:58:21.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.120+0000 7f8655874400 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x562f42616000 con 0x562f427a7800 2024-04-26T20:58:21.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.120+0000 7f8655874400 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x562f42617500 con 0x562f4260fc00 2024-04-26T20:58:21.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.120+0000 7f8653000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562f427a7400 0x562f425fbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:21.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.120+0000 7f8653000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562f427a7400 0x562f425fbb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:54528/0 (socket says 172.21.15.138:54528) 2024-04-26T20:58:21.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.120+0000 7f8653000640 1 -- 172.21.15.138:0/4089283694 learned_addr learned my addr 172.21.15.138:0/4089283694 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:21.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.120+0000 7f8654400640 1 --2- 172.21.15.138:0/4089283694 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x562f4260fc00 0x562f425fb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:21.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.120+0000 7f8653a00640 1 --2- 172.21.15.138:0/4089283694 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562f427a7800 0x562f425fb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:21.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.120+0000 7f8653000640 1 -- 172.21.15.138:0/4089283694 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x562f4260fc00 msgr2=0x562f425fb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:21.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.120+0000 7f8653000640 1 --2- 172.21.15.138:0/4089283694 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x562f4260fc00 0x562f425fb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.120+0000 7f8653000640 1 -- 172.21.15.138:0/4089283694 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562f427a7800 msgr2=0x562f425fb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:21.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.120+0000 7f8653000640 1 --2- 172.21.15.138:0/4089283694 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562f427a7800 0x562f425fb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.120+0000 7f8653000640 1 -- 172.21.15.138:0/4089283694 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f4259da40 con 0x562f427a7400 2024-04-26T20:58:21.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.120+0000 7f8654400640 1 --2- 172.21.15.138:0/4089283694 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x562f4260fc00 0x562f425fb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:58:21.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.120+0000 7f8653000640 1 --2- 172.21.15.138:0/4089283694 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562f427a7400 0x562f425fbb80 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x562f42611a70 tx=0x562f419114a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:21.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.120+0000 7f864c200640 1 -- 172.21.15.138:0/4089283694 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562f41866000 con 0x562f427a7400 2024-04-26T20:58:21.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.120+0000 7f864c200640 1 -- 172.21.15.138:0/4089283694 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x562f4187aa80 con 0x562f427a7400 2024-04-26T20:58:21.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.120+0000 7f864c200640 1 -- 172.21.15.138:0/4089283694 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562f418669c0 con 0x562f427a7400 2024-04-26T20:58:21.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.120+0000 7f8655874400 1 -- 172.21.15.138:0/4089283694 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562f4259dc20 con 0x562f427a7400 2024-04-26T20:58:21.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.120+0000 7f8655874400 1 -- 172.21.15.138:0/4089283694 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f4259da40 con 0x562f427a7400 2024-04-26T20:58:21.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.120+0000 7f8655874400 4 main: JournalTool: resolving pool 7 2024-04-26T20:58:21.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.124+0000 7f864c200640 1 -- 172.21.15.138:0/4089283694 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x562f4279e900 con 0x562f427a7400 2024-04-26T20:58:21.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.124+0000 7f864c200640 1 --2- 172.21.15.138:0/4089283694 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x562f41b21400 0x562f425fc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:21.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.124+0000 7f864c200640 1 -- 172.21.15.138:0/4089283694 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6756+0+0 (secure 0 0 0) 0x562f41b30400 con 0x562f427a7400 2024-04-26T20:58:21.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.124+0000 7f8655874400 4 main: JournalTool: creating IoCtx.. 2024-04-26T20:58:21.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.124+0000 7f8655874400 4 main: Executing for rank 0 2024-04-26T20:58:21.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.124+0000 7f8655874400 1 main_event: Using alternate pool recovery_fs_metadata 2024-04-26T20:58:21.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.124+0000 7f8654400640 1 --2- 172.21.15.138:0/4089283694 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x562f41b21400 0x562f425fc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:21.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.124+0000 7f8655874400 1 --2- 172.21.15.138:0/4089283694 >> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] conn(0x562f427a7000 0x562f425fc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:21.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.124+0000 7f8655874400 1 -- 172.21.15.138:0/4089283694 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- osd_op(unknown.0.0:1 7.f 7:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x562f427a6c00 con 0x562f427a7000 2024-04-26T20:58:21.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.124+0000 7f8653a00640 1 --2- 172.21.15.138:0/4089283694 >> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] conn(0x562f427a7000 0x562f425fc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:21.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.124+0000 7f8654400640 1 --2- 172.21.15.138:0/4089283694 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x562f41b21400 0x562f425fc100 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x562f419a8cf0 tx=0x562f41baede0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:21.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.124+0000 7f8653a00640 1 --2- 172.21.15.138:0/4089283694 >> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] conn(0x562f427a7000 0x562f425fc680 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:21.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.124+0000 7f8653a00640 1 -- 172.21.15.138:0/4089283694 <== osd.7 v2:172.21.15.143:6824/3295508495 1 ==== osd_op_reply(1 400.00000000 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x562f425ba000 con 0x562f427a7000 2024-04-26T20:58:21.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.124+0000 7f8655874400 -1 Pointer 400.00000000 is absent 2024-04-26T20:58:21.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.124+0000 7f8655874400 4 main_event: consumed 0 inodes 2024-04-26T20:58:21.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.124+0000 7f8655874400 1 --2- 172.21.15.138:0/4089283694 >> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] conn(0x562f427a6800 0x562f425fcc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:21.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.124+0000 7f8655874400 1 -- 172.21.15.138:0/4089283694 --> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] -- osd_op(unknown.0.0:2 7.3 7:c0ce80d4:::4.00000000:head [omap-rm-keys in=4b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x562f427a6400 con 0x562f427a6800 2024-04-26T20:58:21.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.124+0000 7f8654400640 1 --2- 172.21.15.138:0/4089283694 >> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] conn(0x562f427a6800 0x562f425fcc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:21.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.124+0000 7f8654400640 1 --2- 172.21.15.138:0/4089283694 >> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] conn(0x562f427a6800 0x562f425fcc00 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:21.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.128+0000 7f8654400640 1 -- 172.21.15.138:0/4089283694 <== osd.5 v2:172.21.15.143:6808/1910222887 1 ==== osd_op_reply(2 4.00000000 [omap-rm-keys] v51'1 uv0 ondisk = -2 ((2) No such file or directory)) ==== 154+0+0 (crc 0 0 0) 0x562f425ba500 con 0x562f427a6800 2024-04-26T20:58:21.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.128+0000 7f8655874400 4 0 events 2024-04-26T20:58:21.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.128+0000 7f8655874400 1 -- 172.21.15.138:0/4089283694 >> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] conn(0x562f427a6800 msgr2=0x562f425fcc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:21.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.128+0000 7f8655874400 1 --2- 172.21.15.138:0/4089283694 >> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] conn(0x562f427a6800 0x562f425fcc00 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.128+0000 7f8655874400 1 -- 172.21.15.138:0/4089283694 >> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] conn(0x562f427a7000 msgr2=0x562f425fc680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:21.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.128+0000 7f8655874400 1 --2- 172.21.15.138:0/4089283694 >> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] conn(0x562f427a7000 0x562f425fc680 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.128+0000 7f8655874400 1 -- 172.21.15.138:0/4089283694 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x562f41b21400 msgr2=0x562f425fc100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:21.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.128+0000 7f8655874400 1 --2- 172.21.15.138:0/4089283694 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x562f41b21400 0x562f425fc100 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x562f419a8cf0 tx=0x562f41baede0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.128+0000 7f8653000640 1 -- 172.21.15.138:0/4089283694 reap_dead start 2024-04-26T20:58:21.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.128+0000 7f8655874400 1 -- 172.21.15.138:0/4089283694 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562f427a7400 msgr2=0x562f425fbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:21.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.128+0000 7f8655874400 1 --2- 172.21.15.138:0/4089283694 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562f427a7400 0x562f425fbb80 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x562f42611a70 tx=0x562f419114a0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.128+0000 7f8655874400 1 -- 172.21.15.138:0/4089283694 shutdown_connections 2024-04-26T20:58:21.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.128+0000 7f8655874400 1 --2- 172.21.15.138:0/4089283694 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562f427a7400 0x562f425fbb80 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.128+0000 7f8655874400 1 -- 172.21.15.138:0/4089283694 >> 172.21.15.138:0/4089283694 conn(0x562f41830c00 msgr2=0x562f4185f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:21.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.128+0000 7f8655874400 1 -- 172.21.15.138:0/4089283694 shutdown_connections 2024-04-26T20:58:21.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.128+0000 7f8655874400 1 -- 172.21.15.138:0/4089283694 wait complete. 2024-04-26T20:58:21.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.128+0000 7f8655874400 1 -- 172.21.15.138:0/4060027221 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x562f41831800 msgr2=0x562f425fa000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:21.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.128+0000 7f8655874400 1 --2- 172.21.15.138:0/4060027221 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x562f41831800 0x562f425fa000 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x562f42690ff0 tx=0x562f4190eae0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.128+0000 7f8655874400 1 -- 172.21.15.138:0/4060027221 shutdown_connections 2024-04-26T20:58:21.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.128+0000 7f8655874400 1 --2- 172.21.15.138:0/4060027221 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562f41831000 0x562f425fab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.128+0000 7f8655874400 1 --2- 172.21.15.138:0/4060027221 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562f41831400 0x562f425fa580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.128+0000 7f8655874400 1 --2- 172.21.15.138:0/4060027221 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x562f41831800 0x562f425fa000 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.128+0000 7f8655874400 1 -- 172.21.15.138:0/4060027221 >> 172.21.15.138:0/4060027221 conn(0x562f41831c00 msgr2=0x562f4185f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:21.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.128+0000 7f8655874400 1 -- 172.21.15.138:0/4060027221 shutdown_connections 2024-04-26T20:58:21.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.128+0000 7f8655874400 1 -- 172.21.15.138:0/4060027221 wait complete. 2024-04-26T20:58:21.134 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'recovery_fs:0', 'event', 'recover_dentries', 'list', '--alternate-pool', 'recovery_fs_metadata'] in time 0:00:00.109641, result: 2024-04-26T20:58:21.134 DEBUG:teuthology.orchestra.run.smithi138:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank recovery_fs:0 journal reset --force 2024-04-26T20:58:21.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.180+0000 7fb31fb91400 1 -- start start 2024-04-26T20:58:21.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.180+0000 7fb31fb91400 1 Processor -- start 2024-04-26T20:58:21.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.180+0000 7fb31fb91400 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a9d7adf000 0x55a9d88b2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:21.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.180+0000 7fb31fb91400 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a9d7adf400 0x55a9d88b2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:21.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.180+0000 7fb31fb91400 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a9d7adf800 0x55a9d88b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:21.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.180+0000 7fb31fb91400 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55a9d88ca600 con 0x55a9d7adf400 2024-04-26T20:58:21.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.180+0000 7fb31fb91400 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55a9d88ca480 con 0x55a9d7adf000 2024-04-26T20:58:21.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.180+0000 7fb31fb91400 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55a9d88ca300 con 0x55a9d7adf800 2024-04-26T20:58:21.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.180+0000 7fb31d200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a9d7adf400 0x55a9d88b2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:21.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.180+0000 7fb31d200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a9d7adf400 0x55a9d88b2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:54554/0 (socket says 172.21.15.138:54554) 2024-04-26T20:58:21.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.180+0000 7fb31d200640 1 -- 172.21.15.138:0/3291906361 learned_addr learned my addr 172.21.15.138:0/3291906361 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:21.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.180+0000 7fb31dc00640 1 --2- 172.21.15.138:0/3291906361 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a9d7adf000 0x55a9d88b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:21.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.180+0000 7fb31e600640 1 --2- 172.21.15.138:0/3291906361 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a9d7adf800 0x55a9d88b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:21.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.180+0000 7fb31d200640 1 -- 172.21.15.138:0/3291906361 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a9d7adf800 msgr2=0x55a9d88b2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:21.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.180+0000 7fb31d200640 1 --2- 172.21.15.138:0/3291906361 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a9d7adf800 0x55a9d88b2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.180+0000 7fb31d200640 1 -- 172.21.15.138:0/3291906361 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a9d7adf000 msgr2=0x55a9d88b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:21.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.180+0000 7fb31d200640 1 --2- 172.21.15.138:0/3291906361 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a9d7adf000 0x55a9d88b2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.180+0000 7fb31d200640 1 -- 172.21.15.138:0/3291906361 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9d7bba960 con 0x55a9d7adf400 2024-04-26T20:58:21.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.180+0000 7fb31dc00640 1 --2- 172.21.15.138:0/3291906361 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a9d7adf000 0x55a9d88b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:58:21.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.180+0000 7fb31d200640 1 --2- 172.21.15.138:0/3291906361 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a9d7adf400 0x55a9d88b2580 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x55a9d89414a0 tx=0x55a9d7bbef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6205a599b96117a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:21.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.180+0000 7fb31aa00640 1 -- 172.21.15.138:0/3291906361 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a9d7b144e0 con 0x55a9d7adf400 2024-04-26T20:58:21.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.180+0000 7fb31aa00640 1 -- 172.21.15.138:0/3291906361 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55a9d7b28540 con 0x55a9d7adf400 2024-04-26T20:58:21.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.180+0000 7fb31aa00640 1 -- 172.21.15.138:0/3291906361 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a9d7b14b60 con 0x55a9d7adf400 2024-04-26T20:58:21.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.180+0000 7fb31fb91400 1 -- 172.21.15.138:0/3291906361 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9d7bbad20 con 0x55a9d7adf400 2024-04-26T20:58:21.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.180+0000 7fb31fb91400 1 -- 172.21.15.138:0/3291906361 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55a9d7bbaf00 con 0x55a9d7adf400 2024-04-26T20:58:21.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.180+0000 7fb31fb91400 4 waiting for MDS map... 2024-04-26T20:58:21.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.180+0000 7fb31aa00640 1 -- 172.21.15.138:0/3291906361 <== mon.0 v2:172.21.15.138:3300/0 4 ==== osd_map(51..51 src has 1..51) ==== 6756+0+0 (secure 0 0 0) 0x55a9d8a14000 con 0x55a9d7adf400 2024-04-26T20:58:21.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.180+0000 7fb31aa00640 1 -- 172.21.15.138:0/3291906361 <== mon.0 v2:172.21.15.138:3300/0 5 ==== fsmap(e 23) ==== 4135+0+0 (secure 0 0 0) 0x55a9d7b35180 con 0x55a9d7adf400 2024-04-26T20:58:21.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.180+0000 7fb31fb91400 4 Got MDS map 23 2024-04-26T20:58:21.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.180+0000 7fb31fb91400 10 main: JournalTool::main 2024-04-26T20:58:21.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.180+0000 7fb31fb91400 4 main: JournalTool: connecting to RADOS... 2024-04-26T20:58:21.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.180+0000 7fb31fb91400 1 Processor -- start 2024-04-26T20:58:21.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.180+0000 7fb31fb91400 1 -- start start 2024-04-26T20:58:21.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.184+0000 7fb31fb91400 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a9d8a03c00 0x55a9d88b3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:21.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.184+0000 7fb31fb91400 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a9d7dd2000 0x55a9d88b3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:21.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.184+0000 7fb31fb91400 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a9d7dd2400 0x55a9d88b3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:21.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.184+0000 7fb31fb91400 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55a9d88ca180 con 0x55a9d7dd2400 2024-04-26T20:58:21.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.184+0000 7fb31fb91400 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55a9d7b3e480 con 0x55a9d7dd2000 2024-04-26T20:58:21.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.184+0000 7fb31fb91400 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55a9d7b3e900 con 0x55a9d8a03c00 2024-04-26T20:58:21.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.184+0000 7fb31d200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a9d7dd2400 0x55a9d88b3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:21.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.184+0000 7fb31d200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a9d7dd2400 0x55a9d88b3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:54566/0 (socket says 172.21.15.138:54566) 2024-04-26T20:58:21.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.184+0000 7fb31d200640 1 -- 172.21.15.138:0/4210807100 learned_addr learned my addr 172.21.15.138:0/4210807100 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:21.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.184+0000 7fb31e600640 1 --2- 172.21.15.138:0/4210807100 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a9d8a03c00 0x55a9d88b3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:21.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.184+0000 7fb31dc00640 1 --2- 172.21.15.138:0/4210807100 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a9d7dd2000 0x55a9d88b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:21.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.184+0000 7fb31d200640 1 -- 172.21.15.138:0/4210807100 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a9d8a03c00 msgr2=0x55a9d88b3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:21.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.184+0000 7fb31d200640 1 --2- 172.21.15.138:0/4210807100 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a9d8a03c00 0x55a9d88b3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.184+0000 7fb31d200640 1 -- 172.21.15.138:0/4210807100 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a9d7dd2000 msgr2=0x55a9d88b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:21.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.184+0000 7fb31d200640 1 --2- 172.21.15.138:0/4210807100 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a9d7dd2000 0x55a9d88b3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.184+0000 7fb31d200640 1 -- 172.21.15.138:0/4210807100 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9d7bbad20 con 0x55a9d7dd2400 2024-04-26T20:58:21.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.184+0000 7fb31dc00640 1 --2- 172.21.15.138:0/4210807100 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a9d7dd2000 0x55a9d88b3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:58:21.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.184+0000 7fb31e600640 1 --2- 172.21.15.138:0/4210807100 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a9d8a03c00 0x55a9d88b3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:58:21.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.184+0000 7fb31d200640 1 --2- 172.21.15.138:0/4210807100 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a9d7dd2400 0x55a9d88b3b80 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x55a9d8a1a900 tx=0x55a9d7bbed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea8eb5e1d456ba6a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:21.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.184+0000 7fb318200640 1 -- 172.21.15.138:0/4210807100 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a9d7b14340 con 0x55a9d7dd2400 2024-04-26T20:58:21.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.184+0000 7fb318200640 1 -- 172.21.15.138:0/4210807100 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55a9d7b28a80 con 0x55a9d7dd2400 2024-04-26T20:58:21.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.184+0000 7fb318200640 1 -- 172.21.15.138:0/4210807100 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a9d7b144e0 con 0x55a9d7dd2400 2024-04-26T20:58:21.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.184+0000 7fb31fb91400 1 -- 172.21.15.138:0/4210807100 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a9d7dd2400 msgr2=0x55a9d88b3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:21.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.184+0000 7fb31fb91400 1 --2- 172.21.15.138:0/4210807100 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a9d7dd2400 0x55a9d88b3b80 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x55a9d8a1a900 tx=0x55a9d7bbed80 comp rx=0 tx=0).stop 2024-04-26T20:58:21.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.184+0000 7fb31fb91400 1 -- 172.21.15.138:0/4210807100 shutdown_connections 2024-04-26T20:58:21.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.184+0000 7fb31fb91400 1 --2- 172.21.15.138:0/4210807100 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a9d7dd2400 0x55a9d88b3b80 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.184+0000 7fb31fb91400 1 --2- 172.21.15.138:0/4210807100 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a9d7dd2000 0x55a9d88b3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.184+0000 7fb31fb91400 1 --2- 172.21.15.138:0/4210807100 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a9d8a03c00 0x55a9d88b3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.184+0000 7fb31fb91400 1 -- 172.21.15.138:0/4210807100 >> 172.21.15.138:0/4210807100 conn(0x55a9d8a03800 msgr2=0x55a9d7b0c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:21.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.184+0000 7fb31fb91400 1 -- 172.21.15.138:0/4210807100 shutdown_connections 2024-04-26T20:58:21.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.184+0000 7fb31fb91400 1 -- 172.21.15.138:0/4210807100 wait complete. 2024-04-26T20:58:21.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.184+0000 7fb31fb91400 1 Processor -- start 2024-04-26T20:58:21.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.184+0000 7fb31fb91400 1 -- start start 2024-04-26T20:58:21.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.184+0000 7fb31fb91400 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a9d8a03800 0x55a9d88b3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:21.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.184+0000 7fb31fb91400 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a9d7dd3000 0x55a9d88b3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:21.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.184+0000 7fb31fb91400 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a9d7dd2c00 0x55a9d88b3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:21.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.184+0000 7fb31fb91400 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55a9d88cb800 con 0x55a9d8a03800 2024-04-26T20:58:21.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.184+0000 7fb31fb91400 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55a9d88cb980 con 0x55a9d7dd3000 2024-04-26T20:58:21.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.184+0000 7fb31fb91400 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55a9d88cad80 con 0x55a9d7dd2c00 2024-04-26T20:58:21.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.184+0000 7fb31e600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a9d8a03800 0x55a9d88b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:21.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.184+0000 7fb31e600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a9d8a03800 0x55a9d88b3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:54576/0 (socket says 172.21.15.138:54576) 2024-04-26T20:58:21.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.184+0000 7fb31e600640 1 -- 172.21.15.138:0/2592863701 learned_addr learned my addr 172.21.15.138:0/2592863701 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:21.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.184+0000 7fb31dc00640 1 --2- 172.21.15.138:0/2592863701 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a9d7dd3000 0x55a9d88b3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:21.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.184+0000 7fb31d200640 1 --2- 172.21.15.138:0/2592863701 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a9d7dd2c00 0x55a9d88b3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:21.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.188+0000 7fb31e600640 1 -- 172.21.15.138:0/2592863701 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a9d7dd2c00 msgr2=0x55a9d88b3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:21.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.188+0000 7fb31e600640 1 --2- 172.21.15.138:0/2592863701 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a9d7dd2c00 0x55a9d88b3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.188+0000 7fb31e600640 1 -- 172.21.15.138:0/2592863701 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a9d7dd3000 msgr2=0x55a9d88b3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:21.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.188+0000 7fb31e600640 1 --2- 172.21.15.138:0/2592863701 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a9d7dd3000 0x55a9d88b3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.188+0000 7fb31e600640 1 -- 172.21.15.138:0/2592863701 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9d7bbba40 con 0x55a9d8a03800 2024-04-26T20:58:21.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.188+0000 7fb31e600640 1 --2- 172.21.15.138:0/2592863701 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a9d8a03800 0x55a9d88b3600 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x55a9d8a1bc20 tx=0x55a9d8a27a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:21.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.188+0000 7fb316400640 1 -- 172.21.15.138:0/2592863701 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a9d7b14340 con 0x55a9d8a03800 2024-04-26T20:58:21.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.188+0000 7fb316400640 1 -- 172.21.15.138:0/2592863701 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55a9d7b281c0 con 0x55a9d8a03800 2024-04-26T20:58:21.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.188+0000 7fb316400640 1 -- 172.21.15.138:0/2592863701 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a9d7b144e0 con 0x55a9d8a03800 2024-04-26T20:58:21.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.188+0000 7fb31fb91400 1 -- 172.21.15.138:0/2592863701 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a9d7bbbc20 con 0x55a9d8a03800 2024-04-26T20:58:21.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.188+0000 7fb31fb91400 1 -- 172.21.15.138:0/2592863701 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9d7bbba40 con 0x55a9d8a03800 2024-04-26T20:58:21.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.188+0000 7fb31fb91400 4 main: JournalTool: resolving pool 7 2024-04-26T20:58:21.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.188+0000 7fb316400640 1 -- 172.21.15.138:0/2592863701 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x55a9d8a5e900 con 0x55a9d8a03800 2024-04-26T20:58:21.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.188+0000 7fb316400640 1 --2- 172.21.15.138:0/2592863701 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x55a9d7de8c00 0x55a9d88b4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:21.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.188+0000 7fb316400640 1 -- 172.21.15.138:0/2592863701 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6756+0+0 (secure 0 0 0) 0x55a9d7deca00 con 0x55a9d8a03800 2024-04-26T20:58:21.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.188+0000 7fb31fb91400 4 main: JournalTool: creating IoCtx.. 2024-04-26T20:58:21.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.188+0000 7fb31fb91400 4 main: Executing for rank 0 2024-04-26T20:58:21.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.188+0000 7fb31dc00640 1 --2- 172.21.15.138:0/2592863701 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x55a9d7de8c00 0x55a9d88b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:21.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.188+0000 7fb31dc00640 1 --2- 172.21.15.138:0/2592863701 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x55a9d7de8c00 0x55a9d88b4100 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x55a9d88683f0 tx=0x55a9d7bbe300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:21.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.188+0000 7fb31fb91400 1 -- start start 2024-04-26T20:58:21.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.188+0000 7fb31fb91400 1 Processor -- start 2024-04-26T20:58:21.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.192+0000 7fb31fb91400 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a9d7dd2400 0x55a9d88b4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:21.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.192+0000 7fb31fb91400 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a9d7dd2000 0x55a9d88b4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:21.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.192+0000 7fb31fb91400 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a9d7de9000 0x55a9d88b5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:21.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.192+0000 7fb31fb91400 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55a9d88caa80 con 0x55a9d7dd2400 2024-04-26T20:58:21.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.192+0000 7fb31fb91400 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55a9d88cbb00 con 0x55a9d7dd2000 2024-04-26T20:58:21.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.192+0000 7fb31fb91400 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55a9d88cbc80 con 0x55a9d7de9000 2024-04-26T20:58:21.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.192+0000 7fb31e600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a9d7dd2400 0x55a9d88b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:21.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.192+0000 7fb31dc00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a9d7dd2000 0x55a9d88b4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:21.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.192+0000 7fb31d200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a9d7de9000 0x55a9d88b5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:21.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.192+0000 7fb31dc00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a9d7dd2000 0x55a9d88b4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.138:55026/0 (socket says 172.21.15.138:55026) 2024-04-26T20:58:21.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.192+0000 7fb31e600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a9d7dd2400 0x55a9d88b4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:54582/0 (socket says 172.21.15.138:54582) 2024-04-26T20:58:21.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.192+0000 7fb31dc00640 1 -- 172.21.15.138:0/1863653893 learned_addr learned my addr 172.21.15.138:0/1863653893 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:21.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.192+0000 7fb31d200640 1 -- 172.21.15.138:0/1863653893 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a9d7dd2000 msgr2=0x55a9d88b4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:21.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.192+0000 7fb31d200640 1 --2- 172.21.15.138:0/1863653893 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a9d7dd2000 0x55a9d88b4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.192+0000 7fb31d200640 1 -- 172.21.15.138:0/1863653893 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a9d7dd2400 msgr2=0x55a9d88b4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:21.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.192+0000 7fb31d200640 1 --2- 172.21.15.138:0/1863653893 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a9d7dd2400 0x55a9d88b4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.192+0000 7fb31d200640 1 -- 172.21.15.138:0/1863653893 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9d7f28780 con 0x55a9d7de9000 2024-04-26T20:58:21.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.192+0000 7fb31dc00640 1 --2- 172.21.15.138:0/1863653893 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a9d7dd2000 0x55a9d88b4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:58:21.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.192+0000 7fb31d200640 1 --2- 172.21.15.138:0/1863653893 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a9d7de9000 0x55a9d88b5180 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x55a9d8a1ab40 tx=0x55a9d8a27800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa59882e2e94fbe0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:21.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.192+0000 7fb312800640 1 -- 172.21.15.138:0/1863653893 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a9d7b14b60 con 0x55a9d7de9000 2024-04-26T20:58:21.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.192+0000 7fb312800640 1 -- 172.21.15.138:0/1863653893 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55a9d7b29340 con 0x55a9d7de9000 2024-04-26T20:58:21.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.192+0000 7fb312800640 1 -- 172.21.15.138:0/1863653893 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a9d7b14000 con 0x55a9d7de9000 2024-04-26T20:58:21.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.192+0000 7fb31fb91400 1 -- 172.21.15.138:0/1863653893 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55a9d7f28960 con 0x55a9d7de9000 2024-04-26T20:58:21.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.192+0000 7fb31fb91400 1 -- 172.21.15.138:0/1863653893 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({fsmap=0}) -- 0x55a9d7f28b40 con 0x55a9d7de9000 2024-04-26T20:58:21.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.192+0000 7fb31fb91400 4 waiting for MDS map... 2024-04-26T20:58:21.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.192+0000 7fb312800640 1 -- 172.21.15.138:0/1863653893 <== mon.2 v2:172.21.15.143:3301/0 4 ==== osd_map(51..51 src has 1..51) ==== 6756+0+0 (secure 0 0 0) 0x55a9d7f3a000 con 0x55a9d7de9000 2024-04-26T20:58:21.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.192+0000 7fb312800640 1 -- 172.21.15.138:0/1863653893 <== mon.2 v2:172.21.15.143:3301/0 5 ==== fsmap(e 23) ==== 4135+0+0 (secure 0 0 0) 0x55a9d7b35500 con 0x55a9d7de9000 2024-04-26T20:58:21.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.192+0000 7fb31fb91400 4 Got MDS map 23 2024-04-26T20:58:21.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.192+0000 7fb31fb91400 1 --2- 172.21.15.138:0/1863653893 >> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] conn(0x55a9d7de9400 0x55a9d88b5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:21.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.192+0000 7fb31fb91400 1 -- 172.21.15.138:0/1863653893 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- osd_op(unknown.0.0:1 7.f 7:f1f69726:::400.00000000:head [writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x55a9d7de9800 con 0x55a9d7de9400 2024-04-26T20:58:21.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.192+0000 7fb31e600640 1 --2- 172.21.15.138:0/1863653893 >> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] conn(0x55a9d7de9400 0x55a9d88b5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:21.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.192+0000 7fb31e600640 1 --2- 172.21.15.138:0/1863653893 >> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] conn(0x55a9d7de9400 0x55a9d88b5700 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=482b1c716c059def server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:21.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.196+0000 7fb31e600640 1 -- 172.21.15.138:0/1863653893 <== osd.7 v2:172.21.15.143:6824/3295508495 1 ==== osd_op_reply(1 400.00000000 [writefull 0~22] v51'1 uv1 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x55a9d7c54000 con 0x55a9d7de9400 2024-04-26T20:58:21.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.196+0000 7fb31fb91400 1 --2- 172.21.15.138:0/1863653893 >> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] conn(0x55a9d7de9c00 0x55a9d7f5c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:21.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.196+0000 7fb31fb91400 1 -- 172.21.15.138:0/1863653893 --> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] -- osd_op(unknown.0.0:2 7.14 7:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x55a9d7f60000 con 0x55a9d7de9c00 2024-04-26T20:58:21.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.196+0000 7fb31dc00640 1 --2- 172.21.15.138:0/1863653893 >> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] conn(0x55a9d7de9c00 0x55a9d7f5c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:21.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.196+0000 7fb31dc00640 1 --2- 172.21.15.138:0/1863653893 >> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] conn(0x55a9d7de9c00 0x55a9d7f5c000 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=3fe57361e25f452b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:21.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.196+0000 7fb31dc00640 1 -- 172.21.15.138:0/1863653893 <== osd.5 v2:172.21.15.143:6808/1910222887 1 ==== osd_op_reply(2 200.00000000 [writefull 0~90] v51'2 uv2 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x55a9d7c54500 con 0x55a9d7de9c00 2024-04-26T20:58:21.201 INFO:teuthology.orchestra.run.smithi138.stdout:writing EResetJournal entry 2024-04-26T20:58:21.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.196+0000 7fb31fb91400 1 -- 172.21.15.138:0/1863653893 --> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] -- osd_op(unknown.0.0:3 7.14 7:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x55a9d7f60400 con 0x55a9d7de9c00 2024-04-26T20:58:21.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.196+0000 7fb31fb91400 1 --2- 172.21.15.138:0/1863653893 >> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] conn(0x55a9d7f60800 0x55a9d7f5c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:21.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.196+0000 7fb31fb91400 1 -- 172.21.15.138:0/1863653893 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- osd_op(unknown.0.0:4 7.1b 7:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x55a9d7f60c00 con 0x55a9d7f60800 2024-04-26T20:58:21.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.196+0000 7fb31fb91400 1 --2- 172.21.15.138:0/1863653893 >> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] conn(0x55a9d7f61000 0x55a9d7f5cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:21.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.196+0000 7fb31fb91400 1 -- 172.21.15.138:0/1863653893 --> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] -- osd_op(unknown.0.0:5 7.b 7:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x55a9d7f61400 con 0x55a9d7f61000 2024-04-26T20:58:21.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.196+0000 7fb31fb91400 1 --2- 172.21.15.138:0/1863653893 >> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] conn(0x55a9d7f61800 0x55a9d7f5d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:21.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.196+0000 7fb31fb91400 1 -- 172.21.15.138:0/1863653893 --> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] -- osd_op(unknown.0.0:6 7.1f 7:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x55a9d7f61c00 con 0x55a9d7f61800 2024-04-26T20:58:21.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.196+0000 7fb31fb91400 1 --2- 172.21.15.138:0/1863653893 >> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] conn(0x55a9d7f6e000 0x55a9d7f5d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:21.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.196+0000 7fb31fb91400 1 -- 172.21.15.138:0/1863653893 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- osd_op(unknown.0.0:7 7.1a 7:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x55a9d7f6e400 con 0x55a9d7f6e000 2024-04-26T20:58:21.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.196+0000 7fb31fb91400 1 -- 172.21.15.138:0/1863653893 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- osd_op(unknown.0.0:8 7.1e 7:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x55a9d7f6e800 con 0x55a9d7de9400 2024-04-26T20:58:21.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.200+0000 7fb31d200640 1 --2- 172.21.15.138:0/1863653893 >> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] conn(0x55a9d7f61800 0x55a9d7f5d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:21.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.200+0000 7fb31e600640 1 --2- 172.21.15.138:0/1863653893 >> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] conn(0x55a9d7f60800 0x55a9d7f5c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:21.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.200+0000 7fb31dc00640 1 --2- 172.21.15.138:0/1863653893 >> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] conn(0x55a9d7f61000 0x55a9d7f5cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:21.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.200+0000 7fb31e600640 1 --2- 172.21.15.138:0/1863653893 >> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] conn(0x55a9d7f6e000 0x55a9d7f5d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:21.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.200+0000 7fb31d200640 1 --2- 172.21.15.138:0/1863653893 >> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] conn(0x55a9d7f61800 0x55a9d7f5d080 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=92923f4b34acd39 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:21.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.200+0000 7fb31e600640 1 --2- 172.21.15.138:0/1863653893 >> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] conn(0x55a9d7f6e000 0x55a9d7f5d600 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=5015e3f759fce4ca server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:21.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.200+0000 7fb31e600640 1 --2- 172.21.15.138:0/1863653893 >> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] conn(0x55a9d7f60800 0x55a9d7f5c580 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=3dc9723af1aff8bb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:21.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.200+0000 7fb31dc00640 1 --2- 172.21.15.138:0/1863653893 >> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] conn(0x55a9d7f61000 0x55a9d7f5cb00 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=5f1219c63e6d6eff server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:21.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.200+0000 7fb31dc00640 1 -- 172.21.15.138:0/1863653893 <== osd.5 v2:172.21.15.143:6808/1910222887 2 ==== osd_op_reply(3 200.00000001 [delete] v51'3 uv2 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55a9d7c54500 con 0x55a9d7de9c00 2024-04-26T20:58:21.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.200+0000 7fb31e600640 1 -- 172.21.15.138:0/1863653893 <== osd.3 v2:172.21.15.138:6824/3098242154 1 ==== osd_op_reply(7 200.00000005 [delete] v51'1 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55a9d7c54000 con 0x55a9d7f6e000 2024-04-26T20:58:21.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.200+0000 7fb31dc00640 1 -- 172.21.15.138:0/1863653893 <== osd.6 v2:172.21.15.143:6816/1082239825 1 ==== osd_op_reply(5 200.00000003 [delete] v51'2 uv1 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55a9d7c54500 con 0x55a9d7f61000 2024-04-26T20:58:21.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.200+0000 7fb31e600640 1 -- 172.21.15.138:0/1863653893 <== osd.7 v2:172.21.15.143:6824/3295508495 2 ==== osd_op_reply(8 200.00000006 [delete] v51'1 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55a9d7c54000 con 0x55a9d7de9400 2024-04-26T20:58:21.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.200+0000 7fb31d200640 1 -- 172.21.15.138:0/1863653893 <== osd.0 v2:172.21.15.138:6800/3534772245 1 ==== osd_op_reply(6 200.00000004 [delete] v51'5 uv4 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55a9d7c54780 con 0x55a9d7f61800 2024-04-26T20:58:21.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.200+0000 7fb31e600640 1 -- 172.21.15.138:0/1863653893 <== osd.4 v2:172.21.15.143:6800/2942056312 1 ==== osd_op_reply(4 200.00000002 [delete] v51'1 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55a9d7c54000 con 0x55a9d7f60800 2024-04-26T20:58:21.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.200+0000 7fb310a00640 1 -- 172.21.15.138:0/1863653893 --> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] -- osd_op(unknown.0.0:9 7.14 7:2e2fa760:::200.00000001:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x55a9d7de9800 con 0x55a9d7de9c00 2024-04-26T20:58:21.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.204+0000 7fb31dc00640 1 -- 172.21.15.138:0/1863653893 <== osd.5 v2:172.21.15.143:6808/1910222887 3 ==== osd_op_reply(9 200.00000001 [write 0~48] v51'4 uv4 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x55a9d7c54500 con 0x55a9d7de9c00 2024-04-26T20:58:21.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.204+0000 7fb31fb91400 4 Successfully wrote new journal pointer and header for rank 3:0 2024-04-26T20:58:21.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.204+0000 7fb31fb91400 1 -- 172.21.15.138:0/1863653893 >> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] conn(0x55a9d7f61800 msgr2=0x55a9d7f5d080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:21.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.204+0000 7fb31fb91400 1 --2- 172.21.15.138:0/1863653893 >> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] conn(0x55a9d7f61800 0x55a9d7f5d080 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.204+0000 7fb31fb91400 1 -- 172.21.15.138:0/1863653893 >> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] conn(0x55a9d7f6e000 msgr2=0x55a9d7f5d600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:21.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.204+0000 7fb31fb91400 1 --2- 172.21.15.138:0/1863653893 >> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] conn(0x55a9d7f6e000 0x55a9d7f5d600 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.204+0000 7fb31fb91400 1 -- 172.21.15.138:0/1863653893 >> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] conn(0x55a9d7f60800 msgr2=0x55a9d7f5c580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:21.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.204+0000 7fb31fb91400 1 --2- 172.21.15.138:0/1863653893 >> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] conn(0x55a9d7f60800 0x55a9d7f5c580 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.204+0000 7fb31fb91400 1 -- 172.21.15.138:0/1863653893 >> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] conn(0x55a9d7de9c00 msgr2=0x55a9d7f5c000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:21.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.204+0000 7fb31fb91400 1 --2- 172.21.15.138:0/1863653893 >> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] conn(0x55a9d7de9c00 0x55a9d7f5c000 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.204+0000 7fb31fb91400 1 -- 172.21.15.138:0/1863653893 >> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] conn(0x55a9d7f61000 msgr2=0x55a9d7f5cb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:21.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.204+0000 7fb31fb91400 1 --2- 172.21.15.138:0/1863653893 >> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] conn(0x55a9d7f61000 0x55a9d7f5cb00 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.204+0000 7fb31d200640 1 -- 172.21.15.138:0/1863653893 reap_dead start 2024-04-26T20:58:21.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.204+0000 7fb31fb91400 1 -- 172.21.15.138:0/1863653893 >> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] conn(0x55a9d7de9400 msgr2=0x55a9d88b5700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:21.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.204+0000 7fb31fb91400 1 --2- 172.21.15.138:0/1863653893 >> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] conn(0x55a9d7de9400 0x55a9d88b5700 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.204+0000 7fb31d200640 1 -- 172.21.15.138:0/1863653893 reap_dead start 2024-04-26T20:58:21.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.204+0000 7fb31fb91400 1 -- 172.21.15.138:0/1863653893 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a9d7de9000 msgr2=0x55a9d88b5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:21.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.204+0000 7fb31fb91400 1 --2- 172.21.15.138:0/1863653893 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a9d7de9000 0x55a9d88b5180 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x55a9d8a1ab40 tx=0x55a9d8a27800 comp rx=0 tx=0).stop 2024-04-26T20:58:21.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.204+0000 7fb31fb91400 1 -- 172.21.15.138:0/1863653893 shutdown_connections 2024-04-26T20:58:21.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.204+0000 7fb31fb91400 1 --2- 172.21.15.138:0/1863653893 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a9d7de9000 0x55a9d88b5180 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.204+0000 7fb31fb91400 1 -- 172.21.15.138:0/1863653893 >> 172.21.15.138:0/1863653893 conn(0x55a9d7dd2800 msgr2=0x55a9d7f22000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:21.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.204+0000 7fb31fb91400 1 -- 172.21.15.138:0/1863653893 shutdown_connections 2024-04-26T20:58:21.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.204+0000 7fb31fb91400 1 -- 172.21.15.138:0/1863653893 wait complete. 2024-04-26T20:58:21.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.204+0000 7fb31fb91400 1 -- 172.21.15.138:0/2592863701 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x55a9d7de8c00 msgr2=0x55a9d88b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:21.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.204+0000 7fb31fb91400 1 --2- 172.21.15.138:0/2592863701 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x55a9d7de8c00 0x55a9d88b4100 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x55a9d88683f0 tx=0x55a9d7bbe300 comp rx=0 tx=0).stop 2024-04-26T20:58:21.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.204+0000 7fb31fb91400 1 -- 172.21.15.138:0/2592863701 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a9d8a03800 msgr2=0x55a9d88b3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:21.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.204+0000 7fb31fb91400 1 --2- 172.21.15.138:0/2592863701 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a9d8a03800 0x55a9d88b3600 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x55a9d8a1bc20 tx=0x55a9d8a27a40 comp rx=0 tx=0).stop 2024-04-26T20:58:21.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.204+0000 7fb31fb91400 1 -- 172.21.15.138:0/2592863701 shutdown_connections 2024-04-26T20:58:21.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.204+0000 7fb31fb91400 1 --2- 172.21.15.138:0/2592863701 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x55a9d7de8c00 0x55a9d88b4100 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.204+0000 7fb31fb91400 1 --2- 172.21.15.138:0/2592863701 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a9d7dd2c00 0x55a9d88b3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.204+0000 7fb31fb91400 1 --2- 172.21.15.138:0/2592863701 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a9d7dd3000 0x55a9d88b3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.204+0000 7fb31fb91400 1 --2- 172.21.15.138:0/2592863701 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a9d8a03800 0x55a9d88b3600 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.204+0000 7fb31fb91400 1 -- 172.21.15.138:0/2592863701 >> 172.21.15.138:0/2592863701 conn(0x55a9d8a03c00 msgr2=0x55a9d7b0c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:21.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.204+0000 7fb31fb91400 1 -- 172.21.15.138:0/2592863701 shutdown_connections 2024-04-26T20:58:21.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.204+0000 7fb31fb91400 1 -- 172.21.15.138:0/2592863701 wait complete. 2024-04-26T20:58:21.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.204+0000 7fb31fb91400 1 -- 172.21.15.138:0/3291906361 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a9d7adf400 msgr2=0x55a9d88b2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:21.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.204+0000 7fb31fb91400 1 --2- 172.21.15.138:0/3291906361 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a9d7adf400 0x55a9d88b2580 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x55a9d89414a0 tx=0x55a9d7bbef60 comp rx=0 tx=0).stop 2024-04-26T20:58:21.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.204+0000 7fb31fb91400 1 -- 172.21.15.138:0/3291906361 shutdown_connections 2024-04-26T20:58:21.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.204+0000 7fb31fb91400 1 --2- 172.21.15.138:0/3291906361 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a9d7adf800 0x55a9d88b2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.204+0000 7fb31fb91400 1 --2- 172.21.15.138:0/3291906361 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a9d7adf400 0x55a9d88b2580 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.204+0000 7fb31fb91400 1 --2- 172.21.15.138:0/3291906361 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a9d7adf000 0x55a9d88b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.204+0000 7fb31fb91400 1 -- 172.21.15.138:0/3291906361 >> 172.21.15.138:0/3291906361 conn(0x55a9d7adec00 msgr2=0x55a9d7b0b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:21.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.204+0000 7fb31fb91400 1 -- 172.21.15.138:0/3291906361 shutdown_connections 2024-04-26T20:58:21.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.204+0000 7fb31fb91400 1 -- 172.21.15.138:0/3291906361 wait complete. 2024-04-26T20:58:21.212 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'recovery_fs:0', 'journal', 'reset', '--force'] in time 0:00:00.077801, result: writing EResetJournal entry 2024-04-26T20:58:21.212 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set recovery_fs joinable true 2024-04-26T20:58:21.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.352+0000 7f936fc00640 1 Processor -- start 2024-04-26T20:58:21.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.352+0000 7f936fc00640 1 -- start start 2024-04-26T20:58:21.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.352+0000 7f936fc00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f936815bdc0 0x7f936815f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:21.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.352+0000 7f936fc00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f936806f880 0x7f93680ce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:21.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.352+0000 7f936fc00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f936806dee0 con 0x7f9368073d70 2024-04-26T20:58:21.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.352+0000 7f936fc00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f936815c1a0 con 0x7f936806f880 2024-04-26T20:58:21.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.352+0000 7f936fc00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f936806e180 con 0x7f936815bdc0 2024-04-26T20:58:21.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.352+0000 7f936dc00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f936806f880 0x7f93680ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:21.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.352+0000 7f9367e00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f9368073d70 0x7f936815fe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:32834/0 (socket says 172.21.15.138:32834) 2024-04-26T20:58:21.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.352+0000 7f9367e00640 1 -- 172.21.15.138:0/1355712074 learned_addr learned my addr 172.21.15.138:0/1355712074 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:21.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.352+0000 7f936d200640 1 --2- 172.21.15.138:0/1355712074 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f936815bdc0 0x7f936815f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:21.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.352+0000 7f936dc00640 1 -- 172.21.15.138:0/1355712074 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f936815bdc0 msgr2=0x7f936815f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:21.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.352+0000 7f936dc00640 1 --2- 172.21.15.138:0/1355712074 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f936815bdc0 0x7f936815f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.352+0000 7f936dc00640 1 -- 172.21.15.138:0/1355712074 >> v1:172.21.15.138:6789/0 conn(0x7f9368073d70 legacy=0x7f936815fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:21.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.352+0000 7f936dc00640 1 -- 172.21.15.138:0/1355712074 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f936806e460 con 0x7f936806f880 2024-04-26T20:58:21.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.352+0000 7f9367400640 1 -- 172.21.15.138:0/1355712074 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3265961773 0 0) 0x7f936806dee0 con 0x7f9368073d70 2024-04-26T20:58:21.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.356+0000 7f936dc00640 1 --2- 172.21.15.138:0/1355712074 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f936806f880 0x7f93680ce780 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f9360009d90 tx=0x7f936001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22aa3ecda359f6c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:21.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.356+0000 7f9367400640 1 -- 172.21.15.138:0/1355712074 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93600b2070 con 0x7f936806f880 2024-04-26T20:58:21.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.356+0000 7f9367400640 1 -- 172.21.15.138:0/1355712074 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93600a5890 con 0x7f936806f880 2024-04-26T20:58:21.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.356+0000 7f9367400640 1 -- 172.21.15.138:0/1355712074 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93600a5c60 con 0x7f936806f880 2024-04-26T20:58:21.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.356+0000 7f936fc00640 1 -- 172.21.15.138:0/1355712074 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f936806f880 msgr2=0x7f93680ce780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:21.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.356+0000 7f936fc00640 1 --2- 172.21.15.138:0/1355712074 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f936806f880 0x7f93680ce780 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f9360009d90 tx=0x7f936001c8e0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.356+0000 7f936fc00640 1 -- 172.21.15.138:0/1355712074 shutdown_connections 2024-04-26T20:58:21.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.356+0000 7f936fc00640 1 --2- 172.21.15.138:0/1355712074 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f936806f880 0x7f93680ce780 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.356+0000 7f936fc00640 1 --2- 172.21.15.138:0/1355712074 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f936815bdc0 0x7f936815f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.356+0000 7f936fc00640 1 -- 172.21.15.138:0/1355712074 >> 172.21.15.138:0/1355712074 conn(0x7f93680d0bb0 msgr2=0x7f93680d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:21.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.356+0000 7f936fc00640 1 -- 172.21.15.138:0/1355712074 shutdown_connections 2024-04-26T20:58:21.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.356+0000 7f936fc00640 1 -- 172.21.15.138:0/1355712074 wait complete. 2024-04-26T20:58:21.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.356+0000 7f936fc00640 1 Processor -- start 2024-04-26T20:58:21.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.356+0000 7f936fc00640 1 -- start start 2024-04-26T20:58:21.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.360+0000 7f936fc00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f936806f880 0x7f9368157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:21.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.360+0000 7f936fc00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9368073d70 0x7f936815a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:21.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.360+0000 7f936fc00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f936815bdc0 0x7f9368164e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:21.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.360+0000 7f936fc00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f9368168cd0 con 0x7f9368073d70 2024-04-26T20:58:21.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.360+0000 7f936fc00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f9368160790 con 0x7f936815bdc0 2024-04-26T20:58:21.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.360+0000 7f936fc00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f9368168e50 con 0x7f936806f880 2024-04-26T20:58:21.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.360+0000 7f9367e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9368073d70 0x7f936815a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:21.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.360+0000 7f9367e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9368073d70 0x7f936815a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:54590/0 (socket says 172.21.15.138:54590) 2024-04-26T20:58:21.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.360+0000 7f9367e00640 1 -- 172.21.15.138:0/1932718577 learned_addr learned my addr 172.21.15.138:0/1932718577 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:21.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.360+0000 7f936d200640 1 --2- 172.21.15.138:0/1932718577 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f936806f880 0x7f9368157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:21.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.360+0000 7f936dc00640 1 --2- 172.21.15.138:0/1932718577 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f936815bdc0 0x7f9368164e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:21.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.360+0000 7f9367e00640 1 -- 172.21.15.138:0/1932718577 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f936806f880 msgr2=0x7f9368157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:21.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.360+0000 7f9367e00640 1 --2- 172.21.15.138:0/1932718577 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f936806f880 0x7f9368157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.360+0000 7f9367e00640 1 -- 172.21.15.138:0/1932718577 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f936815bdc0 msgr2=0x7f9368164e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:21.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.360+0000 7f9367e00640 1 --2- 172.21.15.138:0/1932718577 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f936815bdc0 0x7f9368164e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.360+0000 7f9367e00640 1 -- 172.21.15.138:0/1932718577 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f936815e500 con 0x7f9368073d70 2024-04-26T20:58:21.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.360+0000 7f9367e00640 1 --2- 172.21.15.138:0/1932718577 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9368073d70 0x7f936815a830 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f935400c4b0 tx=0x7f935400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:21.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.360+0000 7f9364c00640 1 -- 172.21.15.138:0/1932718577 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9354018070 con 0x7f9368073d70 2024-04-26T20:58:21.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.360+0000 7f9364c00640 1 -- 172.21.15.138:0/1932718577 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9354007500 con 0x7f9368073d70 2024-04-26T20:58:21.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.360+0000 7f936fc00640 1 -- 172.21.15.138:0/1932718577 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f936815d460 con 0x7f9368073d70 2024-04-26T20:58:21.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.360+0000 7f9364c00640 1 -- 172.21.15.138:0/1932718577 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9354004a30 con 0x7f9368073d70 2024-04-26T20:58:21.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.360+0000 7f936fc00640 1 -- 172.21.15.138:0/1932718577 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f936815da20 con 0x7f9368073d70 2024-04-26T20:58:21.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.360+0000 7f936fc00640 1 -- 172.21.15.138:0/1932718577 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9368069430 con 0x7f9368073d70 2024-04-26T20:58:21.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.360+0000 7f9364c00640 1 -- 172.21.15.138:0/1932718577 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f935401b070 con 0x7f9368073d70 2024-04-26T20:58:21.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.364+0000 7f9364c00640 1 --2- 172.21.15.138:0/1932718577 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f93480683b0 0x7f934806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:21.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.364+0000 7f9364c00640 1 -- 172.21.15.138:0/1932718577 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6756+0+0 (secure 0 0 0) 0x7f9354086060 con 0x7f9368073d70 2024-04-26T20:58:21.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.364+0000 7f936d200640 1 --2- 172.21.15.138:0/1932718577 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f93480683b0 0x7f934806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:21.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.364+0000 7f936d200640 1 --2- 172.21.15.138:0/1932718577 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f93480683b0 0x7f934806a870 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f935c009ac0 tx=0x7f935c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:21.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.368+0000 7f9364c00640 1 -- 172.21.15.138:0/1932718577 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9354055bd0 con 0x7f9368073d70 2024-04-26T20:58:21.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.556+0000 7f936fc00640 1 -- 172.21.15.138:0/1932718577 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "recovery_fs", "var": "joinable", "val": "true"} v 0) -- 0x7f93680d19c0 con 0x7f9368073d70 2024-04-26T20:58:21.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.720+0000 7f9364c00640 1 -- 172.21.15.138:0/1932718577 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "recovery_fs", "var": "joinable", "val": "true"}]=0 recovery_fs marked joinable; MDS may join as newly active. v24) ==== 172+0+0 (secure 0 0 0) 0x7f9354059ed0 con 0x7f9368073d70 2024-04-26T20:58:21.720 INFO:teuthology.orchestra.run.smithi138.stderr:recovery_fs marked joinable; MDS may join as newly active. 2024-04-26T20:58:21.721 INFO:tasks.ceph.mon.a.smithi138.stderr:2024-04-26T20:58:21.720+0000 7f20db200640 -1 log_channel(cluster) log [ERR] : Health check update: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T20:58:21.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.720+0000 7f936fc00640 1 -- 172.21.15.138:0/1932718577 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f93480683b0 msgr2=0x7f934806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:21.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.720+0000 7f936fc00640 1 --2- 172.21.15.138:0/1932718577 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f93480683b0 0x7f934806a870 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f935c009ac0 tx=0x7f935c009190 comp rx=0 tx=0).stop 2024-04-26T20:58:21.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.720+0000 7f936fc00640 1 -- 172.21.15.138:0/1932718577 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9368073d70 msgr2=0x7f936815a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:21.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.720+0000 7f936fc00640 1 --2- 172.21.15.138:0/1932718577 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9368073d70 0x7f936815a830 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f935400c4b0 tx=0x7f935400c970 comp rx=0 tx=0).stop 2024-04-26T20:58:21.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.720+0000 7f936fc00640 1 -- 172.21.15.138:0/1932718577 shutdown_connections 2024-04-26T20:58:21.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.720+0000 7f936fc00640 1 --2- 172.21.15.138:0/1932718577 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f93480683b0 0x7f934806a870 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.720+0000 7f936fc00640 1 --2- 172.21.15.138:0/1932718577 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f936815bdc0 0x7f9368164e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.720+0000 7f936fc00640 1 --2- 172.21.15.138:0/1932718577 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9368073d70 0x7f936815a830 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.720+0000 7f936fc00640 1 --2- 172.21.15.138:0/1932718577 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f936806f880 0x7f9368157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.720+0000 7f936fc00640 1 -- 172.21.15.138:0/1932718577 >> 172.21.15.138:0/1932718577 conn(0x7f93680d0bb0 msgr2=0x7f93680ca750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:21.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.720+0000 7f936fc00640 1 -- 172.21.15.138:0/1932718577 shutdown_connections 2024-04-26T20:58:21.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.720+0000 7f936fc00640 1 -- 172.21.15.138:0/1932718577 wait complete. 2024-04-26T20:58:21.729 INFO:tasks.ceph.mds.a.smithi138.stderr:2024-04-26T20:58:21.728+0000 7f143cc00640 -1 mds.0.openfiles _load_finish got (2) No such file or directory 2024-04-26T20:58:21.745 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:58:21.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.880+0000 7f9cd5600640 1 Processor -- start 2024-04-26T20:58:21.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.880+0000 7f9cd5600640 1 -- start start 2024-04-26T20:58:21.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.880+0000 7f9cd5600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9cd00c7fd0 0x7f9cd0073450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:21.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.880+0000 7f9cd5600640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cd00ce300 con 0x7f9cd0145820 2024-04-26T20:58:21.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.880+0000 7f9cd5600640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cd00c6b00 con 0x7f9cd0072ff0 2024-04-26T20:58:21.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.880+0000 7f9cd5600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f9cd0073990 con 0x7f9cd00c7fd0 2024-04-26T20:58:21.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.880+0000 7f9ccea00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f9cd0145820 0x7f9cd006f030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:32836/0 (socket says 172.21.15.138:32836) 2024-04-26T20:58:21.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.880+0000 7f9ccea00640 1 -- 172.21.15.138:0/3360129145 learned_addr learned my addr 172.21.15.138:0/3360129145 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:21.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.880+0000 7f9ccf400640 1 --2- 172.21.15.138:0/3360129145 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9cd00c7fd0 0x7f9cd0073450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:21.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.880+0000 7f9ccd600640 1 -- 172.21.15.138:0/3360129145 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2762211767 0 0) 0x7f9cd00ce300 con 0x7f9cd0145820 2024-04-26T20:58:21.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.880+0000 7f9ccd600640 1 -- 172.21.15.138:0/3360129145 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9cb4003530 con 0x7f9cd0145820 2024-04-26T20:58:21.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.880+0000 7f9ccd600640 1 -- 172.21.15.138:0/3360129145 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2236539571 0 0) 0x7f9cd00c6b00 con 0x7f9cd0072ff0 2024-04-26T20:58:21.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.880+0000 7f9ccf400640 1 -- 172.21.15.138:0/3360129145 >> v1:172.21.15.143:6789/0 conn(0x7f9cd0072ff0 legacy=0x7f9cd00c78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:21.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.880+0000 7f9ccf400640 1 -- 172.21.15.138:0/3360129145 >> v1:172.21.15.138:6789/0 conn(0x7f9cd0145820 legacy=0x7f9cd006f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:21.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.880+0000 7f9ccf400640 1 -- 172.21.15.138:0/3360129145 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cd00c6de0 con 0x7f9cd00c7fd0 2024-04-26T20:58:21.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.884+0000 7f9ccf400640 1 --2- 172.21.15.138:0/3360129145 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9cd00c7fd0 0x7f9cd0073450 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8009dc0 tx=0x7f9cc801f170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fdf02f174fa294e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:21.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.884+0000 7f9ccd600640 1 -- 172.21.15.138:0/3360129145 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc80b4070 con 0x7f9cd00c7fd0 2024-04-26T20:58:21.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.884+0000 7f9ccd600640 1 -- 172.21.15.138:0/3360129145 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cc80af600 con 0x7f9cd00c7fd0 2024-04-26T20:58:21.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.884+0000 7f9ccd600640 1 -- 172.21.15.138:0/3360129145 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc80af9d0 con 0x7f9cd00c7fd0 2024-04-26T20:58:21.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.884+0000 7f9cd5600640 1 -- 172.21.15.138:0/3360129145 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9cd00c7fd0 msgr2=0x7f9cd0073450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:21.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.884+0000 7f9cd5600640 1 --2- 172.21.15.138:0/3360129145 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9cd00c7fd0 0x7f9cd0073450 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8009dc0 tx=0x7f9cc801f170 comp rx=0 tx=0).stop 2024-04-26T20:58:21.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.884+0000 7f9cd5600640 1 -- 172.21.15.138:0/3360129145 shutdown_connections 2024-04-26T20:58:21.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.884+0000 7f9cd5600640 1 --2- 172.21.15.138:0/3360129145 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9cd00c7fd0 0x7f9cd0073450 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.884+0000 7f9cd5600640 1 -- 172.21.15.138:0/3360129145 >> 172.21.15.138:0/3360129145 conn(0x7f9cd00d1c60 msgr2=0x7f9cd00d2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:21.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.884+0000 7f9cd5600640 1 -- 172.21.15.138:0/3360129145 shutdown_connections 2024-04-26T20:58:21.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.884+0000 7f9cd5600640 1 -- 172.21.15.138:0/3360129145 wait complete. 2024-04-26T20:58:21.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.888+0000 7f9cd5600640 1 Processor -- start 2024-04-26T20:58:21.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.888+0000 7f9cd5600640 1 -- start start 2024-04-26T20:58:21.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.888+0000 7f9cd5600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9cd0072ff0 0x7f9cd015af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:21.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.888+0000 7f9cd5600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9cd00c7fd0 0x7f9cd01f4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:21.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.888+0000 7f9cd5600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9cd0145820 0x7f9cd01f8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:21.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.888+0000 7f9cd5600640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd006f740 con 0x7f9cd0072ff0 2024-04-26T20:58:21.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.888+0000 7f9cd5600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd00c7430 con 0x7f9cd0145820 2024-04-26T20:58:21.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.888+0000 7f9cd5600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f9cd00cd5d0 con 0x7f9cd00c7fd0 2024-04-26T20:58:21.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.888+0000 7f9ccea00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9cd0072ff0 0x7f9cd015af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:21.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.888+0000 7f9ccea00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9cd0072ff0 0x7f9cd015af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:54606/0 (socket says 172.21.15.138:54606) 2024-04-26T20:58:21.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.888+0000 7f9ccea00640 1 -- 172.21.15.138:0/2485460338 learned_addr learned my addr 172.21.15.138:0/2485460338 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:21.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.888+0000 7f9cce000640 1 --2- 172.21.15.138:0/2485460338 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9cd00c7fd0 0x7f9cd01f4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:21.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.888+0000 7f9ccf400640 1 --2- 172.21.15.138:0/2485460338 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9cd0145820 0x7f9cd01f8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:21.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.888+0000 7f9ccea00640 1 -- 172.21.15.138:0/2485460338 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9cd00c7fd0 msgr2=0x7f9cd01f4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:21.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.888+0000 7f9ccea00640 1 --2- 172.21.15.138:0/2485460338 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9cd00c7fd0 0x7f9cd01f4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.888+0000 7f9ccea00640 1 -- 172.21.15.138:0/2485460338 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9cd0145820 msgr2=0x7f9cd01f8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:21.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.888+0000 7f9ccea00640 1 --2- 172.21.15.138:0/2485460338 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9cd0145820 0x7f9cd01f8d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:21.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.888+0000 7f9ccea00640 1 -- 172.21.15.138:0/2485460338 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cd015b470 con 0x7f9cd0072ff0 2024-04-26T20:58:21.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.888+0000 7f9ccea00640 1 --2- 172.21.15.138:0/2485460338 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9cd0072ff0 0x7f9cd015af30 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f9cb800c3c0 tx=0x7f9cb800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:21.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.888+0000 7f9cc6a00640 1 -- 172.21.15.138:0/2485460338 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb8017070 con 0x7f9cd0072ff0 2024-04-26T20:58:21.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.888+0000 7f9cc6a00640 1 -- 172.21.15.138:0/2485460338 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cb8005cf0 con 0x7f9cd0072ff0 2024-04-26T20:58:21.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.888+0000 7f9cd5600640 1 -- 172.21.15.138:0/2485460338 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cd01f57a0 con 0x7f9cd0072ff0 2024-04-26T20:58:21.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.888+0000 7f9cc6a00640 1 -- 172.21.15.138:0/2485460338 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb80072f0 con 0x7f9cd0072ff0 2024-04-26T20:58:21.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.888+0000 7f9cd5600640 1 -- 172.21.15.138:0/2485460338 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cd01f5d60 con 0x7f9cd0072ff0 2024-04-26T20:58:21.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.892+0000 7f9cd5600640 1 -- 172.21.15.138:0/2485460338 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cd0069510 con 0x7f9cd0072ff0 2024-04-26T20:58:21.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.892+0000 7f9cc6a00640 1 -- 172.21.15.138:0/2485460338 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9cb801a070 con 0x7f9cd0072ff0 2024-04-26T20:58:21.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.892+0000 7f9cc6a00640 1 --2- 172.21.15.138:0/2485460338 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9cac068380 0x7f9cac06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:21.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.892+0000 7f9cc6a00640 1 -- 172.21.15.138:0/2485460338 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6756+0+0 (secure 0 0 0) 0x7f9cb8086160 con 0x7f9cd0072ff0 2024-04-26T20:58:21.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.892+0000 7f9cce000640 1 --2- 172.21.15.138:0/2485460338 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9cac068380 0x7f9cac06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:21.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.892+0000 7f9cce000640 1 --2- 172.21.15.138:0/2485460338 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9cac068380 0x7f9cac06a840 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9cd00c89c0 tx=0x7f9cc0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:21.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:21.896+0000 7f9cc6a00640 1 -- 172.21.15.138:0/2485460338 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9cb8056390 con 0x7f9cd0072ff0 2024-04-26T20:58:22.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:22.084+0000 7f9cd5600640 1 -- 172.21.15.138:0/2485460338 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9cd00cd9b0 con 0x7f9cd0072ff0 2024-04-26T20:58:22.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:22.088+0000 7f9cc6a00640 1 -- 172.21.15.138:0/2485460338 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+6482 (secure 0 0 0) 0x7f9cb8055c90 con 0x7f9cd0072ff0 2024-04-26T20:58:22.087 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:22.088 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":25,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5048,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/255610168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":255610168},{"type":"v1","addr":"172.21.15.143:6836","nonce":255610168}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5051,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/799063831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":799063831},{"type":"v1","addr":"172.21.15.143:6837","nonce":799063831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5410,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/976248149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":976248149},{"type":"v1","addr":"172.21.15.138:6835","nonce":976248149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:57:51.937789+0000","modified":"2024-04-26T20:58:07.183899+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":42,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2},{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:58:10.360154+0000","modified":"2024-04-26T20:58:21.722847+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5604":{"gid":5604,"name":"a","rank":0,"incarnation":25,"state":"up:replay","state_seq":1,"addr":"172.21.15.138:6834/2450256246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2450256246},{"type":"v1","addr":"172.21.15.138:6834","nonce":2450256246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":7,"enabled":true,"fs_name":"recovery_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":3}]} 2024-04-26T20:58:22.088 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 25 2024-04-26T20:58:22.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:22.088+0000 7f9cd5600640 1 -- 172.21.15.138:0/2485460338 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9cac068380 msgr2=0x7f9cac06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:22.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:22.088+0000 7f9cd5600640 1 --2- 172.21.15.138:0/2485460338 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9cac068380 0x7f9cac06a840 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9cd00c89c0 tx=0x7f9cc0009040 comp rx=0 tx=0).stop 2024-04-26T20:58:22.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:22.088+0000 7f9cd5600640 1 -- 172.21.15.138:0/2485460338 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9cd0072ff0 msgr2=0x7f9cd015af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:22.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:22.088+0000 7f9cd5600640 1 --2- 172.21.15.138:0/2485460338 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9cd0072ff0 0x7f9cd015af30 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f9cb800c3c0 tx=0x7f9cb800c880 comp rx=0 tx=0).stop 2024-04-26T20:58:22.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:22.088+0000 7f9cd5600640 1 -- 172.21.15.138:0/2485460338 shutdown_connections 2024-04-26T20:58:22.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:22.088+0000 7f9cd5600640 1 --2- 172.21.15.138:0/2485460338 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9cac068380 0x7f9cac06a840 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:22.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:22.088+0000 7f9cd5600640 1 --2- 172.21.15.138:0/2485460338 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9cd0145820 0x7f9cd01f8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:22.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:22.088+0000 7f9cd5600640 1 --2- 172.21.15.138:0/2485460338 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9cd00c7fd0 0x7f9cd01f4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:22.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:22.088+0000 7f9cd5600640 1 --2- 172.21.15.138:0/2485460338 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9cd0072ff0 0x7f9cd015af30 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:22.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:22.088+0000 7f9cd5600640 1 -- 172.21.15.138:0/2485460338 >> 172.21.15.138:0/2485460338 conn(0x7f9cd00d1c60 msgr2=0x7f9cd0142480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:22.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:22.088+0000 7f9cd5600640 1 -- 172.21.15.138:0/2485460338 shutdown_connections 2024-04-26T20:58:22.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:22.088+0000 7f9cd5600640 1 -- 172.21.15.138:0/2485460338 wait complete. 2024-04-26T20:58:22.511 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T20:58:10.360154+0000', 'modified': '2024-04-26T20:58:21.722847+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5604}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5604': {'gid': 5604, 'name': 'a', 'rank': 0, 'incarnation': 25, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.138:6834/2450256246', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6832', 'nonce': 2450256246}, {'type': 'v1', 'addr': '172.21.15.138:6834', 'nonce': 2450256246}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'recovery_fs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-26T20:58:22.511 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5604:up:replay 2024-04-26T20:58:23.512 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:58:23.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.660+0000 7fb8e1000640 1 Processor -- start 2024-04-26T20:58:23.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.660+0000 7fb8e1000640 1 -- start start 2024-04-26T20:58:23.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.660+0000 7fb8e1000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb8dc0cfd10 0x7fb8dc0cdd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:23.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.660+0000 7fb8e1000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb8dc15f510 0x7fb8dc0ce2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:23.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.660+0000 7fb8e1000640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8dc0d2180 con 0x7fb8dc15f130 2024-04-26T20:58:23.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.660+0000 7fb8e1000640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fb8dc0cd570 con 0x7fb8dc0cfd10 2024-04-26T20:58:23.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.660+0000 7fb8e1000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb8dc0cd850 con 0x7fb8dc15f510 2024-04-26T20:58:23.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.660+0000 7fb8d9e00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fb8dc15f130 0x7fb8dc0cf600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:32824/0 (socket says 172.21.15.138:32824) 2024-04-26T20:58:23.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.660+0000 7fb8d9e00640 1 -- 172.21.15.138:0/3849903288 learned_addr learned my addr 172.21.15.138:0/3849903288 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:23.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.660+0000 7fb8d9400640 1 --2- 172.21.15.138:0/3849903288 >> v2:172.21.15.138:3300/0 conn(0x7fb8dc0cfd10 0x7fb8dc0cdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:23.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.660+0000 7fb8da800640 1 --2- 172.21.15.138:0/3849903288 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb8dc15f510 0x7fb8dc0ce2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:23.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.660+0000 7fb8d8a00640 1 -- 172.21.15.138:0/3849903288 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3885231099 0 0) 0x7fb8dc0d2180 con 0x7fb8dc15f130 2024-04-26T20:58:23.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.660+0000 7fb8d8a00640 1 -- 172.21.15.138:0/3849903288 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8c0003530 con 0x7fb8dc15f130 2024-04-26T20:58:23.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.660+0000 7fb8d9400640 1 -- 172.21.15.138:0/3849903288 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb8dc15f510 msgr2=0x7fb8dc0ce2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:23.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.660+0000 7fb8d9400640 1 --2- 172.21.15.138:0/3849903288 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb8dc15f510 0x7fb8dc0ce2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:23.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.660+0000 7fb8d9400640 1 -- 172.21.15.138:0/3849903288 >> v1:172.21.15.138:6789/0 conn(0x7fb8dc15f130 legacy=0x7fb8dc0cf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:23.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.660+0000 7fb8d9400640 1 -- 172.21.15.138:0/3849903288 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8dc06e730 con 0x7fb8dc0cfd10 2024-04-26T20:58:23.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.660+0000 7fb8da800640 1 --2- 172.21.15.138:0/3849903288 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb8dc15f510 0x7fb8dc0ce2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:58:23.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.664+0000 7fb8d9400640 1 --2- 172.21.15.138:0/3849903288 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8dc0cfd10 0x7fb8dc0cdd70 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc0097c0 tx=0x7fb8cc01ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9158f024069a370a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:23.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.664+0000 7fb8d8a00640 1 -- 172.21.15.138:0/3849903288 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc0b5070 con 0x7fb8dc0cfd10 2024-04-26T20:58:23.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.664+0000 7fb8d8a00640 1 -- 172.21.15.138:0/3849903288 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8cc0a8990 con 0x7fb8dc0cfd10 2024-04-26T20:58:23.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.664+0000 7fb8d8a00640 1 -- 172.21.15.138:0/3849903288 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc0a8d60 con 0x7fb8dc0cfd10 2024-04-26T20:58:23.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.664+0000 7fb8e1000640 1 -- 172.21.15.138:0/3849903288 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8dc0cfd10 msgr2=0x7fb8dc0cdd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:23.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.664+0000 7fb8e1000640 1 --2- 172.21.15.138:0/3849903288 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8dc0cfd10 0x7fb8dc0cdd70 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc0097c0 tx=0x7fb8cc01ec90 comp rx=0 tx=0).stop 2024-04-26T20:58:23.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.664+0000 7fb8e1000640 1 -- 172.21.15.138:0/3849903288 shutdown_connections 2024-04-26T20:58:23.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.664+0000 7fb8e1000640 1 --2- 172.21.15.138:0/3849903288 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb8dc15f510 0x7fb8dc0ce2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:23.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.664+0000 7fb8e1000640 1 --2- 172.21.15.138:0/3849903288 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8dc0cfd10 0x7fb8dc0cdd70 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:23.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.664+0000 7fb8e1000640 1 -- 172.21.15.138:0/3849903288 >> 172.21.15.138:0/3849903288 conn(0x7fb8dc0d2d80 msgr2=0x7fb8dc0d3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:23.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.664+0000 7fb8e1000640 1 -- 172.21.15.138:0/3849903288 shutdown_connections 2024-04-26T20:58:23.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.664+0000 7fb8e1000640 1 -- 172.21.15.138:0/3849903288 wait complete. 2024-04-26T20:58:23.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.664+0000 7fb8e1000640 1 Processor -- start 2024-04-26T20:58:23.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.664+0000 7fb8e1000640 1 -- start start 2024-04-26T20:58:23.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.668+0000 7fb8e1000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb8dc0cfd10 0x7fb8dc161f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:23.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.668+0000 7fb8e1000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8dc15f130 0x7fb8dc14b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:23.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.668+0000 7fb8e1000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb8dc15f510 0x7fb8dc0c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:23.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.668+0000 7fb8e1000640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fb8dc0d0670 con 0x7fb8dc15f130 2024-04-26T20:58:23.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.668+0000 7fb8e1000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fb8dc0d04f0 con 0x7fb8dc15f510 2024-04-26T20:58:23.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.668+0000 7fb8e1000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb8dc0d3870 con 0x7fb8dc0cfd10 2024-04-26T20:58:23.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.668+0000 7fb8d9400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8dc15f130 0x7fb8dc14b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:23.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.668+0000 7fb8d9400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8dc15f130 0x7fb8dc14b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40088/0 (socket says 172.21.15.138:40088) 2024-04-26T20:58:23.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.668+0000 7fb8d9400640 1 -- 172.21.15.138:0/2227583197 learned_addr learned my addr 172.21.15.138:0/2227583197 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:23.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.668+0000 7fb8d9e00640 1 --2- 172.21.15.138:0/2227583197 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb8dc0cfd10 0x7fb8dc161f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:23.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.668+0000 7fb8d9400640 1 -- 172.21.15.138:0/2227583197 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb8dc0cfd10 msgr2=0x7fb8dc161f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:23.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.668+0000 7fb8da800640 1 --2- 172.21.15.138:0/2227583197 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb8dc15f510 0x7fb8dc0c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:23.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.668+0000 7fb8d9400640 1 --2- 172.21.15.138:0/2227583197 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb8dc0cfd10 0x7fb8dc161f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:23.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.668+0000 7fb8d9400640 1 -- 172.21.15.138:0/2227583197 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb8dc15f510 msgr2=0x7fb8dc0c8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:23.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.668+0000 7fb8d9400640 1 --2- 172.21.15.138:0/2227583197 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb8dc15f510 0x7fb8dc0c8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:23.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.668+0000 7fb8d9400640 1 -- 172.21.15.138:0/2227583197 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8dc0c9fd0 con 0x7fb8dc15f130 2024-04-26T20:58:23.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.668+0000 7fb8d9e00640 1 --2- 172.21.15.138:0/2227583197 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb8dc0cfd10 0x7fb8dc161f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:58:23.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.668+0000 7fb8da800640 1 --2- 172.21.15.138:0/2227583197 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb8dc15f510 0x7fb8dc0c8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:58:23.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.668+0000 7fb8d9400640 1 --2- 172.21.15.138:0/2227583197 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8dc15f130 0x7fb8dc14b060 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc01c8c0 tx=0x7fb8cc01ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:23.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.668+0000 7fb8d2000640 1 -- 172.21.15.138:0/2227583197 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc0bf070 con 0x7fb8dc15f130 2024-04-26T20:58:23.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.668+0000 7fb8d2000640 1 -- 172.21.15.138:0/2227583197 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8cc0b07a0 con 0x7fb8dc15f130 2024-04-26T20:58:23.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.668+0000 7fb8e1000640 1 -- 172.21.15.138:0/2227583197 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8dc162790 con 0x7fb8dc15f130 2024-04-26T20:58:23.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.668+0000 7fb8d2000640 1 -- 172.21.15.138:0/2227583197 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc0b5040 con 0x7fb8dc15f130 2024-04-26T20:58:23.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.668+0000 7fb8e1000640 1 -- 172.21.15.138:0/2227583197 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8dc0ca570 con 0x7fb8dc15f130 2024-04-26T20:58:23.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.668+0000 7fb8e1000640 1 -- 172.21.15.138:0/2227583197 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8dc069510 con 0x7fb8dc15f130 2024-04-26T20:58:23.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.672+0000 7fb8d2000640 1 -- 172.21.15.138:0/2227583197 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb8cc0c2070 con 0x7fb8dc15f130 2024-04-26T20:58:23.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.672+0000 7fb8d2000640 1 --2- 172.21.15.138:0/2227583197 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb8b8068380 0x7fb8b806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:23.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.672+0000 7fb8d2000640 1 -- 172.21.15.138:0/2227583197 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6756+0+0 (secure 0 0 0) 0x7fb8cc123550 con 0x7fb8dc15f130 2024-04-26T20:58:23.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.672+0000 7fb8d9e00640 1 --2- 172.21.15.138:0/2227583197 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb8b8068380 0x7fb8b806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:23.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.672+0000 7fb8d9e00640 1 --2- 172.21.15.138:0/2227583197 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb8b8068380 0x7fb8b806a840 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4005890 tx=0x7fb8c4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:23.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.676+0000 7fb8d2000640 1 -- 172.21.15.138:0/2227583197 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb8cc0187f0 con 0x7fb8dc15f130 2024-04-26T20:58:23.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.864+0000 7fb8e1000640 1 -- 172.21.15.138:0/2227583197 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb8dc069bd0 con 0x7fb8dc15f130 2024-04-26T20:58:23.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.864+0000 7fb8d2000640 1 -- 172.21.15.138:0/2227583197 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+6482 (secure 0 0 0) 0x7fb8cc0f3720 con 0x7fb8dc15f130 2024-04-26T20:58:23.866 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:23.866 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":27,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5048,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/255610168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":255610168},{"type":"v1","addr":"172.21.15.143:6836","nonce":255610168}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5051,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/799063831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":799063831},{"type":"v1","addr":"172.21.15.143:6837","nonce":799063831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5410,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/976248149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":976248149},{"type":"v1","addr":"172.21.15.138:6835","nonce":976248149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:57:51.937789+0000","modified":"2024-04-26T20:58:07.183899+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":42,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2},{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:58:10.360154+0000","modified":"2024-04-26T20:58:22.732107+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5604":{"gid":5604,"name":"a","rank":0,"incarnation":25,"state":"up:rejoin","state_seq":6,"addr":"172.21.15.138:6834/2450256246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2450256246},{"type":"v1","addr":"172.21.15.138:6834","nonce":2450256246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":7,"enabled":true,"fs_name":"recovery_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":3}]} 2024-04-26T20:58:23.866 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 27 2024-04-26T20:58:23.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.868+0000 7fb8e1000640 1 -- 172.21.15.138:0/2227583197 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb8b8068380 msgr2=0x7fb8b806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:23.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.868+0000 7fb8e1000640 1 --2- 172.21.15.138:0/2227583197 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb8b8068380 0x7fb8b806a840 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4005890 tx=0x7fb8c4009040 comp rx=0 tx=0).stop 2024-04-26T20:58:23.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.868+0000 7fb8e1000640 1 -- 172.21.15.138:0/2227583197 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8dc15f130 msgr2=0x7fb8dc14b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:23.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.868+0000 7fb8e1000640 1 --2- 172.21.15.138:0/2227583197 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8dc15f130 0x7fb8dc14b060 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc01c8c0 tx=0x7fb8cc01ba30 comp rx=0 tx=0).stop 2024-04-26T20:58:23.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.868+0000 7fb8e1000640 1 -- 172.21.15.138:0/2227583197 shutdown_connections 2024-04-26T20:58:23.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.868+0000 7fb8e1000640 1 --2- 172.21.15.138:0/2227583197 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb8b8068380 0x7fb8b806a840 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:23.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.868+0000 7fb8e1000640 1 --2- 172.21.15.138:0/2227583197 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb8dc15f510 0x7fb8dc0c8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:23.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.868+0000 7fb8e1000640 1 --2- 172.21.15.138:0/2227583197 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8dc15f130 0x7fb8dc14b060 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:23.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.868+0000 7fb8e1000640 1 --2- 172.21.15.138:0/2227583197 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb8dc0cfd10 0x7fb8dc161f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:23.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.868+0000 7fb8e1000640 1 -- 172.21.15.138:0/2227583197 >> 172.21.15.138:0/2227583197 conn(0x7fb8dc0d2d80 msgr2=0x7fb8dc071890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:23.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.868+0000 7fb8e1000640 1 -- 172.21.15.138:0/2227583197 shutdown_connections 2024-04-26T20:58:23.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:23.868+0000 7fb8e1000640 1 -- 172.21.15.138:0/2227583197 wait complete. 2024-04-26T20:58:24.290 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T20:58:10.360154+0000', 'modified': '2024-04-26T20:58:22.732107+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5604}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5604': {'gid': 5604, 'name': 'a', 'rank': 0, 'incarnation': 25, 'state': 'up:rejoin', 'state_seq': 6, 'addr': '172.21.15.138:6834/2450256246', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6832', 'nonce': 2450256246}, {'type': 'v1', 'addr': '172.21.15.138:6834', 'nonce': 2450256246}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'recovery_fs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-26T20:58:24.290 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5604:up:rejoin 2024-04-26T20:58:25.291 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:58:25.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.436+0000 7ff14d200640 1 Processor -- start 2024-04-26T20:58:25.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.436+0000 7ff14d200640 1 -- start start 2024-04-26T20:58:25.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.436+0000 7ff14d200640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff1480cbe00 0x7ff14806de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:25.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.436+0000 7ff14d200640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1480727f0 con 0x7ff14815cf80 2024-04-26T20:58:25.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.436+0000 7ff14d200640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff148072a70 con 0x7ff1480cc1e0 2024-04-26T20:58:25.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.436+0000 7ff14d200640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7ff148074220 con 0x7ff1480cbe00 2024-04-26T20:58:25.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.440+0000 7ff145e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff1480cbe00 0x7ff14806de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:25.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.440+0000 7ff146800640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7ff14815cf80 0x7ff1480ce6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:32838/0 (socket says 172.21.15.138:32838) 2024-04-26T20:58:25.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.440+0000 7ff146800640 1 -- 172.21.15.138:0/1198110273 learned_addr learned my addr 172.21.15.138:0/1198110273 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:25.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.440+0000 7ff145e00640 1 -- 172.21.15.138:0/1198110273 >> v1:172.21.15.143:6789/0 conn(0x7ff1480cc1e0 legacy=0x7ff148073b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:25.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.440+0000 7ff145e00640 1 -- 172.21.15.138:0/1198110273 >> v1:172.21.15.138:6789/0 conn(0x7ff14815cf80 legacy=0x7ff1480ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:25.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.440+0000 7ff145e00640 1 -- 172.21.15.138:0/1198110273 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff148072d50 con 0x7ff1480cbe00 2024-04-26T20:58:25.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.440+0000 7ff145400640 1 -- 172.21.15.138:0/1198110273 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1164095432 0 0) 0x7ff140001120 con 0x7ff14815cf80 2024-04-26T20:58:25.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.440+0000 7ff145e00640 1 --2- 172.21.15.138:0/1198110273 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1480cbe00 0x7ff14806de70 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7ff138009d90 tx=0x7ff13801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22352bf818df4413 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:25.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.440+0000 7ff145400640 1 -- 172.21.15.138:0/1198110273 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1380b2070 con 0x7ff1480cbe00 2024-04-26T20:58:25.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.440+0000 7ff145400640 1 -- 172.21.15.138:0/1198110273 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1380a5940 con 0x7ff1480cbe00 2024-04-26T20:58:25.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.440+0000 7ff145400640 1 -- 172.21.15.138:0/1198110273 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1380a5d10 con 0x7ff1480cbe00 2024-04-26T20:58:25.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.444+0000 7ff14d200640 1 -- 172.21.15.138:0/1198110273 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1480cbe00 msgr2=0x7ff14806de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:25.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.444+0000 7ff14d200640 1 --2- 172.21.15.138:0/1198110273 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1480cbe00 0x7ff14806de70 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7ff138009d90 tx=0x7ff13801c970 comp rx=0 tx=0).stop 2024-04-26T20:58:25.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.444+0000 7ff14d200640 1 -- 172.21.15.138:0/1198110273 shutdown_connections 2024-04-26T20:58:25.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.444+0000 7ff14d200640 1 --2- 172.21.15.138:0/1198110273 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1480cbe00 0x7ff14806de70 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:25.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.444+0000 7ff14d200640 1 -- 172.21.15.138:0/1198110273 >> 172.21.15.138:0/1198110273 conn(0x7ff1480d0b20 msgr2=0x7ff1480d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:25.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.444+0000 7ff14d200640 1 -- 172.21.15.138:0/1198110273 shutdown_connections 2024-04-26T20:58:25.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.444+0000 7ff14d200640 1 -- 172.21.15.138:0/1198110273 wait complete. 2024-04-26T20:58:25.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.444+0000 7ff14d200640 1 Processor -- start 2024-04-26T20:58:25.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.444+0000 7ff14d200640 1 -- start start 2024-04-26T20:58:25.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.444+0000 7ff14d200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff1480cbe00 0x7ff1480c7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:25.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.444+0000 7ff14d200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff1480cc1e0 0x7ff148159660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:25.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.444+0000 7ff14d200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff14815cf80 0x7ff148159ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:25.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.444+0000 7ff14d200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff1480d0780 con 0x7ff14815cf80 2024-04-26T20:58:25.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.444+0000 7ff14d200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ff148073680 con 0x7ff1480cc1e0 2024-04-26T20:58:25.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.444+0000 7ff14d200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ff1480d0900 con 0x7ff1480cbe00 2024-04-26T20:58:25.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.444+0000 7ff146800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff14815cf80 0x7ff148159ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:25.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.444+0000 7ff145e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff1480cbe00 0x7ff1480c7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:25.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.444+0000 7ff146800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff14815cf80 0x7ff148159ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40104/0 (socket says 172.21.15.138:40104) 2024-04-26T20:58:25.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.444+0000 7ff146800640 1 -- 172.21.15.138:0/3363189102 learned_addr learned my addr 172.21.15.138:0/3363189102 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:25.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.444+0000 7ff13d400640 1 --2- 172.21.15.138:0/3363189102 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff1480cc1e0 0x7ff148159660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:25.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.444+0000 7ff146800640 1 -- 172.21.15.138:0/3363189102 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff1480cbe00 msgr2=0x7ff1480c7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:25.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.444+0000 7ff146800640 1 --2- 172.21.15.138:0/3363189102 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff1480cbe00 0x7ff1480c7bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:25.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.444+0000 7ff146800640 1 -- 172.21.15.138:0/3363189102 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff1480cc1e0 msgr2=0x7ff148159660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:25.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.444+0000 7ff146800640 1 --2- 172.21.15.138:0/3363189102 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff1480cc1e0 0x7ff148159660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:25.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.444+0000 7ff146800640 1 -- 172.21.15.138:0/3363189102 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff14815a1d0 con 0x7ff14815cf80 2024-04-26T20:58:25.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.448+0000 7ff146800640 1 --2- 172.21.15.138:0/3363189102 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff14815cf80 0x7ff148159ba0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7ff14000c780 tx=0x7ff14000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:25.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.448+0000 7ff13ea00640 1 -- 172.21.15.138:0/3363189102 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff140018070 con 0x7ff14815cf80 2024-04-26T20:58:25.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.448+0000 7ff13ea00640 1 -- 172.21.15.138:0/3363189102 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1400070d0 con 0x7ff14815cf80 2024-04-26T20:58:25.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.448+0000 7ff13ea00640 1 -- 172.21.15.138:0/3363189102 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1400074c0 con 0x7ff14815cf80 2024-04-26T20:58:25.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.448+0000 7ff14d200640 1 -- 172.21.15.138:0/3363189102 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff14815a4b0 con 0x7ff14815cf80 2024-04-26T20:58:25.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.448+0000 7ff14d200640 1 -- 172.21.15.138:0/3363189102 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff14806f2e0 con 0x7ff14815cf80 2024-04-26T20:58:25.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.448+0000 7ff14d200640 1 -- 172.21.15.138:0/3363189102 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff148069510 con 0x7ff14815cf80 2024-04-26T20:58:25.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.448+0000 7ff13ea00640 1 -- 172.21.15.138:0/3363189102 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff1400047f0 con 0x7ff14815cf80 2024-04-26T20:58:25.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.448+0000 7ff13ea00640 1 --2- 172.21.15.138:0/3363189102 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff124068380 0x7ff12406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:25.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.448+0000 7ff13ea00640 1 -- 172.21.15.138:0/3363189102 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6756+0+0 (secure 0 0 0) 0x7ff140085ea0 con 0x7ff14815cf80 2024-04-26T20:58:25.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.448+0000 7ff145e00640 1 --2- 172.21.15.138:0/3363189102 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff124068380 0x7ff12406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:25.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.452+0000 7ff145e00640 1 --2- 172.21.15.138:0/3363189102 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff124068380 0x7ff12406a840 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff1380af000 tx=0x7ff1380a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:25.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.456+0000 7ff13ea00640 1 -- 172.21.15.138:0/3363189102 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff1480727f0 con 0x7ff14815cf80 2024-04-26T20:58:25.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.644+0000 7ff14d200640 1 -- 172.21.15.138:0/3363189102 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff1480d1850 con 0x7ff14815cf80 2024-04-26T20:58:25.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.644+0000 7ff13ea00640 1 -- 172.21.15.138:0/3363189102 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+6489 (secure 0 0 0) 0x7ff140055a80 con 0x7ff14815cf80 2024-04-26T20:58:25.644 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:25.645 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":28,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5048,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/255610168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":255610168},{"type":"v1","addr":"172.21.15.143:6836","nonce":255610168}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5051,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/799063831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":799063831},{"type":"v1","addr":"172.21.15.143:6837","nonce":799063831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5410,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/976248149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":976248149},{"type":"v1","addr":"172.21.15.138:6835","nonce":976248149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:57:51.937789+0000","modified":"2024-04-26T20:58:07.183899+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":42,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2},{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:58:10.360154+0000","modified":"2024-04-26T20:58:24.737160+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5604":{"gid":5604,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.138:6834/2450256246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2450256246},{"type":"v1","addr":"172.21.15.138:6834","nonce":2450256246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":7,"enabled":true,"fs_name":"recovery_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5604,"qdb_cluster":[5604]},"id":3}]} 2024-04-26T20:58:25.645 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 28 2024-04-26T20:58:25.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.644+0000 7ff14d200640 1 -- 172.21.15.138:0/3363189102 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff124068380 msgr2=0x7ff12406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:25.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.644+0000 7ff14d200640 1 --2- 172.21.15.138:0/3363189102 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff124068380 0x7ff12406a840 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff1380af000 tx=0x7ff1380a7070 comp rx=0 tx=0).stop 2024-04-26T20:58:25.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.644+0000 7ff14d200640 1 -- 172.21.15.138:0/3363189102 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff14815cf80 msgr2=0x7ff148159ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:25.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.644+0000 7ff14d200640 1 --2- 172.21.15.138:0/3363189102 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff14815cf80 0x7ff148159ba0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7ff14000c780 tx=0x7ff14000cc40 comp rx=0 tx=0).stop 2024-04-26T20:58:25.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.644+0000 7ff14d200640 1 -- 172.21.15.138:0/3363189102 shutdown_connections 2024-04-26T20:58:25.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.644+0000 7ff14d200640 1 --2- 172.21.15.138:0/3363189102 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff124068380 0x7ff12406a840 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:25.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.644+0000 7ff14d200640 1 --2- 172.21.15.138:0/3363189102 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff14815cf80 0x7ff148159ba0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:25.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.644+0000 7ff14d200640 1 --2- 172.21.15.138:0/3363189102 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff1480cc1e0 0x7ff148159660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:25.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.644+0000 7ff14d200640 1 --2- 172.21.15.138:0/3363189102 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff1480cbe00 0x7ff1480c7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:25.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.644+0000 7ff14d200640 1 -- 172.21.15.138:0/3363189102 >> 172.21.15.138:0/3363189102 conn(0x7ff1480d0b20 msgr2=0x7ff1480caec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:25.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.644+0000 7ff14d200640 1 -- 172.21.15.138:0/3363189102 shutdown_connections 2024-04-26T20:58:25.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:25.644+0000 7ff14d200640 1 -- 172.21.15.138:0/3363189102 wait complete. 2024-04-26T20:58:26.069 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T20:58:10.360154+0000', 'modified': '2024-04-26T20:58:24.737160+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5604}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5604': {'gid': 5604, 'name': 'a', 'rank': 0, 'incarnation': 25, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.138:6834/2450256246', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6832', 'nonce': 2450256246}, {'type': 'v1', 'addr': '172.21.15.138:6834', 'nonce': 2450256246}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'recovery_fs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5604, 'qdb_cluster': [5604]} 2024-04-26T20:58:26.069 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T20:58:26.070 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-26T20:58:26.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.204+0000 7fe0b5e00640 1 Processor -- start 2024-04-26T20:58:26.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.204+0000 7fe0b5e00640 1 -- start start 2024-04-26T20:58:26.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.208+0000 7fe0b5e00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe0b015cf80 0x7fe0b0073b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.208+0000 7fe0b5e00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0b00727f0 con 0x7fe0b00cc1e0 2024-04-26T20:58:26.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.208+0000 7fe0b5e00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0b0072a70 con 0x7fe0b00cbe00 2024-04-26T20:58:26.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.208+0000 7fe0b5e00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fe0b0073680 con 0x7fe0b015cf80 2024-04-26T20:58:26.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.208+0000 7fe0af400640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fe0b00cc1e0 0x7fe0b00ce6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:32844/0 (socket says 172.21.15.138:32844) 2024-04-26T20:58:26.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.208+0000 7fe0af400640 1 -- 172.21.15.138:0/629149790 learned_addr learned my addr 172.21.15.138:0/629149790 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:26.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.208+0000 7fe0a6000640 1 --2- 172.21.15.138:0/629149790 >> v2:172.21.15.143:3300/0 conn(0x7fe0b015cf80 0x7fe0b0073b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:26.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.208+0000 7fe0ae000640 1 -- 172.21.15.138:0/629149790 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1507804444 0 0) 0x7fe0a8001120 con 0x7fe0b00cc1e0 2024-04-26T20:58:26.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.208+0000 7fe0ae000640 1 -- 172.21.15.138:0/629149790 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe094005740 con 0x7fe0b00cc1e0 2024-04-26T20:58:26.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.208+0000 7fe0ae000640 1 -- 172.21.15.138:0/629149790 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 281836580 0 0) 0x7fe0b0072a70 con 0x7fe0b00cbe00 2024-04-26T20:58:26.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.208+0000 7fe0ae000640 1 -- 172.21.15.138:0/629149790 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0a8001120 con 0x7fe0b00cbe00 2024-04-26T20:58:26.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.208+0000 7fe0a6000640 1 -- 172.21.15.138:0/629149790 >> v1:172.21.15.143:6789/0 conn(0x7fe0b00cbe00 legacy=0x7fe0b006de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:26.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.208+0000 7fe0a6000640 1 -- 172.21.15.138:0/629149790 >> v1:172.21.15.138:6789/0 conn(0x7fe0b00cc1e0 legacy=0x7fe0b00ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:26.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.208+0000 7fe0a6000640 1 -- 172.21.15.138:0/629149790 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0b0072d50 con 0x7fe0b015cf80 2024-04-26T20:58:26.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.212+0000 7fe0a6000640 1 --2- 172.21.15.138:0/629149790 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0b015cf80 0x7fe0b0073b10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe098009d90 tx=0x7fe09801c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7050af2240f302ed server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:26.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.212+0000 7fe0ae000640 1 -- 172.21.15.138:0/629149790 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0980b2070 con 0x7fe0b015cf80 2024-04-26T20:58:26.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.212+0000 7fe0ae000640 1 -- 172.21.15.138:0/629149790 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0980a5840 con 0x7fe0b015cf80 2024-04-26T20:58:26.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.212+0000 7fe0ae000640 1 -- 172.21.15.138:0/629149790 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0980a5c10 con 0x7fe0b015cf80 2024-04-26T20:58:26.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.212+0000 7fe0b5e00640 1 -- 172.21.15.138:0/629149790 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0b015cf80 msgr2=0x7fe0b0073b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:26.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.212+0000 7fe0b5e00640 1 --2- 172.21.15.138:0/629149790 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0b015cf80 0x7fe0b0073b10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe098009d90 tx=0x7fe09801c970 comp rx=0 tx=0).stop 2024-04-26T20:58:26.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.212+0000 7fe0b5e00640 1 -- 172.21.15.138:0/629149790 shutdown_connections 2024-04-26T20:58:26.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.212+0000 7fe0b5e00640 1 --2- 172.21.15.138:0/629149790 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0b015cf80 0x7fe0b0073b10 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.212+0000 7fe0b5e00640 1 -- 172.21.15.138:0/629149790 >> 172.21.15.138:0/629149790 conn(0x7fe0b00d0b20 msgr2=0x7fe0b00d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:26.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.212+0000 7fe0b5e00640 1 -- 172.21.15.138:0/629149790 shutdown_connections 2024-04-26T20:58:26.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.212+0000 7fe0b5e00640 1 -- 172.21.15.138:0/629149790 wait complete. 2024-04-26T20:58:26.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.212+0000 7fe0b5e00640 1 Processor -- start 2024-04-26T20:58:26.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.212+0000 7fe0b5e00640 1 -- start start 2024-04-26T20:58:26.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.216+0000 7fe0b5e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe0b00cbe00 0x7fe0b014a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.216+0000 7fe0b5e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0b00cc1e0 0x7fe0b00b0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.216+0000 7fe0b5e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0b015cf80 0x7fe0b00b09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.216+0000 7fe0b5e00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b00d0900 con 0x7fe0b00cc1e0 2024-04-26T20:58:26.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.216+0000 7fe0b5e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b00d0780 con 0x7fe0b015cf80 2024-04-26T20:58:26.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.216+0000 7fe0b5e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fe0b006ef10 con 0x7fe0b00cbe00 2024-04-26T20:58:26.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.216+0000 7fe0a6000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0b00cc1e0 0x7fe0b00b0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:26.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.216+0000 7fe0a6000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0b00cc1e0 0x7fe0b00b0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40108/0 (socket says 172.21.15.138:40108) 2024-04-26T20:58:26.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.216+0000 7fe0a6000640 1 -- 172.21.15.138:0/8291192 learned_addr learned my addr 172.21.15.138:0/8291192 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:26.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.216+0000 7fe0af400640 1 --2- 172.21.15.138:0/8291192 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0b015cf80 0x7fe0b00b09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:26.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.216+0000 7fe0aea00640 1 --2- 172.21.15.138:0/8291192 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe0b00cbe00 0x7fe0b014a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:26.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.216+0000 7fe0a6000640 1 -- 172.21.15.138:0/8291192 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe0b00cbe00 msgr2=0x7fe0b014a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:26.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.216+0000 7fe0a6000640 1 --2- 172.21.15.138:0/8291192 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe0b00cbe00 0x7fe0b014a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.216+0000 7fe0a6000640 1 -- 172.21.15.138:0/8291192 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0b015cf80 msgr2=0x7fe0b00b09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:26.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.216+0000 7fe0a6000640 1 --2- 172.21.15.138:0/8291192 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0b015cf80 0x7fe0b00b09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.216+0000 7fe0a6000640 1 -- 172.21.15.138:0/8291192 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0b00ca480 con 0x7fe0b00cc1e0 2024-04-26T20:58:26.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.216+0000 7fe0a6000640 1 --2- 172.21.15.138:0/8291192 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0b00cc1e0 0x7fe0b00b0490 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fe09801a5a0 tx=0x7fe098019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:26.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.216+0000 7fe0a7e00640 1 -- 172.21.15.138:0/8291192 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0980b2070 con 0x7fe0b00cc1e0 2024-04-26T20:58:26.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.216+0000 7fe0a7e00640 1 -- 172.21.15.138:0/8291192 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0980bf070 con 0x7fe0b00cc1e0 2024-04-26T20:58:26.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.216+0000 7fe0b5e00640 1 -- 172.21.15.138:0/8291192 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0b00afeb0 con 0x7fe0b00cc1e0 2024-04-26T20:58:26.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.216+0000 7fe0a7e00640 1 -- 172.21.15.138:0/8291192 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0980b98d0 con 0x7fe0b00cc1e0 2024-04-26T20:58:26.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.216+0000 7fe0b5e00640 1 -- 172.21.15.138:0/8291192 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0b00c8070 con 0x7fe0b00cc1e0 2024-04-26T20:58:26.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.220+0000 7fe0a7e00640 1 -- 172.21.15.138:0/8291192 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe0980b9a70 con 0x7fe0b00cc1e0 2024-04-26T20:58:26.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.220+0000 7fe0a7e00640 1 --2- 172.21.15.138:0/8291192 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe08c068380 0x7fe08c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.220+0000 7fe0a7e00640 1 -- 172.21.15.138:0/8291192 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6756+0+0 (secure 0 0 0) 0x7fe098121b20 con 0x7fe0b00cc1e0 2024-04-26T20:58:26.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.220+0000 7fe0aea00640 1 --2- 172.21.15.138:0/8291192 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe08c068380 0x7fe08c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:26.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.220+0000 7fe0b9252000 1 Processor -- start 2024-04-26T20:58:26.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.220+0000 7fe0b9252000 1 -- start start 2024-04-26T20:58:26.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.220+0000 7fe0aea00640 1 --2- 172.21.15.138:0/8291192 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe08c068380 0x7fe08c06a840 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe0a00017c0 tx=0x7fe0a0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:26.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.220+0000 7fe0b9252000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563723ca7700 0x563723ca7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.220+0000 7fe0b9252000 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563723ca8020 0x563723c5e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.220+0000 7fe0b9252000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563723c5e740 0x563723c5eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.220+0000 7fe0b9252000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x563723b16140 con 0x563723c5e740 2024-04-26T20:58:26.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.220+0000 7fe0b9252000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x563723aabe00 con 0x563723ca7700 2024-04-26T20:58:26.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.220+0000 7fe0b9252000 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x563723a64a00 con 0x563723ca8020 2024-04-26T20:58:26.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.220+0000 7fe0af400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563723c5e740 0x563723c5eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:26.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.220+0000 7fe0af400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563723c5e740 0x563723c5eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40114/0 (socket says 172.21.15.138:40114) 2024-04-26T20:58:26.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.220+0000 7fe0af400640 1 -- 172.21.15.138:0/1083617807 learned_addr learned my addr 172.21.15.138:0/1083617807 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:26.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.220+0000 7fe0aea00640 1 --2- 172.21.15.138:0/1083617807 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563723ca7700 0x563723ca7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:26.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.220+0000 7fe0a6000640 1 --2- 172.21.15.138:0/1083617807 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563723ca8020 0x563723c5e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:26.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.220+0000 7fe0af400640 1 -- 172.21.15.138:0/1083617807 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563723ca8020 msgr2=0x563723c5e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:26.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.220+0000 7fe0af400640 1 --2- 172.21.15.138:0/1083617807 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563723ca8020 0x563723c5e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.220+0000 7fe0af400640 1 -- 172.21.15.138:0/1083617807 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563723ca7700 msgr2=0x563723ca7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:26.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.220+0000 7fe0af400640 1 --2- 172.21.15.138:0/1083617807 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563723ca7700 0x563723ca7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.220+0000 7fe0af400640 1 -- 172.21.15.138:0/1083617807 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563723a690e0 con 0x563723c5e740 2024-04-26T20:58:26.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.220+0000 7fe0a6000640 1 --2- 172.21.15.138:0/1083617807 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563723ca8020 0x563723c5e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:58:26.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.220+0000 7fe0aea00640 1 --2- 172.21.15.138:0/1083617807 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563723ca7700 0x563723ca7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:58:26.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.220+0000 7fe0af400640 1 --2- 172.21.15.138:0/1083617807 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563723c5e740 0x563723c5eb20 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8006e90 tx=0x7fe0a8007410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b208bbdfeed0996 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:26.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.224+0000 7fe09fe00640 1 -- 172.21.15.138:0/1083617807 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a801a070 con 0x563723c5e740 2024-04-26T20:58:26.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.224+0000 7fe09fe00640 1 -- 172.21.15.138:0/1083617807 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0a8001a10 con 0x563723c5e740 2024-04-26T20:58:26.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.224+0000 7fe09fe00640 1 -- 172.21.15.138:0/1083617807 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a8005860 con 0x563723c5e740 2024-04-26T20:58:26.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.224+0000 7fe0b9252000 1 -- 172.21.15.138:0/1083617807 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563723c5e740 msgr2=0x563723c5eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:26.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.224+0000 7fe0b9252000 1 --2- 172.21.15.138:0/1083617807 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563723c5e740 0x563723c5eb20 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8006e90 tx=0x7fe0a8007410 comp rx=0 tx=0).stop 2024-04-26T20:58:26.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.224+0000 7fe0b9252000 1 -- 172.21.15.138:0/1083617807 shutdown_connections 2024-04-26T20:58:26.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.224+0000 7fe0b9252000 1 --2- 172.21.15.138:0/1083617807 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563723c5e740 0x563723c5eb20 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.224+0000 7fe0b9252000 1 --2- 172.21.15.138:0/1083617807 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563723ca8020 0x563723c5e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.224+0000 7fe0b9252000 1 --2- 172.21.15.138:0/1083617807 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563723ca7700 0x563723ca7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.224+0000 7fe0b9252000 1 -- 172.21.15.138:0/1083617807 >> 172.21.15.138:0/1083617807 conn(0x563723c5a6f0 msgr2=0x563723c5cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:26.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.224+0000 7fe0b9252000 1 -- 172.21.15.138:0/1083617807 shutdown_connections 2024-04-26T20:58:26.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.224+0000 7fe0b9252000 1 -- 172.21.15.138:0/1083617807 wait complete. 2024-04-26T20:58:26.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.224+0000 7fe0b9252000 1 -- start start 2024-04-26T20:58:26.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.224+0000 7fe0b9252000 1 Processor -- start 2024-04-26T20:58:26.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.224+0000 7fe0b9252000 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563723c5e740 0x563723c690a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.224+0000 7fe0b9252000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563723ca7700 0x563723c695e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.224+0000 7fe0b9252000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563723ca8020 0x563723c69b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.224+0000 7fe0b9252000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x563723ab9200 con 0x563723ca7700 2024-04-26T20:58:26.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.224+0000 7fe0b9252000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x563723a4fe80 con 0x563723ca8020 2024-04-26T20:58:26.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.224+0000 7fe0b9252000 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x563723aa6ae0 con 0x563723c5e740 2024-04-26T20:58:26.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.224+0000 7fe0b9252000 10 client.0 _ll_register_callbacks cb 0x563723ab8da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:58:26.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.224+0000 7fe0a6000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563723ca7700 0x563723c695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:26.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.224+0000 7fe0a6000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563723ca7700 0x563723c695e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40116/0 (socket says 172.21.15.138:40116) 2024-04-26T20:58:26.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.224+0000 7fe0a6000640 1 -- 172.21.15.138:0/846242634 learned_addr learned my addr 172.21.15.138:0/846242634 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:26.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.224+0000 7fe0aea00640 1 --2- 172.21.15.138:0/846242634 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563723c5e740 0x563723c690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:26.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.224+0000 7fe0af400640 1 --2- 172.21.15.138:0/846242634 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563723ca8020 0x563723c69b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:26.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.224+0000 7fe0a6000640 1 -- 172.21.15.138:0/846242634 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563723c5e740 msgr2=0x563723c690a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:26.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.224+0000 7fe0a6000640 1 --2- 172.21.15.138:0/846242634 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563723c5e740 0x563723c690a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.224+0000 7fe0a6000640 1 -- 172.21.15.138:0/846242634 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563723ca8020 msgr2=0x563723c69b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:26.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.224+0000 7fe0a6000640 1 --2- 172.21.15.138:0/846242634 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563723ca8020 0x563723c69b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.224+0000 7fe0a6000640 1 -- 172.21.15.138:0/846242634 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563723a4b4e0 con 0x563723ca7700 2024-04-26T20:58:26.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.224+0000 7fe0a6000640 1 --2- 172.21.15.138:0/846242634 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563723ca7700 0x563723c695e0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fe098098460 tx=0x7fe0980f1110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efb039f9f69f7843 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:26.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.224+0000 7fe09cc00640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-04-26T20:58:26.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.224+0000 7fe09cc00640 1 -- 172.21.15.138:0/846242634 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0980fa1b0 con 0x563723ca7700 2024-04-26T20:58:26.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.224+0000 7fe09cc00640 1 -- 172.21.15.138:0/846242634 <== mon.0 v2:172.21.15.138:3300/0 2 ==== osd_map(51..51 src has 1..51) ==== 6756+0+0 (secure 0 0 0) 0x7fe0980edcf0 con 0x563723ca7700 2024-04-26T20:58:26.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.224+0000 7fe0b9252000 1 -- 172.21.15.138:0/846242634 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0a8001a10 con 0x563723ca7700 2024-04-26T20:58:26.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.224+0000 7fe09cc00640 1 -- 172.21.15.138:0/846242634 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe0980f9d20 con 0x563723ca7700 2024-04-26T20:58:26.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.224+0000 7fe0b9252000 10 client.5892 fetch_fsmap learned FSMap version 28 2024-04-26T20:58:26.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.224+0000 7fe0b9252000 1 -- 172.21.15.138:0/846242634 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x563723a31e80 con 0x563723ca7700 2024-04-26T20:58:26.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.228+0000 7fe09cc00640 1 -- 172.21.15.138:0/846242634 <== mon.0 v2:172.21.15.138:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0a8001a10 con 0x563723ca7700 2024-04-26T20:58:26.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.228+0000 7fe09cc00640 1 -- 172.21.15.138:0/846242634 <== mon.0 v2:172.21.15.138:3300/0 5 ==== fsmap(e 28) ==== 4139+0+0 (secure 0 0 0) 0x7fe0980f0ad0 con 0x563723ca7700 2024-04-26T20:58:26.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.228+0000 7fe0b9252000 10 client.5892 fetch_fsmap finished waiting for FSMap version 28 2024-04-26T20:58:26.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.228+0000 7fe0b9252000 10 client.5892 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-26T20:58:26.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.228+0000 7fe0b9252000 20 client.5892 populate_metadata read hostname 'smithi138' 2024-04-26T20:58:26.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.228+0000 7fe0b9252000 1 --2- 172.21.15.138:0/846242634 >> [v2:172.21.15.138:6832/2450256246,v1:172.21.15.138:6834/2450256246] conn(0x563723c6a530 0x563723cb97b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.228+0000 7fe0b9252000 4 client.5892 mds_command: new command op to 5604 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:58:26.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.228+0000 7fe0b9252000 1 -- 172.21.15.138:0/846242634 --> [v2:172.21.15.138:6832/2450256246,v1:172.21.15.138:6834/2450256246] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563723a44bc0 con 0x563723c6a530 2024-04-26T20:58:26.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.228+0000 7fe0aea00640 1 --2- 172.21.15.138:0/846242634 >> [v2:172.21.15.138:6832/2450256246,v1:172.21.15.138:6834/2450256246] conn(0x563723c6a530 0x563723cb97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:26.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.228+0000 7fe0aea00640 1 --2- 172.21.15.138:0/846242634 >> [v2:172.21.15.138:6832/2450256246,v1:172.21.15.138:6834/2450256246] conn(0x563723c6a530 0x563723cb97b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ee424ed0cd94b07 server_cookie=52ea22b147703775 in_seq=0 out_seq=0 2024-04-26T20:58:26.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.228+0000 7fe09cc00640 10 client.5892 ms_handle_connect on v2:172.21.15.138:6832/2450256246 2024-04-26T20:58:26.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.228+0000 7fe09cc00640 1 -- 172.21.15.138:0/846242634 <== mds.0 v2:172.21.15.138:6832/2450256246 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x563723a44bc0 con 0x563723c6a530 2024-04-26T20:58:26.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.228+0000 7fe09cc00640 10 client.5892 handle_command_reply: tid=0 2024-04-26T20:58:26.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.228+0000 7fe0b9252000 1 client.5892 shutdown 2024-04-26T20:58:26.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.228+0000 7fe0b9252000 1 -- 172.21.15.138:0/846242634 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563723ca7700 msgr2=0x563723c695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:26.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.228+0000 7fe0b9252000 1 --2- 172.21.15.138:0/846242634 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563723ca7700 0x563723c695e0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fe098098460 tx=0x7fe0980f1110 comp rx=0 tx=0).stop 2024-04-26T20:58:26.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.228+0000 7fe0b9252000 1 -- 172.21.15.138:0/846242634 shutdown_connections 2024-04-26T20:58:26.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.228+0000 7fe0b9252000 1 --2- 172.21.15.138:0/846242634 >> [v2:172.21.15.138:6832/2450256246,v1:172.21.15.138:6834/2450256246] conn(0x563723c6a530 0x563723cb97b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.228+0000 7fe0b9252000 1 --2- 172.21.15.138:0/846242634 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563723ca8020 0x563723c69b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.228+0000 7fe0b9252000 1 --2- 172.21.15.138:0/846242634 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563723ca7700 0x563723c695e0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.228+0000 7fe0b9252000 1 --2- 172.21.15.138:0/846242634 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563723c5e740 0x563723c690a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.228+0000 7fe0b9252000 1 -- 172.21.15.138:0/846242634 >> 172.21.15.138:0/846242634 conn(0x563723c5a6f0 msgr2=0x563723c5d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:26.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.228+0000 7fe09cc00640 0 client.5892 ms_handle_reset on v2:172.21.15.138:6832/2450256246 2024-04-26T20:58:26.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.228+0000 7fe0b9252000 1 -- 172.21.15.138:0/846242634 shutdown_connections 2024-04-26T20:58:26.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.228+0000 7fe0b9252000 1 -- 172.21.15.138:0/846242634 wait complete. 2024-04-26T20:58:26.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.228+0000 7fe0b9252000 20 client.5892 trim_cache size 0 max 16384 2024-04-26T20:58:26.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.248+0000 7fe0b9252000 1 Processor -- start 2024-04-26T20:58:26.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.248+0000 7fe0b9252000 1 -- start start 2024-04-26T20:58:26.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.248+0000 7fe0b9252000 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563723c5e740 0x563723c5cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.248+0000 7fe0b9252000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563723ca7700 0x563723c5d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.248+0000 7fe0b9252000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563723ca8020 0x563723c5d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.248+0000 7fe0b9252000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b0205030 con 0x563723ca8020 2024-04-26T20:58:26.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.248+0000 7fe0b9252000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b0204430 con 0x563723ca7700 2024-04-26T20:58:26.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.248+0000 7fe0b9252000 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fe0b02049b0 con 0x563723c5e740 2024-04-26T20:58:26.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.248+0000 7fe0af400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563723ca8020 0x563723c5d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:26.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.248+0000 7fe0af400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563723ca8020 0x563723c5d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40124/0 (socket says 172.21.15.138:40124) 2024-04-26T20:58:26.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.248+0000 7fe0af400640 1 -- 172.21.15.138:0/731684124 learned_addr learned my addr 172.21.15.138:0/731684124 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:26.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.248+0000 7fe0aea00640 1 --2- 172.21.15.138:0/731684124 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563723c5e740 0x563723c5cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:26.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.248+0000 7fe0a6000640 1 --2- 172.21.15.138:0/731684124 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563723ca7700 0x563723c5d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:26.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.248+0000 7fe0af400640 1 -- 172.21.15.138:0/731684124 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563723c5e740 msgr2=0x563723c5cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:26.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.248+0000 7fe0af400640 1 --2- 172.21.15.138:0/731684124 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563723c5e740 0x563723c5cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.248+0000 7fe0af400640 1 -- 172.21.15.138:0/731684124 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563723ca7700 msgr2=0x563723c5d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:26.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.248+0000 7fe0af400640 1 --2- 172.21.15.138:0/731684124 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563723ca7700 0x563723c5d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.248+0000 7fe0af400640 1 -- 172.21.15.138:0/731684124 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563723a64c50 con 0x563723ca8020 2024-04-26T20:58:26.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.248+0000 7fe0af400640 1 --2- 172.21.15.138:0/731684124 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563723ca8020 0x563723c5d560 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8018040 tx=0x7fe0a800f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d348ae8344948b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:26.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.248+0000 7fe09f400640 1 -- 172.21.15.138:0/731684124 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a8026070 con 0x563723ca8020 2024-04-26T20:58:26.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.248+0000 7fe09f400640 1 -- 172.21.15.138:0/731684124 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0a800b040 con 0x563723ca8020 2024-04-26T20:58:26.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.248+0000 7fe09f400640 1 -- 172.21.15.138:0/731684124 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a801a040 con 0x563723ca8020 2024-04-26T20:58:26.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.248+0000 7fe0b9252000 1 -- 172.21.15.138:0/731684124 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563723ca8020 msgr2=0x563723c5d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:26.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.248+0000 7fe0b9252000 1 --2- 172.21.15.138:0/731684124 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563723ca8020 0x563723c5d560 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8018040 tx=0x7fe0a800f000 comp rx=0 tx=0).stop 2024-04-26T20:58:26.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.248+0000 7fe0b9252000 1 -- 172.21.15.138:0/731684124 shutdown_connections 2024-04-26T20:58:26.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.248+0000 7fe0b9252000 1 --2- 172.21.15.138:0/731684124 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563723ca8020 0x563723c5d560 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.248+0000 7fe0b9252000 1 --2- 172.21.15.138:0/731684124 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563723ca7700 0x563723c5d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.248+0000 7fe0b9252000 1 --2- 172.21.15.138:0/731684124 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563723c5e740 0x563723c5cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.248+0000 7fe0b9252000 1 -- 172.21.15.138:0/731684124 >> 172.21.15.138:0/731684124 conn(0x563723c5a6f0 msgr2=0x563723c69930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:26.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.248+0000 7fe0b9252000 1 -- 172.21.15.138:0/731684124 shutdown_connections 2024-04-26T20:58:26.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.248+0000 7fe0b9252000 1 -- 172.21.15.138:0/731684124 wait complete. 2024-04-26T20:58:26.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.248+0000 7fe0b9252000 1 -- start start 2024-04-26T20:58:26.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.248+0000 7fe0b9252000 1 Processor -- start 2024-04-26T20:58:26.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.252+0000 7fe0b9252000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563723c5e740 0x563723cbbf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.252+0000 7fe0b9252000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563723ca7700 0x563723cbc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.252+0000 7fe0b9252000 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563723ca8020 0x563723cd3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.252+0000 7fe0b9252000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x563723aab110 con 0x563723ca7700 2024-04-26T20:58:26.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.252+0000 7fe0b9252000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x563723a417b0 con 0x563723c5e740 2024-04-26T20:58:26.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.252+0000 7fe0b9252000 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x563723ab0430 con 0x563723ca8020 2024-04-26T20:58:26.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.252+0000 7fe0b9252000 10 client.0 _ll_register_callbacks cb 0x7fe098007000 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:58:26.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.252+0000 7fe0a6000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563723ca7700 0x563723cbc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:26.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.252+0000 7fe0a6000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563723ca7700 0x563723cbc470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40132/0 (socket says 172.21.15.138:40132) 2024-04-26T20:58:26.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.252+0000 7fe0a6000640 1 -- 172.21.15.138:0/1035052832 learned_addr learned my addr 172.21.15.138:0/1035052832 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:26.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.252+0000 7fe0af400640 1 --2- 172.21.15.138:0/1035052832 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563723ca8020 0x563723cd3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:26.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.252+0000 7fe0aea00640 1 --2- 172.21.15.138:0/1035052832 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563723c5e740 0x563723cbbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:26.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.252+0000 7fe0a6000640 1 -- 172.21.15.138:0/1035052832 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563723ca8020 msgr2=0x563723cd3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:26.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.252+0000 7fe0a6000640 1 --2- 172.21.15.138:0/1035052832 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563723ca8020 0x563723cd3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.252+0000 7fe0a6000640 1 -- 172.21.15.138:0/1035052832 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563723c5e740 msgr2=0x563723cbbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:26.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.252+0000 7fe0a6000640 1 --2- 172.21.15.138:0/1035052832 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563723c5e740 0x563723cbbf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.252+0000 7fe0a6000640 1 -- 172.21.15.138:0/1035052832 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563723b2e160 con 0x563723ca7700 2024-04-26T20:58:26.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.252+0000 7fe0aea00640 1 --2- 172.21.15.138:0/1035052832 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563723c5e740 0x563723cbbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:58:26.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.252+0000 7fe0a6000640 1 --2- 172.21.15.138:0/1035052832 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563723ca7700 0x563723cbc470 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fe0980f1020 tx=0x7fe09811fb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5894536f81c926c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:26.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.252+0000 7fe09cc00640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-04-26T20:58:26.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.252+0000 7fe09cc00640 1 -- 172.21.15.138:0/1035052832 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0980f11c0 con 0x563723ca7700 2024-04-26T20:58:26.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.252+0000 7fe09cc00640 1 -- 172.21.15.138:0/1035052832 <== mon.0 v2:172.21.15.138:3300/0 2 ==== osd_map(51..51 src has 1..51) ==== 6756+0+0 (secure 0 0 0) 0x7fe0980f6b10 con 0x563723ca7700 2024-04-26T20:58:26.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.252+0000 7fe0b9252000 1 -- 172.21.15.138:0/1035052832 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0a800b040 con 0x563723ca7700 2024-04-26T20:58:26.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.252+0000 7fe09cc00640 1 -- 172.21.15.138:0/1035052832 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe0980fa1b0 con 0x563723ca7700 2024-04-26T20:58:26.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.252+0000 7fe0b9252000 10 client.5898 fetch_fsmap learned FSMap version 28 2024-04-26T20:58:26.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.252+0000 7fe0b9252000 1 -- 172.21.15.138:0/1035052832 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x5637237650c0 con 0x563723ca7700 2024-04-26T20:58:26.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.252+0000 7fe09cc00640 1 -- 172.21.15.138:0/1035052832 <== mon.0 v2:172.21.15.138:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0a800b040 con 0x563723ca7700 2024-04-26T20:58:26.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.252+0000 7fe09cc00640 1 -- 172.21.15.138:0/1035052832 <== mon.0 v2:172.21.15.138:3300/0 5 ==== fsmap(e 28) ==== 4139+0+0 (secure 0 0 0) 0x7fe0980ed3d0 con 0x563723ca7700 2024-04-26T20:58:26.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.252+0000 7fe0b9252000 10 client.5898 fetch_fsmap finished waiting for FSMap version 28 2024-04-26T20:58:26.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.252+0000 7fe0b9252000 10 client.5898 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-26T20:58:26.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.252+0000 7fe0b9252000 20 client.5898 populate_metadata read hostname 'smithi138' 2024-04-26T20:58:26.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.252+0000 7fe0b9252000 1 --2- 172.21.15.138:0/1035052832 >> [v2:172.21.15.138:6832/2450256246,v1:172.21.15.138:6834/2450256246] conn(0x563723cd3d00 0x563723d1e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.252+0000 7fe0b9252000 4 client.5898 mds_command: new command op to 5604 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T20:58:26.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.252+0000 7fe0b9252000 1 -- 172.21.15.138:0/1035052832 --> [v2:172.21.15.138:6832/2450256246,v1:172.21.15.138:6834/2450256246] -- command(tid 0: {"prefix": "status"}) -- 0x563723ab9a10 con 0x563723cd3d00 2024-04-26T20:58:26.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.252+0000 7fe0aea00640 1 --2- 172.21.15.138:0/1035052832 >> [v2:172.21.15.138:6832/2450256246,v1:172.21.15.138:6834/2450256246] conn(0x563723cd3d00 0x563723d1e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:26.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.252+0000 7fe0aea00640 1 --2- 172.21.15.138:0/1035052832 >> [v2:172.21.15.138:6832/2450256246,v1:172.21.15.138:6834/2450256246] conn(0x563723cd3d00 0x563723d1e7b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6aa932fc6a01a824 server_cookie=b4bf18de08f990c3 in_seq=0 out_seq=0 2024-04-26T20:58:26.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.252+0000 7fe09cc00640 10 client.5898 ms_handle_connect on v2:172.21.15.138:6832/2450256246 2024-04-26T20:58:26.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.252+0000 7fe09cc00640 1 -- 172.21.15.138:0/1035052832 <== mds.0 v2:172.21.15.138:6832/2450256246 1 ==== command_reply(tid 0: 0 ) ==== 8+0+336 (crc 0 0 0) 0x563723ab9a10 con 0x563723cd3d00 2024-04-26T20:58:26.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.252+0000 7fe09cc00640 10 client.5898 handle_command_reply: tid=0 2024-04-26T20:58:26.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.252+0000 7fe0b9252000 1 client.5898 shutdown 2024-04-26T20:58:26.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.252+0000 7fe0b9252000 1 -- 172.21.15.138:0/1035052832 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563723ca7700 msgr2=0x563723cbc470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:26.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.252+0000 7fe0b9252000 1 --2- 172.21.15.138:0/1035052832 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563723ca7700 0x563723cbc470 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fe0980f1020 tx=0x7fe09811fb90 comp rx=0 tx=0).stop 2024-04-26T20:58:26.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.252+0000 7fe0b9252000 1 -- 172.21.15.138:0/1035052832 shutdown_connections 2024-04-26T20:58:26.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.252+0000 7fe0b9252000 1 --2- 172.21.15.138:0/1035052832 >> [v2:172.21.15.138:6832/2450256246,v1:172.21.15.138:6834/2450256246] conn(0x563723cd3d00 0x563723d1e7b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.252+0000 7fe0b9252000 1 --2- 172.21.15.138:0/1035052832 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563723ca8020 0x563723cd3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.252+0000 7fe0b9252000 1 --2- 172.21.15.138:0/1035052832 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563723ca7700 0x563723cbc470 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.252+0000 7fe09cc00640 0 client.5898 ms_handle_reset on v2:172.21.15.138:6832/2450256246 2024-04-26T20:58:26.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.252+0000 7fe0b9252000 1 --2- 172.21.15.138:0/1035052832 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563723c5e740 0x563723cbbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.252+0000 7fe0b9252000 1 -- 172.21.15.138:0/1035052832 >> 172.21.15.138:0/1035052832 conn(0x563723c5a6f0 msgr2=0x563723cb4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:26.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.252+0000 7fe0b9252000 1 -- 172.21.15.138:0/1035052832 shutdown_connections 2024-04-26T20:58:26.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.252+0000 7fe0b9252000 1 -- 172.21.15.138:0/1035052832 wait complete. 2024-04-26T20:58:26.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.252+0000 7fe0b9252000 20 client.5898 trim_cache size 0 max 16384 2024-04-26T20:58:26.259 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-26T20:58:26.259 INFO:teuthology.orchestra.run.smithi138.stdout: "cluster_fsid": "c22b4730-12cc-4558-8535-b965384398c0", 2024-04-26T20:58:26.260 INFO:teuthology.orchestra.run.smithi138.stdout: "whoami": 0, 2024-04-26T20:58:26.260 INFO:teuthology.orchestra.run.smithi138.stdout: "id": 5604, 2024-04-26T20:58:26.260 INFO:teuthology.orchestra.run.smithi138.stdout: "want_state": "up:active", 2024-04-26T20:58:26.260 INFO:teuthology.orchestra.run.smithi138.stdout: "state": "up:active", 2024-04-26T20:58:26.260 INFO:teuthology.orchestra.run.smithi138.stdout: "fs_name": "recovery_fs", 2024-04-26T20:58:26.260 INFO:teuthology.orchestra.run.smithi138.stdout: "rank_uptime": 4.5285989510000002, 2024-04-26T20:58:26.260 INFO:teuthology.orchestra.run.smithi138.stdout: "mdsmap_epoch": 28, 2024-04-26T20:58:26.260 INFO:teuthology.orchestra.run.smithi138.stdout: "osdmap_epoch": 51, 2024-04-26T20:58:26.260 INFO:teuthology.orchestra.run.smithi138.stdout: "osdmap_epoch_barrier": 51, 2024-04-26T20:58:26.260 INFO:teuthology.orchestra.run.smithi138.stdout: "uptime": 18.657745439999999 2024-04-26T20:58:26.260 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-26T20:58:26.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.256+0000 7fe0b5e00640 1 -- 172.21.15.138:0/8291192 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe08c068380 msgr2=0x7fe08c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:26.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.256+0000 7fe0b5e00640 1 --2- 172.21.15.138:0/8291192 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe08c068380 0x7fe08c06a840 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe0a00017c0 tx=0x7fe0a0009040 comp rx=0 tx=0).stop 2024-04-26T20:58:26.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.256+0000 7fe0b5e00640 1 -- 172.21.15.138:0/8291192 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0b00cc1e0 msgr2=0x7fe0b00b0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:26.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.256+0000 7fe0b5e00640 1 --2- 172.21.15.138:0/8291192 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0b00cc1e0 0x7fe0b00b0490 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fe09801a5a0 tx=0x7fe098019710 comp rx=0 tx=0).stop 2024-04-26T20:58:26.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.256+0000 7fe0b5e00640 1 -- 172.21.15.138:0/8291192 shutdown_connections 2024-04-26T20:58:26.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.256+0000 7fe0b5e00640 1 --2- 172.21.15.138:0/8291192 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe08c068380 0x7fe08c06a840 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.256+0000 7fe0b5e00640 1 --2- 172.21.15.138:0/8291192 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0b015cf80 0x7fe0b00b09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.256+0000 7fe0b5e00640 1 --2- 172.21.15.138:0/8291192 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0b00cc1e0 0x7fe0b00b0490 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.256+0000 7fe0b5e00640 1 --2- 172.21.15.138:0/8291192 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe0b00cbe00 0x7fe0b014a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.256+0000 7fe0b5e00640 1 -- 172.21.15.138:0/8291192 >> 172.21.15.138:0/8291192 conn(0x7fe0b00d0b20 msgr2=0x7fe0b0158da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:26.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.256+0000 7fe0b5e00640 1 -- 172.21.15.138:0/8291192 shutdown_connections 2024-04-26T20:58:26.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.256+0000 7fe0b5e00640 1 -- 172.21.15.138:0/8291192 wait complete. 2024-04-26T20:58:26.275 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds debug_mds 20 2024-04-26T20:58:26.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.412+0000 7fce6f800640 1 Processor -- start 2024-04-26T20:58:26.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.412+0000 7fce6f800640 1 -- start start 2024-04-26T20:58:26.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.412+0000 7fce6f800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fce6815f2f0 0x7fce6806dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.412+0000 7fce6f800640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fce680d2300 0x7fce680ce120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.412+0000 7fce6f800640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce680cd380 con 0x7fce6806e120 2024-04-26T20:58:26.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.412+0000 7fce6f800640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fce6806eb60 con 0x7fce680d2300 2024-04-26T20:58:26.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.412+0000 7fce6f800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fce6806e560 con 0x7fce6815f2f0 2024-04-26T20:58:26.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.416+0000 7fce5fe00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fce6806e120 0x7fce680d1bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:32850/0 (socket says 172.21.15.138:32850) 2024-04-26T20:58:26.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.416+0000 7fce5fe00640 1 -- 172.21.15.138:0/427039447 learned_addr learned my addr 172.21.15.138:0/427039447 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:26.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.416+0000 7fce6d800640 1 --2- 172.21.15.138:0/427039447 >> v2:172.21.15.143:3300/0 conn(0x7fce680d2300 0x7fce680ce120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:26.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.416+0000 7fce6ce00640 1 --2- 172.21.15.138:0/427039447 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fce6815f2f0 0x7fce6806dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:26.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.416+0000 7fce67e00640 1 -- 172.21.15.138:0/427039447 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2186848989 0 0) 0x7fce680cd380 con 0x7fce6806e120 2024-04-26T20:58:26.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.416+0000 7fce67e00640 1 -- 172.21.15.138:0/427039447 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce4c003530 con 0x7fce6806e120 2024-04-26T20:58:26.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.416+0000 7fce67e00640 1 -- 172.21.15.138:0/427039447 <== mon.0 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 983716915 0 0) 0x7fce4c003530 con 0x7fce6806e120 2024-04-26T20:58:26.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.416+0000 7fce67e00640 1 -- 172.21.15.138:0/427039447 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fce6815f2f0 msgr2=0x7fce6806dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:26.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.416+0000 7fce67e00640 1 --2- 172.21.15.138:0/427039447 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fce6815f2f0 0x7fce6806dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.416+0000 7fce67e00640 1 -- 172.21.15.138:0/427039447 >> v2:172.21.15.143:3300/0 conn(0x7fce680d2300 msgr2=0x7fce680ce120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:26.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.416+0000 7fce67e00640 1 --2- 172.21.15.138:0/427039447 >> v2:172.21.15.143:3300/0 conn(0x7fce680d2300 0x7fce680ce120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.416+0000 7fce67e00640 1 -- 172.21.15.138:0/427039447 --> v1:172.21.15.138:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce680d28e0 con 0x7fce6806e120 2024-04-26T20:58:26.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.416+0000 7fce67e00640 1 -- 172.21.15.138:0/427039447 <== mon.0 v1:172.21.15.138:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2715389689 0 0) 0x7fce50001680 con 0x7fce6806e120 2024-04-26T20:58:26.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.416+0000 7fce6ce00640 1 --2- 172.21.15.138:0/427039447 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fce6815f2f0 0x7fce6806dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:58:26.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.416+0000 7fce67e00640 1 -- 172.21.15.138:0/427039447 >> v1:172.21.15.138:6789/0 conn(0x7fce6806e120 legacy=0x7fce680d1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:26.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.416+0000 7fce67e00640 1 --2- 172.21.15.138:0/427039447 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fce4c003a30 0x7fce4c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.416+0000 7fce67e00640 1 --2- 172.21.15.138:0/427039447 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce4c004810 0x7fce4c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.416+0000 7fce67e00640 1 --2- 172.21.15.138:0/427039447 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fce6815f2f0 0x7fce4c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.416+0000 7fce67e00640 1 -- 172.21.15.138:0/427039447 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fce6806eb60 con 0x7fce4c003a30 2024-04-26T20:58:26.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.416+0000 7fce67e00640 1 -- 172.21.15.138:0/427039447 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fce6806e560 con 0x7fce4c004810 2024-04-26T20:58:26.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.416+0000 7fce67e00640 1 -- 172.21.15.138:0/427039447 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fce4c00b9d0 con 0x7fce6815f2f0 2024-04-26T20:58:26.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.416+0000 7fce6d800640 1 --2- 172.21.15.138:0/427039447 >> v2:172.21.15.143:3300/0 conn(0x7fce680d2300 0x7fce680ce120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:58:26.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.416+0000 7fce6ce00640 1 --2- 172.21.15.138:0/427039447 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fce4c003a30 0x7fce4c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:26.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.416+0000 7fce5fe00640 1 --2- 172.21.15.138:0/427039447 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce4c004810 0x7fce4c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:26.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.416+0000 7fce6d800640 1 --2- 172.21.15.138:0/427039447 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fce6815f2f0 0x7fce4c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:26.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.416+0000 7fce6ce00640 1 -- 172.21.15.138:0/427039447 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fce6815f2f0 msgr2=0x7fce4c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:26.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.416+0000 7fce6ce00640 1 --2- 172.21.15.138:0/427039447 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fce6815f2f0 0x7fce4c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.416+0000 7fce6ce00640 1 -- 172.21.15.138:0/427039447 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce4c004810 msgr2=0x7fce4c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:26.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.416+0000 7fce6ce00640 1 --2- 172.21.15.138:0/427039447 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce4c004810 0x7fce4c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.416+0000 7fce6ce00640 1 -- 172.21.15.138:0/427039447 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce4c003530 con 0x7fce4c003a30 2024-04-26T20:58:26.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.420+0000 7fce6ce00640 1 --2- 172.21.15.138:0/427039447 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fce4c003a30 0x7fce4c003e50 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fce58009c90 tx=0x7fce5801cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6973474078f3d9a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:26.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.420+0000 7fce67e00640 1 -- 172.21.15.138:0/427039447 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce580b2070 con 0x7fce4c003a30 2024-04-26T20:58:26.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.420+0000 7fce67e00640 1 -- 172.21.15.138:0/427039447 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce580a5690 con 0x7fce4c003a30 2024-04-26T20:58:26.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.420+0000 7fce67e00640 1 -- 172.21.15.138:0/427039447 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce58009860 con 0x7fce4c003a30 2024-04-26T20:58:26.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.420+0000 7fce6f800640 1 -- 172.21.15.138:0/427039447 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fce4c003a30 msgr2=0x7fce4c003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:26.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.420+0000 7fce6f800640 1 --2- 172.21.15.138:0/427039447 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fce4c003a30 0x7fce4c003e50 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fce58009c90 tx=0x7fce5801cbc0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.420+0000 7fce6d800640 1 -- 172.21.15.138:0/427039447 reap_dead start 2024-04-26T20:58:26.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.420+0000 7fce6f800640 1 -- 172.21.15.138:0/427039447 shutdown_connections 2024-04-26T20:58:26.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.420+0000 7fce6f800640 1 -- 172.21.15.138:0/427039447 >> 172.21.15.138:0/427039447 conn(0x7fce680d2d30 msgr2=0x7fce680d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:26.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.420+0000 7fce6f800640 1 -- 172.21.15.138:0/427039447 shutdown_connections 2024-04-26T20:58:26.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.420+0000 7fce6f800640 1 -- 172.21.15.138:0/427039447 wait complete. 2024-04-26T20:58:26.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.420+0000 7fce6f800640 1 Processor -- start 2024-04-26T20:58:26.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.420+0000 7fce6f800640 1 -- start start 2024-04-26T20:58:26.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.424+0000 7fce6f800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fce4c003a30 0x7fce680b68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.424+0000 7fce6f800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce68156fd0 0x7fce68161b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.424+0000 7fce6f800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fce68162050 0x7fce6815ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.424+0000 7fce6f800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fce6815f6d0 con 0x7fce4c003a30 2024-04-26T20:58:26.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.424+0000 7fce6f800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fce680b5b80 con 0x7fce68156fd0 2024-04-26T20:58:26.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.424+0000 7fce6f800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fce6815f850 con 0x7fce68162050 2024-04-26T20:58:26.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.424+0000 7fce6ce00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fce4c003a30 0x7fce680b68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:26.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.424+0000 7fce6ce00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fce4c003a30 0x7fce680b68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40146/0 (socket says 172.21.15.138:40146) 2024-04-26T20:58:26.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.424+0000 7fce6ce00640 1 -- 172.21.15.138:0/3021062573 learned_addr learned my addr 172.21.15.138:0/3021062573 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:26.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.424+0000 7fce5fe00640 1 --2- 172.21.15.138:0/3021062573 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce68156fd0 0x7fce68161b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:26.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.424+0000 7fce6d800640 1 --2- 172.21.15.138:0/3021062573 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fce68162050 0x7fce6815ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:26.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.424+0000 7fce6ce00640 1 -- 172.21.15.138:0/3021062573 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fce68162050 msgr2=0x7fce6815ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:26.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.424+0000 7fce6ce00640 1 --2- 172.21.15.138:0/3021062573 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fce68162050 0x7fce6815ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.424+0000 7fce6ce00640 1 -- 172.21.15.138:0/3021062573 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce68156fd0 msgr2=0x7fce68161b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:26.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.424+0000 7fce6ce00640 1 --2- 172.21.15.138:0/3021062573 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce68156fd0 0x7fce68161b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.424+0000 7fce6ce00640 1 -- 172.21.15.138:0/3021062573 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce68159d90 con 0x7fce4c003a30 2024-04-26T20:58:26.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.424+0000 7fce6d800640 1 --2- 172.21.15.138:0/3021062573 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fce68162050 0x7fce6815ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:58:26.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.424+0000 7fce5fe00640 1 --2- 172.21.15.138:0/3021062573 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce68156fd0 0x7fce68161b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:58:26.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.424+0000 7fce6ce00640 1 --2- 172.21.15.138:0/3021062573 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fce4c003a30 0x7fce680b68a0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fce5801c9f0 tx=0x7fce4c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:26.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.424+0000 7fce65600640 1 -- 172.21.15.138:0/3021062573 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce580b2040 con 0x7fce4c003a30 2024-04-26T20:58:26.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.424+0000 7fce65600640 1 -- 172.21.15.138:0/3021062573 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce58009390 con 0x7fce4c003a30 2024-04-26T20:58:26.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.424+0000 7fce6f800640 1 -- 172.21.15.138:0/3021062573 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce6815a070 con 0x7fce4c003a30 2024-04-26T20:58:26.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.424+0000 7fce65600640 1 -- 172.21.15.138:0/3021062573 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce58009860 con 0x7fce4c003a30 2024-04-26T20:58:26.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.424+0000 7fce6f800640 1 -- 172.21.15.138:0/3021062573 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce6815a630 con 0x7fce4c003a30 2024-04-26T20:58:26.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.424+0000 7fce6f800640 1 -- 172.21.15.138:0/3021062573 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce68069430 con 0x7fce4c003a30 2024-04-26T20:58:26.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.424+0000 7fce65600640 1 -- 172.21.15.138:0/3021062573 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fce580c0020 con 0x7fce4c003a30 2024-04-26T20:58:26.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.428+0000 7fce65600640 1 --2- 172.21.15.138:0/3021062573 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fce44068380 0x7fce4406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.428+0000 7fce65600640 1 -- 172.21.15.138:0/3021062573 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6756+0+0 (secure 0 0 0) 0x7fce58120b50 con 0x7fce4c003a30 2024-04-26T20:58:26.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.428+0000 7fce5fe00640 1 --2- 172.21.15.138:0/3021062573 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fce44068380 0x7fce4406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:26.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.428+0000 7fce5fe00640 1 --2- 172.21.15.138:0/3021062573 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fce44068380 0x7fce4406a840 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fce50000c10 tx=0x7fce50009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:26.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.432+0000 7fce65600640 1 -- 172.21.15.138:0/3021062573 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fce580c7020 con 0x7fce4c003a30 2024-04-26T20:58:26.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.588+0000 7fce6f800640 1 -- 172.21.15.138:0/3021062573 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7fce68158380 con 0x7fce4c003a30 2024-04-26T20:58:26.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.592+0000 7fce65600640 1 -- 172.21.15.138:0/3021062573 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v11)=0 v11) ==== 108+0+0 (secure 0 0 0) 0x7fce58016900 con 0x7fce4c003a30 2024-04-26T20:58:26.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.596+0000 7fce6f800640 1 -- 172.21.15.138:0/3021062573 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fce44068380 msgr2=0x7fce4406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:26.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.596+0000 7fce6f800640 1 --2- 172.21.15.138:0/3021062573 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fce44068380 0x7fce4406a840 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fce50000c10 tx=0x7fce50009040 comp rx=0 tx=0).stop 2024-04-26T20:58:26.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.596+0000 7fce6f800640 1 -- 172.21.15.138:0/3021062573 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fce4c003a30 msgr2=0x7fce680b68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:26.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.596+0000 7fce6f800640 1 --2- 172.21.15.138:0/3021062573 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fce4c003a30 0x7fce680b68a0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fce5801c9f0 tx=0x7fce4c005840 comp rx=0 tx=0).stop 2024-04-26T20:58:26.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.596+0000 7fce6f800640 1 -- 172.21.15.138:0/3021062573 shutdown_connections 2024-04-26T20:58:26.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.596+0000 7fce6f800640 1 --2- 172.21.15.138:0/3021062573 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fce44068380 0x7fce4406a840 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.596+0000 7fce6f800640 1 --2- 172.21.15.138:0/3021062573 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fce68162050 0x7fce6815ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.596+0000 7fce6f800640 1 --2- 172.21.15.138:0/3021062573 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce68156fd0 0x7fce68161b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.596+0000 7fce6f800640 1 --2- 172.21.15.138:0/3021062573 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fce4c003a30 0x7fce680b68a0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.596+0000 7fce6f800640 1 -- 172.21.15.138:0/3021062573 >> 172.21.15.138:0/3021062573 conn(0x7fce680d2d30 msgr2=0x7fce6815f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:26.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.596+0000 7fce6f800640 1 -- 172.21.15.138:0/3021062573 shutdown_connections 2024-04-26T20:58:26.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.596+0000 7fce6f800640 1 -- 172.21.15.138:0/3021062573 wait complete. 2024-04-26T20:58:26.616 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start / force,recursive,repair 2024-04-26T20:58:26.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.756+0000 7f55c7400640 1 Processor -- start 2024-04-26T20:58:26.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.756+0000 7f55c7400640 1 -- start start 2024-04-26T20:58:26.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.760+0000 7f55c7400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f55c015bc40 0x7f55c0073e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.760+0000 7f55c7400640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f55c00cc2e0 0x7f55c00ce720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.760+0000 7f55c7400640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55c006e1a0 con 0x7f55c015c020 2024-04-26T20:58:26.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.760+0000 7f55c7400640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f55c006e480 con 0x7f55c015bc40 2024-04-26T20:58:26.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.760+0000 7f55c7400640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f55c0073380 con 0x7f55c00cc2e0 2024-04-26T20:58:26.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.760+0000 7f55b7e00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f55c015c020 0x7f55c00cbbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:32854/0 (socket says 172.21.15.138:32854) 2024-04-26T20:58:26.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.760+0000 7f55b7e00640 1 -- 172.21.15.138:0/1325623712 learned_addr learned my addr 172.21.15.138:0/1325623712 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:26.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.760+0000 7f55c4a00640 1 --2- 172.21.15.138:0/1325623712 >> v2:172.21.15.138:3300/0 conn(0x7f55c015bc40 0x7f55c0073e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:26.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.760+0000 7f55c5400640 1 --2- 172.21.15.138:0/1325623712 >> v2:172.21.15.143:3300/0 conn(0x7f55c00cc2e0 0x7f55c00ce720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:26.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.760+0000 7f55c4a00640 1 -- 172.21.15.138:0/1325623712 >> v2:172.21.15.143:3300/0 conn(0x7f55c00cc2e0 msgr2=0x7f55c00ce720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:26.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.760+0000 7f55c4a00640 1 --2- 172.21.15.138:0/1325623712 >> v2:172.21.15.143:3300/0 conn(0x7f55c00cc2e0 0x7f55c00ce720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.760+0000 7f55c4a00640 1 -- 172.21.15.138:0/1325623712 >> v1:172.21.15.138:6789/0 conn(0x7f55c015c020 legacy=0x7f55c00cbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:26.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.760+0000 7f55c4a00640 1 -- 172.21.15.138:0/1325623712 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55c0073660 con 0x7f55c015bc40 2024-04-26T20:58:26.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.760+0000 7f55bfe00640 1 -- 172.21.15.138:0/1325623712 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2373383354 0 0) 0x7f55c006e1a0 con 0x7f55c015c020 2024-04-26T20:58:26.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.760+0000 7f55c5400640 1 --2- 172.21.15.138:0/1325623712 >> v2:172.21.15.143:3300/0 conn(0x7f55c00cc2e0 0x7f55c00ce720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:58:26.764 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.764+0000 7f55c4a00640 1 --2- 172.21.15.138:0/1325623712 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55c015bc40 0x7f55c0073e60 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f55c00c4620 tx=0x7f55b001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c00a865665cc2c55 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:26.764 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.764+0000 7f55bfe00640 1 -- 172.21.15.138:0/1325623712 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b00b1070 con 0x7f55c015bc40 2024-04-26T20:58:26.764 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.764+0000 7f55bfe00640 1 -- 172.21.15.138:0/1325623712 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55b00ac5f0 con 0x7f55c015bc40 2024-04-26T20:58:26.764 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.764+0000 7f55bfe00640 1 -- 172.21.15.138:0/1325623712 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b00ac9c0 con 0x7f55c015bc40 2024-04-26T20:58:26.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.764+0000 7f55c7400640 1 -- 172.21.15.138:0/1325623712 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55c015bc40 msgr2=0x7f55c0073e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:26.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.764+0000 7f55c7400640 1 --2- 172.21.15.138:0/1325623712 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55c015bc40 0x7f55c0073e60 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f55c00c4620 tx=0x7f55b001c480 comp rx=0 tx=0).stop 2024-04-26T20:58:26.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.764+0000 7f55c7400640 1 -- 172.21.15.138:0/1325623712 shutdown_connections 2024-04-26T20:58:26.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.764+0000 7f55c7400640 1 --2- 172.21.15.138:0/1325623712 >> v2:172.21.15.143:3300/0 conn(0x7f55c00cc2e0 0x7f55c00ce720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.764+0000 7f55c7400640 1 --2- 172.21.15.138:0/1325623712 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55c015bc40 0x7f55c0073e60 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.764+0000 7f55c7400640 1 -- 172.21.15.138:0/1325623712 >> 172.21.15.138:0/1325623712 conn(0x7f55c00d0b50 msgr2=0x7f55c00d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:26.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.764+0000 7f55c7400640 1 -- 172.21.15.138:0/1325623712 shutdown_connections 2024-04-26T20:58:26.766 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.764+0000 7f55c7400640 1 -- 172.21.15.138:0/1325623712 wait complete. 2024-04-26T20:58:26.766 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.764+0000 7f55c7400640 1 Processor -- start 2024-04-26T20:58:26.767 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.764+0000 7f55c7400640 1 -- start start 2024-04-26T20:58:26.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.768+0000 7f55c7400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f55c00cc2e0 0x7f55c014d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.768+0000 7f55c7400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55c015bc40 0x7f55c014c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.768+0000 7f55c7400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f55c015c020 0x7f55c014ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.768+0000 7f55c7400640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f55c0166e90 con 0x7f55c015bc40 2024-04-26T20:58:26.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.768+0000 7f55c7400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f55c0166d10 con 0x7f55c00cc2e0 2024-04-26T20:58:26.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.768+0000 7f55c7400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f55c0167010 con 0x7f55c015c020 2024-04-26T20:58:26.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.768+0000 7f55b7e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55c015bc40 0x7f55c014c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:26.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.768+0000 7f55b7e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55c015bc40 0x7f55c014c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40166/0 (socket says 172.21.15.138:40166) 2024-04-26T20:58:26.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.768+0000 7f55b7e00640 1 -- 172.21.15.138:0/412889702 learned_addr learned my addr 172.21.15.138:0/412889702 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:26.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.768+0000 7f55c4a00640 1 --2- 172.21.15.138:0/412889702 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f55c00cc2e0 0x7f55c014d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:26.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.768+0000 7f55c5400640 1 --2- 172.21.15.138:0/412889702 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f55c015c020 0x7f55c014ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:26.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.768+0000 7f55b7e00640 1 -- 172.21.15.138:0/412889702 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f55c015c020 msgr2=0x7f55c014ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:26.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.768+0000 7f55b7e00640 1 --2- 172.21.15.138:0/412889702 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f55c015c020 0x7f55c014ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.768+0000 7f55b7e00640 1 -- 172.21.15.138:0/412889702 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f55c00cc2e0 msgr2=0x7f55c014d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:26.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.768+0000 7f55b7e00640 1 --2- 172.21.15.138:0/412889702 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f55c00cc2e0 0x7f55c014d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.768+0000 7f55b7e00640 1 -- 172.21.15.138:0/412889702 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55c014df90 con 0x7f55c015bc40 2024-04-26T20:58:26.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.768+0000 7f55b7e00640 1 --2- 172.21.15.138:0/412889702 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55c015bc40 0x7f55c014c130 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f55a800c450 tx=0x7f55a800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:26.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.768+0000 7f55bd600640 1 -- 172.21.15.138:0/412889702 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a8018070 con 0x7f55c015bc40 2024-04-26T20:58:26.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.768+0000 7f55bd600640 1 -- 172.21.15.138:0/412889702 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55a80074e0 con 0x7f55c015bc40 2024-04-26T20:58:26.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.768+0000 7f55c7400640 1 -- 172.21.15.138:0/412889702 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55c0168f40 con 0x7f55c015bc40 2024-04-26T20:58:26.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.768+0000 7f55bd600640 1 -- 172.21.15.138:0/412889702 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a80049f0 con 0x7f55c015bc40 2024-04-26T20:58:26.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.768+0000 7f55c7400640 1 -- 172.21.15.138:0/412889702 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55c0169500 con 0x7f55c015bc40 2024-04-26T20:58:26.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.772+0000 7f55bd600640 1 -- 172.21.15.138:0/412889702 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f55a801b070 con 0x7f55c015bc40 2024-04-26T20:58:26.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.772+0000 7f55bd600640 1 --2- 172.21.15.138:0/412889702 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f559c068380 0x7f559c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.772+0000 7f55bd600640 1 -- 172.21.15.138:0/412889702 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6756+0+0 (secure 0 0 0) 0x7f55a80861d0 con 0x7f55c015bc40 2024-04-26T20:58:26.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.772+0000 7f55c4a00640 1 --2- 172.21.15.138:0/412889702 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f559c068380 0x7f559c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:26.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.772+0000 7f55ca7f6000 1 Processor -- start 2024-04-26T20:58:26.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.772+0000 7f55ca7f6000 1 -- start start 2024-04-26T20:58:26.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.772+0000 7f55c4a00640 1 --2- 172.21.15.138:0/412889702 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f559c068380 0x7f559c06a840 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f55b00ae000 tx=0x7f55b00a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:26.777 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.772+0000 7f55ca7f6000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5628c94a4da0 0x5628c94a5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.777 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.772+0000 7f55ca7f6000 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5628c94a56c0 0x5628c945acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.777 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.772+0000 7f55ca7f6000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628c945b1f0 0x5628c945b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.777 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.772+0000 7f55ca7f6000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5628c92a8cc0 con 0x5628c945b1f0 2024-04-26T20:58:26.777 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.772+0000 7f55ca7f6000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x5628c9261b10 con 0x5628c94a4da0 2024-04-26T20:58:26.777 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.772+0000 7f55ca7f6000 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x5628c92a4c80 con 0x5628c94a56c0 2024-04-26T20:58:26.777 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.772+0000 7f55c5400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628c945b1f0 0x5628c945b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:26.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.772+0000 7f55c5400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628c945b1f0 0x5628c945b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40176/0 (socket says 172.21.15.138:40176) 2024-04-26T20:58:26.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.772+0000 7f55c5400640 1 -- 172.21.15.138:0/1548134918 learned_addr learned my addr 172.21.15.138:0/1548134918 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:26.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.772+0000 7f55c4a00640 1 --2- 172.21.15.138:0/1548134918 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5628c94a4da0 0x5628c94a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:26.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.772+0000 7f55b7e00640 1 --2- 172.21.15.138:0/1548134918 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5628c94a56c0 0x5628c945acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:26.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.772+0000 7f55c5400640 1 -- 172.21.15.138:0/1548134918 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5628c94a56c0 msgr2=0x5628c945acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:26.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.772+0000 7f55c5400640 1 --2- 172.21.15.138:0/1548134918 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5628c94a56c0 0x5628c945acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.772+0000 7f55c5400640 1 -- 172.21.15.138:0/1548134918 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5628c94a4da0 msgr2=0x5628c94a5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:26.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.772+0000 7f55c5400640 1 --2- 172.21.15.138:0/1548134918 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5628c94a4da0 0x5628c94a5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.772+0000 7f55c5400640 1 -- 172.21.15.138:0/1548134918 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628c922b660 con 0x5628c945b1f0 2024-04-26T20:58:26.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.772+0000 7f55c5400640 1 --2- 172.21.15.138:0/1548134918 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628c945b1f0 0x5628c945b5d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f55b800d560 tx=0x7f55b800da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adfa59abe643af5e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:26.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.772+0000 7f55b5600640 1 -- 172.21.15.138:0/1548134918 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b800c8b0 con 0x5628c945b1f0 2024-04-26T20:58:26.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.772+0000 7f55b5600640 1 -- 172.21.15.138:0/1548134918 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55b800ca50 con 0x5628c945b1f0 2024-04-26T20:58:26.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.772+0000 7f55b5600640 1 -- 172.21.15.138:0/1548134918 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b800ce20 con 0x5628c945b1f0 2024-04-26T20:58:26.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.776+0000 7f55ca7f6000 1 -- 172.21.15.138:0/1548134918 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628c945b1f0 msgr2=0x5628c945b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:26.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.776+0000 7f55ca7f6000 1 --2- 172.21.15.138:0/1548134918 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628c945b1f0 0x5628c945b5d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f55b800d560 tx=0x7f55b800da20 comp rx=0 tx=0).stop 2024-04-26T20:58:26.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.776+0000 7f55ca7f6000 1 -- 172.21.15.138:0/1548134918 shutdown_connections 2024-04-26T20:58:26.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.776+0000 7f55ca7f6000 1 --2- 172.21.15.138:0/1548134918 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628c945b1f0 0x5628c945b5d0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.776+0000 7f55ca7f6000 1 --2- 172.21.15.138:0/1548134918 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5628c94a56c0 0x5628c945acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.776+0000 7f55ca7f6000 1 --2- 172.21.15.138:0/1548134918 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5628c94a4da0 0x5628c94a5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.776+0000 7f55ca7f6000 1 -- 172.21.15.138:0/1548134918 >> 172.21.15.138:0/1548134918 conn(0x5628c93428f0 msgr2=0x5628c9459590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:26.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.776+0000 7f55ca7f6000 1 -- 172.21.15.138:0/1548134918 shutdown_connections 2024-04-26T20:58:26.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.776+0000 7f55ca7f6000 1 -- 172.21.15.138:0/1548134918 wait complete. 2024-04-26T20:58:26.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.776+0000 7f55ca7f6000 1 -- start start 2024-04-26T20:58:26.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.776+0000 7f55ca7f6000 1 Processor -- start 2024-04-26T20:58:26.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.776+0000 7f55ca7f6000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5628c945b1f0 0x5628c945f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.776+0000 7f55ca7f6000 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5628c94a4da0 0x5628c945fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.776+0000 7f55ca7f6000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628c94a56c0 0x5628c948a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.776+0000 7f55ca7f6000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5628c932b570 con 0x5628c94a56c0 2024-04-26T20:58:26.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.776+0000 7f55ca7f6000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x5628c9362840 con 0x5628c945b1f0 2024-04-26T20:58:26.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.776+0000 7f55ca7f6000 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x5628c9365ef0 con 0x5628c94a4da0 2024-04-26T20:58:26.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.776+0000 7f55ca7f6000 10 client.0 _ll_register_callbacks cb 0x5628c92b5c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:58:26.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.776+0000 7f55c5400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628c94a56c0 0x5628c948a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:26.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.776+0000 7f55c5400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628c94a56c0 0x5628c948a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40182/0 (socket says 172.21.15.138:40182) 2024-04-26T20:58:26.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.776+0000 7f55c5400640 1 -- 172.21.15.138:0/4162460765 learned_addr learned my addr 172.21.15.138:0/4162460765 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:26.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.776+0000 7f55b7e00640 1 --2- 172.21.15.138:0/4162460765 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5628c94a4da0 0x5628c945fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:26.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.776+0000 7f55c4a00640 1 --2- 172.21.15.138:0/4162460765 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5628c945b1f0 0x5628c945f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:26.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.776+0000 7f55c5400640 1 -- 172.21.15.138:0/4162460765 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5628c94a4da0 msgr2=0x5628c945fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:26.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.776+0000 7f55c5400640 1 --2- 172.21.15.138:0/4162460765 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5628c94a4da0 0x5628c945fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.776+0000 7f55c5400640 1 -- 172.21.15.138:0/4162460765 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5628c945b1f0 msgr2=0x5628c945f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:26.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.776+0000 7f55c5400640 1 --2- 172.21.15.138:0/4162460765 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5628c945b1f0 0x5628c945f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.776+0000 7f55c5400640 1 -- 172.21.15.138:0/4162460765 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628c926a480 con 0x5628c94a56c0 2024-04-26T20:58:26.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.776+0000 7f55c5400640 1 --2- 172.21.15.138:0/4162460765 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628c94a56c0 0x5628c948a1f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x5628c935def0 tx=0x7f55b8004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c2e0636327d1468 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:26.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.776+0000 7f55ae000640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-04-26T20:58:26.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.776+0000 7f55ae000640 1 -- 172.21.15.138:0/4162460765 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b8017420 con 0x5628c94a56c0 2024-04-26T20:58:26.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.776+0000 7f55ca7f6000 1 -- 172.21.15.138:0/4162460765 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55b800ca50 con 0x5628c94a56c0 2024-04-26T20:58:26.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.776+0000 7f55ae000640 1 -- 172.21.15.138:0/4162460765 <== mon.0 v2:172.21.15.138:3300/0 2 ==== osd_map(51..51 src has 1..51) ==== 6756+0+0 (secure 0 0 0) 0x7f55b80175c0 con 0x5628c94a56c0 2024-04-26T20:58:26.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.776+0000 7f55ae000640 1 -- 172.21.15.138:0/4162460765 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f55b802d050 con 0x5628c94a56c0 2024-04-26T20:58:26.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.776+0000 7f55ca7f6000 10 client.5919 fetch_fsmap learned FSMap version 28 2024-04-26T20:58:26.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.776+0000 7f55ca7f6000 1 -- 172.21.15.138:0/4162460765 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x5628c9261d60 con 0x5628c94a56c0 2024-04-26T20:58:26.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.776+0000 7f55ae000640 1 -- 172.21.15.138:0/4162460765 <== mon.0 v2:172.21.15.138:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55b800ca50 con 0x5628c94a56c0 2024-04-26T20:58:26.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.780+0000 7f55ae000640 1 -- 172.21.15.138:0/4162460765 <== mon.0 v2:172.21.15.138:3300/0 5 ==== fsmap(e 28) ==== 4139+0+0 (secure 0 0 0) 0x7f55b8030020 con 0x5628c94a56c0 2024-04-26T20:58:26.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.780+0000 7f55ca7f6000 10 client.5919 fetch_fsmap finished waiting for FSMap version 28 2024-04-26T20:58:26.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.780+0000 7f55ca7f6000 10 client.5919 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-26T20:58:26.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.780+0000 7f55ca7f6000 20 client.5919 populate_metadata read hostname 'smithi138' 2024-04-26T20:58:26.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.780+0000 7f55ca7f6000 1 --2- 172.21.15.138:0/4162460765 >> [v2:172.21.15.138:6832/2450256246,v1:172.21.15.138:6834/2450256246] conn(0x5628c948ac00 0x5628c94b6e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.780+0000 7f55ca7f6000 4 client.5919 mds_command: new command op to 5604 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:58:26.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.780+0000 7f55ca7f6000 1 -- 172.21.15.138:0/4162460765 --> [v2:172.21.15.138:6832/2450256246,v1:172.21.15.138:6834/2450256246] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5628c9241b40 con 0x5628c948ac00 2024-04-26T20:58:26.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.780+0000 7f55c4a00640 1 --2- 172.21.15.138:0/4162460765 >> [v2:172.21.15.138:6832/2450256246,v1:172.21.15.138:6834/2450256246] conn(0x5628c948ac00 0x5628c94b6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:26.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.780+0000 7f55c4a00640 1 --2- 172.21.15.138:0/4162460765 >> [v2:172.21.15.138:6832/2450256246,v1:172.21.15.138:6834/2450256246] conn(0x5628c948ac00 0x5628c94b6e50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28cfc2341c6f6c31 server_cookie=91f5290224dc41d6 in_seq=0 out_seq=0 2024-04-26T20:58:26.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.780+0000 7f55ae000640 10 client.5919 ms_handle_connect on v2:172.21.15.138:6832/2450256246 2024-04-26T20:58:26.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.780+0000 7f55ae000640 1 -- 172.21.15.138:0/4162460765 <== mds.0 v2:172.21.15.138:6832/2450256246 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5628c9241b40 con 0x5628c948ac00 2024-04-26T20:58:26.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.780+0000 7f55ae000640 10 client.5919 handle_command_reply: tid=0 2024-04-26T20:58:26.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.780+0000 7f55ca7f6000 1 client.5919 shutdown 2024-04-26T20:58:26.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.780+0000 7f55ca7f6000 1 -- 172.21.15.138:0/4162460765 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628c94a56c0 msgr2=0x5628c948a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:26.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.780+0000 7f55ca7f6000 1 --2- 172.21.15.138:0/4162460765 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628c94a56c0 0x5628c948a1f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x5628c935def0 tx=0x7f55b8004ac0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.780+0000 7f55ca7f6000 1 -- 172.21.15.138:0/4162460765 shutdown_connections 2024-04-26T20:58:26.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.780+0000 7f55ca7f6000 1 --2- 172.21.15.138:0/4162460765 >> [v2:172.21.15.138:6832/2450256246,v1:172.21.15.138:6834/2450256246] conn(0x5628c948ac00 0x5628c94b6e50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.780+0000 7f55ca7f6000 1 --2- 172.21.15.138:0/4162460765 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628c94a56c0 0x5628c948a1f0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.780+0000 7f55ca7f6000 1 --2- 172.21.15.138:0/4162460765 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5628c94a4da0 0x5628c945fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.780+0000 7f55ca7f6000 1 --2- 172.21.15.138:0/4162460765 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5628c945b1f0 0x5628c945f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.780+0000 7f55ae000640 0 client.5919 ms_handle_reset on v2:172.21.15.138:6832/2450256246 2024-04-26T20:58:26.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.780+0000 7f55ca7f6000 1 -- 172.21.15.138:0/4162460765 >> 172.21.15.138:0/4162460765 conn(0x5628c93428f0 msgr2=0x5628c9459590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:26.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.780+0000 7f55ca7f6000 1 -- 172.21.15.138:0/4162460765 shutdown_connections 2024-04-26T20:58:26.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.780+0000 7f55ca7f6000 1 -- 172.21.15.138:0/4162460765 wait complete. 2024-04-26T20:58:26.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.780+0000 7f55ca7f6000 20 client.5919 trim_cache size 0 max 16384 2024-04-26T20:58:26.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.796+0000 7f55ca7f6000 1 Processor -- start 2024-04-26T20:58:26.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.796+0000 7f55ca7f6000 1 -- start start 2024-04-26T20:58:26.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.800+0000 7f55ca7f6000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628c945b1f0 0x5628c9459d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.800+0000 7f55ca7f6000 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5628c94a4da0 0x5628c945a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.800+0000 7f55ca7f6000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5628c94a56c0 0x5628c94a30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.800+0000 7f55ca7f6000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f55c0205350 con 0x5628c945b1f0 2024-04-26T20:58:26.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.800+0000 7f55ca7f6000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f55c02046a0 con 0x5628c94a56c0 2024-04-26T20:58:26.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.800+0000 7f55ca7f6000 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f55c0204cf0 con 0x5628c94a4da0 2024-04-26T20:58:26.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.800+0000 7f55c4a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628c945b1f0 0x5628c9459d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:26.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.800+0000 7f55c4a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628c945b1f0 0x5628c9459d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40194/0 (socket says 172.21.15.138:40194) 2024-04-26T20:58:26.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.800+0000 7f55c4a00640 1 -- 172.21.15.138:0/596833256 learned_addr learned my addr 172.21.15.138:0/596833256 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:26.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.800+0000 7f55c4a00640 1 -- 172.21.15.138:0/596833256 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5628c94a4da0 msgr2=0x5628c945a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:26.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.800+0000 7f55c4a00640 1 --2- 172.21.15.138:0/596833256 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5628c94a4da0 0x5628c945a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.800+0000 7f55c4a00640 1 -- 172.21.15.138:0/596833256 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5628c94a56c0 msgr2=0x5628c94a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:26.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.800+0000 7f55c4a00640 1 --2- 172.21.15.138:0/596833256 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5628c94a56c0 0x5628c94a30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.800+0000 7f55c4a00640 1 -- 172.21.15.138:0/596833256 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628c932ba00 con 0x5628c945b1f0 2024-04-26T20:58:26.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.800+0000 7f55c4a00640 1 --2- 172.21.15.138:0/596833256 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628c945b1f0 0x5628c9459d10 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f55b00af040 tx=0x7f55b0004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fde7d5f30799574 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:26.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.800+0000 7f55b4c00640 1 -- 172.21.15.138:0/596833256 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b00bb040 con 0x5628c945b1f0 2024-04-26T20:58:26.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.800+0000 7f55b4c00640 1 -- 172.21.15.138:0/596833256 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55b00d2070 con 0x5628c945b1f0 2024-04-26T20:58:26.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.800+0000 7f55b4c00640 1 -- 172.21.15.138:0/596833256 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b00b1050 con 0x5628c945b1f0 2024-04-26T20:58:26.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.800+0000 7f55ca7f6000 1 -- 172.21.15.138:0/596833256 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628c945b1f0 msgr2=0x5628c9459d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:26.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.800+0000 7f55ca7f6000 1 --2- 172.21.15.138:0/596833256 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628c945b1f0 0x5628c9459d10 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f55b00af040 tx=0x7f55b0004740 comp rx=0 tx=0).stop 2024-04-26T20:58:26.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.800+0000 7f55ca7f6000 1 -- 172.21.15.138:0/596833256 shutdown_connections 2024-04-26T20:58:26.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.800+0000 7f55ca7f6000 1 --2- 172.21.15.138:0/596833256 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5628c94a56c0 0x5628c94a30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.800+0000 7f55ca7f6000 1 --2- 172.21.15.138:0/596833256 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5628c94a4da0 0x5628c945a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.800+0000 7f55ca7f6000 1 --2- 172.21.15.138:0/596833256 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628c945b1f0 0x5628c9459d10 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.800+0000 7f55ca7f6000 1 -- 172.21.15.138:0/596833256 >> 172.21.15.138:0/596833256 conn(0x5628c93428f0 msgr2=0x5628c94b2390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:26.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.800+0000 7f55ca7f6000 1 -- 172.21.15.138:0/596833256 shutdown_connections 2024-04-26T20:58:26.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.800+0000 7f55ca7f6000 1 -- 172.21.15.138:0/596833256 wait complete. 2024-04-26T20:58:26.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.800+0000 7f55ca7f6000 1 -- start start 2024-04-26T20:58:26.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.800+0000 7f55ca7f6000 1 Processor -- start 2024-04-26T20:58:26.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.800+0000 7f55ca7f6000 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5628c945b1f0 0x5628c94ba270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.800+0000 7f55ca7f6000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628c94a4da0 0x5628c9459d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.800+0000 7f55ca7f6000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5628c94a56c0 0x5628c945a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.800+0000 7f55ca7f6000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5628c9243090 con 0x5628c94a4da0 2024-04-26T20:58:26.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.800+0000 7f55ca7f6000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x5628c926f670 con 0x5628c94a56c0 2024-04-26T20:58:26.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.800+0000 7f55ca7f6000 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x5628c923e730 con 0x5628c945b1f0 2024-04-26T20:58:26.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.800+0000 7f55ca7f6000 10 client.0 _ll_register_callbacks cb 0x7f55b00af070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:58:26.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.804+0000 7f55b7e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628c94a4da0 0x5628c9459d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:26.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.804+0000 7f55b7e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628c94a4da0 0x5628c9459d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40204/0 (socket says 172.21.15.138:40204) 2024-04-26T20:58:26.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.804+0000 7f55b7e00640 1 -- 172.21.15.138:0/4120085114 learned_addr learned my addr 172.21.15.138:0/4120085114 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:26.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.804+0000 7f55c5400640 1 --2- 172.21.15.138:0/4120085114 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5628c94a56c0 0x5628c945a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:26.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.804+0000 7f55c4a00640 1 --2- 172.21.15.138:0/4120085114 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5628c945b1f0 0x5628c94ba270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:26.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.804+0000 7f55b7e00640 1 -- 172.21.15.138:0/4120085114 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5628c945b1f0 msgr2=0x5628c94ba270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:26.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.804+0000 7f55b7e00640 1 --2- 172.21.15.138:0/4120085114 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5628c945b1f0 0x5628c94ba270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.804+0000 7f55b7e00640 1 -- 172.21.15.138:0/4120085114 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5628c94a56c0 msgr2=0x5628c945a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:26.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.804+0000 7f55b7e00640 1 --2- 172.21.15.138:0/4120085114 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5628c94a56c0 0x5628c945a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.804+0000 7f55b7e00640 1 -- 172.21.15.138:0/4120085114 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628c9302710 con 0x5628c94a4da0 2024-04-26T20:58:26.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.804+0000 7f55b7e00640 1 --2- 172.21.15.138:0/4120085114 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628c94a4da0 0x5628c9459d50 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f55a800ce10 tx=0x7f55a8059ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d98ed137f85b91d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:26.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.804+0000 7f55ae000640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-04-26T20:58:26.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.804+0000 7f55ae000640 1 -- 172.21.15.138:0/4120085114 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a8004b90 con 0x5628c94a4da0 2024-04-26T20:58:26.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.804+0000 7f55ae000640 1 -- 172.21.15.138:0/4120085114 <== mon.0 v2:172.21.15.138:3300/0 2 ==== osd_map(51..51 src has 1..51) ==== 6756+0+0 (secure 0 0 0) 0x7f55a8004d30 con 0x5628c94a4da0 2024-04-26T20:58:26.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.804+0000 7f55ca7f6000 1 -- 172.21.15.138:0/4120085114 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55b00d2070 con 0x5628c94a4da0 2024-04-26T20:58:26.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.804+0000 7f55ae000640 1 -- 172.21.15.138:0/4120085114 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f55a807dba0 con 0x5628c94a4da0 2024-04-26T20:58:26.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.804+0000 7f55ca7f6000 10 client.5925 fetch_fsmap learned FSMap version 28 2024-04-26T20:58:26.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.804+0000 7f55ca7f6000 1 -- 172.21.15.138:0/4120085114 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x5628c8f62150 con 0x5628c94a4da0 2024-04-26T20:58:26.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.804+0000 7f55ae000640 1 -- 172.21.15.138:0/4120085114 <== mon.0 v2:172.21.15.138:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55b00d2070 con 0x5628c94a4da0 2024-04-26T20:58:26.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.804+0000 7f55ae000640 1 -- 172.21.15.138:0/4120085114 <== mon.0 v2:172.21.15.138:3300/0 5 ==== fsmap(e 28) ==== 4139+0+0 (secure 0 0 0) 0x7f55a8055040 con 0x5628c94a4da0 2024-04-26T20:58:26.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.804+0000 7f55ca7f6000 10 client.5925 fetch_fsmap finished waiting for FSMap version 28 2024-04-26T20:58:26.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.804+0000 7f55ca7f6000 10 client.5925 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-26T20:58:26.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.804+0000 7f55ca7f6000 20 client.5925 populate_metadata read hostname 'smithi138' 2024-04-26T20:58:26.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.804+0000 7f55ca7f6000 1 --2- 172.21.15.138:0/4120085114 >> [v2:172.21.15.138:6832/2450256246,v1:172.21.15.138:6834/2450256246] conn(0x5628c94b7330 0x5628c94b7740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.804+0000 7f55ca7f6000 4 client.5925 mds_command: new command op to 5604 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive", "repair"]}] 2024-04-26T20:58:26.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.804+0000 7f55ca7f6000 1 -- 172.21.15.138:0/4120085114 --> [v2:172.21.15.138:6832/2450256246,v1:172.21.15.138:6834/2450256246] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive", "repair"]}) -- 0x5628c92b68d0 con 0x5628c94b7330 2024-04-26T20:58:26.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.804+0000 7f55c4a00640 1 --2- 172.21.15.138:0/4120085114 >> [v2:172.21.15.138:6832/2450256246,v1:172.21.15.138:6834/2450256246] conn(0x5628c94b7330 0x5628c94b7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:26.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.804+0000 7f55c4a00640 1 --2- 172.21.15.138:0/4120085114 >> [v2:172.21.15.138:6832/2450256246,v1:172.21.15.138:6834/2450256246] conn(0x5628c94b7330 0x5628c94b7740 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4651fd40c84c84df server_cookie=c1974801df96ebff in_seq=0 out_seq=0 2024-04-26T20:58:26.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.804+0000 7f55ae000640 10 client.5925 ms_handle_connect on v2:172.21.15.138:6832/2450256246 2024-04-26T20:58:26.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.804+0000 7f55ae000640 1 -- 172.21.15.138:0/4120085114 <== mds.0 v2:172.21.15.138:6832/2450256246 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5628c92b68d0 con 0x5628c94b7330 2024-04-26T20:58:26.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.804+0000 7f55ae000640 10 client.5925 handle_command_reply: tid=0 2024-04-26T20:58:26.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.804+0000 7f55ca7f6000 1 client.5925 shutdown 2024-04-26T20:58:26.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.804+0000 7f55ca7f6000 1 -- 172.21.15.138:0/4120085114 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628c94a4da0 msgr2=0x5628c9459d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:26.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.804+0000 7f55ca7f6000 1 --2- 172.21.15.138:0/4120085114 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628c94a4da0 0x5628c9459d50 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f55a800ce10 tx=0x7f55a8059ef0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.811 INFO:tasks.ceph.mds.a.smithi138.stderr:2024-04-26T20:58:26.804+0000 7f143cc00640 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x10000000000 2024-04-26T20:58:26.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.804+0000 7f55ca7f6000 1 -- 172.21.15.138:0/4120085114 shutdown_connections 2024-04-26T20:58:26.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.804+0000 7f55ca7f6000 1 --2- 172.21.15.138:0/4120085114 >> [v2:172.21.15.138:6832/2450256246,v1:172.21.15.138:6834/2450256246] conn(0x5628c94b7330 0x5628c94b7740 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.804+0000 7f55ca7f6000 1 --2- 172.21.15.138:0/4120085114 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5628c94a56c0 0x5628c945a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.804+0000 7f55ca7f6000 1 --2- 172.21.15.138:0/4120085114 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628c94a4da0 0x5628c9459d50 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.804+0000 7f55ca7f6000 1 --2- 172.21.15.138:0/4120085114 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5628c945b1f0 0x5628c94ba270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.804+0000 7f55ae000640 0 client.5925 ms_handle_reset on v2:172.21.15.138:6832/2450256246 2024-04-26T20:58:26.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.804+0000 7f55ca7f6000 1 -- 172.21.15.138:0/4120085114 >> 172.21.15.138:0/4120085114 conn(0x5628c93428f0 msgr2=0x5628c94891a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:26.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.804+0000 7f55ca7f6000 1 -- 172.21.15.138:0/4120085114 shutdown_connections 2024-04-26T20:58:26.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.804+0000 7f55ca7f6000 1 -- 172.21.15.138:0/4120085114 wait complete. 2024-04-26T20:58:26.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.804+0000 7f55ca7f6000 20 client.5925 trim_cache size 0 max 16384 2024-04-26T20:58:26.813 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-26T20:58:26.813 INFO:teuthology.orchestra.run.smithi138.stdout: "return_code": 0, 2024-04-26T20:58:26.813 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_tag": "34f3503f-8cac-45de-bdc1-9a2daf2a255b", 2024-04-26T20:58:26.813 INFO:teuthology.orchestra.run.smithi138.stdout: "mode": "asynchronous" 2024-04-26T20:58:26.813 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-26T20:58:26.813 INFO:tasks.ceph.mds.a.smithi138.stderr:2024-04-26T20:58:26.808+0000 7f143cc00640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /subdir/ auth v1 pv4 ap=3 DIRTYPARENT f(v0 1=1+0) n() (inest lock dirty) (ifile lock->sync w=1 flushing) | dirtyscattered=2 lock=1 dirfrag=1 dirtyparent=1 waiter=1 authpin=1 scrubqueue=0 0x559ec5673180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000000:[<0x1/subdir v1>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 1=1+0)","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 1=1+0)","memory_value.rstat":"n()","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-61} 2024-04-26T20:58:26.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.808+0000 7f55c7400640 1 -- 172.21.15.138:0/412889702 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f559c068380 msgr2=0x7f559c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:26.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.808+0000 7f55c7400640 1 --2- 172.21.15.138:0/412889702 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f559c068380 0x7f559c06a840 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f55b00ae000 tx=0x7f55b00a7000 comp rx=0 tx=0).stop 2024-04-26T20:58:26.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.808+0000 7f55c7400640 1 -- 172.21.15.138:0/412889702 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55c015bc40 msgr2=0x7f55c014c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:26.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.808+0000 7f55c7400640 1 --2- 172.21.15.138:0/412889702 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55c015bc40 0x7f55c014c130 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f55a800c450 tx=0x7f55a800c910 comp rx=0 tx=0).stop 2024-04-26T20:58:26.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.808+0000 7f55c7400640 1 -- 172.21.15.138:0/412889702 shutdown_connections 2024-04-26T20:58:26.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.808+0000 7f55c7400640 1 --2- 172.21.15.138:0/412889702 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f559c068380 0x7f559c06a840 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.808+0000 7f55c7400640 1 --2- 172.21.15.138:0/412889702 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f55c015c020 0x7f55c014ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.808+0000 7f55c7400640 1 --2- 172.21.15.138:0/412889702 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55c015bc40 0x7f55c014c130 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.808+0000 7f55c7400640 1 --2- 172.21.15.138:0/412889702 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f55c00cc2e0 0x7f55c014d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.808+0000 7f55c7400640 1 -- 172.21.15.138:0/412889702 >> 172.21.15.138:0/412889702 conn(0x7f55c00d0b50 msgr2=0x7f55c006e600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:26.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.808+0000 7f55c7400640 1 -- 172.21.15.138:0/412889702 shutdown_connections 2024-04-26T20:58:26.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.808+0000 7f55c7400640 1 -- 172.21.15.138:0/412889702 wait complete. 2024-04-26T20:58:26.816 INFO:tasks.ceph.mds.a.smithi138.stderr:2024-04-26T20:58:26.808+0000 7f143cc00640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /subdir/sixmegs auth v1 ap=1 DIRTYPARENT s=6291456 n() | dirtyparent=1 authpin=1 scrubqueue=0 0x559ec5710580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(6)0x10000000001:[<0x10000000000/sixmegs v10>,<0x1/subdir v12>]//[]","memoryvalue":"(6)0x10000000001:[<0x10000000000/sixmegs v1>,<0x1/subdir v1>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:58:26.816 INFO:tasks.ceph.mds.a.smithi138.stderr:2024-04-26T20:58:26.812+0000 7f143cc00640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1 [...2,head] / auth v4 pv6 ap=5 snaprealm=0x559ec54be900 DIRTYPARENT f(v1 1=0+1) n(v0 1=0+1)/n() (inest mix->lock(2) w=1 flushing) (ifile mix->sync w=1 flushing) | dirtyscattered=2 lock=2 dirfrag=1 openingsnapparents=0 dirtyparent=1 dirty=1 waiter=1 authpin=1 scrubqueue=0 0x559ec5670b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x1:[]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 1=0+1)","ondisk_value.rstat":"n(v0 2=0+2)","memory_value.dirstat":"f(v1 1=0+1)","memory_value.rstat":"n(v0 1=0+1)","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-61} 2024-04-26T20:58:26.828 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:58:26.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.964+0000 7f9447400640 1 Processor -- start 2024-04-26T20:58:26.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.964+0000 7f9447400640 1 -- start start 2024-04-26T20:58:26.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.964+0000 7f9447400640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9440159250 0x7f94400cb380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.964+0000 7f9447400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f944015c270 0x7f9440072bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.964+0000 7f9447400640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9440072130 con 0x7f94400cb8c0 2024-04-26T20:58:26.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.964+0000 7f9447400640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f944015f4e0 con 0x7f9440159250 2024-04-26T20:58:26.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.964+0000 7f9447400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f944015cae0 con 0x7f944015c270 2024-04-26T20:58:26.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.964+0000 7f9444a00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9440159250 0x7f94400cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:26.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.964+0000 7f9445400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f944015c270 0x7f9440072bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:26.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.964+0000 7f943fe00640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f94400cb8c0 0x7f944015bb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.138:59646/0 (socket says 172.21.15.138:59646) 2024-04-26T20:58:26.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.964+0000 7f9444a00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9440159250 0x7f94400cb380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.138:52660/0 (socket says 172.21.15.138:52660) 2024-04-26T20:58:26.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.964+0000 7f9444a00640 1 -- 172.21.15.138:0/4117633766 learned_addr learned my addr 172.21.15.138:0/4117633766 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:26.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.964+0000 7f9445400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f944015c270 0x7f9440072bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.138:58350/0 (socket says 172.21.15.138:58350) 2024-04-26T20:58:26.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.964+0000 7f9444a00640 1 -- 172.21.15.138:0/4117633766 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f944015c270 msgr2=0x7f9440072bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:26.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.964+0000 7f9444a00640 1 --2- 172.21.15.138:0/4117633766 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f944015c270 0x7f9440072bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.964+0000 7f9444a00640 1 -- 172.21.15.138:0/4117633766 >> v1:172.21.15.143:6789/0 conn(0x7f94400cb8c0 legacy=0x7f944015bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:26.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.964+0000 7f9444a00640 1 -- 172.21.15.138:0/4117633766 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f944015c800 con 0x7f9440159250 2024-04-26T20:58:26.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.968+0000 7f9444a00640 1 --2- 172.21.15.138:0/4117633766 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9440159250 0x7f94400cb380 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f943400bb10 tx=0x7f943401ec30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5b6f96f088a9e42 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:26.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.968+0000 7f943f400640 1 -- 172.21.15.138:0/4117633766 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94340b4070 con 0x7f9440159250 2024-04-26T20:58:26.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.968+0000 7f943f400640 1 -- 172.21.15.138:0/4117633766 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94340a7a80 con 0x7f9440159250 2024-04-26T20:58:26.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.968+0000 7f943f400640 1 -- 172.21.15.138:0/4117633766 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94340a7e50 con 0x7f9440159250 2024-04-26T20:58:26.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.968+0000 7f9447400640 1 -- 172.21.15.138:0/4117633766 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9440159250 msgr2=0x7f94400cb380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:26.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.968+0000 7f9447400640 1 --2- 172.21.15.138:0/4117633766 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9440159250 0x7f94400cb380 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f943400bb10 tx=0x7f943401ec30 comp rx=0 tx=0).stop 2024-04-26T20:58:26.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.968+0000 7f9447400640 1 -- 172.21.15.138:0/4117633766 shutdown_connections 2024-04-26T20:58:26.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.968+0000 7f9447400640 1 --2- 172.21.15.138:0/4117633766 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f944015c270 0x7f9440072bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.968+0000 7f9447400640 1 --2- 172.21.15.138:0/4117633766 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9440159250 0x7f94400cb380 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.968+0000 7f9447400640 1 -- 172.21.15.138:0/4117633766 >> 172.21.15.138:0/4117633766 conn(0x7f94400d0b20 msgr2=0x7f94400d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:26.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.968+0000 7f9447400640 1 -- 172.21.15.138:0/4117633766 shutdown_connections 2024-04-26T20:58:26.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.968+0000 7f9447400640 1 -- 172.21.15.138:0/4117633766 wait complete. 2024-04-26T20:58:26.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.972+0000 7f9447400640 1 Processor -- start 2024-04-26T20:58:26.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.972+0000 7f9447400640 1 -- start start 2024-04-26T20:58:26.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.972+0000 7f9447400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94400cb8c0 0x7f9440152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.972+0000 7f9447400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9440159250 0x7f94400cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.972+0000 7f9447400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f944015c270 0x7f94400b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.972+0000 7f9447400640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f9440073cb0 con 0x7f94400cb8c0 2024-04-26T20:58:26.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.972+0000 7f9447400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f9440073b30 con 0x7f9440159250 2024-04-26T20:58:26.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.972+0000 7f9447400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f9440073e30 con 0x7f944015c270 2024-04-26T20:58:26.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.972+0000 7f9444a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94400cb8c0 0x7f9440152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:26.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.972+0000 7f9444a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94400cb8c0 0x7f9440152f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40216/0 (socket says 172.21.15.138:40216) 2024-04-26T20:58:26.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.972+0000 7f9444a00640 1 -- 172.21.15.138:0/322854412 learned_addr learned my addr 172.21.15.138:0/322854412 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:26.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.972+0000 7f9445400640 1 --2- 172.21.15.138:0/322854412 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f944015c270 0x7f94400b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:26.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.972+0000 7f943fe00640 1 --2- 172.21.15.138:0/322854412 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9440159250 0x7f94400cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:26.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.972+0000 7f9444a00640 1 -- 172.21.15.138:0/322854412 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f944015c270 msgr2=0x7f94400b0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:26.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.972+0000 7f9444a00640 1 --2- 172.21.15.138:0/322854412 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f944015c270 0x7f94400b0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.972+0000 7f9444a00640 1 -- 172.21.15.138:0/322854412 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9440159250 msgr2=0x7f94400cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:26.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.972+0000 7f9444a00640 1 --2- 172.21.15.138:0/322854412 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9440159250 0x7f94400cdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:26.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.972+0000 7f9444a00640 1 -- 172.21.15.138:0/322854412 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94400ce8b0 con 0x7f94400cb8c0 2024-04-26T20:58:26.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.972+0000 7f9444a00640 1 --2- 172.21.15.138:0/322854412 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94400cb8c0 0x7f9440152f60 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f943401c860 tx=0x7f943401b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:26.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.972+0000 7f943cc00640 1 -- 172.21.15.138:0/322854412 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94340be070 con 0x7f94400cb8c0 2024-04-26T20:58:26.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.972+0000 7f9447400640 1 -- 172.21.15.138:0/322854412 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94400ceb90 con 0x7f94400cb8c0 2024-04-26T20:58:26.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.972+0000 7f943cc00640 1 -- 172.21.15.138:0/322854412 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94340afe40 con 0x7f94400cb8c0 2024-04-26T20:58:26.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.972+0000 7f943cc00640 1 -- 172.21.15.138:0/322854412 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94340b4040 con 0x7f94400cb8c0 2024-04-26T20:58:26.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.972+0000 7f9447400640 1 -- 172.21.15.138:0/322854412 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9440153910 con 0x7f94400cb8c0 2024-04-26T20:58:26.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.976+0000 7f9447400640 1 -- 172.21.15.138:0/322854412 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9440069510 con 0x7f94400cb8c0 2024-04-26T20:58:26.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.976+0000 7f943cc00640 1 -- 172.21.15.138:0/322854412 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f94340c1070 con 0x7f94400cb8c0 2024-04-26T20:58:26.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.976+0000 7f943cc00640 1 --2- 172.21.15.138:0/322854412 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9420068380 0x7f942006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:26.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.976+0000 7f943cc00640 1 -- 172.21.15.138:0/322854412 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6756+0+0 (secure 0 0 0) 0x7f9434124180 con 0x7f94400cb8c0 2024-04-26T20:58:26.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.976+0000 7f943fe00640 1 --2- 172.21.15.138:0/322854412 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9420068380 0x7f942006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:26.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.976+0000 7f943fe00640 1 --2- 172.21.15.138:0/322854412 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9420068380 0x7f942006a840 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f94400c79b0 tx=0x7f942c007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:26.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:26.980+0000 7f943cc00640 1 -- 172.21.15.138:0/322854412 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9434018820 con 0x7f94400cb8c0 2024-04-26T20:58:27.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.168+0000 7f9447400640 1 -- 172.21.15.138:0/322854412 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f94400741a0 con 0x7f94400cb8c0 2024-04-26T20:58:27.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.168+0000 7f943cc00640 1 -- 172.21.15.138:0/322854412 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+6489 (secure 0 0 0) 0x7f94340f3ce0 con 0x7f94400cb8c0 2024-04-26T20:58:27.171 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:27.171 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":28,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5048,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/255610168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":255610168},{"type":"v1","addr":"172.21.15.143:6836","nonce":255610168}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5051,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/799063831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":799063831},{"type":"v1","addr":"172.21.15.143:6837","nonce":799063831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5410,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/976248149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":976248149},{"type":"v1","addr":"172.21.15.138:6835","nonce":976248149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:57:51.937789+0000","modified":"2024-04-26T20:58:07.183899+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":42,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2},{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:58:10.360154+0000","modified":"2024-04-26T20:58:24.737160+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5604":{"gid":5604,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.138:6834/2450256246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2450256246},{"type":"v1","addr":"172.21.15.138:6834","nonce":2450256246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":7,"enabled":true,"fs_name":"recovery_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5604,"qdb_cluster":[5604]},"id":3}]} 2024-04-26T20:58:27.171 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 28 2024-04-26T20:58:27.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.172+0000 7f9447400640 1 -- 172.21.15.138:0/322854412 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9420068380 msgr2=0x7f942006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:27.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.172+0000 7f9447400640 1 --2- 172.21.15.138:0/322854412 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9420068380 0x7f942006a840 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f94400c79b0 tx=0x7f942c007e90 comp rx=0 tx=0).stop 2024-04-26T20:58:27.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.172+0000 7f9447400640 1 -- 172.21.15.138:0/322854412 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94400cb8c0 msgr2=0x7f9440152f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:27.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.172+0000 7f9447400640 1 --2- 172.21.15.138:0/322854412 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94400cb8c0 0x7f9440152f60 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f943401c860 tx=0x7f943401b9d0 comp rx=0 tx=0).stop 2024-04-26T20:58:27.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.172+0000 7f9447400640 1 -- 172.21.15.138:0/322854412 shutdown_connections 2024-04-26T20:58:27.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.172+0000 7f9447400640 1 --2- 172.21.15.138:0/322854412 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9420068380 0x7f942006a840 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:27.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.172+0000 7f9447400640 1 --2- 172.21.15.138:0/322854412 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f944015c270 0x7f94400b0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:27.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.172+0000 7f9447400640 1 --2- 172.21.15.138:0/322854412 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9440159250 0x7f94400cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:27.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.172+0000 7f9447400640 1 --2- 172.21.15.138:0/322854412 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94400cb8c0 0x7f9440152f60 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:27.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.172+0000 7f9447400640 1 -- 172.21.15.138:0/322854412 >> 172.21.15.138:0/322854412 conn(0x7f94400d0b20 msgr2=0x7f9440159780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:27.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.172+0000 7f9447400640 1 -- 172.21.15.138:0/322854412 shutdown_connections 2024-04-26T20:58:27.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.172+0000 7f9447400640 1 -- 172.21.15.138:0/322854412 wait complete. 2024-04-26T20:58:27.193 INFO:tasks.cephfs.test_recovery_pool:{ "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 2, "epoch": 28, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-26T20:57:51.937789+0000", "damaged": [], "data_pools": [ 6 ], "enabled": true, "epoch": 19, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [ 0 ], "flags": 19, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": false, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0 ], "info": {}, "last_failure": 0, "last_failure_osd_epoch": 42, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 5, "modified": "2024-04-26T20:58:07.183899+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": {} } }, { "id": 3, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-26T20:58:10.360154+0000", "damaged": [], "data_pools": [ 6 ], "enabled": true, "epoch": 28, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "recovery_fs", "in": [ 0 ], "info": { "gid_5604": { "addr": "172.21.15.138:6834/2450256246", "addrs": { "addrvec": [ { "addr": "172.21.15.138:6832", "nonce": 2450256246, "type": "v2" }, { "addr": "172.21.15.138:6834", "nonce": 2450256246, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5604, "incarnation": 25, "join_fscid": -1, "name": "a", "rank": 0, "state": "up:active", "state_seq": 7 } }, "last_failure": 0, "last_failure_osd_epoch": 0, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 7, "modified": "2024-04-26T20:58:24.737160+0000", "qdb_cluster": [ 5604 ], "qdb_leader": 5604, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5604 } } } ], "standbys": [ { "addr": "172.21.15.143:6836/255610168", "addrs": { "addrvec": [ { "addr": "172.21.15.143:6834", "nonce": 255610168, "type": "v2" }, { "addr": "172.21.15.143:6836", "nonce": 255610168, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 20, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5048, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.143:6837/799063831", "addrs": { "addrvec": [ { "addr": "172.21.15.143:6835", "nonce": 799063831, "type": "v2" }, { "addr": "172.21.15.143:6837", "nonce": 799063831, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 20, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5051, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.138:6835/976248149", "addrs": { "addrvec": [ { "addr": "172.21.15.138:6833", "nonce": 976248149, "type": "v2" }, { "addr": "172.21.15.138:6835", "nonce": 976248149, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 20, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5410, "incarnation": 0, "join_fscid": -1, "name": "c", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-04-26T20:58:27.193 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T20:58:27.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.328+0000 7fd0d6600640 1 Processor -- start 2024-04-26T20:58:27.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.328+0000 7fd0d6600640 1 -- start start 2024-04-26T20:58:27.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.328+0000 7fd0d6600640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd0d015cf80 0x7fd0d0073b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:27.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.328+0000 7fd0d6600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd0d00cc1e0 0x7fd0d00ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:27.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.328+0000 7fd0d6600640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0d00727f0 con 0x7fd0d00cbe00 2024-04-26T20:58:27.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.328+0000 7fd0d6600640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fd0d0073680 con 0x7fd0d015cf80 2024-04-26T20:58:27.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.328+0000 7fd0d6600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fd0d0072a70 con 0x7fd0d00cc1e0 2024-04-26T20:58:27.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.328+0000 7fd0cea00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd0d015cf80 0x7fd0d0073b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:27.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.332+0000 7fd0cf400640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fd0d00cbe00 0x7fd0d006de70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:32862/0 (socket says 172.21.15.138:32862) 2024-04-26T20:58:27.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.332+0000 7fd0cf400640 1 -- 172.21.15.138:0/1092645481 learned_addr learned my addr 172.21.15.138:0/1092645481 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:27.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.332+0000 7fd0cfe00640 1 --2- 172.21.15.138:0/1092645481 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd0d00cc1e0 0x7fd0d00ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:27.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.332+0000 7fd0cea00640 1 -- 172.21.15.138:0/1092645481 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd0d00cc1e0 msgr2=0x7fd0d00ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:27.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.332+0000 7fd0cea00640 1 --2- 172.21.15.138:0/1092645481 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd0d00cc1e0 0x7fd0d00ce6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:27.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.332+0000 7fd0cea00640 1 -- 172.21.15.138:0/1092645481 >> v1:172.21.15.138:6789/0 conn(0x7fd0d00cbe00 legacy=0x7fd0d006de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:27.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.332+0000 7fd0cea00640 1 -- 172.21.15.138:0/1092645481 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0d0072d50 con 0x7fd0d015cf80 2024-04-26T20:58:27.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.332+0000 7fd0ce000640 1 -- 172.21.15.138:0/1092645481 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2285471029 0 0) 0x7fd0c00014a0 con 0x7fd0d00cbe00 2024-04-26T20:58:27.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.332+0000 7fd0cfe00640 1 --2- 172.21.15.138:0/1092645481 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd0d00cc1e0 0x7fd0d00ce6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:58:27.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.332+0000 7fd0cea00640 1 --2- 172.21.15.138:0/1092645481 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0d015cf80 0x7fd0d0073b10 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc0097c0 tx=0x7fd0bc01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42b2cbd045fba523 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:27.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.332+0000 7fd0ce000640 1 -- 172.21.15.138:0/1092645481 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0bc0b0070 con 0x7fd0d015cf80 2024-04-26T20:58:27.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.332+0000 7fd0ce000640 1 -- 172.21.15.138:0/1092645481 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0bc0ab600 con 0x7fd0d015cf80 2024-04-26T20:58:27.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.332+0000 7fd0ce000640 1 -- 172.21.15.138:0/1092645481 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0bc0ab9d0 con 0x7fd0d015cf80 2024-04-26T20:58:27.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.336+0000 7fd0d6600640 1 -- 172.21.15.138:0/1092645481 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0d015cf80 msgr2=0x7fd0d0073b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:27.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.336+0000 7fd0d6600640 1 --2- 172.21.15.138:0/1092645481 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0d015cf80 0x7fd0d0073b10 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc0097c0 tx=0x7fd0bc01c4a0 comp rx=0 tx=0).stop 2024-04-26T20:58:27.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.336+0000 7fd0d6600640 1 -- 172.21.15.138:0/1092645481 shutdown_connections 2024-04-26T20:58:27.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.336+0000 7fd0d6600640 1 --2- 172.21.15.138:0/1092645481 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd0d00cc1e0 0x7fd0d00ce6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:27.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.336+0000 7fd0d6600640 1 --2- 172.21.15.138:0/1092645481 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0d015cf80 0x7fd0d0073b10 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:27.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.336+0000 7fd0d6600640 1 -- 172.21.15.138:0/1092645481 >> 172.21.15.138:0/1092645481 conn(0x7fd0d00d0b20 msgr2=0x7fd0d00d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:27.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.336+0000 7fd0d6600640 1 -- 172.21.15.138:0/1092645481 shutdown_connections 2024-04-26T20:58:27.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.336+0000 7fd0d6600640 1 -- 172.21.15.138:0/1092645481 wait complete. 2024-04-26T20:58:27.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.336+0000 7fd0d6600640 1 Processor -- start 2024-04-26T20:58:27.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.336+0000 7fd0d6600640 1 -- start start 2024-04-26T20:58:27.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.336+0000 7fd0d6600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd0d00cbe00 0x7fd0d014bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:27.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.336+0000 7fd0d6600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd0d00cc1e0 0x7fd0d00b5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:27.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.336+0000 7fd0d6600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0d015cf80 0x7fd0d015b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:27.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.336+0000 7fd0d6600640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd0d00741d0 con 0x7fd0d015cf80 2024-04-26T20:58:27.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.336+0000 7fd0d6600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fd0d0074050 con 0x7fd0d00cbe00 2024-04-26T20:58:27.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.336+0000 7fd0d6600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fd0d00d0780 con 0x7fd0d00cc1e0 2024-04-26T20:58:27.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.336+0000 7fd0cfe00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0d015cf80 0x7fd0d015b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:27.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.336+0000 7fd0cfe00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0d015cf80 0x7fd0d015b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40228/0 (socket says 172.21.15.138:40228) 2024-04-26T20:58:27.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.336+0000 7fd0cfe00640 1 -- 172.21.15.138:0/343380139 learned_addr learned my addr 172.21.15.138:0/343380139 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:27.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.336+0000 7fd0cea00640 1 --2- 172.21.15.138:0/343380139 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd0d00cc1e0 0x7fd0d00b5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:27.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.336+0000 7fd0cf400640 1 --2- 172.21.15.138:0/343380139 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd0d00cbe00 0x7fd0d014bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:27.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.336+0000 7fd0cfe00640 1 -- 172.21.15.138:0/343380139 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd0d00cc1e0 msgr2=0x7fd0d00b5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:27.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.336+0000 7fd0cfe00640 1 --2- 172.21.15.138:0/343380139 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd0d00cc1e0 0x7fd0d00b5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:27.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.336+0000 7fd0cfe00640 1 -- 172.21.15.138:0/343380139 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd0d00cbe00 msgr2=0x7fd0d014bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:27.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.336+0000 7fd0cfe00640 1 --2- 172.21.15.138:0/343380139 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd0d00cbe00 0x7fd0d014bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:27.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.336+0000 7fd0cfe00640 1 -- 172.21.15.138:0/343380139 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0d014c100 con 0x7fd0d015cf80 2024-04-26T20:58:27.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.336+0000 7fd0cf400640 1 --2- 172.21.15.138:0/343380139 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd0d00cbe00 0x7fd0d014bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:58:27.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.340+0000 7fd0cfe00640 1 --2- 172.21.15.138:0/343380139 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0d015cf80 0x7fd0d015b300 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fd0c800e810 tx=0x7fd0c800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:27.341 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.340+0000 7fd0c7400640 1 -- 172.21.15.138:0/343380139 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c8017070 con 0x7fd0d015cf80 2024-04-26T20:58:27.341 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.340+0000 7fd0c7400640 1 -- 172.21.15.138:0/343380139 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0c800c6d0 con 0x7fd0d015cf80 2024-04-26T20:58:27.341 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.340+0000 7fd0c7400640 1 -- 172.21.15.138:0/343380139 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c800f040 con 0x7fd0d015cf80 2024-04-26T20:58:27.341 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.340+0000 7fd0d6600640 1 -- 172.21.15.138:0/343380139 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0d014c3e0 con 0x7fd0d015cf80 2024-04-26T20:58:27.341 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.340+0000 7fd0d6600640 1 -- 172.21.15.138:0/343380139 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0d014c9a0 con 0x7fd0d015cf80 2024-04-26T20:58:27.341 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.340+0000 7fd0d6600640 1 -- 172.21.15.138:0/343380139 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0d0069510 con 0x7fd0d015cf80 2024-04-26T20:58:27.341 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.340+0000 7fd0c7400640 1 -- 172.21.15.138:0/343380139 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd0c801a070 con 0x7fd0d015cf80 2024-04-26T20:58:27.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.340+0000 7fd0c7400640 1 --2- 172.21.15.138:0/343380139 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd0b0068380 0x7fd0b006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:27.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.340+0000 7fd0c7400640 1 -- 172.21.15.138:0/343380139 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6756+0+0 (secure 0 0 0) 0x7fd0c80869d0 con 0x7fd0d015cf80 2024-04-26T20:58:27.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.340+0000 7fd0cf400640 1 --2- 172.21.15.138:0/343380139 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd0b0068380 0x7fd0b006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:27.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.344+0000 7fd0cf400640 1 --2- 172.21.15.138:0/343380139 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd0b0068380 0x7fd0b006a840 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0007fd0 tx=0x7fd0c0007da0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:27.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.344+0000 7fd0c7400640 1 -- 172.21.15.138:0/343380139 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd0c8056480 con 0x7fd0d015cf80 2024-04-26T20:58:27.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.536+0000 7fd0d6600640 1 -- 172.21.15.138:0/343380139 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd0d0151e50 con 0x7fd0d015cf80 2024-04-26T20:58:27.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.536+0000 7fd0c7400640 1 -- 172.21.15.138:0/343380139 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v28) ==== 53+0+156 (secure 0 0 0) 0x7fd0c805a780 con 0x7fd0d015cf80 2024-04-26T20:58:27.539 INFO:teuthology.orchestra.run.smithi138.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T20:58:27.539 INFO:teuthology.orchestra.run.smithi138.stdout:name: recovery_fs, metadata pool: recovery_fs_metadata, data pools: [cephfs_data ] 2024-04-26T20:58:27.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.540+0000 7fd0d6600640 1 -- 172.21.15.138:0/343380139 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd0b0068380 msgr2=0x7fd0b006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:27.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.540+0000 7fd0d6600640 1 --2- 172.21.15.138:0/343380139 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd0b0068380 0x7fd0b006a840 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0007fd0 tx=0x7fd0c0007da0 comp rx=0 tx=0).stop 2024-04-26T20:58:27.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.540+0000 7fd0d6600640 1 -- 172.21.15.138:0/343380139 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0d015cf80 msgr2=0x7fd0d015b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:27.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.540+0000 7fd0d6600640 1 --2- 172.21.15.138:0/343380139 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0d015cf80 0x7fd0d015b300 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fd0c800e810 tx=0x7fd0c800ecd0 comp rx=0 tx=0).stop 2024-04-26T20:58:27.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.540+0000 7fd0d6600640 1 -- 172.21.15.138:0/343380139 shutdown_connections 2024-04-26T20:58:27.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.540+0000 7fd0d6600640 1 --2- 172.21.15.138:0/343380139 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fd0b0068380 0x7fd0b006a840 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:27.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.540+0000 7fd0d6600640 1 --2- 172.21.15.138:0/343380139 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0d015cf80 0x7fd0d015b300 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:27.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.540+0000 7fd0d6600640 1 --2- 172.21.15.138:0/343380139 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd0d00cc1e0 0x7fd0d00b5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:27.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.540+0000 7fd0d6600640 1 --2- 172.21.15.138:0/343380139 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd0d00cbe00 0x7fd0d014bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:27.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.540+0000 7fd0d6600640 1 -- 172.21.15.138:0/343380139 >> 172.21.15.138:0/343380139 conn(0x7fd0d00d0b20 msgr2=0x7fd0d00cd460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:27.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.540+0000 7fd0d6600640 1 -- 172.21.15.138:0/343380139 shutdown_connections 2024-04-26T20:58:27.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27.540+0000 7fd0d6600640 1 -- 172.21.15.138:0/343380139 wait complete. 2024-04-26T20:58:27.560 INFO:tasks.cephfs.mount:Mounting Ceph FS recovery_fs; just confirmed its presence on cluster 2024-04-26T20:58:27.560 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T20:58:27.560 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi138.front.sepia.ceph.com 2024-04-26T20:58:27.560 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T20:58:27.560 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T20:58:27.560 INFO:tasks.cephfs.mount:self.cephfs_name = recovery_fs 2024-04-26T20:58:27.561 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-26T20:58:27.561 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T20:58:27.561 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T20:58:27.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:58:27.561 DEBUG:teuthology.orchestra.run.smithi138:> ip addr 2024-04-26T20:58:27.570 INFO:teuthology.orchestra.run.smithi138.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T20:58:27.570 INFO:teuthology.orchestra.run.smithi138.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T20:58:27.570 INFO:teuthology.orchestra.run.smithi138.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T20:58:27.570 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:58:27.570 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 ::1/128 scope host 2024-04-26T20:58:27.570 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:58:27.570 INFO:teuthology.orchestra.run.smithi138.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T20:58:27.570 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:d9:36:7a brd ff:ff:ff:ff:ff:ff 2024-04-26T20:58:27.570 INFO:teuthology.orchestra.run.smithi138.stdout: altname enp7s0f0 2024-04-26T20:58:27.570 INFO:teuthology.orchestra.run.smithi138.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T20:58:27.570 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:d9:36:7b brd ff:ff:ff:ff:ff:ff 2024-04-26T20:58:27.571 INFO:teuthology.orchestra.run.smithi138.stdout: altname enp7s0f1 2024-04-26T20:58:27.571 INFO:teuthology.orchestra.run.smithi138.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T20:58:27.571 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:88:6f:70 brd ff:ff:ff:ff:ff:ff 2024-04-26T20:58:27.571 INFO:teuthology.orchestra.run.smithi138.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T20:58:27.571 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:88:6f:71 brd ff:ff:ff:ff:ff:ff 2024-04-26T20:58:27.571 INFO:teuthology.orchestra.run.smithi138.stdout: inet 172.21.15.138/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-26T20:58:27.571 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft 42317sec preferred_lft 42317sec 2024-04-26T20:58:27.571 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 fe80::ec4:7aff:fe88:6f71/64 scope link 2024-04-26T20:58:27.571 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:58:27.571 INFO:teuthology.orchestra.run.smithi138.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-26T20:58:27.571 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 02:42:f3:4e:97:bb brd ff:ff:ff:ff:ff:ff 2024-04-26T20:58:27.571 INFO:teuthology.orchestra.run.smithi138.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-26T20:58:27.571 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:58:27.571 INFO:teuthology.orchestra.run.smithi138.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T20:58:27.571 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-26T20:58:27.571 INFO:teuthology.orchestra.run.smithi138.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-26T20:58:27.571 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:58:27.572 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-26T20:58:27.572 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:58:27.572 INFO:teuthology.orchestra.run.smithi138.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T20:58:27.572 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T20:58:27.572 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-26T20:58:27.572 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:58:27.572 INFO:teuthology.orchestra.run.smithi138.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T20:58:27.572 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T20:58:27.572 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-26T20:58:27.572 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:58:27.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:58:27.573 DEBUG:teuthology.orchestra.run.smithi138:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T20:58:27.636 INFO:teuthology.orchestra.run.smithi138.stdout:1 2024-04-26T20:58:27.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:58:27.638 DEBUG:teuthology.orchestra.run.smithi138:> route 2024-04-26T20:58:27.690 INFO:teuthology.orchestra.run.smithi138.stdout:Kernel IP routing table 2024-04-26T20:58:27.690 INFO:teuthology.orchestra.run.smithi138.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T20:58:27.690 INFO:teuthology.orchestra.run.smithi138.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-26T20:58:27.691 INFO:teuthology.orchestra.run.smithi138.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T20:58:27.691 INFO:teuthology.orchestra.run.smithi138.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-26T20:58:27.691 INFO:teuthology.orchestra.run.smithi138.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-26T20:58:27.691 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T20:58:27.691 INFO:teuthology.orchestra.run.smithi138.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T20:58:27.691 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T20:58:27.691 INFO:teuthology.orchestra.run.smithi138.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T20:58:27.691 INFO:teuthology.orchestra.run.smithi138.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T20:58:27.691 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T20:58:27.691 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2024-04-26T20:58:27.691 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T20:58:27.691 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T20:58:27.691 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T20:58:27.691 DEBUG:teuthology.orchestra.run.smithi138:> ') 2024-04-26T20:58:27.777 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:58:27.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:58:27.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:58:27.825 DEBUG:teuthology.orchestra.run.smithi138:> ip netns list 2024-04-26T20:58:27.834 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T20:58:27.834 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-26T20:58:27.835 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T20:58:27.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:58:27.835 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link set brx.0 up 2024-04-26T20:58:27.894 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T20:58:27.894 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T20:58:27.943 INFO:teuthology.orchestra.run.smithi138.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T20:58:27.943 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T20:58:27.943 DEBUG:teuthology.orchestra.run.smithi138:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T20:58:27.994 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.recovery_fs=/ 2024-04-26T20:58:27.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:58:27.995 DEBUG:teuthology.orchestra.run.smithi138:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.recovery_fs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T20:58:28.082 INFO:teuthology.orchestra.run.smithi138.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T20:58:28.082 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T20:58:28.095 INFO:teuthology.orchestra.run.smithi138.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T20:58:28.095 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T20:58:28.095 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: resolved to: "172.21.15.138:3300,172.21.15.143:3300,172.21.15.143:3301" 2024-04-26T20:58:28.095 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: trying mount with new device syntax: 0@c22b4730-12cc-4558-8535-b965384398c0.recovery_fs=/ 2024-04-26T20:58:28.096 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.138:3300/172.21.15.143:3300/172.21.15.143:3301" will pass to kernel 2024-04-26T20:58:28.099 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-26T20:58:28.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:58:28.099 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T20:58:28.119 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T20:58:28.197 INFO:tasks.ceph.mds.a.smithi138.stderr:2024-04-26T20:58:28.196+0000 7f1441c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T20:58:28.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T20:58:28.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:58:28.225 INFO:teuthology.orchestra.run.smithi138.stdout:client5701 2024-04-26T20:58:28.226 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-26T20:58:28.226 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T20:58:28.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:58:28.275 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls subdir) 2024-04-26T20:58:28.335 INFO:teuthology.orchestra.run.smithi138.stdout:sixmegs 2024-04-26T20:58:28.336 DEBUG:teuthology.orchestra.run.smithi138:> stdin-killer -- python3 -c ' 2024-04-26T20:58:28.336 DEBUG:teuthology.orchestra.run.smithi138:> import os 2024-04-26T20:58:28.336 DEBUG:teuthology.orchestra.run.smithi138:> import stat 2024-04-26T20:58:28.336 DEBUG:teuthology.orchestra.run.smithi138:> import json 2024-04-26T20:58:28.336 DEBUG:teuthology.orchestra.run.smithi138:> import sys 2024-04-26T20:58:28.336 DEBUG:teuthology.orchestra.run.smithi138:> 2024-04-26T20:58:28.336 DEBUG:teuthology.orchestra.run.smithi138:> try: 2024-04-26T20:58:28.336 DEBUG:teuthology.orchestra.run.smithi138:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/sixmegs'"'"') 2024-04-26T20:58:28.336 DEBUG:teuthology.orchestra.run.smithi138:> except OSError as e: 2024-04-26T20:58:28.336 DEBUG:teuthology.orchestra.run.smithi138:> sys.exit(e.errno) 2024-04-26T20:58:28.336 DEBUG:teuthology.orchestra.run.smithi138:> 2024-04-26T20:58:28.336 DEBUG:teuthology.orchestra.run.smithi138:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-04-26T20:58:28.336 DEBUG:teuthology.orchestra.run.smithi138:> print(json.dumps( 2024-04-26T20:58:28.336 DEBUG:teuthology.orchestra.run.smithi138:> dict([(a, getattr(s, a)) for a in attrs]), 2024-04-26T20:58:28.337 DEBUG:teuthology.orchestra.run.smithi138:> indent=2)) 2024-04-26T20:58:28.337 DEBUG:teuthology.orchestra.run.smithi138:> ' 2024-04-26T20:58:28.446 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-26T20:58:28.447 INFO:teuthology.orchestra.run.smithi138.stdout: "st_mode": 33088, 2024-04-26T20:58:28.447 INFO:teuthology.orchestra.run.smithi138.stdout: "st_ino": 1099511627777, 2024-04-26T20:58:28.447 INFO:teuthology.orchestra.run.smithi138.stdout: "st_dev": 44, 2024-04-26T20:58:28.447 INFO:teuthology.orchestra.run.smithi138.stdout: "st_nlink": 1, 2024-04-26T20:58:28.447 INFO:teuthology.orchestra.run.smithi138.stdout: "st_uid": 0, 2024-04-26T20:58:28.447 INFO:teuthology.orchestra.run.smithi138.stdout: "st_gid": 0, 2024-04-26T20:58:28.447 INFO:teuthology.orchestra.run.smithi138.stdout: "st_size": 6291456, 2024-04-26T20:58:28.447 INFO:teuthology.orchestra.run.smithi138.stdout: "st_atime": 1714165086.0, 2024-04-26T20:58:28.447 INFO:teuthology.orchestra.run.smithi138.stdout: "st_mtime": 1714165086.0, 2024-04-26T20:58:28.447 INFO:teuthology.orchestra.run.smithi138.stdout: "st_ctime": 1714165086.0 2024-04-26T20:58:28.447 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-26T20:58:28.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:58:28.457 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-26T20:58:28.457 DEBUG:teuthology.orchestra.run.smithi138:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T20:58:28.609 DEBUG:teuthology.orchestra.run.smithi143:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T20:58:28.708 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-26T20:58:28.709 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T20:58:28.709 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-26T20:58:28.709 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T20:58:28.717 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-26T20:58:28.718 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T20:58:28.771 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:58:28.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.952+0000 7f4694000640 1 Processor -- start 2024-04-26T20:58:28.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.952+0000 7f4694000640 1 -- start start 2024-04-26T20:58:28.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.952+0000 7f4694000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f468c0cbe00 0x7f468c06de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:28.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.952+0000 7f4694000640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f468c0cc1e0 0x7f468c073b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:28.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.952+0000 7f4694000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f468c0ce6f0 0x7f468c0ceb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:28.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.952+0000 7f4694000640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f468c073680 con 0x7f468c0ce6f0 2024-04-26T20:58:28.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.952+0000 7f4694000640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f468c0727f0 con 0x7f468c0cc1e0 2024-04-26T20:58:28.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.952+0000 7f4694000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f468c072a70 con 0x7f468c0cbe00 2024-04-26T20:58:28.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.952+0000 7f4692000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f468c0ce6f0 0x7f468c0ceb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:28.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.952+0000 7f4692000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f468c0ce6f0 0x7f468c0ceb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40240/0 (socket says 172.21.15.138:40240) 2024-04-26T20:58:28.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.952+0000 7f4692000640 1 -- 172.21.15.138:0/3085267848 learned_addr learned my addr 172.21.15.138:0/3085267848 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:28.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.952+0000 7f4690c00640 1 --2- 172.21.15.138:0/3085267848 >> v2:172.21.15.143:3300/0 conn(0x7f468c0cc1e0 0x7f468c073b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:28.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.952+0000 7f4691600640 1 --2- 172.21.15.138:0/3085267848 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f468c0cbe00 0x7f468c06de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:28.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.952+0000 7f4692000640 1 -- 172.21.15.138:0/3085267848 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f468c0cbe00 msgr2=0x7f468c06de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:28.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.952+0000 7f4692000640 1 --2- 172.21.15.138:0/3085267848 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f468c0cbe00 0x7f468c06de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:28.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.952+0000 7f4692000640 1 -- 172.21.15.138:0/3085267848 >> v2:172.21.15.143:3300/0 conn(0x7f468c0cc1e0 msgr2=0x7f468c073b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:28.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.952+0000 7f4692000640 1 --2- 172.21.15.138:0/3085267848 >> v2:172.21.15.143:3300/0 conn(0x7f468c0cc1e0 0x7f468c073b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:28.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.952+0000 7f4692000640 1 -- 172.21.15.138:0/3085267848 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f468c072d50 con 0x7f468c0ce6f0 2024-04-26T20:58:28.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.956+0000 7f4692000640 1 --2- 172.21.15.138:0/3085267848 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f468c0ce6f0 0x7f468c0ceb80 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f468c074b60 tx=0x7f468401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92b07814b477956f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:28.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.956+0000 7f468be00640 1 -- 172.21.15.138:0/3085267848 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46840b0070 con 0x7f468c0ce6f0 2024-04-26T20:58:28.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.956+0000 7f468be00640 1 -- 172.21.15.138:0/3085267848 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46840ab600 con 0x7f468c0ce6f0 2024-04-26T20:58:28.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.956+0000 7f468be00640 1 -- 172.21.15.138:0/3085267848 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46840ab9d0 con 0x7f468c0ce6f0 2024-04-26T20:58:28.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.956+0000 7f4694000640 1 -- 172.21.15.138:0/3085267848 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f468c0ce6f0 msgr2=0x7f468c0ceb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:28.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.956+0000 7f4694000640 1 --2- 172.21.15.138:0/3085267848 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f468c0ce6f0 0x7f468c0ceb80 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f468c074b60 tx=0x7f468401c520 comp rx=0 tx=0).stop 2024-04-26T20:58:28.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.956+0000 7f4694000640 1 -- 172.21.15.138:0/3085267848 shutdown_connections 2024-04-26T20:58:28.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.956+0000 7f4694000640 1 --2- 172.21.15.138:0/3085267848 >> v2:172.21.15.143:3300/0 conn(0x7f468c0cc1e0 0x7f468c073b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:28.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.956+0000 7f4694000640 1 --2- 172.21.15.138:0/3085267848 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f468c0ce6f0 0x7f468c0ceb80 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:28.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.956+0000 7f4694000640 1 --2- 172.21.15.138:0/3085267848 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f468c0cbe00 0x7f468c06de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:28.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.956+0000 7f4694000640 1 -- 172.21.15.138:0/3085267848 >> 172.21.15.138:0/3085267848 conn(0x7f468c0d0b20 msgr2=0x7f468c0d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:28.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.956+0000 7f4694000640 1 -- 172.21.15.138:0/3085267848 shutdown_connections 2024-04-26T20:58:28.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.956+0000 7f4694000640 1 -- 172.21.15.138:0/3085267848 wait complete. 2024-04-26T20:58:28.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.960+0000 7f4694000640 1 Processor -- start 2024-04-26T20:58:28.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.960+0000 7f4694000640 1 -- start start 2024-04-26T20:58:28.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.960+0000 7f4694000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f468c0cbe00 0x7f468c14c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:28.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.960+0000 7f4694000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f468c0cc1e0 0x7f468c0c6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:28.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.960+0000 7f4694000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f468c0ce6f0 0x7f468c0b08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:28.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.960+0000 7f4694000640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f468c06e530 con 0x7f468c0ce6f0 2024-04-26T20:58:28.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.960+0000 7f4694000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f468c06e3b0 con 0x7f468c0cbe00 2024-04-26T20:58:28.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.960+0000 7f4694000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f468c074050 con 0x7f468c0cc1e0 2024-04-26T20:58:28.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.960+0000 7f4692000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f468c0ce6f0 0x7f468c0b08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:28.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.960+0000 7f4692000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f468c0ce6f0 0x7f468c0b08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40256/0 (socket says 172.21.15.138:40256) 2024-04-26T20:58:28.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.960+0000 7f4692000640 1 -- 172.21.15.138:0/2317566151 learned_addr learned my addr 172.21.15.138:0/2317566151 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:28.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.960+0000 7f4691600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f468c0cbe00 0x7f468c14c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:28.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.960+0000 7f4690c00640 1 --2- 172.21.15.138:0/2317566151 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f468c0cc1e0 0x7f468c0c6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:28.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.960+0000 7f4692000640 1 -- 172.21.15.138:0/2317566151 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f468c0cc1e0 msgr2=0x7f468c0c6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:28.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.960+0000 7f4692000640 1 --2- 172.21.15.138:0/2317566151 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f468c0cc1e0 0x7f468c0c6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:28.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.960+0000 7f4692000640 1 -- 172.21.15.138:0/2317566151 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f468c0cbe00 msgr2=0x7f468c14c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:28.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.960+0000 7f4692000640 1 --2- 172.21.15.138:0/2317566151 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f468c0cbe00 0x7f468c14c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:28.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.960+0000 7f4692000640 1 -- 172.21.15.138:0/2317566151 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f468c0b3ba0 con 0x7f468c0ce6f0 2024-04-26T20:58:28.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.960+0000 7f4692000640 1 --2- 172.21.15.138:0/2317566151 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f468c0ce6f0 0x7f468c0b08d0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f46840ae040 tx=0x7f468401ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:28.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.960+0000 7f4689600640 1 -- 172.21.15.138:0/2317566151 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46840b0040 con 0x7f468c0ce6f0 2024-04-26T20:58:28.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.960+0000 7f4689600640 1 -- 172.21.15.138:0/2317566151 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46840bc070 con 0x7f468c0ce6f0 2024-04-26T20:58:28.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.960+0000 7f4694000640 1 -- 172.21.15.138:0/2317566151 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f468c0b6750 con 0x7f468c0ce6f0 2024-04-26T20:58:28.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.960+0000 7f4689600640 1 -- 172.21.15.138:0/2317566151 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46840b6640 con 0x7f468c0ce6f0 2024-04-26T20:58:28.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.960+0000 7f4694000640 1 -- 172.21.15.138:0/2317566151 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f468c0c4880 con 0x7f468c0ce6f0 2024-04-26T20:58:28.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.964+0000 7f4694000640 1 -- 172.21.15.138:0/2317566151 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f468c069510 con 0x7f468c0ce6f0 2024-04-26T20:58:28.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.964+0000 7f4689600640 1 -- 172.21.15.138:0/2317566151 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f46840b67e0 con 0x7f468c0ce6f0 2024-04-26T20:58:28.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.964+0000 7f4689600640 1 --2- 172.21.15.138:0/2317566151 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f466c068380 0x7f466c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:28.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.964+0000 7f4689600640 1 -- 172.21.15.138:0/2317566151 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6756+0+0 (secure 0 0 0) 0x7f4684120fd0 con 0x7f468c0ce6f0 2024-04-26T20:58:28.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.964+0000 7f4691600640 1 --2- 172.21.15.138:0/2317566151 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f466c068380 0x7f466c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:28.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.968+0000 7f4691600640 1 --2- 172.21.15.138:0/2317566151 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f466c068380 0x7f466c06a840 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f468c1fb320 tx=0x7f4680009830 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:28.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:28.968+0000 7f4689600640 1 -- 172.21.15.138:0/2317566151 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4684016110 con 0x7f468c0ce6f0 2024-04-26T20:58:29.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.128+0000 7f4694000640 1 -- 172.21.15.138:0/2317566151 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f468c06f290 con 0x7f468c0ce6f0 2024-04-26T20:58:29.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.128+0000 7f4689600640 1 -- 172.21.15.138:0/2317566151 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+19198 (secure 0 0 0) 0x7f46840f10d0 con 0x7f468c0ce6f0 2024-04-26T20:58:29.129 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:29.129 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":51,"fsid":"c22b4730-12cc-4558-8535-b965384398c0","created":"2024-04-26T20:56:14.182475+0000","modified":"2024-04-26T20:58:20.703295+0000","last_up_change":"2024-04-26T20:56:26.013243+0000","last_in_change":"2024-04-26T20:56:16.714055+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:56:27.265834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:57:49.597600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-26T20:57:50.901951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"recovery_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"recovery_fs_metadata","create_time":"2024-04-26T20:58:09.327192+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"recovery_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3f9a2e34-3199-466f-a6cf-57927318121e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6801","nonce":3534772245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6803","nonce":3534772245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6807","nonce":3534772245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6805","nonce":3534772245}]},"public_addr":"172.21.15.138:6801/3534772245","cluster_addr":"172.21.15.138:6803/3534772245","heartbeat_back_addr":"172.21.15.138:6807/3534772245","heartbeat_front_addr":"172.21.15.138:6805/3534772245","state":["exists","up"]},{"osd":1,"uuid":"e881fcf6-3248-4696-a2ef-95d206d77712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6817","nonce":1427635773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6819","nonce":1427635773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6823","nonce":1427635773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6821","nonce":1427635773}]},"public_addr":"172.21.15.138:6817/1427635773","cluster_addr":"172.21.15.138:6819/1427635773","heartbeat_back_addr":"172.21.15.138:6823/1427635773","heartbeat_front_addr":"172.21.15.138:6821/1427635773","state":["exists","up"]},{"osd":2,"uuid":"f7d1db33-7672-4699-ae47-9f1e0a8e4222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6809","nonce":4273721573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6811","nonce":4273721573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6815","nonce":4273721573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6813","nonce":4273721573}]},"public_addr":"172.21.15.138:6809/4273721573","cluster_addr":"172.21.15.138:6811/4273721573","heartbeat_back_addr":"172.21.15.138:6815/4273721573","heartbeat_front_addr":"172.21.15.138:6813/4273721573","state":["exists","up"]},{"osd":3,"uuid":"2f4e0a9a-b8f6-4468-844a-a4501cd85054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6825","nonce":3098242154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6827","nonce":3098242154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6831","nonce":3098242154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6829","nonce":3098242154}]},"public_addr":"172.21.15.138:6825/3098242154","cluster_addr":"172.21.15.138:6827/3098242154","heartbeat_back_addr":"172.21.15.138:6831/3098242154","heartbeat_front_addr":"172.21.15.138:6829/3098242154","state":["exists","up"]},{"osd":4,"uuid":"c85df99b-3624-410e-866b-86830af2cfe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6801","nonce":2942056312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6803","nonce":2942056312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6807","nonce":2942056312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6805","nonce":2942056312}]},"public_addr":"172.21.15.143:6801/2942056312","cluster_addr":"172.21.15.143:6803/2942056312","heartbeat_back_addr":"172.21.15.143:6807/2942056312","heartbeat_front_addr":"172.21.15.143:6805/2942056312","state":["exists","up"]},{"osd":5,"uuid":"9af1efb5-c416-4808-b5ef-de0679ab9705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6809","nonce":1910222887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6811","nonce":1910222887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6815","nonce":1910222887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6813","nonce":1910222887}]},"public_addr":"172.21.15.143:6809/1910222887","cluster_addr":"172.21.15.143:6811/1910222887","heartbeat_back_addr":"172.21.15.143:6815/1910222887","heartbeat_front_addr":"172.21.15.143:6813/1910222887","state":["exists","up"]},{"osd":6,"uuid":"d7138615-8838-45ff-9072-2fd0683362f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6817","nonce":1082239825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6819","nonce":1082239825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6823","nonce":1082239825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6821","nonce":1082239825}]},"public_addr":"172.21.15.143:6817/1082239825","cluster_addr":"172.21.15.143:6819/1082239825","heartbeat_back_addr":"172.21.15.143:6823/1082239825","heartbeat_front_addr":"172.21.15.143:6821/1082239825","state":["exists","up"]},{"osd":7,"uuid":"0c27172b-35c4-49ec-ba0b-0137b8ff0010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6825","nonce":3295508495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6827","nonce":3295508495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6831","nonce":3295508495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6829","nonce":3295508495}]},"public_addr":"172.21.15.143:6825/3295508495","cluster_addr":"172.21.15.143:6827/3295508495","heartbeat_back_addr":"172.21.15.143:6831/3295508495","heartbeat_front_addr":"172.21.15.143:6829/3295508495","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.326627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.396119+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.433915+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.414179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.216947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.329272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.503073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.436382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.d","mappings":[{"from":1,"to":2}]},{"pgid":"6.23","mappings":[{"from":3,"to":2}]},{"pgid":"6.2b","mappings":[{"from":4,"to":7}]},{"pgid":"6.30","mappings":[{"from":4,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.143:6836/483370849":"2024-04-27T20:58:07.183664+0000","172.21.15.143:6834/483370849":"2024-04-27T20:58:07.183664+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:58:29.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.128+0000 7f4694000640 1 -- 172.21.15.138:0/2317566151 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f466c068380 msgr2=0x7f466c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:29.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.128+0000 7f4694000640 1 --2- 172.21.15.138:0/2317566151 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f466c068380 0x7f466c06a840 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f468c1fb320 tx=0x7f4680009830 comp rx=0 tx=0).stop 2024-04-26T20:58:29.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.128+0000 7f4694000640 1 -- 172.21.15.138:0/2317566151 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f468c0ce6f0 msgr2=0x7f468c0b08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:29.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.128+0000 7f4694000640 1 --2- 172.21.15.138:0/2317566151 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f468c0ce6f0 0x7f468c0b08d0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f46840ae040 tx=0x7f468401ad60 comp rx=0 tx=0).stop 2024-04-26T20:58:29.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.128+0000 7f4694000640 1 -- 172.21.15.138:0/2317566151 shutdown_connections 2024-04-26T20:58:29.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.128+0000 7f4694000640 1 --2- 172.21.15.138:0/2317566151 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f466c068380 0x7f466c06a840 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:29.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.128+0000 7f4694000640 1 --2- 172.21.15.138:0/2317566151 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f468c0ce6f0 0x7f468c0b08d0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:29.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.128+0000 7f4694000640 1 --2- 172.21.15.138:0/2317566151 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f468c0cc1e0 0x7f468c0c6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:29.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.128+0000 7f4694000640 1 --2- 172.21.15.138:0/2317566151 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f468c0cbe00 0x7f468c14c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:29.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.128+0000 7f4694000640 1 -- 172.21.15.138:0/2317566151 >> 172.21.15.138:0/2317566151 conn(0x7f468c0d0b20 msgr2=0x7f468c15ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:29.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.128+0000 7f4694000640 1 -- 172.21.15.138:0/2317566151 shutdown_connections 2024-04-26T20:58:29.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.128+0000 7f4694000640 1 -- 172.21.15.138:0/2317566151 wait complete. 2024-04-26T20:58:29.150 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:56:27.265834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T20:57:49.597600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T20:57:50.901951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'recovery_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'recovery_fs_metadata', 'create_time': '2024-04-26T20:58:09.327192+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'recovery_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T20:58:29.150 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T20:58:29.290 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.288+0000 7f4893800640 1 Processor -- start 2024-04-26T20:58:29.290 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.288+0000 7f4893800640 1 -- start start 2024-04-26T20:58:29.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.288+0000 7f4893800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f488c0ce9e0 0x7f488c0afc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:29.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.288+0000 7f4893800640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f488c15f360 0x7f488c0cb200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:29.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.288+0000 7f4893800640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f488c0ae8c0 con 0x7f488c06fad0 2024-04-26T20:58:29.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.288+0000 7f4893800640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f488c0aeba0 con 0x7f488c15f360 2024-04-26T20:58:29.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.288+0000 7f4893800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f488c0aee80 con 0x7f488c0ce9e0 2024-04-26T20:58:29.292 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.292+0000 7f4890e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f488c0ce9e0 0x7f488c0afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:29.292 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.292+0000 7f4890e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f488c0ce9e0 0x7f488c0afc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.138:58388/0 (socket says 172.21.15.138:58388) 2024-04-26T20:58:29.292 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.292+0000 7f4890e00640 1 -- 172.21.15.138:0/4216615808 learned_addr learned my addr 172.21.15.138:0/4216615808 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:29.292 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.292+0000 7f4891800640 1 --2- 172.21.15.138:0/4216615808 >> v2:172.21.15.143:3300/0 conn(0x7f488c15f360 0x7f488c0cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:29.292 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.292+0000 7f4890e00640 1 -- 172.21.15.138:0/4216615808 >> v2:172.21.15.143:3300/0 conn(0x7f488c15f360 msgr2=0x7f488c0cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:29.292 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.292+0000 7f4890e00640 1 --2- 172.21.15.138:0/4216615808 >> v2:172.21.15.143:3300/0 conn(0x7f488c15f360 0x7f488c0cb200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:29.292 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.292+0000 7f4890e00640 1 -- 172.21.15.138:0/4216615808 >> v1:172.21.15.143:6789/0 conn(0x7f488c06fad0 legacy=0x7f488c15ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:29.293 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.292+0000 7f4890e00640 1 -- 172.21.15.138:0/4216615808 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f488c0af160 con 0x7f488c0ce9e0 2024-04-26T20:58:29.293 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.292+0000 7f4891800640 1 --2- 172.21.15.138:0/4216615808 >> v2:172.21.15.143:3300/0 conn(0x7f488c15f360 0x7f488c0cb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:58:29.294 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.292+0000 7f4890e00640 1 --2- 172.21.15.138:0/4216615808 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f488c0ce9e0 0x7f488c0afc20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f487c009870 tx=0x7f487c01c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e167dd7b4e85624 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:29.295 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.292+0000 7f488be00640 1 -- 172.21.15.138:0/4216615808 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487c0a9620 con 0x7f488c0ce9e0 2024-04-26T20:58:29.295 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.296+0000 7f488be00640 1 -- 172.21.15.138:0/4216615808 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f487c0a97c0 con 0x7f488c0ce9e0 2024-04-26T20:58:29.295 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.296+0000 7f488be00640 1 -- 172.21.15.138:0/4216615808 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487c0a9b90 con 0x7f488c0ce9e0 2024-04-26T20:58:29.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.296+0000 7f4893800640 1 -- 172.21.15.138:0/4216615808 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f488c0ce9e0 msgr2=0x7f488c0afc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:29.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.296+0000 7f4893800640 1 --2- 172.21.15.138:0/4216615808 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f488c0ce9e0 0x7f488c0afc20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f487c009870 tx=0x7f487c01c560 comp rx=0 tx=0).stop 2024-04-26T20:58:29.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.296+0000 7f4893800640 1 -- 172.21.15.138:0/4216615808 shutdown_connections 2024-04-26T20:58:29.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.296+0000 7f4893800640 1 --2- 172.21.15.138:0/4216615808 >> v2:172.21.15.143:3300/0 conn(0x7f488c15f360 0x7f488c0cb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:29.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.296+0000 7f4893800640 1 --2- 172.21.15.138:0/4216615808 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f488c0ce9e0 0x7f488c0afc20 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:29.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.296+0000 7f4893800640 1 -- 172.21.15.138:0/4216615808 >> 172.21.15.138:0/4216615808 conn(0x7f488c0d0bb0 msgr2=0x7f488c0d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:29.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.296+0000 7f4893800640 1 -- 172.21.15.138:0/4216615808 shutdown_connections 2024-04-26T20:58:29.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.296+0000 7f4893800640 1 -- 172.21.15.138:0/4216615808 wait complete. 2024-04-26T20:58:29.297 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.296+0000 7f4893800640 1 Processor -- start 2024-04-26T20:58:29.298 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.296+0000 7f4893800640 1 -- start start 2024-04-26T20:58:29.299 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.296+0000 7f4893800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f488c06fad0 0x7f488c0c4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:29.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.296+0000 7f4893800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f488c0ce9e0 0x7f488c159950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:29.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.296+0000 7f4893800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f488c15f360 0x7f488c157780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:29.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.296+0000 7f4893800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f488c0cb8c0 con 0x7f488c06fad0 2024-04-26T20:58:29.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.296+0000 7f4893800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f488c0cb740 con 0x7f488c0ce9e0 2024-04-26T20:58:29.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.296+0000 7f4893800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f488c0cba40 con 0x7f488c15f360 2024-04-26T20:58:29.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.296+0000 7f4890e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f488c06fad0 0x7f488c0c4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:29.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.296+0000 7f4890e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f488c06fad0 0x7f488c0c4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40266/0 (socket says 172.21.15.138:40266) 2024-04-26T20:58:29.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.296+0000 7f4890e00640 1 -- 172.21.15.138:0/2430238069 learned_addr learned my addr 172.21.15.138:0/2430238069 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:29.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.296+0000 7f4883e00640 1 --2- 172.21.15.138:0/2430238069 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f488c0ce9e0 0x7f488c159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:29.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.296+0000 7f4891800640 1 --2- 172.21.15.138:0/2430238069 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f488c15f360 0x7f488c157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:29.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.296+0000 7f4890e00640 1 -- 172.21.15.138:0/2430238069 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f488c15f360 msgr2=0x7f488c157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:29.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.296+0000 7f4890e00640 1 --2- 172.21.15.138:0/2430238069 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f488c15f360 0x7f488c157780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:29.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.296+0000 7f4890e00640 1 -- 172.21.15.138:0/2430238069 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f488c0ce9e0 msgr2=0x7f488c159950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:29.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.296+0000 7f4890e00640 1 --2- 172.21.15.138:0/2430238069 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f488c0ce9e0 0x7f488c159950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:29.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.296+0000 7f4890e00640 1 -- 172.21.15.138:0/2430238069 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f488c15a0a0 con 0x7f488c06fad0 2024-04-26T20:58:29.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.296+0000 7f4891800640 1 --2- 172.21.15.138:0/2430238069 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f488c15f360 0x7f488c157780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:58:29.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.296+0000 7f4883e00640 1 --2- 172.21.15.138:0/2430238069 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f488c0ce9e0 0x7f488c159950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:58:29.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.300+0000 7f4890e00640 1 --2- 172.21.15.138:0/2430238069 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f488c06fad0 0x7f488c0c4f70 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f487c01ac10 tx=0x7f487c019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:29.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.300+0000 7f4889600640 1 -- 172.21.15.138:0/2430238069 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487c0bb3f0 con 0x7f488c06fad0 2024-04-26T20:58:29.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.300+0000 7f4889600640 1 -- 172.21.15.138:0/2430238069 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f487c0bb5b0 con 0x7f488c06fad0 2024-04-26T20:58:29.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.300+0000 7f4893800640 1 -- 172.21.15.138:0/2430238069 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f488c15a380 con 0x7f488c06fad0 2024-04-26T20:58:29.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.300+0000 7f4889600640 1 -- 172.21.15.138:0/2430238069 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487c0bb9a0 con 0x7f488c06fad0 2024-04-26T20:58:29.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.300+0000 7f4893800640 1 -- 172.21.15.138:0/2430238069 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f488c15a940 con 0x7f488c06fad0 2024-04-26T20:58:29.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.300+0000 7f4893800640 1 -- 172.21.15.138:0/2430238069 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f488c069430 con 0x7f488c06fad0 2024-04-26T20:58:29.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.300+0000 7f4889600640 1 -- 172.21.15.138:0/2430238069 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f487c0c43f0 con 0x7f488c06fad0 2024-04-26T20:58:29.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.300+0000 7f4889600640 1 --2- 172.21.15.138:0/2430238069 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4868068380 0x7f486806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:29.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.300+0000 7f4889600640 1 -- 172.21.15.138:0/2430238069 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6756+0+0 (secure 0 0 0) 0x7f487c121210 con 0x7f488c06fad0 2024-04-26T20:58:29.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.300+0000 7f4883e00640 1 --2- 172.21.15.138:0/2430238069 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4868068380 0x7f486806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:29.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.304+0000 7f4883e00640 1 --2- 172.21.15.138:0/2430238069 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4868068380 0x7f486806a840 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f488c0c4f00 tx=0x7f4874009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:29.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.304+0000 7f4889600640 1 -- 172.21.15.138:0/2430238069 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f487c0ad020 con 0x7f488c06fad0 2024-04-26T20:58:29.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.464+0000 7f4893800640 1 -- 172.21.15.138:0/2430238069 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f488c0cf2b0 con 0x7f488c06fad0 2024-04-26T20:58:29.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.464+0000 7f4889600640 1 -- 172.21.15.138:0/2430238069 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) ==== 93+0+10 (secure 0 0 0) 0x7f487c016150 con 0x7f488c06fad0 2024-04-26T20:58:29.464 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 1 2024-04-26T20:58:29.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.464+0000 7f4893800640 1 -- 172.21.15.138:0/2430238069 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4868068380 msgr2=0x7f486806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:29.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.464+0000 7f4893800640 1 --2- 172.21.15.138:0/2430238069 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4868068380 0x7f486806a840 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f488c0c4f00 tx=0x7f4874009040 comp rx=0 tx=0).stop 2024-04-26T20:58:29.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.464+0000 7f4893800640 1 -- 172.21.15.138:0/2430238069 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f488c06fad0 msgr2=0x7f488c0c4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:29.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.464+0000 7f4893800640 1 --2- 172.21.15.138:0/2430238069 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f488c06fad0 0x7f488c0c4f70 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f487c01ac10 tx=0x7f487c019300 comp rx=0 tx=0).stop 2024-04-26T20:58:29.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.464+0000 7f4893800640 1 -- 172.21.15.138:0/2430238069 shutdown_connections 2024-04-26T20:58:29.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.464+0000 7f4893800640 1 --2- 172.21.15.138:0/2430238069 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f4868068380 0x7f486806a840 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:29.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.464+0000 7f4893800640 1 --2- 172.21.15.138:0/2430238069 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f488c15f360 0x7f488c157780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:29.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.464+0000 7f4893800640 1 --2- 172.21.15.138:0/2430238069 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f488c0ce9e0 0x7f488c159950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:29.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.464+0000 7f4893800640 1 --2- 172.21.15.138:0/2430238069 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f488c06fad0 0x7f488c0c4f70 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:29.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.464+0000 7f4893800640 1 -- 172.21.15.138:0/2430238069 >> 172.21.15.138:0/2430238069 conn(0x7f488c0d0bb0 msgr2=0x7f488c0b1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:29.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.464+0000 7f4893800640 1 -- 172.21.15.138:0/2430238069 shutdown_connections 2024-04-26T20:58:29.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.464+0000 7f4893800640 1 -- 172.21.15.138:0/2430238069 wait complete. 2024-04-26T20:58:29.485 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T20:58:29.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.620+0000 7f311a600640 1 Processor -- start 2024-04-26T20:58:29.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.620+0000 7f311a600640 1 -- start start 2024-04-26T20:58:29.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.624+0000 7f311a600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f311415bdc0 0x7f311415f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:29.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.624+0000 7f311a600640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f311406f880 0x7f31140ce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:29.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.624+0000 7f311a600640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f311406dee0 con 0x7f3114073d70 2024-04-26T20:58:29.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.624+0000 7f311a600640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f311415c1a0 con 0x7f311406f880 2024-04-26T20:58:29.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.624+0000 7f311a600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f311406e180 con 0x7f311415bdc0 2024-04-26T20:58:29.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.624+0000 7f3113e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f311406f880 0x7f31140ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:29.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.624+0000 7f310aa00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f3114073d70 0x7f311415fe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:32874/0 (socket says 172.21.15.138:32874) 2024-04-26T20:58:29.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.624+0000 7f310aa00640 1 -- 172.21.15.138:0/3834454706 learned_addr learned my addr 172.21.15.138:0/3834454706 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:29.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.624+0000 7f3113400640 1 --2- 172.21.15.138:0/3834454706 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f311415bdc0 0x7f311415f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:29.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.624+0000 7f3113e00640 1 -- 172.21.15.138:0/3834454706 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f311415bdc0 msgr2=0x7f311415f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:29.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.624+0000 7f3113e00640 1 --2- 172.21.15.138:0/3834454706 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f311415bdc0 0x7f311415f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:29.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.624+0000 7f3113e00640 1 -- 172.21.15.138:0/3834454706 >> v1:172.21.15.138:6789/0 conn(0x7f3114073d70 legacy=0x7f311415fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:29.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.624+0000 7f3113e00640 1 -- 172.21.15.138:0/3834454706 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f311406e460 con 0x7f311406f880 2024-04-26T20:58:29.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.624+0000 7f3112a00640 1 -- 172.21.15.138:0/3834454706 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2481530190 0 0) 0x7f311406dee0 con 0x7f3114073d70 2024-04-26T20:58:29.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.628+0000 7f3113e00640 1 --2- 172.21.15.138:0/3834454706 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f311406f880 0x7f31140ce780 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f310c0097c0 tx=0x7f310c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e416c00e92deabca server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:29.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.628+0000 7f3112a00640 1 -- 172.21.15.138:0/3834454706 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310c0b0070 con 0x7f311406f880 2024-04-26T20:58:29.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.628+0000 7f3112a00640 1 -- 172.21.15.138:0/3834454706 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f310c0ab600 con 0x7f311406f880 2024-04-26T20:58:29.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.628+0000 7f3112a00640 1 -- 172.21.15.138:0/3834454706 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310c0ab9d0 con 0x7f311406f880 2024-04-26T20:58:29.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.628+0000 7f311a600640 1 -- 172.21.15.138:0/3834454706 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f311406f880 msgr2=0x7f31140ce780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:29.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.628+0000 7f311a600640 1 --2- 172.21.15.138:0/3834454706 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f311406f880 0x7f31140ce780 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f310c0097c0 tx=0x7f310c01c410 comp rx=0 tx=0).stop 2024-04-26T20:58:29.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.628+0000 7f311a600640 1 -- 172.21.15.138:0/3834454706 shutdown_connections 2024-04-26T20:58:29.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.628+0000 7f311a600640 1 --2- 172.21.15.138:0/3834454706 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f311406f880 0x7f31140ce780 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:29.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.628+0000 7f311a600640 1 --2- 172.21.15.138:0/3834454706 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f311415bdc0 0x7f311415f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:29.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.628+0000 7f311a600640 1 -- 172.21.15.138:0/3834454706 >> 172.21.15.138:0/3834454706 conn(0x7f31140d0bb0 msgr2=0x7f31140d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:29.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.628+0000 7f311a600640 1 -- 172.21.15.138:0/3834454706 shutdown_connections 2024-04-26T20:58:29.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.628+0000 7f311a600640 1 -- 172.21.15.138:0/3834454706 wait complete. 2024-04-26T20:58:29.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.628+0000 7f311a600640 1 Processor -- start 2024-04-26T20:58:29.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.628+0000 7f311a600640 1 -- start start 2024-04-26T20:58:29.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.628+0000 7f311a600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f311406f880 0x7f3114161b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:29.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.628+0000 7f311a600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3114073d70 0x7f3114153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:29.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.628+0000 7f311a600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f311415bdc0 0x7f3114154710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:29.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.628+0000 7f311a600640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f3114168cd0 con 0x7f311406f880 2024-04-26T20:58:29.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.628+0000 7f311a600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f3114160790 con 0x7f3114073d70 2024-04-26T20:58:29.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.628+0000 7f311a600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f3114168e50 con 0x7f311415bdc0 2024-04-26T20:58:29.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.632+0000 7f3113400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f311406f880 0x7f3114161b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:29.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.632+0000 7f3113400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f311406f880 0x7f3114161b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40282/0 (socket says 172.21.15.138:40282) 2024-04-26T20:58:29.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.632+0000 7f3113400640 1 -- 172.21.15.138:0/3273943685 learned_addr learned my addr 172.21.15.138:0/3273943685 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:29.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.632+0000 7f3113e00640 1 --2- 172.21.15.138:0/3273943685 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f311415bdc0 0x7f3114154710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:29.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.632+0000 7f310aa00640 1 --2- 172.21.15.138:0/3273943685 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3114073d70 0x7f3114153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:29.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.632+0000 7f3113400640 1 -- 172.21.15.138:0/3273943685 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f311415bdc0 msgr2=0x7f3114154710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:29.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.632+0000 7f3113400640 1 --2- 172.21.15.138:0/3273943685 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f311415bdc0 0x7f3114154710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:29.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.632+0000 7f3113400640 1 -- 172.21.15.138:0/3273943685 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3114073d70 msgr2=0x7f3114153f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:29.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.632+0000 7f3113400640 1 --2- 172.21.15.138:0/3273943685 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3114073d70 0x7f3114153f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:29.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.632+0000 7f3113400640 1 -- 172.21.15.138:0/3273943685 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f311415ce60 con 0x7f311406f880 2024-04-26T20:58:29.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.632+0000 7f3113400640 1 --2- 172.21.15.138:0/3273943685 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f311406f880 0x7f3114161b50 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f3104007e40 tx=0x7f310400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:29.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.632+0000 7f310be00640 1 -- 172.21.15.138:0/3273943685 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3104014620 con 0x7f311406f880 2024-04-26T20:58:29.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.632+0000 7f310be00640 1 -- 172.21.15.138:0/3273943685 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3104019070 con 0x7f311406f880 2024-04-26T20:58:29.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.632+0000 7f311a600640 1 -- 172.21.15.138:0/3273943685 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f311415b1c0 con 0x7f311406f880 2024-04-26T20:58:29.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.632+0000 7f310be00640 1 -- 172.21.15.138:0/3273943685 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3104014a00 con 0x7f311406f880 2024-04-26T20:58:29.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.632+0000 7f311a600640 1 -- 172.21.15.138:0/3273943685 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3114160130 con 0x7f311406f880 2024-04-26T20:58:29.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.632+0000 7f311a600640 1 -- 172.21.15.138:0/3273943685 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3114069430 con 0x7f311406f880 2024-04-26T20:58:29.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.632+0000 7f310be00640 1 -- 172.21.15.138:0/3273943685 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3104014ba0 con 0x7f311406f880 2024-04-26T20:58:29.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.636+0000 7f310be00640 1 --2- 172.21.15.138:0/3273943685 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f30f0068380 0x7f30f006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:29.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.636+0000 7f310be00640 1 -- 172.21.15.138:0/3273943685 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6756+0+0 (secure 0 0 0) 0x7f31040875b0 con 0x7f311406f880 2024-04-26T20:58:29.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.636+0000 7f310aa00640 1 --2- 172.21.15.138:0/3273943685 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f30f0068380 0x7f30f006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:29.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.636+0000 7f310aa00640 1 --2- 172.21.15.138:0/3273943685 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f30f0068380 0x7f30f006a840 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3114155690 tx=0x7f30fc007d60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:29.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.640+0000 7f310be00640 1 -- 172.21.15.138:0/3273943685 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3104057060 con 0x7f311406f880 2024-04-26T20:58:29.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.796+0000 7f311a600640 1 -- 172.21.15.138:0/3273943685 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f31140008e0 con 0x7f311406f880 2024-04-26T20:58:29.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.796+0000 7f310be00640 1 -- 172.21.15.138:0/3273943685 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v51) ==== 104+0+11 (secure 0 0 0) 0x7f310405b360 con 0x7f311406f880 2024-04-26T20:58:29.798 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 32 2024-04-26T20:58:29.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.800+0000 7f311a600640 1 -- 172.21.15.138:0/3273943685 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f30f0068380 msgr2=0x7f30f006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:29.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.800+0000 7f311a600640 1 --2- 172.21.15.138:0/3273943685 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f30f0068380 0x7f30f006a840 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3114155690 tx=0x7f30fc007d60 comp rx=0 tx=0).stop 2024-04-26T20:58:29.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.800+0000 7f311a600640 1 -- 172.21.15.138:0/3273943685 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f311406f880 msgr2=0x7f3114161b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:29.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.800+0000 7f311a600640 1 --2- 172.21.15.138:0/3273943685 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f311406f880 0x7f3114161b50 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f3104007e40 tx=0x7f310400e4b0 comp rx=0 tx=0).stop 2024-04-26T20:58:29.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.800+0000 7f311a600640 1 -- 172.21.15.138:0/3273943685 shutdown_connections 2024-04-26T20:58:29.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.800+0000 7f311a600640 1 --2- 172.21.15.138:0/3273943685 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f30f0068380 0x7f30f006a840 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:29.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.800+0000 7f311a600640 1 --2- 172.21.15.138:0/3273943685 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f311415bdc0 0x7f3114154710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:29.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.800+0000 7f311a600640 1 --2- 172.21.15.138:0/3273943685 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3114073d70 0x7f3114153f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:29.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.800+0000 7f311a600640 1 --2- 172.21.15.138:0/3273943685 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f311406f880 0x7f3114161b50 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:29.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.800+0000 7f311a600640 1 -- 172.21.15.138:0/3273943685 >> 172.21.15.138:0/3273943685 conn(0x7f31140d0bb0 msgr2=0x7f31140d0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:29.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.800+0000 7f311a600640 1 -- 172.21.15.138:0/3273943685 shutdown_connections 2024-04-26T20:58:29.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.800+0000 7f311a600640 1 -- 172.21.15.138:0/3273943685 wait complete. 2024-04-26T20:58:29.819 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T20:58:29.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.956+0000 7f1fcbe00640 1 Processor -- start 2024-04-26T20:58:29.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.956+0000 7f1fcbe00640 1 -- start start 2024-04-26T20:58:29.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.956+0000 7f1fcbe00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1fc415bdc0 0x7f1fc415f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:29.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.956+0000 7f1fcbe00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f1fc406f880 0x7f1fc40ce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:29.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.956+0000 7f1fcbe00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fc406dee0 con 0x7f1fc4073d70 2024-04-26T20:58:29.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.956+0000 7f1fcbe00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f1fc415c1a0 con 0x7f1fc406f880 2024-04-26T20:58:29.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.956+0000 7f1fcbe00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f1fc406e180 con 0x7f1fc415bdc0 2024-04-26T20:58:29.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.956+0000 7f1fc9e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f1fc406f880 0x7f1fc40ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:29.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.956+0000 7f1fc9e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f1fc406f880 0x7f1fc40ce780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40292/0 (socket says 172.21.15.138:40292) 2024-04-26T20:58:29.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.956+0000 7f1fc9e00640 1 -- 172.21.15.138:0/517813308 learned_addr learned my addr 172.21.15.138:0/517813308 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:29.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.956+0000 7f1fc9400640 1 --2- 172.21.15.138:0/517813308 >> v2:172.21.15.143:3300/0 conn(0x7f1fc415bdc0 0x7f1fc415f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:29.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.956+0000 7f1fc9e00640 1 -- 172.21.15.138:0/517813308 >> v2:172.21.15.143:3300/0 conn(0x7f1fc415bdc0 msgr2=0x7f1fc415f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:29.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.960+0000 7f1fc9e00640 1 --2- 172.21.15.138:0/517813308 >> v2:172.21.15.143:3300/0 conn(0x7f1fc415bdc0 0x7f1fc415f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:29.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.960+0000 7f1fc9e00640 1 -- 172.21.15.138:0/517813308 >> v1:172.21.15.143:6789/0 conn(0x7f1fc4073d70 legacy=0x7f1fc415fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:29.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.960+0000 7f1fc9e00640 1 -- 172.21.15.138:0/517813308 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fc406e460 con 0x7f1fc406f880 2024-04-26T20:58:29.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.960+0000 7f1fc9e00640 1 --2- 172.21.15.138:0/517813308 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1fc406f880 0x7f1fc40ce780 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4071b20 tx=0x7f1fbc01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ac07612b80f3e2e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:29.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.960+0000 7f1fc3e00640 1 -- 172.21.15.138:0/517813308 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc0b0070 con 0x7f1fc406f880 2024-04-26T20:58:29.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.960+0000 7f1fc3e00640 1 -- 172.21.15.138:0/517813308 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fbc0ab600 con 0x7f1fc406f880 2024-04-26T20:58:29.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.960+0000 7f1fc3e00640 1 -- 172.21.15.138:0/517813308 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc0ab9d0 con 0x7f1fc406f880 2024-04-26T20:58:29.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.960+0000 7f1fcbe00640 1 -- 172.21.15.138:0/517813308 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1fc406f880 msgr2=0x7f1fc40ce780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:29.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.960+0000 7f1fcbe00640 1 --2- 172.21.15.138:0/517813308 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1fc406f880 0x7f1fc40ce780 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4071b20 tx=0x7f1fbc01c400 comp rx=0 tx=0).stop 2024-04-26T20:58:29.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.960+0000 7f1fcbe00640 1 -- 172.21.15.138:0/517813308 shutdown_connections 2024-04-26T20:58:29.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.960+0000 7f1fcbe00640 1 --2- 172.21.15.138:0/517813308 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1fc406f880 0x7f1fc40ce780 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:29.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.960+0000 7f1fcbe00640 1 --2- 172.21.15.138:0/517813308 >> v2:172.21.15.143:3300/0 conn(0x7f1fc415bdc0 0x7f1fc415f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:29.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.960+0000 7f1fcbe00640 1 -- 172.21.15.138:0/517813308 >> 172.21.15.138:0/517813308 conn(0x7f1fc40d0bb0 msgr2=0x7f1fc40d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:29.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.960+0000 7f1fcbe00640 1 -- 172.21.15.138:0/517813308 shutdown_connections 2024-04-26T20:58:29.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.960+0000 7f1fcbe00640 1 -- 172.21.15.138:0/517813308 wait complete. 2024-04-26T20:58:29.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.964+0000 7f1fcbe00640 1 Processor -- start 2024-04-26T20:58:29.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.964+0000 7f1fcbe00640 1 -- start start 2024-04-26T20:58:29.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.964+0000 7f1fcbe00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1fc406f880 0x7f1fc40c4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:29.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.964+0000 7f1fcbe00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1fc4073d70 0x7f1fc4154870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:29.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.964+0000 7f1fcbe00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1fc415bdc0 0x7f1fc40c6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:29.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.964+0000 7f1fcbe00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc4168cd0 con 0x7f1fc4073d70 2024-04-26T20:58:29.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.964+0000 7f1fcbe00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc4160790 con 0x7f1fc406f880 2024-04-26T20:58:29.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.964+0000 7f1fcbe00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f1fc4168e50 con 0x7f1fc415bdc0 2024-04-26T20:58:29.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.964+0000 7f1fc8a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1fc4073d70 0x7f1fc4154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:29.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.964+0000 7f1fc8a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1fc4073d70 0x7f1fc4154870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40296/0 (socket says 172.21.15.138:40296) 2024-04-26T20:58:29.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.964+0000 7f1fc8a00640 1 -- 172.21.15.138:0/1396271040 learned_addr learned my addr 172.21.15.138:0/1396271040 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:29.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.964+0000 7f1fc9400640 1 --2- 172.21.15.138:0/1396271040 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1fc406f880 0x7f1fc40c4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:29.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.964+0000 7f1fc9e00640 1 --2- 172.21.15.138:0/1396271040 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1fc415bdc0 0x7f1fc40c6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:29.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.964+0000 7f1fc8a00640 1 -- 172.21.15.138:0/1396271040 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1fc415bdc0 msgr2=0x7f1fc40c6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:29.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.964+0000 7f1fc8a00640 1 --2- 172.21.15.138:0/1396271040 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1fc415bdc0 0x7f1fc40c6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:29.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.964+0000 7f1fc8a00640 1 -- 172.21.15.138:0/1396271040 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1fc406f880 msgr2=0x7f1fc40c4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:29.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.964+0000 7f1fc8a00640 1 --2- 172.21.15.138:0/1396271040 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1fc406f880 0x7f1fc40c4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:29.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.964+0000 7f1fc8a00640 1 -- 172.21.15.138:0/1396271040 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fc40c9960 con 0x7f1fc4073d70 2024-04-26T20:58:29.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.964+0000 7f1fc8a00640 1 --2- 172.21.15.138:0/1396271040 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1fc4073d70 0x7f1fc4154870 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f1fb000c430 tx=0x7f1fb000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:29.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.964+0000 7f1fc1600640 1 -- 172.21.15.138:0/1396271040 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb00052d0 con 0x7f1fc4073d70 2024-04-26T20:58:29.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.964+0000 7f1fc1600640 1 -- 172.21.15.138:0/1396271040 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fb0005470 con 0x7f1fc4073d70 2024-04-26T20:58:29.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.964+0000 7f1fc1600640 1 -- 172.21.15.138:0/1396271040 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb0007260 con 0x7f1fc4073d70 2024-04-26T20:58:29.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.964+0000 7f1fcbe00640 1 -- 172.21.15.138:0/1396271040 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fc40c5d70 con 0x7f1fc4073d70 2024-04-26T20:58:29.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.968+0000 7f1fcbe00640 1 -- 172.21.15.138:0/1396271040 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fc40c9c40 con 0x7f1fc4073d70 2024-04-26T20:58:29.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.968+0000 7f1fcbe00640 1 -- 172.21.15.138:0/1396271040 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fc4069430 con 0x7f1fc4073d70 2024-04-26T20:58:29.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.968+0000 7f1fc1600640 1 -- 172.21.15.138:0/1396271040 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1fb0007400 con 0x7f1fc4073d70 2024-04-26T20:58:29.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.968+0000 7f1fc1600640 1 --2- 172.21.15.138:0/1396271040 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1fa4068380 0x7f1fa406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:29.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.968+0000 7f1fc1600640 1 -- 172.21.15.138:0/1396271040 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6756+0+0 (secure 0 0 0) 0x7f1fb0086290 con 0x7f1fc4073d70 2024-04-26T20:58:29.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.968+0000 7f1fc9400640 1 --2- 172.21.15.138:0/1396271040 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1fa4068380 0x7f1fa406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:29.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.968+0000 7f1fc9400640 1 --2- 172.21.15.138:0/1396271040 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1fa4068380 0x7f1fa406a840 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1fc41fb460 tx=0x7f1fb8009830 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:29.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:29.972+0000 7f1fc1600640 1 -- 172.21.15.138:0/1396271040 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1fb0055dd0 con 0x7f1fc4073d70 2024-04-26T20:58:30.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.132+0000 7f1fcbe00640 1 -- 172.21.15.138:0/1396271040 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f1fc40d19c0 con 0x7f1fc4073d70 2024-04-26T20:58:30.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.132+0000 7f1fc1600640 1 -- 172.21.15.138:0/1396271040 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v51) ==== 100+0+11 (secure 0 0 0) 0x7f1fb005a0d0 con 0x7f1fc4073d70 2024-04-26T20:58:30.135 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 64 2024-04-26T20:58:30.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.136+0000 7f1fcbe00640 1 -- 172.21.15.138:0/1396271040 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1fa4068380 msgr2=0x7f1fa406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:30.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.136+0000 7f1fcbe00640 1 --2- 172.21.15.138:0/1396271040 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1fa4068380 0x7f1fa406a840 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1fc41fb460 tx=0x7f1fb8009830 comp rx=0 tx=0).stop 2024-04-26T20:58:30.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.136+0000 7f1fcbe00640 1 -- 172.21.15.138:0/1396271040 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1fc4073d70 msgr2=0x7f1fc4154870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:30.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.136+0000 7f1fcbe00640 1 --2- 172.21.15.138:0/1396271040 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1fc4073d70 0x7f1fc4154870 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f1fb000c430 tx=0x7f1fb000c8f0 comp rx=0 tx=0).stop 2024-04-26T20:58:30.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.136+0000 7f1fcbe00640 1 -- 172.21.15.138:0/1396271040 shutdown_connections 2024-04-26T20:58:30.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.136+0000 7f1fcbe00640 1 --2- 172.21.15.138:0/1396271040 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1fa4068380 0x7f1fa406a840 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:30.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.136+0000 7f1fcbe00640 1 --2- 172.21.15.138:0/1396271040 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1fc415bdc0 0x7f1fc40c6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:30.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.136+0000 7f1fcbe00640 1 --2- 172.21.15.138:0/1396271040 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1fc4073d70 0x7f1fc4154870 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:30.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.136+0000 7f1fcbe00640 1 --2- 172.21.15.138:0/1396271040 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1fc406f880 0x7f1fc40c4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:30.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.136+0000 7f1fcbe00640 1 -- 172.21.15.138:0/1396271040 >> 172.21.15.138:0/1396271040 conn(0x7f1fc40d0bb0 msgr2=0x7f1fc406e770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:30.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.136+0000 7f1fcbe00640 1 -- 172.21.15.138:0/1396271040 shutdown_connections 2024-04-26T20:58:30.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.136+0000 7f1fcbe00640 1 -- 172.21.15.138:0/1396271040 wait complete. 2024-04-26T20:58:30.156 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get recovery_fs_metadata pg_num 2024-04-26T20:58:30.295 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.292+0000 7f169fa00640 1 Processor -- start 2024-04-26T20:58:30.295 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.296+0000 7f169fa00640 1 -- start start 2024-04-26T20:58:30.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.296+0000 7f169fa00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f16980cb910 0x7f16980b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:30.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.296+0000 7f169fa00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16980cd210 con 0x7f169815aa60 2024-04-26T20:58:30.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.296+0000 7f169fa00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f169815d6a0 con 0x7f169815e180 2024-04-26T20:58:30.297 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.296+0000 7f169fa00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f169815d980 con 0x7f16980cb910 2024-04-26T20:58:30.297 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.296+0000 7f169da00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f16980cb910 0x7f16980b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:30.297 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.296+0000 7f169d000640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f169815aa60 0x7f16980cc7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:32876/0 (socket says 172.21.15.138:32876) 2024-04-26T20:58:30.297 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.296+0000 7f169d000640 1 -- 172.21.15.138:0/4133647507 learned_addr learned my addr 172.21.15.138:0/4133647507 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:30.297 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.296+0000 7f169da00640 1 -- 172.21.15.138:0/4133647507 >> v1:172.21.15.143:6789/0 conn(0x7f169815e180 legacy=0x7f16980cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:30.297 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.296+0000 7f169da00640 1 -- 172.21.15.138:0/4133647507 >> v1:172.21.15.138:6789/0 conn(0x7f169815aa60 legacy=0x7f16980cc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:30.297 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.296+0000 7f1697400640 1 -- 172.21.15.138:0/4133647507 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 799622256 0 0) 0x7f16980cd210 con 0x7f169815aa60 2024-04-26T20:58:30.297 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.296+0000 7f169da00640 1 -- 172.21.15.138:0/4133647507 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f169815dc60 con 0x7f16980cb910 2024-04-26T20:58:30.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.300+0000 7f169da00640 1 --2- 172.21.15.138:0/4133647507 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f16980cb910 0x7f16980b5aa0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f1690009d90 tx=0x7f169001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=360f869e12607e6c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:30.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.300+0000 7f1697400640 1 -- 172.21.15.138:0/4133647507 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16900b2070 con 0x7f16980cb910 2024-04-26T20:58:30.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.300+0000 7f1697400640 1 -- 172.21.15.138:0/4133647507 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16900a5830 con 0x7f16980cb910 2024-04-26T20:58:30.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.300+0000 7f1697400640 1 -- 172.21.15.138:0/4133647507 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16900a5c00 con 0x7f16980cb910 2024-04-26T20:58:30.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.300+0000 7f169fa00640 1 -- 172.21.15.138:0/4133647507 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f16980cb910 msgr2=0x7f16980b5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:30.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.300+0000 7f169fa00640 1 --2- 172.21.15.138:0/4133647507 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f16980cb910 0x7f16980b5aa0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f1690009d90 tx=0x7f169001c970 comp rx=0 tx=0).stop 2024-04-26T20:58:30.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.300+0000 7f169fa00640 1 -- 172.21.15.138:0/4133647507 shutdown_connections 2024-04-26T20:58:30.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.300+0000 7f169fa00640 1 --2- 172.21.15.138:0/4133647507 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f16980cb910 0x7f16980b5aa0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:30.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.300+0000 7f169fa00640 1 -- 172.21.15.138:0/4133647507 >> 172.21.15.138:0/4133647507 conn(0x7f16980d0bb0 msgr2=0x7f16980d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:30.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.300+0000 7f169fa00640 1 -- 172.21.15.138:0/4133647507 shutdown_connections 2024-04-26T20:58:30.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.300+0000 7f169fa00640 1 -- 172.21.15.138:0/4133647507 wait complete. 2024-04-26T20:58:30.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.300+0000 7f169fa00640 1 Processor -- start 2024-04-26T20:58:30.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.300+0000 7f169fa00640 1 -- start start 2024-04-26T20:58:30.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.304+0000 7f169fa00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f16980cb910 0x7f1698150030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:30.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.304+0000 7f169fa00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f169815aa60 0x7f1698154990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:30.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.304+0000 7f169fa00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f169815e180 0x7f16981506d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:30.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.304+0000 7f169fa00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f169816ae30 con 0x7f16980cb910 2024-04-26T20:58:30.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.304+0000 7f169fa00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f1698072240 con 0x7f169815aa60 2024-04-26T20:58:30.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.304+0000 7f169fa00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f169816afb0 con 0x7f169815e180 2024-04-26T20:58:30.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.304+0000 7f169d000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f16980cb910 0x7f1698150030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:30.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.304+0000 7f169d000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f16980cb910 0x7f1698150030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40312/0 (socket says 172.21.15.138:40312) 2024-04-26T20:58:30.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.304+0000 7f169d000640 1 -- 172.21.15.138:0/2840236726 learned_addr learned my addr 172.21.15.138:0/2840236726 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:30.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.304+0000 7f169d000640 1 -- 172.21.15.138:0/2840236726 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f169815e180 msgr2=0x7f16981506d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:30.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.304+0000 7f169d000640 1 --2- 172.21.15.138:0/2840236726 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f169815e180 0x7f16981506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:30.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.304+0000 7f169d000640 1 -- 172.21.15.138:0/2840236726 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f169815aa60 msgr2=0x7f1698154990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:30.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.304+0000 7f1697e00640 1 --2- 172.21.15.138:0/2840236726 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f169815aa60 0x7f1698154990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:30.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.304+0000 7f169d000640 1 --2- 172.21.15.138:0/2840236726 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f169815aa60 0x7f1698154990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:30.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.304+0000 7f169d000640 1 -- 172.21.15.138:0/2840236726 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16980c5ec0 con 0x7f16980cb910 2024-04-26T20:58:30.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.304+0000 7f1697e00640 1 --2- 172.21.15.138:0/2840236726 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f169815aa60 0x7f1698154990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:58:30.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.304+0000 7f169d000640 1 --2- 172.21.15.138:0/2840236726 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f16980cb910 0x7f1698150030 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f168c00c4d0 tx=0x7f168c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:30.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.304+0000 7f1694c00640 1 -- 172.21.15.138:0/2840236726 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f168c018070 con 0x7f16980cb910 2024-04-26T20:58:30.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.304+0000 7f1694c00640 1 -- 172.21.15.138:0/2840236726 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f168c0074e0 con 0x7f16980cb910 2024-04-26T20:58:30.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.304+0000 7f169fa00640 1 -- 172.21.15.138:0/2840236726 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16980c61a0 con 0x7f16980cb910 2024-04-26T20:58:30.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.304+0000 7f1694c00640 1 -- 172.21.15.138:0/2840236726 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f168c004a30 con 0x7f16980cb910 2024-04-26T20:58:30.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.304+0000 7f169fa00640 1 -- 172.21.15.138:0/2840236726 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16980c6760 con 0x7f16980cb910 2024-04-26T20:58:30.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.304+0000 7f169fa00640 1 -- 172.21.15.138:0/2840236726 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16980c6960 con 0x7f16980cb910 2024-04-26T20:58:30.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.304+0000 7f1694c00640 1 -- 172.21.15.138:0/2840236726 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f168c01b070 con 0x7f16980cb910 2024-04-26T20:58:30.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.308+0000 7f1694c00640 1 --2- 172.21.15.138:0/2840236726 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f16780683b0 0x7f167806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:30.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.308+0000 7f1694c00640 1 -- 172.21.15.138:0/2840236726 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6756+0+0 (secure 0 0 0) 0x7f168c0860c0 con 0x7f16980cb910 2024-04-26T20:58:30.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.308+0000 7f1697e00640 1 --2- 172.21.15.138:0/2840236726 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f16780683b0 0x7f167806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:30.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.308+0000 7f1697e00640 1 --2- 172.21.15.138:0/2840236726 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f16780683b0 0x7f167806a870 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1698153140 tx=0x7f1684009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:30.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.312+0000 7f1694c00640 1 -- 172.21.15.138:0/2840236726 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f16980c6960 con 0x7f16980cb910 2024-04-26T20:58:30.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.464+0000 7f169fa00640 1 -- 172.21.15.138:0/2840236726 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "recovery_fs_metadata", "var": "pg_num"} v 0) -- 0x7f1698069430 con 0x7f16980cb910 2024-04-26T20:58:30.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.468+0000 7f1694c00640 1 -- 172.21.15.138:0/2840236726 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "recovery_fs_metadata", "var": "pg_num"}]=0 v51) ==== 109+0+11 (secure 0 0 0) 0x7f168c056260 con 0x7f16980cb910 2024-04-26T20:58:30.468 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 32 2024-04-26T20:58:30.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.468+0000 7f169fa00640 1 -- 172.21.15.138:0/2840236726 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f16780683b0 msgr2=0x7f167806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:30.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.468+0000 7f169fa00640 1 --2- 172.21.15.138:0/2840236726 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f16780683b0 0x7f167806a870 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1698153140 tx=0x7f1684009040 comp rx=0 tx=0).stop 2024-04-26T20:58:30.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.468+0000 7f169fa00640 1 -- 172.21.15.138:0/2840236726 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f16980cb910 msgr2=0x7f1698150030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:30.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.468+0000 7f169fa00640 1 --2- 172.21.15.138:0/2840236726 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f16980cb910 0x7f1698150030 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f168c00c4d0 tx=0x7f168c00c990 comp rx=0 tx=0).stop 2024-04-26T20:58:30.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.468+0000 7f169fa00640 1 -- 172.21.15.138:0/2840236726 shutdown_connections 2024-04-26T20:58:30.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.468+0000 7f169fa00640 1 --2- 172.21.15.138:0/2840236726 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f16780683b0 0x7f167806a870 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:30.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.468+0000 7f169fa00640 1 --2- 172.21.15.138:0/2840236726 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f169815e180 0x7f16981506d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:30.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.468+0000 7f169fa00640 1 --2- 172.21.15.138:0/2840236726 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f169815aa60 0x7f1698154990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:30.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.468+0000 7f169fa00640 1 --2- 172.21.15.138:0/2840236726 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f16980cb910 0x7f1698150030 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:30.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.468+0000 7f169fa00640 1 -- 172.21.15.138:0/2840236726 >> 172.21.15.138:0/2840236726 conn(0x7f16980d0bb0 msgr2=0x7f169815e630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:30.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.468+0000 7f169fa00640 1 -- 172.21.15.138:0/2840236726 shutdown_connections 2024-04-26T20:58:30.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.468+0000 7f169fa00640 1 -- 172.21.15.138:0/2840236726 wait complete. 2024-04-26T20:58:30.488 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T20:58:30.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.624+0000 7f1138e00640 1 Processor -- start 2024-04-26T20:58:30.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.624+0000 7f1138e00640 1 -- start start 2024-04-26T20:58:30.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.624+0000 7f1138e00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f113415ce20 0x7f1134161340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:30.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.624+0000 7f1138e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f11340cca00 0x7f11340cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:30.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.624+0000 7f1138e00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11340cd360 con 0x7f113415e0c0 2024-04-26T20:58:30.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.624+0000 7f1138e00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f1134073b70 con 0x7f113415ce20 2024-04-26T20:58:30.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.624+0000 7f1138e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f1134073e10 con 0x7f11340cca00 2024-04-26T20:58:30.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.628+0000 7f1131e00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f113415ce20 0x7f1134161340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:30.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.628+0000 7f1132800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f11340cca00 0x7f11340cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:30.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.628+0000 7f1129400640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f113415e0c0 0x7f1134071ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.138:59684/0 (socket says 172.21.15.138:59684) 2024-04-26T20:58:30.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.628+0000 7f1129400640 1 -- 172.21.15.138:0/3638040308 learned_addr learned my addr 172.21.15.138:0/3638040308 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:30.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.628+0000 7f1131e00640 1 -- 172.21.15.138:0/3638040308 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f11340cca00 msgr2=0x7f11340cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:30.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.628+0000 7f1131e00640 1 --2- 172.21.15.138:0/3638040308 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f11340cca00 0x7f11340cce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:30.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.628+0000 7f1131e00640 1 -- 172.21.15.138:0/3638040308 >> v1:172.21.15.143:6789/0 conn(0x7f113415e0c0 legacy=0x7f1134071ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:30.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.628+0000 7f1131e00640 1 -- 172.21.15.138:0/3638040308 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11340740f0 con 0x7f113415ce20 2024-04-26T20:58:30.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.628+0000 7f1132800640 1 --2- 172.21.15.138:0/3638040308 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f11340cca00 0x7f11340cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:58:30.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.628+0000 7f1131400640 1 -- 172.21.15.138:0/3638040308 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2742015058 0 0) 0x7f11340cd360 con 0x7f113415e0c0 2024-04-26T20:58:30.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.628+0000 7f1131e00640 1 --2- 172.21.15.138:0/3638040308 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f113415ce20 0x7f1134161340 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f11240097c0 tx=0x7f112401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2d86d02725a8edd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:30.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.628+0000 7f1131400640 1 -- 172.21.15.138:0/3638040308 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11240b2070 con 0x7f113415ce20 2024-04-26T20:58:30.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.628+0000 7f1131400640 1 -- 172.21.15.138:0/3638040308 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11240ad640 con 0x7f113415ce20 2024-04-26T20:58:30.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.628+0000 7f1131400640 1 -- 172.21.15.138:0/3638040308 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11240ada10 con 0x7f113415ce20 2024-04-26T20:58:30.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.632+0000 7f1138e00640 1 -- 172.21.15.138:0/3638040308 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f113415ce20 msgr2=0x7f1134161340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:30.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.632+0000 7f1138e00640 1 --2- 172.21.15.138:0/3638040308 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f113415ce20 0x7f1134161340 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f11240097c0 tx=0x7f112401c4a0 comp rx=0 tx=0).stop 2024-04-26T20:58:30.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.632+0000 7f1138e00640 1 -- 172.21.15.138:0/3638040308 shutdown_connections 2024-04-26T20:58:30.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.632+0000 7f1138e00640 1 --2- 172.21.15.138:0/3638040308 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f11340cca00 0x7f11340cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:30.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.632+0000 7f1138e00640 1 --2- 172.21.15.138:0/3638040308 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f113415ce20 0x7f1134161340 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:30.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.632+0000 7f1138e00640 1 -- 172.21.15.138:0/3638040308 >> 172.21.15.138:0/3638040308 conn(0x7f11340d0b20 msgr2=0x7f11340d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:30.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.632+0000 7f1138e00640 1 -- 172.21.15.138:0/3638040308 shutdown_connections 2024-04-26T20:58:30.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.632+0000 7f1138e00640 1 -- 172.21.15.138:0/3638040308 wait complete. 2024-04-26T20:58:30.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.632+0000 7f1138e00640 1 Processor -- start 2024-04-26T20:58:30.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.632+0000 7f1138e00640 1 -- start start 2024-04-26T20:58:30.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.632+0000 7f1138e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11340cca00 0x7f11341facf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:30.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.632+0000 7f1138e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f113415ce20 0x7f113414d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:30.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.632+0000 7f1138e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f113415e0c0 0x7f11341f92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:30.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.632+0000 7f1138e00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f113415d380 con 0x7f11340cca00 2024-04-26T20:58:30.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.632+0000 7f1138e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f113415d200 con 0x7f113415ce20 2024-04-26T20:58:30.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.632+0000 7f1138e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f113406e680 con 0x7f113415e0c0 2024-04-26T20:58:30.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.632+0000 7f1131e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11340cca00 0x7f11341facf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:30.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.632+0000 7f1131e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11340cca00 0x7f11341facf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40320/0 (socket says 172.21.15.138:40320) 2024-04-26T20:58:30.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.632+0000 7f1131e00640 1 -- 172.21.15.138:0/134081642 learned_addr learned my addr 172.21.15.138:0/134081642 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:30.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.632+0000 7f1129400640 1 --2- 172.21.15.138:0/134081642 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f113415ce20 0x7f113414d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:30.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.632+0000 7f1132800640 1 --2- 172.21.15.138:0/134081642 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f113415e0c0 0x7f11341f92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:30.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.632+0000 7f1131e00640 1 -- 172.21.15.138:0/134081642 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f113415e0c0 msgr2=0x7f11341f92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:30.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.632+0000 7f1131e00640 1 --2- 172.21.15.138:0/134081642 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f113415e0c0 0x7f11341f92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:30.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.632+0000 7f1131e00640 1 -- 172.21.15.138:0/134081642 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f113415ce20 msgr2=0x7f113414d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:30.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.632+0000 7f1131e00640 1 --2- 172.21.15.138:0/134081642 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f113415ce20 0x7f113414d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:30.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.632+0000 7f1131e00640 1 -- 172.21.15.138:0/134081642 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11340b3880 con 0x7f11340cca00 2024-04-26T20:58:30.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.636+0000 7f1131e00640 1 --2- 172.21.15.138:0/134081642 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11340cca00 0x7f11341facf0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f11240097c0 tx=0x7f1124019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:30.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.636+0000 7f112aa00640 1 -- 172.21.15.138:0/134081642 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11240bd070 con 0x7f11340cca00 2024-04-26T20:58:30.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.636+0000 7f112aa00640 1 -- 172.21.15.138:0/134081642 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1124004030 con 0x7f11340cca00 2024-04-26T20:58:30.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.636+0000 7f1138e00640 1 -- 172.21.15.138:0/134081642 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11340b3b20 con 0x7f11340cca00 2024-04-26T20:58:30.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.636+0000 7f112aa00640 1 -- 172.21.15.138:0/134081642 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11240b2040 con 0x7f11340cca00 2024-04-26T20:58:30.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.636+0000 7f1138e00640 1 -- 172.21.15.138:0/134081642 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11340b40e0 con 0x7f11340cca00 2024-04-26T20:58:30.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.636+0000 7f1138e00640 1 -- 172.21.15.138:0/134081642 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1134069510 con 0x7f11340cca00 2024-04-26T20:58:30.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.636+0000 7f112aa00640 1 -- 172.21.15.138:0/134081642 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f11240c0070 con 0x7f11340cca00 2024-04-26T20:58:30.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.636+0000 7f112aa00640 1 --2- 172.21.15.138:0/134081642 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1110068380 0x7f111006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:30.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.636+0000 7f112aa00640 1 -- 172.21.15.138:0/134081642 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6756+0+0 (secure 0 0 0) 0x7f112411ffb0 con 0x7f11340cca00 2024-04-26T20:58:30.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.636+0000 7f1129400640 1 --2- 172.21.15.138:0/134081642 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1110068380 0x7f111006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:30.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.640+0000 7f1129400640 1 --2- 172.21.15.138:0/134081642 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1110068380 0x7f111006a840 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1134075a10 tx=0x7f111c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:30.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.640+0000 7f112aa00640 1 -- 172.21.15.138:0/134081642 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1124016090 con 0x7f11340cca00 2024-04-26T20:58:30.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.808+0000 7f1138e00640 1 -- 172.21.15.138:0/134081642 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f11340b42b0 con 0x7f11340cca00 2024-04-26T20:58:30.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.812+0000 7f112aa00640 1 -- 172.21.15.138:0/134081642 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v51) ==== 80+0+122 (secure 0 0 0) 0x7f11240efa60 con 0x7f11340cca00 2024-04-26T20:58:30.815 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.143:6836/483370849 2024-04-27T20:58:07.183664+0000 2024-04-26T20:58:30.815 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.143:6834/483370849 2024-04-27T20:58:07.183664+0000 2024-04-26T20:58:30.816 INFO:teuthology.orchestra.run.smithi138.stderr:listed 2 entries 2024-04-26T20:58:30.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.812+0000 7f1138e00640 1 -- 172.21.15.138:0/134081642 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1110068380 msgr2=0x7f111006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:30.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.812+0000 7f1138e00640 1 --2- 172.21.15.138:0/134081642 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1110068380 0x7f111006a840 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1134075a10 tx=0x7f111c009040 comp rx=0 tx=0).stop 2024-04-26T20:58:30.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.812+0000 7f1138e00640 1 -- 172.21.15.138:0/134081642 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11340cca00 msgr2=0x7f11341facf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:30.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.812+0000 7f1138e00640 1 --2- 172.21.15.138:0/134081642 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11340cca00 0x7f11341facf0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f11240097c0 tx=0x7f1124019240 comp rx=0 tx=0).stop 2024-04-26T20:58:30.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.812+0000 7f1138e00640 1 -- 172.21.15.138:0/134081642 shutdown_connections 2024-04-26T20:58:30.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.812+0000 7f1138e00640 1 --2- 172.21.15.138:0/134081642 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1110068380 0x7f111006a840 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:30.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.812+0000 7f1138e00640 1 --2- 172.21.15.138:0/134081642 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f113415e0c0 0x7f11341f92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:30.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.812+0000 7f1138e00640 1 --2- 172.21.15.138:0/134081642 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f113415ce20 0x7f113414d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:30.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.812+0000 7f1138e00640 1 --2- 172.21.15.138:0/134081642 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11340cca00 0x7f11341facf0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:30.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.812+0000 7f1138e00640 1 -- 172.21.15.138:0/134081642 >> 172.21.15.138:0/134081642 conn(0x7f11340d0b20 msgr2=0x7f113415d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:30.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.812+0000 7f1138e00640 1 -- 172.21.15.138:0/134081642 shutdown_connections 2024-04-26T20:58:30.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:30.812+0000 7f1138e00640 1 -- 172.21.15.138:0/134081642 wait complete. 2024-04-26T20:58:30.832 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-26T20:58:30.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:58:30.833 DEBUG:teuthology.orchestra.run.smithi138:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-26T20:58:30.861 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi138.front.sepia.ceph.com 2024-04-26T20:58:30.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:58:30.861 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T20:58:30.915 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T20:58:30.915 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T20:58:30.915 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T20:58:30.925 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350292k,nr_inodes=4087573,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2870 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274988k,nr_inodes=818747,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T20:58:30.925 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T20:58:30.925 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-26T20:58:30.925 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T20:58:30.971 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350256k,nr_inodes=4087564,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6206 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T20:58:30.971 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T20:58:30.971 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T20:58:30.971 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T20:58:30.982 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350292k,nr_inodes=4087573,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2870 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274988k,nr_inodes=818747,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T20:58:30.982 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:58:31.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.148+0000 7f7e01e00640 1 Processor -- start 2024-04-26T20:58:31.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.148+0000 7f7e01e00640 1 -- start start 2024-04-26T20:58:31.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.148+0000 7f7e01e00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7dfc0b2280 0x7f7dfc0b2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:31.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.148+0000 7f7e01e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7dfc0d1720 0x7f7dfc0b30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:31.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.148+0000 7f7e01e00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dfc0ce540 con 0x7f7dfc15d0f0 2024-04-26T20:58:31.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.148+0000 7f7e01e00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f7dfc0d0e50 con 0x7f7dfc0b2280 2024-04-26T20:58:31.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.148+0000 7f7e01e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f7dfc0b26e0 con 0x7f7dfc0d1720 2024-04-26T20:58:31.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.148+0000 7f7dfaa00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f7dfc15d0f0 0x7f7dfc0d1010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:32882/0 (socket says 172.21.15.138:32882) 2024-04-26T20:58:31.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.148+0000 7f7dfaa00640 1 -- 172.21.15.138:0/1487906938 learned_addr learned my addr 172.21.15.138:0/1487906938 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:31.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.148+0000 7f7dfb400640 1 --2- 172.21.15.138:0/1487906938 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7dfc0d1720 0x7f7dfc0b30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:31.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.148+0000 7f7dfa000640 1 --2- 172.21.15.138:0/1487906938 >> v2:172.21.15.143:3300/0 conn(0x7f7dfc0b2280 0x7f7dfc0b2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:31.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.148+0000 7f7df9600640 1 -- 172.21.15.138:0/1487906938 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1915776240 0 0) 0x7f7dfc0ce540 con 0x7f7dfc15d0f0 2024-04-26T20:58:31.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.148+0000 7f7df9600640 1 -- 172.21.15.138:0/1487906938 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7de0003530 con 0x7f7dfc15d0f0 2024-04-26T20:58:31.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.148+0000 7f7df9600640 1 -- 172.21.15.138:0/1487906938 <== mon.0 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2442456877 0 0) 0x7f7de0003530 con 0x7f7dfc15d0f0 2024-04-26T20:58:31.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.148+0000 7f7df9600640 1 -- 172.21.15.138:0/1487906938 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7dfc0d1720 msgr2=0x7f7dfc0b30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:31.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.148+0000 7f7df9600640 1 --2- 172.21.15.138:0/1487906938 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7dfc0d1720 0x7f7dfc0b30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:31.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.148+0000 7f7df9600640 1 -- 172.21.15.138:0/1487906938 >> v2:172.21.15.143:3300/0 conn(0x7f7dfc0b2280 msgr2=0x7f7dfc0b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:31.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.148+0000 7f7df9600640 1 --2- 172.21.15.138:0/1487906938 >> v2:172.21.15.143:3300/0 conn(0x7f7dfc0b2280 0x7f7dfc0b2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:31.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.148+0000 7f7df9600640 1 -- 172.21.15.138:0/1487906938 --> v1:172.21.15.138:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dfc0ce820 con 0x7f7dfc15d0f0 2024-04-26T20:58:31.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.148+0000 7f7df9600640 1 -- 172.21.15.138:0/1487906938 <== mon.0 v1:172.21.15.138:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2715389689 0 0) 0x7f7dec001680 con 0x7f7dfc15d0f0 2024-04-26T20:58:31.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.148+0000 7f7df9600640 1 -- 172.21.15.138:0/1487906938 >> v1:172.21.15.138:6789/0 conn(0x7f7dfc15d0f0 legacy=0x7f7dfc0d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:31.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.148+0000 7f7df9600640 1 --2- 172.21.15.138:0/1487906938 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7de00039c0 0x7f7de0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:31.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.148+0000 7f7df9600640 1 --2- 172.21.15.138:0/1487906938 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7dfc0d1720 0x7f7de0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:31.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.148+0000 7f7df9600640 1 --2- 172.21.15.138:0/1487906938 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7de0004d50 0x7f7de00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:31.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.148+0000 7f7df9600640 1 -- 172.21.15.138:0/1487906938 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f7dfc0d0e50 con 0x7f7de00039c0 2024-04-26T20:58:31.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.148+0000 7f7df9600640 1 -- 172.21.15.138:0/1487906938 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f7dfc0b26e0 con 0x7f7de0004d50 2024-04-26T20:58:31.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.148+0000 7f7df9600640 1 -- 172.21.15.138:0/1487906938 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f7de000b9d0 con 0x7f7dfc0d1720 2024-04-26T20:58:31.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.148+0000 7f7dfaa00640 1 --2- 172.21.15.138:0/1487906938 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7de00039c0 0x7f7de0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:31.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.148+0000 7f7dfa000640 1 --2- 172.21.15.138:0/1487906938 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7dfc0d1720 0x7f7de0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:31.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.148+0000 7f7dfb400640 1 --2- 172.21.15.138:0/1487906938 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7de0004d50 0x7f7de00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:31.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.148+0000 7f7dfaa00640 1 -- 172.21.15.138:0/1487906938 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7dfc0d1720 msgr2=0x7f7de0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:31.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.148+0000 7f7dfaa00640 1 --2- 172.21.15.138:0/1487906938 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7dfc0d1720 0x7f7de0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:31.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.148+0000 7f7dfaa00640 1 -- 172.21.15.138:0/1487906938 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7de0004d50 msgr2=0x7f7de00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:31.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.148+0000 7f7dfaa00640 1 --2- 172.21.15.138:0/1487906938 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7de0004d50 0x7f7de00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:31.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.152+0000 7f7dfaa00640 1 -- 172.21.15.138:0/1487906938 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7de0003530 con 0x7f7de00039c0 2024-04-26T20:58:31.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.152+0000 7f7dfaa00640 1 --2- 172.21.15.138:0/1487906938 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7de00039c0 0x7f7de0003de0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f7dec00c270 tx=0x7f7dec01ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8db5f4e812eddff7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:31.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.152+0000 7f7df9600640 1 -- 172.21.15.138:0/1487906938 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dec007d60 con 0x7f7de00039c0 2024-04-26T20:58:31.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.152+0000 7f7df9600640 1 -- 172.21.15.138:0/1487906938 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dec0a9020 con 0x7f7de00039c0 2024-04-26T20:58:31.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.152+0000 7f7df9600640 1 -- 172.21.15.138:0/1487906938 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dec005ae0 con 0x7f7de00039c0 2024-04-26T20:58:31.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.152+0000 7f7e01e00640 1 -- 172.21.15.138:0/1487906938 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7de00039c0 msgr2=0x7f7de0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:31.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.152+0000 7f7e01e00640 1 --2- 172.21.15.138:0/1487906938 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7de00039c0 0x7f7de0003de0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f7dec00c270 tx=0x7f7dec01ccc0 comp rx=0 tx=0).stop 2024-04-26T20:58:31.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.152+0000 7f7dfb400640 1 -- 172.21.15.138:0/1487906938 reap_dead start 2024-04-26T20:58:31.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.152+0000 7f7e01e00640 1 -- 172.21.15.138:0/1487906938 shutdown_connections 2024-04-26T20:58:31.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.152+0000 7f7e01e00640 1 -- 172.21.15.138:0/1487906938 >> 172.21.15.138:0/1487906938 conn(0x7f7dfc0d2d80 msgr2=0x7f7dfc0d3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:31.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.152+0000 7f7e01e00640 1 -- 172.21.15.138:0/1487906938 shutdown_connections 2024-04-26T20:58:31.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.152+0000 7f7e01e00640 1 -- 172.21.15.138:0/1487906938 wait complete. 2024-04-26T20:58:31.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.156+0000 7f7e01e00640 1 Processor -- start 2024-04-26T20:58:31.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.156+0000 7f7e01e00640 1 -- start start 2024-04-26T20:58:31.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.156+0000 7f7e01e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7de00039c0 0x7f7dfc146970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:31.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.156+0000 7f7e01e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7dfc149490 0x7f7dfc0c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:31.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.156+0000 7f7e01e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7dfc0c68b0 0x7f7dfc0c74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:31.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.156+0000 7f7e01e00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f7dfc0b3c50 con 0x7f7dfc0c68b0 2024-04-26T20:58:31.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.156+0000 7f7e01e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f7dfc0b3ad0 con 0x7f7dfc149490 2024-04-26T20:58:31.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.156+0000 7f7e01e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f7dfc0b3dd0 con 0x7f7de00039c0 2024-04-26T20:58:31.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.156+0000 7f7dfb400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7dfc0c68b0 0x7f7dfc0c74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:31.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.156+0000 7f7dfb400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7dfc0c68b0 0x7f7dfc0c74d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40340/0 (socket says 172.21.15.138:40340) 2024-04-26T20:58:31.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.156+0000 7f7dfb400640 1 -- 172.21.15.138:0/4283109060 learned_addr learned my addr 172.21.15.138:0/4283109060 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:31.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.156+0000 7f7dfaa00640 1 --2- 172.21.15.138:0/4283109060 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7de00039c0 0x7f7dfc146970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:31.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.156+0000 7f7dfa000640 1 --2- 172.21.15.138:0/4283109060 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7dfc149490 0x7f7dfc0c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:31.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.156+0000 7f7dfb400640 1 -- 172.21.15.138:0/4283109060 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7de00039c0 msgr2=0x7f7dfc146970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:31.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.156+0000 7f7dfb400640 1 --2- 172.21.15.138:0/4283109060 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7de00039c0 0x7f7dfc146970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:31.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.156+0000 7f7dfb400640 1 -- 172.21.15.138:0/4283109060 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7dfc149490 msgr2=0x7f7dfc0c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:31.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.156+0000 7f7dfb400640 1 --2- 172.21.15.138:0/4283109060 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7dfc149490 0x7f7dfc0c59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:31.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.156+0000 7f7dfb400640 1 -- 172.21.15.138:0/4283109060 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dfc155210 con 0x7f7dfc0c68b0 2024-04-26T20:58:31.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.156+0000 7f7dfb400640 1 --2- 172.21.15.138:0/4283109060 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7dfc0c68b0 0x7f7dfc0c74d0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f7df4011bf0 tx=0x7f7df400f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:31.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.156+0000 7f7df3400640 1 -- 172.21.15.138:0/4283109060 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df400fcb0 con 0x7f7dfc0c68b0 2024-04-26T20:58:31.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.156+0000 7f7df3400640 1 -- 172.21.15.138:0/4283109060 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7df401d070 con 0x7f7dfc0c68b0 2024-04-26T20:58:31.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.156+0000 7f7e01e00640 1 -- 172.21.15.138:0/4283109060 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dfc1554f0 con 0x7f7dfc0c68b0 2024-04-26T20:58:31.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.156+0000 7f7df3400640 1 -- 172.21.15.138:0/4283109060 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df4015670 con 0x7f7dfc0c68b0 2024-04-26T20:58:31.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.160+0000 7f7e01e00640 1 -- 172.21.15.138:0/4283109060 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dfc154700 con 0x7f7dfc0c68b0 2024-04-26T20:58:31.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.160+0000 7f7e01e00640 1 -- 172.21.15.138:0/4283109060 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dfc069510 con 0x7f7dfc0c68b0 2024-04-26T20:58:31.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.160+0000 7f7df3400640 1 -- 172.21.15.138:0/4283109060 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7df4015810 con 0x7f7dfc0c68b0 2024-04-26T20:58:31.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.160+0000 7f7df3400640 1 --2- 172.21.15.138:0/4283109060 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7ddc068380 0x7f7ddc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:31.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.160+0000 7f7df3400640 1 -- 172.21.15.138:0/4283109060 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6756+0+0 (secure 0 0 0) 0x7f7df4087550 con 0x7f7dfc0c68b0 2024-04-26T20:58:31.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.160+0000 7f7dfaa00640 1 --2- 172.21.15.138:0/4283109060 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7ddc068380 0x7f7ddc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:31.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.164+0000 7f7dfaa00640 1 --2- 172.21.15.138:0/4283109060 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7ddc068380 0x7f7ddc06a840 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7dec0aa000 tx=0x7f7dec0b1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:31.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.164+0000 7f7df3400640 1 -- 172.21.15.138:0/4283109060 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7df4010040 con 0x7f7dfc0c68b0 2024-04-26T20:58:31.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.356+0000 7f7e01e00640 1 -- 172.21.15.138:0/4283109060 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7dfc0b88b0 con 0x7f7dfc0c68b0 2024-04-26T20:58:31.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.356+0000 7f7df3400640 1 -- 172.21.15.138:0/4283109060 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+6489 (secure 0 0 0) 0x7f7df4057650 con 0x7f7dfc0c68b0 2024-04-26T20:58:31.357 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:31.357 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":28,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5048,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/255610168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":255610168},{"type":"v1","addr":"172.21.15.143:6836","nonce":255610168}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5051,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/799063831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":799063831},{"type":"v1","addr":"172.21.15.143:6837","nonce":799063831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5410,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/976248149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":976248149},{"type":"v1","addr":"172.21.15.138:6835","nonce":976248149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:57:51.937789+0000","modified":"2024-04-26T20:58:07.183899+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":42,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2},{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:58:10.360154+0000","modified":"2024-04-26T20:58:24.737160+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5604":{"gid":5604,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.138:6834/2450256246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2450256246},{"type":"v1","addr":"172.21.15.138:6834","nonce":2450256246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":7,"enabled":true,"fs_name":"recovery_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5604,"qdb_cluster":[5604]},"id":3}]} 2024-04-26T20:58:31.357 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 28 2024-04-26T20:58:31.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.356+0000 7f7e01e00640 1 -- 172.21.15.138:0/4283109060 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7ddc068380 msgr2=0x7f7ddc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:31.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.356+0000 7f7e01e00640 1 --2- 172.21.15.138:0/4283109060 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7ddc068380 0x7f7ddc06a840 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7dec0aa000 tx=0x7f7dec0b1040 comp rx=0 tx=0).stop 2024-04-26T20:58:31.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.356+0000 7f7e01e00640 1 -- 172.21.15.138:0/4283109060 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7dfc0c68b0 msgr2=0x7f7dfc0c74d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:31.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.356+0000 7f7e01e00640 1 --2- 172.21.15.138:0/4283109060 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7dfc0c68b0 0x7f7dfc0c74d0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f7df4011bf0 tx=0x7f7df400f1b0 comp rx=0 tx=0).stop 2024-04-26T20:58:31.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.356+0000 7f7e01e00640 1 -- 172.21.15.138:0/4283109060 shutdown_connections 2024-04-26T20:58:31.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.356+0000 7f7e01e00640 1 --2- 172.21.15.138:0/4283109060 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7ddc068380 0x7f7ddc06a840 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:31.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.356+0000 7f7e01e00640 1 --2- 172.21.15.138:0/4283109060 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7dfc0c68b0 0x7f7dfc0c74d0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:31.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.356+0000 7f7e01e00640 1 --2- 172.21.15.138:0/4283109060 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7dfc149490 0x7f7dfc0c59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:31.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.356+0000 7f7e01e00640 1 --2- 172.21.15.138:0/4283109060 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7de00039c0 0x7f7dfc146970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:31.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.356+0000 7f7e01e00640 1 -- 172.21.15.138:0/4283109060 >> 172.21.15.138:0/4283109060 conn(0x7f7dfc0d2d80 msgr2=0x7f7dfc15bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:31.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.356+0000 7f7e01e00640 1 -- 172.21.15.138:0/4283109060 shutdown_connections 2024-04-26T20:58:31.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.356+0000 7f7e01e00640 1 -- 172.21.15.138:0/4283109060 wait complete. 2024-04-26T20:58:31.378 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:58:31.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.512+0000 7f3f3bc00640 1 Processor -- start 2024-04-26T20:58:31.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.512+0000 7f3f3bc00640 1 -- start start 2024-04-26T20:58:31.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.512+0000 7f3f3bc00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f3f340d1720 0x7f3f340b3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:31.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.512+0000 7f3f3bc00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f340ce540 con 0x7f3f340b2280 2024-04-26T20:58:31.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.512+0000 7f3f3bc00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f340ce820 con 0x7f3f3415d0f0 2024-04-26T20:58:31.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.512+0000 7f3f3bc00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f3f340d0e50 con 0x7f3f340d1720 2024-04-26T20:58:31.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.512+0000 7f3f2be00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f3f340b2280 0x7f3f340b2b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:32894/0 (socket says 172.21.15.138:32894) 2024-04-26T20:58:31.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.512+0000 7f3f2be00640 1 -- 172.21.15.138:0/3193025634 learned_addr learned my addr 172.21.15.138:0/3193025634 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:31.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.512+0000 7f3f39c00640 1 --2- 172.21.15.138:0/3193025634 >> v2:172.21.15.143:3300/0 conn(0x7f3f340d1720 0x7f3f340b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:31.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.512+0000 7f3f33e00640 1 -- 172.21.15.138:0/3193025634 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3273867752 0 0) 0x7f3f340ce540 con 0x7f3f340b2280 2024-04-26T20:58:31.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.512+0000 7f3f33e00640 1 -- 172.21.15.138:0/3193025634 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f18003530 con 0x7f3f340b2280 2024-04-26T20:58:31.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.512+0000 7f3f33e00640 1 -- 172.21.15.138:0/3193025634 <== mon.0 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1136079022 0 0) 0x7f3f18003530 con 0x7f3f340b2280 2024-04-26T20:58:31.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.512+0000 7f3f33e00640 1 -- 172.21.15.138:0/3193025634 >> v2:172.21.15.143:3300/0 conn(0x7f3f340d1720 msgr2=0x7f3f340b3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:31.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.512+0000 7f3f33e00640 1 --2- 172.21.15.138:0/3193025634 >> v2:172.21.15.143:3300/0 conn(0x7f3f340d1720 0x7f3f340b3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:31.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.512+0000 7f3f33e00640 1 -- 172.21.15.138:0/3193025634 >> v1:172.21.15.143:6789/0 conn(0x7f3f3415d0f0 legacy=0x7f3f340d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:31.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.512+0000 7f3f33e00640 1 -- 172.21.15.138:0/3193025634 --> v1:172.21.15.138:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f340ceb00 con 0x7f3f340b2280 2024-04-26T20:58:31.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.512+0000 7f3f33e00640 1 -- 172.21.15.138:0/3193025634 <== mon.0 v1:172.21.15.138:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2715389689 0 0) 0x7f3f1c001680 con 0x7f3f340b2280 2024-04-26T20:58:31.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.512+0000 7f3f33e00640 1 -- 172.21.15.138:0/3193025634 >> v1:172.21.15.138:6789/0 conn(0x7f3f340b2280 legacy=0x7f3f340b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:31.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.512+0000 7f3f33e00640 1 --2- 172.21.15.138:0/3193025634 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3f180039c0 0x7f3f18003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:31.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.512+0000 7f3f33e00640 1 --2- 172.21.15.138:0/3193025634 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f18004810 0x7f3f18004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:31.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.512+0000 7f3f33e00640 1 --2- 172.21.15.138:0/3193025634 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3f180051d0 0x7f3f1800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:31.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.512+0000 7f3f33e00640 1 -- 172.21.15.138:0/3193025634 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f3f340d0e50 con 0x7f3f180039c0 2024-04-26T20:58:31.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.512+0000 7f3f33e00640 1 -- 172.21.15.138:0/3193025634 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f3f1800c070 con 0x7f3f18004810 2024-04-26T20:58:31.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.512+0000 7f3f33e00640 1 -- 172.21.15.138:0/3193025634 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f3f1800c270 con 0x7f3f180051d0 2024-04-26T20:58:31.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.512+0000 7f3f39200640 1 --2- 172.21.15.138:0/3193025634 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3f180039c0 0x7f3f18003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:31.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.512+0000 7f3f2be00640 1 --2- 172.21.15.138:0/3193025634 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f18004810 0x7f3f18004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:31.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.516+0000 7f3f39c00640 1 --2- 172.21.15.138:0/3193025634 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3f180051d0 0x7f3f1800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:31.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.516+0000 7f3f39200640 1 -- 172.21.15.138:0/3193025634 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3f180051d0 msgr2=0x7f3f1800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:31.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.516+0000 7f3f39200640 1 --2- 172.21.15.138:0/3193025634 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3f180051d0 0x7f3f1800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:31.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.516+0000 7f3f39200640 1 -- 172.21.15.138:0/3193025634 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f18004810 msgr2=0x7f3f18004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:31.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.516+0000 7f3f39200640 1 --2- 172.21.15.138:0/3193025634 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f18004810 0x7f3f18004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:31.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.516+0000 7f3f39200640 1 -- 172.21.15.138:0/3193025634 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f18003530 con 0x7f3f180039c0 2024-04-26T20:58:31.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.516+0000 7f3f39c00640 1 --2- 172.21.15.138:0/3193025634 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3f180051d0 0x7f3f1800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:58:31.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.516+0000 7f3f2be00640 1 --2- 172.21.15.138:0/3193025634 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f18004810 0x7f3f18004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:58:31.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.516+0000 7f3f39c00640 1 -- 172.21.15.138:0/3193025634 reap_dead start 2024-04-26T20:58:31.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.516+0000 7f3f39200640 1 --2- 172.21.15.138:0/3193025634 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3f180039c0 0x7f3f18003de0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f3f24001780 tx=0x7f3f2401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c12307cb41207847 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:31.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.516+0000 7f3f33e00640 1 -- 172.21.15.138:0/3193025634 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f240013a0 con 0x7f3f180039c0 2024-04-26T20:58:31.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.516+0000 7f3f33e00640 1 -- 172.21.15.138:0/3193025634 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f240052f0 con 0x7f3f180039c0 2024-04-26T20:58:31.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.516+0000 7f3f33e00640 1 -- 172.21.15.138:0/3193025634 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f24003840 con 0x7f3f180039c0 2024-04-26T20:58:31.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.516+0000 7f3f3bc00640 1 -- 172.21.15.138:0/3193025634 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3f180039c0 msgr2=0x7f3f18003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:31.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.516+0000 7f3f3bc00640 1 --2- 172.21.15.138:0/3193025634 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3f180039c0 0x7f3f18003de0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f3f24001780 tx=0x7f3f2401c400 comp rx=0 tx=0).stop 2024-04-26T20:58:31.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.520+0000 7f3f3bc00640 1 -- 172.21.15.138:0/3193025634 shutdown_connections 2024-04-26T20:58:31.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.520+0000 7f3f3bc00640 1 --2- 172.21.15.138:0/3193025634 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3f180039c0 0x7f3f18003de0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:31.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.520+0000 7f3f3bc00640 1 -- 172.21.15.138:0/3193025634 >> 172.21.15.138:0/3193025634 conn(0x7f3f340d2d80 msgr2=0x7f3f340d3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:31.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.520+0000 7f3f3bc00640 1 -- 172.21.15.138:0/3193025634 shutdown_connections 2024-04-26T20:58:31.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.520+0000 7f3f3bc00640 1 -- 172.21.15.138:0/3193025634 wait complete. 2024-04-26T20:58:31.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.520+0000 7f3f3bc00640 1 Processor -- start 2024-04-26T20:58:31.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.520+0000 7f3f3bc00640 1 -- start start 2024-04-26T20:58:31.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.520+0000 7f3f3bc00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3f180039c0 0x7f3f34152420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:31.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.520+0000 7f3f3bc00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3f340b6e80 0x7f3f34159ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:31.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.520+0000 7f3f3bc00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f3406ea10 0x7f3f3406ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:31.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.520+0000 7f3f3bc00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f3f340d13a0 con 0x7f3f340b6e80 2024-04-26T20:58:31.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.520+0000 7f3f3bc00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f3f340d1220 con 0x7f3f3406ea10 2024-04-26T20:58:31.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.520+0000 7f3f3bc00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f3f340d1520 con 0x7f3f180039c0 2024-04-26T20:58:31.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.520+0000 7f3f2be00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3f340b6e80 0x7f3f34159ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:31.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.520+0000 7f3f2be00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3f340b6e80 0x7f3f34159ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40362/0 (socket says 172.21.15.138:40362) 2024-04-26T20:58:31.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.520+0000 7f3f2be00640 1 -- 172.21.15.138:0/4006957727 learned_addr learned my addr 172.21.15.138:0/4006957727 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:31.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.520+0000 7f3f39200640 1 --2- 172.21.15.138:0/4006957727 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3f180039c0 0x7f3f34152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:31.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.520+0000 7f3f39c00640 1 --2- 172.21.15.138:0/4006957727 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f3406ea10 0x7f3f3406ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:31.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.520+0000 7f3f2be00640 1 -- 172.21.15.138:0/4006957727 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3f180039c0 msgr2=0x7f3f34152420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:31.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.520+0000 7f3f2be00640 1 --2- 172.21.15.138:0/4006957727 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3f180039c0 0x7f3f34152420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:31.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.520+0000 7f3f2be00640 1 -- 172.21.15.138:0/4006957727 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f3406ea10 msgr2=0x7f3f3406ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:31.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.520+0000 7f3f2be00640 1 --2- 172.21.15.138:0/4006957727 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f3406ea10 0x7f3f3406ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:31.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.520+0000 7f3f2be00640 1 -- 172.21.15.138:0/4006957727 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f34152960 con 0x7f3f340b6e80 2024-04-26T20:58:31.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.520+0000 7f3f2be00640 1 --2- 172.21.15.138:0/4006957727 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3f340b6e80 0x7f3f34159ff0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c005fd0 tx=0x7f3f1c00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:31.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.520+0000 7f3f31600640 1 -- 172.21.15.138:0/4006957727 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c00c660 con 0x7f3f340b6e80 2024-04-26T20:58:31.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.520+0000 7f3f31600640 1 -- 172.21.15.138:0/4006957727 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f1c018070 con 0x7f3f340b6e80 2024-04-26T20:58:31.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.520+0000 7f3f3bc00640 1 -- 172.21.15.138:0/4006957727 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f340b7f70 con 0x7f3f340b6e80 2024-04-26T20:58:31.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.520+0000 7f3f31600640 1 -- 172.21.15.138:0/4006957727 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c00ca00 con 0x7f3f340b6e80 2024-04-26T20:58:31.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.520+0000 7f3f3bc00640 1 -- 172.21.15.138:0/4006957727 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f340b76d0 con 0x7f3f340b6e80 2024-04-26T20:58:31.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.524+0000 7f3f3bc00640 1 -- 172.21.15.138:0/4006957727 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f34069510 con 0x7f3f340b6e80 2024-04-26T20:58:31.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.524+0000 7f3f31600640 1 -- 172.21.15.138:0/4006957727 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3f1c00cba0 con 0x7f3f340b6e80 2024-04-26T20:58:31.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.524+0000 7f3f31600640 1 --2- 172.21.15.138:0/4006957727 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f3f100683b0 0x7f3f1006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:31.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.524+0000 7f3f31600640 1 -- 172.21.15.138:0/4006957727 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6756+0+0 (secure 0 0 0) 0x7f3f1c086800 con 0x7f3f340b6e80 2024-04-26T20:58:31.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.524+0000 7f3f39200640 1 --2- 172.21.15.138:0/4006957727 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f3f100683b0 0x7f3f1006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:31.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.524+0000 7f3f39200640 1 --2- 172.21.15.138:0/4006957727 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f3f100683b0 0x7f3f1006a870 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3f24001750 tx=0x7f3f240011a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:31.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.528+0000 7f3f31600640 1 -- 172.21.15.138:0/4006957727 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3f1c056990 con 0x7f3f340b6e80 2024-04-26T20:58:31.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.688+0000 7f3f3bc00640 1 -- 172.21.15.138:0/4006957727 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3f340d0370 con 0x7f3f340b6e80 2024-04-26T20:58:31.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.692+0000 7f3f31600640 1 -- 172.21.15.138:0/4006957727 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+19198 (secure 0 0 0) 0x7f3f1c056290 con 0x7f3f340b6e80 2024-04-26T20:58:31.691 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:31.692 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":51,"fsid":"c22b4730-12cc-4558-8535-b965384398c0","created":"2024-04-26T20:56:14.182475+0000","modified":"2024-04-26T20:58:20.703295+0000","last_up_change":"2024-04-26T20:56:26.013243+0000","last_in_change":"2024-04-26T20:56:16.714055+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:56:27.265834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:57:49.597600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-26T20:57:50.901951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"recovery_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"recovery_fs_metadata","create_time":"2024-04-26T20:58:09.327192+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"recovery_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3f9a2e34-3199-466f-a6cf-57927318121e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6801","nonce":3534772245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6803","nonce":3534772245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6807","nonce":3534772245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6805","nonce":3534772245}]},"public_addr":"172.21.15.138:6801/3534772245","cluster_addr":"172.21.15.138:6803/3534772245","heartbeat_back_addr":"172.21.15.138:6807/3534772245","heartbeat_front_addr":"172.21.15.138:6805/3534772245","state":["exists","up"]},{"osd":1,"uuid":"e881fcf6-3248-4696-a2ef-95d206d77712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6817","nonce":1427635773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6819","nonce":1427635773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6823","nonce":1427635773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6821","nonce":1427635773}]},"public_addr":"172.21.15.138:6817/1427635773","cluster_addr":"172.21.15.138:6819/1427635773","heartbeat_back_addr":"172.21.15.138:6823/1427635773","heartbeat_front_addr":"172.21.15.138:6821/1427635773","state":["exists","up"]},{"osd":2,"uuid":"f7d1db33-7672-4699-ae47-9f1e0a8e4222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6809","nonce":4273721573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6811","nonce":4273721573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6815","nonce":4273721573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6813","nonce":4273721573}]},"public_addr":"172.21.15.138:6809/4273721573","cluster_addr":"172.21.15.138:6811/4273721573","heartbeat_back_addr":"172.21.15.138:6815/4273721573","heartbeat_front_addr":"172.21.15.138:6813/4273721573","state":["exists","up"]},{"osd":3,"uuid":"2f4e0a9a-b8f6-4468-844a-a4501cd85054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6825","nonce":3098242154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6827","nonce":3098242154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6831","nonce":3098242154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6829","nonce":3098242154}]},"public_addr":"172.21.15.138:6825/3098242154","cluster_addr":"172.21.15.138:6827/3098242154","heartbeat_back_addr":"172.21.15.138:6831/3098242154","heartbeat_front_addr":"172.21.15.138:6829/3098242154","state":["exists","up"]},{"osd":4,"uuid":"c85df99b-3624-410e-866b-86830af2cfe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6801","nonce":2942056312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6803","nonce":2942056312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6807","nonce":2942056312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6805","nonce":2942056312}]},"public_addr":"172.21.15.143:6801/2942056312","cluster_addr":"172.21.15.143:6803/2942056312","heartbeat_back_addr":"172.21.15.143:6807/2942056312","heartbeat_front_addr":"172.21.15.143:6805/2942056312","state":["exists","up"]},{"osd":5,"uuid":"9af1efb5-c416-4808-b5ef-de0679ab9705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6809","nonce":1910222887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6811","nonce":1910222887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6815","nonce":1910222887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6813","nonce":1910222887}]},"public_addr":"172.21.15.143:6809/1910222887","cluster_addr":"172.21.15.143:6811/1910222887","heartbeat_back_addr":"172.21.15.143:6815/1910222887","heartbeat_front_addr":"172.21.15.143:6813/1910222887","state":["exists","up"]},{"osd":6,"uuid":"d7138615-8838-45ff-9072-2fd0683362f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6817","nonce":1082239825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6819","nonce":1082239825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6823","nonce":1082239825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6821","nonce":1082239825}]},"public_addr":"172.21.15.143:6817/1082239825","cluster_addr":"172.21.15.143:6819/1082239825","heartbeat_back_addr":"172.21.15.143:6823/1082239825","heartbeat_front_addr":"172.21.15.143:6821/1082239825","state":["exists","up"]},{"osd":7,"uuid":"0c27172b-35c4-49ec-ba0b-0137b8ff0010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6825","nonce":3295508495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6827","nonce":3295508495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6831","nonce":3295508495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6829","nonce":3295508495}]},"public_addr":"172.21.15.143:6825/3295508495","cluster_addr":"172.21.15.143:6827/3295508495","heartbeat_back_addr":"172.21.15.143:6831/3295508495","heartbeat_front_addr":"172.21.15.143:6829/3295508495","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.326627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.396119+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.433915+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.414179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.216947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.329272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.503073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.436382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.d","mappings":[{"from":1,"to":2}]},{"pgid":"6.23","mappings":[{"from":3,"to":2}]},{"pgid":"6.2b","mappings":[{"from":4,"to":7}]},{"pgid":"6.30","mappings":[{"from":4,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.143:6836/483370849":"2024-04-27T20:58:07.183664+0000","172.21.15.143:6834/483370849":"2024-04-27T20:58:07.183664+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:58:31.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.692+0000 7f3f3bc00640 1 -- 172.21.15.138:0/4006957727 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f3f100683b0 msgr2=0x7f3f1006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:31.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.692+0000 7f3f3bc00640 1 --2- 172.21.15.138:0/4006957727 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f3f100683b0 0x7f3f1006a870 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3f24001750 tx=0x7f3f240011a0 comp rx=0 tx=0).stop 2024-04-26T20:58:31.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.692+0000 7f3f3bc00640 1 -- 172.21.15.138:0/4006957727 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3f340b6e80 msgr2=0x7f3f34159ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:31.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.692+0000 7f3f3bc00640 1 --2- 172.21.15.138:0/4006957727 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3f340b6e80 0x7f3f34159ff0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c005fd0 tx=0x7f3f1c00eb50 comp rx=0 tx=0).stop 2024-04-26T20:58:31.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.692+0000 7f3f3bc00640 1 -- 172.21.15.138:0/4006957727 shutdown_connections 2024-04-26T20:58:31.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.692+0000 7f3f3bc00640 1 --2- 172.21.15.138:0/4006957727 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f3f100683b0 0x7f3f1006a870 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:31.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.692+0000 7f3f3bc00640 1 --2- 172.21.15.138:0/4006957727 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f3406ea10 0x7f3f3406ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:31.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.692+0000 7f3f3bc00640 1 --2- 172.21.15.138:0/4006957727 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3f340b6e80 0x7f3f34159ff0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:31.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.692+0000 7f3f3bc00640 1 --2- 172.21.15.138:0/4006957727 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3f180039c0 0x7f3f34152420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:31.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.692+0000 7f3f3bc00640 1 -- 172.21.15.138:0/4006957727 >> 172.21.15.138:0/4006957727 conn(0x7f3f340d2d80 msgr2=0x7f3f340c7480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:31.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.692+0000 7f3f3bc00640 1 -- 172.21.15.138:0/4006957727 shutdown_connections 2024-04-26T20:58:31.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.692+0000 7f3f3bc00640 1 -- 172.21.15.138:0/4006957727 wait complete. 2024-04-26T20:58:31.713 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:56:27.265834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T20:57:49.597600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T20:57:50.901951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'recovery_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'recovery_fs_metadata', 'create_time': '2024-04-26T20:58:09.327192+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'recovery_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T20:58:31.714 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T20:58:31.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.856+0000 7f6135800640 1 Processor -- start 2024-04-26T20:58:31.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.856+0000 7f6135800640 1 -- start start 2024-04-26T20:58:31.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.856+0000 7f6135800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f61300ce9e0 0x7f61300afc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:31.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.856+0000 7f6135800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f613015f360 0x7f61300cb200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:31.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.856+0000 7f6135800640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61300ae8c0 con 0x7f613006fad0 2024-04-26T20:58:31.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.856+0000 7f6135800640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f61300aeba0 con 0x7f61300ce9e0 2024-04-26T20:58:31.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.856+0000 7f6135800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f61300aee80 con 0x7f613015f360 2024-04-26T20:58:31.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.856+0000 7f612ea00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f61300ce9e0 0x7f61300afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:31.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.856+0000 7f612ea00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f61300ce9e0 0x7f61300afc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40374/0 (socket says 172.21.15.138:40374) 2024-04-26T20:58:31.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.856+0000 7f612ea00640 1 -- 172.21.15.138:0/2756746366 learned_addr learned my addr 172.21.15.138:0/2756746366 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:31.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.856+0000 7f612f400640 1 --2- 172.21.15.138:0/2756746366 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f613015f360 0x7f61300cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:31.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.856+0000 7f612ea00640 1 -- 172.21.15.138:0/2756746366 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f613015f360 msgr2=0x7f61300cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:31.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.856+0000 7f612ea00640 1 --2- 172.21.15.138:0/2756746366 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f613015f360 0x7f61300cb200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:31.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.856+0000 7f612ea00640 1 -- 172.21.15.138:0/2756746366 >> v1:172.21.15.143:6789/0 conn(0x7f613006fad0 legacy=0x7f613015ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:31.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.856+0000 7f612ea00640 1 -- 172.21.15.138:0/2756746366 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61300af160 con 0x7f61300ce9e0 2024-04-26T20:58:31.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.860+0000 7f612ea00640 1 --2- 172.21.15.138:0/2756746366 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f61300ce9e0 0x7f61300afc20 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f6120009e80 tx=0x7f612001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fcaa8e36503abb6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:31.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.860+0000 7f612d600640 1 -- 172.21.15.138:0/2756746366 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61200a58e0 con 0x7f61300ce9e0 2024-04-26T20:58:31.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.860+0000 7f612d600640 1 -- 172.21.15.138:0/2756746366 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61200a5a80 con 0x7f61300ce9e0 2024-04-26T20:58:31.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.860+0000 7f612d600640 1 -- 172.21.15.138:0/2756746366 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61200a5e50 con 0x7f61300ce9e0 2024-04-26T20:58:31.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.860+0000 7f6135800640 1 -- 172.21.15.138:0/2756746366 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f61300ce9e0 msgr2=0x7f61300afc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:31.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.860+0000 7f6135800640 1 --2- 172.21.15.138:0/2756746366 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f61300ce9e0 0x7f61300afc20 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f6120009e80 tx=0x7f612001ca10 comp rx=0 tx=0).stop 2024-04-26T20:58:31.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.860+0000 7f6135800640 1 -- 172.21.15.138:0/2756746366 shutdown_connections 2024-04-26T20:58:31.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.860+0000 7f6135800640 1 --2- 172.21.15.138:0/2756746366 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f613015f360 0x7f61300cb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:31.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.860+0000 7f6135800640 1 --2- 172.21.15.138:0/2756746366 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f61300ce9e0 0x7f61300afc20 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:31.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.860+0000 7f6135800640 1 -- 172.21.15.138:0/2756746366 >> 172.21.15.138:0/2756746366 conn(0x7f61300d0bb0 msgr2=0x7f61300d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:31.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.860+0000 7f6135800640 1 -- 172.21.15.138:0/2756746366 shutdown_connections 2024-04-26T20:58:31.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.860+0000 7f6135800640 1 -- 172.21.15.138:0/2756746366 wait complete. 2024-04-26T20:58:31.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.860+0000 7f6135800640 1 Processor -- start 2024-04-26T20:58:31.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.864+0000 7f6135800640 1 -- start start 2024-04-26T20:58:31.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.864+0000 7f6135800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f613006fad0 0x7f61301546c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:31.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.864+0000 7f6135800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f61300ce9e0 0x7f613015fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:31.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.864+0000 7f6135800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f613015f360 0x7f6130159e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:31.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.864+0000 7f6135800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f61300cb8c0 con 0x7f61300ce9e0 2024-04-26T20:58:31.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.864+0000 7f6135800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f61300cb740 con 0x7f613006fad0 2024-04-26T20:58:31.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.864+0000 7f6135800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f61300cba40 con 0x7f613015f360 2024-04-26T20:58:31.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.864+0000 7f612e000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f61300ce9e0 0x7f613015fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:31.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.864+0000 7f612ea00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f613006fad0 0x7f61301546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:31.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.864+0000 7f612e000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f61300ce9e0 0x7f613015fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40376/0 (socket says 172.21.15.138:40376) 2024-04-26T20:58:31.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.864+0000 7f612e000640 1 -- 172.21.15.138:0/3393467294 learned_addr learned my addr 172.21.15.138:0/3393467294 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:31.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.864+0000 7f612f400640 1 --2- 172.21.15.138:0/3393467294 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f613015f360 0x7f6130159e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:31.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.864+0000 7f612e000640 1 -- 172.21.15.138:0/3393467294 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f613015f360 msgr2=0x7f6130159e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:31.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.864+0000 7f612e000640 1 --2- 172.21.15.138:0/3393467294 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f613015f360 0x7f6130159e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:31.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.864+0000 7f612e000640 1 -- 172.21.15.138:0/3393467294 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f613006fad0 msgr2=0x7f61301546c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:31.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.864+0000 7f612e000640 1 --2- 172.21.15.138:0/3393467294 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f613006fad0 0x7f61301546c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:31.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.864+0000 7f612e000640 1 -- 172.21.15.138:0/3393467294 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61301603a0 con 0x7f61300ce9e0 2024-04-26T20:58:31.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.864+0000 7f612e000640 1 --2- 172.21.15.138:0/3393467294 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f61300ce9e0 0x7f613015fa30 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f611c00c450 tx=0x7f611c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:31.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.864+0000 7f6126a00640 1 -- 172.21.15.138:0/3393467294 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f611c0052d0 con 0x7f61300ce9e0 2024-04-26T20:58:31.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.864+0000 7f6126a00640 1 -- 172.21.15.138:0/3393467294 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f611c005470 con 0x7f61300ce9e0 2024-04-26T20:58:31.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.864+0000 7f6135800640 1 -- 172.21.15.138:0/3393467294 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6130160680 con 0x7f61300ce9e0 2024-04-26T20:58:31.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.864+0000 7f6126a00640 1 -- 172.21.15.138:0/3393467294 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f611c007260 con 0x7f61300ce9e0 2024-04-26T20:58:31.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.864+0000 7f6135800640 1 -- 172.21.15.138:0/3393467294 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6130160c40 con 0x7f61300ce9e0 2024-04-26T20:58:31.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.864+0000 7f6135800640 1 -- 172.21.15.138:0/3393467294 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6130069430 con 0x7f61300ce9e0 2024-04-26T20:58:31.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.868+0000 7f6126a00640 1 -- 172.21.15.138:0/3393467294 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f611c007400 con 0x7f61300ce9e0 2024-04-26T20:58:31.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.868+0000 7f6126a00640 1 --2- 172.21.15.138:0/3393467294 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f61100683b0 0x7f611006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:31.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.868+0000 7f6126a00640 1 -- 172.21.15.138:0/3393467294 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6756+0+0 (secure 0 0 0) 0x7f611c0861c0 con 0x7f61300ce9e0 2024-04-26T20:58:31.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.868+0000 7f612ea00640 1 --2- 172.21.15.138:0/3393467294 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f61100683b0 0x7f611006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:31.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.868+0000 7f612ea00640 1 --2- 172.21.15.138:0/3393467294 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f61100683b0 0x7f611006a870 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f61200ae000 tx=0x7f61200a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:31.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:31.872+0000 7f6126a00640 1 -- 172.21.15.138:0/3393467294 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f611c055d10 con 0x7f61300ce9e0 2024-04-26T20:58:32.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.028+0000 7f6135800640 1 -- 172.21.15.138:0/3393467294 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f61300c7440 con 0x7f61300ce9e0 2024-04-26T20:58:32.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.028+0000 7f6126a00640 1 -- 172.21.15.138:0/3393467294 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) ==== 93+0+10 (secure 0 0 0) 0x7f611c05a010 con 0x7f61300ce9e0 2024-04-26T20:58:32.030 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 1 2024-04-26T20:58:32.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.032+0000 7f6135800640 1 -- 172.21.15.138:0/3393467294 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f61100683b0 msgr2=0x7f611006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:32.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.032+0000 7f6135800640 1 --2- 172.21.15.138:0/3393467294 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f61100683b0 0x7f611006a870 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f61200ae000 tx=0x7f61200a7070 comp rx=0 tx=0).stop 2024-04-26T20:58:32.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.032+0000 7f6135800640 1 -- 172.21.15.138:0/3393467294 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f61300ce9e0 msgr2=0x7f613015fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:32.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.032+0000 7f6135800640 1 --2- 172.21.15.138:0/3393467294 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f61300ce9e0 0x7f613015fa30 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f611c00c450 tx=0x7f611c00c850 comp rx=0 tx=0).stop 2024-04-26T20:58:32.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.032+0000 7f6135800640 1 -- 172.21.15.138:0/3393467294 shutdown_connections 2024-04-26T20:58:32.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.032+0000 7f6135800640 1 --2- 172.21.15.138:0/3393467294 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f61100683b0 0x7f611006a870 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:32.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.032+0000 7f6135800640 1 --2- 172.21.15.138:0/3393467294 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f613015f360 0x7f6130159e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:32.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.032+0000 7f6135800640 1 --2- 172.21.15.138:0/3393467294 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f61300ce9e0 0x7f613015fa30 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:32.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.032+0000 7f6135800640 1 --2- 172.21.15.138:0/3393467294 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f613006fad0 0x7f61301546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:32.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.032+0000 7f6135800640 1 -- 172.21.15.138:0/3393467294 >> 172.21.15.138:0/3393467294 conn(0x7f61300d0bb0 msgr2=0x7f61300cbe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:32.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.032+0000 7f6135800640 1 -- 172.21.15.138:0/3393467294 shutdown_connections 2024-04-26T20:58:32.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.032+0000 7f6135800640 1 -- 172.21.15.138:0/3393467294 wait complete. 2024-04-26T20:58:32.051 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T20:58:32.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.188+0000 7f5238600640 1 Processor -- start 2024-04-26T20:58:32.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.188+0000 7f5238600640 1 -- start start 2024-04-26T20:58:32.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.188+0000 7f5238600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f523015d0d0 0x7f52300d0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:32.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.188+0000 7f5238600640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f52300cfd40 0x7f52300d1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:32.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.188+0000 7f5238600640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f52300d1880 0x7f52300cd970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:32.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.188+0000 7f5238600640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f52300d1ca0 con 0x7f52300cfd40 2024-04-26T20:58:32.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.188+0000 7f5238600640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f52300cedf0 con 0x7f52300d1880 2024-04-26T20:58:32.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.188+0000 7f5238600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f52300d3920 con 0x7f523015d0d0 2024-04-26T20:58:32.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.188+0000 7f5235200640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f52300cfd40 0x7f52300d1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:32.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.188+0000 7f5235200640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f52300cfd40 0x7f52300d1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40390/0 (socket says 172.21.15.138:40390) 2024-04-26T20:58:32.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.188+0000 7f5235200640 1 -- 172.21.15.138:0/2213610800 learned_addr learned my addr 172.21.15.138:0/2213610800 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:32.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.188+0000 7f5236600640 1 --2- 172.21.15.138:0/2213610800 >> v2:172.21.15.143:3300/0 conn(0x7f52300d1880 0x7f52300cd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:32.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.188+0000 7f5235c00640 1 --2- 172.21.15.138:0/2213610800 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f523015d0d0 0x7f52300d0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:32.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.188+0000 7f5235200640 1 -- 172.21.15.138:0/2213610800 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f523015d0d0 msgr2=0x7f52300d0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:32.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.188+0000 7f5235200640 1 --2- 172.21.15.138:0/2213610800 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f523015d0d0 0x7f52300d0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:32.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.188+0000 7f5235200640 1 -- 172.21.15.138:0/2213610800 >> v2:172.21.15.143:3300/0 conn(0x7f52300d1880 msgr2=0x7f52300cd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:32.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.188+0000 7f5235200640 1 --2- 172.21.15.138:0/2213610800 >> v2:172.21.15.143:3300/0 conn(0x7f52300d1880 0x7f52300cd970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:32.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.188+0000 7f5235200640 1 -- 172.21.15.138:0/2213610800 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52300d3c00 con 0x7f52300cfd40 2024-04-26T20:58:32.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.192+0000 7f5235200640 1 --2- 172.21.15.138:0/2213610800 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52300cfd40 0x7f52300d1340 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f52300c9db0 tx=0x7f521c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e24dcaa33bf13 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:32.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.192+0000 7f522fe00640 1 -- 172.21.15.138:0/2213610800 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f521c0aa610 con 0x7f52300cfd40 2024-04-26T20:58:32.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.192+0000 7f522fe00640 1 -- 172.21.15.138:0/2213610800 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f521c0af070 con 0x7f52300cfd40 2024-04-26T20:58:32.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.192+0000 7f522fe00640 1 -- 172.21.15.138:0/2213610800 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f521c0aa9d0 con 0x7f52300cfd40 2024-04-26T20:58:32.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.192+0000 7f5238600640 1 -- 172.21.15.138:0/2213610800 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52300cfd40 msgr2=0x7f52300d1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:32.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.192+0000 7f5238600640 1 --2- 172.21.15.138:0/2213610800 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52300cfd40 0x7f52300d1340 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f52300c9db0 tx=0x7f521c01c4f0 comp rx=0 tx=0).stop 2024-04-26T20:58:32.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.192+0000 7f5238600640 1 -- 172.21.15.138:0/2213610800 shutdown_connections 2024-04-26T20:58:32.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.192+0000 7f5238600640 1 --2- 172.21.15.138:0/2213610800 >> v2:172.21.15.143:3300/0 conn(0x7f52300d1880 0x7f52300cd970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:32.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.192+0000 7f5238600640 1 --2- 172.21.15.138:0/2213610800 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52300cfd40 0x7f52300d1340 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:32.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.192+0000 7f5238600640 1 --2- 172.21.15.138:0/2213610800 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f523015d0d0 0x7f52300d0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:32.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.192+0000 7f5238600640 1 -- 172.21.15.138:0/2213610800 >> 172.21.15.138:0/2213610800 conn(0x7f52300d2d60 msgr2=0x7f52300d3170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:32.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.192+0000 7f5238600640 1 -- 172.21.15.138:0/2213610800 shutdown_connections 2024-04-26T20:58:32.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.192+0000 7f5238600640 1 -- 172.21.15.138:0/2213610800 wait complete. 2024-04-26T20:58:32.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.196+0000 7f5238600640 1 Processor -- start 2024-04-26T20:58:32.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.196+0000 7f5238600640 1 -- start start 2024-04-26T20:58:32.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.196+0000 7f5238600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52300cfd40 0x7f523014e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:32.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.196+0000 7f5238600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52300d1880 0x7f52301525d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:32.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.196+0000 7f5238600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f523015d0d0 0x7f523014f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:32.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.196+0000 7f5238600640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f52300ce840 con 0x7f52300d1880 2024-04-26T20:58:32.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.196+0000 7f5238600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f52300ce6c0 con 0x7f52300cfd40 2024-04-26T20:58:32.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.196+0000 7f5238600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f52300ce9c0 con 0x7f523015d0d0 2024-04-26T20:58:32.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.196+0000 7f5235200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52300d1880 0x7f52301525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:32.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.196+0000 7f5235200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52300d1880 0x7f52301525d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40406/0 (socket says 172.21.15.138:40406) 2024-04-26T20:58:32.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.196+0000 7f5235200640 1 -- 172.21.15.138:0/889757089 learned_addr learned my addr 172.21.15.138:0/889757089 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:32.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.196+0000 7f5236600640 1 --2- 172.21.15.138:0/889757089 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f523015d0d0 0x7f523014f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:32.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.196+0000 7f5235c00640 1 --2- 172.21.15.138:0/889757089 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52300cfd40 0x7f523014e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:32.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.196+0000 7f5235200640 1 -- 172.21.15.138:0/889757089 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f523015d0d0 msgr2=0x7f523014f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:32.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.196+0000 7f5235200640 1 --2- 172.21.15.138:0/889757089 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f523015d0d0 0x7f523014f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:32.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.196+0000 7f5235200640 1 -- 172.21.15.138:0/889757089 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52300cfd40 msgr2=0x7f523014e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:32.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.196+0000 7f5235200640 1 --2- 172.21.15.138:0/889757089 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52300cfd40 0x7f523014e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:32.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.196+0000 7f5235200640 1 -- 172.21.15.138:0/889757089 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f523015a200 con 0x7f52300d1880 2024-04-26T20:58:32.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.196+0000 7f5235c00640 1 --2- 172.21.15.138:0/889757089 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52300cfd40 0x7f523014e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:58:32.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.196+0000 7f5236600640 1 --2- 172.21.15.138:0/889757089 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f523015d0d0 0x7f523014f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:58:32.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.196+0000 7f5235200640 1 --2- 172.21.15.138:0/889757089 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52300d1880 0x7f52301525d0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f521c01c9d0 tx=0x7f521c01ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:32.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.196+0000 7f522d600640 1 -- 172.21.15.138:0/889757089 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f521c0bd5f0 con 0x7f52300d1880 2024-04-26T20:58:32.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.196+0000 7f522d600640 1 -- 172.21.15.138:0/889757089 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f521c0bd790 con 0x7f52300d1880 2024-04-26T20:58:32.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.196+0000 7f522d600640 1 -- 172.21.15.138:0/889757089 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f521c0bdb80 con 0x7f52300d1880 2024-04-26T20:58:32.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.196+0000 7f5238600640 1 -- 172.21.15.138:0/889757089 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5230154dd0 con 0x7f52300d1880 2024-04-26T20:58:32.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.196+0000 7f5238600640 1 -- 172.21.15.138:0/889757089 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f523014ed60 con 0x7f52300d1880 2024-04-26T20:58:32.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.200+0000 7f5238600640 1 -- 172.21.15.138:0/889757089 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5230069430 con 0x7f52300d1880 2024-04-26T20:58:32.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.200+0000 7f522d600640 1 -- 172.21.15.138:0/889757089 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f521c0b33f0 con 0x7f52300d1880 2024-04-26T20:58:32.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.200+0000 7f522d600640 1 --2- 172.21.15.138:0/889757089 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f52100683b0 0x7f521006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:32.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.200+0000 7f522d600640 1 -- 172.21.15.138:0/889757089 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6756+0+0 (secure 0 0 0) 0x7f521c121aa0 con 0x7f52300d1880 2024-04-26T20:58:32.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.200+0000 7f5235c00640 1 --2- 172.21.15.138:0/889757089 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f52100683b0 0x7f521006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:32.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.200+0000 7f5235c00640 1 --2- 172.21.15.138:0/889757089 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f52100683b0 0x7f521006a870 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5224003fd0 tx=0x7f5224003a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:32.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.204+0000 7f522d600640 1 -- 172.21.15.138:0/889757089 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f521c0c3060 con 0x7f52300d1880 2024-04-26T20:58:32.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.360+0000 7f5238600640 1 -- 172.21.15.138:0/889757089 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f52300b0550 con 0x7f52300d1880 2024-04-26T20:58:32.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.360+0000 7f522d600640 1 -- 172.21.15.138:0/889757089 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v51) ==== 104+0+11 (secure 0 0 0) 0x7f523015a200 con 0x7f52300d1880 2024-04-26T20:58:32.361 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 32 2024-04-26T20:58:32.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.360+0000 7f5238600640 1 -- 172.21.15.138:0/889757089 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f52100683b0 msgr2=0x7f521006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:32.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.360+0000 7f5238600640 1 --2- 172.21.15.138:0/889757089 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f52100683b0 0x7f521006a870 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5224003fd0 tx=0x7f5224003a00 comp rx=0 tx=0).stop 2024-04-26T20:58:32.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.360+0000 7f5238600640 1 -- 172.21.15.138:0/889757089 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52300d1880 msgr2=0x7f52301525d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:32.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.360+0000 7f5238600640 1 --2- 172.21.15.138:0/889757089 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52300d1880 0x7f52301525d0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f521c01c9d0 tx=0x7f521c01ad30 comp rx=0 tx=0).stop 2024-04-26T20:58:32.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.360+0000 7f5238600640 1 -- 172.21.15.138:0/889757089 shutdown_connections 2024-04-26T20:58:32.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.360+0000 7f5238600640 1 --2- 172.21.15.138:0/889757089 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f52100683b0 0x7f521006a870 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:32.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.360+0000 7f5238600640 1 --2- 172.21.15.138:0/889757089 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f523015d0d0 0x7f523014f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:32.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.360+0000 7f5238600640 1 --2- 172.21.15.138:0/889757089 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52300d1880 0x7f52301525d0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:32.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.360+0000 7f5238600640 1 --2- 172.21.15.138:0/889757089 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52300cfd40 0x7f523014e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:32.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.360+0000 7f5238600640 1 -- 172.21.15.138:0/889757089 >> 172.21.15.138:0/889757089 conn(0x7f52300d2d60 msgr2=0x7f523015e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:32.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.360+0000 7f5238600640 1 -- 172.21.15.138:0/889757089 shutdown_connections 2024-04-26T20:58:32.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.360+0000 7f5238600640 1 -- 172.21.15.138:0/889757089 wait complete. 2024-04-26T20:58:32.382 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T20:58:32.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.520+0000 7f5eae200640 1 Processor -- start 2024-04-26T20:58:32.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.520+0000 7f5eae200640 1 -- start start 2024-04-26T20:58:32.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.520+0000 7f5eae200640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f5ea80cb910 0x7f5ea80b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:32.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.520+0000 7f5eae200640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ea80cd210 con 0x7f5ea815aa60 2024-04-26T20:58:32.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.520+0000 7f5eae200640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ea815d6a0 con 0x7f5ea815e180 2024-04-26T20:58:32.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.520+0000 7f5eae200640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f5ea815d980 con 0x7f5ea80cb910 2024-04-26T20:58:32.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.520+0000 7f5ea7400640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f5ea815aa60 0x7f5ea80cc7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:32900/0 (socket says 172.21.15.138:32900) 2024-04-26T20:58:32.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.520+0000 7f5ea7400640 1 -- 172.21.15.138:0/438820738 learned_addr learned my addr 172.21.15.138:0/438820738 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:32.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.520+0000 7f5ea7e00640 1 --2- 172.21.15.138:0/438820738 >> v2:172.21.15.138:3300/0 conn(0x7f5ea80cb910 0x7f5ea80b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:32.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.524+0000 7f5ea6000640 1 -- 172.21.15.138:0/438820738 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1062175566 0 0) 0x7f5ea80cd210 con 0x7f5ea815aa60 2024-04-26T20:58:32.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.524+0000 7f5ea6000640 1 -- 172.21.15.138:0/438820738 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e8c003530 con 0x7f5ea815aa60 2024-04-26T20:58:32.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.524+0000 7f5ea7e00640 1 -- 172.21.15.138:0/438820738 >> v1:172.21.15.143:6789/0 conn(0x7f5ea815e180 legacy=0x7f5ea80cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:32.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.524+0000 7f5ea6000640 1 -- 172.21.15.138:0/438820738 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2996332446 0 0) 0x7f5ea815d6a0 con 0x7f5ea815e180 2024-04-26T20:58:32.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.524+0000 7f5ea7e00640 1 -- 172.21.15.138:0/438820738 >> v1:172.21.15.138:6789/0 conn(0x7f5ea815aa60 legacy=0x7f5ea80cc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:32.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.524+0000 7f5ea7e00640 1 -- 172.21.15.138:0/438820738 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ea815dc60 con 0x7f5ea80cb910 2024-04-26T20:58:32.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.524+0000 7f5ea7e00640 1 --2- 172.21.15.138:0/438820738 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ea80cb910 0x7f5ea80b5aa0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0009d90 tx=0x7f5ea001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aaa02fe34ae7caa server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:32.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.524+0000 7f5ea6000640 1 -- 172.21.15.138:0/438820738 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea00b2070 con 0x7f5ea80cb910 2024-04-26T20:58:32.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.524+0000 7f5ea6000640 1 -- 172.21.15.138:0/438820738 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ea00a5830 con 0x7f5ea80cb910 2024-04-26T20:58:32.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.524+0000 7f5ea6000640 1 -- 172.21.15.138:0/438820738 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea00a5c00 con 0x7f5ea80cb910 2024-04-26T20:58:32.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.524+0000 7f5eae200640 1 -- 172.21.15.138:0/438820738 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ea80cb910 msgr2=0x7f5ea80b5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:32.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.524+0000 7f5eae200640 1 --2- 172.21.15.138:0/438820738 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ea80cb910 0x7f5ea80b5aa0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0009d90 tx=0x7f5ea001c970 comp rx=0 tx=0).stop 2024-04-26T20:58:32.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.528+0000 7f5eae200640 1 -- 172.21.15.138:0/438820738 shutdown_connections 2024-04-26T20:58:32.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.528+0000 7f5eae200640 1 --2- 172.21.15.138:0/438820738 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ea80cb910 0x7f5ea80b5aa0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:32.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.528+0000 7f5eae200640 1 -- 172.21.15.138:0/438820738 >> 172.21.15.138:0/438820738 conn(0x7f5ea80d0bb0 msgr2=0x7f5ea80d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:32.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.528+0000 7f5eae200640 1 -- 172.21.15.138:0/438820738 shutdown_connections 2024-04-26T20:58:32.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.528+0000 7f5eae200640 1 -- 172.21.15.138:0/438820738 wait complete. 2024-04-26T20:58:32.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.528+0000 7f5eae200640 1 Processor -- start 2024-04-26T20:58:32.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.528+0000 7f5eae200640 1 -- start start 2024-04-26T20:58:32.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.528+0000 7f5eae200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ea80cb910 0x7f5ea80c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:32.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.528+0000 7f5eae200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ea815aa60 0x7f5ea815bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:32.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.528+0000 7f5eae200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5ea815e180 0x7f5ea815c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:32.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.528+0000 7f5eae200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea816afb0 con 0x7f5ea80cb910 2024-04-26T20:58:32.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.528+0000 7f5eae200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea816ae30 con 0x7f5ea815aa60 2024-04-26T20:58:32.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.528+0000 7f5eae200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f5ea816b130 con 0x7f5ea815e180 2024-04-26T20:58:32.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.528+0000 7f5ea7400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ea80cb910 0x7f5ea80c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:32.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.528+0000 7f5ea7400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ea80cb910 0x7f5ea80c83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40420/0 (socket says 172.21.15.138:40420) 2024-04-26T20:58:32.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.528+0000 7f5ea7400640 1 -- 172.21.15.138:0/787583059 learned_addr learned my addr 172.21.15.138:0/787583059 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:32.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.528+0000 7f5ea7400640 1 -- 172.21.15.138:0/787583059 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5ea815e180 msgr2=0x7f5ea815c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:32.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.528+0000 7f5ea7400640 1 --2- 172.21.15.138:0/787583059 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5ea815e180 0x7f5ea815c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:32.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.528+0000 7f5ea7400640 1 -- 172.21.15.138:0/787583059 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ea815aa60 msgr2=0x7f5ea815bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:32.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.528+0000 7f5ea7400640 1 --2- 172.21.15.138:0/787583059 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ea815aa60 0x7f5ea815bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:32.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.528+0000 7f5ea7400640 1 -- 172.21.15.138:0/787583059 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ea815ca20 con 0x7f5ea80cb910 2024-04-26T20:58:32.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.528+0000 7f5ea7400640 1 --2- 172.21.15.138:0/787583059 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ea80cb910 0x7f5ea80c83d0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f5e9000c450 tx=0x7f5e9000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:32.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.528+0000 7f5e9f400640 1 -- 172.21.15.138:0/787583059 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e90017070 con 0x7f5ea80cb910 2024-04-26T20:58:32.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.528+0000 7f5e9f400640 1 -- 172.21.15.138:0/787583059 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e90005cf0 con 0x7f5ea80cb910 2024-04-26T20:58:32.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.528+0000 7f5eae200640 1 -- 172.21.15.138:0/787583059 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ea815c770 con 0x7f5ea80cb910 2024-04-26T20:58:32.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.528+0000 7f5e9f400640 1 -- 172.21.15.138:0/787583059 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e90007290 con 0x7f5ea80cb910 2024-04-26T20:58:32.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.528+0000 7f5eae200640 1 -- 172.21.15.138:0/787583059 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ea80cf090 con 0x7f5ea80cb910 2024-04-26T20:58:32.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.532+0000 7f5eae200640 1 -- 172.21.15.138:0/787583059 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ea8069430 con 0x7f5ea80cb910 2024-04-26T20:58:32.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.532+0000 7f5e9f400640 1 -- 172.21.15.138:0/787583059 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5e9001a070 con 0x7f5ea80cb910 2024-04-26T20:58:32.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.532+0000 7f5e9f400640 1 --2- 172.21.15.138:0/787583059 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5e84068380 0x7f5e8406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:32.534 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.532+0000 7f5e9f400640 1 -- 172.21.15.138:0/787583059 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6756+0+0 (secure 0 0 0) 0x7f5e900861c0 con 0x7f5ea80cb910 2024-04-26T20:58:32.534 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.532+0000 7f5ea6a00640 1 --2- 172.21.15.138:0/787583059 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5e84068380 0x7f5e8406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:32.534 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.532+0000 7f5ea6a00640 1 --2- 172.21.15.138:0/787583059 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5e84068380 0x7f5e8406a840 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5e98007fd0 tx=0x7f5e98007920 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:32.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.536+0000 7f5e9f400640 1 -- 172.21.15.138:0/787583059 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5e90056350 con 0x7f5ea80cb910 2024-04-26T20:58:32.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.700+0000 7f5eae200640 1 -- 172.21.15.138:0/787583059 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5ea8075230 con 0x7f5ea80cb910 2024-04-26T20:58:32.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.700+0000 7f5e9f400640 1 -- 172.21.15.138:0/787583059 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v51) ==== 100+0+11 (secure 0 0 0) 0x7f5e90055c50 con 0x7f5ea80cb910 2024-04-26T20:58:32.702 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 64 2024-04-26T20:58:32.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.704+0000 7f5eae200640 1 -- 172.21.15.138:0/787583059 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5e84068380 msgr2=0x7f5e8406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:32.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.704+0000 7f5eae200640 1 --2- 172.21.15.138:0/787583059 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5e84068380 0x7f5e8406a840 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5e98007fd0 tx=0x7f5e98007920 comp rx=0 tx=0).stop 2024-04-26T20:58:32.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.704+0000 7f5eae200640 1 -- 172.21.15.138:0/787583059 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ea80cb910 msgr2=0x7f5ea80c83d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:32.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.704+0000 7f5eae200640 1 --2- 172.21.15.138:0/787583059 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ea80cb910 0x7f5ea80c83d0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f5e9000c450 tx=0x7f5e9000c910 comp rx=0 tx=0).stop 2024-04-26T20:58:32.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.704+0000 7f5eae200640 1 -- 172.21.15.138:0/787583059 shutdown_connections 2024-04-26T20:58:32.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.704+0000 7f5eae200640 1 --2- 172.21.15.138:0/787583059 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5e84068380 0x7f5e8406a840 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:32.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.704+0000 7f5eae200640 1 --2- 172.21.15.138:0/787583059 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5ea815e180 0x7f5ea815c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:32.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.704+0000 7f5eae200640 1 --2- 172.21.15.138:0/787583059 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ea815aa60 0x7f5ea815bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:32.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.704+0000 7f5eae200640 1 --2- 172.21.15.138:0/787583059 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ea80cb910 0x7f5ea80c83d0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:32.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.704+0000 7f5eae200640 1 -- 172.21.15.138:0/787583059 >> 172.21.15.138:0/787583059 conn(0x7f5ea80d0bb0 msgr2=0x7f5ea80cc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:32.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.704+0000 7f5eae200640 1 -- 172.21.15.138:0/787583059 shutdown_connections 2024-04-26T20:58:32.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.704+0000 7f5eae200640 1 -- 172.21.15.138:0/787583059 wait complete. 2024-04-26T20:58:32.723 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get recovery_fs_metadata pg_num 2024-04-26T20:58:32.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.864+0000 7f2245800640 1 Processor -- start 2024-04-26T20:58:32.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.864+0000 7f2245800640 1 -- start start 2024-04-26T20:58:32.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.864+0000 7f2245800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f224006f880 0x7f2240166cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:32.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.864+0000 7f2245800640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2240160750 con 0x7f2240073d70 2024-04-26T20:58:32.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.864+0000 7f2245800640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f224006dee0 con 0x7f224015bdc0 2024-04-26T20:58:32.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.864+0000 7f2245800640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f224015c1a0 con 0x7f224006f880 2024-04-26T20:58:32.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.864+0000 7f223f400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f224006f880 0x7f2240166cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:32.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.864+0000 7f2236000640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f2240073d70 0x7f2240160040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:32916/0 (socket says 172.21.15.138:32916) 2024-04-26T20:58:32.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.864+0000 7f2236000640 1 -- 172.21.15.138:0/3273181675 learned_addr learned my addr 172.21.15.138:0/3273181675 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:32.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.864+0000 7f223f400640 1 -- 172.21.15.138:0/3273181675 >> v1:172.21.15.143:6789/0 conn(0x7f224015bdc0 legacy=0x7f224015f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:32.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.864+0000 7f223f400640 1 -- 172.21.15.138:0/3273181675 >> v1:172.21.15.138:6789/0 conn(0x7f2240073d70 legacy=0x7f2240160040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:32.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.864+0000 7f223f400640 1 -- 172.21.15.138:0/3273181675 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f224006e180 con 0x7f224006f880 2024-04-26T20:58:32.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.864+0000 7f223e000640 1 -- 172.21.15.138:0/3273181675 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4154854245 0 0) 0x7f2240160750 con 0x7f2240073d70 2024-04-26T20:58:32.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.868+0000 7f223f400640 1 --2- 172.21.15.138:0/3273181675 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f224006f880 0x7f2240166cc0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f22380097c0 tx=0x7f223801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f7f99f6a6adb16d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:32.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.868+0000 7f223e000640 1 -- 172.21.15.138:0/3273181675 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22380b0070 con 0x7f224006f880 2024-04-26T20:58:32.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.868+0000 7f223e000640 1 -- 172.21.15.138:0/3273181675 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22380ab600 con 0x7f224006f880 2024-04-26T20:58:32.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.868+0000 7f223e000640 1 -- 172.21.15.138:0/3273181675 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22380ab9d0 con 0x7f224006f880 2024-04-26T20:58:32.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.868+0000 7f2245800640 1 -- 172.21.15.138:0/3273181675 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f224006f880 msgr2=0x7f2240166cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:32.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.868+0000 7f2245800640 1 --2- 172.21.15.138:0/3273181675 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f224006f880 0x7f2240166cc0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f22380097c0 tx=0x7f223801c380 comp rx=0 tx=0).stop 2024-04-26T20:58:32.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.868+0000 7f2245800640 1 -- 172.21.15.138:0/3273181675 shutdown_connections 2024-04-26T20:58:32.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.868+0000 7f2245800640 1 --2- 172.21.15.138:0/3273181675 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f224006f880 0x7f2240166cc0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:32.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.868+0000 7f2245800640 1 -- 172.21.15.138:0/3273181675 >> 172.21.15.138:0/3273181675 conn(0x7f22400d0bb0 msgr2=0x7f22400d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:32.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.868+0000 7f2245800640 1 -- 172.21.15.138:0/3273181675 shutdown_connections 2024-04-26T20:58:32.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.868+0000 7f2245800640 1 -- 172.21.15.138:0/3273181675 wait complete. 2024-04-26T20:58:32.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.872+0000 7f2245800640 1 Processor -- start 2024-04-26T20:58:32.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.872+0000 7f2245800640 1 -- start start 2024-04-26T20:58:32.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.872+0000 7f2245800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f224006f880 0x7f22400b5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:32.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.872+0000 7f2245800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2240073d70 0x7f2240166a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:32.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.872+0000 7f2245800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f224015bdc0 0x7f2240147e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:32.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.872+0000 7f2245800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f2240169ba0 con 0x7f224006f880 2024-04-26T20:58:32.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.872+0000 7f2245800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f2240169a20 con 0x7f2240073d70 2024-04-26T20:58:32.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.872+0000 7f2245800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f2240169d20 con 0x7f224015bdc0 2024-04-26T20:58:32.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.872+0000 7f223ea00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f224006f880 0x7f22400b5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:32.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.872+0000 7f223ea00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f224006f880 0x7f22400b5bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40438/0 (socket says 172.21.15.138:40438) 2024-04-26T20:58:32.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.872+0000 7f223ea00640 1 -- 172.21.15.138:0/255190308 learned_addr learned my addr 172.21.15.138:0/255190308 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:32.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.872+0000 7f2236000640 1 --2- 172.21.15.138:0/255190308 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2240073d70 0x7f2240166a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:32.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.872+0000 7f223f400640 1 --2- 172.21.15.138:0/255190308 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f224015bdc0 0x7f2240147e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:32.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.872+0000 7f223ea00640 1 -- 172.21.15.138:0/255190308 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f224015bdc0 msgr2=0x7f2240147e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:32.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.872+0000 7f223ea00640 1 --2- 172.21.15.138:0/255190308 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f224015bdc0 0x7f2240147e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:32.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.872+0000 7f223ea00640 1 -- 172.21.15.138:0/255190308 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2240073d70 msgr2=0x7f2240166a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:32.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.872+0000 7f223ea00640 1 --2- 172.21.15.138:0/255190308 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2240073d70 0x7f2240166a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:32.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.872+0000 7f223ea00640 1 -- 172.21.15.138:0/255190308 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22400c8730 con 0x7f224006f880 2024-04-26T20:58:32.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.872+0000 7f223ea00640 1 --2- 172.21.15.138:0/255190308 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f224006f880 0x7f22400b5bc0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f223000c7d0 tx=0x7f223000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:32.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.872+0000 7f2237400640 1 -- 172.21.15.138:0/255190308 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2230003b80 con 0x7f224006f880 2024-04-26T20:58:32.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.872+0000 7f2237400640 1 -- 172.21.15.138:0/255190308 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2230003d20 con 0x7f224006f880 2024-04-26T20:58:32.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.872+0000 7f2245800640 1 -- 172.21.15.138:0/255190308 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22400b61a0 con 0x7f224006f880 2024-04-26T20:58:32.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.872+0000 7f2237400640 1 -- 172.21.15.138:0/255190308 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f223000aa90 con 0x7f224006f880 2024-04-26T20:58:32.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.872+0000 7f2245800640 1 -- 172.21.15.138:0/255190308 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22400c9be0 con 0x7f224006f880 2024-04-26T20:58:32.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.872+0000 7f2245800640 1 -- 172.21.15.138:0/255190308 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2240069430 con 0x7f224006f880 2024-04-26T20:58:32.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.876+0000 7f2237400640 1 -- 172.21.15.138:0/255190308 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f223000ac30 con 0x7f224006f880 2024-04-26T20:58:32.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.876+0000 7f2237400640 1 --2- 172.21.15.138:0/255190308 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f221c068380 0x7f221c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:32.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.876+0000 7f2237400640 1 -- 172.21.15.138:0/255190308 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6756+0+0 (secure 0 0 0) 0x7f2230086bf0 con 0x7f224006f880 2024-04-26T20:58:32.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.876+0000 7f2236000640 1 --2- 172.21.15.138:0/255190308 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f221c068380 0x7f221c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:32.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.876+0000 7f2236000640 1 --2- 172.21.15.138:0/255190308 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f221c068380 0x7f221c06a840 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f22400c8660 tx=0x7f2228007240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:32.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:32.880+0000 7f2237400640 1 -- 172.21.15.138:0/255190308 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f22300566a0 con 0x7f224006f880 2024-04-26T20:58:33.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.032+0000 7f2245800640 1 -- 172.21.15.138:0/255190308 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "recovery_fs_metadata", "var": "pg_num"} v 0) -- 0x7f22400d19c0 con 0x7f224006f880 2024-04-26T20:58:33.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.032+0000 7f2237400640 1 -- 172.21.15.138:0/255190308 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "recovery_fs_metadata", "var": "pg_num"}]=0 v51) ==== 109+0+11 (secure 0 0 0) 0x7f223005a9a0 con 0x7f224006f880 2024-04-26T20:58:33.035 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 32 2024-04-26T20:58:33.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.036+0000 7f2245800640 1 -- 172.21.15.138:0/255190308 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f221c068380 msgr2=0x7f221c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:33.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.036+0000 7f2245800640 1 --2- 172.21.15.138:0/255190308 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f221c068380 0x7f221c06a840 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f22400c8660 tx=0x7f2228007240 comp rx=0 tx=0).stop 2024-04-26T20:58:33.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.036+0000 7f2245800640 1 -- 172.21.15.138:0/255190308 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f224006f880 msgr2=0x7f22400b5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:33.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.036+0000 7f2245800640 1 --2- 172.21.15.138:0/255190308 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f224006f880 0x7f22400b5bc0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f223000c7d0 tx=0x7f223000cc90 comp rx=0 tx=0).stop 2024-04-26T20:58:33.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.036+0000 7f2245800640 1 -- 172.21.15.138:0/255190308 shutdown_connections 2024-04-26T20:58:33.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.036+0000 7f2245800640 1 --2- 172.21.15.138:0/255190308 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f221c068380 0x7f221c06a840 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:33.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.036+0000 7f2245800640 1 --2- 172.21.15.138:0/255190308 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f224015bdc0 0x7f2240147e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:33.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.036+0000 7f2245800640 1 --2- 172.21.15.138:0/255190308 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2240073d70 0x7f2240166a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:33.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.036+0000 7f2245800640 1 --2- 172.21.15.138:0/255190308 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f224006f880 0x7f22400b5bc0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:33.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.036+0000 7f2245800640 1 -- 172.21.15.138:0/255190308 >> 172.21.15.138:0/255190308 conn(0x7f22400d0bb0 msgr2=0x7f22400d0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:33.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.036+0000 7f2245800640 1 -- 172.21.15.138:0/255190308 shutdown_connections 2024-04-26T20:58:33.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.036+0000 7f2245800640 1 -- 172.21.15.138:0/255190308 wait complete. 2024-04-26T20:58:33.057 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:58:33.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.192+0000 7f2c6c800640 1 Processor -- start 2024-04-26T20:58:33.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.192+0000 7f2c6c800640 1 -- start start 2024-04-26T20:58:33.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.192+0000 7f2c6c800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2c6415d0f0 0x7f2c640d1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:33.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.192+0000 7f2c6c800640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f2c640b2280 0x7f2c640d1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:33.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.192+0000 7f2c6c800640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c640ce540 con 0x7f2c640d0950 2024-04-26T20:58:33.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.192+0000 7f2c6c800640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f2c640d0e50 con 0x7f2c640b2280 2024-04-26T20:58:33.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.192+0000 7f2c6c800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f2c640b26e0 con 0x7f2c6415d0f0 2024-04-26T20:58:33.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.192+0000 7f2c6a800640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f2c640d0950 0x7f2c640cf750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:32926/0 (socket says 172.21.15.138:32926) 2024-04-26T20:58:33.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.192+0000 7f2c6a800640 1 -- 172.21.15.138:0/2272034744 learned_addr learned my addr 172.21.15.138:0/2272034744 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:33.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.192+0000 7f2c69400640 1 --2- 172.21.15.138:0/2272034744 >> v2:172.21.15.143:3300/0 conn(0x7f2c640b2280 0x7f2c640d1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:33.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.192+0000 7f2c69e00640 1 --2- 172.21.15.138:0/2272034744 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2c6415d0f0 0x7f2c640d1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:33.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.192+0000 7f2c68a00640 1 -- 172.21.15.138:0/2272034744 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4019038796 0 0) 0x7f2c640ce540 con 0x7f2c640d0950 2024-04-26T20:58:33.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.192+0000 7f2c68a00640 1 -- 172.21.15.138:0/2272034744 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c4c003530 con 0x7f2c640d0950 2024-04-26T20:58:33.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.192+0000 7f2c69400640 1 -- 172.21.15.138:0/2272034744 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2c6415d0f0 msgr2=0x7f2c640d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:33.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.192+0000 7f2c69400640 1 --2- 172.21.15.138:0/2272034744 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2c6415d0f0 0x7f2c640d1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:33.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.192+0000 7f2c69400640 1 -- 172.21.15.138:0/2272034744 >> v1:172.21.15.138:6789/0 conn(0x7f2c640d0950 legacy=0x7f2c640cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:33.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.192+0000 7f2c69400640 1 -- 172.21.15.138:0/2272034744 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c640ce820 con 0x7f2c640b2280 2024-04-26T20:58:33.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.196+0000 7f2c69400640 1 --2- 172.21.15.138:0/2272034744 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2c640b2280 0x7f2c640d1550 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2c540097c0 tx=0x7f2c5401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a358780e7d04d46f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:33.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.196+0000 7f2c68a00640 1 -- 172.21.15.138:0/2272034744 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c540b0070 con 0x7f2c640b2280 2024-04-26T20:58:33.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.196+0000 7f2c68a00640 1 -- 172.21.15.138:0/2272034744 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c540ab600 con 0x7f2c640b2280 2024-04-26T20:58:33.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.196+0000 7f2c68a00640 1 -- 172.21.15.138:0/2272034744 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c540ab9b0 con 0x7f2c640b2280 2024-04-26T20:58:33.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.196+0000 7f2c6c800640 1 -- 172.21.15.138:0/2272034744 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2c640b2280 msgr2=0x7f2c640d1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:33.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.196+0000 7f2c6c800640 1 --2- 172.21.15.138:0/2272034744 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2c640b2280 0x7f2c640d1550 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2c540097c0 tx=0x7f2c5401c4a0 comp rx=0 tx=0).stop 2024-04-26T20:58:33.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.196+0000 7f2c6c800640 1 -- 172.21.15.138:0/2272034744 shutdown_connections 2024-04-26T20:58:33.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.196+0000 7f2c6c800640 1 --2- 172.21.15.138:0/2272034744 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2c640b2280 0x7f2c640d1550 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:33.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.196+0000 7f2c6c800640 1 --2- 172.21.15.138:0/2272034744 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2c6415d0f0 0x7f2c640d1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:33.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.196+0000 7f2c6c800640 1 -- 172.21.15.138:0/2272034744 >> 172.21.15.138:0/2272034744 conn(0x7f2c640d2d80 msgr2=0x7f2c640d3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:33.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.196+0000 7f2c6c800640 1 -- 172.21.15.138:0/2272034744 shutdown_connections 2024-04-26T20:58:33.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.196+0000 7f2c6c800640 1 -- 172.21.15.138:0/2272034744 wait complete. 2024-04-26T20:58:33.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.200+0000 7f2c6c800640 1 Processor -- start 2024-04-26T20:58:33.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.200+0000 7f2c6c800640 1 -- start start 2024-04-26T20:58:33.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.200+0000 7f2c6c800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2c640b2280 0x7f2c640c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:33.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.200+0000 7f2c6c800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2c640d0950 0x7f2c64154270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:33.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.200+0000 7f2c6c800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2c6415d0f0 0x7f2c640b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:33.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.200+0000 7f2c6c800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6416a040 con 0x7f2c640d0950 2024-04-26T20:58:33.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.200+0000 7f2c6c800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f2c64169ec0 con 0x7f2c6415d0f0 2024-04-26T20:58:33.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.200+0000 7f2c6c800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f2c6416a1c0 con 0x7f2c640b2280 2024-04-26T20:58:33.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.200+0000 7f2c69400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2c640d0950 0x7f2c64154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:33.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.200+0000 7f2c69400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2c640d0950 0x7f2c64154270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40450/0 (socket says 172.21.15.138:40450) 2024-04-26T20:58:33.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.200+0000 7f2c69400640 1 -- 172.21.15.138:0/2637423291 learned_addr learned my addr 172.21.15.138:0/2637423291 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:33.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.200+0000 7f2c69e00640 1 --2- 172.21.15.138:0/2637423291 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2c640b2280 0x7f2c640c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:33.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.200+0000 7f2c6a800640 1 --2- 172.21.15.138:0/2637423291 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2c6415d0f0 0x7f2c640b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:33.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.200+0000 7f2c69400640 1 -- 172.21.15.138:0/2637423291 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2c640b2280 msgr2=0x7f2c640c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:33.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.200+0000 7f2c69400640 1 --2- 172.21.15.138:0/2637423291 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2c640b2280 0x7f2c640c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:33.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.200+0000 7f2c69400640 1 -- 172.21.15.138:0/2637423291 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2c6415d0f0 msgr2=0x7f2c640b6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:33.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.200+0000 7f2c69400640 1 --2- 172.21.15.138:0/2637423291 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2c6415d0f0 0x7f2c640b6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:33.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.200+0000 7f2c69400640 1 -- 172.21.15.138:0/2637423291 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c641547b0 con 0x7f2c640d0950 2024-04-26T20:58:33.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.200+0000 7f2c69400640 1 --2- 172.21.15.138:0/2637423291 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2c640d0950 0x7f2c64154270 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f2c540ae040 tx=0x7f2c54019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:33.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.200+0000 7f2c5e000640 1 -- 172.21.15.138:0/2637423291 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c540b9020 con 0x7f2c640d0950 2024-04-26T20:58:33.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.200+0000 7f2c5e000640 1 -- 172.21.15.138:0/2637423291 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c540ab7b0 con 0x7f2c640d0950 2024-04-26T20:58:33.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.200+0000 7f2c5e000640 1 -- 172.21.15.138:0/2637423291 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c540b0040 con 0x7f2c640d0950 2024-04-26T20:58:33.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.200+0000 7f2c6c800640 1 -- 172.21.15.138:0/2637423291 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c640b86d0 con 0x7f2c640d0950 2024-04-26T20:58:33.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.200+0000 7f2c6c800640 1 -- 172.21.15.138:0/2637423291 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c640b5600 con 0x7f2c640d0950 2024-04-26T20:58:33.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.204+0000 7f2c6c800640 1 -- 172.21.15.138:0/2637423291 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c64069510 con 0x7f2c640d0950 2024-04-26T20:58:33.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.204+0000 7f2c5e000640 1 -- 172.21.15.138:0/2637423291 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2c540bc020 con 0x7f2c640d0950 2024-04-26T20:58:33.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.204+0000 7f2c5e000640 1 --2- 172.21.15.138:0/2637423291 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f2c48068380 0x7f2c4806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:33.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.204+0000 7f2c5e000640 1 -- 172.21.15.138:0/2637423291 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6756+0+0 (secure 0 0 0) 0x7f2c54120b30 con 0x7f2c640d0950 2024-04-26T20:58:33.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.204+0000 7f2c69e00640 1 --2- 172.21.15.138:0/2637423291 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f2c48068380 0x7f2c4806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:33.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.204+0000 7f2c69e00640 1 --2- 172.21.15.138:0/2637423291 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f2c48068380 0x7f2c4806a840 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2c58009ac0 tx=0x7f2c58009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:33.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.208+0000 7f2c5e000640 1 -- 172.21.15.138:0/2637423291 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2c540c3030 con 0x7f2c640d0950 2024-04-26T20:58:33.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.396+0000 7f2c6c800640 1 -- 172.21.15.138:0/2637423291 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2c64159bd0 con 0x7f2c640d0950 2024-04-26T20:58:33.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.400+0000 7f2c5e000640 1 -- 172.21.15.138:0/2637423291 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+6489 (secure 0 0 0) 0x7f2c54016090 con 0x7f2c640d0950 2024-04-26T20:58:33.399 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:33.400 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":28,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5048,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/255610168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":255610168},{"type":"v1","addr":"172.21.15.143:6836","nonce":255610168}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5051,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/799063831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":799063831},{"type":"v1","addr":"172.21.15.143:6837","nonce":799063831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5410,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/976248149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":976248149},{"type":"v1","addr":"172.21.15.138:6835","nonce":976248149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:57:51.937789+0000","modified":"2024-04-26T20:58:07.183899+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":42,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2},{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:58:10.360154+0000","modified":"2024-04-26T20:58:24.737160+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5604":{"gid":5604,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.138:6834/2450256246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2450256246},{"type":"v1","addr":"172.21.15.138:6834","nonce":2450256246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":7,"enabled":true,"fs_name":"recovery_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5604,"qdb_cluster":[5604]},"id":3}]} 2024-04-26T20:58:33.400 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 28 2024-04-26T20:58:33.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.400+0000 7f2c6c800640 1 -- 172.21.15.138:0/2637423291 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f2c48068380 msgr2=0x7f2c4806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:33.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.400+0000 7f2c6c800640 1 --2- 172.21.15.138:0/2637423291 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f2c48068380 0x7f2c4806a840 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2c58009ac0 tx=0x7f2c58009190 comp rx=0 tx=0).stop 2024-04-26T20:58:33.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.400+0000 7f2c6c800640 1 -- 172.21.15.138:0/2637423291 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2c640d0950 msgr2=0x7f2c64154270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:33.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.400+0000 7f2c6c800640 1 --2- 172.21.15.138:0/2637423291 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2c640d0950 0x7f2c64154270 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f2c540ae040 tx=0x7f2c54019240 comp rx=0 tx=0).stop 2024-04-26T20:58:33.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.400+0000 7f2c6c800640 1 -- 172.21.15.138:0/2637423291 shutdown_connections 2024-04-26T20:58:33.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.400+0000 7f2c6c800640 1 --2- 172.21.15.138:0/2637423291 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f2c48068380 0x7f2c4806a840 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:33.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.400+0000 7f2c6c800640 1 --2- 172.21.15.138:0/2637423291 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2c6415d0f0 0x7f2c640b6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:33.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.400+0000 7f2c6c800640 1 --2- 172.21.15.138:0/2637423291 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2c640d0950 0x7f2c64154270 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:33.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.400+0000 7f2c6c800640 1 --2- 172.21.15.138:0/2637423291 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2c640b2280 0x7f2c640c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:33.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.400+0000 7f2c6c800640 1 -- 172.21.15.138:0/2637423291 >> 172.21.15.138:0/2637423291 conn(0x7f2c640d2d80 msgr2=0x7f2c640d3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:33.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.400+0000 7f2c6c800640 1 -- 172.21.15.138:0/2637423291 shutdown_connections 2024-04-26T20:58:33.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.400+0000 7f2c6c800640 1 -- 172.21.15.138:0/2637423291 wait complete. 2024-04-26T20:58:33.420 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:58:33.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.552+0000 7f152b000640 1 Processor -- start 2024-04-26T20:58:33.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.552+0000 7f152b000640 1 -- start start 2024-04-26T20:58:33.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.556+0000 7f152b000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f15240cbe00 0x7f152406de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:33.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.556+0000 7f152b000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f15240cc1e0 0x7f1524073b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:33.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.556+0000 7f152b000640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15240727f0 con 0x7f15240ce6f0 2024-04-26T20:58:33.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.556+0000 7f152b000640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f1524073680 con 0x7f15240cbe00 2024-04-26T20:58:33.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.556+0000 7f152b000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f1524072a70 con 0x7f15240cc1e0 2024-04-26T20:58:33.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.556+0000 7f1523e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f15240cbe00 0x7f152406de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:33.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.556+0000 7f1529000640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f15240ce6f0 0x7f15240ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:32928/0 (socket says 172.21.15.138:32928) 2024-04-26T20:58:33.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.556+0000 7f1529000640 1 -- 172.21.15.138:0/3675408023 learned_addr learned my addr 172.21.15.138:0/3675408023 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:33.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.556+0000 7f151b400640 1 --2- 172.21.15.138:0/3675408023 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f15240cc1e0 0x7f1524073b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:33.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.556+0000 7f1523e00640 1 -- 172.21.15.138:0/3675408023 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f15240cc1e0 msgr2=0x7f1524073b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:33.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.556+0000 7f1523e00640 1 --2- 172.21.15.138:0/3675408023 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f15240cc1e0 0x7f1524073b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:33.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.556+0000 7f1523e00640 1 -- 172.21.15.138:0/3675408023 >> v1:172.21.15.138:6789/0 conn(0x7f15240ce6f0 legacy=0x7f15240ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:33.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.556+0000 7f1523e00640 1 -- 172.21.15.138:0/3675408023 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1524072d50 con 0x7f15240cbe00 2024-04-26T20:58:33.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.556+0000 7f1523400640 1 -- 172.21.15.138:0/3675408023 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1402178423 0 0) 0x7f151c0014a0 con 0x7f15240ce6f0 2024-04-26T20:58:33.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.560+0000 7f1523e00640 1 --2- 172.21.15.138:0/3675408023 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f15240cbe00 0x7f152406de70 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f15140097c0 tx=0x7f151401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=983bdaa72233529e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:33.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.560+0000 7f1523400640 1 -- 172.21.15.138:0/3675408023 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15140b0070 con 0x7f15240cbe00 2024-04-26T20:58:33.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.560+0000 7f1523400640 1 -- 172.21.15.138:0/3675408023 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15140ab600 con 0x7f15240cbe00 2024-04-26T20:58:33.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.560+0000 7f1523400640 1 -- 172.21.15.138:0/3675408023 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15140ab9d0 con 0x7f15240cbe00 2024-04-26T20:58:33.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.560+0000 7f152b000640 1 -- 172.21.15.138:0/3675408023 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f15240cbe00 msgr2=0x7f152406de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:33.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.560+0000 7f152b000640 1 --2- 172.21.15.138:0/3675408023 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f15240cbe00 0x7f152406de70 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f15140097c0 tx=0x7f151401c4a0 comp rx=0 tx=0).stop 2024-04-26T20:58:33.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.560+0000 7f152b000640 1 -- 172.21.15.138:0/3675408023 shutdown_connections 2024-04-26T20:58:33.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.560+0000 7f152b000640 1 --2- 172.21.15.138:0/3675408023 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f15240cc1e0 0x7f1524073b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:33.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.560+0000 7f152b000640 1 --2- 172.21.15.138:0/3675408023 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f15240cbe00 0x7f152406de70 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:33.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.560+0000 7f152b000640 1 -- 172.21.15.138:0/3675408023 >> 172.21.15.138:0/3675408023 conn(0x7f15240d0b20 msgr2=0x7f15240d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:33.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.560+0000 7f152b000640 1 -- 172.21.15.138:0/3675408023 shutdown_connections 2024-04-26T20:58:33.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.560+0000 7f152b000640 1 -- 172.21.15.138:0/3675408023 wait complete. 2024-04-26T20:58:33.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.560+0000 7f152b000640 1 Processor -- start 2024-04-26T20:58:33.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.560+0000 7f152b000640 1 -- start start 2024-04-26T20:58:33.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.564+0000 7f152b000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f15240cbe00 0x7f1524154b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:33.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.564+0000 7f152b000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f15240cc1e0 0x7f1524155dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:33.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.564+0000 7f152b000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15240ce6f0 0x7f152415a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:33.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.564+0000 7f152b000640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f15240741d0 con 0x7f15240cc1e0 2024-04-26T20:58:33.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.564+0000 7f152b000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f1524074050 con 0x7f15240ce6f0 2024-04-26T20:58:33.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.564+0000 7f152b000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f15240d0780 con 0x7f15240cbe00 2024-04-26T20:58:33.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.564+0000 7f151b400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f15240cc1e0 0x7f1524155dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:33.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.564+0000 7f151b400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f15240cc1e0 0x7f1524155dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40460/0 (socket says 172.21.15.138:40460) 2024-04-26T20:58:33.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.564+0000 7f151b400640 1 -- 172.21.15.138:0/2325821993 learned_addr learned my addr 172.21.15.138:0/2325821993 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:33.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.564+0000 7f1523e00640 1 --2- 172.21.15.138:0/2325821993 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f15240cbe00 0x7f1524154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:33.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.564+0000 7f1529000640 1 --2- 172.21.15.138:0/2325821993 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15240ce6f0 0x7f152415a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:33.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.564+0000 7f151b400640 1 -- 172.21.15.138:0/2325821993 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f15240cbe00 msgr2=0x7f1524154b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:33.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.564+0000 7f151b400640 1 --2- 172.21.15.138:0/2325821993 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f15240cbe00 0x7f1524154b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:33.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.564+0000 7f151b400640 1 -- 172.21.15.138:0/2325821993 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15240ce6f0 msgr2=0x7f152415a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:33.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.564+0000 7f151b400640 1 --2- 172.21.15.138:0/2325821993 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15240ce6f0 0x7f152415a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:33.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.564+0000 7f151b400640 1 -- 172.21.15.138:0/2325821993 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1524156520 con 0x7f15240cc1e0 2024-04-26T20:58:33.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.564+0000 7f151b400640 1 --2- 172.21.15.138:0/2325821993 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f15240cc1e0 0x7f1524155dd0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f150c00e960 tx=0x7f150c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:33.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.564+0000 7f1520c00640 1 -- 172.21.15.138:0/2325821993 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c017070 con 0x7f15240cc1e0 2024-04-26T20:58:33.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.564+0000 7f1520c00640 1 -- 172.21.15.138:0/2325821993 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f150c00ca00 con 0x7f15240cc1e0 2024-04-26T20:58:33.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.564+0000 7f152b000640 1 -- 172.21.15.138:0/2325821993 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1524156800 con 0x7f15240cc1e0 2024-04-26T20:58:33.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.564+0000 7f1520c00640 1 -- 172.21.15.138:0/2325821993 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c00cdb0 con 0x7f15240cc1e0 2024-04-26T20:58:33.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.564+0000 7f152b000640 1 -- 172.21.15.138:0/2325821993 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15240aea60 con 0x7f15240cc1e0 2024-04-26T20:58:33.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.564+0000 7f152b000640 1 -- 172.21.15.138:0/2325821993 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1524156d20 con 0x7f15240cc1e0 2024-04-26T20:58:33.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.564+0000 7f1520c00640 1 -- 172.21.15.138:0/2325821993 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f150c01a070 con 0x7f15240cc1e0 2024-04-26T20:58:33.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.568+0000 7f1520c00640 1 --2- 172.21.15.138:0/2325821993 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1500068380 0x7f150006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:33.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.568+0000 7f1520c00640 1 -- 172.21.15.138:0/2325821993 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6756+0+0 (secure 0 0 0) 0x7f150c087270 con 0x7f15240cc1e0 2024-04-26T20:58:33.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.568+0000 7f1523e00640 1 --2- 172.21.15.138:0/2325821993 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1500068380 0x7f150006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:33.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.568+0000 7f1523e00640 1 --2- 172.21.15.138:0/2325821993 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1500068380 0x7f150006a840 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f15140ad000 tx=0x7f15140a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:33.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.572+0000 7f1520c00640 1 -- 172.21.15.138:0/2325821993 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f150c057370 con 0x7f15240cc1e0 2024-04-26T20:58:33.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.728+0000 7f152b000640 1 -- 172.21.15.138:0/2325821993 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1524069510 con 0x7f15240cc1e0 2024-04-26T20:58:33.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.728+0000 7f1520c00640 1 -- 172.21.15.138:0/2325821993 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+19198 (secure 0 0 0) 0x7f150c05d030 con 0x7f15240cc1e0 2024-04-26T20:58:33.729 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:33.729 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":51,"fsid":"c22b4730-12cc-4558-8535-b965384398c0","created":"2024-04-26T20:56:14.182475+0000","modified":"2024-04-26T20:58:20.703295+0000","last_up_change":"2024-04-26T20:56:26.013243+0000","last_in_change":"2024-04-26T20:56:16.714055+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:56:27.265834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:57:49.597600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-26T20:57:50.901951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"recovery_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"recovery_fs_metadata","create_time":"2024-04-26T20:58:09.327192+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"recovery_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3f9a2e34-3199-466f-a6cf-57927318121e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6801","nonce":3534772245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6803","nonce":3534772245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6807","nonce":3534772245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6805","nonce":3534772245}]},"public_addr":"172.21.15.138:6801/3534772245","cluster_addr":"172.21.15.138:6803/3534772245","heartbeat_back_addr":"172.21.15.138:6807/3534772245","heartbeat_front_addr":"172.21.15.138:6805/3534772245","state":["exists","up"]},{"osd":1,"uuid":"e881fcf6-3248-4696-a2ef-95d206d77712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6817","nonce":1427635773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6819","nonce":1427635773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6823","nonce":1427635773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6821","nonce":1427635773}]},"public_addr":"172.21.15.138:6817/1427635773","cluster_addr":"172.21.15.138:6819/1427635773","heartbeat_back_addr":"172.21.15.138:6823/1427635773","heartbeat_front_addr":"172.21.15.138:6821/1427635773","state":["exists","up"]},{"osd":2,"uuid":"f7d1db33-7672-4699-ae47-9f1e0a8e4222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6809","nonce":4273721573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6811","nonce":4273721573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6815","nonce":4273721573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6813","nonce":4273721573}]},"public_addr":"172.21.15.138:6809/4273721573","cluster_addr":"172.21.15.138:6811/4273721573","heartbeat_back_addr":"172.21.15.138:6815/4273721573","heartbeat_front_addr":"172.21.15.138:6813/4273721573","state":["exists","up"]},{"osd":3,"uuid":"2f4e0a9a-b8f6-4468-844a-a4501cd85054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6825","nonce":3098242154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6827","nonce":3098242154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6831","nonce":3098242154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6829","nonce":3098242154}]},"public_addr":"172.21.15.138:6825/3098242154","cluster_addr":"172.21.15.138:6827/3098242154","heartbeat_back_addr":"172.21.15.138:6831/3098242154","heartbeat_front_addr":"172.21.15.138:6829/3098242154","state":["exists","up"]},{"osd":4,"uuid":"c85df99b-3624-410e-866b-86830af2cfe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6801","nonce":2942056312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6803","nonce":2942056312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6807","nonce":2942056312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6805","nonce":2942056312}]},"public_addr":"172.21.15.143:6801/2942056312","cluster_addr":"172.21.15.143:6803/2942056312","heartbeat_back_addr":"172.21.15.143:6807/2942056312","heartbeat_front_addr":"172.21.15.143:6805/2942056312","state":["exists","up"]},{"osd":5,"uuid":"9af1efb5-c416-4808-b5ef-de0679ab9705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6809","nonce":1910222887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6811","nonce":1910222887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6815","nonce":1910222887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6813","nonce":1910222887}]},"public_addr":"172.21.15.143:6809/1910222887","cluster_addr":"172.21.15.143:6811/1910222887","heartbeat_back_addr":"172.21.15.143:6815/1910222887","heartbeat_front_addr":"172.21.15.143:6813/1910222887","state":["exists","up"]},{"osd":6,"uuid":"d7138615-8838-45ff-9072-2fd0683362f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6817","nonce":1082239825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6819","nonce":1082239825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6823","nonce":1082239825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6821","nonce":1082239825}]},"public_addr":"172.21.15.143:6817/1082239825","cluster_addr":"172.21.15.143:6819/1082239825","heartbeat_back_addr":"172.21.15.143:6823/1082239825","heartbeat_front_addr":"172.21.15.143:6821/1082239825","state":["exists","up"]},{"osd":7,"uuid":"0c27172b-35c4-49ec-ba0b-0137b8ff0010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6825","nonce":3295508495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6827","nonce":3295508495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6831","nonce":3295508495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6829","nonce":3295508495}]},"public_addr":"172.21.15.143:6825/3295508495","cluster_addr":"172.21.15.143:6827/3295508495","heartbeat_back_addr":"172.21.15.143:6831/3295508495","heartbeat_front_addr":"172.21.15.143:6829/3295508495","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.326627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.396119+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.433915+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.414179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.216947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.329272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.503073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.436382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.d","mappings":[{"from":1,"to":2}]},{"pgid":"6.23","mappings":[{"from":3,"to":2}]},{"pgid":"6.2b","mappings":[{"from":4,"to":7}]},{"pgid":"6.30","mappings":[{"from":4,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.143:6836/483370849":"2024-04-27T20:58:07.183664+0000","172.21.15.143:6834/483370849":"2024-04-27T20:58:07.183664+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:58:33.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.728+0000 7f152b000640 1 -- 172.21.15.138:0/2325821993 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1500068380 msgr2=0x7f150006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:33.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.728+0000 7f152b000640 1 --2- 172.21.15.138:0/2325821993 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1500068380 0x7f150006a840 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f15140ad000 tx=0x7f15140a6000 comp rx=0 tx=0).stop 2024-04-26T20:58:33.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.728+0000 7f152b000640 1 -- 172.21.15.138:0/2325821993 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f15240cc1e0 msgr2=0x7f1524155dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:33.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.732+0000 7f152b000640 1 --2- 172.21.15.138:0/2325821993 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f15240cc1e0 0x7f1524155dd0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f150c00e960 tx=0x7f150c00ee20 comp rx=0 tx=0).stop 2024-04-26T20:58:33.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.732+0000 7f152b000640 1 -- 172.21.15.138:0/2325821993 shutdown_connections 2024-04-26T20:58:33.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.732+0000 7f152b000640 1 --2- 172.21.15.138:0/2325821993 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1500068380 0x7f150006a840 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:33.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.732+0000 7f152b000640 1 --2- 172.21.15.138:0/2325821993 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15240ce6f0 0x7f152415a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:33.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.732+0000 7f152b000640 1 --2- 172.21.15.138:0/2325821993 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f15240cc1e0 0x7f1524155dd0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:33.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.732+0000 7f152b000640 1 --2- 172.21.15.138:0/2325821993 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f15240cbe00 0x7f1524154b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:33.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.732+0000 7f152b000640 1 -- 172.21.15.138:0/2325821993 >> 172.21.15.138:0/2325821993 conn(0x7f15240d0b20 msgr2=0x7f15241685e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:33.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.732+0000 7f152b000640 1 -- 172.21.15.138:0/2325821993 shutdown_connections 2024-04-26T20:58:33.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.732+0000 7f152b000640 1 -- 172.21.15.138:0/2325821993 wait complete. 2024-04-26T20:58:33.750 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-26T20:58:33.751 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:58:33.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.884+0000 7f7535a00640 1 Processor -- start 2024-04-26T20:58:33.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.884+0000 7f7535a00640 1 -- start start 2024-04-26T20:58:33.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.888+0000 7f7535a00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f753015e0c0 0x7f7530071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:33.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.888+0000 7f7535a00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7530073b70 con 0x7f753015ce20 2024-04-26T20:58:33.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.888+0000 7f7535a00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7530073e10 con 0x7f75300cca00 2024-04-26T20:58:33.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.888+0000 7f7535a00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f75300740f0 con 0x7f753015e0c0 2024-04-26T20:58:33.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.888+0000 7f752ea00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f753015ce20 0x7f7530161340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:51764/0 (socket says 172.21.15.138:51764) 2024-04-26T20:58:33.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.888+0000 7f752ea00640 1 -- 172.21.15.138:0/87372855 learned_addr learned my addr 172.21.15.138:0/87372855 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:33.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.888+0000 7f752d600640 1 -- 172.21.15.138:0/87372855 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 889953372 0 0) 0x7f7530073b70 con 0x7f753015ce20 2024-04-26T20:58:33.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.888+0000 7f752d600640 1 -- 172.21.15.138:0/87372855 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7514003530 con 0x7f753015ce20 2024-04-26T20:58:33.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.888+0000 7f752e000640 1 --2- 172.21.15.138:0/87372855 >> v2:172.21.15.143:3300/0 conn(0x7f753015e0c0 0x7f7530071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:33.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.888+0000 7f752d600640 1 -- 172.21.15.138:0/87372855 <== mon.0 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2033395319 0 0) 0x7f7514003530 con 0x7f753015ce20 2024-04-26T20:58:33.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.888+0000 7f752d600640 1 -- 172.21.15.138:0/87372855 >> v2:172.21.15.143:3300/0 conn(0x7f753015e0c0 msgr2=0x7f7530071ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:33.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.888+0000 7f752d600640 1 --2- 172.21.15.138:0/87372855 >> v2:172.21.15.143:3300/0 conn(0x7f753015e0c0 0x7f7530071ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:33.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.888+0000 7f752d600640 1 -- 172.21.15.138:0/87372855 >> v1:172.21.15.143:6789/0 conn(0x7f75300cca00 legacy=0x7f75300cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:33.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.888+0000 7f752d600640 1 -- 172.21.15.138:0/87372855 --> v1:172.21.15.138:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7530160b40 con 0x7f753015ce20 2024-04-26T20:58:33.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.888+0000 7f752d600640 1 -- 172.21.15.138:0/87372855 <== mon.0 v1:172.21.15.138:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2715389689 0 0) 0x7f75200016a0 con 0x7f753015ce20 2024-04-26T20:58:33.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.888+0000 7f752d600640 1 -- 172.21.15.138:0/87372855 >> v1:172.21.15.138:6789/0 conn(0x7f753015ce20 legacy=0x7f7530161340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:33.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.888+0000 7f752d600640 1 --2- 172.21.15.138:0/87372855 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f75140039c0 0x7f7514003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:33.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.888+0000 7f752d600640 1 --2- 172.21.15.138:0/87372855 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7514004810 0x7f7514004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:33.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.888+0000 7f752d600640 1 --2- 172.21.15.138:0/87372855 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75140051d0 0x7f751400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:33.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.888+0000 7f752d600640 1 -- 172.21.15.138:0/87372855 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f75300740f0 con 0x7f75140051d0 2024-04-26T20:58:33.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.888+0000 7f752d600640 1 -- 172.21.15.138:0/87372855 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f751400c120 con 0x7f75140039c0 2024-04-26T20:58:33.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.888+0000 7f752d600640 1 -- 172.21.15.138:0/87372855 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f751400c320 con 0x7f7514004810 2024-04-26T20:58:33.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.888+0000 7f752f400640 1 --2- 172.21.15.138:0/87372855 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75140051d0 0x7f751400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:33.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.888+0000 7f752ea00640 1 --2- 172.21.15.138:0/87372855 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f75140039c0 0x7f7514003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:33.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.888+0000 7f752e000640 1 --2- 172.21.15.138:0/87372855 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7514004810 0x7f7514004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:33.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.888+0000 7f752f400640 1 -- 172.21.15.138:0/87372855 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7514004810 msgr2=0x7f7514004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:33.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.888+0000 7f752f400640 1 --2- 172.21.15.138:0/87372855 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7514004810 0x7f7514004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:33.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.888+0000 7f752f400640 1 -- 172.21.15.138:0/87372855 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f75140039c0 msgr2=0x7f7514003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:33.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.888+0000 7f752f400640 1 --2- 172.21.15.138:0/87372855 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f75140039c0 0x7f7514003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:33.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.888+0000 7f752f400640 1 -- 172.21.15.138:0/87372855 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7514003530 con 0x7f75140051d0 2024-04-26T20:58:33.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.892+0000 7f752f400640 1 -- 172.21.15.138:0/87372855 reap_dead start 2024-04-26T20:58:33.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.892+0000 7f752f400640 1 --2- 172.21.15.138:0/87372855 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75140051d0 0x7f751400b9d0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f7528001e70 tx=0x7f752801c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c91e9d68cd70c85 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:33.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.892+0000 7f752d600640 1 -- 172.21.15.138:0/87372855 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7528001a90 con 0x7f75140051d0 2024-04-26T20:58:33.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.892+0000 7f752d600640 1 -- 172.21.15.138:0/87372855 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7528003bc0 con 0x7f75140051d0 2024-04-26T20:58:33.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.892+0000 7f752d600640 1 -- 172.21.15.138:0/87372855 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7528005020 con 0x7f75140051d0 2024-04-26T20:58:33.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.892+0000 7f7535a00640 1 -- 172.21.15.138:0/87372855 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75140051d0 msgr2=0x7f751400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:33.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.892+0000 7f7535a00640 1 --2- 172.21.15.138:0/87372855 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75140051d0 0x7f751400b9d0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f7528001e70 tx=0x7f752801c780 comp rx=0 tx=0).stop 2024-04-26T20:58:33.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.892+0000 7f7535a00640 1 -- 172.21.15.138:0/87372855 shutdown_connections 2024-04-26T20:58:33.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.892+0000 7f7535a00640 1 --2- 172.21.15.138:0/87372855 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75140051d0 0x7f751400b9d0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:33.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.892+0000 7f7535a00640 1 -- 172.21.15.138:0/87372855 >> 172.21.15.138:0/87372855 conn(0x7f75300d0b20 msgr2=0x7f75300d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:33.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.892+0000 7f7535a00640 1 -- 172.21.15.138:0/87372855 shutdown_connections 2024-04-26T20:58:33.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.892+0000 7f7535a00640 1 -- 172.21.15.138:0/87372855 wait complete. 2024-04-26T20:58:33.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.892+0000 7f7535a00640 1 Processor -- start 2024-04-26T20:58:33.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.896+0000 7f7535a00640 1 -- start start 2024-04-26T20:58:33.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.896+0000 7f7535a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75140051d0 0x7f753014a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:33.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.896+0000 7f7535a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f75300d0520 0x7f7530157d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:33.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.896+0000 7f7535a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75300b56b0 0x7f7530158270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:33.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.896+0000 7f7535a00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f753015d200 con 0x7f75140051d0 2024-04-26T20:58:33.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.896+0000 7f7535a00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f75300739d0 con 0x7f75300d0520 2024-04-26T20:58:33.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.896+0000 7f7535a00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f753015d380 con 0x7f75300b56b0 2024-04-26T20:58:33.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.896+0000 7f752ea00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75140051d0 0x7f753014a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:33.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.896+0000 7f752ea00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75140051d0 0x7f753014a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:60920/0 (socket says 172.21.15.138:60920) 2024-04-26T20:58:33.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.896+0000 7f752ea00640 1 -- 172.21.15.138:0/2977616244 learned_addr learned my addr 172.21.15.138:0/2977616244 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:33.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.896+0000 7f752f400640 1 --2- 172.21.15.138:0/2977616244 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75300b56b0 0x7f7530158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:33.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.896+0000 7f752e000640 1 --2- 172.21.15.138:0/2977616244 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f75300d0520 0x7f7530157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:33.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.896+0000 7f752ea00640 1 -- 172.21.15.138:0/2977616244 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75300b56b0 msgr2=0x7f7530158270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:33.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.896+0000 7f752ea00640 1 --2- 172.21.15.138:0/2977616244 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75300b56b0 0x7f7530158270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:33.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.896+0000 7f752ea00640 1 -- 172.21.15.138:0/2977616244 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f75300d0520 msgr2=0x7f7530157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:33.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.896+0000 7f752ea00640 1 --2- 172.21.15.138:0/2977616244 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f75300d0520 0x7f7530157d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:33.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.896+0000 7f752ea00640 1 -- 172.21.15.138:0/2977616244 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75300b4b00 con 0x7f75140051d0 2024-04-26T20:58:33.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.896+0000 7f752e000640 1 --2- 172.21.15.138:0/2977616244 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f75300d0520 0x7f7530157d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:58:33.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.896+0000 7f752ea00640 1 --2- 172.21.15.138:0/2977616244 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75140051d0 0x7f753014a260 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f75200072f0 tx=0x7f75200076f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:33.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.896+0000 7f7526a00640 1 -- 172.21.15.138:0/2977616244 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752000f9c0 con 0x7f75140051d0 2024-04-26T20:58:33.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.896+0000 7f7526a00640 1 -- 172.21.15.138:0/2977616244 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7520018070 con 0x7f75140051d0 2024-04-26T20:58:33.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.896+0000 7f7535a00640 1 -- 172.21.15.138:0/2977616244 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75300b4de0 con 0x7f75140051d0 2024-04-26T20:58:33.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.896+0000 7f7526a00640 1 -- 172.21.15.138:0/2977616244 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752000fde0 con 0x7f75140051d0 2024-04-26T20:58:33.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.896+0000 7f7535a00640 1 -- 172.21.15.138:0/2977616244 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75300b62c0 con 0x7f75140051d0 2024-04-26T20:58:33.900 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.896+0000 7f7535a00640 1 -- 172.21.15.138:0/2977616244 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7530069510 con 0x7f75140051d0 2024-04-26T20:58:33.900 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.900+0000 7f7526a00640 1 -- 172.21.15.138:0/2977616244 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f752001d460 con 0x7f75140051d0 2024-04-26T20:58:33.900 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.900+0000 7f7526a00640 1 --2- 172.21.15.138:0/2977616244 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7510068380 0x7f751006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:33.900 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.900+0000 7f7526a00640 1 -- 172.21.15.138:0/2977616244 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6756+0+0 (secure 0 0 0) 0x7f7520086f20 con 0x7f75140051d0 2024-04-26T20:58:33.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.900+0000 7f752e000640 1 --2- 172.21.15.138:0/2977616244 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7510068380 0x7f751006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:33.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.900+0000 7f752e000640 1 --2- 172.21.15.138:0/2977616244 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7510068380 0x7f751006a840 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f75300c6f70 tx=0x7f751c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:33.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:33.904+0000 7f7526a00640 1 -- 172.21.15.138:0/2977616244 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f75200570b0 con 0x7f75140051d0 2024-04-26T20:58:34.095 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.092+0000 7f7535a00640 1 -- 172.21.15.138:0/2977616244 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f75300cb150 con 0x7f75140051d0 2024-04-26T20:58:34.095 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.096+0000 7f7526a00640 1 -- 172.21.15.138:0/2977616244 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+6489 (secure 0 0 0) 0x7f75200569b0 con 0x7f75140051d0 2024-04-26T20:58:34.096 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:34.096 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":28,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5048,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/255610168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":255610168},{"type":"v1","addr":"172.21.15.143:6836","nonce":255610168}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5051,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/799063831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":799063831},{"type":"v1","addr":"172.21.15.143:6837","nonce":799063831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5410,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/976248149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":976248149},{"type":"v1","addr":"172.21.15.138:6835","nonce":976248149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:57:51.937789+0000","modified":"2024-04-26T20:58:07.183899+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":42,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2},{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:58:10.360154+0000","modified":"2024-04-26T20:58:24.737160+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5604":{"gid":5604,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.138:6834/2450256246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2450256246},{"type":"v1","addr":"172.21.15.138:6834","nonce":2450256246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":7,"enabled":true,"fs_name":"recovery_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5604,"qdb_cluster":[5604]},"id":3}]} 2024-04-26T20:58:34.096 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 28 2024-04-26T20:58:34.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.096+0000 7f7535a00640 1 -- 172.21.15.138:0/2977616244 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7510068380 msgr2=0x7f751006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:34.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.096+0000 7f7535a00640 1 --2- 172.21.15.138:0/2977616244 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7510068380 0x7f751006a840 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f75300c6f70 tx=0x7f751c008040 comp rx=0 tx=0).stop 2024-04-26T20:58:34.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.096+0000 7f7535a00640 1 -- 172.21.15.138:0/2977616244 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75140051d0 msgr2=0x7f753014a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:34.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.096+0000 7f7535a00640 1 --2- 172.21.15.138:0/2977616244 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75140051d0 0x7f753014a260 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f75200072f0 tx=0x7f75200076f0 comp rx=0 tx=0).stop 2024-04-26T20:58:34.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.096+0000 7f7535a00640 1 -- 172.21.15.138:0/2977616244 shutdown_connections 2024-04-26T20:58:34.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.096+0000 7f7535a00640 1 --2- 172.21.15.138:0/2977616244 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7510068380 0x7f751006a840 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:34.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.096+0000 7f7535a00640 1 --2- 172.21.15.138:0/2977616244 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75300b56b0 0x7f7530158270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:34.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.096+0000 7f7535a00640 1 --2- 172.21.15.138:0/2977616244 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f75300d0520 0x7f7530157d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:34.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.096+0000 7f7535a00640 1 --2- 172.21.15.138:0/2977616244 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75140051d0 0x7f753014a260 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:34.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.096+0000 7f7535a00640 1 -- 172.21.15.138:0/2977616244 >> 172.21.15.138:0/2977616244 conn(0x7f75300d0b20 msgr2=0x7f753015d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:34.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.096+0000 7f7535a00640 1 -- 172.21.15.138:0/2977616244 shutdown_connections 2024-04-26T20:58:34.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.096+0000 7f7535a00640 1 -- 172.21.15.138:0/2977616244 wait complete. 2024-04-26T20:58:34.117 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:58:34.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.252+0000 7f50a4000640 1 Processor -- start 2024-04-26T20:58:34.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.252+0000 7f50a4000640 1 -- start start 2024-04-26T20:58:34.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.252+0000 7f50a4000640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f509c0cbe00 0x7f509c06de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:34.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.252+0000 7f50a4000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f509c15cf80 0x7f509c0ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:34.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.252+0000 7f50a4000640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f509c0727f0 con 0x7f509c0cc1e0 2024-04-26T20:58:34.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.252+0000 7f50a4000640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f509c074220 con 0x7f509c15cf80 2024-04-26T20:58:34.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.252+0000 7f50a4000640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f509c073680 con 0x7f509c0cbe00 2024-04-26T20:58:34.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.252+0000 7f50a0c00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f509c0cc1e0 0x7f509c073b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:51766/0 (socket says 172.21.15.138:51766) 2024-04-26T20:58:34.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.252+0000 7f50a0c00640 1 -- 172.21.15.138:0/1064256183 learned_addr learned my addr 172.21.15.138:0/1064256183 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:34.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.252+0000 7f50a2000640 1 --2- 172.21.15.138:0/1064256183 >> v2:172.21.15.138:3300/0 conn(0x7f509c15cf80 0x7f509c0ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:34.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.252+0000 7f50a1600640 1 --2- 172.21.15.138:0/1064256183 >> v2:172.21.15.143:3300/0 conn(0x7f509c0cbe00 0x7f509c06de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:34.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.252+0000 7f509be00640 1 -- 172.21.15.138:0/1064256183 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1407815744 0 0) 0x7f5088001120 con 0x7f509c0cc1e0 2024-04-26T20:58:34.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.252+0000 7f509be00640 1 -- 172.21.15.138:0/1064256183 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5084003530 con 0x7f509c0cc1e0 2024-04-26T20:58:34.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.252+0000 7f50a2000640 1 -- 172.21.15.138:0/1064256183 >> v2:172.21.15.143:3300/0 conn(0x7f509c0cbe00 msgr2=0x7f509c06de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:34.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.252+0000 7f50a2000640 1 --2- 172.21.15.138:0/1064256183 >> v2:172.21.15.143:3300/0 conn(0x7f509c0cbe00 0x7f509c06de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:34.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.252+0000 7f50a2000640 1 -- 172.21.15.138:0/1064256183 >> v1:172.21.15.138:6789/0 conn(0x7f509c0cc1e0 legacy=0x7f509c073b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:34.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.252+0000 7f50a2000640 1 -- 172.21.15.138:0/1064256183 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f509c072a70 con 0x7f509c15cf80 2024-04-26T20:58:34.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.256+0000 7f50a2000640 1 --2- 172.21.15.138:0/1064256183 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f509c15cf80 0x7f509c0ce6f0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f509c074a70 tx=0x7f509401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1055f74136600e32 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:34.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.256+0000 7f509be00640 1 -- 172.21.15.138:0/1064256183 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50940b0070 con 0x7f509c15cf80 2024-04-26T20:58:34.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.256+0000 7f509be00640 1 -- 172.21.15.138:0/1064256183 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50940ab600 con 0x7f509c15cf80 2024-04-26T20:58:34.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.256+0000 7f509be00640 1 -- 172.21.15.138:0/1064256183 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50940ab9d0 con 0x7f509c15cf80 2024-04-26T20:58:34.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.256+0000 7f50a4000640 1 -- 172.21.15.138:0/1064256183 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f509c15cf80 msgr2=0x7f509c0ce6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:34.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.256+0000 7f50a4000640 1 --2- 172.21.15.138:0/1064256183 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f509c15cf80 0x7f509c0ce6f0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f509c074a70 tx=0x7f509401c480 comp rx=0 tx=0).stop 2024-04-26T20:58:34.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.256+0000 7f50a4000640 1 -- 172.21.15.138:0/1064256183 shutdown_connections 2024-04-26T20:58:34.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.256+0000 7f50a4000640 1 --2- 172.21.15.138:0/1064256183 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f509c15cf80 0x7f509c0ce6f0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:34.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.256+0000 7f50a4000640 1 --2- 172.21.15.138:0/1064256183 >> v2:172.21.15.143:3300/0 conn(0x7f509c0cbe00 0x7f509c06de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:34.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.256+0000 7f50a4000640 1 -- 172.21.15.138:0/1064256183 >> 172.21.15.138:0/1064256183 conn(0x7f509c0d0b20 msgr2=0x7f509c0d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:34.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.256+0000 7f50a4000640 1 -- 172.21.15.138:0/1064256183 shutdown_connections 2024-04-26T20:58:34.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.256+0000 7f50a4000640 1 -- 172.21.15.138:0/1064256183 wait complete. 2024-04-26T20:58:34.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.260+0000 7f50a4000640 1 Processor -- start 2024-04-26T20:58:34.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.260+0000 7f50a4000640 1 -- start start 2024-04-26T20:58:34.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.260+0000 7f50a4000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f509c0cbe00 0x7f509c0c6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:34.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.260+0000 7f50a4000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f509c0cc1e0 0x7f509c0c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:34.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.260+0000 7f50a4000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f509c15cf80 0x7f509c0c9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:34.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.260+0000 7f50a4000640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f509c06e3b0 con 0x7f509c15cf80 2024-04-26T20:58:34.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.260+0000 7f50a4000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f509c0cf040 con 0x7f509c0cc1e0 2024-04-26T20:58:34.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.260+0000 7f50a4000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f509c06e530 con 0x7f509c0cbe00 2024-04-26T20:58:34.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.260+0000 7f50a2000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f509c15cf80 0x7f509c0c9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:34.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.260+0000 7f50a2000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f509c15cf80 0x7f509c0c9b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:60932/0 (socket says 172.21.15.138:60932) 2024-04-26T20:58:34.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.260+0000 7f50a2000640 1 -- 172.21.15.138:0/1068841322 learned_addr learned my addr 172.21.15.138:0/1068841322 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:34.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.260+0000 7f50a1600640 1 --2- 172.21.15.138:0/1068841322 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f509c0cbe00 0x7f509c0c6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:34.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.260+0000 7f50a0c00640 1 --2- 172.21.15.138:0/1068841322 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f509c0cc1e0 0x7f509c0c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:34.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.260+0000 7f50a2000640 1 -- 172.21.15.138:0/1068841322 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f509c0cbe00 msgr2=0x7f509c0c6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:34.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.260+0000 7f50a2000640 1 --2- 172.21.15.138:0/1068841322 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f509c0cbe00 0x7f509c0c6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:34.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.260+0000 7f50a2000640 1 -- 172.21.15.138:0/1068841322 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f509c0cc1e0 msgr2=0x7f509c0c85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:34.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.260+0000 7f50a2000640 1 --2- 172.21.15.138:0/1068841322 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f509c0cc1e0 0x7f509c0c85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:34.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.260+0000 7f50a2000640 1 -- 172.21.15.138:0/1068841322 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f509c0c8f50 con 0x7f509c15cf80 2024-04-26T20:58:34.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.260+0000 7f50a2000640 1 --2- 172.21.15.138:0/1068841322 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f509c15cf80 0x7f509c0c9b70 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f50940ae040 tx=0x7f5094019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:34.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.260+0000 7f5099600640 1 -- 172.21.15.138:0/1068841322 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50940b0040 con 0x7f509c15cf80 2024-04-26T20:58:34.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.260+0000 7f5099600640 1 -- 172.21.15.138:0/1068841322 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50940b9070 con 0x7f509c15cf80 2024-04-26T20:58:34.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.260+0000 7f50a4000640 1 -- 172.21.15.138:0/1068841322 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f509c0c9230 con 0x7f509c15cf80 2024-04-26T20:58:34.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.260+0000 7f5099600640 1 -- 172.21.15.138:0/1068841322 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50940b4650 con 0x7f509c15cf80 2024-04-26T20:58:34.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.260+0000 7f50a4000640 1 -- 172.21.15.138:0/1068841322 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f509c156c10 con 0x7f509c15cf80 2024-04-26T20:58:34.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.264+0000 7f50a4000640 1 -- 172.21.15.138:0/1068841322 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f509c069510 con 0x7f509c15cf80 2024-04-26T20:58:34.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.264+0000 7f5099600640 1 -- 172.21.15.138:0/1068841322 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f50940b47f0 con 0x7f509c15cf80 2024-04-26T20:58:34.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.264+0000 7f5099600640 1 --2- 172.21.15.138:0/1068841322 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f507c068380 0x7f507c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:34.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.264+0000 7f5099600640 1 -- 172.21.15.138:0/1068841322 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6756+0+0 (secure 0 0 0) 0x7f5094120860 con 0x7f509c15cf80 2024-04-26T20:58:34.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.264+0000 7f50a1600640 1 --2- 172.21.15.138:0/1068841322 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f507c068380 0x7f507c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:34.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.264+0000 7f50a1600640 1 --2- 172.21.15.138:0/1068841322 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f507c068380 0x7f507c06a840 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f509c0b26e0 tx=0x7f50900098d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:34.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.268+0000 7f5099600640 1 -- 172.21.15.138:0/1068841322 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5094016070 con 0x7f509c15cf80 2024-04-26T20:58:34.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.455+0000 7f50a4000640 1 -- 172.21.15.138:0/1068841322 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f509c156de0 con 0x7f509c15cf80 2024-04-26T20:58:34.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.455+0000 7f5099600640 1 -- 172.21.15.138:0/1068841322 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+6489 (secure 0 0 0) 0x7f50940f03b0 con 0x7f509c15cf80 2024-04-26T20:58:34.458 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:34.458 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":28,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5048,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/255610168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":255610168},{"type":"v1","addr":"172.21.15.143:6836","nonce":255610168}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5051,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/799063831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":799063831},{"type":"v1","addr":"172.21.15.143:6837","nonce":799063831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5410,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/976248149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":976248149},{"type":"v1","addr":"172.21.15.138:6835","nonce":976248149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:57:51.937789+0000","modified":"2024-04-26T20:58:07.183899+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":42,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2},{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:58:10.360154+0000","modified":"2024-04-26T20:58:24.737160+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5604":{"gid":5604,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.138:6834/2450256246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2450256246},{"type":"v1","addr":"172.21.15.138:6834","nonce":2450256246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":7,"enabled":true,"fs_name":"recovery_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5604,"qdb_cluster":[5604]},"id":3}]} 2024-04-26T20:58:34.458 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 28 2024-04-26T20:58:34.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.459+0000 7f50a4000640 1 -- 172.21.15.138:0/1068841322 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f507c068380 msgr2=0x7f507c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:34.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.459+0000 7f50a4000640 1 --2- 172.21.15.138:0/1068841322 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f507c068380 0x7f507c06a840 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f509c0b26e0 tx=0x7f50900098d0 comp rx=0 tx=0).stop 2024-04-26T20:58:34.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.459+0000 7f50a4000640 1 -- 172.21.15.138:0/1068841322 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f509c15cf80 msgr2=0x7f509c0c9b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:34.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.459+0000 7f50a4000640 1 --2- 172.21.15.138:0/1068841322 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f509c15cf80 0x7f509c0c9b70 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f50940ae040 tx=0x7f5094019220 comp rx=0 tx=0).stop 2024-04-26T20:58:34.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.459+0000 7f50a4000640 1 -- 172.21.15.138:0/1068841322 shutdown_connections 2024-04-26T20:58:34.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.459+0000 7f50a4000640 1 --2- 172.21.15.138:0/1068841322 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f507c068380 0x7f507c06a840 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:34.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.459+0000 7f50a4000640 1 --2- 172.21.15.138:0/1068841322 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f509c15cf80 0x7f509c0c9b70 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:34.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.459+0000 7f50a4000640 1 --2- 172.21.15.138:0/1068841322 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f509c0cc1e0 0x7f509c0c85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:34.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.459+0000 7f50a4000640 1 --2- 172.21.15.138:0/1068841322 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f509c0cbe00 0x7f509c0c6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:34.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.459+0000 7f50a4000640 1 -- 172.21.15.138:0/1068841322 >> 172.21.15.138:0/1068841322 conn(0x7f509c0d0b20 msgr2=0x7f509c1679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:34.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.459+0000 7f50a4000640 1 -- 172.21.15.138:0/1068841322 shutdown_connections 2024-04-26T20:58:34.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.459+0000 7f50a4000640 1 -- 172.21.15.138:0/1068841322 wait complete. 2024-04-26T20:58:34.479 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:58:34.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.611+0000 7f5d82c00640 1 Processor -- start 2024-04-26T20:58:34.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.611+0000 7f5d82c00640 1 -- start start 2024-04-26T20:58:34.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.615+0000 7f5d82c00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f5d7c15ce20 0x7f5d7c161340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:34.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.615+0000 7f5d82c00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d7c073b70 con 0x7f5d7c0cca00 2024-04-26T20:58:34.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.615+0000 7f5d82c00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d7c073e10 con 0x7f5d7c15e0c0 2024-04-26T20:58:34.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.615+0000 7f5d82c00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f5d7c0740f0 con 0x7f5d7c15ce20 2024-04-26T20:58:34.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.615+0000 7f5d7be00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f5d7c15ce20 0x7f5d7c161340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:34.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.615+0000 7f5d80c00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f5d7c0cca00 0x7f5d7c0cce20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:51774/0 (socket says 172.21.15.138:51774) 2024-04-26T20:58:34.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.615+0000 7f5d80c00640 1 -- 172.21.15.138:0/1698528917 learned_addr learned my addr 172.21.15.138:0/1698528917 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:34.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.615+0000 7f5d7be00640 1 -- 172.21.15.138:0/1698528917 >> v1:172.21.15.143:6789/0 conn(0x7f5d7c15e0c0 legacy=0x7f5d7c071ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:34.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.615+0000 7f5d7be00640 1 -- 172.21.15.138:0/1698528917 >> v1:172.21.15.138:6789/0 conn(0x7f5d7c0cca00 legacy=0x7f5d7c0cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:34.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.615+0000 7f5d7be00640 1 -- 172.21.15.138:0/1698528917 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d7c160b40 con 0x7f5d7c15ce20 2024-04-26T20:58:34.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.615+0000 7f5d7be00640 1 --2- 172.21.15.138:0/1698528917 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d7c15ce20 0x7f5d7c161340 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c009d90 tx=0x7f5d6c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60d6c620657950d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:34.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.619+0000 7f5d7aa00640 1 -- 172.21.15.138:0/1698528917 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c0b2070 con 0x7f5d7c15ce20 2024-04-26T20:58:34.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.619+0000 7f5d7aa00640 1 -- 172.21.15.138:0/1698528917 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d6c0a5940 con 0x7f5d7c15ce20 2024-04-26T20:58:34.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.619+0000 7f5d7aa00640 1 -- 172.21.15.138:0/1698528917 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c0a5d10 con 0x7f5d7c15ce20 2024-04-26T20:58:34.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.619+0000 7f5d82c00640 1 -- 172.21.15.138:0/1698528917 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d7c15ce20 msgr2=0x7f5d7c161340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:34.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.619+0000 7f5d82c00640 1 --2- 172.21.15.138:0/1698528917 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d7c15ce20 0x7f5d7c161340 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c009d90 tx=0x7f5d6c01c970 comp rx=0 tx=0).stop 2024-04-26T20:58:34.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.619+0000 7f5d82c00640 1 -- 172.21.15.138:0/1698528917 shutdown_connections 2024-04-26T20:58:34.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.619+0000 7f5d82c00640 1 --2- 172.21.15.138:0/1698528917 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d7c15ce20 0x7f5d7c161340 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:34.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.619+0000 7f5d82c00640 1 -- 172.21.15.138:0/1698528917 >> 172.21.15.138:0/1698528917 conn(0x7f5d7c0d0b20 msgr2=0x7f5d7c0d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:34.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.619+0000 7f5d82c00640 1 -- 172.21.15.138:0/1698528917 shutdown_connections 2024-04-26T20:58:34.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.619+0000 7f5d82c00640 1 -- 172.21.15.138:0/1698528917 wait complete. 2024-04-26T20:58:34.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.619+0000 7f5d82c00640 1 Processor -- start 2024-04-26T20:58:34.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.619+0000 7f5d82c00640 1 -- start start 2024-04-26T20:58:34.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.619+0000 7f5d82c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5d7c0cca00 0x7f5d7c151ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:34.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.619+0000 7f5d82c00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d7c15ce20 0x7f5d7c0ad350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:34.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.619+0000 7f5d82c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5d7c15e0c0 0x7f5d7c0c64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:34.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.619+0000 7f5d82c00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f5d7c06e800 con 0x7f5d7c15ce20 2024-04-26T20:58:34.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.619+0000 7f5d82c00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f5d7c06e680 con 0x7f5d7c0cca00 2024-04-26T20:58:34.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.619+0000 7f5d82c00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f5d7c16ae50 con 0x7f5d7c15e0c0 2024-04-26T20:58:34.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.619+0000 7f5d7b400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d7c15ce20 0x7f5d7c0ad350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:34.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.619+0000 7f5d7b400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d7c15ce20 0x7f5d7c0ad350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:60942/0 (socket says 172.21.15.138:60942) 2024-04-26T20:58:34.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.619+0000 7f5d7b400640 1 -- 172.21.15.138:0/2835859295 learned_addr learned my addr 172.21.15.138:0/2835859295 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:34.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.619+0000 7f5d7be00640 1 --2- 172.21.15.138:0/2835859295 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5d7c0cca00 0x7f5d7c151ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:34.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.623+0000 7f5d80c00640 1 --2- 172.21.15.138:0/2835859295 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5d7c15e0c0 0x7f5d7c0c64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:34.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.623+0000 7f5d7b400640 1 -- 172.21.15.138:0/2835859295 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5d7c15e0c0 msgr2=0x7f5d7c0c64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:34.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.623+0000 7f5d7b400640 1 --2- 172.21.15.138:0/2835859295 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5d7c15e0c0 0x7f5d7c0c64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:34.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.623+0000 7f5d7b400640 1 -- 172.21.15.138:0/2835859295 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5d7c0cca00 msgr2=0x7f5d7c151ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:34.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.623+0000 7f5d7b400640 1 --2- 172.21.15.138:0/2835859295 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5d7c0cca00 0x7f5d7c151ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:34.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.623+0000 7f5d7b400640 1 -- 172.21.15.138:0/2835859295 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d7c0ce530 con 0x7f5d7c15ce20 2024-04-26T20:58:34.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.623+0000 7f5d7b400640 1 --2- 172.21.15.138:0/2835859295 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d7c15ce20 0x7f5d7c0ad350 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f5d6400c370 tx=0x7f5d6400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:34.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.623+0000 7f5d73e00640 1 -- 172.21.15.138:0/2835859295 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d640052d0 con 0x7f5d7c15ce20 2024-04-26T20:58:34.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.623+0000 7f5d73e00640 1 -- 172.21.15.138:0/2835859295 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d64005470 con 0x7f5d7c15ce20 2024-04-26T20:58:34.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.623+0000 7f5d73e00640 1 -- 172.21.15.138:0/2835859295 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d64007260 con 0x7f5d7c15ce20 2024-04-26T20:58:34.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.623+0000 7f5d82c00640 1 -- 172.21.15.138:0/2835859295 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d7c0ce810 con 0x7f5d7c15ce20 2024-04-26T20:58:34.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.623+0000 7f5d82c00640 1 -- 172.21.15.138:0/2835859295 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d7c0ad890 con 0x7f5d7c15ce20 2024-04-26T20:58:34.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.623+0000 7f5d82c00640 1 -- 172.21.15.138:0/2835859295 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d7c069510 con 0x7f5d7c15ce20 2024-04-26T20:58:34.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.623+0000 7f5d73e00640 1 -- 172.21.15.138:0/2835859295 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5d64007400 con 0x7f5d7c15ce20 2024-04-26T20:58:34.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.623+0000 7f5d73e00640 1 --2- 172.21.15.138:0/2835859295 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5d58068400 0x7f5d5806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:34.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.623+0000 7f5d73e00640 1 -- 172.21.15.138:0/2835859295 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6756+0+0 (secure 0 0 0) 0x7f5d64086250 con 0x7f5d7c15ce20 2024-04-26T20:58:34.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.627+0000 7f5d7be00640 1 --2- 172.21.15.138:0/2835859295 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5d58068400 0x7f5d5806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:34.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.627+0000 7f5d7be00640 1 --2- 172.21.15.138:0/2835859295 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5d58068400 0x7f5d5806a8c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c0af000 tx=0x7f5d6c0a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:34.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.627+0000 7f5d73e00640 1 -- 172.21.15.138:0/2835859295 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5d64055cf0 con 0x7f5d7c15ce20 2024-04-26T20:58:34.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.795+0000 7f5d82c00640 1 -- 172.21.15.138:0/2835859295 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5d7c075cf0 con 0x7f5d7c15ce20 2024-04-26T20:58:34.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.795+0000 7f5d73e00640 1 -- 172.21.15.138:0/2835859295 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+19198 (secure 0 0 0) 0x7f5d64059ff0 con 0x7f5d7c15ce20 2024-04-26T20:58:34.797 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:34.798 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":51,"fsid":"c22b4730-12cc-4558-8535-b965384398c0","created":"2024-04-26T20:56:14.182475+0000","modified":"2024-04-26T20:58:20.703295+0000","last_up_change":"2024-04-26T20:56:26.013243+0000","last_in_change":"2024-04-26T20:56:16.714055+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:56:27.265834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:57:49.597600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-26T20:57:50.901951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"recovery_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"recovery_fs_metadata","create_time":"2024-04-26T20:58:09.327192+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"recovery_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3f9a2e34-3199-466f-a6cf-57927318121e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6801","nonce":3534772245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6803","nonce":3534772245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6807","nonce":3534772245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6805","nonce":3534772245}]},"public_addr":"172.21.15.138:6801/3534772245","cluster_addr":"172.21.15.138:6803/3534772245","heartbeat_back_addr":"172.21.15.138:6807/3534772245","heartbeat_front_addr":"172.21.15.138:6805/3534772245","state":["exists","up"]},{"osd":1,"uuid":"e881fcf6-3248-4696-a2ef-95d206d77712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6817","nonce":1427635773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6819","nonce":1427635773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6823","nonce":1427635773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6821","nonce":1427635773}]},"public_addr":"172.21.15.138:6817/1427635773","cluster_addr":"172.21.15.138:6819/1427635773","heartbeat_back_addr":"172.21.15.138:6823/1427635773","heartbeat_front_addr":"172.21.15.138:6821/1427635773","state":["exists","up"]},{"osd":2,"uuid":"f7d1db33-7672-4699-ae47-9f1e0a8e4222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6809","nonce":4273721573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6811","nonce":4273721573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6815","nonce":4273721573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6813","nonce":4273721573}]},"public_addr":"172.21.15.138:6809/4273721573","cluster_addr":"172.21.15.138:6811/4273721573","heartbeat_back_addr":"172.21.15.138:6815/4273721573","heartbeat_front_addr":"172.21.15.138:6813/4273721573","state":["exists","up"]},{"osd":3,"uuid":"2f4e0a9a-b8f6-4468-844a-a4501cd85054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6825","nonce":3098242154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6827","nonce":3098242154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6831","nonce":3098242154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6829","nonce":3098242154}]},"public_addr":"172.21.15.138:6825/3098242154","cluster_addr":"172.21.15.138:6827/3098242154","heartbeat_back_addr":"172.21.15.138:6831/3098242154","heartbeat_front_addr":"172.21.15.138:6829/3098242154","state":["exists","up"]},{"osd":4,"uuid":"c85df99b-3624-410e-866b-86830af2cfe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6801","nonce":2942056312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6803","nonce":2942056312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6807","nonce":2942056312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6805","nonce":2942056312}]},"public_addr":"172.21.15.143:6801/2942056312","cluster_addr":"172.21.15.143:6803/2942056312","heartbeat_back_addr":"172.21.15.143:6807/2942056312","heartbeat_front_addr":"172.21.15.143:6805/2942056312","state":["exists","up"]},{"osd":5,"uuid":"9af1efb5-c416-4808-b5ef-de0679ab9705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6809","nonce":1910222887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6811","nonce":1910222887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6815","nonce":1910222887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6813","nonce":1910222887}]},"public_addr":"172.21.15.143:6809/1910222887","cluster_addr":"172.21.15.143:6811/1910222887","heartbeat_back_addr":"172.21.15.143:6815/1910222887","heartbeat_front_addr":"172.21.15.143:6813/1910222887","state":["exists","up"]},{"osd":6,"uuid":"d7138615-8838-45ff-9072-2fd0683362f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6817","nonce":1082239825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6819","nonce":1082239825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6823","nonce":1082239825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6821","nonce":1082239825}]},"public_addr":"172.21.15.143:6817/1082239825","cluster_addr":"172.21.15.143:6819/1082239825","heartbeat_back_addr":"172.21.15.143:6823/1082239825","heartbeat_front_addr":"172.21.15.143:6821/1082239825","state":["exists","up"]},{"osd":7,"uuid":"0c27172b-35c4-49ec-ba0b-0137b8ff0010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6825","nonce":3295508495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6827","nonce":3295508495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6831","nonce":3295508495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6829","nonce":3295508495}]},"public_addr":"172.21.15.143:6825/3295508495","cluster_addr":"172.21.15.143:6827/3295508495","heartbeat_back_addr":"172.21.15.143:6831/3295508495","heartbeat_front_addr":"172.21.15.143:6829/3295508495","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.326627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.396119+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.433915+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.414179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.216947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.329272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.503073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.436382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.d","mappings":[{"from":1,"to":2}]},{"pgid":"6.23","mappings":[{"from":3,"to":2}]},{"pgid":"6.2b","mappings":[{"from":4,"to":7}]},{"pgid":"6.30","mappings":[{"from":4,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.143:6836/483370849":"2024-04-27T20:58:07.183664+0000","172.21.15.143:6834/483370849":"2024-04-27T20:58:07.183664+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:58:34.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.799+0000 7f5d82c00640 1 -- 172.21.15.138:0/2835859295 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5d58068400 msgr2=0x7f5d5806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:34.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.799+0000 7f5d82c00640 1 --2- 172.21.15.138:0/2835859295 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5d58068400 0x7f5d5806a8c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c0af000 tx=0x7f5d6c0a7070 comp rx=0 tx=0).stop 2024-04-26T20:58:34.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.799+0000 7f5d82c00640 1 -- 172.21.15.138:0/2835859295 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d7c15ce20 msgr2=0x7f5d7c0ad350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:34.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.799+0000 7f5d82c00640 1 --2- 172.21.15.138:0/2835859295 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d7c15ce20 0x7f5d7c0ad350 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f5d6400c370 tx=0x7f5d6400c830 comp rx=0 tx=0).stop 2024-04-26T20:58:34.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.799+0000 7f5d82c00640 1 -- 172.21.15.138:0/2835859295 shutdown_connections 2024-04-26T20:58:34.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.799+0000 7f5d82c00640 1 --2- 172.21.15.138:0/2835859295 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5d58068400 0x7f5d5806a8c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:34.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.799+0000 7f5d82c00640 1 --2- 172.21.15.138:0/2835859295 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5d7c15e0c0 0x7f5d7c0c64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:34.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.799+0000 7f5d82c00640 1 --2- 172.21.15.138:0/2835859295 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d7c15ce20 0x7f5d7c0ad350 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:34.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.799+0000 7f5d82c00640 1 --2- 172.21.15.138:0/2835859295 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5d7c0cca00 0x7f5d7c151ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:34.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.799+0000 7f5d82c00640 1 -- 172.21.15.138:0/2835859295 >> 172.21.15.138:0/2835859295 conn(0x7f5d7c0d0b20 msgr2=0x7f5d7c0b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:34.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.799+0000 7f5d82c00640 1 -- 172.21.15.138:0/2835859295 shutdown_connections 2024-04-26T20:58:34.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.799+0000 7f5d82c00640 1 -- 172.21.15.138:0/2835859295 wait complete. 2024-04-26T20:58:34.819 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-26T20:58:34.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.955+0000 7f27f6600640 1 Processor -- start 2024-04-26T20:58:34.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.955+0000 7f27f6600640 1 -- start start 2024-04-26T20:58:34.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.955+0000 7f27f6600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f27f00cb1b0 0x7f27f00cb590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:34.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.955+0000 7f27f6600640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f27f00b5a90 0x7f27f00d01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:34.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.955+0000 7f27f6600640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27f00d06f0 con 0x7f27f00d0bd0 2024-04-26T20:58:34.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.955+0000 7f27f6600640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f27f00d2920 con 0x7f27f00b5a90 2024-04-26T20:58:34.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.955+0000 7f27f6600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f27f00d5c50 con 0x7f27f00cb1b0 2024-04-26T20:58:34.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.955+0000 7f27e6a00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f27f00d0bd0 0x7f27f00cfaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:51784/0 (socket says 172.21.15.138:51784) 2024-04-26T20:58:34.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.955+0000 7f27e6a00640 1 -- 172.21.15.138:0/1614169965 learned_addr learned my addr 172.21.15.138:0/1614169965 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:34.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.955+0000 7f27efe00640 1 --2- 172.21.15.138:0/1614169965 >> v2:172.21.15.143:3300/0 conn(0x7f27f00b5a90 0x7f27f00d01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:34.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.955+0000 7f27ef400640 1 --2- 172.21.15.138:0/1614169965 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f27f00cb1b0 0x7f27f00cb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:34.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.955+0000 7f27eea00640 1 -- 172.21.15.138:0/1614169965 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3870002429 0 0) 0x7f27f00d06f0 con 0x7f27f00d0bd0 2024-04-26T20:58:34.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.955+0000 7f27eea00640 1 -- 172.21.15.138:0/1614169965 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27d4003530 con 0x7f27f00d0bd0 2024-04-26T20:58:34.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.955+0000 7f27efe00640 1 -- 172.21.15.138:0/1614169965 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f27f00cb1b0 msgr2=0x7f27f00cb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:34.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.955+0000 7f27efe00640 1 --2- 172.21.15.138:0/1614169965 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f27f00cb1b0 0x7f27f00cb590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:34.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.955+0000 7f27efe00640 1 -- 172.21.15.138:0/1614169965 >> v1:172.21.15.138:6789/0 conn(0x7f27f00d0bd0 legacy=0x7f27f00cfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:34.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.955+0000 7f27efe00640 1 -- 172.21.15.138:0/1614169965 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27f00d2f10 con 0x7f27f00b5a90 2024-04-26T20:58:34.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.959+0000 7f27efe00640 1 --2- 172.21.15.138:0/1614169965 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f27f00b5a90 0x7f27f00d01b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f27e8009d90 tx=0x7f27e801c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afd349d871dfe3a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:34.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.959+0000 7f27eea00640 1 -- 172.21.15.138:0/1614169965 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e80b2070 con 0x7f27f00b5a90 2024-04-26T20:58:34.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.959+0000 7f27eea00640 1 -- 172.21.15.138:0/1614169965 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27e80a5a20 con 0x7f27f00b5a90 2024-04-26T20:58:34.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.959+0000 7f27eea00640 1 -- 172.21.15.138:0/1614169965 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e80a5df0 con 0x7f27f00b5a90 2024-04-26T20:58:34.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.959+0000 7f27f6600640 1 -- 172.21.15.138:0/1614169965 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f27f00b5a90 msgr2=0x7f27f00d01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:34.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.959+0000 7f27f6600640 1 --2- 172.21.15.138:0/1614169965 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f27f00b5a90 0x7f27f00d01b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f27e8009d90 tx=0x7f27e801c940 comp rx=0 tx=0).stop 2024-04-26T20:58:34.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.963+0000 7f27f6600640 1 -- 172.21.15.138:0/1614169965 shutdown_connections 2024-04-26T20:58:34.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.963+0000 7f27f6600640 1 --2- 172.21.15.138:0/1614169965 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f27f00b5a90 0x7f27f00d01b0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:34.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.963+0000 7f27f6600640 1 --2- 172.21.15.138:0/1614169965 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f27f00cb1b0 0x7f27f00cb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:34.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.963+0000 7f27f6600640 1 -- 172.21.15.138:0/1614169965 >> 172.21.15.138:0/1614169965 conn(0x7f27f00d4f90 msgr2=0x7f27f00d53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:34.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.963+0000 7f27f6600640 1 -- 172.21.15.138:0/1614169965 shutdown_connections 2024-04-26T20:58:34.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.963+0000 7f27f6600640 1 -- 172.21.15.138:0/1614169965 wait complete. 2024-04-26T20:58:34.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.963+0000 7f27f6600640 1 Processor -- start 2024-04-26T20:58:34.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.963+0000 7f27f6600640 1 -- start start 2024-04-26T20:58:34.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.963+0000 7f27f6600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f27f00b5a90 0x7f27f0161550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:34.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.963+0000 7f27f6600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f27f00cb1b0 0x7f27f015a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:34.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.963+0000 7f27f6600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f27f00d0bd0 0x7f27f015aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:34.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.963+0000 7f27f6600640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f27f00c9680 con 0x7f27f00cb1b0 2024-04-26T20:58:34.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.963+0000 7f27f6600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f27f00c9500 con 0x7f27f00b5a90 2024-04-26T20:58:34.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.963+0000 7f27f6600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f27f00c9800 con 0x7f27f00d0bd0 2024-04-26T20:58:34.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.963+0000 7f27e6a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f27f00cb1b0 0x7f27f015a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:34.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.963+0000 7f27e6a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f27f00cb1b0 0x7f27f015a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:60952/0 (socket says 172.21.15.138:60952) 2024-04-26T20:58:34.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.963+0000 7f27e6a00640 1 -- 172.21.15.138:0/316304320 learned_addr learned my addr 172.21.15.138:0/316304320 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:34.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.963+0000 7f27ef400640 1 --2- 172.21.15.138:0/316304320 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f27f00b5a90 0x7f27f0161550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:34.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.963+0000 7f27efe00640 1 --2- 172.21.15.138:0/316304320 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f27f00d0bd0 0x7f27f015aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:34.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.963+0000 7f27e6a00640 1 -- 172.21.15.138:0/316304320 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f27f00d0bd0 msgr2=0x7f27f015aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:34.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.963+0000 7f27e6a00640 1 --2- 172.21.15.138:0/316304320 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f27f00d0bd0 0x7f27f015aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:34.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.963+0000 7f27e6a00640 1 -- 172.21.15.138:0/316304320 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f27f00b5a90 msgr2=0x7f27f0161550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:34.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.963+0000 7f27e6a00640 1 --2- 172.21.15.138:0/316304320 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f27f00b5a90 0x7f27f0161550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:34.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.963+0000 7f27e6a00640 1 -- 172.21.15.138:0/316304320 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27f00ba760 con 0x7f27f00cb1b0 2024-04-26T20:58:34.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.963+0000 7f27efe00640 1 --2- 172.21.15.138:0/316304320 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f27f00d0bd0 0x7f27f015aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:58:34.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.963+0000 7f27ef400640 1 --2- 172.21.15.138:0/316304320 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f27f00b5a90 0x7f27f0161550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:58:34.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.963+0000 7f27e6a00640 1 --2- 172.21.15.138:0/316304320 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f27f00cb1b0 0x7f27f015a500 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f27d800c480 tx=0x7f27d800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:34.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.963+0000 7f27e7e00640 1 -- 172.21.15.138:0/316304320 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d8017070 con 0x7f27f00cb1b0 2024-04-26T20:58:34.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.963+0000 7f27e7e00640 1 -- 172.21.15.138:0/316304320 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27d8005cf0 con 0x7f27f00cb1b0 2024-04-26T20:58:34.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.967+0000 7f27f6600640 1 -- 172.21.15.138:0/316304320 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27f00baa40 con 0x7f27f00cb1b0 2024-04-26T20:58:34.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.967+0000 7f27e7e00640 1 -- 172.21.15.138:0/316304320 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d8007290 con 0x7f27f00cb1b0 2024-04-26T20:58:34.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.967+0000 7f27f6600640 1 -- 172.21.15.138:0/316304320 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27f00b1bc0 con 0x7f27f00cb1b0 2024-04-26T20:58:34.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.967+0000 7f27f6600640 1 -- 172.21.15.138:0/316304320 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27f0069510 con 0x7f27f00cb1b0 2024-04-26T20:58:34.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.967+0000 7f27e7e00640 1 -- 172.21.15.138:0/316304320 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f27d801a070 con 0x7f27f00cb1b0 2024-04-26T20:58:34.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.967+0000 7f27e7e00640 1 --2- 172.21.15.138:0/316304320 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f27cc068380 0x7f27cc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:34.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.967+0000 7f27e7e00640 1 -- 172.21.15.138:0/316304320 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6756+0+0 (secure 0 0 0) 0x7f27d8086170 con 0x7f27f00cb1b0 2024-04-26T20:58:34.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.967+0000 7f27ef400640 1 --2- 172.21.15.138:0/316304320 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f27cc068380 0x7f27cc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:34.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.971+0000 7f27ef400640 1 --2- 172.21.15.138:0/316304320 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f27cc068380 0x7f27cc06a840 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f27f00cba30 tx=0x7f27e0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:34.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:34.971+0000 7f27e7e00640 1 -- 172.21.15.138:0/316304320 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f27d80563a0 con 0x7f27f00cb1b0 2024-04-26T20:58:35.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.179+0000 7f27f6600640 1 -- 172.21.15.138:0/316304320 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f27f015bba0 con 0x7f27f00cb1b0 2024-04-26T20:58:35.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.787+0000 7f27e7e00640 1 -- 172.21.15.138:0/316304320 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v29) ==== 161+0+0 (secure 0 0 0) 0x7f27d8055ca0 con 0x7f27f00cb1b0 2024-04-26T20:58:35.790 INFO:teuthology.orchestra.run.smithi138.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T20:58:35.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.791+0000 7f27f6600640 1 -- 172.21.15.138:0/316304320 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f27cc068380 msgr2=0x7f27cc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:35.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.791+0000 7f27f6600640 1 --2- 172.21.15.138:0/316304320 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f27cc068380 0x7f27cc06a840 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f27f00cba30 tx=0x7f27e0008040 comp rx=0 tx=0).stop 2024-04-26T20:58:35.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.791+0000 7f27f6600640 1 -- 172.21.15.138:0/316304320 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f27f00cb1b0 msgr2=0x7f27f015a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:35.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.791+0000 7f27f6600640 1 --2- 172.21.15.138:0/316304320 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f27f00cb1b0 0x7f27f015a500 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f27d800c480 tx=0x7f27d800c940 comp rx=0 tx=0).stop 2024-04-26T20:58:35.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.791+0000 7f27f6600640 1 -- 172.21.15.138:0/316304320 shutdown_connections 2024-04-26T20:58:35.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.791+0000 7f27f6600640 1 --2- 172.21.15.138:0/316304320 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f27cc068380 0x7f27cc06a840 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:35.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.791+0000 7f27f6600640 1 --2- 172.21.15.138:0/316304320 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f27f00d0bd0 0x7f27f015aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:35.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.791+0000 7f27f6600640 1 --2- 172.21.15.138:0/316304320 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f27f00cb1b0 0x7f27f015a500 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:35.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.791+0000 7f27f6600640 1 --2- 172.21.15.138:0/316304320 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f27f00b5a90 0x7f27f0161550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:35.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.791+0000 7f27f6600640 1 -- 172.21.15.138:0/316304320 >> 172.21.15.138:0/316304320 conn(0x7f27f00d4f90 msgr2=0x7f27f00b6a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:35.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.791+0000 7f27f6600640 1 -- 172.21.15.138:0/316304320 shutdown_connections 2024-04-26T20:58:35.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.791+0000 7f27f6600640 1 -- 172.21.15.138:0/316304320 wait complete. 2024-04-26T20:58:35.812 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-26T20:58:35.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.947+0000 7fbe3e600640 1 Processor -- start 2024-04-26T20:58:35.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.947+0000 7fbe3e600640 1 -- start start 2024-04-26T20:58:35.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.947+0000 7fbe3e600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbe3815b730 0x7fbe38073e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:35.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.947+0000 7fbe3e600640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fbe3806ee80 0x7fbe380ce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:35.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.947+0000 7fbe3e600640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe380cbe40 con 0x7fbe380738e0 2024-04-26T20:58:35.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.947+0000 7fbe3e600640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fbe380cbbf0 con 0x7fbe3806ee80 2024-04-26T20:58:35.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.947+0000 7fbe3e600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fbe380731c0 con 0x7fbe3815b730 2024-04-26T20:58:35.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.951+0000 7fbe37400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbe3815b730 0x7fbe38073e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:35.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.951+0000 7fbe37e00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fbe3806ee80 0x7fbe380ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:35.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.951+0000 7fbe37400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbe3815b730 0x7fbe38073e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.138:51482/0 (socket says 172.21.15.138:51482) 2024-04-26T20:58:35.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.951+0000 7fbe37400640 1 -- 172.21.15.138:0/4288161957 learned_addr learned my addr 172.21.15.138:0/4288161957 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:35.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.951+0000 7fbe37400640 1 -- 172.21.15.138:0/4288161957 >> v2:172.21.15.143:3300/0 conn(0x7fbe3806ee80 msgr2=0x7fbe380ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:35.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.951+0000 7fbe37400640 1 --2- 172.21.15.138:0/4288161957 >> v2:172.21.15.143:3300/0 conn(0x7fbe3806ee80 0x7fbe380ce780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:35.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.951+0000 7fbe37400640 1 -- 172.21.15.138:0/4288161957 >> v1:172.21.15.143:6789/0 conn(0x7fbe380738e0 legacy=0x7fbe3806e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:35.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.951+0000 7fbe37400640 1 -- 172.21.15.138:0/4288161957 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe380cc120 con 0x7fbe3815b730 2024-04-26T20:58:35.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.951+0000 7fbe37e00640 1 --2- 172.21.15.138:0/4288161957 >> v2:172.21.15.143:3300/0 conn(0x7fbe3806ee80 0x7fbe380ce780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:58:35.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.951+0000 7fbe37400640 1 --2- 172.21.15.138:0/4288161957 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbe3815b730 0x7fbe38073e10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbe28009870 tx=0x7fbe2801c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69011789e95feb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:35.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.951+0000 7fbe36a00640 1 -- 172.21.15.138:0/4288161957 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe280aa610 con 0x7fbe3815b730 2024-04-26T20:58:35.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.951+0000 7fbe36a00640 1 -- 172.21.15.138:0/4288161957 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe280af070 con 0x7fbe3815b730 2024-04-26T20:58:35.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.951+0000 7fbe36a00640 1 -- 172.21.15.138:0/4288161957 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe280aa9d0 con 0x7fbe3815b730 2024-04-26T20:58:35.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.955+0000 7fbe3e600640 1 -- 172.21.15.138:0/4288161957 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbe3815b730 msgr2=0x7fbe38073e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:35.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.955+0000 7fbe3e600640 1 --2- 172.21.15.138:0/4288161957 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbe3815b730 0x7fbe38073e10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbe28009870 tx=0x7fbe2801c530 comp rx=0 tx=0).stop 2024-04-26T20:58:35.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.955+0000 7fbe3e600640 1 -- 172.21.15.138:0/4288161957 shutdown_connections 2024-04-26T20:58:35.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.955+0000 7fbe3e600640 1 --2- 172.21.15.138:0/4288161957 >> v2:172.21.15.143:3300/0 conn(0x7fbe3806ee80 0x7fbe380ce780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:35.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.955+0000 7fbe3e600640 1 --2- 172.21.15.138:0/4288161957 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbe3815b730 0x7fbe38073e10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:35.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.955+0000 7fbe3e600640 1 -- 172.21.15.138:0/4288161957 >> 172.21.15.138:0/4288161957 conn(0x7fbe380d0bb0 msgr2=0x7fbe380d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:35.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.955+0000 7fbe3e600640 1 -- 172.21.15.138:0/4288161957 shutdown_connections 2024-04-26T20:58:35.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.955+0000 7fbe3e600640 1 -- 172.21.15.138:0/4288161957 wait complete. 2024-04-26T20:58:35.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.955+0000 7fbe3e600640 1 Processor -- start 2024-04-26T20:58:35.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.955+0000 7fbe3e600640 1 -- start start 2024-04-26T20:58:35.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.955+0000 7fbe3e600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbe3806ee80 0x7fbe38154f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:35.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.955+0000 7fbe3e600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbe380738e0 0x7fbe3814c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:35.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.955+0000 7fbe3e600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbe3815b730 0x7fbe38153470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:35.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.955+0000 7fbe3e600640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fbe380cee40 con 0x7fbe3815b730 2024-04-26T20:58:35.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.955+0000 7fbe3e600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fbe380cecc0 con 0x7fbe380738e0 2024-04-26T20:58:35.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.955+0000 7fbe3e600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fbe380cefc0 con 0x7fbe3806ee80 2024-04-26T20:58:35.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.955+0000 7fbe37e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbe3815b730 0x7fbe38153470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:35.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.955+0000 7fbe37e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbe3815b730 0x7fbe38153470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:60962/0 (socket says 172.21.15.138:60962) 2024-04-26T20:58:35.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.955+0000 7fbe37e00640 1 -- 172.21.15.138:0/259948461 learned_addr learned my addr 172.21.15.138:0/259948461 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:35.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.955+0000 7fbe37400640 1 --2- 172.21.15.138:0/259948461 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbe3806ee80 0x7fbe38154f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:35.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.955+0000 7fbe2ea00640 1 --2- 172.21.15.138:0/259948461 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbe380738e0 0x7fbe3814c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:35.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.955+0000 7fbe37e00640 1 -- 172.21.15.138:0/259948461 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbe3806ee80 msgr2=0x7fbe38154f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:35.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.955+0000 7fbe37e00640 1 --2- 172.21.15.138:0/259948461 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbe3806ee80 0x7fbe38154f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:35.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.955+0000 7fbe37e00640 1 -- 172.21.15.138:0/259948461 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbe380738e0 msgr2=0x7fbe3814c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:35.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.955+0000 7fbe37e00640 1 --2- 172.21.15.138:0/259948461 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbe380738e0 0x7fbe3814c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:35.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.955+0000 7fbe37e00640 1 -- 172.21.15.138:0/259948461 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe380b3700 con 0x7fbe3815b730 2024-04-26T20:58:35.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.955+0000 7fbe37400640 1 --2- 172.21.15.138:0/259948461 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbe3806ee80 0x7fbe38154f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:58:35.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.955+0000 7fbe37e00640 1 --2- 172.21.15.138:0/259948461 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbe3815b730 0x7fbe38153470 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fbe3000efc0 tx=0x7fbe30009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:35.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.959+0000 7fbe2fe00640 1 -- 172.21.15.138:0/259948461 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe30018030 con 0x7fbe3815b730 2024-04-26T20:58:35.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.959+0000 7fbe2fe00640 1 -- 172.21.15.138:0/259948461 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe3000cde0 con 0x7fbe3815b730 2024-04-26T20:58:35.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.959+0000 7fbe2fe00640 1 -- 172.21.15.138:0/259948461 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe30003bc0 con 0x7fbe3815b730 2024-04-26T20:58:35.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.959+0000 7fbe3e600640 1 -- 172.21.15.138:0/259948461 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe38155480 con 0x7fbe3815b730 2024-04-26T20:58:35.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.959+0000 7fbe3e600640 1 -- 172.21.15.138:0/259948461 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe380b3c80 con 0x7fbe3815b730 2024-04-26T20:58:35.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.959+0000 7fbe3e600640 1 -- 172.21.15.138:0/259948461 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe38069430 con 0x7fbe3815b730 2024-04-26T20:58:35.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.959+0000 7fbe2fe00640 1 -- 172.21.15.138:0/259948461 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbe3001b070 con 0x7fbe3815b730 2024-04-26T20:58:35.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.959+0000 7fbe2fe00640 1 --2- 172.21.15.138:0/259948461 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fbe14068380 0x7fbe1406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:35.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.959+0000 7fbe2fe00640 1 -- 172.21.15.138:0/259948461 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6756+0+0 (secure 0 0 0) 0x7fbe30087690 con 0x7fbe3815b730 2024-04-26T20:58:35.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.959+0000 7fbe37400640 1 --2- 172.21.15.138:0/259948461 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fbe14068380 0x7fbe1406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:35.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.963+0000 7fbe37400640 1 --2- 172.21.15.138:0/259948461 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fbe14068380 0x7fbe1406a840 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fbe280ae000 tx=0x7fbe280a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:35.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:35.963+0000 7fbe2fe00640 1 -- 172.21.15.138:0/259948461 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fbe30022070 con 0x7fbe3815b730 2024-04-26T20:58:36.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.155+0000 7fbe3e600640 1 -- 172.21.15.138:0/259948461 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fbe38069ee0 con 0x7fbe3815b730 2024-04-26T20:58:36.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.795+0000 7fbe2fe00640 1 -- 172.21.15.138:0/259948461 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v30) ==== 104+0+0 (secure 0 0 0) 0x7fbe30010040 con 0x7fbe3815b730 2024-04-26T20:58:36.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.795+0000 7fbe3e600640 1 -- 172.21.15.138:0/259948461 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fbe14068380 msgr2=0x7fbe1406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:36.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.795+0000 7fbe3e600640 1 --2- 172.21.15.138:0/259948461 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fbe14068380 0x7fbe1406a840 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fbe280ae000 tx=0x7fbe280a7000 comp rx=0 tx=0).stop 2024-04-26T20:58:36.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.795+0000 7fbe3e600640 1 -- 172.21.15.138:0/259948461 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbe3815b730 msgr2=0x7fbe38153470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:36.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.795+0000 7fbe3e600640 1 --2- 172.21.15.138:0/259948461 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbe3815b730 0x7fbe38153470 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fbe3000efc0 tx=0x7fbe30009f90 comp rx=0 tx=0).stop 2024-04-26T20:58:36.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.795+0000 7fbe3e600640 1 -- 172.21.15.138:0/259948461 shutdown_connections 2024-04-26T20:58:36.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.795+0000 7fbe3e600640 1 --2- 172.21.15.138:0/259948461 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fbe14068380 0x7fbe1406a840 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:36.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.795+0000 7fbe3e600640 1 --2- 172.21.15.138:0/259948461 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbe3815b730 0x7fbe38153470 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:36.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.795+0000 7fbe3e600640 1 --2- 172.21.15.138:0/259948461 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbe380738e0 0x7fbe3814c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:36.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.795+0000 7fbe3e600640 1 --2- 172.21.15.138:0/259948461 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbe3806ee80 0x7fbe38154f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:36.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.795+0000 7fbe3e600640 1 -- 172.21.15.138:0/259948461 >> 172.21.15.138:0/259948461 conn(0x7fbe380d0bb0 msgr2=0x7fbe38154200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:36.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.795+0000 7fbe3e600640 1 -- 172.21.15.138:0/259948461 shutdown_connections 2024-04-26T20:58:36.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.795+0000 7fbe3e600640 1 -- 172.21.15.138:0/259948461 wait complete. 2024-04-26T20:58:36.818 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-26T20:58:36.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.955+0000 7fbda9c00640 1 Processor -- start 2024-04-26T20:58:36.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.955+0000 7fbda9c00640 1 -- start start 2024-04-26T20:58:36.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.959+0000 7fbda9c00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fbda41635b0 0x7fbda40d1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:36.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.959+0000 7fbda9c00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fbda40d1750 0x7fbda40adf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:36.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.959+0000 7fbda9c00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbda40d1b50 con 0x7fbda415cc30 2024-04-26T20:58:36.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.959+0000 7fbda9c00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fbda4163120 con 0x7fbda41635b0 2024-04-26T20:58:36.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.959+0000 7fbda9c00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fbda415d010 con 0x7fbda40d1750 2024-04-26T20:58:36.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.959+0000 7fbda2000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fbda41635b0 0x7fbda40d1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:36.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.959+0000 7fbda2a00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fbda415cc30 0x7fbda415f640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:51798/0 (socket says 172.21.15.138:51798) 2024-04-26T20:58:36.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.959+0000 7fbda2000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fbda41635b0 0x7fbda40d1210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:60976/0 (socket says 172.21.15.138:60976) 2024-04-26T20:58:36.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.959+0000 7fbda2a00640 1 -- 172.21.15.138:0/3729440464 learned_addr learned my addr 172.21.15.138:0/3729440464 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:36.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.959+0000 7fbda3400640 1 --2- 172.21.15.138:0/3729440464 >> v2:172.21.15.143:3300/0 conn(0x7fbda40d1750 0x7fbda40adf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:36.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.959+0000 7fbda2000640 1 -- 172.21.15.138:0/3729440464 >> v2:172.21.15.143:3300/0 conn(0x7fbda40d1750 msgr2=0x7fbda40adf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:36.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.959+0000 7fbda2000640 1 --2- 172.21.15.138:0/3729440464 >> v2:172.21.15.143:3300/0 conn(0x7fbda40d1750 0x7fbda40adf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:36.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.959+0000 7fbda2000640 1 -- 172.21.15.138:0/3729440464 >> v1:172.21.15.138:6789/0 conn(0x7fbda415cc30 legacy=0x7fbda415f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:36.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.959+0000 7fbda2000640 1 -- 172.21.15.138:0/3729440464 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbda4163a40 con 0x7fbda41635b0 2024-04-26T20:58:36.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.959+0000 7fbda2000640 1 --2- 172.21.15.138:0/3729440464 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbda41635b0 0x7fbda40d1210 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fbda409f250 tx=0x7fbd8c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbd791995bd514dd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:36.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.963+0000 7fbda1600640 1 -- 172.21.15.138:0/3729440464 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c0b0070 con 0x7fbda41635b0 2024-04-26T20:58:36.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.963+0000 7fbda1600640 1 -- 172.21.15.138:0/3729440464 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd8c0ab600 con 0x7fbda41635b0 2024-04-26T20:58:36.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.963+0000 7fbda1600640 1 -- 172.21.15.138:0/3729440464 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c0ab9d0 con 0x7fbda41635b0 2024-04-26T20:58:36.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.963+0000 7fbda9c00640 1 -- 172.21.15.138:0/3729440464 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbda41635b0 msgr2=0x7fbda40d1210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:36.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.963+0000 7fbda9c00640 1 --2- 172.21.15.138:0/3729440464 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbda41635b0 0x7fbda40d1210 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fbda409f250 tx=0x7fbd8c01c3f0 comp rx=0 tx=0).stop 2024-04-26T20:58:36.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.963+0000 7fbda9c00640 1 -- 172.21.15.138:0/3729440464 shutdown_connections 2024-04-26T20:58:36.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.963+0000 7fbda9c00640 1 --2- 172.21.15.138:0/3729440464 >> v2:172.21.15.143:3300/0 conn(0x7fbda40d1750 0x7fbda40adf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:36.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.963+0000 7fbda9c00640 1 --2- 172.21.15.138:0/3729440464 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbda41635b0 0x7fbda40d1210 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:36.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.963+0000 7fbda9c00640 1 -- 172.21.15.138:0/3729440464 >> 172.21.15.138:0/3729440464 conn(0x7fbda406c4d0 msgr2=0x7fbda406c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:36.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.963+0000 7fbda9c00640 1 -- 172.21.15.138:0/3729440464 shutdown_connections 2024-04-26T20:58:36.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.963+0000 7fbda9c00640 1 -- 172.21.15.138:0/3729440464 wait complete. 2024-04-26T20:58:36.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.963+0000 7fbda9c00640 1 Processor -- start 2024-04-26T20:58:36.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.963+0000 7fbda9c00640 1 -- start start 2024-04-26T20:58:36.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.963+0000 7fbda9c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbda40d1750 0x7fbda4154a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:36.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.963+0000 7fbda9c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbda415cc30 0x7fbda4157e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:36.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.963+0000 7fbda9c00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbda41635b0 0x7fbda414f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:36.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.963+0000 7fbda9c00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fbda40b60f0 con 0x7fbda41635b0 2024-04-26T20:58:36.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.963+0000 7fbda9c00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fbda415fd50 con 0x7fbda40d1750 2024-04-26T20:58:36.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.963+0000 7fbda9c00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fbda40b6270 con 0x7fbda415cc30 2024-04-26T20:58:36.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.963+0000 7fbda3400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbda41635b0 0x7fbda414f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:36.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.963+0000 7fbda3400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbda41635b0 0x7fbda414f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:60992/0 (socket says 172.21.15.138:60992) 2024-04-26T20:58:36.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.963+0000 7fbda3400640 1 -- 172.21.15.138:0/229630388 learned_addr learned my addr 172.21.15.138:0/229630388 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:36.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.963+0000 7fbda2000640 1 --2- 172.21.15.138:0/229630388 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbda415cc30 0x7fbda4157e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:36.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.963+0000 7fbda2a00640 1 --2- 172.21.15.138:0/229630388 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbda40d1750 0x7fbda4154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:36.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.967+0000 7fbda3400640 1 -- 172.21.15.138:0/229630388 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbda415cc30 msgr2=0x7fbda4157e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:36.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.967+0000 7fbda3400640 1 --2- 172.21.15.138:0/229630388 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbda415cc30 0x7fbda4157e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:36.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.967+0000 7fbda3400640 1 -- 172.21.15.138:0/229630388 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbda40d1750 msgr2=0x7fbda4154a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:36.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.967+0000 7fbda3400640 1 --2- 172.21.15.138:0/229630388 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbda40d1750 0x7fbda4154a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:36.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.967+0000 7fbda3400640 1 -- 172.21.15.138:0/229630388 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbda4072b10 con 0x7fbda41635b0 2024-04-26T20:58:36.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.967+0000 7fbda2a00640 1 --2- 172.21.15.138:0/229630388 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbda40d1750 0x7fbda4154a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:58:36.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.967+0000 7fbda3400640 1 --2- 172.21.15.138:0/229630388 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbda41635b0 0x7fbda414f710 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c007e40 tx=0x7fbd9c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:36.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.967+0000 7fbd9aa00640 1 -- 172.21.15.138:0/229630388 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c014620 con 0x7fbda41635b0 2024-04-26T20:58:36.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.967+0000 7fbd9aa00640 1 -- 172.21.15.138:0/229630388 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd9c019070 con 0x7fbda41635b0 2024-04-26T20:58:36.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.967+0000 7fbda9c00640 1 -- 172.21.15.138:0/229630388 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbda4155190 con 0x7fbda41635b0 2024-04-26T20:58:36.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.967+0000 7fbd9aa00640 1 -- 172.21.15.138:0/229630388 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c014a20 con 0x7fbda41635b0 2024-04-26T20:58:36.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.967+0000 7fbda9c00640 1 -- 172.21.15.138:0/229630388 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbda4072db0 con 0x7fbda41635b0 2024-04-26T20:58:36.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.967+0000 7fbda9c00640 1 -- 172.21.15.138:0/229630388 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbda4069510 con 0x7fbda41635b0 2024-04-26T20:58:36.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.967+0000 7fbd9aa00640 1 -- 172.21.15.138:0/229630388 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbd9c014bc0 con 0x7fbda41635b0 2024-04-26T20:58:36.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.967+0000 7fbd9aa00640 1 --2- 172.21.15.138:0/229630388 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fbd800683b0 0x7fbd8006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:36.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.967+0000 7fbd9aa00640 1 -- 172.21.15.138:0/229630388 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6756+0+0 (secure 0 0 0) 0x7fbd9c087720 con 0x7fbda41635b0 2024-04-26T20:58:36.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.967+0000 7fbda2a00640 1 --2- 172.21.15.138:0/229630388 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fbd800683b0 0x7fbd8006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:36.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.971+0000 7fbda2a00640 1 --2- 172.21.15.138:0/229630388 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fbd800683b0 0x7fbd8006a870 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fbd94000f70 tx=0x7fbd94009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:36.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:36.971+0000 7fbd9aa00640 1 -- 172.21.15.138:0/229630388 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fbd9c057790 con 0x7fbda41635b0 2024-04-26T20:58:37.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.131+0000 7fbda9c00640 1 -- 172.21.15.138:0/229630388 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fbda41556b0 con 0x7fbda41635b0 2024-04-26T20:58:37.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.799+0000 7fbd9aa00640 1 -- 172.21.15.138:0/229630388 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v52) ==== 181+0+0 (secure 0 0 0) 0x7fbd9c057090 con 0x7fbda41635b0 2024-04-26T20:58:37.803 INFO:teuthology.orchestra.run.smithi138.stderr:pool 'cephfs_metadata' removed 2024-04-26T20:58:37.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.803+0000 7fbda9c00640 1 -- 172.21.15.138:0/229630388 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fbd800683b0 msgr2=0x7fbd8006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:37.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.803+0000 7fbda9c00640 1 --2- 172.21.15.138:0/229630388 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fbd800683b0 0x7fbd8006a870 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fbd94000f70 tx=0x7fbd94009040 comp rx=0 tx=0).stop 2024-04-26T20:58:37.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.803+0000 7fbda9c00640 1 -- 172.21.15.138:0/229630388 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbda41635b0 msgr2=0x7fbda414f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:37.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.803+0000 7fbda9c00640 1 --2- 172.21.15.138:0/229630388 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbda41635b0 0x7fbda414f710 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c007e40 tx=0x7fbd9c00e4b0 comp rx=0 tx=0).stop 2024-04-26T20:58:37.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.803+0000 7fbda9c00640 1 -- 172.21.15.138:0/229630388 shutdown_connections 2024-04-26T20:58:37.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.803+0000 7fbda9c00640 1 --2- 172.21.15.138:0/229630388 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fbd800683b0 0x7fbd8006a870 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:37.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.803+0000 7fbda9c00640 1 --2- 172.21.15.138:0/229630388 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbda41635b0 0x7fbda414f710 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:37.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.803+0000 7fbda9c00640 1 --2- 172.21.15.138:0/229630388 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbda415cc30 0x7fbda4157e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:37.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.803+0000 7fbda9c00640 1 --2- 172.21.15.138:0/229630388 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbda40d1750 0x7fbda4154a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:37.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.803+0000 7fbda9c00640 1 -- 172.21.15.138:0/229630388 >> 172.21.15.138:0/229630388 conn(0x7fbda406c4d0 msgr2=0x7fbda40b34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:37.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.807+0000 7fbda9c00640 1 -- 172.21.15.138:0/229630388 shutdown_connections 2024-04-26T20:58:37.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.807+0000 7fbda9c00640 1 -- 172.21.15.138:0/229630388 wait complete. 2024-04-26T20:58:37.831 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-26T20:58:37.852 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:58:37.881 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:58:37.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.971+0000 7f5b3b200640 1 Processor -- start 2024-04-26T20:58:37.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.971+0000 7f5b3b200640 1 -- start start 2024-04-26T20:58:37.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.971+0000 7f5b3b200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5b3406edf0 0x7f5b340cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:37.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.971+0000 7f5b3b200640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5b340734f0 0x7f5b340ce720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:37.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.971+0000 7f5b3b200640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b3415b920 con 0x7f5b3415b540 2024-04-26T20:58:37.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.971+0000 7f5b3b200640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f5b34072450 con 0x7f5b340734f0 2024-04-26T20:58:37.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.971+0000 7f5b3b200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f5b34072730 con 0x7f5b3406edf0 2024-04-26T20:58:37.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.971+0000 7f5b33e00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f5b3415b540 0x7f5b3406e6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:51814/0 (socket says 172.21.15.138:51814) 2024-04-26T20:58:37.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.971+0000 7f5b33e00640 1 -- 172.21.15.138:0/3328144187 learned_addr learned my addr 172.21.15.138:0/3328144187 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:37.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.971+0000 7f5b32a00640 1 -- 172.21.15.138:0/3328144187 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1432715569 0 0) 0x7f5b3415b920 con 0x7f5b3415b540 2024-04-26T20:58:37.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.971+0000 7f5b33400640 1 --2- 172.21.15.138:0/3328144187 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5b3406edf0 0x7f5b340cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:37.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.971+0000 7f5b32a00640 1 -- 172.21.15.138:0/3328144187 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b18003450 con 0x7f5b3415b540 2024-04-26T20:58:37.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.971+0000 7f5b39200640 1 --2- 172.21.15.138:0/3328144187 >> v2:172.21.15.143:3300/0 conn(0x7f5b340734f0 0x7f5b340ce720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:37.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.975+0000 7f5b32a00640 1 -- 172.21.15.138:0/3328144187 <== mon.0 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 234651680 0 0) 0x7f5b18003450 con 0x7f5b3415b540 2024-04-26T20:58:37.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.975+0000 7f5b32a00640 1 -- 172.21.15.138:0/3328144187 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5b3406edf0 msgr2=0x7f5b340cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:37.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.975+0000 7f5b32a00640 1 --2- 172.21.15.138:0/3328144187 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5b3406edf0 0x7f5b340cbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:37.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.975+0000 7f5b32a00640 1 -- 172.21.15.138:0/3328144187 >> v2:172.21.15.143:3300/0 conn(0x7f5b340734f0 msgr2=0x7f5b340ce720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:37.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.975+0000 7f5b32a00640 1 --2- 172.21.15.138:0/3328144187 >> v2:172.21.15.143:3300/0 conn(0x7f5b340734f0 0x7f5b340ce720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:37.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.975+0000 7f5b32a00640 1 -- 172.21.15.138:0/3328144187 --> v1:172.21.15.138:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b34072a10 con 0x7f5b3415b540 2024-04-26T20:58:37.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.975+0000 7f5b32a00640 1 -- 172.21.15.138:0/3328144187 <== mon.0 v1:172.21.15.138:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2715389689 0 0) 0x7f5b24001680 con 0x7f5b3415b540 2024-04-26T20:58:37.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.975+0000 7f5b32a00640 1 -- 172.21.15.138:0/3328144187 >> v1:172.21.15.138:6789/0 conn(0x7f5b3415b540 legacy=0x7f5b3406e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:37.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.975+0000 7f5b32a00640 1 --2- 172.21.15.138:0/3328144187 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b18003ab0 0x7f5b18003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:37.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.975+0000 7f5b32a00640 1 --2- 172.21.15.138:0/3328144187 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5b3406edf0 0x7f5b1800a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:37.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.975+0000 7f5b32a00640 1 --2- 172.21.15.138:0/3328144187 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b1800ae40 0x7f5b1800d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:37.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.975+0000 7f5b32a00640 1 -- 172.21.15.138:0/3328144187 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f5b34072450 con 0x7f5b1800ae40 2024-04-26T20:58:37.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.975+0000 7f5b32a00640 1 -- 172.21.15.138:0/3328144187 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f5b34072730 con 0x7f5b18003ab0 2024-04-26T20:58:37.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.975+0000 7f5b32a00640 1 -- 172.21.15.138:0/3328144187 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f5b1800dc30 con 0x7f5b3406edf0 2024-04-26T20:58:37.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.975+0000 7f5b39200640 1 --2- 172.21.15.138:0/3328144187 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b1800ae40 0x7f5b1800d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:37.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.975+0000 7f5b33400640 1 --2- 172.21.15.138:0/3328144187 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5b3406edf0 0x7f5b1800a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:37.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.975+0000 7f5b33e00640 1 --2- 172.21.15.138:0/3328144187 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b18003ab0 0x7f5b18003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:37.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.975+0000 7f5b39200640 1 -- 172.21.15.138:0/3328144187 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5b3406edf0 msgr2=0x7f5b1800a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:37.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.975+0000 7f5b39200640 1 --2- 172.21.15.138:0/3328144187 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5b3406edf0 0x7f5b1800a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:37.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.975+0000 7f5b39200640 1 -- 172.21.15.138:0/3328144187 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b18003ab0 msgr2=0x7f5b18003ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:37.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.975+0000 7f5b39200640 1 --2- 172.21.15.138:0/3328144187 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b18003ab0 0x7f5b18003ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:37.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.975+0000 7f5b39200640 1 -- 172.21.15.138:0/3328144187 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b18003450 con 0x7f5b1800ae40 2024-04-26T20:58:37.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.975+0000 7f5b39200640 1 --2- 172.21.15.138:0/3328144187 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b1800ae40 0x7f5b1800d2d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f5b34071ca0 tx=0x7f5b2c01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96eb2c35f79ccff5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:37.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.979+0000 7f5b32a00640 1 -- 172.21.15.138:0/3328144187 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c0b0070 con 0x7f5b1800ae40 2024-04-26T20:58:37.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.979+0000 7f5b32a00640 1 -- 172.21.15.138:0/3328144187 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b2c0ab600 con 0x7f5b1800ae40 2024-04-26T20:58:37.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.979+0000 7f5b32a00640 1 -- 172.21.15.138:0/3328144187 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c009c10 con 0x7f5b1800ae40 2024-04-26T20:58:37.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.979+0000 7f5b3b200640 1 -- 172.21.15.138:0/3328144187 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b1800ae40 msgr2=0x7f5b1800d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:37.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.979+0000 7f5b3b200640 1 --2- 172.21.15.138:0/3328144187 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b1800ae40 0x7f5b1800d2d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f5b34071ca0 tx=0x7f5b2c01c910 comp rx=0 tx=0).stop 2024-04-26T20:58:37.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.979+0000 7f5b39200640 1 -- 172.21.15.138:0/3328144187 reap_dead start 2024-04-26T20:58:37.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.979+0000 7f5b3b200640 1 -- 172.21.15.138:0/3328144187 shutdown_connections 2024-04-26T20:58:37.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.979+0000 7f5b3b200640 1 -- 172.21.15.138:0/3328144187 >> 172.21.15.138:0/3328144187 conn(0x7f5b340d0b50 msgr2=0x7f5b340d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:37.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.979+0000 7f5b3b200640 1 -- 172.21.15.138:0/3328144187 shutdown_connections 2024-04-26T20:58:37.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.979+0000 7f5b3b200640 1 -- 172.21.15.138:0/3328144187 wait complete. 2024-04-26T20:58:37.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.979+0000 7f5b3b200640 1 Processor -- start 2024-04-26T20:58:37.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.979+0000 7f5b3b200640 1 -- start start 2024-04-26T20:58:37.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.979+0000 7f5b3b200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b1800ae40 0x7f5b340c67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:37.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.979+0000 7f5b3b200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5b341f8ec0 0x7f5b341f9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:37.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.979+0000 7f5b3b200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b341e4c30 0x7f5b341e50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:37.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.979+0000 7f5b3b200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f5b3406de50 con 0x7f5b341e4c30 2024-04-26T20:58:37.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.979+0000 7f5b3b200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f5b340cc1a0 con 0x7f5b1800ae40 2024-04-26T20:58:37.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.979+0000 7f5b3b200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f5b3406dfd0 con 0x7f5b341f8ec0 2024-04-26T20:58:37.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.979+0000 7f5b39200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b341e4c30 0x7f5b341e50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:37.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.979+0000 7f5b39200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b341e4c30 0x7f5b341e50b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:32770/0 (socket says 172.21.15.138:32770) 2024-04-26T20:58:37.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.979+0000 7f5b39200640 1 -- 172.21.15.138:0/3521823286 learned_addr learned my addr 172.21.15.138:0/3521823286 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:37.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.979+0000 7f5b33e00640 1 --2- 172.21.15.138:0/3521823286 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b1800ae40 0x7f5b340c67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:37.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.979+0000 7f5b33400640 1 --2- 172.21.15.138:0/3521823286 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5b341f8ec0 0x7f5b341f9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:37.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.983+0000 7f5b39200640 1 -- 172.21.15.138:0/3521823286 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5b341f8ec0 msgr2=0x7f5b341f9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:37.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.983+0000 7f5b39200640 1 --2- 172.21.15.138:0/3521823286 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5b341f8ec0 0x7f5b341f9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:37.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.983+0000 7f5b39200640 1 -- 172.21.15.138:0/3521823286 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b1800ae40 msgr2=0x7f5b340c67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:37.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.983+0000 7f5b39200640 1 --2- 172.21.15.138:0/3521823286 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b1800ae40 0x7f5b340c67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:37.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.983+0000 7f5b39200640 1 -- 172.21.15.138:0/3521823286 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b341e58f0 con 0x7f5b341e4c30 2024-04-26T20:58:37.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.983+0000 7f5b33e00640 1 --2- 172.21.15.138:0/3521823286 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b1800ae40 0x7f5b340c67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:58:37.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.983+0000 7f5b39200640 1 --2- 172.21.15.138:0/3521823286 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b341e4c30 0x7f5b341e50b0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c002240 tx=0x7f5b2c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:37.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.983+0000 7f5b2be00640 1 -- 172.21.15.138:0/3521823286 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c0be070 con 0x7f5b341e4c30 2024-04-26T20:58:37.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.983+0000 7f5b2be00640 1 -- 172.21.15.138:0/3521823286 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b2c0ab400 con 0x7f5b341e4c30 2024-04-26T20:58:37.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.983+0000 7f5b2be00640 1 -- 172.21.15.138:0/3521823286 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c0b0040 con 0x7f5b341e4c30 2024-04-26T20:58:37.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.983+0000 7f5b3b200640 1 -- 172.21.15.138:0/3521823286 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b341e5bd0 con 0x7f5b341e4c30 2024-04-26T20:58:37.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.983+0000 7f5b3b200640 1 -- 172.21.15.138:0/3521823286 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b341e6190 con 0x7f5b341e4c30 2024-04-26T20:58:37.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.983+0000 7f5b3b200640 1 -- 172.21.15.138:0/3521823286 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b34069510 con 0x7f5b341e4c30 2024-04-26T20:58:37.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.983+0000 7f5b2be00640 1 -- 172.21.15.138:0/3521823286 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5b2c0c1070 con 0x7f5b341e4c30 2024-04-26T20:58:37.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.983+0000 7f5b2be00640 1 --2- 172.21.15.138:0/3521823286 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5b140683b0 0x7f5b1406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:37.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.983+0000 7f5b2be00640 1 -- 172.21.15.138:0/3521823286 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6318+0+0 (secure 0 0 0) 0x7f5b2c120570 con 0x7f5b341e4c30 2024-04-26T20:58:37.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.987+0000 7f5b33e00640 1 --2- 172.21.15.138:0/3521823286 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5b140683b0 0x7f5b1406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:37.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.987+0000 7f5b33e00640 1 --2- 172.21.15.138:0/3521823286 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5b140683b0 0x7f5b1406a870 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5b24000c10 tx=0x7f5b24009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:37.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:37.987+0000 7f5b2be00640 1 -- 172.21.15.138:0/3521823286 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5b2c016970 con 0x7f5b341e4c30 2024-04-26T20:58:38.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.147+0000 7f5b3b200640 1 -- 172.21.15.138:0/3521823286 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5b340d1910 con 0x7f5b341e4c30 2024-04-26T20:58:38.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.147+0000 7f5b2be00640 1 -- 172.21.15.138:0/3521823286 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=-16 pool 'cephfs_data' is in use by CephFS v52) ==== 181+0+0 (secure 0 0 0) 0x7f5b2c0f0300 con 0x7f5b341e4c30 2024-04-26T20:58:38.148 INFO:teuthology.orchestra.run.smithi138.stderr:Error EBUSY: pool 'cephfs_data' is in use by CephFS 2024-04-26T20:58:38.157 DEBUG:teuthology.orchestra.run:got remote process result: 16 2024-04-26T20:58:38.158 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:58:38.294 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.291+0000 7f2301200640 1 Processor -- start 2024-04-26T20:58:38.294 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.291+0000 7f2301200640 1 -- start start 2024-04-26T20:58:38.295 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.291+0000 7f2301200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f22fc0cbe00 0x7f22fc06de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:38.295 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.291+0000 7f2301200640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f22fc0cc1e0 0x7f22fc073b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:38.295 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.291+0000 7f2301200640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f22fc0ce6f0 0x7f22fc0ceb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:38.295 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.291+0000 7f2301200640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f22fc073680 con 0x7f22fc0cc1e0 2024-04-26T20:58:38.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.291+0000 7f2301200640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f22fc0727f0 con 0x7f22fc0ce6f0 2024-04-26T20:58:38.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.291+0000 7f2301200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f22fc072a70 con 0x7f22fc0cbe00 2024-04-26T20:58:38.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.291+0000 7f22f1400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f22fc0cc1e0 0x7f22fc073b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:38.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.291+0000 7f22f1400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f22fc0cc1e0 0x7f22fc073b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:32784/0 (socket says 172.21.15.138:32784) 2024-04-26T20:58:38.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.291+0000 7f22f1400640 1 -- 172.21.15.138:0/441967282 learned_addr learned my addr 172.21.15.138:0/441967282 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:38.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.295+0000 7f22fa800640 1 --2- 172.21.15.138:0/441967282 >> v2:172.21.15.143:3300/0 conn(0x7f22fc0ce6f0 0x7f22fc0ceb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:38.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.295+0000 7f22f9e00640 1 --2- 172.21.15.138:0/441967282 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f22fc0cbe00 0x7f22fc06de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:38.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.295+0000 7f22f1400640 1 -- 172.21.15.138:0/441967282 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f22fc0cbe00 msgr2=0x7f22fc06de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:38.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.295+0000 7f22f1400640 1 --2- 172.21.15.138:0/441967282 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f22fc0cbe00 0x7f22fc06de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:38.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.295+0000 7f22f1400640 1 -- 172.21.15.138:0/441967282 >> v2:172.21.15.143:3300/0 conn(0x7f22fc0ce6f0 msgr2=0x7f22fc0ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:38.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.295+0000 7f22f1400640 1 --2- 172.21.15.138:0/441967282 >> v2:172.21.15.143:3300/0 conn(0x7f22fc0ce6f0 0x7f22fc0ceb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:38.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.295+0000 7f22f1400640 1 -- 172.21.15.138:0/441967282 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22fc072d50 con 0x7f22fc0cc1e0 2024-04-26T20:58:38.298 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.295+0000 7f22f1400640 1 --2- 172.21.15.138:0/441967282 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22fc0cc1e0 0x7f22fc073b10 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f22fc071b00 tx=0x7f22e401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e221ffccc3c68c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:38.298 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.295+0000 7f22f9400640 1 -- 172.21.15.138:0/441967282 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e40b1070 con 0x7f22fc0cc1e0 2024-04-26T20:58:38.298 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.295+0000 7f22f9400640 1 -- 172.21.15.138:0/441967282 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22e40ac630 con 0x7f22fc0cc1e0 2024-04-26T20:58:38.298 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.295+0000 7f22f9400640 1 -- 172.21.15.138:0/441967282 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e40a8050 con 0x7f22fc0cc1e0 2024-04-26T20:58:38.299 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.295+0000 7f2301200640 1 -- 172.21.15.138:0/441967282 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22fc0cc1e0 msgr2=0x7f22fc073b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:38.299 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.295+0000 7f2301200640 1 --2- 172.21.15.138:0/441967282 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22fc0cc1e0 0x7f22fc073b10 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f22fc071b00 tx=0x7f22e401c520 comp rx=0 tx=0).stop 2024-04-26T20:58:38.299 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.299+0000 7f2301200640 1 -- 172.21.15.138:0/441967282 shutdown_connections 2024-04-26T20:58:38.299 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.299+0000 7f2301200640 1 --2- 172.21.15.138:0/441967282 >> v2:172.21.15.143:3300/0 conn(0x7f22fc0ce6f0 0x7f22fc0ceb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:38.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.299+0000 7f2301200640 1 --2- 172.21.15.138:0/441967282 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22fc0cc1e0 0x7f22fc073b10 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:38.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.299+0000 7f2301200640 1 --2- 172.21.15.138:0/441967282 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f22fc0cbe00 0x7f22fc06de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:38.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.299+0000 7f2301200640 1 -- 172.21.15.138:0/441967282 >> 172.21.15.138:0/441967282 conn(0x7f22fc0d0b20 msgr2=0x7f22fc0d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:38.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.299+0000 7f2301200640 1 -- 172.21.15.138:0/441967282 shutdown_connections 2024-04-26T20:58:38.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.299+0000 7f2301200640 1 -- 172.21.15.138:0/441967282 wait complete. 2024-04-26T20:58:38.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.299+0000 7f2301200640 1 Processor -- start 2024-04-26T20:58:38.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.299+0000 7f2301200640 1 -- start start 2024-04-26T20:58:38.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.299+0000 7f2301200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22fc0cbe00 0x7f22fc150950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:38.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.299+0000 7f2301200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f22fc0cc1e0 0x7f22fc145f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:38.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.299+0000 7f2301200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f22fc0ce6f0 0x7f22fc0c5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:38.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.299+0000 7f2301200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f22fc06e530 con 0x7f22fc0cbe00 2024-04-26T20:58:38.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.299+0000 7f2301200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f22fc06e3b0 con 0x7f22fc0cc1e0 2024-04-26T20:58:38.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.299+0000 7f2301200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f22fc074050 con 0x7f22fc0ce6f0 2024-04-26T20:58:38.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.299+0000 7f22f9e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22fc0cbe00 0x7f22fc150950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:38.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.299+0000 7f22f9e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22fc0cbe00 0x7f22fc150950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:32792/0 (socket says 172.21.15.138:32792) 2024-04-26T20:58:38.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.299+0000 7f22f9e00640 1 -- 172.21.15.138:0/3778857809 learned_addr learned my addr 172.21.15.138:0/3778857809 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:38.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.299+0000 7f22f1400640 1 --2- 172.21.15.138:0/3778857809 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f22fc0cc1e0 0x7f22fc145f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:38.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.299+0000 7f22fa800640 1 --2- 172.21.15.138:0/3778857809 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f22fc0ce6f0 0x7f22fc0c5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:38.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.299+0000 7f22f9e00640 1 -- 172.21.15.138:0/3778857809 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f22fc0ce6f0 msgr2=0x7f22fc0c5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:38.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.299+0000 7f22f9e00640 1 --2- 172.21.15.138:0/3778857809 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f22fc0ce6f0 0x7f22fc0c5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:38.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.299+0000 7f22f9e00640 1 -- 172.21.15.138:0/3778857809 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f22fc0cc1e0 msgr2=0x7f22fc145f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:38.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.299+0000 7f22f9e00640 1 --2- 172.21.15.138:0/3778857809 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f22fc0cc1e0 0x7f22fc145f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:38.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.299+0000 7f22f9e00640 1 -- 172.21.15.138:0/3778857809 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22fc146440 con 0x7f22fc0cbe00 2024-04-26T20:58:38.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.299+0000 7f22f9e00640 1 --2- 172.21.15.138:0/3778857809 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22fc0cbe00 0x7f22fc150950 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f22ec007e60 tx=0x7f22ec00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:38.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.299+0000 7f22f2a00640 1 -- 172.21.15.138:0/3778857809 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ec014620 con 0x7f22fc0cbe00 2024-04-26T20:58:38.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.299+0000 7f22f2a00640 1 -- 172.21.15.138:0/3778857809 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22ec019070 con 0x7f22fc0cbe00 2024-04-26T20:58:38.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.303+0000 7f2301200640 1 -- 172.21.15.138:0/3778857809 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22fc152160 con 0x7f22fc0cbe00 2024-04-26T20:58:38.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.303+0000 7f22f2a00640 1 -- 172.21.15.138:0/3778857809 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ec014a00 con 0x7f22fc0cbe00 2024-04-26T20:58:38.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.303+0000 7f2301200640 1 -- 172.21.15.138:0/3778857809 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22fc1513a0 con 0x7f22fc0cbe00 2024-04-26T20:58:38.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.303+0000 7f2301200640 1 -- 172.21.15.138:0/3778857809 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22fc069510 con 0x7f22fc0cbe00 2024-04-26T20:58:38.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.303+0000 7f22f2a00640 1 -- 172.21.15.138:0/3778857809 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f22ec014ba0 con 0x7f22fc0cbe00 2024-04-26T20:58:38.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.303+0000 7f22f2a00640 1 --2- 172.21.15.138:0/3778857809 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f22d8068380 0x7f22d806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:38.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.303+0000 7f22f2a00640 1 -- 172.21.15.138:0/3778857809 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6318+0+0 (secure 0 0 0) 0x7f22ec087460 con 0x7f22fc0cbe00 2024-04-26T20:58:38.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.303+0000 7f22f1400640 1 --2- 172.21.15.138:0/3778857809 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f22d8068380 0x7f22d806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:38.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.303+0000 7f22f1400640 1 --2- 172.21.15.138:0/3778857809 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f22d8068380 0x7f22d806a840 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f22e40ae000 tx=0x7f22e4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:38.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.307+0000 7f22f2a00640 1 -- 172.21.15.138:0/3778857809 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f22ec0577b0 con 0x7f22fc0cbe00 2024-04-26T20:58:38.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.467+0000 7f2301200640 1 -- 172.21.15.138:0/3778857809 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f22fc0cb880 con 0x7f22fc0cbe00 2024-04-26T20:58:38.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.467+0000 7f22f2a00640 1 -- 172.21.15.138:0/3778857809 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) ==== 74+0+17331 (secure 0 0 0) 0x7f22ec0570b0 con 0x7f22fc0cbe00 2024-04-26T20:58:38.469 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:38.469 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":52,"fsid":"c22b4730-12cc-4558-8535-b965384398c0","created":"2024-04-26T20:56:14.182475+0000","modified":"2024-04-26T20:58:37.797563+0000","last_up_change":"2024-04-26T20:56:26.013243+0000","last_in_change":"2024-04-26T20:56:16.714055+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:56:27.265834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-26T20:57:50.901951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"recovery_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"recovery_fs_metadata","create_time":"2024-04-26T20:58:09.327192+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"recovery_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3f9a2e34-3199-466f-a6cf-57927318121e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6801","nonce":3534772245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6803","nonce":3534772245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6807","nonce":3534772245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6805","nonce":3534772245}]},"public_addr":"172.21.15.138:6801/3534772245","cluster_addr":"172.21.15.138:6803/3534772245","heartbeat_back_addr":"172.21.15.138:6807/3534772245","heartbeat_front_addr":"172.21.15.138:6805/3534772245","state":["exists","up"]},{"osd":1,"uuid":"e881fcf6-3248-4696-a2ef-95d206d77712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6817","nonce":1427635773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6819","nonce":1427635773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6823","nonce":1427635773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6821","nonce":1427635773}]},"public_addr":"172.21.15.138:6817/1427635773","cluster_addr":"172.21.15.138:6819/1427635773","heartbeat_back_addr":"172.21.15.138:6823/1427635773","heartbeat_front_addr":"172.21.15.138:6821/1427635773","state":["exists","up"]},{"osd":2,"uuid":"f7d1db33-7672-4699-ae47-9f1e0a8e4222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6809","nonce":4273721573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6811","nonce":4273721573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6815","nonce":4273721573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6813","nonce":4273721573}]},"public_addr":"172.21.15.138:6809/4273721573","cluster_addr":"172.21.15.138:6811/4273721573","heartbeat_back_addr":"172.21.15.138:6815/4273721573","heartbeat_front_addr":"172.21.15.138:6813/4273721573","state":["exists","up"]},{"osd":3,"uuid":"2f4e0a9a-b8f6-4468-844a-a4501cd85054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6825","nonce":3098242154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6827","nonce":3098242154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6831","nonce":3098242154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6829","nonce":3098242154}]},"public_addr":"172.21.15.138:6825/3098242154","cluster_addr":"172.21.15.138:6827/3098242154","heartbeat_back_addr":"172.21.15.138:6831/3098242154","heartbeat_front_addr":"172.21.15.138:6829/3098242154","state":["exists","up"]},{"osd":4,"uuid":"c85df99b-3624-410e-866b-86830af2cfe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6801","nonce":2942056312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6803","nonce":2942056312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6807","nonce":2942056312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6805","nonce":2942056312}]},"public_addr":"172.21.15.143:6801/2942056312","cluster_addr":"172.21.15.143:6803/2942056312","heartbeat_back_addr":"172.21.15.143:6807/2942056312","heartbeat_front_addr":"172.21.15.143:6805/2942056312","state":["exists","up"]},{"osd":5,"uuid":"9af1efb5-c416-4808-b5ef-de0679ab9705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6809","nonce":1910222887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6811","nonce":1910222887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6815","nonce":1910222887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6813","nonce":1910222887}]},"public_addr":"172.21.15.143:6809/1910222887","cluster_addr":"172.21.15.143:6811/1910222887","heartbeat_back_addr":"172.21.15.143:6815/1910222887","heartbeat_front_addr":"172.21.15.143:6813/1910222887","state":["exists","up"]},{"osd":6,"uuid":"d7138615-8838-45ff-9072-2fd0683362f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6817","nonce":1082239825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6819","nonce":1082239825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6823","nonce":1082239825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6821","nonce":1082239825}]},"public_addr":"172.21.15.143:6817/1082239825","cluster_addr":"172.21.15.143:6819/1082239825","heartbeat_back_addr":"172.21.15.143:6823/1082239825","heartbeat_front_addr":"172.21.15.143:6821/1082239825","state":["exists","up"]},{"osd":7,"uuid":"0c27172b-35c4-49ec-ba0b-0137b8ff0010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6825","nonce":3295508495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6827","nonce":3295508495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6831","nonce":3295508495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6829","nonce":3295508495}]},"public_addr":"172.21.15.143:6825/3295508495","cluster_addr":"172.21.15.143:6827/3295508495","heartbeat_back_addr":"172.21.15.143:6831/3295508495","heartbeat_front_addr":"172.21.15.143:6829/3295508495","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.326627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.396119+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.433915+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.414179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.216947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.329272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.503073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.436382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.d","mappings":[{"from":1,"to":2}]},{"pgid":"6.23","mappings":[{"from":3,"to":2}]},{"pgid":"6.2b","mappings":[{"from":4,"to":7}]},{"pgid":"6.30","mappings":[{"from":4,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.143:6836/483370849":"2024-04-27T20:58:07.183664+0000","172.21.15.143:6834/483370849":"2024-04-27T20:58:07.183664+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:58:38.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.467+0000 7f2301200640 1 -- 172.21.15.138:0/3778857809 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f22d8068380 msgr2=0x7f22d806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:38.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.467+0000 7f2301200640 1 --2- 172.21.15.138:0/3778857809 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f22d8068380 0x7f22d806a840 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f22e40ae000 tx=0x7f22e4008040 comp rx=0 tx=0).stop 2024-04-26T20:58:38.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.467+0000 7f2301200640 1 -- 172.21.15.138:0/3778857809 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22fc0cbe00 msgr2=0x7f22fc150950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:38.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.467+0000 7f2301200640 1 --2- 172.21.15.138:0/3778857809 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22fc0cbe00 0x7f22fc150950 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f22ec007e60 tx=0x7f22ec00e4b0 comp rx=0 tx=0).stop 2024-04-26T20:58:38.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.467+0000 7f2301200640 1 -- 172.21.15.138:0/3778857809 shutdown_connections 2024-04-26T20:58:38.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.467+0000 7f2301200640 1 --2- 172.21.15.138:0/3778857809 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f22d8068380 0x7f22d806a840 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:38.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.467+0000 7f2301200640 1 --2- 172.21.15.138:0/3778857809 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f22fc0ce6f0 0x7f22fc0c5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:38.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.467+0000 7f2301200640 1 --2- 172.21.15.138:0/3778857809 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f22fc0cc1e0 0x7f22fc145f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:38.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.467+0000 7f2301200640 1 --2- 172.21.15.138:0/3778857809 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22fc0cbe00 0x7f22fc150950 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:38.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.467+0000 7f2301200640 1 -- 172.21.15.138:0/3778857809 >> 172.21.15.138:0/3778857809 conn(0x7f22fc0d0b20 msgr2=0x7f22fc0cde30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:38.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.467+0000 7f2301200640 1 -- 172.21.15.138:0/3778857809 shutdown_connections 2024-04-26T20:58:38.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.467+0000 7f2301200640 1 -- 172.21.15.138:0/3778857809 wait complete. 2024-04-26T20:58:38.490 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:56:27.265834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T20:57:50.901951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'recovery_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'recovery_fs_metadata', 'create_time': '2024-04-26T20:58:09.327192+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'recovery_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T20:58:38.490 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T20:58:38.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.627+0000 7f1a40e00640 1 Processor -- start 2024-04-26T20:58:38.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.627+0000 7f1a40e00640 1 -- start start 2024-04-26T20:58:38.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.627+0000 7f1a40e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f1a3c15b730 0x7f1a3c073e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:38.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.627+0000 7f1a40e00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1a3c06ee80 0x7f1a3c0ce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:38.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.627+0000 7f1a40e00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a3c0cbe40 con 0x7f1a3c0738e0 2024-04-26T20:58:38.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.627+0000 7f1a40e00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f1a3c0cbbf0 con 0x7f1a3c15b730 2024-04-26T20:58:38.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.627+0000 7f1a40e00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f1a3c0731c0 con 0x7f1a3c06ee80 2024-04-26T20:58:38.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.627+0000 7f1a39e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f1a3c15b730 0x7f1a3c073e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:38.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.627+0000 7f1a33e00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f1a3c0738e0 0x7f1a3c06e770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:51824/0 (socket says 172.21.15.138:51824) 2024-04-26T20:58:38.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.627+0000 7f1a33e00640 1 -- 172.21.15.138:0/4247342397 learned_addr learned my addr 172.21.15.138:0/4247342397 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:38.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.631+0000 7f1a3a800640 1 --2- 172.21.15.138:0/4247342397 >> v2:172.21.15.143:3300/0 conn(0x7f1a3c06ee80 0x7f1a3c0ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:38.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.631+0000 7f1a39e00640 1 -- 172.21.15.138:0/4247342397 >> v2:172.21.15.143:3300/0 conn(0x7f1a3c06ee80 msgr2=0x7f1a3c0ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:38.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.631+0000 7f1a39e00640 1 --2- 172.21.15.138:0/4247342397 >> v2:172.21.15.143:3300/0 conn(0x7f1a3c06ee80 0x7f1a3c0ce780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:38.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.631+0000 7f1a39e00640 1 -- 172.21.15.138:0/4247342397 >> v1:172.21.15.138:6789/0 conn(0x7f1a3c0738e0 legacy=0x7f1a3c06e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:38.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.631+0000 7f1a39e00640 1 -- 172.21.15.138:0/4247342397 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a3c0cc120 con 0x7f1a3c15b730 2024-04-26T20:58:38.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.631+0000 7f1a39400640 1 -- 172.21.15.138:0/4247342397 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 512992044 0 0) 0x7f1a3c0cbe40 con 0x7f1a3c0738e0 2024-04-26T20:58:38.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.631+0000 7f1a39e00640 1 --2- 172.21.15.138:0/4247342397 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a3c15b730 0x7f1a3c073e10 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c071f50 tx=0x7f1a2c01d680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e1ce43cbd25f3a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:38.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.631+0000 7f1a39400640 1 -- 172.21.15.138:0/4247342397 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c0a76c0 con 0x7f1a3c15b730 2024-04-26T20:58:38.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.631+0000 7f1a39400640 1 -- 172.21.15.138:0/4247342397 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a2c0a7860 con 0x7f1a3c15b730 2024-04-26T20:58:38.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.631+0000 7f1a39400640 1 -- 172.21.15.138:0/4247342397 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c0a7c30 con 0x7f1a3c15b730 2024-04-26T20:58:38.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.631+0000 7f1a40e00640 1 -- 172.21.15.138:0/4247342397 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a3c15b730 msgr2=0x7f1a3c073e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:38.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.631+0000 7f1a40e00640 1 --2- 172.21.15.138:0/4247342397 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a3c15b730 0x7f1a3c073e10 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c071f50 tx=0x7f1a2c01d680 comp rx=0 tx=0).stop 2024-04-26T20:58:38.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.635+0000 7f1a40e00640 1 -- 172.21.15.138:0/4247342397 shutdown_connections 2024-04-26T20:58:38.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.635+0000 7f1a40e00640 1 --2- 172.21.15.138:0/4247342397 >> v2:172.21.15.143:3300/0 conn(0x7f1a3c06ee80 0x7f1a3c0ce780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:38.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.635+0000 7f1a40e00640 1 --2- 172.21.15.138:0/4247342397 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a3c15b730 0x7f1a3c073e10 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:38.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.635+0000 7f1a40e00640 1 -- 172.21.15.138:0/4247342397 >> 172.21.15.138:0/4247342397 conn(0x7f1a3c0d0bb0 msgr2=0x7f1a3c0d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:38.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.635+0000 7f1a40e00640 1 -- 172.21.15.138:0/4247342397 shutdown_connections 2024-04-26T20:58:38.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.635+0000 7f1a40e00640 1 -- 172.21.15.138:0/4247342397 wait complete. 2024-04-26T20:58:38.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.635+0000 7f1a40e00640 1 Processor -- start 2024-04-26T20:58:38.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.635+0000 7f1a40e00640 1 -- start start 2024-04-26T20:58:38.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.635+0000 7f1a40e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a3c06ee80 0x7f1a3c1556c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:38.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.635+0000 7f1a40e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1a3c0738e0 0x7f1a3c14e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:38.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.635+0000 7f1a40e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1a3c15b730 0x7f1a3c0c8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:38.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.635+0000 7f1a40e00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3c0cee40 con 0x7f1a3c06ee80 2024-04-26T20:58:38.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.635+0000 7f1a40e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3c0cecc0 con 0x7f1a3c15b730 2024-04-26T20:58:38.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.635+0000 7f1a40e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f1a3c0cefc0 con 0x7f1a3c0738e0 2024-04-26T20:58:38.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.635+0000 7f1a39e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a3c06ee80 0x7f1a3c1556c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:38.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.635+0000 7f1a39e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a3c06ee80 0x7f1a3c1556c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:32800/0 (socket says 172.21.15.138:32800) 2024-04-26T20:58:38.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.635+0000 7f1a39e00640 1 -- 172.21.15.138:0/2819575501 learned_addr learned my addr 172.21.15.138:0/2819575501 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:38.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.635+0000 7f1a33e00640 1 --2- 172.21.15.138:0/2819575501 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1a3c0738e0 0x7f1a3c14e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:38.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.635+0000 7f1a3a800640 1 --2- 172.21.15.138:0/2819575501 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1a3c15b730 0x7f1a3c0c8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:38.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.635+0000 7f1a39e00640 1 -- 172.21.15.138:0/2819575501 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1a3c0738e0 msgr2=0x7f1a3c14e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:38.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.635+0000 7f1a39e00640 1 --2- 172.21.15.138:0/2819575501 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1a3c0738e0 0x7f1a3c14e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:38.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.635+0000 7f1a39e00640 1 -- 172.21.15.138:0/2819575501 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1a3c15b730 msgr2=0x7f1a3c0c8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:38.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.635+0000 7f1a39e00640 1 --2- 172.21.15.138:0/2819575501 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1a3c15b730 0x7f1a3c0c8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:38.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.635+0000 7f1a39e00640 1 -- 172.21.15.138:0/2819575501 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a3c15e8b0 con 0x7f1a3c06ee80 2024-04-26T20:58:38.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.635+0000 7f1a39e00640 1 --2- 172.21.15.138:0/2819575501 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a3c06ee80 0x7f1a3c1556c0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c01a290 tx=0x7f1a2c01a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:38.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.635+0000 7f1a32000640 1 -- 172.21.15.138:0/2819575501 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c0af830 con 0x7f1a3c06ee80 2024-04-26T20:58:38.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.635+0000 7f1a32000640 1 -- 172.21.15.138:0/2819575501 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a2c0be070 con 0x7f1a3c06ee80 2024-04-26T20:58:38.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.639+0000 7f1a40e00640 1 -- 172.21.15.138:0/2819575501 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a3c0ca400 con 0x7f1a3c06ee80 2024-04-26T20:58:38.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.639+0000 7f1a32000640 1 -- 172.21.15.138:0/2819575501 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c0afbf0 con 0x7f1a3c06ee80 2024-04-26T20:58:38.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.639+0000 7f1a40e00640 1 -- 172.21.15.138:0/2819575501 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a3c0ca9c0 con 0x7f1a3c06ee80 2024-04-26T20:58:38.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.639+0000 7f1a40e00640 1 -- 172.21.15.138:0/2819575501 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a3c069430 con 0x7f1a3c06ee80 2024-04-26T20:58:38.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.639+0000 7f1a32000640 1 -- 172.21.15.138:0/2819575501 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1a2c0c2410 con 0x7f1a3c06ee80 2024-04-26T20:58:38.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.639+0000 7f1a32000640 1 --2- 172.21.15.138:0/2819575501 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1a18068380 0x7f1a1806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:38.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.639+0000 7f1a32000640 1 -- 172.21.15.138:0/2819575501 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6318+0+0 (secure 0 0 0) 0x7f1a2c121080 con 0x7f1a3c06ee80 2024-04-26T20:58:38.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.639+0000 7f1a33e00640 1 --2- 172.21.15.138:0/2819575501 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1a18068380 0x7f1a1806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:38.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.639+0000 7f1a33e00640 1 --2- 172.21.15.138:0/2819575501 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1a18068380 0x7f1a1806a840 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c0d1200 tx=0x7f1a24007b60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:38.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.643+0000 7f1a32000640 1 -- 172.21.15.138:0/2819575501 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1a2c0c7020 con 0x7f1a3c06ee80 2024-04-26T20:58:38.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.799+0000 7f1a40e00640 1 -- 172.21.15.138:0/2819575501 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1a3c0d19c0 con 0x7f1a3c06ee80 2024-04-26T20:58:38.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.799+0000 7f1a32000640 1 -- 172.21.15.138:0/2819575501 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v52) ==== 93+0+10 (secure 0 0 0) 0x7f1a3c15e8b0 con 0x7f1a3c06ee80 2024-04-26T20:58:38.803 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 1 2024-04-26T20:58:38.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.803+0000 7f1a40e00640 1 -- 172.21.15.138:0/2819575501 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1a18068380 msgr2=0x7f1a1806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:38.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.803+0000 7f1a40e00640 1 --2- 172.21.15.138:0/2819575501 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1a18068380 0x7f1a1806a840 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c0d1200 tx=0x7f1a24007b60 comp rx=0 tx=0).stop 2024-04-26T20:58:38.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.803+0000 7f1a40e00640 1 -- 172.21.15.138:0/2819575501 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a3c06ee80 msgr2=0x7f1a3c1556c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:38.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.803+0000 7f1a40e00640 1 --2- 172.21.15.138:0/2819575501 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a3c06ee80 0x7f1a3c1556c0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c01a290 tx=0x7f1a2c01a420 comp rx=0 tx=0).stop 2024-04-26T20:58:38.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.803+0000 7f1a40e00640 1 -- 172.21.15.138:0/2819575501 shutdown_connections 2024-04-26T20:58:38.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.803+0000 7f1a40e00640 1 --2- 172.21.15.138:0/2819575501 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1a18068380 0x7f1a1806a840 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:38.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.803+0000 7f1a40e00640 1 --2- 172.21.15.138:0/2819575501 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1a3c15b730 0x7f1a3c0c8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:38.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.803+0000 7f1a40e00640 1 --2- 172.21.15.138:0/2819575501 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1a3c0738e0 0x7f1a3c14e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:38.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.803+0000 7f1a40e00640 1 --2- 172.21.15.138:0/2819575501 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a3c06ee80 0x7f1a3c1556c0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:38.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.803+0000 7f1a40e00640 1 -- 172.21.15.138:0/2819575501 >> 172.21.15.138:0/2819575501 conn(0x7f1a3c0d0bb0 msgr2=0x7f1a3c0b1790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:38.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.803+0000 7f1a40e00640 1 -- 172.21.15.138:0/2819575501 shutdown_connections 2024-04-26T20:58:38.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.803+0000 7f1a40e00640 1 -- 172.21.15.138:0/2819575501 wait complete. 2024-04-26T20:58:38.824 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T20:58:38.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.959+0000 7ff0ad000640 1 Processor -- start 2024-04-26T20:58:38.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.959+0000 7ff0ad000640 1 -- start start 2024-04-26T20:58:38.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.963+0000 7ff0ad000640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff0a80b53e0 0x7ff0a80b21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:38.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.963+0000 7ff0ad000640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0a80d0660 con 0x7ff0a8160750 2024-04-26T20:58:38.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.963+0000 7ff0ad000640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0a80d0380 con 0x7ff0a8160370 2024-04-26T20:58:38.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.963+0000 7ff0ad000640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7ff0a80ce340 con 0x7ff0a80b53e0 2024-04-26T20:58:38.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.963+0000 7ff0a6a00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7ff0a8160750 0x7ff0a8070030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:51832/0 (socket says 172.21.15.138:51832) 2024-04-26T20:58:38.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.963+0000 7ff0a6a00640 1 -- 172.21.15.138:0/2214412502 learned_addr learned my addr 172.21.15.138:0/2214412502 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:38.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.963+0000 7ff0a7e00640 1 --2- 172.21.15.138:0/2214412502 >> v2:172.21.15.143:3300/0 conn(0x7ff0a80b53e0 0x7ff0a80b21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:38.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.963+0000 7ff0a6000640 1 -- 172.21.15.138:0/2214412502 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3352862602 0 0) 0x7ff0a80d0660 con 0x7ff0a8160750 2024-04-26T20:58:38.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.963+0000 7ff0a6000640 1 -- 172.21.15.138:0/2214412502 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff08c003530 con 0x7ff0a8160750 2024-04-26T20:58:38.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.963+0000 7ff0a6000640 1 -- 172.21.15.138:0/2214412502 <== mon.0 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3810068217 0 0) 0x7ff08c003530 con 0x7ff0a8160750 2024-04-26T20:58:38.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.963+0000 7ff0a6000640 1 -- 172.21.15.138:0/2214412502 >> v2:172.21.15.143:3300/0 conn(0x7ff0a80b53e0 msgr2=0x7ff0a80b21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:38.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.963+0000 7ff0a6000640 1 --2- 172.21.15.138:0/2214412502 >> v2:172.21.15.143:3300/0 conn(0x7ff0a80b53e0 0x7ff0a80b21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:38.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.963+0000 7ff0a6000640 1 -- 172.21.15.138:0/2214412502 >> v1:172.21.15.143:6789/0 conn(0x7ff0a8160370 legacy=0x7ff0a80cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:38.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.963+0000 7ff0a6000640 1 -- 172.21.15.138:0/2214412502 --> v1:172.21.15.138:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0a80ce620 con 0x7ff0a8160750 2024-04-26T20:58:38.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.963+0000 7ff0a6000640 1 -- 172.21.15.138:0/2214412502 <== mon.0 v1:172.21.15.138:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2715389689 0 0) 0x7ff094001680 con 0x7ff0a8160750 2024-04-26T20:58:38.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.963+0000 7ff0a6000640 1 -- 172.21.15.138:0/2214412502 >> v1:172.21.15.138:6789/0 conn(0x7ff0a8160750 legacy=0x7ff0a8070030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:38.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.963+0000 7ff0a6000640 1 --2- 172.21.15.138:0/2214412502 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff08c0039c0 0x7ff08c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:38.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.963+0000 7ff0a6000640 1 --2- 172.21.15.138:0/2214412502 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff08c004810 0x7ff08c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:38.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.963+0000 7ff0a6000640 1 --2- 172.21.15.138:0/2214412502 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff08c0051d0 0x7ff08c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:38.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.963+0000 7ff0a6000640 1 -- 172.21.15.138:0/2214412502 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a80ce340 con 0x7ff08c004810 2024-04-26T20:58:38.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.963+0000 7ff0a6000640 1 -- 172.21.15.138:0/2214412502 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ff08c00c070 con 0x7ff08c0051d0 2024-04-26T20:58:38.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.963+0000 7ff0a6000640 1 -- 172.21.15.138:0/2214412502 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ff08c00c270 con 0x7ff08c0039c0 2024-04-26T20:58:38.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.963+0000 7ff0a6a00640 1 --2- 172.21.15.138:0/2214412502 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff08c004810 0x7ff08c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:38.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.963+0000 7ff0a7e00640 1 --2- 172.21.15.138:0/2214412502 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff08c0051d0 0x7ff08c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:38.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.963+0000 7ff0a7400640 1 --2- 172.21.15.138:0/2214412502 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff08c0039c0 0x7ff08c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:38.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.963+0000 7ff0a6a00640 1 -- 172.21.15.138:0/2214412502 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff08c0039c0 msgr2=0x7ff08c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:38.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.963+0000 7ff0a6a00640 1 --2- 172.21.15.138:0/2214412502 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff08c0039c0 0x7ff08c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:38.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.963+0000 7ff0a6a00640 1 -- 172.21.15.138:0/2214412502 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff08c0051d0 msgr2=0x7ff08c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:38.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.963+0000 7ff0a6a00640 1 --2- 172.21.15.138:0/2214412502 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff08c0051d0 0x7ff08c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:38.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.963+0000 7ff0a6a00640 1 -- 172.21.15.138:0/2214412502 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff08c003530 con 0x7ff08c004810 2024-04-26T20:58:38.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.963+0000 7ff0a7e00640 1 -- 172.21.15.138:0/2214412502 reap_dead start 2024-04-26T20:58:38.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.967+0000 7ff0a6a00640 1 --2- 172.21.15.138:0/2214412502 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff08c004810 0x7ff08c004c90 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7ff09400c210 tx=0x7ff09401f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c505eb88fb5d43d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:38.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.967+0000 7ff0a6000640 1 -- 172.21.15.138:0/2214412502 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff094007d40 con 0x7ff08c004810 2024-04-26T20:58:38.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.967+0000 7ff0a6000640 1 -- 172.21.15.138:0/2214412502 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff094005b00 con 0x7ff08c004810 2024-04-26T20:58:38.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.967+0000 7ff0a6000640 1 -- 172.21.15.138:0/2214412502 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff094007070 con 0x7ff08c004810 2024-04-26T20:58:38.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.967+0000 7ff0ad000640 1 -- 172.21.15.138:0/2214412502 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff08c004810 msgr2=0x7ff08c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:38.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.967+0000 7ff0ad000640 1 --2- 172.21.15.138:0/2214412502 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff08c004810 0x7ff08c004c90 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7ff09400c210 tx=0x7ff09401f3b0 comp rx=0 tx=0).stop 2024-04-26T20:58:38.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.967+0000 7ff0ad000640 1 -- 172.21.15.138:0/2214412502 shutdown_connections 2024-04-26T20:58:38.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.967+0000 7ff0ad000640 1 --2- 172.21.15.138:0/2214412502 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff08c004810 0x7ff08c004c90 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:38.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.967+0000 7ff0ad000640 1 -- 172.21.15.138:0/2214412502 >> 172.21.15.138:0/2214412502 conn(0x7ff0a80b4850 msgr2=0x7ff0a80b4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:38.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.967+0000 7ff0ad000640 1 -- 172.21.15.138:0/2214412502 shutdown_connections 2024-04-26T20:58:38.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.967+0000 7ff0ad000640 1 -- 172.21.15.138:0/2214412502 wait complete. 2024-04-26T20:58:38.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.967+0000 7ff0ad000640 1 Processor -- start 2024-04-26T20:58:38.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.971+0000 7ff0ad000640 1 -- start start 2024-04-26T20:58:38.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.971+0000 7ff0ad000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff08c004810 0x7ff0a815c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:38.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.971+0000 7ff0ad000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff0a81f4860 0x7ff0a81f4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:38.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.971+0000 7ff0ad000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff0a81e73b0 0x7ff0a81e7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:38.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.971+0000 7ff0ad000640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a80b2530 con 0x7ff0a81e73b0 2024-04-26T20:58:38.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.971+0000 7ff0ad000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a80b23b0 con 0x7ff0a81f4860 2024-04-26T20:58:38.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.971+0000 7ff0ad000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ff0a80cf570 con 0x7ff08c004810 2024-04-26T20:58:38.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.971+0000 7ff0a7e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff0a81e73b0 0x7ff0a81e7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:38.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.971+0000 7ff0a7e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff0a81e73b0 0x7ff0a81e7840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:32824/0 (socket says 172.21.15.138:32824) 2024-04-26T20:58:38.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.971+0000 7ff0a7e00640 1 -- 172.21.15.138:0/1529738144 learned_addr learned my addr 172.21.15.138:0/1529738144 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:38.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.971+0000 7ff0a7400640 1 --2- 172.21.15.138:0/1529738144 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff08c004810 0x7ff0a815c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:38.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.971+0000 7ff0a6a00640 1 --2- 172.21.15.138:0/1529738144 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff0a81f4860 0x7ff0a81f4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:38.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.971+0000 7ff0a7e00640 1 -- 172.21.15.138:0/1529738144 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff08c004810 msgr2=0x7ff0a815c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:38.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.971+0000 7ff0a7e00640 1 --2- 172.21.15.138:0/1529738144 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff08c004810 0x7ff0a815c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:38.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.971+0000 7ff0a7e00640 1 -- 172.21.15.138:0/1529738144 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff0a81f4860 msgr2=0x7ff0a81f4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:38.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.971+0000 7ff0a7e00640 1 --2- 172.21.15.138:0/1529738144 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff0a81f4860 0x7ff0a81f4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:38.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.971+0000 7ff0a7e00640 1 -- 172.21.15.138:0/1529738144 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0a81f5350 con 0x7ff0a81e73b0 2024-04-26T20:58:38.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.971+0000 7ff0a7e00640 1 --2- 172.21.15.138:0/1529738144 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff0a81e73b0 0x7ff0a81e7840 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7ff0a8072280 tx=0x7ff0a0011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:38.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.971+0000 7ff09f400640 1 -- 172.21.15.138:0/1529738144 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a0019020 con 0x7ff0a81e73b0 2024-04-26T20:58:38.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.971+0000 7ff09f400640 1 -- 172.21.15.138:0/1529738144 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0a0003620 con 0x7ff0a81e73b0 2024-04-26T20:58:38.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.971+0000 7ff0ad000640 1 -- 172.21.15.138:0/1529738144 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0a81f5630 con 0x7ff0a81e73b0 2024-04-26T20:58:38.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.971+0000 7ff09f400640 1 -- 172.21.15.138:0/1529738144 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a0003a10 con 0x7ff0a81e73b0 2024-04-26T20:58:38.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.971+0000 7ff0ad000640 1 -- 172.21.15.138:0/1529738144 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0a81e6e90 con 0x7ff0a81e73b0 2024-04-26T20:58:38.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.971+0000 7ff0ad000640 1 -- 172.21.15.138:0/1529738144 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0a81e7090 con 0x7ff0a81e73b0 2024-04-26T20:58:38.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.975+0000 7ff09f400640 1 -- 172.21.15.138:0/1529738144 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff0a001c020 con 0x7ff0a81e73b0 2024-04-26T20:58:38.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.975+0000 7ff09f400640 1 --2- 172.21.15.138:0/1529738144 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff088068380 0x7ff08806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:38.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.975+0000 7ff09f400640 1 -- 172.21.15.138:0/1529738144 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6318+0+0 (secure 0 0 0) 0x7ff0a0086d20 con 0x7ff0a81e73b0 2024-04-26T20:58:38.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.975+0000 7ff0a7400640 1 --2- 172.21.15.138:0/1529738144 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff088068380 0x7ff08806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:38.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.975+0000 7ff0a7400640 1 --2- 172.21.15.138:0/1529738144 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff088068380 0x7ff08806a840 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff098000f90 tx=0x7ff098001520 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:38.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:38.983+0000 7ff09f400640 1 -- 172.21.15.138:0/1529738144 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff0a81e7090 con 0x7ff0a81e73b0 2024-04-26T20:58:39.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.139+0000 7ff0ad000640 1 -- 172.21.15.138:0/1529738144 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff0a8070370 con 0x7ff0a81e73b0 2024-04-26T20:58:39.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.139+0000 7ff09f400640 1 -- 172.21.15.138:0/1529738144 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v52) ==== 100+0+11 (secure 0 0 0) 0x7ff0a0023030 con 0x7ff0a81e73b0 2024-04-26T20:58:39.143 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 64 2024-04-26T20:58:39.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.143+0000 7ff0ad000640 1 -- 172.21.15.138:0/1529738144 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff088068380 msgr2=0x7ff08806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:39.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.143+0000 7ff0ad000640 1 --2- 172.21.15.138:0/1529738144 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff088068380 0x7ff08806a840 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff098000f90 tx=0x7ff098001520 comp rx=0 tx=0).stop 2024-04-26T20:58:39.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.143+0000 7ff0ad000640 1 -- 172.21.15.138:0/1529738144 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff0a81e73b0 msgr2=0x7ff0a81e7840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:39.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.143+0000 7ff0ad000640 1 --2- 172.21.15.138:0/1529738144 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff0a81e73b0 0x7ff0a81e7840 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7ff0a8072280 tx=0x7ff0a0011920 comp rx=0 tx=0).stop 2024-04-26T20:58:39.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.143+0000 7ff0ad000640 1 -- 172.21.15.138:0/1529738144 shutdown_connections 2024-04-26T20:58:39.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.143+0000 7ff0ad000640 1 --2- 172.21.15.138:0/1529738144 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7ff088068380 0x7ff08806a840 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:39.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.143+0000 7ff0ad000640 1 --2- 172.21.15.138:0/1529738144 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff0a81e73b0 0x7ff0a81e7840 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:39.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.143+0000 7ff0ad000640 1 --2- 172.21.15.138:0/1529738144 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff0a81f4860 0x7ff0a81f4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:39.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.143+0000 7ff0ad000640 1 --2- 172.21.15.138:0/1529738144 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff08c004810 0x7ff0a815c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:39.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.143+0000 7ff0ad000640 1 -- 172.21.15.138:0/1529738144 >> 172.21.15.138:0/1529738144 conn(0x7ff0a80b4850 msgr2=0x7ff0a80b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:39.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.143+0000 7ff0ad000640 1 -- 172.21.15.138:0/1529738144 shutdown_connections 2024-04-26T20:58:39.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.143+0000 7ff0ad000640 1 -- 172.21.15.138:0/1529738144 wait complete. 2024-04-26T20:58:39.164 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get recovery_fs_metadata pg_num 2024-04-26T20:58:39.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.303+0000 7f941c600640 1 Processor -- start 2024-04-26T20:58:39.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.303+0000 7f941c600640 1 -- start start 2024-04-26T20:58:39.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.303+0000 7f941c600640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f94140cf950 0x7f941406c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:39.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.303+0000 7f941c600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f94140cd6d0 0x7f94140c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:39.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.303+0000 7f941c600640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94140cbab0 con 0x7f941415efe0 2024-04-26T20:58:39.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.303+0000 7f941c600640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f9414163940 con 0x7f94140cf950 2024-04-26T20:58:39.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.303+0000 7f941c600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f94140cbd30 con 0x7f94140cd6d0 2024-04-26T20:58:39.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.303+0000 7f9419200640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f94140cf950 0x7f941406c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:39.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.303+0000 7f941a600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f94140cd6d0 0x7f94140c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:39.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.303+0000 7f9419c00640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f941415efe0 0x7f94140cf240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.138:58656/0 (socket says 172.21.15.138:58656) 2024-04-26T20:58:39.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.303+0000 7f9419c00640 1 -- 172.21.15.138:0/2326484296 learned_addr learned my addr 172.21.15.138:0/2326484296 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:39.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.303+0000 7f9419200640 1 -- 172.21.15.138:0/2326484296 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f94140cd6d0 msgr2=0x7f94140c7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:39.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.303+0000 7f9419200640 1 --2- 172.21.15.138:0/2326484296 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f94140cd6d0 0x7f94140c7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:39.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.303+0000 7f9419200640 1 -- 172.21.15.138:0/2326484296 >> v1:172.21.15.143:6789/0 conn(0x7f941415efe0 legacy=0x7f94140cf240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:39.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.303+0000 7f9419200640 1 -- 172.21.15.138:0/2326484296 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94140cc010 con 0x7f94140cf950 2024-04-26T20:58:39.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.303+0000 7f941a600640 1 --2- 172.21.15.138:0/2326484296 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f94140cd6d0 0x7f94140c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:58:39.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.307+0000 7f9419200640 1 --2- 172.21.15.138:0/2326484296 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94140cf950 0x7f941406c300 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f94000097c0 tx=0x7f940001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccf2e294082a9d7f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:39.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.307+0000 7f9413e00640 1 -- 172.21.15.138:0/2326484296 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94000b1070 con 0x7f94140cf950 2024-04-26T20:58:39.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.307+0000 7f9413e00640 1 -- 172.21.15.138:0/2326484296 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94000ac410 con 0x7f94140cf950 2024-04-26T20:58:39.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.307+0000 7f9413e00640 1 -- 172.21.15.138:0/2326484296 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94000ac7e0 con 0x7f94140cf950 2024-04-26T20:58:39.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.307+0000 7f941c600640 1 -- 172.21.15.138:0/2326484296 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94140cf950 msgr2=0x7f941406c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:39.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.307+0000 7f941c600640 1 --2- 172.21.15.138:0/2326484296 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94140cf950 0x7f941406c300 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f94000097c0 tx=0x7f940001c4a0 comp rx=0 tx=0).stop 2024-04-26T20:58:39.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.307+0000 7f941c600640 1 -- 172.21.15.138:0/2326484296 shutdown_connections 2024-04-26T20:58:39.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.307+0000 7f941c600640 1 --2- 172.21.15.138:0/2326484296 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f94140cd6d0 0x7f94140c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:39.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.307+0000 7f941c600640 1 --2- 172.21.15.138:0/2326484296 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94140cf950 0x7f941406c300 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:39.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.307+0000 7f941c600640 1 -- 172.21.15.138:0/2326484296 >> 172.21.15.138:0/2326484296 conn(0x7f94140cdee0 msgr2=0x7f94140ce2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:39.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.307+0000 7f941c600640 1 -- 172.21.15.138:0/2326484296 shutdown_connections 2024-04-26T20:58:39.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.307+0000 7f941c600640 1 -- 172.21.15.138:0/2326484296 wait complete. 2024-04-26T20:58:39.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.311+0000 7f941c600640 1 Processor -- start 2024-04-26T20:58:39.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.311+0000 7f941c600640 1 -- start start 2024-04-26T20:58:39.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.311+0000 7f941c600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94140cd6d0 0x7f94140b0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:39.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.311+0000 7f941c600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94140cf950 0x7f94141595a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:39.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.311+0000 7f941c600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f941415efe0 0x7f9414141c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:39.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.311+0000 7f941c600640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f94140cd020 con 0x7f94140cf950 2024-04-26T20:58:39.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.311+0000 7f941c600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f941415f5d0 con 0x7f94140cd6d0 2024-04-26T20:58:39.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.311+0000 7f941c600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f94140cd1a0 con 0x7f941415efe0 2024-04-26T20:58:39.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.311+0000 7f9419200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94140cf950 0x7f94141595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:39.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.311+0000 7f9419200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94140cf950 0x7f94141595a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:32838/0 (socket says 172.21.15.138:32838) 2024-04-26T20:58:39.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.311+0000 7f9419200640 1 -- 172.21.15.138:0/1656843341 learned_addr learned my addr 172.21.15.138:0/1656843341 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:39.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.311+0000 7f9419c00640 1 --2- 172.21.15.138:0/1656843341 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94140cd6d0 0x7f94140b0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:39.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.311+0000 7f941a600640 1 --2- 172.21.15.138:0/1656843341 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f941415efe0 0x7f9414141c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:39.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.311+0000 7f9419200640 1 -- 172.21.15.138:0/1656843341 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f941415efe0 msgr2=0x7f9414141c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:39.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.311+0000 7f9419200640 1 --2- 172.21.15.138:0/1656843341 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f941415efe0 0x7f9414141c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:39.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.311+0000 7f9419200640 1 -- 172.21.15.138:0/1656843341 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94140cd6d0 msgr2=0x7f94140b0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:39.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.311+0000 7f9419200640 1 --2- 172.21.15.138:0/1656843341 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94140cd6d0 0x7f94140b0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:39.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.311+0000 7f9419200640 1 -- 172.21.15.138:0/1656843341 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9414142160 con 0x7f94140cf950 2024-04-26T20:58:39.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.311+0000 7f9419200640 1 --2- 172.21.15.138:0/1656843341 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94140cf950 0x7f94141595a0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f94000af040 tx=0x7f9400019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:39.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.311+0000 7f9411600640 1 -- 172.21.15.138:0/1656843341 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94000b1040 con 0x7f94140cf950 2024-04-26T20:58:39.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.311+0000 7f9411600640 1 -- 172.21.15.138:0/1656843341 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94000ba070 con 0x7f94140cf950 2024-04-26T20:58:39.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.311+0000 7f941c600640 1 -- 172.21.15.138:0/1656843341 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94141423f0 con 0x7f94140cf950 2024-04-26T20:58:39.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.311+0000 7f9411600640 1 -- 172.21.15.138:0/1656843341 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9400006e20 con 0x7f94140cf950 2024-04-26T20:58:39.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.311+0000 7f941c600640 1 -- 172.21.15.138:0/1656843341 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94141429b0 con 0x7f94140cf950 2024-04-26T20:58:39.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.311+0000 7f941c600640 1 -- 172.21.15.138:0/1656843341 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9414069430 con 0x7f94140cf950 2024-04-26T20:58:39.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.315+0000 7f9411600640 1 -- 172.21.15.138:0/1656843341 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f94000b5690 con 0x7f94140cf950 2024-04-26T20:58:39.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.315+0000 7f9411600640 1 --2- 172.21.15.138:0/1656843341 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f93f4068380 0x7f93f406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:39.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.315+0000 7f9411600640 1 -- 172.21.15.138:0/1656843341 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6318+0+0 (secure 0 0 0) 0x7f9400120790 con 0x7f94140cf950 2024-04-26T20:58:39.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.315+0000 7f9419c00640 1 --2- 172.21.15.138:0/1656843341 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f93f4068380 0x7f93f406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:39.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.315+0000 7f9419c00640 1 --2- 172.21.15.138:0/1656843341 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f93f4068380 0x7f93f406a840 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9408000f70 tx=0x7f9408007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:39.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.319+0000 7f9411600640 1 -- 172.21.15.138:0/1656843341 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9400016090 con 0x7f94140cf950 2024-04-26T20:58:39.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.475+0000 7f941c600640 1 -- 172.21.15.138:0/1656843341 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "recovery_fs_metadata", "var": "pg_num"} v 0) -- 0x7f9414068690 con 0x7f94140cf950 2024-04-26T20:58:39.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.475+0000 7f9411600640 1 -- 172.21.15.138:0/1656843341 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "recovery_fs_metadata", "var": "pg_num"}]=0 v52) ==== 109+0+11 (secure 0 0 0) 0x7f94000f0a50 con 0x7f94140cf950 2024-04-26T20:58:39.478 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 32 2024-04-26T20:58:39.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.479+0000 7f941c600640 1 -- 172.21.15.138:0/1656843341 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f93f4068380 msgr2=0x7f93f406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:39.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.479+0000 7f941c600640 1 --2- 172.21.15.138:0/1656843341 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f93f4068380 0x7f93f406a840 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9408000f70 tx=0x7f9408007e90 comp rx=0 tx=0).stop 2024-04-26T20:58:39.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.479+0000 7f941c600640 1 -- 172.21.15.138:0/1656843341 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94140cf950 msgr2=0x7f94141595a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:39.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.479+0000 7f941c600640 1 --2- 172.21.15.138:0/1656843341 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94140cf950 0x7f94141595a0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f94000af040 tx=0x7f9400019240 comp rx=0 tx=0).stop 2024-04-26T20:58:39.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.479+0000 7f941c600640 1 -- 172.21.15.138:0/1656843341 shutdown_connections 2024-04-26T20:58:39.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.479+0000 7f941c600640 1 --2- 172.21.15.138:0/1656843341 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f93f4068380 0x7f93f406a840 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:39.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.479+0000 7f941c600640 1 --2- 172.21.15.138:0/1656843341 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f941415efe0 0x7f9414141c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:39.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.479+0000 7f941c600640 1 --2- 172.21.15.138:0/1656843341 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94140cf950 0x7f94141595a0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:39.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.479+0000 7f941c600640 1 --2- 172.21.15.138:0/1656843341 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94140cd6d0 0x7f94140b0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:39.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.479+0000 7f941c600640 1 -- 172.21.15.138:0/1656843341 >> 172.21.15.138:0/1656843341 conn(0x7f94140cdee0 msgr2=0x7f9414072f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:39.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.479+0000 7f941c600640 1 -- 172.21.15.138:0/1656843341 shutdown_connections 2024-04-26T20:58:39.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.479+0000 7f941c600640 1 -- 172.21.15.138:0/1656843341 wait complete. 2024-04-26T20:58:39.499 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:58:39.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.635+0000 7f5727800640 1 Processor -- start 2024-04-26T20:58:39.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.635+0000 7f5727800640 1 -- start start 2024-04-26T20:58:39.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.635+0000 7f5727800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f572015cf80 0x7f5720073b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:39.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.635+0000 7f5727800640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f57200cc1e0 0x7f57200ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:39.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.635+0000 7f5727800640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57200727f0 con 0x7f57200cbe00 2024-04-26T20:58:39.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.635+0000 7f5727800640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f5720073680 con 0x7f572015cf80 2024-04-26T20:58:39.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.635+0000 7f5727800640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f5720072a70 con 0x7f57200cc1e0 2024-04-26T20:58:39.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.635+0000 7f571fe00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f572015cf80 0x7f5720073b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:39.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.635+0000 7f571fe00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f572015cf80 0x7f5720073b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:32852/0 (socket says 172.21.15.138:32852) 2024-04-26T20:58:39.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.635+0000 7f571fe00640 1 -- 172.21.15.138:0/2210419553 learned_addr learned my addr 172.21.15.138:0/2210419553 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:39.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.635+0000 7f5725800640 1 --2- 172.21.15.138:0/2210419553 >> v2:172.21.15.143:3300/0 conn(0x7f57200cc1e0 0x7f57200ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:39.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.635+0000 7f571fe00640 1 -- 172.21.15.138:0/2210419553 >> v2:172.21.15.143:3300/0 conn(0x7f57200cc1e0 msgr2=0x7f57200ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:39.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.635+0000 7f571fe00640 1 --2- 172.21.15.138:0/2210419553 >> v2:172.21.15.143:3300/0 conn(0x7f57200cc1e0 0x7f57200ce6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:39.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.635+0000 7f571fe00640 1 -- 172.21.15.138:0/2210419553 >> v1:172.21.15.143:6789/0 conn(0x7f57200cbe00 legacy=0x7f572006de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:39.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.635+0000 7f571fe00640 1 -- 172.21.15.138:0/2210419553 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5720072d50 con 0x7f572015cf80 2024-04-26T20:58:39.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.639+0000 7f571fe00640 1 --2- 172.21.15.138:0/2210419553 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f572015cf80 0x7f5720073b10 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f572006f9c0 tx=0x7f570c01ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d22cf75fc39909d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:39.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.639+0000 7f571f400640 1 -- 172.21.15.138:0/2210419553 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570c0b4070 con 0x7f572015cf80 2024-04-26T20:58:39.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.639+0000 7f571f400640 1 -- 172.21.15.138:0/2210419553 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f570c0a79c0 con 0x7f572015cf80 2024-04-26T20:58:39.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.639+0000 7f571f400640 1 -- 172.21.15.138:0/2210419553 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570c0a7d90 con 0x7f572015cf80 2024-04-26T20:58:39.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.639+0000 7f5727800640 1 -- 172.21.15.138:0/2210419553 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f572015cf80 msgr2=0x7f5720073b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:39.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.639+0000 7f5727800640 1 --2- 172.21.15.138:0/2210419553 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f572015cf80 0x7f5720073b10 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f572006f9c0 tx=0x7f570c01ebf0 comp rx=0 tx=0).stop 2024-04-26T20:58:39.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.639+0000 7f5727800640 1 -- 172.21.15.138:0/2210419553 shutdown_connections 2024-04-26T20:58:39.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.639+0000 7f5727800640 1 --2- 172.21.15.138:0/2210419553 >> v2:172.21.15.143:3300/0 conn(0x7f57200cc1e0 0x7f57200ce6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:39.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.639+0000 7f5727800640 1 --2- 172.21.15.138:0/2210419553 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f572015cf80 0x7f5720073b10 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:39.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.639+0000 7f5727800640 1 -- 172.21.15.138:0/2210419553 >> 172.21.15.138:0/2210419553 conn(0x7f57200d0b20 msgr2=0x7f57200d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:39.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.639+0000 7f5727800640 1 -- 172.21.15.138:0/2210419553 shutdown_connections 2024-04-26T20:58:39.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.639+0000 7f5727800640 1 -- 172.21.15.138:0/2210419553 wait complete. 2024-04-26T20:58:39.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.639+0000 7f5727800640 1 Processor -- start 2024-04-26T20:58:39.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.643+0000 7f5727800640 1 -- start start 2024-04-26T20:58:39.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.643+0000 7f5727800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f57200cbe00 0x7f57200c93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:39.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.643+0000 7f5727800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f57200cc1e0 0x7f5720151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:39.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.643+0000 7f5727800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f572015cf80 0x7f57201f7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:39.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.643+0000 7f5727800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f57200741d0 con 0x7f57200cc1e0 2024-04-26T20:58:39.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.643+0000 7f5727800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f5720074050 con 0x7f572015cf80 2024-04-26T20:58:39.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.643+0000 7f5727800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f57200d0780 con 0x7f57200cbe00 2024-04-26T20:58:39.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.643+0000 7f571fe00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f57200cc1e0 0x7f5720151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:39.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.643+0000 7f571fe00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f57200cc1e0 0x7f5720151e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:32868/0 (socket says 172.21.15.138:32868) 2024-04-26T20:58:39.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.643+0000 7f571fe00640 1 -- 172.21.15.138:0/2189479154 learned_addr learned my addr 172.21.15.138:0/2189479154 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:39.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.643+0000 7f5725800640 1 --2- 172.21.15.138:0/2189479154 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f572015cf80 0x7f57201f7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:39.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.643+0000 7f5724e00640 1 --2- 172.21.15.138:0/2189479154 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f57200cbe00 0x7f57200c93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:39.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.643+0000 7f571fe00640 1 -- 172.21.15.138:0/2189479154 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f57200cbe00 msgr2=0x7f57200c93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:39.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.643+0000 7f571fe00640 1 --2- 172.21.15.138:0/2189479154 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f57200cbe00 0x7f57200c93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:39.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.643+0000 7f571fe00640 1 -- 172.21.15.138:0/2189479154 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f572015cf80 msgr2=0x7f57201f7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:39.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.643+0000 7f571fe00640 1 --2- 172.21.15.138:0/2189479154 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f572015cf80 0x7f57201f7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:39.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.643+0000 7f571fe00640 1 -- 172.21.15.138:0/2189479154 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5720153360 con 0x7f57200cc1e0 2024-04-26T20:58:39.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.643+0000 7f5725800640 1 --2- 172.21.15.138:0/2189479154 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f572015cf80 0x7f57201f7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:58:39.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.643+0000 7f571fe00640 1 --2- 172.21.15.138:0/2189479154 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f57200cc1e0 0x7f5720151e00 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f570c01c820 tx=0x7f570c01b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:39.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.643+0000 7f571cc00640 1 -- 172.21.15.138:0/2189479154 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570c0b4040 con 0x7f57200cc1e0 2024-04-26T20:58:39.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.643+0000 7f571cc00640 1 -- 172.21.15.138:0/2189479154 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f570c0c1070 con 0x7f57200cc1e0 2024-04-26T20:58:39.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.643+0000 7f5727800640 1 -- 172.21.15.138:0/2189479154 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57200c8600 con 0x7f57200cc1e0 2024-04-26T20:58:39.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.643+0000 7f571cc00640 1 -- 172.21.15.138:0/2189479154 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570c0af940 con 0x7f57200cc1e0 2024-04-26T20:58:39.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.643+0000 7f5727800640 1 -- 172.21.15.138:0/2189479154 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57200c8bc0 con 0x7f57200cc1e0 2024-04-26T20:58:39.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.643+0000 7f5727800640 1 -- 172.21.15.138:0/2189479154 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5720069510 con 0x7f57200cc1e0 2024-04-26T20:58:39.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.647+0000 7f571cc00640 1 -- 172.21.15.138:0/2189479154 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f570c0b7070 con 0x7f57200cc1e0 2024-04-26T20:58:39.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.647+0000 7f571cc00640 1 --2- 172.21.15.138:0/2189479154 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5700068380 0x7f570006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:39.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.647+0000 7f571cc00640 1 -- 172.21.15.138:0/2189479154 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6318+0+0 (secure 0 0 0) 0x7f570c1237b0 con 0x7f57200cc1e0 2024-04-26T20:58:39.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.647+0000 7f5724e00640 1 --2- 172.21.15.138:0/2189479154 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5700068380 0x7f570006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:39.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.647+0000 7f5724e00640 1 --2- 172.21.15.138:0/2189479154 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5700068380 0x7f570006a840 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f57140015b0 tx=0x7f5714009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:39.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.651+0000 7f571cc00640 1 -- 172.21.15.138:0/2189479154 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f570c0187e0 con 0x7f57200cc1e0 2024-04-26T20:58:39.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.839+0000 7f5727800640 1 -- 172.21.15.138:0/2189479154 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f57200cb050 con 0x7f57200cc1e0 2024-04-26T20:58:39.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.843+0000 7f571cc00640 1 -- 172.21.15.138:0/2189479154 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+5190 (secure 0 0 0) 0x7f570c0f3b20 con 0x7f57200cc1e0 2024-04-26T20:58:39.844 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:39.844 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":30,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5048,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/255610168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":255610168},{"type":"v1","addr":"172.21.15.143:6836","nonce":255610168}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5051,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/799063831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":799063831},{"type":"v1","addr":"172.21.15.143:6837","nonce":799063831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5410,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/976248149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":976248149},{"type":"v1","addr":"172.21.15.138:6835","nonce":976248149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:58:10.360154+0000","modified":"2024-04-26T20:58:24.737160+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5604":{"gid":5604,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.138:6834/2450256246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2450256246},{"type":"v1","addr":"172.21.15.138:6834","nonce":2450256246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":7,"enabled":true,"fs_name":"recovery_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5604,"qdb_cluster":[5604]},"id":3}]} 2024-04-26T20:58:39.844 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 30 2024-04-26T20:58:39.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.843+0000 7f5727800640 1 -- 172.21.15.138:0/2189479154 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5700068380 msgr2=0x7f570006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:39.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.843+0000 7f5727800640 1 --2- 172.21.15.138:0/2189479154 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5700068380 0x7f570006a840 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f57140015b0 tx=0x7f5714009040 comp rx=0 tx=0).stop 2024-04-26T20:58:39.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.843+0000 7f5727800640 1 -- 172.21.15.138:0/2189479154 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f57200cc1e0 msgr2=0x7f5720151e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:39.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.843+0000 7f5727800640 1 --2- 172.21.15.138:0/2189479154 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f57200cc1e0 0x7f5720151e00 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f570c01c820 tx=0x7f570c01b990 comp rx=0 tx=0).stop 2024-04-26T20:58:39.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.843+0000 7f5727800640 1 -- 172.21.15.138:0/2189479154 shutdown_connections 2024-04-26T20:58:39.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.843+0000 7f5727800640 1 --2- 172.21.15.138:0/2189479154 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5700068380 0x7f570006a840 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:39.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.843+0000 7f5727800640 1 --2- 172.21.15.138:0/2189479154 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f572015cf80 0x7f57201f7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:39.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.843+0000 7f5727800640 1 --2- 172.21.15.138:0/2189479154 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f57200cc1e0 0x7f5720151e00 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:39.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.843+0000 7f5727800640 1 --2- 172.21.15.138:0/2189479154 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f57200cbe00 0x7f57200c93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:39.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.843+0000 7f5727800640 1 -- 172.21.15.138:0/2189479154 >> 172.21.15.138:0/2189479154 conn(0x7f57200d0b20 msgr2=0x7f572015a050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:39.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.843+0000 7f5727800640 1 -- 172.21.15.138:0/2189479154 shutdown_connections 2024-04-26T20:58:39.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.843+0000 7f5727800640 1 -- 172.21.15.138:0/2189479154 wait complete. 2024-04-26T20:58:39.866 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:58:40.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.999+0000 7f70ea600640 1 Processor -- start 2024-04-26T20:58:40.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.999+0000 7f70ea600640 1 -- start start 2024-04-26T20:58:40.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.999+0000 7f70ea600640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f70e40cbe00 0x7f70e406de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:40.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.999+0000 7f70ea600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f70e40cc1e0 0x7f70e4073b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:40.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.999+0000 7f70ea600640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70e40727f0 con 0x7f70e40ce6f0 2024-04-26T20:58:40.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.999+0000 7f70ea600640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f70e4073680 con 0x7f70e40cbe00 2024-04-26T20:58:40.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.999+0000 7f70ea600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f70e4072a70 con 0x7f70e40cc1e0 2024-04-26T20:58:40.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.999+0000 7f70e3400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f70e40cbe00 0x7f70e406de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:40.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.999+0000 7f70e3e00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f70e40ce6f0 0x7f70e40ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:51840/0 (socket says 172.21.15.138:51840) 2024-04-26T20:58:40.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.999+0000 7f70e3e00640 1 -- 172.21.15.138:0/3882755595 learned_addr learned my addr 172.21.15.138:0/3882755595 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:40.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.999+0000 7f70dbe00640 1 --2- 172.21.15.138:0/3882755595 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f70e40cc1e0 0x7f70e4073b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:40.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.999+0000 7f70e3400640 1 -- 172.21.15.138:0/3882755595 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f70e40cc1e0 msgr2=0x7f70e4073b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:40.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.999+0000 7f70e3400640 1 --2- 172.21.15.138:0/3882755595 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f70e40cc1e0 0x7f70e4073b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:40.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.999+0000 7f70e3400640 1 -- 172.21.15.138:0/3882755595 >> v1:172.21.15.138:6789/0 conn(0x7f70e40ce6f0 legacy=0x7f70e40ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:40.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:39.999+0000 7f70e3400640 1 -- 172.21.15.138:0/3882755595 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70e4072d50 con 0x7f70e40cbe00 2024-04-26T20:58:40.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.003+0000 7f70e3400640 1 --2- 172.21.15.138:0/3882755595 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70e40cbe00 0x7f70e406de70 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f70d40097c0 tx=0x7f70d401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e4a18560be1685b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:40.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.003+0000 7f70e2a00640 1 -- 172.21.15.138:0/3882755595 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d40b0070 con 0x7f70e40cbe00 2024-04-26T20:58:40.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.003+0000 7f70e2a00640 1 -- 172.21.15.138:0/3882755595 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70d40ab600 con 0x7f70e40cbe00 2024-04-26T20:58:40.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.003+0000 7f70e2a00640 1 -- 172.21.15.138:0/3882755595 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d40ab9d0 con 0x7f70e40cbe00 2024-04-26T20:58:40.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.003+0000 7f70ea600640 1 -- 172.21.15.138:0/3882755595 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70e40cbe00 msgr2=0x7f70e406de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:40.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.003+0000 7f70ea600640 1 --2- 172.21.15.138:0/3882755595 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70e40cbe00 0x7f70e406de70 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f70d40097c0 tx=0x7f70d401c4a0 comp rx=0 tx=0).stop 2024-04-26T20:58:40.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.003+0000 7f70ea600640 1 -- 172.21.15.138:0/3882755595 shutdown_connections 2024-04-26T20:58:40.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.003+0000 7f70ea600640 1 --2- 172.21.15.138:0/3882755595 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f70e40cc1e0 0x7f70e4073b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:40.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.003+0000 7f70ea600640 1 --2- 172.21.15.138:0/3882755595 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70e40cbe00 0x7f70e406de70 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:40.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.003+0000 7f70ea600640 1 -- 172.21.15.138:0/3882755595 >> 172.21.15.138:0/3882755595 conn(0x7f70e40d0b20 msgr2=0x7f70e40d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:40.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.003+0000 7f70ea600640 1 -- 172.21.15.138:0/3882755595 shutdown_connections 2024-04-26T20:58:40.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.003+0000 7f70ea600640 1 -- 172.21.15.138:0/3882755595 wait complete. 2024-04-26T20:58:40.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.007+0000 7f70ea600640 1 Processor -- start 2024-04-26T20:58:40.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.007+0000 7f70ea600640 1 -- start start 2024-04-26T20:58:40.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.007+0000 7f70ea600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f70e40cbe00 0x7f70e40b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:40.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.007+0000 7f70ea600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70e40cc1e0 0x7f70e40b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:40.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.007+0000 7f70ea600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f70e40ce6f0 0x7f70e415af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:40.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.007+0000 7f70ea600640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f70e40741d0 con 0x7f70e40cc1e0 2024-04-26T20:58:40.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.007+0000 7f70ea600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f70e4074050 con 0x7f70e40cbe00 2024-04-26T20:58:40.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.007+0000 7f70ea600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f70e40d0780 con 0x7f70e40ce6f0 2024-04-26T20:58:40.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.007+0000 7f70dbe00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70e40cc1e0 0x7f70e40b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:40.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.007+0000 7f70dbe00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70e40cc1e0 0x7f70e40b1ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:32886/0 (socket says 172.21.15.138:32886) 2024-04-26T20:58:40.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.007+0000 7f70dbe00640 1 -- 172.21.15.138:0/2882184317 learned_addr learned my addr 172.21.15.138:0/2882184317 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:40.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.007+0000 7f70e3e00640 1 --2- 172.21.15.138:0/2882184317 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f70e40ce6f0 0x7f70e415af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:40.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.007+0000 7f70e3400640 1 --2- 172.21.15.138:0/2882184317 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f70e40cbe00 0x7f70e40b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:40.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.007+0000 7f70dbe00640 1 -- 172.21.15.138:0/2882184317 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f70e40ce6f0 msgr2=0x7f70e415af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:40.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.007+0000 7f70dbe00640 1 --2- 172.21.15.138:0/2882184317 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f70e40ce6f0 0x7f70e415af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:40.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.007+0000 7f70dbe00640 1 -- 172.21.15.138:0/2882184317 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f70e40cbe00 msgr2=0x7f70e40b3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:40.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.007+0000 7f70dbe00640 1 --2- 172.21.15.138:0/2882184317 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f70e40cbe00 0x7f70e40b3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:40.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.007+0000 7f70dbe00640 1 -- 172.21.15.138:0/2882184317 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70e41514a0 con 0x7f70e40cc1e0 2024-04-26T20:58:40.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.007+0000 7f70e3400640 1 --2- 172.21.15.138:0/2882184317 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f70e40cbe00 0x7f70e40b3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:58:40.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.007+0000 7f70dbe00640 1 --2- 172.21.15.138:0/2882184317 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70e40cc1e0 0x7f70e40b1ea0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f70cc00e930 tx=0x7f70cc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:40.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.007+0000 7f70db400640 1 -- 172.21.15.138:0/2882184317 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70cc017070 con 0x7f70e40cc1e0 2024-04-26T20:58:40.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.007+0000 7f70db400640 1 -- 172.21.15.138:0/2882184317 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70cc00ca00 con 0x7f70e40cc1e0 2024-04-26T20:58:40.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.007+0000 7f70db400640 1 -- 172.21.15.138:0/2882184317 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70cc00cdb0 con 0x7f70e40cc1e0 2024-04-26T20:58:40.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.007+0000 7f70ea600640 1 -- 172.21.15.138:0/2882184317 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70e4151710 con 0x7f70e40cc1e0 2024-04-26T20:58:40.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.007+0000 7f70ea600640 1 -- 172.21.15.138:0/2882184317 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70e4151fb0 con 0x7f70e40cc1e0 2024-04-26T20:58:40.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.011+0000 7f70ea600640 1 -- 172.21.15.138:0/2882184317 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70e41518e0 con 0x7f70e40cc1e0 2024-04-26T20:58:40.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.011+0000 7f70db400640 1 -- 172.21.15.138:0/2882184317 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f70cc01a070 con 0x7f70e40cc1e0 2024-04-26T20:58:40.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.011+0000 7f70db400640 1 --2- 172.21.15.138:0/2882184317 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f70c00683b0 0x7f70c006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:40.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.011+0000 7f70db400640 1 -- 172.21.15.138:0/2882184317 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6318+0+0 (secure 0 0 0) 0x7f70cc086fe0 con 0x7f70e40cc1e0 2024-04-26T20:58:40.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.011+0000 7f70e3400640 1 --2- 172.21.15.138:0/2882184317 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f70c00683b0 0x7f70c006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:40.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.011+0000 7f70e3400640 1 --2- 172.21.15.138:0/2882184317 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f70c00683b0 0x7f70c006a870 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f70d40ad000 tx=0x7f70d40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:40.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.015+0000 7f70db400640 1 -- 172.21.15.138:0/2882184317 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f70cc0573f0 con 0x7f70e40cc1e0 2024-04-26T20:58:40.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.171+0000 7f70ea600640 1 -- 172.21.15.138:0/2882184317 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f70e4069510 con 0x7f70e40cc1e0 2024-04-26T20:58:40.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.171+0000 7f70db400640 1 -- 172.21.15.138:0/2882184317 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) ==== 74+0+17331 (secure 0 0 0) 0x7f70cc056cf0 con 0x7f70e40cc1e0 2024-04-26T20:58:40.175 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:40.175 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":52,"fsid":"c22b4730-12cc-4558-8535-b965384398c0","created":"2024-04-26T20:56:14.182475+0000","modified":"2024-04-26T20:58:37.797563+0000","last_up_change":"2024-04-26T20:56:26.013243+0000","last_in_change":"2024-04-26T20:56:16.714055+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:56:27.265834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-26T20:57:50.901951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"recovery_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"recovery_fs_metadata","create_time":"2024-04-26T20:58:09.327192+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"recovery_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3f9a2e34-3199-466f-a6cf-57927318121e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6801","nonce":3534772245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6803","nonce":3534772245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6807","nonce":3534772245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6805","nonce":3534772245}]},"public_addr":"172.21.15.138:6801/3534772245","cluster_addr":"172.21.15.138:6803/3534772245","heartbeat_back_addr":"172.21.15.138:6807/3534772245","heartbeat_front_addr":"172.21.15.138:6805/3534772245","state":["exists","up"]},{"osd":1,"uuid":"e881fcf6-3248-4696-a2ef-95d206d77712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6817","nonce":1427635773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6819","nonce":1427635773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6823","nonce":1427635773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6821","nonce":1427635773}]},"public_addr":"172.21.15.138:6817/1427635773","cluster_addr":"172.21.15.138:6819/1427635773","heartbeat_back_addr":"172.21.15.138:6823/1427635773","heartbeat_front_addr":"172.21.15.138:6821/1427635773","state":["exists","up"]},{"osd":2,"uuid":"f7d1db33-7672-4699-ae47-9f1e0a8e4222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6809","nonce":4273721573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6811","nonce":4273721573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6815","nonce":4273721573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6813","nonce":4273721573}]},"public_addr":"172.21.15.138:6809/4273721573","cluster_addr":"172.21.15.138:6811/4273721573","heartbeat_back_addr":"172.21.15.138:6815/4273721573","heartbeat_front_addr":"172.21.15.138:6813/4273721573","state":["exists","up"]},{"osd":3,"uuid":"2f4e0a9a-b8f6-4468-844a-a4501cd85054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6825","nonce":3098242154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6827","nonce":3098242154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6831","nonce":3098242154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6829","nonce":3098242154}]},"public_addr":"172.21.15.138:6825/3098242154","cluster_addr":"172.21.15.138:6827/3098242154","heartbeat_back_addr":"172.21.15.138:6831/3098242154","heartbeat_front_addr":"172.21.15.138:6829/3098242154","state":["exists","up"]},{"osd":4,"uuid":"c85df99b-3624-410e-866b-86830af2cfe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6801","nonce":2942056312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6803","nonce":2942056312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6807","nonce":2942056312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6805","nonce":2942056312}]},"public_addr":"172.21.15.143:6801/2942056312","cluster_addr":"172.21.15.143:6803/2942056312","heartbeat_back_addr":"172.21.15.143:6807/2942056312","heartbeat_front_addr":"172.21.15.143:6805/2942056312","state":["exists","up"]},{"osd":5,"uuid":"9af1efb5-c416-4808-b5ef-de0679ab9705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6809","nonce":1910222887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6811","nonce":1910222887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6815","nonce":1910222887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6813","nonce":1910222887}]},"public_addr":"172.21.15.143:6809/1910222887","cluster_addr":"172.21.15.143:6811/1910222887","heartbeat_back_addr":"172.21.15.143:6815/1910222887","heartbeat_front_addr":"172.21.15.143:6813/1910222887","state":["exists","up"]},{"osd":6,"uuid":"d7138615-8838-45ff-9072-2fd0683362f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6817","nonce":1082239825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6819","nonce":1082239825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6823","nonce":1082239825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6821","nonce":1082239825}]},"public_addr":"172.21.15.143:6817/1082239825","cluster_addr":"172.21.15.143:6819/1082239825","heartbeat_back_addr":"172.21.15.143:6823/1082239825","heartbeat_front_addr":"172.21.15.143:6821/1082239825","state":["exists","up"]},{"osd":7,"uuid":"0c27172b-35c4-49ec-ba0b-0137b8ff0010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6825","nonce":3295508495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6827","nonce":3295508495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6831","nonce":3295508495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6829","nonce":3295508495}]},"public_addr":"172.21.15.143:6825/3295508495","cluster_addr":"172.21.15.143:6827/3295508495","heartbeat_back_addr":"172.21.15.143:6831/3295508495","heartbeat_front_addr":"172.21.15.143:6829/3295508495","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.326627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.396119+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.433915+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.414179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.216947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.329272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.503073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.436382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.d","mappings":[{"from":1,"to":2}]},{"pgid":"6.23","mappings":[{"from":3,"to":2}]},{"pgid":"6.2b","mappings":[{"from":4,"to":7}]},{"pgid":"6.30","mappings":[{"from":4,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.143:6836/483370849":"2024-04-27T20:58:07.183664+0000","172.21.15.143:6834/483370849":"2024-04-27T20:58:07.183664+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:58:40.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.175+0000 7f70ea600640 1 -- 172.21.15.138:0/2882184317 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f70c00683b0 msgr2=0x7f70c006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:40.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.175+0000 7f70ea600640 1 --2- 172.21.15.138:0/2882184317 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f70c00683b0 0x7f70c006a870 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f70d40ad000 tx=0x7f70d40a6000 comp rx=0 tx=0).stop 2024-04-26T20:58:40.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.175+0000 7f70ea600640 1 -- 172.21.15.138:0/2882184317 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70e40cc1e0 msgr2=0x7f70e40b1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:40.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.175+0000 7f70ea600640 1 --2- 172.21.15.138:0/2882184317 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70e40cc1e0 0x7f70e40b1ea0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f70cc00e930 tx=0x7f70cc00edf0 comp rx=0 tx=0).stop 2024-04-26T20:58:40.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.175+0000 7f70ea600640 1 -- 172.21.15.138:0/2882184317 shutdown_connections 2024-04-26T20:58:40.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.175+0000 7f70ea600640 1 --2- 172.21.15.138:0/2882184317 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f70c00683b0 0x7f70c006a870 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:40.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.175+0000 7f70ea600640 1 --2- 172.21.15.138:0/2882184317 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f70e40ce6f0 0x7f70e415af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:40.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.175+0000 7f70ea600640 1 --2- 172.21.15.138:0/2882184317 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70e40cc1e0 0x7f70e40b1ea0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:40.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.175+0000 7f70ea600640 1 --2- 172.21.15.138:0/2882184317 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f70e40cbe00 0x7f70e40b3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:40.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.175+0000 7f70ea600640 1 -- 172.21.15.138:0/2882184317 >> 172.21.15.138:0/2882184317 conn(0x7f70e40d0b20 msgr2=0x7f70e406eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:40.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.175+0000 7f70ea600640 1 -- 172.21.15.138:0/2882184317 shutdown_connections 2024-04-26T20:58:40.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.175+0000 7f70ea600640 1 -- 172.21.15.138:0/2882184317 wait complete. 2024-04-26T20:58:40.196 INFO:tasks.cephfs.filesystem:Destroying file system recovery_fs and related pools 2024-04-26T20:58:40.196 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:58:40.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.331+0000 7efc70600640 1 Processor -- start 2024-04-26T20:58:40.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.331+0000 7efc70600640 1 -- start start 2024-04-26T20:58:40.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.331+0000 7efc70600640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7efc6815ce20 0x7efc68161340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:40.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.331+0000 7efc70600640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7efc6815e0c0 0x7efc68071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:40.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.331+0000 7efc70600640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc68073b70 con 0x7efc680cca00 2024-04-26T20:58:40.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.331+0000 7efc70600640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7efc68073e10 con 0x7efc6815e0c0 2024-04-26T20:58:40.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.331+0000 7efc70600640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7efc680740f0 con 0x7efc6815ce20 2024-04-26T20:58:40.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.331+0000 7efc6d200640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7efc6815e0c0 0x7efc68071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:40.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.331+0000 7efc6d200640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7efc6815e0c0 0x7efc68071ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:32896/0 (socket says 172.21.15.138:32896) 2024-04-26T20:58:40.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.331+0000 7efc6d200640 1 -- 172.21.15.138:0/2748878795 learned_addr learned my addr 172.21.15.138:0/2748878795 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:40.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.331+0000 7efc6dc00640 1 --2- 172.21.15.138:0/2748878795 >> v2:172.21.15.143:3300/0 conn(0x7efc6815ce20 0x7efc68161340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:40.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.331+0000 7efc6d200640 1 -- 172.21.15.138:0/2748878795 >> v2:172.21.15.143:3300/0 conn(0x7efc6815ce20 msgr2=0x7efc68161340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:40.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.331+0000 7efc6d200640 1 --2- 172.21.15.138:0/2748878795 >> v2:172.21.15.143:3300/0 conn(0x7efc6815ce20 0x7efc68161340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:40.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.331+0000 7efc6d200640 1 -- 172.21.15.138:0/2748878795 >> v1:172.21.15.143:6789/0 conn(0x7efc680cca00 legacy=0x7efc680cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:40.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.331+0000 7efc6d200640 1 -- 172.21.15.138:0/2748878795 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc68160b40 con 0x7efc6815e0c0 2024-04-26T20:58:40.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.335+0000 7efc6d200640 1 --2- 172.21.15.138:0/2748878795 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efc6815e0c0 0x7efc68071ee0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7efc6806fb00 tx=0x7efc5401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1be8b4fe261ff3b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:40.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.335+0000 7efc67e00640 1 -- 172.21.15.138:0/2748878795 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc540b1070 con 0x7efc6815e0c0 2024-04-26T20:58:40.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.335+0000 7efc67e00640 1 -- 172.21.15.138:0/2748878795 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc540ac410 con 0x7efc6815e0c0 2024-04-26T20:58:40.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.335+0000 7efc67e00640 1 -- 172.21.15.138:0/2748878795 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc540ac7e0 con 0x7efc6815e0c0 2024-04-26T20:58:40.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.335+0000 7efc70600640 1 -- 172.21.15.138:0/2748878795 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efc6815e0c0 msgr2=0x7efc68071ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:40.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.335+0000 7efc70600640 1 --2- 172.21.15.138:0/2748878795 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efc6815e0c0 0x7efc68071ee0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7efc6806fb00 tx=0x7efc5401c490 comp rx=0 tx=0).stop 2024-04-26T20:58:40.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.335+0000 7efc70600640 1 -- 172.21.15.138:0/2748878795 shutdown_connections 2024-04-26T20:58:40.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.335+0000 7efc70600640 1 --2- 172.21.15.138:0/2748878795 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efc6815e0c0 0x7efc68071ee0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:40.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.335+0000 7efc70600640 1 --2- 172.21.15.138:0/2748878795 >> v2:172.21.15.143:3300/0 conn(0x7efc6815ce20 0x7efc68161340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:40.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.335+0000 7efc70600640 1 -- 172.21.15.138:0/2748878795 >> 172.21.15.138:0/2748878795 conn(0x7efc680d0b20 msgr2=0x7efc680d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:40.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.335+0000 7efc70600640 1 -- 172.21.15.138:0/2748878795 shutdown_connections 2024-04-26T20:58:40.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.335+0000 7efc70600640 1 -- 172.21.15.138:0/2748878795 wait complete. 2024-04-26T20:58:40.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.339+0000 7efc70600640 1 Processor -- start 2024-04-26T20:58:40.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.339+0000 7efc70600640 1 -- start start 2024-04-26T20:58:40.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.339+0000 7efc70600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efc680cca00 0x7efc68155bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:40.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.339+0000 7efc70600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efc6815ce20 0x7efc68148570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:40.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.339+0000 7efc70600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efc6815e0c0 0x7efc681498d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:40.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.339+0000 7efc70600640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7efc6815d380 con 0x7efc6815e0c0 2024-04-26T20:58:40.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.339+0000 7efc70600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7efc6815d200 con 0x7efc6815ce20 2024-04-26T20:58:40.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.339+0000 7efc70600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7efc6806e680 con 0x7efc680cca00 2024-04-26T20:58:40.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.339+0000 7efc6e600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efc6815e0c0 0x7efc681498d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:40.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.339+0000 7efc6e600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efc6815e0c0 0x7efc681498d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:32908/0 (socket says 172.21.15.138:32908) 2024-04-26T20:58:40.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.339+0000 7efc6e600640 1 -- 172.21.15.138:0/4283673541 learned_addr learned my addr 172.21.15.138:0/4283673541 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:40.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.339+0000 7efc6dc00640 1 --2- 172.21.15.138:0/4283673541 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efc680cca00 0x7efc68155bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:40.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.339+0000 7efc6d200640 1 --2- 172.21.15.138:0/4283673541 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efc6815ce20 0x7efc68148570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:40.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.339+0000 7efc6e600640 1 -- 172.21.15.138:0/4283673541 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efc680cca00 msgr2=0x7efc68155bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:40.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.339+0000 7efc6e600640 1 --2- 172.21.15.138:0/4283673541 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efc680cca00 0x7efc68155bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:40.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.339+0000 7efc6e600640 1 -- 172.21.15.138:0/4283673541 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efc6815ce20 msgr2=0x7efc68148570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:40.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.339+0000 7efc6e600640 1 --2- 172.21.15.138:0/4283673541 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efc6815ce20 0x7efc68148570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:40.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.339+0000 7efc6e600640 1 -- 172.21.15.138:0/4283673541 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc68156110 con 0x7efc6815e0c0 2024-04-26T20:58:40.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.339+0000 7efc6e600640 1 --2- 172.21.15.138:0/4283673541 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efc6815e0c0 0x7efc681498d0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7efc6000c7b0 tx=0x7efc6000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:40.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.339+0000 7efc65600640 1 -- 172.21.15.138:0/4283673541 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc60004b70 con 0x7efc6815e0c0 2024-04-26T20:58:40.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.339+0000 7efc65600640 1 -- 172.21.15.138:0/4283673541 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc60004d10 con 0x7efc6815e0c0 2024-04-26T20:58:40.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.339+0000 7efc65600640 1 -- 172.21.15.138:0/4283673541 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc6000aa90 con 0x7efc6815e0c0 2024-04-26T20:58:40.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.339+0000 7efc70600640 1 -- 172.21.15.138:0/4283673541 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc68156670 con 0x7efc6815e0c0 2024-04-26T20:58:40.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.339+0000 7efc70600640 1 -- 172.21.15.138:0/4283673541 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc68148df0 con 0x7efc6815e0c0 2024-04-26T20:58:40.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.339+0000 7efc70600640 1 -- 172.21.15.138:0/4283673541 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc68069510 con 0x7efc6815e0c0 2024-04-26T20:58:40.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.343+0000 7efc65600640 1 -- 172.21.15.138:0/4283673541 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efc6000ac30 con 0x7efc6815e0c0 2024-04-26T20:58:40.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.343+0000 7efc65600640 1 --2- 172.21.15.138:0/4283673541 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7efc48068380 0x7efc4806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:40.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.343+0000 7efc65600640 1 -- 172.21.15.138:0/4283673541 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6318+0+0 (secure 0 0 0) 0x7efc60086e80 con 0x7efc6815e0c0 2024-04-26T20:58:40.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.343+0000 7efc6dc00640 1 --2- 172.21.15.138:0/4283673541 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7efc48068380 0x7efc4806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:40.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.343+0000 7efc6dc00640 1 --2- 172.21.15.138:0/4283673541 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7efc48068380 0x7efc4806a840 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7efc5c00b9d0 tx=0x7efc5c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:40.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.347+0000 7efc65600640 1 -- 172.21.15.138:0/4283673541 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7efc60020070 con 0x7efc6815e0c0 2024-04-26T20:58:40.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.539+0000 7efc70600640 1 -- 172.21.15.138:0/4283673541 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efc680c7930 con 0x7efc6815e0c0 2024-04-26T20:58:40.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.539+0000 7efc65600640 1 -- 172.21.15.138:0/4283673541 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+5190 (secure 0 0 0) 0x7efc68156110 con 0x7efc6815e0c0 2024-04-26T20:58:40.541 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:40.541 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":30,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5048,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/255610168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":255610168},{"type":"v1","addr":"172.21.15.143:6836","nonce":255610168}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5051,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/799063831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":799063831},{"type":"v1","addr":"172.21.15.143:6837","nonce":799063831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5410,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/976248149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":976248149},{"type":"v1","addr":"172.21.15.138:6835","nonce":976248149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:58:10.360154+0000","modified":"2024-04-26T20:58:24.737160+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5604":{"gid":5604,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.138:6834/2450256246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2450256246},{"type":"v1","addr":"172.21.15.138:6834","nonce":2450256246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":7,"enabled":true,"fs_name":"recovery_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5604,"qdb_cluster":[5604]},"id":3}]} 2024-04-26T20:58:40.541 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 30 2024-04-26T20:58:40.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.539+0000 7efc70600640 1 -- 172.21.15.138:0/4283673541 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7efc48068380 msgr2=0x7efc4806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:40.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.539+0000 7efc70600640 1 --2- 172.21.15.138:0/4283673541 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7efc48068380 0x7efc4806a840 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7efc5c00b9d0 tx=0x7efc5c008040 comp rx=0 tx=0).stop 2024-04-26T20:58:40.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.539+0000 7efc70600640 1 -- 172.21.15.138:0/4283673541 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efc6815e0c0 msgr2=0x7efc681498d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:40.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.539+0000 7efc70600640 1 --2- 172.21.15.138:0/4283673541 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efc6815e0c0 0x7efc681498d0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7efc6000c7b0 tx=0x7efc6000cc70 comp rx=0 tx=0).stop 2024-04-26T20:58:40.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.539+0000 7efc70600640 1 -- 172.21.15.138:0/4283673541 shutdown_connections 2024-04-26T20:58:40.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.539+0000 7efc70600640 1 --2- 172.21.15.138:0/4283673541 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7efc48068380 0x7efc4806a840 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:40.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.539+0000 7efc70600640 1 --2- 172.21.15.138:0/4283673541 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efc6815e0c0 0x7efc681498d0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:40.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.539+0000 7efc70600640 1 --2- 172.21.15.138:0/4283673541 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efc6815ce20 0x7efc68148570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:40.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.539+0000 7efc70600640 1 --2- 172.21.15.138:0/4283673541 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efc680cca00 0x7efc68155bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:40.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.539+0000 7efc70600640 1 -- 172.21.15.138:0/4283673541 >> 172.21.15.138:0/4283673541 conn(0x7efc680d0b20 msgr2=0x7efc68150590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:40.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.539+0000 7efc70600640 1 -- 172.21.15.138:0/4283673541 shutdown_connections 2024-04-26T20:58:40.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.539+0000 7efc70600640 1 -- 172.21.15.138:0/4283673541 wait complete. 2024-04-26T20:58:40.563 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:58:40.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.699+0000 7f8aabe00640 1 Processor -- start 2024-04-26T20:58:40.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.699+0000 7f8aabe00640 1 -- start start 2024-04-26T20:58:40.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.703+0000 7f8aabe00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f8aac0d3760 0x7f8aac070680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:40.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.703+0000 7f8aabe00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8aac071340 0x7f8aac0b13d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:40.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.703+0000 7f8aabe00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8aac070cf0 con 0x7f8aac160530 2024-04-26T20:58:40.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.703+0000 7f8aabe00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f8aac0d1220 con 0x7f8aac0d3760 2024-04-26T20:58:40.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.703+0000 7f8aabe00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f8aac070fd0 con 0x7f8aac071340 2024-04-26T20:58:40.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.703+0000 7f8aaa000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f8aac0d3760 0x7f8aac070680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:40.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.703+0000 7f8aaa000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f8aac0d3760 0x7f8aac070680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:32910/0 (socket says 172.21.15.138:32910) 2024-04-26T20:58:40.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.703+0000 7f8aaa000640 1 -- 172.21.15.138:0/2482348929 learned_addr learned my addr 172.21.15.138:0/2482348929 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:40.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.703+0000 7f8aab400640 1 --2- 172.21.15.138:0/2482348929 >> v2:172.21.15.143:3300/0 conn(0x7f8aac071340 0x7f8aac0b13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:40.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.703+0000 7f8aaa000640 1 -- 172.21.15.138:0/2482348929 >> v2:172.21.15.143:3300/0 conn(0x7f8aac071340 msgr2=0x7f8aac0b13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:40.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.703+0000 7f8aaa000640 1 --2- 172.21.15.138:0/2482348929 >> v2:172.21.15.143:3300/0 conn(0x7f8aac071340 0x7f8aac0b13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:40.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.703+0000 7f8aaa000640 1 -- 172.21.15.138:0/2482348929 >> v1:172.21.15.143:6789/0 conn(0x7f8aac160530 legacy=0x7f8aac06ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:40.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.703+0000 7f8aaa000640 1 -- 172.21.15.138:0/2482348929 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aac0d1470 con 0x7f8aac0d3760 2024-04-26T20:58:40.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.703+0000 7f8aab400640 1 --2- 172.21.15.138:0/2482348929 >> v2:172.21.15.143:3300/0 conn(0x7f8aac071340 0x7f8aac0b13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:58:40.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.703+0000 7f8aaa000640 1 --2- 172.21.15.138:0/2482348929 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8aac0d3760 0x7f8aac070680 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f8aac06a090 tx=0x7f8a9801c300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84d67534a3fa127a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:40.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.707+0000 7f8aa9600640 1 -- 172.21.15.138:0/2482348929 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a980b0070 con 0x7f8aac0d3760 2024-04-26T20:58:40.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.707+0000 7f8aa9600640 1 -- 172.21.15.138:0/2482348929 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a980ab600 con 0x7f8aac0d3760 2024-04-26T20:58:40.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.707+0000 7f8aa9600640 1 -- 172.21.15.138:0/2482348929 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a980ab9d0 con 0x7f8aac0d3760 2024-04-26T20:58:40.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.707+0000 7f8aabe00640 1 -- 172.21.15.138:0/2482348929 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8aac0d3760 msgr2=0x7f8aac070680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:40.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.707+0000 7f8aabe00640 1 --2- 172.21.15.138:0/2482348929 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8aac0d3760 0x7f8aac070680 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f8aac06a090 tx=0x7f8a9801c300 comp rx=0 tx=0).stop 2024-04-26T20:58:40.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.707+0000 7f8aabe00640 1 -- 172.21.15.138:0/2482348929 shutdown_connections 2024-04-26T20:58:40.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.707+0000 7f8aabe00640 1 --2- 172.21.15.138:0/2482348929 >> v2:172.21.15.143:3300/0 conn(0x7f8aac071340 0x7f8aac0b13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:40.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.707+0000 7f8aabe00640 1 --2- 172.21.15.138:0/2482348929 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8aac0d3760 0x7f8aac070680 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:40.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.707+0000 7f8aabe00640 1 -- 172.21.15.138:0/2482348929 >> 172.21.15.138:0/2482348929 conn(0x7f8aac0d2c40 msgr2=0x7f8aac0d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:40.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.707+0000 7f8aabe00640 1 -- 172.21.15.138:0/2482348929 shutdown_connections 2024-04-26T20:58:40.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.707+0000 7f8aabe00640 1 -- 172.21.15.138:0/2482348929 wait complete. 2024-04-26T20:58:40.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.707+0000 7f8aabe00640 1 Processor -- start 2024-04-26T20:58:40.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.707+0000 7f8aabe00640 1 -- start start 2024-04-26T20:58:40.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.707+0000 7f8aabe00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8aac071340 0x7f8aac1521c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:40.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.707+0000 7f8aabe00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8aac0d3760 0x7f8aac0cb340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:40.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.707+0000 7f8aabe00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8aac160530 0x7f8aac0b0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:40.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.707+0000 7f8aabe00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f8aac0b2120 con 0x7f8aac160530 2024-04-26T20:58:40.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.707+0000 7f8aabe00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f8aac160b20 con 0x7f8aac071340 2024-04-26T20:58:40.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.707+0000 7f8aabe00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f8aac0b22a0 con 0x7f8aac0d3760 2024-04-26T20:58:40.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.707+0000 7f8aab400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8aac160530 0x7f8aac0b0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:40.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.707+0000 7f8aab400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8aac160530 0x7f8aac0b0a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:32918/0 (socket says 172.21.15.138:32918) 2024-04-26T20:58:40.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.707+0000 7f8aab400640 1 -- 172.21.15.138:0/1640481506 learned_addr learned my addr 172.21.15.138:0/1640481506 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:40.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.711+0000 7f8aaa000640 1 --2- 172.21.15.138:0/1640481506 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8aac0d3760 0x7f8aac0cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:40.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.711+0000 7f8aaaa00640 1 --2- 172.21.15.138:0/1640481506 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8aac071340 0x7f8aac1521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:40.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.711+0000 7f8aab400640 1 -- 172.21.15.138:0/1640481506 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8aac0d3760 msgr2=0x7f8aac0cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:40.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.711+0000 7f8aab400640 1 --2- 172.21.15.138:0/1640481506 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8aac0d3760 0x7f8aac0cb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:40.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.711+0000 7f8aab400640 1 -- 172.21.15.138:0/1640481506 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8aac071340 msgr2=0x7f8aac1521c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:40.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.711+0000 7f8aab400640 1 --2- 172.21.15.138:0/1640481506 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8aac071340 0x7f8aac1521c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:40.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.711+0000 7f8aab400640 1 -- 172.21.15.138:0/1640481506 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aac152700 con 0x7f8aac160530 2024-04-26T20:58:40.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.711+0000 7f8aaaa00640 1 --2- 172.21.15.138:0/1640481506 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8aac071340 0x7f8aac1521c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:58:40.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.711+0000 7f8aab400640 1 --2- 172.21.15.138:0/1640481506 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8aac160530 0x7f8aac0b0a00 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f8aa400c7f0 tx=0x7f8aa400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:40.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.711+0000 7f8aa2a00640 1 -- 172.21.15.138:0/1640481506 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa4015020 con 0x7f8aac160530 2024-04-26T20:58:40.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.711+0000 7f8aa2a00640 1 -- 172.21.15.138:0/1640481506 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa4004250 con 0x7f8aac160530 2024-04-26T20:58:40.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.711+0000 7f8aa2a00640 1 -- 172.21.15.138:0/1640481506 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa4003620 con 0x7f8aac160530 2024-04-26T20:58:40.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.711+0000 7f8aabe00640 1 -- 172.21.15.138:0/1640481506 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8aac0cbd90 con 0x7f8aac160530 2024-04-26T20:58:40.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.711+0000 7f8aabe00640 1 -- 172.21.15.138:0/1640481506 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8aac0cc350 con 0x7f8aac160530 2024-04-26T20:58:40.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.711+0000 7f8aabe00640 1 -- 172.21.15.138:0/1640481506 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8aac069430 con 0x7f8aac160530 2024-04-26T20:58:40.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.711+0000 7f8aa2a00640 1 -- 172.21.15.138:0/1640481506 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8aa4018020 con 0x7f8aac160530 2024-04-26T20:58:40.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.711+0000 7f8aa2a00640 1 --2- 172.21.15.138:0/1640481506 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f8a8c068380 0x7f8a8c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:40.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.711+0000 7f8aa2a00640 1 -- 172.21.15.138:0/1640481506 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6318+0+0 (secure 0 0 0) 0x7f8aa4086aa0 con 0x7f8aac160530 2024-04-26T20:58:40.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.715+0000 7f8aaaa00640 1 --2- 172.21.15.138:0/1640481506 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f8a8c068380 0x7f8a8c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:40.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.715+0000 7f8aaaa00640 1 --2- 172.21.15.138:0/1640481506 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f8a8c068380 0x7f8a8c06a840 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8aac0d0740 tx=0x7f8a9c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:40.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.719+0000 7f8aa2a00640 1 -- 172.21.15.138:0/1640481506 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8aa401f030 con 0x7f8aac160530 2024-04-26T20:58:40.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.907+0000 7f8aabe00640 1 -- 172.21.15.138:0/1640481506 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8aac0b8a40 con 0x7f8aac160530 2024-04-26T20:58:40.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.907+0000 7f8aa2a00640 1 -- 172.21.15.138:0/1640481506 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+5190 (secure 0 0 0) 0x7f8aa4056e00 con 0x7f8aac160530 2024-04-26T20:58:40.911 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:40.911 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":30,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5048,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/255610168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":255610168},{"type":"v1","addr":"172.21.15.143:6836","nonce":255610168}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5051,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/799063831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":799063831},{"type":"v1","addr":"172.21.15.143:6837","nonce":799063831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5410,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/976248149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":976248149},{"type":"v1","addr":"172.21.15.138:6835","nonce":976248149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:58:10.360154+0000","modified":"2024-04-26T20:58:24.737160+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5604":{"gid":5604,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.138:6834/2450256246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2450256246},{"type":"v1","addr":"172.21.15.138:6834","nonce":2450256246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":7,"enabled":true,"fs_name":"recovery_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5604,"qdb_cluster":[5604]},"id":3}]} 2024-04-26T20:58:40.911 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 30 2024-04-26T20:58:40.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.911+0000 7f8aabe00640 1 -- 172.21.15.138:0/1640481506 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f8a8c068380 msgr2=0x7f8a8c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:40.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.911+0000 7f8aabe00640 1 --2- 172.21.15.138:0/1640481506 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f8a8c068380 0x7f8a8c06a840 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8aac0d0740 tx=0x7f8a9c009040 comp rx=0 tx=0).stop 2024-04-26T20:58:40.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.911+0000 7f8aabe00640 1 -- 172.21.15.138:0/1640481506 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8aac160530 msgr2=0x7f8aac0b0a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:40.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.911+0000 7f8aabe00640 1 --2- 172.21.15.138:0/1640481506 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8aac160530 0x7f8aac0b0a00 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f8aa400c7f0 tx=0x7f8aa400ccb0 comp rx=0 tx=0).stop 2024-04-26T20:58:40.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.911+0000 7f8aabe00640 1 -- 172.21.15.138:0/1640481506 shutdown_connections 2024-04-26T20:58:40.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.911+0000 7f8aabe00640 1 --2- 172.21.15.138:0/1640481506 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f8a8c068380 0x7f8a8c06a840 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:40.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.911+0000 7f8aabe00640 1 --2- 172.21.15.138:0/1640481506 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8aac160530 0x7f8aac0b0a00 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:40.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.911+0000 7f8aabe00640 1 --2- 172.21.15.138:0/1640481506 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8aac0d3760 0x7f8aac0cb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:40.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.911+0000 7f8aabe00640 1 --2- 172.21.15.138:0/1640481506 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8aac071340 0x7f8aac1521c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:40.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.911+0000 7f8aabe00640 1 -- 172.21.15.138:0/1640481506 >> 172.21.15.138:0/1640481506 conn(0x7f8aac0d2c40 msgr2=0x7f8aac0d3020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:40.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.911+0000 7f8aabe00640 1 -- 172.21.15.138:0/1640481506 shutdown_connections 2024-04-26T20:58:40.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:40.911+0000 7f8aabe00640 1 -- 172.21.15.138:0/1640481506 wait complete. 2024-04-26T20:58:40.932 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:58:41.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.063+0000 7f995bc00640 1 Processor -- start 2024-04-26T20:58:41.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.067+0000 7f995bc00640 1 -- start start 2024-04-26T20:58:41.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.067+0000 7f995bc00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f99540c5270 0x7f9954073a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:41.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.067+0000 7f995bc00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f99540d12d0 0x7f99540cc280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:41.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.067+0000 7f995bc00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99540cfb20 con 0x7f995406c300 2024-04-26T20:58:41.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.067+0000 7f995bc00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f99541670f0 con 0x7f99540d12d0 2024-04-26T20:58:41.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.067+0000 7f995bc00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f99540d1860 con 0x7f99540c5270 2024-04-26T20:58:41.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.067+0000 7f9953e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f99540d12d0 0x7f99540cc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:41.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.067+0000 7f9959c00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f995406c300 0x7f9954167580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:51852/0 (socket says 172.21.15.138:51852) 2024-04-26T20:58:41.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.067+0000 7f9959c00640 1 -- 172.21.15.138:0/4082102670 learned_addr learned my addr 172.21.15.138:0/4082102670 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:41.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.067+0000 7f9959200640 1 --2- 172.21.15.138:0/4082102670 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f99540c5270 0x7f9954073a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:41.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.067+0000 7f9953e00640 1 -- 172.21.15.138:0/4082102670 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f99540c5270 msgr2=0x7f9954073a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:41.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.067+0000 7f9953e00640 1 --2- 172.21.15.138:0/4082102670 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f99540c5270 0x7f9954073a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:41.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.067+0000 7f9953e00640 1 -- 172.21.15.138:0/4082102670 >> v1:172.21.15.138:6789/0 conn(0x7f995406c300 legacy=0x7f9954167580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:41.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.067+0000 7f9953e00640 1 -- 172.21.15.138:0/4082102670 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9954070780 con 0x7f99540d12d0 2024-04-26T20:58:41.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.067+0000 7f9959200640 1 --2- 172.21.15.138:0/4082102670 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f99540c5270 0x7f9954073a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:58:41.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.067+0000 7f9953400640 1 -- 172.21.15.138:0/4082102670 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2878876785 0 0) 0x7f99540cfb20 con 0x7f995406c300 2024-04-26T20:58:41.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.071+0000 7f9953e00640 1 --2- 172.21.15.138:0/4082102670 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f99540d12d0 0x7f99540cc280 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f99400097c0 tx=0x7f994001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b84fb8be129a7f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:41.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.071+0000 7f9953400640 1 -- 172.21.15.138:0/4082102670 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99400b1070 con 0x7f99540d12d0 2024-04-26T20:58:41.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.071+0000 7f9953400640 1 -- 172.21.15.138:0/4082102670 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99400ac410 con 0x7f99540d12d0 2024-04-26T20:58:41.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.071+0000 7f9953400640 1 -- 172.21.15.138:0/4082102670 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99400ac7e0 con 0x7f99540d12d0 2024-04-26T20:58:41.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.071+0000 7f995bc00640 1 -- 172.21.15.138:0/4082102670 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f99540d12d0 msgr2=0x7f99540cc280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:41.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.071+0000 7f995bc00640 1 --2- 172.21.15.138:0/4082102670 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f99540d12d0 0x7f99540cc280 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f99400097c0 tx=0x7f994001c4a0 comp rx=0 tx=0).stop 2024-04-26T20:58:41.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.071+0000 7f995bc00640 1 -- 172.21.15.138:0/4082102670 shutdown_connections 2024-04-26T20:58:41.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.071+0000 7f995bc00640 1 --2- 172.21.15.138:0/4082102670 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f99540d12d0 0x7f99540cc280 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:41.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.071+0000 7f995bc00640 1 --2- 172.21.15.138:0/4082102670 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f99540c5270 0x7f9954073a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:41.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.071+0000 7f995bc00640 1 -- 172.21.15.138:0/4082102670 >> 172.21.15.138:0/4082102670 conn(0x7f99540d1c30 msgr2=0x7f99540d2040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:41.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.071+0000 7f995bc00640 1 -- 172.21.15.138:0/4082102670 shutdown_connections 2024-04-26T20:58:41.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.071+0000 7f995bc00640 1 -- 172.21.15.138:0/4082102670 wait complete. 2024-04-26T20:58:41.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.071+0000 7f995bc00640 1 Processor -- start 2024-04-26T20:58:41.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.071+0000 7f995bc00640 1 -- start start 2024-04-26T20:58:41.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.075+0000 7f995bc00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f995406c300 0x7f99540cb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:41.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.075+0000 7f995bc00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f99540c5270 0x7f995415a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:41.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.075+0000 7f995bc00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f99540d12d0 0x7f99541625a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:41.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.075+0000 7f995bc00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f99540cc940 con 0x7f99540c5270 2024-04-26T20:58:41.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.075+0000 7f995bc00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f99540cc7c0 con 0x7f99540d12d0 2024-04-26T20:58:41.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.075+0000 7f995bc00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f9954170ca0 con 0x7f995406c300 2024-04-26T20:58:41.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.075+0000 7f9953e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f99540c5270 0x7f995415a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:41.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.075+0000 7f9953e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f99540c5270 0x7f995415a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:32934/0 (socket says 172.21.15.138:32934) 2024-04-26T20:58:41.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.075+0000 7f9953e00640 1 -- 172.21.15.138:0/4052080148 learned_addr learned my addr 172.21.15.138:0/4052080148 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:41.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.075+0000 7f9959c00640 1 --2- 172.21.15.138:0/4052080148 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f99540d12d0 0x7f99541625a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:41.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.075+0000 7f9959200640 1 --2- 172.21.15.138:0/4052080148 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f995406c300 0x7f99540cb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:41.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.075+0000 7f9953e00640 1 -- 172.21.15.138:0/4052080148 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f995406c300 msgr2=0x7f99540cb3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:41.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.075+0000 7f9953e00640 1 --2- 172.21.15.138:0/4052080148 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f995406c300 0x7f99540cb3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:41.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.075+0000 7f9953e00640 1 -- 172.21.15.138:0/4052080148 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f99540d12d0 msgr2=0x7f99541625a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:41.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.075+0000 7f9953e00640 1 --2- 172.21.15.138:0/4052080148 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f99540d12d0 0x7f99541625a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:41.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.075+0000 7f9953e00640 1 -- 172.21.15.138:0/4052080148 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f995415aa10 con 0x7f99540c5270 2024-04-26T20:58:41.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.075+0000 7f9953e00640 1 --2- 172.21.15.138:0/4052080148 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f99540c5270 0x7f995415a4d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f99400097c0 tx=0x7f9940019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:41.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.075+0000 7f9950c00640 1 -- 172.21.15.138:0/4052080148 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99400bc070 con 0x7f99540c5270 2024-04-26T20:58:41.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.075+0000 7f9950c00640 1 -- 172.21.15.138:0/4052080148 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99400ace20 con 0x7f99540c5270 2024-04-26T20:58:41.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.075+0000 7f9950c00640 1 -- 172.21.15.138:0/4052080148 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99400b1040 con 0x7f99540c5270 2024-04-26T20:58:41.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.075+0000 7f995bc00640 1 -- 172.21.15.138:0/4052080148 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9954164450 con 0x7f99540c5270 2024-04-26T20:58:41.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.075+0000 7f995bc00640 1 -- 172.21.15.138:0/4052080148 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99540c97b0 con 0x7f99540c5270 2024-04-26T20:58:41.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.075+0000 7f995bc00640 1 -- 172.21.15.138:0/4052080148 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9954069510 con 0x7f99540c5270 2024-04-26T20:58:41.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.079+0000 7f9950c00640 1 -- 172.21.15.138:0/4052080148 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9940004230 con 0x7f99540c5270 2024-04-26T20:58:41.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.079+0000 7f9950c00640 1 --2- 172.21.15.138:0/4052080148 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9934068380 0x7f993406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:41.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.079+0000 7f9950c00640 1 -- 172.21.15.138:0/4052080148 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6318+0+0 (secure 0 0 0) 0x7f994011fb30 con 0x7f99540c5270 2024-04-26T20:58:41.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.079+0000 7f9959200640 1 --2- 172.21.15.138:0/4052080148 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9934068380 0x7f993406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:41.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.079+0000 7f9959200640 1 --2- 172.21.15.138:0/4052080148 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9934068380 0x7f993406a840 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f99540cb1e0 tx=0x7f9948008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:41.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.083+0000 7f9950c00640 1 -- 172.21.15.138:0/4052080148 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9940016090 con 0x7f99540c5270 2024-04-26T20:58:41.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.243+0000 7f995bc00640 1 -- 172.21.15.138:0/4052080148 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f99540d2140 con 0x7f99540c5270 2024-04-26T20:58:41.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.243+0000 7f9950c00640 1 -- 172.21.15.138:0/4052080148 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) ==== 74+0+17331 (secure 0 0 0) 0x7f99400ef7a0 con 0x7f99540c5270 2024-04-26T20:58:41.245 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:41.245 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":52,"fsid":"c22b4730-12cc-4558-8535-b965384398c0","created":"2024-04-26T20:56:14.182475+0000","modified":"2024-04-26T20:58:37.797563+0000","last_up_change":"2024-04-26T20:56:26.013243+0000","last_in_change":"2024-04-26T20:56:16.714055+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:56:27.265834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-26T20:57:50.901951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"recovery_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"recovery_fs_metadata","create_time":"2024-04-26T20:58:09.327192+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"recovery_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3f9a2e34-3199-466f-a6cf-57927318121e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6801","nonce":3534772245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6803","nonce":3534772245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6807","nonce":3534772245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6805","nonce":3534772245}]},"public_addr":"172.21.15.138:6801/3534772245","cluster_addr":"172.21.15.138:6803/3534772245","heartbeat_back_addr":"172.21.15.138:6807/3534772245","heartbeat_front_addr":"172.21.15.138:6805/3534772245","state":["exists","up"]},{"osd":1,"uuid":"e881fcf6-3248-4696-a2ef-95d206d77712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6817","nonce":1427635773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6819","nonce":1427635773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6823","nonce":1427635773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6821","nonce":1427635773}]},"public_addr":"172.21.15.138:6817/1427635773","cluster_addr":"172.21.15.138:6819/1427635773","heartbeat_back_addr":"172.21.15.138:6823/1427635773","heartbeat_front_addr":"172.21.15.138:6821/1427635773","state":["exists","up"]},{"osd":2,"uuid":"f7d1db33-7672-4699-ae47-9f1e0a8e4222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6809","nonce":4273721573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6811","nonce":4273721573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6815","nonce":4273721573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6813","nonce":4273721573}]},"public_addr":"172.21.15.138:6809/4273721573","cluster_addr":"172.21.15.138:6811/4273721573","heartbeat_back_addr":"172.21.15.138:6815/4273721573","heartbeat_front_addr":"172.21.15.138:6813/4273721573","state":["exists","up"]},{"osd":3,"uuid":"2f4e0a9a-b8f6-4468-844a-a4501cd85054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6825","nonce":3098242154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6827","nonce":3098242154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6831","nonce":3098242154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6829","nonce":3098242154}]},"public_addr":"172.21.15.138:6825/3098242154","cluster_addr":"172.21.15.138:6827/3098242154","heartbeat_back_addr":"172.21.15.138:6831/3098242154","heartbeat_front_addr":"172.21.15.138:6829/3098242154","state":["exists","up"]},{"osd":4,"uuid":"c85df99b-3624-410e-866b-86830af2cfe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6801","nonce":2942056312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6803","nonce":2942056312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6807","nonce":2942056312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6805","nonce":2942056312}]},"public_addr":"172.21.15.143:6801/2942056312","cluster_addr":"172.21.15.143:6803/2942056312","heartbeat_back_addr":"172.21.15.143:6807/2942056312","heartbeat_front_addr":"172.21.15.143:6805/2942056312","state":["exists","up"]},{"osd":5,"uuid":"9af1efb5-c416-4808-b5ef-de0679ab9705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6809","nonce":1910222887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6811","nonce":1910222887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6815","nonce":1910222887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6813","nonce":1910222887}]},"public_addr":"172.21.15.143:6809/1910222887","cluster_addr":"172.21.15.143:6811/1910222887","heartbeat_back_addr":"172.21.15.143:6815/1910222887","heartbeat_front_addr":"172.21.15.143:6813/1910222887","state":["exists","up"]},{"osd":6,"uuid":"d7138615-8838-45ff-9072-2fd0683362f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6817","nonce":1082239825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6819","nonce":1082239825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6823","nonce":1082239825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6821","nonce":1082239825}]},"public_addr":"172.21.15.143:6817/1082239825","cluster_addr":"172.21.15.143:6819/1082239825","heartbeat_back_addr":"172.21.15.143:6823/1082239825","heartbeat_front_addr":"172.21.15.143:6821/1082239825","state":["exists","up"]},{"osd":7,"uuid":"0c27172b-35c4-49ec-ba0b-0137b8ff0010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6825","nonce":3295508495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6827","nonce":3295508495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6831","nonce":3295508495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6829","nonce":3295508495}]},"public_addr":"172.21.15.143:6825/3295508495","cluster_addr":"172.21.15.143:6827/3295508495","heartbeat_back_addr":"172.21.15.143:6831/3295508495","heartbeat_front_addr":"172.21.15.143:6829/3295508495","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.326627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.396119+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.433915+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.414179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.216947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.329272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.503073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.436382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.d","mappings":[{"from":1,"to":2}]},{"pgid":"6.23","mappings":[{"from":3,"to":2}]},{"pgid":"6.2b","mappings":[{"from":4,"to":7}]},{"pgid":"6.30","mappings":[{"from":4,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.143:6836/483370849":"2024-04-27T20:58:07.183664+0000","172.21.15.143:6834/483370849":"2024-04-27T20:58:07.183664+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:58:41.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.243+0000 7f995bc00640 1 -- 172.21.15.138:0/4052080148 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9934068380 msgr2=0x7f993406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:41.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.243+0000 7f995bc00640 1 --2- 172.21.15.138:0/4052080148 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9934068380 0x7f993406a840 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f99540cb1e0 tx=0x7f9948008040 comp rx=0 tx=0).stop 2024-04-26T20:58:41.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.243+0000 7f995bc00640 1 -- 172.21.15.138:0/4052080148 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f99540c5270 msgr2=0x7f995415a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:41.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.243+0000 7f995bc00640 1 --2- 172.21.15.138:0/4052080148 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f99540c5270 0x7f995415a4d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f99400097c0 tx=0x7f9940019240 comp rx=0 tx=0).stop 2024-04-26T20:58:41.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.243+0000 7f995bc00640 1 -- 172.21.15.138:0/4052080148 shutdown_connections 2024-04-26T20:58:41.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.243+0000 7f995bc00640 1 --2- 172.21.15.138:0/4052080148 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9934068380 0x7f993406a840 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:41.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.243+0000 7f995bc00640 1 --2- 172.21.15.138:0/4052080148 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f99540d12d0 0x7f99541625a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:41.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.243+0000 7f995bc00640 1 --2- 172.21.15.138:0/4052080148 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f99540c5270 0x7f995415a4d0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:41.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.243+0000 7f995bc00640 1 --2- 172.21.15.138:0/4052080148 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f995406c300 0x7f99540cb3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:41.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.243+0000 7f995bc00640 1 -- 172.21.15.138:0/4052080148 >> 172.21.15.138:0/4052080148 conn(0x7f99540d1c30 msgr2=0x7f99540b1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:41.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.243+0000 7f995bc00640 1 -- 172.21.15.138:0/4052080148 shutdown_connections 2024-04-26T20:58:41.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.243+0000 7f995bc00640 1 -- 172.21.15.138:0/4052080148 wait complete. 2024-04-26T20:58:41.266 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail recovery_fs 2024-04-26T20:58:41.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.403+0000 7f0515e00640 1 Processor -- start 2024-04-26T20:58:41.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.403+0000 7f0515e00640 1 -- start start 2024-04-26T20:58:41.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.403+0000 7f0515e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f051015cf80 0x7f0510073b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:41.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.403+0000 7f0515e00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05100727f0 con 0x7f05100cc1e0 2024-04-26T20:58:41.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.403+0000 7f0515e00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0510072a70 con 0x7f05100cbe00 2024-04-26T20:58:41.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.403+0000 7f0515e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f0510073680 con 0x7f051015cf80 2024-04-26T20:58:41.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.403+0000 7f050f400640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f05100cc1e0 0x7f05100ce6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:51868/0 (socket says 172.21.15.138:51868) 2024-04-26T20:58:41.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.403+0000 7f050f400640 1 -- 172.21.15.138:0/3573149118 learned_addr learned my addr 172.21.15.138:0/3573149118 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:41.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.403+0000 7f0506000640 1 --2- 172.21.15.138:0/3573149118 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f051015cf80 0x7f0510073b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:41.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.403+0000 7f050e000640 1 -- 172.21.15.138:0/3573149118 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1473939123 0 0) 0x7f0508001120 con 0x7f05100cc1e0 2024-04-26T20:58:41.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.403+0000 7f050e000640 1 -- 172.21.15.138:0/3573149118 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04f4003530 con 0x7f05100cc1e0 2024-04-26T20:58:41.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.407+0000 7f050e000640 1 -- 172.21.15.138:0/3573149118 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3223094924 0 0) 0x7f0510072a70 con 0x7f05100cbe00 2024-04-26T20:58:41.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.407+0000 7f050e000640 1 -- 172.21.15.138:0/3573149118 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0508001120 con 0x7f05100cbe00 2024-04-26T20:58:41.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.407+0000 7f050e000640 1 -- 172.21.15.138:0/3573149118 <== mon.0 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2526504579 0 0) 0x7f04f4003530 con 0x7f05100cc1e0 2024-04-26T20:58:41.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.407+0000 7f0506000640 1 -- 172.21.15.138:0/3573149118 >> v1:172.21.15.143:6789/0 conn(0x7f05100cbe00 legacy=0x7f051006de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:41.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.407+0000 7f0506000640 1 -- 172.21.15.138:0/3573149118 >> v1:172.21.15.138:6789/0 conn(0x7f05100cc1e0 legacy=0x7f05100ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:41.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.407+0000 7f0506000640 1 -- 172.21.15.138:0/3573149118 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0510072d50 con 0x7f051015cf80 2024-04-26T20:58:41.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.407+0000 7f0506000640 1 --2- 172.21.15.138:0/3573149118 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f051015cf80 0x7f0510073b10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f04f80097f0 tx=0x7f04f801c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acdc5746b85d0c61 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:41.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.407+0000 7f050e000640 1 -- 172.21.15.138:0/3573149118 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f80b0070 con 0x7f051015cf80 2024-04-26T20:58:41.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.407+0000 7f050e000640 1 -- 172.21.15.138:0/3573149118 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04f80ab400 con 0x7f051015cf80 2024-04-26T20:58:41.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.407+0000 7f050e000640 1 -- 172.21.15.138:0/3573149118 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0508001850 con 0x7f051015cf80 2024-04-26T20:58:41.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.407+0000 7f0515e00640 1 -- 172.21.15.138:0/3573149118 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f051015cf80 msgr2=0x7f0510073b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:41.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.407+0000 7f0515e00640 1 --2- 172.21.15.138:0/3573149118 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f051015cf80 0x7f0510073b10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f04f80097f0 tx=0x7f04f801c400 comp rx=0 tx=0).stop 2024-04-26T20:58:41.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.407+0000 7f0515e00640 1 -- 172.21.15.138:0/3573149118 shutdown_connections 2024-04-26T20:58:41.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.407+0000 7f0515e00640 1 --2- 172.21.15.138:0/3573149118 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f051015cf80 0x7f0510073b10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:41.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.407+0000 7f0515e00640 1 -- 172.21.15.138:0/3573149118 >> 172.21.15.138:0/3573149118 conn(0x7f05100d0b20 msgr2=0x7f05100d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:41.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.411+0000 7f0515e00640 1 -- 172.21.15.138:0/3573149118 shutdown_connections 2024-04-26T20:58:41.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.411+0000 7f0515e00640 1 -- 172.21.15.138:0/3573149118 wait complete. 2024-04-26T20:58:41.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.411+0000 7f0515e00640 1 Processor -- start 2024-04-26T20:58:41.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.411+0000 7f0515e00640 1 -- start start 2024-04-26T20:58:41.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.411+0000 7f0515e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f05100cbe00 0x7f05100c7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:41.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.411+0000 7f0515e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05100cc1e0 0x7f05100c9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:41.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.411+0000 7f0515e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f051015cf80 0x7f05100c9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:41.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.411+0000 7f0515e00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f05100d0900 con 0x7f05100cc1e0 2024-04-26T20:58:41.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.411+0000 7f0515e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f05100d0780 con 0x7f05100cbe00 2024-04-26T20:58:41.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.411+0000 7f0515e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f051016a5f0 con 0x7f051015cf80 2024-04-26T20:58:41.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.411+0000 7f0506000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05100cc1e0 0x7f05100c9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:41.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.411+0000 7f0506000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05100cc1e0 0x7f05100c9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:32942/0 (socket says 172.21.15.138:32942) 2024-04-26T20:58:41.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.411+0000 7f0506000640 1 -- 172.21.15.138:0/527486971 learned_addr learned my addr 172.21.15.138:0/527486971 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:41.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.411+0000 7f050f400640 1 --2- 172.21.15.138:0/527486971 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f051015cf80 0x7f05100c9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:41.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.411+0000 7f050ea00640 1 --2- 172.21.15.138:0/527486971 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f05100cbe00 0x7f05100c7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:41.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.411+0000 7f0506000640 1 -- 172.21.15.138:0/527486971 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f051015cf80 msgr2=0x7f05100c9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:41.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.411+0000 7f0506000640 1 --2- 172.21.15.138:0/527486971 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f051015cf80 0x7f05100c9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:41.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.411+0000 7f0506000640 1 -- 172.21.15.138:0/527486971 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f05100cbe00 msgr2=0x7f05100c7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:41.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.411+0000 7f0506000640 1 --2- 172.21.15.138:0/527486971 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f05100cbe00 0x7f05100c7bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:41.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.411+0000 7f0506000640 1 -- 172.21.15.138:0/527486971 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05100b11c0 con 0x7f05100cc1e0 2024-04-26T20:58:41.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.411+0000 7f050f400640 1 --2- 172.21.15.138:0/527486971 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f051015cf80 0x7f05100c9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:58:41.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.411+0000 7f050ea00640 1 --2- 172.21.15.138:0/527486971 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f05100cbe00 0x7f05100c7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:58:41.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.411+0000 7f0506000640 1 --2- 172.21.15.138:0/527486971 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05100cc1e0 0x7f05100c9860 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f04f801a030 tx=0x7f04f80191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:41.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.411+0000 7f0507e00640 1 -- 172.21.15.138:0/527486971 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f80b0050 con 0x7f05100cc1e0 2024-04-26T20:58:41.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.411+0000 7f0507e00640 1 -- 172.21.15.138:0/527486971 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04f80b1040 con 0x7f05100cc1e0 2024-04-26T20:58:41.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.411+0000 7f0507e00640 1 -- 172.21.15.138:0/527486971 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f8003a30 con 0x7f05100cc1e0 2024-04-26T20:58:41.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.411+0000 7f0515e00640 1 -- 172.21.15.138:0/527486971 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05100b14a0 con 0x7f05100cc1e0 2024-04-26T20:58:41.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.411+0000 7f0515e00640 1 -- 172.21.15.138:0/527486971 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05100b1d40 con 0x7f05100cc1e0 2024-04-26T20:58:41.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.415+0000 7f0515e00640 1 -- 172.21.15.138:0/527486971 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0510069510 con 0x7f05100cc1e0 2024-04-26T20:58:41.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.415+0000 7f0507e00640 1 -- 172.21.15.138:0/527486971 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f04f80be020 con 0x7f05100cc1e0 2024-04-26T20:58:41.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.415+0000 7f0507e00640 1 --2- 172.21.15.138:0/527486971 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f04ec068380 0x7f04ec06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:41.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.415+0000 7f0507e00640 1 -- 172.21.15.138:0/527486971 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6318+0+0 (secure 0 0 0) 0x7f04f8120930 con 0x7f05100cc1e0 2024-04-26T20:58:41.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.415+0000 7f050ea00640 1 --2- 172.21.15.138:0/527486971 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f04ec068380 0x7f04ec06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:41.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.415+0000 7f050ea00640 1 --2- 172.21.15.138:0/527486971 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f04ec068380 0x7f04ec06a840 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0500007fd0 tx=0x7f0500009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:41.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.419+0000 7f0507e00640 1 -- 172.21.15.138:0/527486971 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f04f8015ff0 con 0x7f05100cc1e0 2024-04-26T20:58:41.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.607+0000 7f0515e00640 1 -- 172.21.15.138:0/527486971 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "recovery_fs"} v 0) -- 0x7f05100b6a30 con 0x7f05100cc1e0 2024-04-26T20:58:41.610 INFO:tasks.ceph.mon.a.smithi138.stderr:2024-04-26T20:58:41.607+0000 7f20de400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T20:58:41.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.611+0000 7f0507e00640 1 -- 172.21.15.138:0/527486971 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "recovery_fs"}]=0 recovery_fs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v31) ==== 171+0+0 (secure 0 0 0) 0x7f04f80b4360 con 0x7f05100cc1e0 2024-04-26T20:58:41.612 INFO:teuthology.orchestra.run.smithi138.stderr:recovery_fs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T20:58:41.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.611+0000 7f0515e00640 1 -- 172.21.15.138:0/527486971 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f04ec068380 msgr2=0x7f04ec06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:41.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.611+0000 7f0515e00640 1 --2- 172.21.15.138:0/527486971 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f04ec068380 0x7f04ec06a840 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0500007fd0 tx=0x7f0500009040 comp rx=0 tx=0).stop 2024-04-26T20:58:41.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.611+0000 7f0515e00640 1 -- 172.21.15.138:0/527486971 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05100cc1e0 msgr2=0x7f05100c9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:41.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.611+0000 7f0515e00640 1 --2- 172.21.15.138:0/527486971 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05100cc1e0 0x7f05100c9860 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f04f801a030 tx=0x7f04f80191a0 comp rx=0 tx=0).stop 2024-04-26T20:58:41.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.611+0000 7f0515e00640 1 -- 172.21.15.138:0/527486971 shutdown_connections 2024-04-26T20:58:41.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.611+0000 7f0515e00640 1 --2- 172.21.15.138:0/527486971 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f04ec068380 0x7f04ec06a840 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:41.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.611+0000 7f0515e00640 1 --2- 172.21.15.138:0/527486971 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f051015cf80 0x7f05100c9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:41.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.611+0000 7f0515e00640 1 --2- 172.21.15.138:0/527486971 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05100cc1e0 0x7f05100c9860 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:41.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.611+0000 7f0515e00640 1 --2- 172.21.15.138:0/527486971 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f05100cbe00 0x7f05100c7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:41.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.611+0000 7f0515e00640 1 -- 172.21.15.138:0/527486971 >> 172.21.15.138:0/527486971 conn(0x7f05100d0b20 msgr2=0x7f05100af220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:41.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.611+0000 7f0515e00640 1 -- 172.21.15.138:0/527486971 shutdown_connections 2024-04-26T20:58:41.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.611+0000 7f0515e00640 1 -- 172.21.15.138:0/527486971 wait complete. 2024-04-26T20:58:41.622 INFO:tasks.ceph.mds.a.smithi138.stderr: -4998> 2024-04-26T20:58:21.728+0000 7f143cc00640 -1 mds.0.openfiles _load_finish got (2) No such file or directory 2024-04-26T20:58:41.626 INFO:tasks.ceph.mds.a.smithi138.stderr: -3343> 2024-04-26T20:58:26.804+0000 7f143cc00640 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x10000000000 2024-04-26T20:58:41.626 INFO:tasks.ceph.mds.a.smithi138.stderr: -3166> 2024-04-26T20:58:26.808+0000 7f143cc00640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /subdir/ auth v1 pv4 ap=3 DIRTYPARENT f(v0 1=1+0) n() (inest lock dirty) (ifile lock->sync w=1 flushing) | dirtyscattered=2 lock=1 dirfrag=1 dirtyparent=1 waiter=1 authpin=1 scrubqueue=0 0x559ec5673180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000000:[<0x1/subdir v1>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 1=1+0)","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 1=1+0)","memory_value.rstat":"n()","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-61} 2024-04-26T20:58:41.626 INFO:tasks.ceph.mds.a.smithi138.stderr: -3111> 2024-04-26T20:58:26.808+0000 7f143cc00640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /subdir/sixmegs auth v1 ap=1 DIRTYPARENT s=6291456 n() | dirtyparent=1 authpin=1 scrubqueue=0 0x559ec5710580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(6)0x10000000001:[<0x10000000000/sixmegs v10>,<0x1/subdir v12>]//[]","memoryvalue":"(6)0x10000000001:[<0x10000000000/sixmegs v1>,<0x1/subdir v1>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T20:58:41.627 INFO:tasks.ceph.mds.a.smithi138.stderr: -2770> 2024-04-26T20:58:26.812+0000 7f143cc00640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1 [...2,head] / auth v4 pv6 ap=5 snaprealm=0x559ec54be900 DIRTYPARENT f(v1 1=0+1) n(v0 1=0+1)/n() (inest mix->lock(2) w=1 flushing) (ifile mix->sync w=1 flushing) | dirtyscattered=2 lock=2 dirfrag=1 openingsnapparents=0 dirtyparent=1 dirty=1 waiter=1 authpin=1 scrubqueue=0 0x559ec5670b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x1:[]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 1=0+1)","ondisk_value.rstat":"n(v0 2=0+2)","memory_value.dirstat":"f(v1 1=0+1)","memory_value.rstat":"n(v0 1=0+1)","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-61} 2024-04-26T20:58:41.628 INFO:tasks.ceph.mds.a.smithi138.stderr: -2137> 2024-04-26T20:58:28.196+0000 7f1441c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T20:58:41.640 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm recovery_fs --yes-i-really-mean-it 2024-04-26T20:58:41.673 INFO:tasks.ceph.mds.a.smithi138.stdout:starting mds.a at 2024-04-26T20:58:41.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.775+0000 7f034b000640 1 Processor -- start 2024-04-26T20:58:41.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.775+0000 7f034b000640 1 -- start start 2024-04-26T20:58:41.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.779+0000 7f034b000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f03440ce9e0 0x7f03440afc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:41.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.779+0000 7f034b000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f034406fad0 0x7f034415ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:41.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.779+0000 7f034b000640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f0344162d20 0x7f034415f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:41.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.779+0000 7f034b000640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f03440ae8c0 con 0x7f03440ce9e0 2024-04-26T20:58:41.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.779+0000 7f034b000640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f03440aeba0 con 0x7f0344162d20 2024-04-26T20:58:41.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.779+0000 7f034b000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f03440aee80 con 0x7f034406fad0 2024-04-26T20:58:41.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.779+0000 7f0343e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f03440ce9e0 0x7f03440afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:41.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.779+0000 7f0343e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f03440ce9e0 0x7f03440afc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:32982/0 (socket says 172.21.15.138:32982) 2024-04-26T20:58:41.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.779+0000 7f0343e00640 1 -- 172.21.15.138:0/1723739131 learned_addr learned my addr 172.21.15.138:0/1723739131 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:41.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.779+0000 7f0349000640 1 --2- 172.21.15.138:0/1723739131 >> v2:172.21.15.143:3300/0 conn(0x7f0344162d20 0x7f034415f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:41.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.779+0000 7f033b400640 1 --2- 172.21.15.138:0/1723739131 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f034406fad0 0x7f034415ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:41.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.779+0000 7f0343e00640 1 -- 172.21.15.138:0/1723739131 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f034406fad0 msgr2=0x7f034415ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:41.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.779+0000 7f0343e00640 1 --2- 172.21.15.138:0/1723739131 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f034406fad0 0x7f034415ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:41.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.779+0000 7f0343e00640 1 -- 172.21.15.138:0/1723739131 >> v2:172.21.15.143:3300/0 conn(0x7f0344162d20 msgr2=0x7f034415f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:41.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.779+0000 7f0343e00640 1 --2- 172.21.15.138:0/1723739131 >> v2:172.21.15.143:3300/0 conn(0x7f0344162d20 0x7f034415f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:41.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.779+0000 7f0343e00640 1 -- 172.21.15.138:0/1723739131 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03440af160 con 0x7f03440ce9e0 2024-04-26T20:58:41.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.779+0000 7f033b400640 1 --2- 172.21.15.138:0/1723739131 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f034406fad0 0x7f034415ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:58:41.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.783+0000 7f0343e00640 1 --2- 172.21.15.138:0/1723739131 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f03440ce9e0 0x7f03440afc20 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f03440cf680 tx=0x7f033401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d6fd6503d0191ce server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:41.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.783+0000 7f0343400640 1 -- 172.21.15.138:0/1723739131 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03340a5780 con 0x7f03440ce9e0 2024-04-26T20:58:41.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.783+0000 7f0343400640 1 -- 172.21.15.138:0/1723739131 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03340a5920 con 0x7f03440ce9e0 2024-04-26T20:58:41.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.783+0000 7f0343400640 1 -- 172.21.15.138:0/1723739131 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03340a5cf0 con 0x7f03440ce9e0 2024-04-26T20:58:41.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.783+0000 7f034b000640 1 -- 172.21.15.138:0/1723739131 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f03440ce9e0 msgr2=0x7f03440afc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:41.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.783+0000 7f034b000640 1 --2- 172.21.15.138:0/1723739131 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f03440ce9e0 0x7f03440afc20 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f03440cf680 tx=0x7f033401c9f0 comp rx=0 tx=0).stop 2024-04-26T20:58:41.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.783+0000 7f034b000640 1 -- 172.21.15.138:0/1723739131 shutdown_connections 2024-04-26T20:58:41.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.783+0000 7f034b000640 1 --2- 172.21.15.138:0/1723739131 >> v2:172.21.15.143:3300/0 conn(0x7f0344162d20 0x7f034415f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:41.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.783+0000 7f034b000640 1 --2- 172.21.15.138:0/1723739131 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f034406fad0 0x7f034415ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:41.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.783+0000 7f034b000640 1 --2- 172.21.15.138:0/1723739131 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f03440ce9e0 0x7f03440afc20 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:41.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.783+0000 7f034b000640 1 -- 172.21.15.138:0/1723739131 >> 172.21.15.138:0/1723739131 conn(0x7f03440d0bb0 msgr2=0x7f03440d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:41.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.783+0000 7f034b000640 1 -- 172.21.15.138:0/1723739131 shutdown_connections 2024-04-26T20:58:41.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.783+0000 7f034b000640 1 -- 172.21.15.138:0/1723739131 wait complete. 2024-04-26T20:58:41.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.783+0000 7f034b000640 1 Processor -- start 2024-04-26T20:58:41.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.783+0000 7f034b000640 1 -- start start 2024-04-26T20:58:41.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.783+0000 7f034b000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f034406fad0 0x7f034415c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:41.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.783+0000 7f034b000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f03440ce9e0 0x7f034415dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:41.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.783+0000 7f034b000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0344162d20 0x7f0344161b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:41.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.783+0000 7f034b000640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f03440cbb90 con 0x7f0344162d20 2024-04-26T20:58:41.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.783+0000 7f034b000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f03440cba10 con 0x7f03440ce9e0 2024-04-26T20:58:41.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.783+0000 7f034b000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f034406e3f0 con 0x7f034406fad0 2024-04-26T20:58:41.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.787+0000 7f0349000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0344162d20 0x7f0344161b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:41.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.787+0000 7f0349000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0344162d20 0x7f0344161b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:32998/0 (socket says 172.21.15.138:32998) 2024-04-26T20:58:41.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.787+0000 7f0349000640 1 -- 172.21.15.138:0/1940011744 learned_addr learned my addr 172.21.15.138:0/1940011744 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:41.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.787+0000 7f0343e00640 1 --2- 172.21.15.138:0/1940011744 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f034406fad0 0x7f034415c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:41.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.787+0000 7f033b400640 1 --2- 172.21.15.138:0/1940011744 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f03440ce9e0 0x7f034415dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:41.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.787+0000 7f0349000640 1 -- 172.21.15.138:0/1940011744 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f034406fad0 msgr2=0x7f034415c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:41.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.787+0000 7f0349000640 1 --2- 172.21.15.138:0/1940011744 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f034406fad0 0x7f034415c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:41.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.787+0000 7f0349000640 1 -- 172.21.15.138:0/1940011744 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f03440ce9e0 msgr2=0x7f034415dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:41.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.787+0000 7f0349000640 1 --2- 172.21.15.138:0/1940011744 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f03440ce9e0 0x7f034415dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:41.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.787+0000 7f0349000640 1 -- 172.21.15.138:0/1940011744 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f034415cb00 con 0x7f0344162d20 2024-04-26T20:58:41.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.787+0000 7f0349000640 1 --2- 172.21.15.138:0/1940011744 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0344162d20 0x7f0344161b80 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f033c00e7f0 tx=0x7f033c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:41.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.787+0000 7f0340c00640 1 -- 172.21.15.138:0/1940011744 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f033c017070 con 0x7f0344162d20 2024-04-26T20:58:41.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.787+0000 7f0340c00640 1 -- 172.21.15.138:0/1940011744 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f033c00c940 con 0x7f0344162d20 2024-04-26T20:58:41.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.787+0000 7f0340c00640 1 -- 172.21.15.138:0/1940011744 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f033c00eea0 con 0x7f0344162d20 2024-04-26T20:58:41.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.787+0000 7f034b000640 1 -- 172.21.15.138:0/1940011744 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f034415cde0 con 0x7f0344162d20 2024-04-26T20:58:41.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.787+0000 7f034b000640 1 -- 172.21.15.138:0/1940011744 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f034415d3a0 con 0x7f0344162d20 2024-04-26T20:58:41.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.787+0000 7f034b000640 1 -- 172.21.15.138:0/1940011744 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0344069430 con 0x7f0344162d20 2024-04-26T20:58:41.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.787+0000 7f0340c00640 1 -- 172.21.15.138:0/1940011744 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f033c01a070 con 0x7f0344162d20 2024-04-26T20:58:41.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.791+0000 7f0340c00640 1 --2- 172.21.15.138:0/1940011744 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0320068380 0x7f032006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:41.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.791+0000 7f0340c00640 1 -- 172.21.15.138:0/1940011744 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6404+0+0 (secure 0 0 0) 0x7f033c086a30 con 0x7f0344162d20 2024-04-26T20:58:41.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.791+0000 7f0343e00640 1 --2- 172.21.15.138:0/1940011744 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0320068380 0x7f032006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:41.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.791+0000 7f0343e00640 1 --2- 172.21.15.138:0/1940011744 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0320068380 0x7f032006a840 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f03340ae000 tx=0x7f03340a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:41.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.795+0000 7f0340c00640 1 -- 172.21.15.138:0/1940011744 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f033c056770 con 0x7f0344162d20 2024-04-26T20:58:41.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:41.987+0000 7f034b000640 1 -- 172.21.15.138:0/1940011744 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "recovery_fs", "yes_i_really_mean_it": true} v 0) -- 0x7f03440d1810 con 0x7f0344162d20 2024-04-26T20:58:42.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.611+0000 7f0340c00640 1 -- 172.21.15.138:0/1940011744 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "recovery_fs", "yes_i_really_mean_it": true}]=0 v32) ==== 109+0+0 (secure 0 0 0) 0x7f033c05aa70 con 0x7f0344162d20 2024-04-26T20:58:42.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.615+0000 7f034b000640 1 -- 172.21.15.138:0/1940011744 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0320068380 msgr2=0x7f032006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:42.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.615+0000 7f034b000640 1 --2- 172.21.15.138:0/1940011744 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0320068380 0x7f032006a840 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f03340ae000 tx=0x7f03340a7070 comp rx=0 tx=0).stop 2024-04-26T20:58:42.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.615+0000 7f034b000640 1 -- 172.21.15.138:0/1940011744 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0344162d20 msgr2=0x7f0344161b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:42.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.615+0000 7f034b000640 1 --2- 172.21.15.138:0/1940011744 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0344162d20 0x7f0344161b80 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f033c00e7f0 tx=0x7f033c00ecb0 comp rx=0 tx=0).stop 2024-04-26T20:58:42.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.615+0000 7f034b000640 1 -- 172.21.15.138:0/1940011744 shutdown_connections 2024-04-26T20:58:42.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.615+0000 7f034b000640 1 --2- 172.21.15.138:0/1940011744 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0320068380 0x7f032006a840 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:42.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.615+0000 7f034b000640 1 --2- 172.21.15.138:0/1940011744 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0344162d20 0x7f0344161b80 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:42.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.615+0000 7f034b000640 1 --2- 172.21.15.138:0/1940011744 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f03440ce9e0 0x7f034415dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:42.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.615+0000 7f034b000640 1 --2- 172.21.15.138:0/1940011744 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f034406fad0 0x7f034415c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:42.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.615+0000 7f034b000640 1 -- 172.21.15.138:0/1940011744 >> 172.21.15.138:0/1940011744 conn(0x7f03440d0bb0 msgr2=0x7f034415ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:42.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.615+0000 7f034b000640 1 -- 172.21.15.138:0/1940011744 shutdown_connections 2024-04-26T20:58:42.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.615+0000 7f034b000640 1 -- 172.21.15.138:0/1940011744 wait complete. 2024-04-26T20:58:42.639 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm recovery_fs_metadata recovery_fs_metadata --yes-i-really-really-mean-it 2024-04-26T20:58:42.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.823+0000 7fe00c000640 1 Processor -- start 2024-04-26T20:58:42.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.823+0000 7fe00c000640 1 -- start start 2024-04-26T20:58:42.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.823+0000 7fe00c000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe00415bc40 0x7fe004073e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:42.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.823+0000 7fe00c000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe00415c020 0x7fe0040cbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:42.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.823+0000 7fe00c000640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe00406e1a0 con 0x7fe0040cb1a0 2024-04-26T20:58:42.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.823+0000 7fe00c000640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fe00406e480 con 0x7fe00415bc40 2024-04-26T20:58:42.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.823+0000 7fe00c000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fe004073380 con 0x7fe00415c020 2024-04-26T20:58:42.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.823+0000 7fe009600640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe00415bc40 0x7fe004073e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:42.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.823+0000 7fe00a000640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fe0040cb1a0 0x7fe0040ce720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:51894/0 (socket says 172.21.15.138:51894) 2024-04-26T20:58:42.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.823+0000 7fe00a000640 1 -- 172.21.15.138:0/2145889683 learned_addr learned my addr 172.21.15.138:0/2145889683 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:42.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.823+0000 7fe008c00640 1 --2- 172.21.15.138:0/2145889683 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe00415c020 0x7fe0040cbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:42.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.823+0000 7fe009600640 1 -- 172.21.15.138:0/2145889683 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe00415c020 msgr2=0x7fe0040cbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:42.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.823+0000 7fe009600640 1 --2- 172.21.15.138:0/2145889683 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe00415c020 0x7fe0040cbbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:42.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.823+0000 7fe009600640 1 -- 172.21.15.138:0/2145889683 >> v1:172.21.15.138:6789/0 conn(0x7fe0040cb1a0 legacy=0x7fe0040ce720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:42.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.823+0000 7fe009600640 1 -- 172.21.15.138:0/2145889683 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe004073660 con 0x7fe00415bc40 2024-04-26T20:58:42.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.823+0000 7fe003e00640 1 -- 172.21.15.138:0/2145889683 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1162312553 0 0) 0x7fe00406e1a0 con 0x7fe0040cb1a0 2024-04-26T20:58:42.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.827+0000 7fe009600640 1 --2- 172.21.15.138:0/2145889683 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe00415bc40 0x7fe004073e60 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fdff80097c0 tx=0x7fdff801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4515d3082382bcb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:42.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.827+0000 7fe003e00640 1 -- 172.21.15.138:0/2145889683 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff80b1070 con 0x7fe00415bc40 2024-04-26T20:58:42.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.827+0000 7fe003e00640 1 -- 172.21.15.138:0/2145889683 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdff80ac410 con 0x7fe00415bc40 2024-04-26T20:58:42.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.827+0000 7fe003e00640 1 -- 172.21.15.138:0/2145889683 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff80ac7e0 con 0x7fe00415bc40 2024-04-26T20:58:42.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.827+0000 7fe00c000640 1 -- 172.21.15.138:0/2145889683 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe00415bc40 msgr2=0x7fe004073e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:42.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.827+0000 7fe00c000640 1 --2- 172.21.15.138:0/2145889683 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe00415bc40 0x7fe004073e60 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fdff80097c0 tx=0x7fdff801c4a0 comp rx=0 tx=0).stop 2024-04-26T20:58:42.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.827+0000 7fe00c000640 1 -- 172.21.15.138:0/2145889683 shutdown_connections 2024-04-26T20:58:42.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.827+0000 7fe00c000640 1 --2- 172.21.15.138:0/2145889683 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe00415c020 0x7fe0040cbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:42.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.827+0000 7fe00c000640 1 --2- 172.21.15.138:0/2145889683 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe00415bc40 0x7fe004073e60 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:42.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.827+0000 7fe00c000640 1 -- 172.21.15.138:0/2145889683 >> 172.21.15.138:0/2145889683 conn(0x7fe0040d0b50 msgr2=0x7fe0040d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:42.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.827+0000 7fe00c000640 1 -- 172.21.15.138:0/2145889683 shutdown_connections 2024-04-26T20:58:42.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.827+0000 7fe00c000640 1 -- 172.21.15.138:0/2145889683 wait complete. 2024-04-26T20:58:42.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.831+0000 7fe00c000640 1 Processor -- start 2024-04-26T20:58:42.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.831+0000 7fe00c000640 1 -- start start 2024-04-26T20:58:42.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.831+0000 7fe00c000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0040cb1a0 0x7fe00415ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:42.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.831+0000 7fe00c000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe00415bc40 0x7fe0040c5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:42.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.831+0000 7fe00c000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe00415c020 0x7fe0040c5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:42.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.831+0000 7fe00c000640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe0041670a0 con 0x7fe0040cb1a0 2024-04-26T20:58:42.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.831+0000 7fe00c000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fe004166f20 con 0x7fe00415c020 2024-04-26T20:58:42.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.831+0000 7fe00c000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fe004167220 con 0x7fe00415bc40 2024-04-26T20:58:42.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.831+0000 7fe009600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0040cb1a0 0x7fe00415ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:42.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.831+0000 7fe009600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0040cb1a0 0x7fe00415ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:33020/0 (socket says 172.21.15.138:33020) 2024-04-26T20:58:42.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.831+0000 7fe009600640 1 -- 172.21.15.138:0/1733023759 learned_addr learned my addr 172.21.15.138:0/1733023759 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:42.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.831+0000 7fe008c00640 1 --2- 172.21.15.138:0/1733023759 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe00415bc40 0x7fe0040c5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:42.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.831+0000 7fe00a000640 1 --2- 172.21.15.138:0/1733023759 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe00415c020 0x7fe0040c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:42.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.831+0000 7fe009600640 1 -- 172.21.15.138:0/1733023759 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe00415bc40 msgr2=0x7fe0040c5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:42.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.831+0000 7fe009600640 1 --2- 172.21.15.138:0/1733023759 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe00415bc40 0x7fe0040c5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:42.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.831+0000 7fe009600640 1 -- 172.21.15.138:0/1733023759 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe00415c020 msgr2=0x7fe0040c5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:42.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.831+0000 7fe009600640 1 --2- 172.21.15.138:0/1733023759 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe00415c020 0x7fe0040c5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:42.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.831+0000 7fe009600640 1 -- 172.21.15.138:0/1733023759 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe00415b150 con 0x7fe0040cb1a0 2024-04-26T20:58:42.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.831+0000 7fe00a000640 1 --2- 172.21.15.138:0/1733023759 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe00415c020 0x7fe0040c5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:58:42.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.831+0000 7fe009600640 1 --2- 172.21.15.138:0/1733023759 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0040cb1a0 0x7fe00415ac10 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fdff801a0d0 tx=0x7fdff8019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:42.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.831+0000 7fe001600640 1 -- 172.21.15.138:0/1733023759 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff80b1040 con 0x7fe0040cb1a0 2024-04-26T20:58:42.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.831+0000 7fe001600640 1 -- 172.21.15.138:0/1733023759 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdff80bc070 con 0x7fe0040cb1a0 2024-04-26T20:58:42.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.831+0000 7fe00c000640 1 -- 172.21.15.138:0/1733023759 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe004159b70 con 0x7fe0040cb1a0 2024-04-26T20:58:42.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.831+0000 7fe001600640 1 -- 172.21.15.138:0/1733023759 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff80b5410 con 0x7fe0040cb1a0 2024-04-26T20:58:42.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.831+0000 7fe00c000640 1 -- 172.21.15.138:0/1733023759 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe00415a130 con 0x7fe0040cb1a0 2024-04-26T20:58:42.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.831+0000 7fe00c000640 1 -- 172.21.15.138:0/1733023759 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe004069510 con 0x7fe0040cb1a0 2024-04-26T20:58:42.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.835+0000 7fe001600640 1 -- 172.21.15.138:0/1733023759 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdff80b55b0 con 0x7fe0040cb1a0 2024-04-26T20:58:42.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.835+0000 7fe001600640 1 --2- 172.21.15.138:0/1733023759 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fdfe4068380 0x7fdfe406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:42.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.835+0000 7fe001600640 1 -- 172.21.15.138:0/1733023759 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6404+0+0 (secure 0 0 0) 0x7fdff81208b0 con 0x7fe0040cb1a0 2024-04-26T20:58:42.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.835+0000 7fe008c00640 1 --2- 172.21.15.138:0/1733023759 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fdfe4068380 0x7fdfe406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:42.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.835+0000 7fe008c00640 1 --2- 172.21.15.138:0/1733023759 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fdfe4068380 0x7fdfe406a840 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe0041fb660 tx=0x7fdff0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:42.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.839+0000 7fe001600640 1 -- 172.21.15.138:0/1733023759 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fdff8016090 con 0x7fe0040cb1a0 2024-04-26T20:58:42.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:42.995+0000 7fe00c000640 1 -- 172.21.15.138:0/1733023759 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "recovery_fs_metadata", "pool2": "recovery_fs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe0040d1910 con 0x7fe0040cb1a0 2024-04-26T20:58:43.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:43.827+0000 7fe001600640 1 -- 172.21.15.138:0/1733023759 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "recovery_fs_metadata", "pool2": "recovery_fs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'recovery_fs_metadata' removed v54) ==== 196+0+0 (secure 0 0 0) 0x7fdff80f0b10 con 0x7fe0040cb1a0 2024-04-26T20:58:43.831 INFO:teuthology.orchestra.run.smithi138.stderr:pool 'recovery_fs_metadata' removed 2024-04-26T20:58:43.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:43.831+0000 7fe00c000640 1 -- 172.21.15.138:0/1733023759 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fdfe4068380 msgr2=0x7fdfe406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:43.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:43.831+0000 7fe00c000640 1 --2- 172.21.15.138:0/1733023759 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fdfe4068380 0x7fdfe406a840 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe0041fb660 tx=0x7fdff0008040 comp rx=0 tx=0).stop 2024-04-26T20:58:43.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:43.831+0000 7fe00c000640 1 -- 172.21.15.138:0/1733023759 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0040cb1a0 msgr2=0x7fe00415ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:43.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:43.831+0000 7fe00c000640 1 --2- 172.21.15.138:0/1733023759 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0040cb1a0 0x7fe00415ac10 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fdff801a0d0 tx=0x7fdff8019240 comp rx=0 tx=0).stop 2024-04-26T20:58:43.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:43.831+0000 7fe00c000640 1 -- 172.21.15.138:0/1733023759 shutdown_connections 2024-04-26T20:58:43.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:43.831+0000 7fe00c000640 1 --2- 172.21.15.138:0/1733023759 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fdfe4068380 0x7fdfe406a840 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:43.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:43.831+0000 7fe00c000640 1 --2- 172.21.15.138:0/1733023759 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe00415c020 0x7fe0040c5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:43.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:43.831+0000 7fe00c000640 1 --2- 172.21.15.138:0/1733023759 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe00415bc40 0x7fe0040c5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:43.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:43.831+0000 7fe00c000640 1 --2- 172.21.15.138:0/1733023759 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0040cb1a0 0x7fe00415ac10 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:43.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:43.831+0000 7fe00c000640 1 -- 172.21.15.138:0/1733023759 >> 172.21.15.138:0/1733023759 conn(0x7fe0040d0b50 msgr2=0x7fe004168c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:43.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:43.831+0000 7fe00c000640 1 -- 172.21.15.138:0/1733023759 shutdown_connections 2024-04-26T20:58:43.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:43.831+0000 7fe00c000640 1 -- 172.21.15.138:0/1733023759 wait complete. 2024-04-26T20:58:43.857 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-26T20:58:43.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:43.995+0000 7f7d6ca00640 1 Processor -- start 2024-04-26T20:58:43.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:43.995+0000 7f7d6ca00640 1 -- start start 2024-04-26T20:58:44.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:43.999+0000 7f7d6ca00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f7d6815f0f0 0x7f7d680b4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:44.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:43.999+0000 7f7d6ca00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7d680ae990 0x7f7d6806e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:44.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:43.999+0000 7f7d6ca00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7d6806ec20 0x7f7d680b5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:44.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:43.999+0000 7f7d6ca00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f7d680b4d70 con 0x7f7d6815f0f0 2024-04-26T20:58:44.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:43.999+0000 7f7d6ca00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f7d680b5050 con 0x7f7d6806ec20 2024-04-26T20:58:44.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:43.999+0000 7f7d6ca00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f7d680b5330 con 0x7f7d680ae990 2024-04-26T20:58:44.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:43.999+0000 7f7d65e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f7d6815f0f0 0x7f7d680b4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:44.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:43.999+0000 7f7d65e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f7d6815f0f0 0x7f7d680b4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:47762/0 (socket says 172.21.15.138:47762) 2024-04-26T20:58:44.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:43.999+0000 7f7d65e00640 1 -- 172.21.15.138:0/2833247929 learned_addr learned my addr 172.21.15.138:0/2833247929 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:44.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:43.999+0000 7f7d66800640 1 --2- 172.21.15.138:0/2833247929 >> v2:172.21.15.143:3300/0 conn(0x7f7d6806ec20 0x7f7d680b5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:44.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:43.999+0000 7f7d5d400640 1 --2- 172.21.15.138:0/2833247929 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7d680ae990 0x7f7d6806e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:44.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:43.999+0000 7f7d65e00640 1 -- 172.21.15.138:0/2833247929 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7d680ae990 msgr2=0x7f7d6806e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:44.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:43.999+0000 7f7d65e00640 1 --2- 172.21.15.138:0/2833247929 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7d680ae990 0x7f7d6806e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:44.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:43.999+0000 7f7d65e00640 1 -- 172.21.15.138:0/2833247929 >> v2:172.21.15.143:3300/0 conn(0x7f7d6806ec20 msgr2=0x7f7d680b5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:44.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:43.999+0000 7f7d65e00640 1 --2- 172.21.15.138:0/2833247929 >> v2:172.21.15.143:3300/0 conn(0x7f7d6806ec20 0x7f7d680b5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:44.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:43.999+0000 7f7d65e00640 1 -- 172.21.15.138:0/2833247929 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d680b5610 con 0x7f7d6815f0f0 2024-04-26T20:58:44.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.003+0000 7f7d65e00640 1 --2- 172.21.15.138:0/2833247929 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7d6815f0f0 0x7f7d680b4400 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f7d58009e50 tx=0x7f7d5801f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f8b7bdd7eb695b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:44.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.003+0000 7f7d65400640 1 -- 172.21.15.138:0/2833247929 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d580b4070 con 0x7f7d6815f0f0 2024-04-26T20:58:44.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.003+0000 7f7d65400640 1 -- 172.21.15.138:0/2833247929 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d580af400 con 0x7f7d6815f0f0 2024-04-26T20:58:44.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.003+0000 7f7d65400640 1 -- 172.21.15.138:0/2833247929 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d580af7d0 con 0x7f7d6815f0f0 2024-04-26T20:58:44.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.003+0000 7f7d6ca00640 1 -- 172.21.15.138:0/2833247929 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7d6815f0f0 msgr2=0x7f7d680b4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:44.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.003+0000 7f7d6ca00640 1 --2- 172.21.15.138:0/2833247929 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7d6815f0f0 0x7f7d680b4400 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f7d58009e50 tx=0x7f7d5801f1e0 comp rx=0 tx=0).stop 2024-04-26T20:58:44.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.003+0000 7f7d6ca00640 1 -- 172.21.15.138:0/2833247929 shutdown_connections 2024-04-26T20:58:44.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.003+0000 7f7d6ca00640 1 --2- 172.21.15.138:0/2833247929 >> v2:172.21.15.143:3300/0 conn(0x7f7d6806ec20 0x7f7d680b5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:44.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.003+0000 7f7d6ca00640 1 --2- 172.21.15.138:0/2833247929 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7d680ae990 0x7f7d6806e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:44.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.003+0000 7f7d6ca00640 1 --2- 172.21.15.138:0/2833247929 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7d6815f0f0 0x7f7d680b4400 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:44.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.003+0000 7f7d6ca00640 1 -- 172.21.15.138:0/2833247929 >> 172.21.15.138:0/2833247929 conn(0x7f7d68072790 msgr2=0x7f7d68072ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:44.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.003+0000 7f7d6ca00640 1 -- 172.21.15.138:0/2833247929 shutdown_connections 2024-04-26T20:58:44.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.003+0000 7f7d6ca00640 1 -- 172.21.15.138:0/2833247929 wait complete. 2024-04-26T20:58:44.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.003+0000 7f7d6ca00640 1 Processor -- start 2024-04-26T20:58:44.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.003+0000 7f7d6ca00640 1 -- start start 2024-04-26T20:58:44.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.007+0000 7f7d6ca00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7d6806ec20 0x7f7d681e79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:44.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.007+0000 7f7d6ca00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d680ae990 0x7f7d68144cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:44.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.007+0000 7f7d6ca00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7d6815f0f0 0x7f7d681e9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:44.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.007+0000 7f7d6ca00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f7d6815f650 con 0x7f7d6806ec20 2024-04-26T20:58:44.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.007+0000 7f7d6ca00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f7d6815f4d0 con 0x7f7d680ae990 2024-04-26T20:58:44.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.007+0000 7f7d6ca00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f7d680b4940 con 0x7f7d6815f0f0 2024-04-26T20:58:44.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.007+0000 7f7d65e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7d6806ec20 0x7f7d681e79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:44.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.007+0000 7f7d65e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7d6806ec20 0x7f7d681e79a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:47772/0 (socket says 172.21.15.138:47772) 2024-04-26T20:58:44.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.007+0000 7f7d65e00640 1 -- 172.21.15.138:0/345251960 learned_addr learned my addr 172.21.15.138:0/345251960 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:44.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.007+0000 7f7d66800640 1 --2- 172.21.15.138:0/345251960 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7d6815f0f0 0x7f7d681e9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:44.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.007+0000 7f7d5d400640 1 --2- 172.21.15.138:0/345251960 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d680ae990 0x7f7d68144cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:44.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.007+0000 7f7d65e00640 1 -- 172.21.15.138:0/345251960 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7d6815f0f0 msgr2=0x7f7d681e9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:44.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.007+0000 7f7d65e00640 1 --2- 172.21.15.138:0/345251960 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7d6815f0f0 0x7f7d681e9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:44.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.007+0000 7f7d65e00640 1 -- 172.21.15.138:0/345251960 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d680ae990 msgr2=0x7f7d68144cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:44.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.007+0000 7f7d65e00640 1 --2- 172.21.15.138:0/345251960 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d680ae990 0x7f7d68144cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:44.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.007+0000 7f7d65e00640 1 -- 172.21.15.138:0/345251960 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d681e82a0 con 0x7f7d6806ec20 2024-04-26T20:58:44.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.007+0000 7f7d66800640 1 --2- 172.21.15.138:0/345251960 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7d6815f0f0 0x7f7d681e9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:58:44.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.007+0000 7f7d5d400640 1 --2- 172.21.15.138:0/345251960 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d680ae990 0x7f7d68144cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:58:44.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.007+0000 7f7d65e00640 1 --2- 172.21.15.138:0/345251960 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7d6806ec20 0x7f7d681e79a0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f7d580b2040 tx=0x7f7d5801bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:44.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.007+0000 7f7d5ea00640 1 -- 172.21.15.138:0/345251960 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d580be020 con 0x7f7d6806ec20 2024-04-26T20:58:44.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.007+0000 7f7d5ea00640 1 -- 172.21.15.138:0/345251960 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d580afe10 con 0x7f7d6806ec20 2024-04-26T20:58:44.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.007+0000 7f7d5ea00640 1 -- 172.21.15.138:0/345251960 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d580b4040 con 0x7f7d6806ec20 2024-04-26T20:58:44.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.007+0000 7f7d6ca00640 1 -- 172.21.15.138:0/345251960 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d681e8580 con 0x7f7d6806ec20 2024-04-26T20:58:44.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.007+0000 7f7d6ca00640 1 -- 172.21.15.138:0/345251960 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d681e7ee0 con 0x7f7d6806ec20 2024-04-26T20:58:44.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.007+0000 7f7d6ca00640 1 -- 172.21.15.138:0/345251960 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d68069510 con 0x7f7d6806ec20 2024-04-26T20:58:44.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.007+0000 7f7d5ea00640 1 -- 172.21.15.138:0/345251960 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7d580c1020 con 0x7f7d6806ec20 2024-04-26T20:58:44.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.011+0000 7f7d5ea00640 1 --2- 172.21.15.138:0/345251960 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7d44068380 0x7f7d4406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:44.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.011+0000 7f7d5ea00640 1 -- 172.21.15.138:0/345251960 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5956+0+0 (secure 0 0 0) 0x7f7d58124cc0 con 0x7f7d6806ec20 2024-04-26T20:58:44.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.011+0000 7f7d5d400640 1 --2- 172.21.15.138:0/345251960 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7d44068380 0x7f7d4406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:44.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.011+0000 7f7d5d400640 1 --2- 172.21.15.138:0/345251960 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7d44068380 0x7f7d4406a840 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7d68152010 tx=0x7f7d50008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:44.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.015+0000 7f7d5ea00640 1 -- 172.21.15.138:0/345251960 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7d5812b080 con 0x7f7d6806ec20 2024-04-26T20:58:44.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.175+0000 7f7d6ca00640 1 -- 172.21.15.138:0/345251960 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7d68068590 con 0x7f7d6806ec20 2024-04-26T20:58:44.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.831+0000 7f7d5ea00640 1 -- 172.21.15.138:0/345251960 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v55) ==== 169+0+0 (secure 0 0 0) 0x7f7d580c8030 con 0x7f7d6806ec20 2024-04-26T20:58:44.833 INFO:teuthology.orchestra.run.smithi138.stderr:pool 'cephfs_data' removed 2024-04-26T20:58:44.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.835+0000 7f7d6ca00640 1 -- 172.21.15.138:0/345251960 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7d44068380 msgr2=0x7f7d4406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:44.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.835+0000 7f7d6ca00640 1 --2- 172.21.15.138:0/345251960 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7d44068380 0x7f7d4406a840 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7d68152010 tx=0x7f7d50008040 comp rx=0 tx=0).stop 2024-04-26T20:58:44.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.835+0000 7f7d6ca00640 1 -- 172.21.15.138:0/345251960 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7d6806ec20 msgr2=0x7f7d681e79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:44.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.835+0000 7f7d6ca00640 1 --2- 172.21.15.138:0/345251960 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7d6806ec20 0x7f7d681e79a0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f7d580b2040 tx=0x7f7d5801bf80 comp rx=0 tx=0).stop 2024-04-26T20:58:44.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.835+0000 7f7d6ca00640 1 -- 172.21.15.138:0/345251960 shutdown_connections 2024-04-26T20:58:44.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.835+0000 7f7d6ca00640 1 --2- 172.21.15.138:0/345251960 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f7d44068380 0x7f7d4406a840 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:44.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.835+0000 7f7d6ca00640 1 --2- 172.21.15.138:0/345251960 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7d6815f0f0 0x7f7d681e9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:44.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.835+0000 7f7d6ca00640 1 --2- 172.21.15.138:0/345251960 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d680ae990 0x7f7d68144cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:44.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.835+0000 7f7d6ca00640 1 --2- 172.21.15.138:0/345251960 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7d6806ec20 0x7f7d681e79a0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:44.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.835+0000 7f7d6ca00640 1 -- 172.21.15.138:0/345251960 >> 172.21.15.138:0/345251960 conn(0x7f7d68072790 msgr2=0x7f7d680b5d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:44.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.835+0000 7f7d6ca00640 1 -- 172.21.15.138:0/345251960 shutdown_connections 2024-04-26T20:58:44.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:44.839+0000 7f7d6ca00640 1 -- 172.21.15.138:0/345251960 wait complete. 2024-04-26T20:58:44.866 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds debug_mds 2024-04-26T20:58:45.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.003+0000 7f627ce00640 1 Processor -- start 2024-04-26T20:58:45.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.003+0000 7f627ce00640 1 -- start start 2024-04-26T20:58:45.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.003+0000 7f627ce00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f627815bdc0 0x7f627815f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:45.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.003+0000 7f627ce00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f627806f880 0x7f62780ce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:45.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.003+0000 7f627ce00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f627806dee0 con 0x7f6278073d70 2024-04-26T20:58:45.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.003+0000 7f627ce00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f627815c1a0 con 0x7f627815bdc0 2024-04-26T20:58:45.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.003+0000 7f627ce00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f627806e180 con 0x7f627806f880 2024-04-26T20:58:45.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.003+0000 7f6275e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f627815bdc0 0x7f627815f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:45.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.003+0000 7f6275e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f627815bdc0 0x7f627815f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:47788/0 (socket says 172.21.15.138:47788) 2024-04-26T20:58:45.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.003+0000 7f6275e00640 1 -- 172.21.15.138:0/1231139968 learned_addr learned my addr 172.21.15.138:0/1231139968 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:45.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.003+0000 7f6275e00640 1 -- 172.21.15.138:0/1231139968 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f627806f880 msgr2=0x7f62780ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:45.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.003+0000 7f6275e00640 1 --2- 172.21.15.138:0/1231139968 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f627806f880 0x7f62780ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:45.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.003+0000 7f6275e00640 1 -- 172.21.15.138:0/1231139968 >> v1:172.21.15.143:6789/0 conn(0x7f6278073d70 legacy=0x7f627815fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:45.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.003+0000 7f6275e00640 1 -- 172.21.15.138:0/1231139968 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f627806e460 con 0x7f627815bdc0 2024-04-26T20:58:45.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.007+0000 7f6275e00640 1 --2- 172.21.15.138:0/1231139968 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f627815bdc0 0x7f627815f930 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f6278071b20 tx=0x7f626801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3565144e28c4008 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:45.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.007+0000 7f6274a00640 1 -- 172.21.15.138:0/1231139968 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62680b0070 con 0x7f627815bdc0 2024-04-26T20:58:45.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.007+0000 7f6274a00640 1 -- 172.21.15.138:0/1231139968 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62680ab600 con 0x7f627815bdc0 2024-04-26T20:58:45.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.007+0000 7f6274a00640 1 -- 172.21.15.138:0/1231139968 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62680ab9d0 con 0x7f627815bdc0 2024-04-26T20:58:45.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.007+0000 7f627ce00640 1 -- 172.21.15.138:0/1231139968 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f627815bdc0 msgr2=0x7f627815f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:45.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.007+0000 7f627ce00640 1 --2- 172.21.15.138:0/1231139968 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f627815bdc0 0x7f627815f930 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f6278071b20 tx=0x7f626801c470 comp rx=0 tx=0).stop 2024-04-26T20:58:45.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.007+0000 7f627ce00640 1 -- 172.21.15.138:0/1231139968 shutdown_connections 2024-04-26T20:58:45.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.007+0000 7f627ce00640 1 --2- 172.21.15.138:0/1231139968 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f627806f880 0x7f62780ce780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:45.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.007+0000 7f627ce00640 1 --2- 172.21.15.138:0/1231139968 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f627815bdc0 0x7f627815f930 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:45.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.007+0000 7f627ce00640 1 -- 172.21.15.138:0/1231139968 >> 172.21.15.138:0/1231139968 conn(0x7f62780d0bb0 msgr2=0x7f62780d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:45.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.007+0000 7f627ce00640 1 -- 172.21.15.138:0/1231139968 shutdown_connections 2024-04-26T20:58:45.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.007+0000 7f627ce00640 1 -- 172.21.15.138:0/1231139968 wait complete. 2024-04-26T20:58:45.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.007+0000 7f627ce00640 1 Processor -- start 2024-04-26T20:58:45.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.007+0000 7f627ce00640 1 -- start start 2024-04-26T20:58:45.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.011+0000 7f627ce00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f627806f880 0x7f6278148140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:45.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.011+0000 7f627ce00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6278073d70 0x7f62781666b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:45.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.011+0000 7f627ce00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f627815bdc0 0x7f62780b5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:45.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.011+0000 7f627ce00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f6278168e50 con 0x7f6278073d70 2024-04-26T20:58:45.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.011+0000 7f627ce00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f6278168cd0 con 0x7f627815bdc0 2024-04-26T20:58:45.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.011+0000 7f627ce00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f6278168fd0 con 0x7f627806f880 2024-04-26T20:58:45.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.011+0000 7f6275400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6278073d70 0x7f62781666b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:45.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.011+0000 7f6275400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6278073d70 0x7f62781666b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:47790/0 (socket says 172.21.15.138:47790) 2024-04-26T20:58:45.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.011+0000 7f6275400640 1 -- 172.21.15.138:0/1453013750 learned_addr learned my addr 172.21.15.138:0/1453013750 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:45.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.011+0000 7f6275e00640 1 --2- 172.21.15.138:0/1453013750 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f627806f880 0x7f6278148140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:45.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.011+0000 7f6276800640 1 --2- 172.21.15.138:0/1453013750 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f627815bdc0 0x7f62780b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:45.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.011+0000 7f6275400640 1 -- 172.21.15.138:0/1453013750 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f627806f880 msgr2=0x7f6278148140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:45.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.011+0000 7f6275400640 1 --2- 172.21.15.138:0/1453013750 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f627806f880 0x7f6278148140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:45.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.011+0000 7f6275400640 1 -- 172.21.15.138:0/1453013750 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f627815bdc0 msgr2=0x7f62780b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:45.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.011+0000 7f6275400640 1 --2- 172.21.15.138:0/1453013750 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f627815bdc0 0x7f62780b5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:45.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.011+0000 7f6275400640 1 -- 172.21.15.138:0/1453013750 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6278165610 con 0x7f6278073d70 2024-04-26T20:58:45.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.011+0000 7f6275400640 1 --2- 172.21.15.138:0/1453013750 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6278073d70 0x7f62781666b0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f626400c410 tx=0x7f626400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:45.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.011+0000 7f626e000640 1 -- 172.21.15.138:0/1453013750 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6264017070 con 0x7f6278073d70 2024-04-26T20:58:45.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.011+0000 7f626e000640 1 -- 172.21.15.138:0/1453013750 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6264003600 con 0x7f6278073d70 2024-04-26T20:58:45.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.011+0000 7f627ce00640 1 -- 172.21.15.138:0/1453013750 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62781658f0 con 0x7f6278073d70 2024-04-26T20:58:45.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.011+0000 7f626e000640 1 -- 172.21.15.138:0/1453013750 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62640039f0 con 0x7f6278073d70 2024-04-26T20:58:45.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.011+0000 7f627ce00640 1 -- 172.21.15.138:0/1453013750 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6278165eb0 con 0x7f6278073d70 2024-04-26T20:58:45.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.011+0000 7f627ce00640 1 -- 172.21.15.138:0/1453013750 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6278069430 con 0x7f6278073d70 2024-04-26T20:58:45.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.015+0000 7f626e000640 1 -- 172.21.15.138:0/1453013750 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f626401a070 con 0x7f6278073d70 2024-04-26T20:58:45.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.015+0000 7f626e000640 1 --2- 172.21.15.138:0/1453013750 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6258068380 0x7f625806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:45.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.015+0000 7f626e000640 1 -- 172.21.15.138:0/1453013750 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5421+0+0 (secure 0 0 0) 0x7f6264085bb0 con 0x7f6278073d70 2024-04-26T20:58:45.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.015+0000 7f6275e00640 1 --2- 172.21.15.138:0/1453013750 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6258068380 0x7f625806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:45.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.015+0000 7f6275e00640 1 --2- 172.21.15.138:0/1453013750 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6258068380 0x7f625806a840 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f62680ad000 tx=0x7f62680a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:45.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.019+0000 7f626e000640 1 -- 172.21.15.138:0/1453013750 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6264055c40 con 0x7f6278073d70 2024-04-26T20:58:45.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.175+0000 7f627ce00640 1 -- 172.21.15.138:0/1453013750 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "debug_mds"} v 0) -- 0x7f62780b3f20 con 0x7f6278073d70 2024-04-26T20:58:45.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.179+0000 7f626e000640 1 -- 172.21.15.138:0/1453013750 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "debug_mds"}]=0 v12) ==== 92+0+0 (secure 0 0 0) 0x7f6264059f40 con 0x7f6278073d70 2024-04-26T20:58:45.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.183+0000 7f627ce00640 1 -- 172.21.15.138:0/1453013750 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6258068380 msgr2=0x7f625806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:45.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.183+0000 7f627ce00640 1 --2- 172.21.15.138:0/1453013750 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6258068380 0x7f625806a840 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f62680ad000 tx=0x7f62680a6000 comp rx=0 tx=0).stop 2024-04-26T20:58:45.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.183+0000 7f627ce00640 1 -- 172.21.15.138:0/1453013750 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6278073d70 msgr2=0x7f62781666b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:45.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.183+0000 7f627ce00640 1 --2- 172.21.15.138:0/1453013750 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6278073d70 0x7f62781666b0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f626400c410 tx=0x7f626400c8d0 comp rx=0 tx=0).stop 2024-04-26T20:58:45.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.183+0000 7f627ce00640 1 -- 172.21.15.138:0/1453013750 shutdown_connections 2024-04-26T20:58:45.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.183+0000 7f627ce00640 1 --2- 172.21.15.138:0/1453013750 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f6258068380 0x7f625806a840 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:45.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.183+0000 7f627ce00640 1 --2- 172.21.15.138:0/1453013750 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f627815bdc0 0x7f62780b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:45.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.183+0000 7f627ce00640 1 --2- 172.21.15.138:0/1453013750 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6278073d70 0x7f62781666b0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:45.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.183+0000 7f627ce00640 1 --2- 172.21.15.138:0/1453013750 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f627806f880 0x7f6278148140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:45.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.183+0000 7f627ce00640 1 -- 172.21.15.138:0/1453013750 >> 172.21.15.138:0/1453013750 conn(0x7f62780d0bb0 msgr2=0x7f62780ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:45.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.183+0000 7f627ce00640 1 -- 172.21.15.138:0/1453013750 shutdown_connections 2024-04-26T20:58:45.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.183+0000 7f627ce00640 1 -- 172.21.15.138:0/1453013750 wait complete. 2024-04-26T20:58:45.203 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-26T20:58:45.341 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.339+0000 7fdb78600640 1 Processor -- start 2024-04-26T20:58:45.341 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.339+0000 7fdb78600640 1 -- start start 2024-04-26T20:58:45.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.339+0000 7fdb78600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdb7006f880 0x7fdb70166cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:45.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.339+0000 7fdb78600640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb70160750 con 0x7fdb7015bdc0 2024-04-26T20:58:45.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.339+0000 7fdb78600640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb7006dee0 con 0x7fdb70073d70 2024-04-26T20:58:45.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.339+0000 7fdb78600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fdb7015c1a0 con 0x7fdb7006f880 2024-04-26T20:58:45.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.339+0000 7fdb75c00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fdb7015bdc0 0x7fdb7015f930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:60012/0 (socket says 172.21.15.138:60012) 2024-04-26T20:58:45.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.339+0000 7fdb75c00640 1 -- 172.21.15.138:0/4150299603 learned_addr learned my addr 172.21.15.138:0/4150299603 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:45.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.339+0000 7fdb76600640 1 --2- 172.21.15.138:0/4150299603 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdb7006f880 0x7fdb70166cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:45.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.339+0000 7fdb6fe00640 1 -- 172.21.15.138:0/4150299603 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1396710406 0 0) 0x7fdb70160750 con 0x7fdb7015bdc0 2024-04-26T20:58:45.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.339+0000 7fdb6fe00640 1 -- 172.21.15.138:0/4150299603 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb58003530 con 0x7fdb7015bdc0 2024-04-26T20:58:45.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.339+0000 7fdb6fe00640 1 -- 172.21.15.138:0/4150299603 <== mon.0 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3944651672 0 0) 0x7fdb58003530 con 0x7fdb7015bdc0 2024-04-26T20:58:45.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.339+0000 7fdb76600640 1 -- 172.21.15.138:0/4150299603 >> v1:172.21.15.143:6789/0 conn(0x7fdb70073d70 legacy=0x7fdb70160040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:45.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.339+0000 7fdb76600640 1 -- 172.21.15.138:0/4150299603 >> v1:172.21.15.138:6789/0 conn(0x7fdb7015bdc0 legacy=0x7fdb7015f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:45.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.339+0000 7fdb76600640 1 -- 172.21.15.138:0/4150299603 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb7006e180 con 0x7fdb7006f880 2024-04-26T20:58:45.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.343+0000 7fdb76600640 1 --2- 172.21.15.138:0/4150299603 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdb7006f880 0x7fdb70166cc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdb68009dc0 tx=0x7fdb6801c6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf3490042ae6c01f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:45.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.343+0000 7fdb6fe00640 1 -- 172.21.15.138:0/4150299603 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb680ac070 con 0x7fdb7006f880 2024-04-26T20:58:45.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.343+0000 7fdb6fe00640 1 -- 172.21.15.138:0/4150299603 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb680a6410 con 0x7fdb7006f880 2024-04-26T20:58:45.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.343+0000 7fdb6fe00640 1 -- 172.21.15.138:0/4150299603 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb64001680 con 0x7fdb7006f880 2024-04-26T20:58:45.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.343+0000 7fdb78600640 1 -- 172.21.15.138:0/4150299603 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdb7006f880 msgr2=0x7fdb70166cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:45.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.343+0000 7fdb78600640 1 --2- 172.21.15.138:0/4150299603 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdb7006f880 0x7fdb70166cc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdb68009dc0 tx=0x7fdb6801c6d0 comp rx=0 tx=0).stop 2024-04-26T20:58:45.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.343+0000 7fdb78600640 1 -- 172.21.15.138:0/4150299603 shutdown_connections 2024-04-26T20:58:45.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.343+0000 7fdb78600640 1 --2- 172.21.15.138:0/4150299603 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdb7006f880 0x7fdb70166cc0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:45.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.343+0000 7fdb78600640 1 -- 172.21.15.138:0/4150299603 >> 172.21.15.138:0/4150299603 conn(0x7fdb700d0bb0 msgr2=0x7fdb700d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:45.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.343+0000 7fdb78600640 1 -- 172.21.15.138:0/4150299603 shutdown_connections 2024-04-26T20:58:45.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.343+0000 7fdb78600640 1 -- 172.21.15.138:0/4150299603 wait complete. 2024-04-26T20:58:45.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.347+0000 7fdb78600640 1 Processor -- start 2024-04-26T20:58:45.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.347+0000 7fdb78600640 1 -- start start 2024-04-26T20:58:45.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.347+0000 7fdb78600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdb7006f880 0x7fdb700c4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:45.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.347+0000 7fdb78600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdb70073d70 0x7fdb700b5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:45.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.347+0000 7fdb78600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdb7015bdc0 0x7fdb7014dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:45.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.347+0000 7fdb78600640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fdb70169ba0 con 0x7fdb7015bdc0 2024-04-26T20:58:45.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.347+0000 7fdb78600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fdb70169a20 con 0x7fdb70073d70 2024-04-26T20:58:45.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.347+0000 7fdb78600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fdb70169d20 con 0x7fdb7006f880 2024-04-26T20:58:45.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.347+0000 7fdb76600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdb7015bdc0 0x7fdb7014dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:45.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.347+0000 7fdb76600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdb7015bdc0 0x7fdb7014dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:47806/0 (socket says 172.21.15.138:47806) 2024-04-26T20:58:45.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.347+0000 7fdb76600640 1 -- 172.21.15.138:0/851807251 learned_addr learned my addr 172.21.15.138:0/851807251 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:45.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.347+0000 7fdb75c00640 1 --2- 172.21.15.138:0/851807251 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdb7006f880 0x7fdb700c4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:45.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.347+0000 7fdb75200640 1 --2- 172.21.15.138:0/851807251 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdb70073d70 0x7fdb700b5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:45.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.347+0000 7fdb76600640 1 -- 172.21.15.138:0/851807251 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdb7006f880 msgr2=0x7fdb700c4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:45.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.347+0000 7fdb76600640 1 --2- 172.21.15.138:0/851807251 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdb7006f880 0x7fdb700c4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:45.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.347+0000 7fdb76600640 1 -- 172.21.15.138:0/851807251 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdb70073d70 msgr2=0x7fdb700b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:45.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.347+0000 7fdb76600640 1 --2- 172.21.15.138:0/851807251 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdb70073d70 0x7fdb700b5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:45.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.347+0000 7fdb76600640 1 -- 172.21.15.138:0/851807251 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb700c4960 con 0x7fdb7015bdc0 2024-04-26T20:58:45.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.347+0000 7fdb76600640 1 --2- 172.21.15.138:0/851807251 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdb7015bdc0 0x7fdb7014dbf0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fdb6801ad80 tx=0x7fdb68019470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:45.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.347+0000 7fdb6d600640 1 -- 172.21.15.138:0/851807251 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb680ac070 con 0x7fdb7015bdc0 2024-04-26T20:58:45.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.347+0000 7fdb6d600640 1 -- 172.21.15.138:0/851807251 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb680b1860 con 0x7fdb7015bdc0 2024-04-26T20:58:45.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.347+0000 7fdb78600640 1 -- 172.21.15.138:0/851807251 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb700c4c40 con 0x7fdb7015bdc0 2024-04-26T20:58:45.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.347+0000 7fdb6d600640 1 -- 172.21.15.138:0/851807251 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb68009450 con 0x7fdb7015bdc0 2024-04-26T20:58:45.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.347+0000 7fdb78600640 1 -- 172.21.15.138:0/851807251 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb700c5200 con 0x7fdb7015bdc0 2024-04-26T20:58:45.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.351+0000 7fdb78600640 1 -- 172.21.15.138:0/851807251 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb70069430 con 0x7fdb7015bdc0 2024-04-26T20:58:45.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.351+0000 7fdb6d600640 1 -- 172.21.15.138:0/851807251 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdb680af070 con 0x7fdb7015bdc0 2024-04-26T20:58:45.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.351+0000 7fdb6d600640 1 --2- 172.21.15.138:0/851807251 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fdb50068380 0x7fdb5006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:45.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.351+0000 7fdb6d600640 1 -- 172.21.15.138:0/851807251 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5421+0+0 (secure 0 0 0) 0x7fdb68120fe0 con 0x7fdb7015bdc0 2024-04-26T20:58:45.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.351+0000 7fdb75c00640 1 --2- 172.21.15.138:0/851807251 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fdb50068380 0x7fdb5006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:45.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.351+0000 7fdb75c00640 1 --2- 172.21.15.138:0/851807251 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fdb50068380 0x7fdb5006a840 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fdb64001ec0 tx=0x7fdb64001c50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:45.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.355+0000 7fdb6d600640 1 -- 172.21.15.138:0/851807251 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fdb680c1060 con 0x7fdb7015bdc0 2024-04-26T20:58:45.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.515+0000 7fdb78600640 1 -- 172.21.15.138:0/851807251 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fdb7006f660 con 0x7fdb7015bdc0 2024-04-26T20:58:45.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.519+0000 7fdb6d600640 1 -- 172.21.15.138:0/851807251 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) ==== 104+0+0 (secure 0 0 0) 0x7fdb680164a0 con 0x7fdb7015bdc0 2024-04-26T20:58:45.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.519+0000 7fdb78600640 1 -- 172.21.15.138:0/851807251 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fdb50068380 msgr2=0x7fdb5006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:45.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.519+0000 7fdb78600640 1 --2- 172.21.15.138:0/851807251 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fdb50068380 0x7fdb5006a840 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fdb64001ec0 tx=0x7fdb64001c50 comp rx=0 tx=0).stop 2024-04-26T20:58:45.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.519+0000 7fdb78600640 1 -- 172.21.15.138:0/851807251 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdb7015bdc0 msgr2=0x7fdb7014dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:45.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.519+0000 7fdb78600640 1 --2- 172.21.15.138:0/851807251 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdb7015bdc0 0x7fdb7014dbf0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fdb6801ad80 tx=0x7fdb68019470 comp rx=0 tx=0).stop 2024-04-26T20:58:45.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.519+0000 7fdb78600640 1 -- 172.21.15.138:0/851807251 shutdown_connections 2024-04-26T20:58:45.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.519+0000 7fdb78600640 1 --2- 172.21.15.138:0/851807251 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fdb50068380 0x7fdb5006a840 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:45.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.519+0000 7fdb78600640 1 --2- 172.21.15.138:0/851807251 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdb7015bdc0 0x7fdb7014dbf0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:45.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.519+0000 7fdb78600640 1 --2- 172.21.15.138:0/851807251 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdb70073d70 0x7fdb700b5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:45.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.519+0000 7fdb78600640 1 --2- 172.21.15.138:0/851807251 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdb7006f880 0x7fdb700c4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:45.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.519+0000 7fdb78600640 1 -- 172.21.15.138:0/851807251 >> 172.21.15.138:0/851807251 conn(0x7fdb700d0bb0 msgr2=0x7fdb70160290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:45.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.519+0000 7fdb78600640 1 -- 172.21.15.138:0/851807251 shutdown_connections 2024-04-26T20:58:45.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.519+0000 7fdb78600640 1 -- 172.21.15.138:0/851807251 wait complete. 2024-04-26T20:58:45.541 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_recovery_pool.TestRecoveryPool.test_rebuild_simple' 2024-04-26T20:58:45.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.675+0000 7f863f600640 1 Processor -- start 2024-04-26T20:58:45.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.675+0000 7f863f600640 1 -- start start 2024-04-26T20:58:45.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.675+0000 7f863f600640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f863815e0c0 0x7f8638071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:45.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.675+0000 7f863f600640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f86380cca00 0x7f86380cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:45.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.675+0000 7f863f600640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86380cd360 con 0x7f863815ce20 2024-04-26T20:58:45.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.675+0000 7f863f600640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f8638073b70 con 0x7f863815e0c0 2024-04-26T20:58:45.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.675+0000 7f863f600640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f8638073e10 con 0x7f86380cca00 2024-04-26T20:58:45.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.675+0000 7f862fe00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f863815e0c0 0x7f8638071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:45.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.675+0000 7f863cc00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f863815ce20 0x7f8638161340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:60018/0 (socket says 172.21.15.138:60018) 2024-04-26T20:58:45.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.675+0000 7f863cc00640 1 -- 172.21.15.138:0/744000679 learned_addr learned my addr 172.21.15.138:0/744000679 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:45.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.675+0000 7f863d600640 1 --2- 172.21.15.138:0/744000679 >> v2:172.21.15.143:3300/0 conn(0x7f86380cca00 0x7f86380cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:45.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.679+0000 7f862fe00640 1 -- 172.21.15.138:0/744000679 >> v2:172.21.15.143:3300/0 conn(0x7f86380cca00 msgr2=0x7f86380cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:45.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.679+0000 7f862fe00640 1 --2- 172.21.15.138:0/744000679 >> v2:172.21.15.143:3300/0 conn(0x7f86380cca00 0x7f86380cce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:45.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.679+0000 7f862fe00640 1 -- 172.21.15.138:0/744000679 >> v1:172.21.15.138:6789/0 conn(0x7f863815ce20 legacy=0x7f8638161340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:45.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.679+0000 7f862fe00640 1 -- 172.21.15.138:0/744000679 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86380740f0 con 0x7f863815e0c0 2024-04-26T20:58:45.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.679+0000 7f862fe00640 1 --2- 172.21.15.138:0/744000679 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f863815e0c0 0x7f8638071ee0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f86380d0990 tx=0x7f862001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6dca05601d5c7be server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:45.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.679+0000 7f8637e00640 1 -- 172.21.15.138:0/744000679 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86200b0070 con 0x7f863815e0c0 2024-04-26T20:58:45.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.679+0000 7f8637e00640 1 -- 172.21.15.138:0/744000679 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86200ab600 con 0x7f863815e0c0 2024-04-26T20:58:45.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.679+0000 7f8637e00640 1 -- 172.21.15.138:0/744000679 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86200ab9d0 con 0x7f863815e0c0 2024-04-26T20:58:45.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.679+0000 7f863f600640 1 -- 172.21.15.138:0/744000679 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f863815e0c0 msgr2=0x7f8638071ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:45.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.679+0000 7f863f600640 1 --2- 172.21.15.138:0/744000679 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f863815e0c0 0x7f8638071ee0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f86380d0990 tx=0x7f862001c480 comp rx=0 tx=0).stop 2024-04-26T20:58:45.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.679+0000 7f863f600640 1 -- 172.21.15.138:0/744000679 shutdown_connections 2024-04-26T20:58:45.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.679+0000 7f863f600640 1 --2- 172.21.15.138:0/744000679 >> v2:172.21.15.143:3300/0 conn(0x7f86380cca00 0x7f86380cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:45.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.679+0000 7f863f600640 1 --2- 172.21.15.138:0/744000679 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f863815e0c0 0x7f8638071ee0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:45.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.679+0000 7f863f600640 1 -- 172.21.15.138:0/744000679 >> 172.21.15.138:0/744000679 conn(0x7f86380d0b20 msgr2=0x7f86380d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:45.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.679+0000 7f863f600640 1 -- 172.21.15.138:0/744000679 shutdown_connections 2024-04-26T20:58:45.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.683+0000 7f863f600640 1 -- 172.21.15.138:0/744000679 wait complete. 2024-04-26T20:58:45.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.683+0000 7f863f600640 1 Processor -- start 2024-04-26T20:58:45.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.683+0000 7f863f600640 1 -- start start 2024-04-26T20:58:45.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.683+0000 7f863f600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f86380cca00 0x7f863814bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:45.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.683+0000 7f863f600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f863815ce20 0x7f86380b4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:45.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.683+0000 7f863f600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f863815e0c0 0x7f863815b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:45.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.683+0000 7f863f600640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f863815d380 con 0x7f863815ce20 2024-04-26T20:58:45.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.683+0000 7f863f600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f863815d200 con 0x7f86380cca00 2024-04-26T20:58:45.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.683+0000 7f863f600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f863806e680 con 0x7f863815e0c0 2024-04-26T20:58:45.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.683+0000 7f862fe00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f863815ce20 0x7f86380b4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:45.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.683+0000 7f862fe00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f863815ce20 0x7f86380b4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:47832/0 (socket says 172.21.15.138:47832) 2024-04-26T20:58:45.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.683+0000 7f862fe00640 1 -- 172.21.15.138:0/2653187182 learned_addr learned my addr 172.21.15.138:0/2653187182 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:45.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.683+0000 7f863cc00640 1 --2- 172.21.15.138:0/2653187182 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f86380cca00 0x7f863814bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:45.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.683+0000 7f863d600640 1 --2- 172.21.15.138:0/2653187182 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f863815e0c0 0x7f863815b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:45.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.683+0000 7f862fe00640 1 -- 172.21.15.138:0/2653187182 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f863815e0c0 msgr2=0x7f863815b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:45.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.683+0000 7f862fe00640 1 --2- 172.21.15.138:0/2653187182 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f863815e0c0 0x7f863815b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:45.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.683+0000 7f862fe00640 1 -- 172.21.15.138:0/2653187182 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f86380cca00 msgr2=0x7f863814bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:45.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.683+0000 7f862fe00640 1 --2- 172.21.15.138:0/2653187182 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f86380cca00 0x7f863814bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:45.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.683+0000 7f862fe00640 1 -- 172.21.15.138:0/2653187182 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86380b5550 con 0x7f863815ce20 2024-04-26T20:58:45.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.683+0000 7f863cc00640 1 --2- 172.21.15.138:0/2653187182 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f86380cca00 0x7f863814bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:58:45.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.683+0000 7f862fe00640 1 --2- 172.21.15.138:0/2653187182 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f863815ce20 0x7f86380b4c00 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f86200ae040 tx=0x7f8620019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:45.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.683+0000 7f8635600640 1 -- 172.21.15.138:0/2653187182 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86200b0040 con 0x7f863815ce20 2024-04-26T20:58:45.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.683+0000 7f8635600640 1 -- 172.21.15.138:0/2653187182 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86200ba070 con 0x7f863815ce20 2024-04-26T20:58:45.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.683+0000 7f863f600640 1 -- 172.21.15.138:0/2653187182 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86380b5830 con 0x7f863815ce20 2024-04-26T20:58:45.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.683+0000 7f8635600640 1 -- 172.21.15.138:0/2653187182 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86200b4870 con 0x7f863815ce20 2024-04-26T20:58:45.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.683+0000 7f863f600640 1 -- 172.21.15.138:0/2653187182 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86380b5df0 con 0x7f863815ce20 2024-04-26T20:58:45.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.687+0000 7f863f600640 1 -- 172.21.15.138:0/2653187182 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8638069510 con 0x7f863815ce20 2024-04-26T20:58:45.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.687+0000 7f8635600640 1 -- 172.21.15.138:0/2653187182 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f86200ab4c0 con 0x7f863815ce20 2024-04-26T20:58:45.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.687+0000 7f8635600640 1 --2- 172.21.15.138:0/2653187182 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f8614068380 0x7f861406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:45.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.687+0000 7f8635600640 1 -- 172.21.15.138:0/2653187182 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5421+0+0 (secure 0 0 0) 0x7f86201205b0 con 0x7f863815ce20 2024-04-26T20:58:45.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.687+0000 7f863cc00640 1 --2- 172.21.15.138:0/2653187182 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f8614068380 0x7f861406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:45.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.687+0000 7f863cc00640 1 --2- 172.21.15.138:0/2653187182 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f8614068380 0x7f861406a840 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8628000f70 tx=0x7f8628009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:45.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.691+0000 7f8635600640 1 -- 172.21.15.138:0/2653187182 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8620016070 con 0x7f863815ce20 2024-04-26T20:58:45.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:45.911+0000 7f863f600640 1 -- 172.21.15.138:0/2653187182 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_recovery_pool.TestRecoveryPool.test_rebuild_simple"]} v 0) -- 0x7f8638071f80 con 0x7f863815ce20 2024-04-26T20:58:46.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:46.843+0000 7f8635600640 1 -- 172.21.15.138:0/2653187182 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_recovery_pool.TestRecoveryPool.test_rebuild_simple"]}]=0 v142) ==== 147+0+0 (secure 0 0 0) 0x7f86200f0c80 con 0x7f863815ce20 2024-04-26T20:58:46.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:46.847+0000 7f863f600640 1 -- 172.21.15.138:0/2653187182 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f8614068380 msgr2=0x7f861406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:46.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:46.847+0000 7f863f600640 1 --2- 172.21.15.138:0/2653187182 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f8614068380 0x7f861406a840 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8628000f70 tx=0x7f8628009040 comp rx=0 tx=0).stop 2024-04-26T20:58:46.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:46.847+0000 7f863f600640 1 -- 172.21.15.138:0/2653187182 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f863815ce20 msgr2=0x7f86380b4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:46.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:46.847+0000 7f863f600640 1 --2- 172.21.15.138:0/2653187182 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f863815ce20 0x7f86380b4c00 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f86200ae040 tx=0x7f8620019220 comp rx=0 tx=0).stop 2024-04-26T20:58:46.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:46.847+0000 7f863f600640 1 -- 172.21.15.138:0/2653187182 shutdown_connections 2024-04-26T20:58:46.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:46.847+0000 7f863f600640 1 --2- 172.21.15.138:0/2653187182 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f8614068380 0x7f861406a840 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:46.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:46.847+0000 7f863f600640 1 --2- 172.21.15.138:0/2653187182 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f863815e0c0 0x7f863815b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:46.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:46.847+0000 7f863f600640 1 --2- 172.21.15.138:0/2653187182 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f863815ce20 0x7f86380b4c00 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:46.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:46.847+0000 7f863f600640 1 --2- 172.21.15.138:0/2653187182 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f86380cca00 0x7f863814bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:46.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:46.847+0000 7f863f600640 1 -- 172.21.15.138:0/2653187182 >> 172.21.15.138:0/2653187182 conn(0x7f86380d0b20 msgr2=0x7f8638160040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:46.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:46.847+0000 7f863f600640 1 -- 172.21.15.138:0/2653187182 shutdown_connections 2024-04-26T20:58:46.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:46.847+0000 7f863f600640 1 -- 172.21.15.138:0/2653187182 wait complete. 2024-04-26T20:58:46.872 INFO:tasks.cephfs_test_runner:test_rebuild_simple (tasks.cephfs.test_recovery_pool.TestRecoveryPool) ... ok 2024-04-26T20:58:46.872 INFO:tasks.cephfs_test_runner: 2024-04-26T20:58:46.872 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-26T20:58:46.872 INFO:tasks.cephfs_test_runner:Ran 1 test in 82.646s 2024-04-26T20:58:46.873 INFO:tasks.cephfs_test_runner: 2024-04-26T20:58:46.873 INFO:tasks.cephfs_test_runner:OK 2024-04-26T20:58:46.873 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-04-26T20:58:46.883 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-26T20:58:46.924 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-26T20:58:46.925 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-26T20:58:46.925 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T20:58:46.934 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350256k,nr_inodes=4087564,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6206 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T20:58:46.935 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-26T20:58:46.935 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T20:58:46.991 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350256k,nr_inodes=4087564,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6206 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T20:58:46.992 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T20:58:46.992 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T20:58:47.001 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350292k,nr_inodes=4087573,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2870 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274988k,nr_inodes=818747,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T20:58:47.001 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T20:58:47.002 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T20:58:47.054 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350292k,nr_inodes=4087573,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2870 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274988k,nr_inodes=818747,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T20:58:47.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:58:47.054 DEBUG:teuthology.orchestra.run.smithi138:> ip netns list 2024-04-26T20:58:47.063 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T20:58:47.063 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-26T20:58:47.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:58:47.064 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T20:58:47.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:58:47.129 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T20:58:47.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:58:47.198 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link delete ceph-brx 2024-04-26T20:58:47.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:58:47.370 DEBUG:teuthology.orchestra.run.smithi138:> ip netns list 2024-04-26T20:58:47.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:58:47.379 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link delete ceph-brx 2024-04-26T20:58:47.444 INFO:teuthology.orchestra.run.smithi138.stderr:Cannot find device "ceph-brx" 2024-04-26T20:58:47.446 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:58:47.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:58:47.446 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list 2024-04-26T20:58:47.456 INFO:teuthology.orchestra.run.smithi143.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-26T20:58:47.456 INFO:teuthology.orchestra.run.smithi143.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-26T20:58:47.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:58:47.457 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T20:58:47.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:58:47.521 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T20:58:47.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:58:47.591 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link delete ceph-brx 2024-04-26T20:58:47.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:58:47.764 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list 2024-04-26T20:58:47.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:58:47.773 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link delete ceph-brx 2024-04-26T20:58:47.838 INFO:teuthology.orchestra.run.smithi143.stderr:Cannot find device "ceph-brx" 2024-04-26T20:58:47.840 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:58:47.841 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-26T20:58:47.850 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T20:58:47.850 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T20:58:47.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.983+0000 7f5218000640 1 Processor -- start 2024-04-26T20:58:47.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.983+0000 7f5218000640 1 -- start start 2024-04-26T20:58:47.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.983+0000 7f5218000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f521015f2b0 0x7f52101637d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:47.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.983+0000 7f5218000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f52100cee00 0x7f52100cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:47.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.983+0000 7f5218000640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5210163d10 con 0x7f52100ae8c0 2024-04-26T20:58:47.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.983+0000 7f5218000640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f521015f690 con 0x7f52100cee00 2024-04-26T20:58:47.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.983+0000 7f5218000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f52100cb610 con 0x7f521015f2b0 2024-04-26T20:58:47.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.983+0000 7f5216000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f52100cee00 0x7f52100cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:47.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.983+0000 7f5216000640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f52100cee00 0x7f52100cbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:47840/0 (socket says 172.21.15.138:47840) 2024-04-26T20:58:47.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.987+0000 7f5216000640 1 -- 172.21.15.138:0/445623261 learned_addr learned my addr 172.21.15.138:0/445623261 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:47.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.987+0000 7f5215600640 1 --2- 172.21.15.138:0/445623261 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f521015f2b0 0x7f52101637d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:47.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.987+0000 7f5216000640 1 -- 172.21.15.138:0/445623261 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f521015f2b0 msgr2=0x7f52101637d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:47.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.987+0000 7f5216000640 1 --2- 172.21.15.138:0/445623261 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f521015f2b0 0x7f52101637d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:47.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.987+0000 7f5216000640 1 -- 172.21.15.138:0/445623261 >> v1:172.21.15.143:6789/0 conn(0x7f52100ae8c0 legacy=0x7f52100ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:47.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.987+0000 7f5216000640 1 -- 172.21.15.138:0/445623261 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52100ccb60 con 0x7f52100cee00 2024-04-26T20:58:47.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.987+0000 7f5216000640 1 --2- 172.21.15.138:0/445623261 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52100cee00 0x7f52100cbaa0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f5208009870 tx=0x7f520801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c90b3171578c7c5f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:47.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.987+0000 7f520fe00640 1 -- 172.21.15.138:0/445623261 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52080b1070 con 0x7f52100cee00 2024-04-26T20:58:47.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.987+0000 7f520fe00640 1 -- 172.21.15.138:0/445623261 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52080ac620 con 0x7f52100cee00 2024-04-26T20:58:47.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.987+0000 7f520fe00640 1 -- 172.21.15.138:0/445623261 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52080ac9f0 con 0x7f52100cee00 2024-04-26T20:58:47.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.991+0000 7f5218000640 1 -- 172.21.15.138:0/445623261 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52100cee00 msgr2=0x7f52100cbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:47.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.991+0000 7f5218000640 1 --2- 172.21.15.138:0/445623261 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52100cee00 0x7f52100cbaa0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f5208009870 tx=0x7f520801c4d0 comp rx=0 tx=0).stop 2024-04-26T20:58:47.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.991+0000 7f5218000640 1 -- 172.21.15.138:0/445623261 shutdown_connections 2024-04-26T20:58:47.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.991+0000 7f5218000640 1 --2- 172.21.15.138:0/445623261 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52100cee00 0x7f52100cbaa0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:47.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.991+0000 7f5218000640 1 --2- 172.21.15.138:0/445623261 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f521015f2b0 0x7f52101637d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:47.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.991+0000 7f5218000640 1 -- 172.21.15.138:0/445623261 >> 172.21.15.138:0/445623261 conn(0x7f52100d0b20 msgr2=0x7f52100d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:47.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.991+0000 7f5218000640 1 -- 172.21.15.138:0/445623261 shutdown_connections 2024-04-26T20:58:47.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.991+0000 7f5218000640 1 -- 172.21.15.138:0/445623261 wait complete. 2024-04-26T20:58:47.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.991+0000 7f5218000640 1 Processor -- start 2024-04-26T20:58:47.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.991+0000 7f5218000640 1 -- start start 2024-04-26T20:58:47.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.991+0000 7f5218000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52100ae8c0 0x7f52100c70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:47.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.991+0000 7f5218000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52100cee00 0x7f5210152180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:47.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.991+0000 7f5218000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f521015f2b0 0x7f521015ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:47.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.991+0000 7f5218000640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f521006fd00 con 0x7f52100cee00 2024-04-26T20:58:47.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.991+0000 7f5218000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f521006fb80 con 0x7f52100ae8c0 2024-04-26T20:58:47.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.991+0000 7f5218000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f52100cc3f0 con 0x7f521015f2b0 2024-04-26T20:58:47.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.991+0000 7f5214c00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52100cee00 0x7f5210152180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:47.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.991+0000 7f5215600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52100ae8c0 0x7f52100c70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:47.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.991+0000 7f5214c00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52100cee00 0x7f5210152180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:47848/0 (socket says 172.21.15.138:47848) 2024-04-26T20:58:47.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.991+0000 7f5214c00640 1 -- 172.21.15.138:0/320948233 learned_addr learned my addr 172.21.15.138:0/320948233 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:47.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.991+0000 7f5216000640 1 --2- 172.21.15.138:0/320948233 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f521015f2b0 0x7f521015ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:47.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.991+0000 7f5214c00640 1 -- 172.21.15.138:0/320948233 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f521015f2b0 msgr2=0x7f521015ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:47.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.991+0000 7f5214c00640 1 --2- 172.21.15.138:0/320948233 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f521015f2b0 0x7f521015ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:47.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.991+0000 7f5214c00640 1 -- 172.21.15.138:0/320948233 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52100ae8c0 msgr2=0x7f52100c70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:47.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.991+0000 7f5214c00640 1 --2- 172.21.15.138:0/320948233 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52100ae8c0 0x7f52100c70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:47.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.991+0000 7f5214c00640 1 -- 172.21.15.138:0/320948233 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52101528f0 con 0x7f52100cee00 2024-04-26T20:58:47.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.991+0000 7f5214c00640 1 --2- 172.21.15.138:0/320948233 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52100cee00 0x7f5210152180 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f51fc00c3a0 tx=0x7f51fc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:47.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.991+0000 7f520d600640 1 -- 172.21.15.138:0/320948233 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51fc0052d0 con 0x7f52100cee00 2024-04-26T20:58:47.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.991+0000 7f520d600640 1 -- 172.21.15.138:0/320948233 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51fc005470 con 0x7f52100cee00 2024-04-26T20:58:47.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.991+0000 7f520d600640 1 -- 172.21.15.138:0/320948233 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51fc007260 con 0x7f52100cee00 2024-04-26T20:58:47.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.991+0000 7f5218000640 1 -- 172.21.15.138:0/320948233 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5210152bd0 con 0x7f52100cee00 2024-04-26T20:58:47.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.995+0000 7f5218000640 1 -- 172.21.15.138:0/320948233 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5210153190 con 0x7f52100cee00 2024-04-26T20:58:47.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.995+0000 7f5218000640 1 -- 172.21.15.138:0/320948233 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5210069510 con 0x7f52100cee00 2024-04-26T20:58:47.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.995+0000 7f520d600640 1 -- 172.21.15.138:0/320948233 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f51fc007400 con 0x7f52100cee00 2024-04-26T20:58:47.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.995+0000 7f520d600640 1 --2- 172.21.15.138:0/320948233 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f51f0068380 0x7f51f006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:47.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.995+0000 7f520d600640 1 -- 172.21.15.138:0/320948233 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5421+0+0 (secure 0 0 0) 0x7f51fc085cf0 con 0x7f52100cee00 2024-04-26T20:58:47.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.995+0000 7f5215600640 1 --2- 172.21.15.138:0/320948233 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f51f0068380 0x7f51f006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:47.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.999+0000 7f5215600640 1 --2- 172.21.15.138:0/320948233 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f51f0068380 0x7f51f006a840 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5204003b90 tx=0x7f52040098a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:48.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:47.999+0000 7f520d600640 1 -- 172.21.15.138:0/320948233 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f51fc055ce0 con 0x7f52100cee00 2024-04-26T20:58:48.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.151+0000 7f5218000640 1 -- 172.21.15.138:0/320948233 --> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f52100d16a0 con 0x7f51f0068380 2024-04-26T20:58:48.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.151+0000 7f520d600640 1 -- 172.21.15.138:0/320948233 <== mgr.4100 v2:172.21.15.143:6832/4275464198 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13501 (secure 0 0 0) 0x7f52100d16a0 con 0x7f51f0068380 2024-04-26T20:58:48.155 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:48.155 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-04-26T20:58:48.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.155+0000 7f5218000640 1 -- 172.21.15.138:0/320948233 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f51f0068380 msgr2=0x7f51f006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:48.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.155+0000 7f5218000640 1 --2- 172.21.15.138:0/320948233 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f51f0068380 0x7f51f006a840 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5204003b90 tx=0x7f52040098a0 comp rx=0 tx=0).stop 2024-04-26T20:58:48.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.155+0000 7f5218000640 1 -- 172.21.15.138:0/320948233 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52100cee00 msgr2=0x7f5210152180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:48.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.155+0000 7f5218000640 1 --2- 172.21.15.138:0/320948233 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52100cee00 0x7f5210152180 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f51fc00c3a0 tx=0x7f51fc00c860 comp rx=0 tx=0).stop 2024-04-26T20:58:48.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.155+0000 7f5218000640 1 -- 172.21.15.138:0/320948233 shutdown_connections 2024-04-26T20:58:48.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.155+0000 7f5218000640 1 --2- 172.21.15.138:0/320948233 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f51f0068380 0x7f51f006a840 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:48.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.155+0000 7f5218000640 1 --2- 172.21.15.138:0/320948233 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f521015f2b0 0x7f521015ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:48.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.155+0000 7f5218000640 1 --2- 172.21.15.138:0/320948233 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52100cee00 0x7f5210152180 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:48.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.155+0000 7f5218000640 1 --2- 172.21.15.138:0/320948233 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52100ae8c0 0x7f52100c70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:48.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.155+0000 7f5218000640 1 -- 172.21.15.138:0/320948233 >> 172.21.15.138:0/320948233 conn(0x7f52100d0b20 msgr2=0x7f52100b14a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:48.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.155+0000 7f5218000640 1 -- 172.21.15.138:0/320948233 shutdown_connections 2024-04-26T20:58:48.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.155+0000 7f5218000640 1 -- 172.21.15.138:0/320948233 wait complete. 2024-04-26T20:58:48.176 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":120,"stamp":"2024-04-26T20:58:47.271423+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":168,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":228616,"kb_used_data":8280,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754746104,"statfs":{"total":773094113280,"available":772860010496,"internally_reserved":0,"allocated":8478720,"data_stored":5636578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":225496627},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6322156,"num_objects":-15,"num_object_clones":0,"num_object_copies":-30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-15,"num_whiteouts":0,"num_read":-53,"num_read_kb":-39,"num_write":-50,"num_write_kb":-6193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001188"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":230,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-26T20:58:44.837375+0000","last_change":"2024-04-26T20:56:29.347462+0000","last_active":"2024-04-26T20:58:44.837375+0000","last_peered":"2024-04-26T20:58:44.837375+0000","last_clean":"2024-04-26T20:58:44.837375+0000","last_became_active":"2024-04-26T20:56:29.346224+0000","last_became_peered":"2024-04-26T20:56:29.346224+0000","last_unstale":"2024-04-26T20:58:44.837375+0000","last_undegraded":"2024-04-26T20:58:44.837375+0000","last_fullsized":"2024-04-26T20:58:44.837375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:28.079105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:28.079105+0000","last_clean_scrub_stamp":"2024-04-26T20:56:28.079105+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:13.693525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509472,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27660,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":651264,"data_stored":294207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509471,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27640,"kb_used_data":620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":634880,"data_stored":288091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509472,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28240,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343600,"statfs":{"total":96636764160,"available":96607846400,"internally_reserved":0,"allocated":1245184,"data_stored":884575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509472,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27656,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":651264,"data_stored":294207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509472,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27660,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":651264,"data_stored":294207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509471,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32400,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339440,"statfs":{"total":96636764160,"available":96603586560,"internally_reserved":0,"allocated":1245184,"data_stored":884575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509470,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29688,"kb_used_data":2668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342152,"statfs":{"total":96636764160,"available":96606363648,"internally_reserved":0,"allocated":2732032,"data_stored":2385243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":667648,"data_stored":311473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T20:58:48.177 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T20:58:48.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.311+0000 7fbb2b800640 1 Processor -- start 2024-04-26T20:58:48.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.311+0000 7fbb2b800640 1 -- start start 2024-04-26T20:58:48.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.311+0000 7fbb2b800640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fbb240b8890 0x7fbb2415e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:48.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.311+0000 7fbb2b800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbb2415f330 0x7fbb240d16d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:48.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.311+0000 7fbb2b800640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb2415f7c0 con 0x7fbb2415eea0 2024-04-26T20:58:48.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.311+0000 7fbb2b800640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fbb240cec40 con 0x7fbb240b8890 2024-04-26T20:58:48.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.311+0000 7fbb2b800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fbb240d00e0 con 0x7fbb2415f330 2024-04-26T20:58:48.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.311+0000 7fbb29800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbb2415f330 0x7fbb240d16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:48.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.311+0000 7fbb28e00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fbb240b8890 0x7fbb2415e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:48.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.311+0000 7fbb29800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbb2415f330 0x7fbb240d16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.138:57338/0 (socket says 172.21.15.138:57338) 2024-04-26T20:58:48.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.311+0000 7fbb28e00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fbb240b8890 0x7fbb2415e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.138:40970/0 (socket says 172.21.15.138:40970) 2024-04-26T20:58:48.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.311+0000 7fbb29800640 1 -- 172.21.15.138:0/1909529040 learned_addr learned my addr 172.21.15.138:0/1909529040 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:48.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.311+0000 7fbb23e00640 1 --1- 172.21.15.138:0/1909529040 >> v1:172.21.15.143:6789/0 conn(0x7fbb2415eea0 0x7fbb240d0fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.138:59928/0 (socket says 172.21.15.138:59928) 2024-04-26T20:58:48.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.311+0000 7fbb28e00640 1 -- 172.21.15.138:0/1909529040 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbb2415f330 msgr2=0x7fbb240d16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:48.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.311+0000 7fbb28e00640 1 --2- 172.21.15.138:0/1909529040 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbb2415f330 0x7fbb240d16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:48.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.311+0000 7fbb28e00640 1 -- 172.21.15.138:0/1909529040 >> v1:172.21.15.143:6789/0 conn(0x7fbb2415eea0 legacy=0x7fbb240d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:48.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.311+0000 7fbb28e00640 1 -- 172.21.15.138:0/1909529040 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb240cdd50 con 0x7fbb240b8890 2024-04-26T20:58:48.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.311+0000 7fbb23400640 1 -- 172.21.15.138:0/1909529040 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3372714452 0 0) 0x7fbb2415f7c0 con 0x7fbb2415eea0 2024-04-26T20:58:48.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.311+0000 7fbb29800640 1 --2- 172.21.15.138:0/1909529040 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbb2415f330 0x7fbb240d16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:58:48.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.315+0000 7fbb28e00640 1 --2- 172.21.15.138:0/1909529040 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb240b8890 0x7fbb2415e960 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fbb140097c0 tx=0x7fbb1401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62e892251a04db65 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:48.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.315+0000 7fbb23400640 1 -- 172.21.15.138:0/1909529040 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb140b2070 con 0x7fbb240b8890 2024-04-26T20:58:48.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.315+0000 7fbb23400640 1 -- 172.21.15.138:0/1909529040 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb140ad640 con 0x7fbb240b8890 2024-04-26T20:58:48.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.315+0000 7fbb23400640 1 -- 172.21.15.138:0/1909529040 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb140ada10 con 0x7fbb240b8890 2024-04-26T20:58:48.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.315+0000 7fbb2b800640 1 -- 172.21.15.138:0/1909529040 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb240b8890 msgr2=0x7fbb2415e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:48.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.315+0000 7fbb2b800640 1 --2- 172.21.15.138:0/1909529040 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb240b8890 0x7fbb2415e960 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fbb140097c0 tx=0x7fbb1401c4a0 comp rx=0 tx=0).stop 2024-04-26T20:58:48.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.315+0000 7fbb2b800640 1 -- 172.21.15.138:0/1909529040 shutdown_connections 2024-04-26T20:58:48.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.315+0000 7fbb2b800640 1 --2- 172.21.15.138:0/1909529040 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbb2415f330 0x7fbb240d16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:48.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.315+0000 7fbb2b800640 1 --2- 172.21.15.138:0/1909529040 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb240b8890 0x7fbb2415e960 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:48.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.315+0000 7fbb2b800640 1 -- 172.21.15.138:0/1909529040 >> 172.21.15.138:0/1909529040 conn(0x7fbb240d2cf0 msgr2=0x7fbb240d3100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:48.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.315+0000 7fbb2b800640 1 -- 172.21.15.138:0/1909529040 shutdown_connections 2024-04-26T20:58:48.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.315+0000 7fbb2b800640 1 -- 172.21.15.138:0/1909529040 wait complete. 2024-04-26T20:58:48.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.319+0000 7fbb2b800640 1 Processor -- start 2024-04-26T20:58:48.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.319+0000 7fbb2b800640 1 -- start start 2024-04-26T20:58:48.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.319+0000 7fbb2b800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbb240b8890 0x7fbb241603c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:48.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.319+0000 7fbb2b800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb2415eea0 0x7fbb2415fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:48.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.319+0000 7fbb2b800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbb2415f330 0x7fbb24153320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:48.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.319+0000 7fbb2b800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fbb240d3a40 con 0x7fbb240b8890 2024-04-26T20:58:48.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.319+0000 7fbb2b800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fbb240ce8d0 con 0x7fbb2415eea0 2024-04-26T20:58:48.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.319+0000 7fbb2b800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fbb241600f0 con 0x7fbb2415f330 2024-04-26T20:58:48.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.319+0000 7fbb28e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbb240b8890 0x7fbb241603c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:48.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.319+0000 7fbb28e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbb240b8890 0x7fbb241603c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:47856/0 (socket says 172.21.15.138:47856) 2024-04-26T20:58:48.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.319+0000 7fbb28e00640 1 -- 172.21.15.138:0/2573359611 learned_addr learned my addr 172.21.15.138:0/2573359611 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:48.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.319+0000 7fbb29800640 1 --2- 172.21.15.138:0/2573359611 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbb2415f330 0x7fbb24153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:48.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.319+0000 7fbb23e00640 1 --2- 172.21.15.138:0/2573359611 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb2415eea0 0x7fbb2415fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:48.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.319+0000 7fbb28e00640 1 -- 172.21.15.138:0/2573359611 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbb2415f330 msgr2=0x7fbb24153320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:48.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.319+0000 7fbb28e00640 1 --2- 172.21.15.138:0/2573359611 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbb2415f330 0x7fbb24153320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:48.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.319+0000 7fbb28e00640 1 -- 172.21.15.138:0/2573359611 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb2415eea0 msgr2=0x7fbb2415fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:48.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.319+0000 7fbb28e00640 1 --2- 172.21.15.138:0/2573359611 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb2415eea0 0x7fbb2415fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:48.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.319+0000 7fbb28e00640 1 -- 172.21.15.138:0/2573359611 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb24160a10 con 0x7fbb240b8890 2024-04-26T20:58:48.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.319+0000 7fbb29800640 1 --2- 172.21.15.138:0/2573359611 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbb2415f330 0x7fbb24153320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:58:48.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.319+0000 7fbb28e00640 1 --2- 172.21.15.138:0/2573359611 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbb240b8890 0x7fbb241603c0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fbb140b0040 tx=0x7fbb1401ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:48.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.319+0000 7fbb20c00640 1 -- 172.21.15.138:0/2573359611 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb140be070 con 0x7fbb240b8890 2024-04-26T20:58:48.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.319+0000 7fbb20c00640 1 -- 172.21.15.138:0/2573359611 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb140b3040 con 0x7fbb240b8890 2024-04-26T20:58:48.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.319+0000 7fbb2b800640 1 -- 172.21.15.138:0/2573359611 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb241623f0 con 0x7fbb240b8890 2024-04-26T20:58:48.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.319+0000 7fbb20c00640 1 -- 172.21.15.138:0/2573359611 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb140b2050 con 0x7fbb240b8890 2024-04-26T20:58:48.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.319+0000 7fbb2b800640 1 -- 172.21.15.138:0/2573359611 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb241620a0 con 0x7fbb240b8890 2024-04-26T20:58:48.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.323+0000 7fbb2b800640 1 -- 172.21.15.138:0/2573359611 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb24069510 con 0x7fbb240b8890 2024-04-26T20:58:48.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.323+0000 7fbb20c00640 1 -- 172.21.15.138:0/2573359611 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbb140c1070 con 0x7fbb240b8890 2024-04-26T20:58:48.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.323+0000 7fbb20c00640 1 --2- 172.21.15.138:0/2573359611 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fbb04068380 0x7fbb0406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:48.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.323+0000 7fbb20c00640 1 -- 172.21.15.138:0/2573359611 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5421+0+0 (secure 0 0 0) 0x7fbb141206a0 con 0x7fbb240b8890 2024-04-26T20:58:48.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.323+0000 7fbb23e00640 1 --2- 172.21.15.138:0/2573359611 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fbb04068380 0x7fbb0406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:48.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.323+0000 7fbb23e00640 1 --2- 172.21.15.138:0/2573359611 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fbb04068380 0x7fbb0406a840 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fbb240c9940 tx=0x7fbb10007b60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:48.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.327+0000 7fbb20c00640 1 -- 172.21.15.138:0/2573359611 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fbb14016090 con 0x7fbb240b8890 2024-04-26T20:58:48.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.483+0000 7fbb2b800640 1 -- 172.21.15.138:0/2573359611 --> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbb24075cf0 con 0x7fbb04068380 2024-04-26T20:58:48.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.483+0000 7fbb20c00640 1 -- 172.21.15.138:0/2573359611 <== mgr.4100 v2:172.21.15.143:6832/4275464198 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13501 (secure 0 0 0) 0x7fbb24075cf0 con 0x7fbb04068380 2024-04-26T20:58:48.486 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:48.487 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-04-26T20:58:48.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.487+0000 7fbb2b800640 1 -- 172.21.15.138:0/2573359611 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fbb04068380 msgr2=0x7fbb0406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:48.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.487+0000 7fbb2b800640 1 --2- 172.21.15.138:0/2573359611 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fbb04068380 0x7fbb0406a840 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fbb240c9940 tx=0x7fbb10007b60 comp rx=0 tx=0).stop 2024-04-26T20:58:48.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.487+0000 7fbb2b800640 1 -- 172.21.15.138:0/2573359611 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbb240b8890 msgr2=0x7fbb241603c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:48.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.487+0000 7fbb2b800640 1 --2- 172.21.15.138:0/2573359611 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbb240b8890 0x7fbb241603c0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fbb140b0040 tx=0x7fbb1401ace0 comp rx=0 tx=0).stop 2024-04-26T20:58:48.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.487+0000 7fbb2b800640 1 -- 172.21.15.138:0/2573359611 shutdown_connections 2024-04-26T20:58:48.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.487+0000 7fbb2b800640 1 --2- 172.21.15.138:0/2573359611 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fbb04068380 0x7fbb0406a840 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:48.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.487+0000 7fbb2b800640 1 --2- 172.21.15.138:0/2573359611 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbb2415f330 0x7fbb24153320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:48.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.487+0000 7fbb2b800640 1 --2- 172.21.15.138:0/2573359611 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb2415eea0 0x7fbb2415fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:48.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.487+0000 7fbb2b800640 1 --2- 172.21.15.138:0/2573359611 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbb240b8890 0x7fbb241603c0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:48.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.487+0000 7fbb2b800640 1 -- 172.21.15.138:0/2573359611 >> 172.21.15.138:0/2573359611 conn(0x7fbb240d2cf0 msgr2=0x7fbb24071170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:48.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.487+0000 7fbb2b800640 1 -- 172.21.15.138:0/2573359611 shutdown_connections 2024-04-26T20:58:48.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.487+0000 7fbb2b800640 1 -- 172.21.15.138:0/2573359611 wait complete. 2024-04-26T20:58:48.507 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":120,"stamp":"2024-04-26T20:58:47.271423+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":168,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":228616,"kb_used_data":8280,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754746104,"statfs":{"total":773094113280,"available":772860010496,"internally_reserved":0,"allocated":8478720,"data_stored":5636578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":225496627},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6322156,"num_objects":-15,"num_object_clones":0,"num_object_copies":-30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-15,"num_whiteouts":0,"num_read":-53,"num_read_kb":-39,"num_write":-50,"num_write_kb":-6193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001188"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":230,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-26T20:58:44.837375+0000","last_change":"2024-04-26T20:56:29.347462+0000","last_active":"2024-04-26T20:58:44.837375+0000","last_peered":"2024-04-26T20:58:44.837375+0000","last_clean":"2024-04-26T20:58:44.837375+0000","last_became_active":"2024-04-26T20:56:29.346224+0000","last_became_peered":"2024-04-26T20:56:29.346224+0000","last_unstale":"2024-04-26T20:58:44.837375+0000","last_undegraded":"2024-04-26T20:58:44.837375+0000","last_fullsized":"2024-04-26T20:58:44.837375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:28.079105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:28.079105+0000","last_clean_scrub_stamp":"2024-04-26T20:56:28.079105+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:13.693525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509472,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27660,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":651264,"data_stored":294207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509471,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27640,"kb_used_data":620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":634880,"data_stored":288091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509472,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28240,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343600,"statfs":{"total":96636764160,"available":96607846400,"internally_reserved":0,"allocated":1245184,"data_stored":884575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509472,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27656,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":651264,"data_stored":294207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509472,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27660,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":651264,"data_stored":294207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509471,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32400,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339440,"statfs":{"total":96636764160,"available":96603586560,"internally_reserved":0,"allocated":1245184,"data_stored":884575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509470,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29688,"kb_used_data":2668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342152,"statfs":{"total":96636764160,"available":96606363648,"internally_reserved":0,"allocated":2732032,"data_stored":2385243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":667648,"data_stored":311473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T20:58:48.508 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T20:58:48.508 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T20:58:48.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.643+0000 7fe2c2400640 1 Processor -- start 2024-04-26T20:58:48.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.643+0000 7fe2c2400640 1 -- start start 2024-04-26T20:58:48.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.643+0000 7fe2c2400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe2bc15f2b0 0x7fe2bc1637d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:48.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.643+0000 7fe2c2400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe2bc0ae8c0 0x7fe2bc0ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:48.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.643+0000 7fe2c2400640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2bc163d10 con 0x7fe2bc0cec30 2024-04-26T20:58:48.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.643+0000 7fe2c2400640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fe2bc15f690 con 0x7fe2bc15f2b0 2024-04-26T20:58:48.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.643+0000 7fe2c2400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fe2bc0cb610 con 0x7fe2bc0ae8c0 2024-04-26T20:58:48.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.643+0000 7fe2bb400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe2bc15f2b0 0x7fe2bc1637d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:48.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.643+0000 7fe2bb400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe2bc15f2b0 0x7fe2bc1637d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:47870/0 (socket says 172.21.15.138:47870) 2024-04-26T20:58:48.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.643+0000 7fe2bb400640 1 -- 172.21.15.138:0/1235600440 learned_addr learned my addr 172.21.15.138:0/1235600440 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:48.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.643+0000 7fe2baa00640 1 --2- 172.21.15.138:0/1235600440 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe2bc0ae8c0 0x7fe2bc0ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:48.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.643+0000 7fe2bb400640 1 -- 172.21.15.138:0/1235600440 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe2bc0ae8c0 msgr2=0x7fe2bc0ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:48.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.643+0000 7fe2bb400640 1 --2- 172.21.15.138:0/1235600440 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe2bc0ae8c0 0x7fe2bc0ce6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:48.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.643+0000 7fe2bb400640 1 -- 172.21.15.138:0/1235600440 >> v1:172.21.15.138:6789/0 conn(0x7fe2bc0cec30 legacy=0x7fe2bc0cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:48.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.643+0000 7fe2ba000640 1 -- 172.21.15.138:0/1235600440 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4044307412 0 0) 0x7fe2bc163d10 con 0x7fe2bc0cec30 2024-04-26T20:58:48.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.643+0000 7fe2bb400640 1 -- 172.21.15.138:0/1235600440 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2bc0ccb60 con 0x7fe2bc15f2b0 2024-04-26T20:58:48.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.647+0000 7fe2bb400640 1 --2- 172.21.15.138:0/1235600440 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2bc15f2b0 0x7fe2bc1637d0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac009e50 tx=0x7fe2ac01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1652e71ee06340c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:48.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.647+0000 7fe2ba000640 1 -- 172.21.15.138:0/1235600440 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac0a5660 con 0x7fe2bc15f2b0 2024-04-26T20:58:48.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.647+0000 7fe2ba000640 1 -- 172.21.15.138:0/1235600440 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2ac0a5800 con 0x7fe2bc15f2b0 2024-04-26T20:58:48.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.647+0000 7fe2ba000640 1 -- 172.21.15.138:0/1235600440 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac0a5bd0 con 0x7fe2bc15f2b0 2024-04-26T20:58:48.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.647+0000 7fe2c2400640 1 -- 172.21.15.138:0/1235600440 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2bc15f2b0 msgr2=0x7fe2bc1637d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:48.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.647+0000 7fe2c2400640 1 --2- 172.21.15.138:0/1235600440 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2bc15f2b0 0x7fe2bc1637d0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac009e50 tx=0x7fe2ac01c9a0 comp rx=0 tx=0).stop 2024-04-26T20:58:48.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.647+0000 7fe2c2400640 1 -- 172.21.15.138:0/1235600440 shutdown_connections 2024-04-26T20:58:48.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.647+0000 7fe2c2400640 1 --2- 172.21.15.138:0/1235600440 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe2bc0ae8c0 0x7fe2bc0ce6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:48.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.647+0000 7fe2c2400640 1 --2- 172.21.15.138:0/1235600440 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2bc15f2b0 0x7fe2bc1637d0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:48.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.647+0000 7fe2c2400640 1 -- 172.21.15.138:0/1235600440 >> 172.21.15.138:0/1235600440 conn(0x7fe2bc0d0b20 msgr2=0x7fe2bc0d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:48.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.647+0000 7fe2c2400640 1 -- 172.21.15.138:0/1235600440 shutdown_connections 2024-04-26T20:58:48.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.647+0000 7fe2c2400640 1 -- 172.21.15.138:0/1235600440 wait complete. 2024-04-26T20:58:48.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.651+0000 7fe2c2400640 1 Processor -- start 2024-04-26T20:58:48.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.651+0000 7fe2c2400640 1 -- start start 2024-04-26T20:58:48.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.651+0000 7fe2c2400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe2bc0ae8c0 0x7fe2bc1fcb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:48.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.651+0000 7fe2c2400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2bc0cec30 0x7fe2bc0ca0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:48.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.651+0000 7fe2c2400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe2bc15f2b0 0x7fe2bc15ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:48.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.651+0000 7fe2c2400640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe2bc06fb80 con 0x7fe2bc0cec30 2024-04-26T20:58:48.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.651+0000 7fe2c2400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fe2bc0cc5c0 con 0x7fe2bc0ae8c0 2024-04-26T20:58:48.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.651+0000 7fe2c2400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fe2bc06fd00 con 0x7fe2bc15f2b0 2024-04-26T20:58:48.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.651+0000 7fe2baa00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2bc0cec30 0x7fe2bc0ca0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:48.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.651+0000 7fe2baa00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2bc0cec30 0x7fe2bc0ca0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:47884/0 (socket says 172.21.15.138:47884) 2024-04-26T20:58:48.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.651+0000 7fe2baa00640 1 -- 172.21.15.138:0/1648102059 learned_addr learned my addr 172.21.15.138:0/1648102059 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:48.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.651+0000 7fe2bb400640 1 --2- 172.21.15.138:0/1648102059 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe2bc0ae8c0 0x7fe2bc1fcb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:48.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.651+0000 7fe2bbe00640 1 --2- 172.21.15.138:0/1648102059 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe2bc15f2b0 0x7fe2bc15ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:48.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.651+0000 7fe2baa00640 1 -- 172.21.15.138:0/1648102059 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe2bc15f2b0 msgr2=0x7fe2bc15ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:48.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.651+0000 7fe2baa00640 1 --2- 172.21.15.138:0/1648102059 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe2bc15f2b0 0x7fe2bc15ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:48.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.651+0000 7fe2baa00640 1 -- 172.21.15.138:0/1648102059 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe2bc0ae8c0 msgr2=0x7fe2bc1fcb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:48.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.651+0000 7fe2baa00640 1 --2- 172.21.15.138:0/1648102059 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe2bc0ae8c0 0x7fe2bc1fcb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:48.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.651+0000 7fe2baa00640 1 -- 172.21.15.138:0/1648102059 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2bc1fd070 con 0x7fe2bc0cec30 2024-04-26T20:58:48.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.651+0000 7fe2baa00640 1 --2- 172.21.15.138:0/1648102059 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2bc0cec30 0x7fe2bc0ca0a0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fe2a800e8a0 tx=0x7fe2a800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:48.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.651+0000 7fe2b3400640 1 -- 172.21.15.138:0/1648102059 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a8017070 con 0x7fe2bc0cec30 2024-04-26T20:58:48.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.651+0000 7fe2b3400640 1 -- 172.21.15.138:0/1648102059 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2a800c940 con 0x7fe2bc0cec30 2024-04-26T20:58:48.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.651+0000 7fe2c2400640 1 -- 172.21.15.138:0/1648102059 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2bc159240 con 0x7fe2bc0cec30 2024-04-26T20:58:48.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.651+0000 7fe2b3400640 1 -- 172.21.15.138:0/1648102059 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a800ccf0 con 0x7fe2bc0cec30 2024-04-26T20:58:48.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.651+0000 7fe2c2400640 1 -- 172.21.15.138:0/1648102059 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2bc159800 con 0x7fe2bc0cec30 2024-04-26T20:58:48.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.651+0000 7fe2c2400640 1 -- 172.21.15.138:0/1648102059 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2bc069510 con 0x7fe2bc0cec30 2024-04-26T20:58:48.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.655+0000 7fe2b3400640 1 -- 172.21.15.138:0/1648102059 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe2a801a070 con 0x7fe2bc0cec30 2024-04-26T20:58:48.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.655+0000 7fe2b3400640 1 --2- 172.21.15.138:0/1648102059 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe29c068380 0x7fe29c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:48.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.655+0000 7fe2b3400640 1 -- 172.21.15.138:0/1648102059 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5421+0+0 (secure 0 0 0) 0x7fe2a8086700 con 0x7fe2bc0cec30 2024-04-26T20:58:48.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.655+0000 7fe2bb400640 1 --2- 172.21.15.138:0/1648102059 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe29c068380 0x7fe29c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:48.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.655+0000 7fe2bb400640 1 --2- 172.21.15.138:0/1648102059 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe29c068380 0x7fe29c06a840 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac0ae000 tx=0x7fe2ac0a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:48.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.659+0000 7fe2b3400640 1 -- 172.21.15.138:0/1648102059 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe2bc1fd070 con 0x7fe2bc0cec30 2024-04-26T20:58:48.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.811+0000 7fe2c2400640 1 -- 172.21.15.138:0/1648102059 --> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe2bc0d16a0 con 0x7fe29c068380 2024-04-26T20:58:48.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.811+0000 7fe2b3400640 1 -- 172.21.15.138:0/1648102059 <== mgr.4100 v2:172.21.15.143:6832/4275464198 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13501 (secure 0 0 0) 0x7fe2bc0d16a0 con 0x7fe29c068380 2024-04-26T20:58:48.815 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:48.815 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-04-26T20:58:48.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.815+0000 7fe2c2400640 1 -- 172.21.15.138:0/1648102059 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe29c068380 msgr2=0x7fe29c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:48.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.815+0000 7fe2c2400640 1 --2- 172.21.15.138:0/1648102059 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe29c068380 0x7fe29c06a840 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac0ae000 tx=0x7fe2ac0a7070 comp rx=0 tx=0).stop 2024-04-26T20:58:48.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.815+0000 7fe2c2400640 1 -- 172.21.15.138:0/1648102059 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2bc0cec30 msgr2=0x7fe2bc0ca0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:48.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.815+0000 7fe2c2400640 1 --2- 172.21.15.138:0/1648102059 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2bc0cec30 0x7fe2bc0ca0a0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fe2a800e8a0 tx=0x7fe2a800eca0 comp rx=0 tx=0).stop 2024-04-26T20:58:48.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.815+0000 7fe2c2400640 1 -- 172.21.15.138:0/1648102059 shutdown_connections 2024-04-26T20:58:48.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.815+0000 7fe2c2400640 1 --2- 172.21.15.138:0/1648102059 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fe29c068380 0x7fe29c06a840 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:48.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.815+0000 7fe2c2400640 1 --2- 172.21.15.138:0/1648102059 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe2bc15f2b0 0x7fe2bc15ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:48.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.815+0000 7fe2c2400640 1 --2- 172.21.15.138:0/1648102059 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2bc0cec30 0x7fe2bc0ca0a0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:48.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.815+0000 7fe2c2400640 1 --2- 172.21.15.138:0/1648102059 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe2bc0ae8c0 0x7fe2bc1fcb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:48.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.815+0000 7fe2c2400640 1 -- 172.21.15.138:0/1648102059 >> 172.21.15.138:0/1648102059 conn(0x7fe2bc0d0b20 msgr2=0x7fe2bc0b0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:48.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.815+0000 7fe2c2400640 1 -- 172.21.15.138:0/1648102059 shutdown_connections 2024-04-26T20:58:48.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.815+0000 7fe2c2400640 1 -- 172.21.15.138:0/1648102059 wait complete. 2024-04-26T20:58:48.836 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":120,"stamp":"2024-04-26T20:58:47.271423+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":168,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":228616,"kb_used_data":8280,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754746104,"statfs":{"total":773094113280,"available":772860010496,"internally_reserved":0,"allocated":8478720,"data_stored":5636578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":225496627},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6322156,"num_objects":-15,"num_object_clones":0,"num_object_copies":-30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-15,"num_whiteouts":0,"num_read":-53,"num_read_kb":-39,"num_write":-50,"num_write_kb":-6193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001188"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":230,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-26T20:58:44.837375+0000","last_change":"2024-04-26T20:56:29.347462+0000","last_active":"2024-04-26T20:58:44.837375+0000","last_peered":"2024-04-26T20:58:44.837375+0000","last_clean":"2024-04-26T20:58:44.837375+0000","last_became_active":"2024-04-26T20:56:29.346224+0000","last_became_peered":"2024-04-26T20:56:29.346224+0000","last_unstale":"2024-04-26T20:58:44.837375+0000","last_undegraded":"2024-04-26T20:58:44.837375+0000","last_fullsized":"2024-04-26T20:58:44.837375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:28.079105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:28.079105+0000","last_clean_scrub_stamp":"2024-04-26T20:56:28.079105+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:13.693525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509472,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27660,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":651264,"data_stored":294207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509471,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27640,"kb_used_data":620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":634880,"data_stored":288091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509472,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28240,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343600,"statfs":{"total":96636764160,"available":96607846400,"internally_reserved":0,"allocated":1245184,"data_stored":884575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509472,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27656,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":651264,"data_stored":294207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509472,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27660,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":651264,"data_stored":294207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509471,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32400,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339440,"statfs":{"total":96636764160,"available":96603586560,"internally_reserved":0,"allocated":1245184,"data_stored":884575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509470,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29688,"kb_used_data":2668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342152,"statfs":{"total":96636764160,"available":96606363648,"internally_reserved":0,"allocated":2732032,"data_stored":2385243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":667648,"data_stored":311473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T20:58:48.836 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:58:48.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.971+0000 7f914ee00640 1 Processor -- start 2024-04-26T20:58:48.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.971+0000 7f914ee00640 1 -- start start 2024-04-26T20:58:48.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.971+0000 7f914ee00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f91480cbe00 0x7f914806de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:48.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.971+0000 7f914ee00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f91480cc1e0 0x7f9148073b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:48.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.971+0000 7f914ee00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91480727f0 con 0x7f91480ce6f0 2024-04-26T20:58:48.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.971+0000 7f914ee00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f9148073680 con 0x7f91480cbe00 2024-04-26T20:58:48.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.971+0000 7f914ee00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f9148072a70 con 0x7f91480cc1e0 2024-04-26T20:58:48.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.971+0000 7f9147e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f91480cbe00 0x7f914806de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:48.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.971+0000 7f9147e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f91480cbe00 0x7f914806de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:47900/0 (socket says 172.21.15.138:47900) 2024-04-26T20:58:48.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.971+0000 7f9147e00640 1 -- 172.21.15.138:0/2597167979 learned_addr learned my addr 172.21.15.138:0/2597167979 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:48.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.971+0000 7f913f400640 1 --2- 172.21.15.138:0/2597167979 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f91480cc1e0 0x7f9148073b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:48.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.971+0000 7f9147e00640 1 -- 172.21.15.138:0/2597167979 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f91480cc1e0 msgr2=0x7f9148073b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:48.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.971+0000 7f9147e00640 1 --2- 172.21.15.138:0/2597167979 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f91480cc1e0 0x7f9148073b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:48.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.971+0000 7f9147e00640 1 -- 172.21.15.138:0/2597167979 >> v1:172.21.15.143:6789/0 conn(0x7f91480ce6f0 legacy=0x7f91480ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:48.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.971+0000 7f9147e00640 1 -- 172.21.15.138:0/2597167979 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9148072d50 con 0x7f91480cbe00 2024-04-26T20:58:48.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.975+0000 7f9147e00640 1 --2- 172.21.15.138:0/2597167979 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f91480cbe00 0x7f914806de70 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f913800bb10 tx=0x7f913801ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1571253718c0804 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:48.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.975+0000 7f9147400640 1 -- 172.21.15.138:0/2597167979 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91380b4070 con 0x7f91480cbe00 2024-04-26T20:58:48.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.975+0000 7f9147400640 1 -- 172.21.15.138:0/2597167979 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91380a7a00 con 0x7f91480cbe00 2024-04-26T20:58:48.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.975+0000 7f9147400640 1 -- 172.21.15.138:0/2597167979 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91380a7dd0 con 0x7f91480cbe00 2024-04-26T20:58:48.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.975+0000 7f914ee00640 1 -- 172.21.15.138:0/2597167979 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f91480cbe00 msgr2=0x7f914806de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:48.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.975+0000 7f914ee00640 1 --2- 172.21.15.138:0/2597167979 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f91480cbe00 0x7f914806de70 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f913800bb10 tx=0x7f913801ec30 comp rx=0 tx=0).stop 2024-04-26T20:58:48.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.975+0000 7f914ee00640 1 -- 172.21.15.138:0/2597167979 shutdown_connections 2024-04-26T20:58:48.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.975+0000 7f914ee00640 1 --2- 172.21.15.138:0/2597167979 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f91480cc1e0 0x7f9148073b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:48.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.975+0000 7f914ee00640 1 --2- 172.21.15.138:0/2597167979 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f91480cbe00 0x7f914806de70 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:48.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.975+0000 7f914ee00640 1 -- 172.21.15.138:0/2597167979 >> 172.21.15.138:0/2597167979 conn(0x7f91480d0b20 msgr2=0x7f91480d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:48.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.975+0000 7f914ee00640 1 -- 172.21.15.138:0/2597167979 shutdown_connections 2024-04-26T20:58:48.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.975+0000 7f914ee00640 1 -- 172.21.15.138:0/2597167979 wait complete. 2024-04-26T20:58:48.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.979+0000 7f914ee00640 1 Processor -- start 2024-04-26T20:58:48.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.979+0000 7f914ee00640 1 -- start start 2024-04-26T20:58:48.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.979+0000 7f914ee00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f91480cbe00 0x7f914814b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:48.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.979+0000 7f914ee00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91480cc1e0 0x7f91480b1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:48.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.979+0000 7f914ee00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f91480ce6f0 0x7f91480c66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:48.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.979+0000 7f914ee00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f91480741d0 con 0x7f91480ce6f0 2024-04-26T20:58:48.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.979+0000 7f914ee00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f9148074050 con 0x7f91480cc1e0 2024-04-26T20:58:48.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.979+0000 7f914ee00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f91480d0780 con 0x7f91480cbe00 2024-04-26T20:58:48.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.979+0000 7f914ce00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f91480ce6f0 0x7f91480c66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:48.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.979+0000 7f9147e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f91480cbe00 0x7f914814b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:48.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.979+0000 7f914ce00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f91480ce6f0 0x7f91480c66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:47912/0 (socket says 172.21.15.138:47912) 2024-04-26T20:58:48.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.979+0000 7f914ce00640 1 -- 172.21.15.138:0/2791948491 learned_addr learned my addr 172.21.15.138:0/2791948491 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:48.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.979+0000 7f913f400640 1 --2- 172.21.15.138:0/2791948491 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91480cc1e0 0x7f91480b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:48.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.979+0000 7f914ce00640 1 -- 172.21.15.138:0/2791948491 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f91480cbe00 msgr2=0x7f914814b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:48.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.979+0000 7f914ce00640 1 --2- 172.21.15.138:0/2791948491 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f91480cbe00 0x7f914814b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:48.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.979+0000 7f914ce00640 1 -- 172.21.15.138:0/2791948491 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91480cc1e0 msgr2=0x7f91480b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:48.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.979+0000 7f914ce00640 1 --2- 172.21.15.138:0/2791948491 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91480cc1e0 0x7f91480b1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:48.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.979+0000 7f914ce00640 1 -- 172.21.15.138:0/2791948491 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91480b19a0 con 0x7f91480ce6f0 2024-04-26T20:58:48.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.979+0000 7f914ce00640 1 --2- 172.21.15.138:0/2791948491 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f91480ce6f0 0x7f91480c66e0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f914000c770 tx=0x7f914000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:48.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.979+0000 7f9144c00640 1 -- 172.21.15.138:0/2791948491 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9140003b80 con 0x7f91480ce6f0 2024-04-26T20:58:48.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.979+0000 7f9144c00640 1 -- 172.21.15.138:0/2791948491 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9140003d20 con 0x7f91480ce6f0 2024-04-26T20:58:48.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.979+0000 7f9144c00640 1 -- 172.21.15.138:0/2791948491 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f914000aa90 con 0x7f91480ce6f0 2024-04-26T20:58:48.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.979+0000 7f914ee00640 1 -- 172.21.15.138:0/2791948491 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91480c8160 con 0x7f91480ce6f0 2024-04-26T20:58:48.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.983+0000 7f914ee00640 1 -- 172.21.15.138:0/2791948491 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91480c8720 con 0x7f91480ce6f0 2024-04-26T20:58:48.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.983+0000 7f914ee00640 1 -- 172.21.15.138:0/2791948491 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91480694f0 con 0x7f91480ce6f0 2024-04-26T20:58:48.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.983+0000 7f9144c00640 1 -- 172.21.15.138:0/2791948491 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f914000ac30 con 0x7f91480ce6f0 2024-04-26T20:58:48.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.983+0000 7f9144c00640 1 --2- 172.21.15.138:0/2791948491 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9124068380 0x7f912406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:48.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.983+0000 7f9144c00640 1 -- 172.21.15.138:0/2791948491 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5421+0+0 (secure 0 0 0) 0x7f91400865a0 con 0x7f91480ce6f0 2024-04-26T20:58:48.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.983+0000 7f9147e00640 1 --2- 172.21.15.138:0/2791948491 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9124068380 0x7f912406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:48.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.983+0000 7f9147e00640 1 --2- 172.21.15.138:0/2791948491 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9124068380 0x7f912406a840 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f91380b1000 tx=0x7f91380a9070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:48.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:48.987+0000 7f9144c00640 1 -- 172.21.15.138:0/2791948491 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f91480727f0 con 0x7f91480ce6f0 2024-04-26T20:58:49.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:49.147+0000 7f914ee00640 1 -- 172.21.15.138:0/2791948491 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f91480c61c0 con 0x7f91480ce6f0 2024-04-26T20:58:49.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:49.147+0000 7f9144c00640 1 -- 172.21.15.138:0/2791948491 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) ==== 74+0+13485 (secure 0 0 0) 0x7f91400566c0 con 0x7f91480ce6f0 2024-04-26T20:58:49.148 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:49.148 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":55,"fsid":"c22b4730-12cc-4558-8535-b965384398c0","created":"2024-04-26T20:56:14.182475+0000","modified":"2024-04-26T20:58:44.831507+0000","last_up_change":"2024-04-26T20:56:26.013243+0000","last_in_change":"2024-04-26T20:56:16.714055+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:56:27.265834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3f9a2e34-3199-466f-a6cf-57927318121e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6801","nonce":3534772245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6803","nonce":3534772245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6807","nonce":3534772245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3534772245},{"type":"v1","addr":"172.21.15.138:6805","nonce":3534772245}]},"public_addr":"172.21.15.138:6801/3534772245","cluster_addr":"172.21.15.138:6803/3534772245","heartbeat_back_addr":"172.21.15.138:6807/3534772245","heartbeat_front_addr":"172.21.15.138:6805/3534772245","state":["exists","up"]},{"osd":1,"uuid":"e881fcf6-3248-4696-a2ef-95d206d77712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6817","nonce":1427635773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6819","nonce":1427635773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6823","nonce":1427635773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1427635773},{"type":"v1","addr":"172.21.15.138:6821","nonce":1427635773}]},"public_addr":"172.21.15.138:6817/1427635773","cluster_addr":"172.21.15.138:6819/1427635773","heartbeat_back_addr":"172.21.15.138:6823/1427635773","heartbeat_front_addr":"172.21.15.138:6821/1427635773","state":["exists","up"]},{"osd":2,"uuid":"f7d1db33-7672-4699-ae47-9f1e0a8e4222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6809","nonce":4273721573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6811","nonce":4273721573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6815","nonce":4273721573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":4273721573},{"type":"v1","addr":"172.21.15.138:6813","nonce":4273721573}]},"public_addr":"172.21.15.138:6809/4273721573","cluster_addr":"172.21.15.138:6811/4273721573","heartbeat_back_addr":"172.21.15.138:6815/4273721573","heartbeat_front_addr":"172.21.15.138:6813/4273721573","state":["exists","up"]},{"osd":3,"uuid":"2f4e0a9a-b8f6-4468-844a-a4501cd85054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6825","nonce":3098242154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6827","nonce":3098242154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6831","nonce":3098242154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3098242154},{"type":"v1","addr":"172.21.15.138:6829","nonce":3098242154}]},"public_addr":"172.21.15.138:6825/3098242154","cluster_addr":"172.21.15.138:6827/3098242154","heartbeat_back_addr":"172.21.15.138:6831/3098242154","heartbeat_front_addr":"172.21.15.138:6829/3098242154","state":["exists","up"]},{"osd":4,"uuid":"c85df99b-3624-410e-866b-86830af2cfe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6801","nonce":2942056312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6803","nonce":2942056312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6807","nonce":2942056312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2942056312},{"type":"v1","addr":"172.21.15.143:6805","nonce":2942056312}]},"public_addr":"172.21.15.143:6801/2942056312","cluster_addr":"172.21.15.143:6803/2942056312","heartbeat_back_addr":"172.21.15.143:6807/2942056312","heartbeat_front_addr":"172.21.15.143:6805/2942056312","state":["exists","up"]},{"osd":5,"uuid":"9af1efb5-c416-4808-b5ef-de0679ab9705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6809","nonce":1910222887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6811","nonce":1910222887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6815","nonce":1910222887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1910222887},{"type":"v1","addr":"172.21.15.143:6813","nonce":1910222887}]},"public_addr":"172.21.15.143:6809/1910222887","cluster_addr":"172.21.15.143:6811/1910222887","heartbeat_back_addr":"172.21.15.143:6815/1910222887","heartbeat_front_addr":"172.21.15.143:6813/1910222887","state":["exists","up"]},{"osd":6,"uuid":"d7138615-8838-45ff-9072-2fd0683362f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6817","nonce":1082239825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6819","nonce":1082239825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6823","nonce":1082239825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":1082239825},{"type":"v1","addr":"172.21.15.143:6821","nonce":1082239825}]},"public_addr":"172.21.15.143:6817/1082239825","cluster_addr":"172.21.15.143:6819/1082239825","heartbeat_back_addr":"172.21.15.143:6823/1082239825","heartbeat_front_addr":"172.21.15.143:6821/1082239825","state":["exists","up"]},{"osd":7,"uuid":"0c27172b-35c4-49ec-ba0b-0137b8ff0010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6825","nonce":3295508495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6827","nonce":3295508495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6831","nonce":3295508495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":3295508495},{"type":"v1","addr":"172.21.15.143:6829","nonce":3295508495}]},"public_addr":"172.21.15.143:6825/3295508495","cluster_addr":"172.21.15.143:6827/3295508495","heartbeat_back_addr":"172.21.15.143:6831/3295508495","heartbeat_front_addr":"172.21.15.143:6829/3295508495","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.326627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.396119+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.433915+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.414179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.216947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.329272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.503073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:56:22.436382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.138:6834/2450256246":"2024-04-27T20:58:41.611689+0000","172.21.15.138:6832/2450256246":"2024-04-27T20:58:41.611689+0000","172.21.15.143:6836/483370849":"2024-04-27T20:58:07.183664+0000","172.21.15.143:6834/483370849":"2024-04-27T20:58:07.183664+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:58:49.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:49.147+0000 7f914ee00640 1 -- 172.21.15.138:0/2791948491 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9124068380 msgr2=0x7f912406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:49.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:49.147+0000 7f914ee00640 1 --2- 172.21.15.138:0/2791948491 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9124068380 0x7f912406a840 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f91380b1000 tx=0x7f91380a9070 comp rx=0 tx=0).stop 2024-04-26T20:58:49.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:49.147+0000 7f914ee00640 1 -- 172.21.15.138:0/2791948491 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f91480ce6f0 msgr2=0x7f91480c66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:49.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:49.147+0000 7f914ee00640 1 --2- 172.21.15.138:0/2791948491 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f91480ce6f0 0x7f91480c66e0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f914000c770 tx=0x7f914000cc30 comp rx=0 tx=0).stop 2024-04-26T20:58:49.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:49.147+0000 7f914ee00640 1 -- 172.21.15.138:0/2791948491 shutdown_connections 2024-04-26T20:58:49.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:49.147+0000 7f914ee00640 1 --2- 172.21.15.138:0/2791948491 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f9124068380 0x7f912406a840 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:49.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:49.147+0000 7f914ee00640 1 --2- 172.21.15.138:0/2791948491 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f91480ce6f0 0x7f91480c66e0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:49.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:49.147+0000 7f914ee00640 1 --2- 172.21.15.138:0/2791948491 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91480cc1e0 0x7f91480b1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:49.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:49.147+0000 7f914ee00640 1 --2- 172.21.15.138:0/2791948491 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f91480cbe00 0x7f914814b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:49.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:49.147+0000 7f914ee00640 1 -- 172.21.15.138:0/2791948491 >> 172.21.15.138:0/2791948491 conn(0x7f91480d0b20 msgr2=0x7f91480b57f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:49.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:49.147+0000 7f914ee00640 1 -- 172.21.15.138:0/2791948491 shutdown_connections 2024-04-26T20:58:49.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:49.147+0000 7f914ee00640 1 -- 172.21.15.138:0/2791948491 wait complete. 2024-04-26T20:58:50.170 INFO:tasks.ceph:Scrubbing osd.0 2024-04-26T20:58:50.170 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-26T20:58:50.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.311+0000 7f28e0e00640 1 Processor -- start 2024-04-26T20:58:50.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.311+0000 7f28e0e00640 1 -- start start 2024-04-26T20:58:50.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.311+0000 7f28e0e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f28dc15cd70 0x7f28dc0cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:50.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.311+0000 7f28e0e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f28dc071ec0 0x7f28dc0cb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:50.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.311+0000 7f28e0e00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28dc0ccf20 con 0x7f28dc0cbc20 2024-04-26T20:58:50.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.311+0000 7f28e0e00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f28dc0cccd0 con 0x7f28dc071ec0 2024-04-26T20:58:50.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.311+0000 7f28e0e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f28dc0cd200 con 0x7f28dc15cd70 2024-04-26T20:58:50.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.311+0000 7f28da800640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f28dc0cbc20 0x7f28dc160a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:60036/0 (socket says 172.21.15.138:60036) 2024-04-26T20:58:50.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.311+0000 7f28d1400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f28dc071ec0 0x7f28dc0cb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:50.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.311+0000 7f28da800640 1 -- 172.21.15.138:0/2627977373 learned_addr learned my addr 172.21.15.138:0/2627977373 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:50.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.311+0000 7f28d9e00640 1 --2- 172.21.15.138:0/2627977373 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f28dc15cd70 0x7f28dc0cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:50.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.311+0000 7f28d9400640 1 -- 172.21.15.138:0/2627977373 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2113484679 0 0) 0x7f28dc0ccf20 con 0x7f28dc0cbc20 2024-04-26T20:58:50.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.311+0000 7f28d9400640 1 -- 172.21.15.138:0/2627977373 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28c0003530 con 0x7f28dc0cbc20 2024-04-26T20:58:50.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.311+0000 7f28d1400640 1 -- 172.21.15.138:0/2627977373 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f28dc15cd70 msgr2=0x7f28dc0cb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:50.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.315+0000 7f28d1400640 1 --2- 172.21.15.138:0/2627977373 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f28dc15cd70 0x7f28dc0cb1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:50.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.315+0000 7f28d1400640 1 -- 172.21.15.138:0/2627977373 >> v1:172.21.15.138:6789/0 conn(0x7f28dc0cbc20 legacy=0x7f28dc160a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:50.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.315+0000 7f28d1400640 1 -- 172.21.15.138:0/2627977373 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28dc073c90 con 0x7f28dc071ec0 2024-04-26T20:58:50.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.315+0000 7f28d1400640 1 --2- 172.21.15.138:0/2627977373 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f28dc071ec0 0x7f28dc0cb6e0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f28c40097c0 tx=0x7f28c401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72cd837859b2f8e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:50.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.315+0000 7f28d9400640 1 -- 172.21.15.138:0/2627977373 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c40b0070 con 0x7f28dc071ec0 2024-04-26T20:58:50.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.315+0000 7f28d9400640 1 -- 172.21.15.138:0/2627977373 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28c4004230 con 0x7f28dc071ec0 2024-04-26T20:58:50.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.315+0000 7f28d9400640 1 -- 172.21.15.138:0/2627977373 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c4003620 con 0x7f28dc071ec0 2024-04-26T20:58:50.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.315+0000 7f28e0e00640 1 -- 172.21.15.138:0/2627977373 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f28dc071ec0 msgr2=0x7f28dc0cb6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:50.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.315+0000 7f28e0e00640 1 --2- 172.21.15.138:0/2627977373 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f28dc071ec0 0x7f28dc0cb6e0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f28c40097c0 tx=0x7f28c401c410 comp rx=0 tx=0).stop 2024-04-26T20:58:50.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.315+0000 7f28e0e00640 1 -- 172.21.15.138:0/2627977373 shutdown_connections 2024-04-26T20:58:50.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.315+0000 7f28e0e00640 1 --2- 172.21.15.138:0/2627977373 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f28dc071ec0 0x7f28dc0cb6e0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:50.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.315+0000 7f28e0e00640 1 --2- 172.21.15.138:0/2627977373 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f28dc15cd70 0x7f28dc0cb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:50.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.315+0000 7f28e0e00640 1 -- 172.21.15.138:0/2627977373 >> 172.21.15.138:0/2627977373 conn(0x7f28dc0d0b50 msgr2=0x7f28dc0d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:50.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.315+0000 7f28e0e00640 1 -- 172.21.15.138:0/2627977373 shutdown_connections 2024-04-26T20:58:50.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.315+0000 7f28e0e00640 1 -- 172.21.15.138:0/2627977373 wait complete. 2024-04-26T20:58:50.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.319+0000 7f28e0e00640 1 Processor -- start 2024-04-26T20:58:50.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.319+0000 7f28e0e00640 1 -- start start 2024-04-26T20:58:50.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.319+0000 7f28e0e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f28dc071ec0 0x7f28dc0ac130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:50.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.319+0000 7f28e0e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f28dc0cbc20 0x7f28dc14ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:50.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.319+0000 7f28e0e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f28dc15cd70 0x7f28dc15f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:50.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.319+0000 7f28e0e00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f28dc0b39a0 con 0x7f28dc071ec0 2024-04-26T20:58:50.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.319+0000 7f28e0e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f28dc0cc030 con 0x7f28dc15cd70 2024-04-26T20:58:50.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.319+0000 7f28e0e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f28dc0b3b20 con 0x7f28dc0cbc20 2024-04-26T20:58:50.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.319+0000 7f28d9e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f28dc071ec0 0x7f28dc0ac130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:50.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.319+0000 7f28d9e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f28dc071ec0 0x7f28dc0ac130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:47918/0 (socket says 172.21.15.138:47918) 2024-04-26T20:58:50.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.319+0000 7f28d9e00640 1 -- 172.21.15.138:0/1010657328 learned_addr learned my addr 172.21.15.138:0/1010657328 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:50.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.319+0000 7f28da800640 1 --2- 172.21.15.138:0/1010657328 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f28dc15cd70 0x7f28dc15f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:50.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.319+0000 7f28d1400640 1 --2- 172.21.15.138:0/1010657328 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f28dc0cbc20 0x7f28dc14ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:50.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.319+0000 7f28d9e00640 1 -- 172.21.15.138:0/1010657328 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f28dc0cbc20 msgr2=0x7f28dc14ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:50.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.319+0000 7f28d9e00640 1 --2- 172.21.15.138:0/1010657328 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f28dc0cbc20 0x7f28dc14ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:50.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.319+0000 7f28d9e00640 1 -- 172.21.15.138:0/1010657328 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f28dc15cd70 msgr2=0x7f28dc15f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:50.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.319+0000 7f28d9e00640 1 --2- 172.21.15.138:0/1010657328 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f28dc15cd70 0x7f28dc15f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:50.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.319+0000 7f28d9e00640 1 -- 172.21.15.138:0/1010657328 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28dc15c190 con 0x7f28dc071ec0 2024-04-26T20:58:50.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.319+0000 7f28da800640 1 --2- 172.21.15.138:0/1010657328 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f28dc15cd70 0x7f28dc15f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:58:50.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.319+0000 7f28d9e00640 1 --2- 172.21.15.138:0/1010657328 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f28dc071ec0 0x7f28dc0ac130 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f28cc00efc0 tx=0x7f28cc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:50.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.319+0000 7f28d2a00640 1 -- 172.21.15.138:0/1010657328 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28cc018020 con 0x7f28dc071ec0 2024-04-26T20:58:50.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.319+0000 7f28d2a00640 1 -- 172.21.15.138:0/1010657328 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28cc014480 con 0x7f28dc071ec0 2024-04-26T20:58:50.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.319+0000 7f28d2a00640 1 -- 172.21.15.138:0/1010657328 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28cc014850 con 0x7f28dc071ec0 2024-04-26T20:58:50.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.319+0000 7f28e0e00640 1 -- 172.21.15.138:0/1010657328 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28dc0ab090 con 0x7f28dc071ec0 2024-04-26T20:58:50.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.319+0000 7f28e0e00640 1 -- 172.21.15.138:0/1010657328 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28dc0ab650 con 0x7f28dc071ec0 2024-04-26T20:58:50.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.323+0000 7f28e0e00640 1 -- 172.21.15.138:0/1010657328 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f28dc069510 con 0x7f28dc071ec0 2024-04-26T20:58:50.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.323+0000 7f28d2a00640 1 -- 172.21.15.138:0/1010657328 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f28cc01b020 con 0x7f28dc071ec0 2024-04-26T20:58:50.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.323+0000 7f28d2a00640 1 --2- 172.21.15.138:0/1010657328 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f28b8068380 0x7f28b806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:50.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.323+0000 7f28d2a00640 1 -- 172.21.15.138:0/1010657328 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5421+0+0 (secure 0 0 0) 0x7f28cc0876c0 con 0x7f28dc071ec0 2024-04-26T20:58:50.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.323+0000 7f28d1400640 1 --2- 172.21.15.138:0/1010657328 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f28b8068380 0x7f28b806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:50.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.323+0000 7f28d2a00640 1 --2- 172.21.15.138:0/1010657328 >> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] conn(0x7f28b806e8c0 0x7f28b8070d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:50.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.323+0000 7f28d2a00640 1 -- 172.21.15.138:0/1010657328 --> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f28cc0020c0 con 0x7f28b806e8c0 2024-04-26T20:58:50.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.323+0000 7f28d2a00640 1 -- 172.21.15.138:0/1010657328 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f28cc08e050 con 0x7f28dc071ec0 2024-04-26T20:58:50.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.323+0000 7f28da800640 1 --2- 172.21.15.138:0/1010657328 >> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] conn(0x7f28b806e8c0 0x7f28b8070d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:50.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.323+0000 7f28d1400640 1 --2- 172.21.15.138:0/1010657328 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f28b8068380 0x7f28b806a840 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f28c40ad000 tx=0x7f28c4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:50.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.323+0000 7f28da800640 1 --2- 172.21.15.138:0/1010657328 >> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] conn(0x7f28b806e8c0 0x7f28b8070d00 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:50.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.327+0000 7f28d2a00640 1 -- 172.21.15.138:0/1010657328 <== osd.0 v2:172.21.15.138:6800/3534772245 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f28cc0020c0 con 0x7f28b806e8c0 2024-04-26T20:58:50.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.339+0000 7f28e0e00640 1 -- 172.21.15.138:0/1010657328 --> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f28dc160f00 con 0x7f28b806e8c0 2024-04-26T20:58:50.341 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.339+0000 7f28d2a00640 1 -- 172.21.15.138:0/1010657328 <== osd.0 v2:172.21.15.138:6800/3534772245 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f28dc160f00 con 0x7f28b806e8c0 2024-04-26T20:58:50.341 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-26T20:58:50.341 INFO:teuthology.orchestra.run.smithi138.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T20:58:50.341 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-26T20:58:50.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.339+0000 7f28e0e00640 1 -- 172.21.15.138:0/1010657328 >> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] conn(0x7f28b806e8c0 msgr2=0x7f28b8070d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:50.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.339+0000 7f28e0e00640 1 --2- 172.21.15.138:0/1010657328 >> [v2:172.21.15.138:6800/3534772245,v1:172.21.15.138:6801/3534772245] conn(0x7f28b806e8c0 0x7f28b8070d00 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:50.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.339+0000 7f28e0e00640 1 -- 172.21.15.138:0/1010657328 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f28b8068380 msgr2=0x7f28b806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:50.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.339+0000 7f28e0e00640 1 --2- 172.21.15.138:0/1010657328 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f28b8068380 0x7f28b806a840 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f28c40ad000 tx=0x7f28c4008040 comp rx=0 tx=0).stop 2024-04-26T20:58:50.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.339+0000 7f28e0e00640 1 -- 172.21.15.138:0/1010657328 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f28dc071ec0 msgr2=0x7f28dc0ac130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:50.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.339+0000 7f28e0e00640 1 --2- 172.21.15.138:0/1010657328 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f28dc071ec0 0x7f28dc0ac130 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f28cc00efc0 tx=0x7f28cc00c490 comp rx=0 tx=0).stop 2024-04-26T20:58:50.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.339+0000 7f28da800640 1 -- 172.21.15.138:0/1010657328 reap_dead start 2024-04-26T20:58:50.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.339+0000 7f28e0e00640 1 -- 172.21.15.138:0/1010657328 shutdown_connections 2024-04-26T20:58:50.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.339+0000 7f28e0e00640 1 -- 172.21.15.138:0/1010657328 >> 172.21.15.138:0/1010657328 conn(0x7f28dc0d0b50 msgr2=0x7f28dc0cd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:50.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.339+0000 7f28e0e00640 1 -- 172.21.15.138:0/1010657328 shutdown_connections 2024-04-26T20:58:50.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.339+0000 7f28e0e00640 1 -- 172.21.15.138:0/1010657328 wait complete. 2024-04-26T20:58:50.360 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-26T20:58:50.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.495+0000 7f5e43200640 1 Processor -- start 2024-04-26T20:58:50.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.495+0000 7f5e43200640 1 -- start start 2024-04-26T20:58:50.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.495+0000 7f5e43200640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f5e3c070ab0 0x7f5e3c06c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:50.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.495+0000 7f5e43200640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e3c0708b0 con 0x7f5e3c06c300 2024-04-26T20:58:50.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.495+0000 7f5e43200640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e3c06cc20 con 0x7f5e3c0b4c90 2024-04-26T20:58:50.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.495+0000 7f5e43200640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f5e3c0ce310 con 0x7f5e3c070ab0 2024-04-26T20:58:50.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.495+0000 7f5e3be00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f5e3c06c300 0x7f5e3c0cc280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:60048/0 (socket says 172.21.15.138:60048) 2024-04-26T20:58:50.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.495+0000 7f5e3be00640 1 -- 172.21.15.138:0/72457755 learned_addr learned my addr 172.21.15.138:0/72457755 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:50.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.495+0000 7f5e33400640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f5e3c070ab0 0x7f5e3c06c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:50.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.495+0000 7f5e33400640 1 -- 172.21.15.138:0/72457755 >> v1:172.21.15.143:6789/0 conn(0x7f5e3c0b4c90 legacy=0x7f5e3c0b5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:50.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.495+0000 7f5e33400640 1 -- 172.21.15.138:0/72457755 >> v1:172.21.15.138:6789/0 conn(0x7f5e3c06c300 legacy=0x7f5e3c0cc280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:50.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.495+0000 7f5e33400640 1 -- 172.21.15.138:0/72457755 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e3c073aa0 con 0x7f5e3c070ab0 2024-04-26T20:58:50.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.495+0000 7f5e3b400640 1 -- 172.21.15.138:0/72457755 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 808075711 0 0) 0x7f5e2c001120 con 0x7f5e3c06c300 2024-04-26T20:58:50.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.499+0000 7f5e33400640 1 --2- 172.21.15.138:0/72457755 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e3c070ab0 0x7f5e3c06c6e0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f5e24009d90 tx=0x7f5e2401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f20b6a444eb18fb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:50.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.499+0000 7f5e3b400640 1 -- 172.21.15.138:0/72457755 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e240b2070 con 0x7f5e3c070ab0 2024-04-26T20:58:50.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.499+0000 7f5e3b400640 1 -- 172.21.15.138:0/72457755 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e240a5a00 con 0x7f5e3c070ab0 2024-04-26T20:58:50.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.499+0000 7f5e3b400640 1 -- 172.21.15.138:0/72457755 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e240a5dd0 con 0x7f5e3c070ab0 2024-04-26T20:58:50.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.499+0000 7f5e43200640 1 -- 172.21.15.138:0/72457755 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e3c070ab0 msgr2=0x7f5e3c06c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:50.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.499+0000 7f5e43200640 1 --2- 172.21.15.138:0/72457755 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e3c070ab0 0x7f5e3c06c6e0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f5e24009d90 tx=0x7f5e2401c940 comp rx=0 tx=0).stop 2024-04-26T20:58:50.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.499+0000 7f5e43200640 1 -- 172.21.15.138:0/72457755 shutdown_connections 2024-04-26T20:58:50.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.499+0000 7f5e43200640 1 --2- 172.21.15.138:0/72457755 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e3c070ab0 0x7f5e3c06c6e0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:50.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.499+0000 7f5e43200640 1 -- 172.21.15.138:0/72457755 >> 172.21.15.138:0/72457755 conn(0x7f5e3c0d1c30 msgr2=0x7f5e3c0d2040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:50.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.499+0000 7f5e43200640 1 -- 172.21.15.138:0/72457755 shutdown_connections 2024-04-26T20:58:50.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.499+0000 7f5e43200640 1 -- 172.21.15.138:0/72457755 wait complete. 2024-04-26T20:58:50.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.503+0000 7f5e43200640 1 Processor -- start 2024-04-26T20:58:50.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.503+0000 7f5e43200640 1 -- start start 2024-04-26T20:58:50.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.503+0000 7f5e43200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e3c06c300 0x7f5e3c0c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:50.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.503+0000 7f5e43200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5e3c070ab0 0x7f5e3c0c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:50.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.503+0000 7f5e43200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5e3c0b4c90 0x7f5e3c15f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:50.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.503+0000 7f5e43200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3c15d480 con 0x7f5e3c06c300 2024-04-26T20:58:50.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.503+0000 7f5e43200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3c15d300 con 0x7f5e3c070ab0 2024-04-26T20:58:50.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.503+0000 7f5e43200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f5e3c16aba0 con 0x7f5e3c0b4c90 2024-04-26T20:58:50.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.503+0000 7f5e3be00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e3c06c300 0x7f5e3c0c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:50.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.503+0000 7f5e3be00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e3c06c300 0x7f5e3c0c7df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:47938/0 (socket says 172.21.15.138:47938) 2024-04-26T20:58:50.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.503+0000 7f5e3be00640 1 -- 172.21.15.138:0/1672185071 learned_addr learned my addr 172.21.15.138:0/1672185071 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:50.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.503+0000 7f5e33400640 1 --2- 172.21.15.138:0/1672185071 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5e3c070ab0 0x7f5e3c0c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:50.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.503+0000 7f5e41200640 1 --2- 172.21.15.138:0/1672185071 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5e3c0b4c90 0x7f5e3c15f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:50.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.503+0000 7f5e3be00640 1 -- 172.21.15.138:0/1672185071 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5e3c0b4c90 msgr2=0x7f5e3c15f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:50.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.503+0000 7f5e3be00640 1 --2- 172.21.15.138:0/1672185071 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5e3c0b4c90 0x7f5e3c15f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:50.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.503+0000 7f5e3be00640 1 -- 172.21.15.138:0/1672185071 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5e3c070ab0 msgr2=0x7f5e3c0c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:50.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.503+0000 7f5e3be00640 1 --2- 172.21.15.138:0/1672185071 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5e3c070ab0 0x7f5e3c0c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:50.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.503+0000 7f5e3be00640 1 -- 172.21.15.138:0/1672185071 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e3c15e860 con 0x7f5e3c06c300 2024-04-26T20:58:50.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.503+0000 7f5e33400640 1 --2- 172.21.15.138:0/1672185071 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5e3c070ab0 0x7f5e3c0c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:58:50.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.503+0000 7f5e41200640 1 --2- 172.21.15.138:0/1672185071 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5e3c0b4c90 0x7f5e3c15f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:58:50.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.503+0000 7f5e3be00640 1 --2- 172.21.15.138:0/1672185071 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e3c06c300 0x7f5e3c0c7df0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c00c440 tx=0x7f5e2c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:50.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.503+0000 7f5e38c00640 1 -- 172.21.15.138:0/1672185071 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c018070 con 0x7f5e3c06c300 2024-04-26T20:58:50.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.503+0000 7f5e38c00640 1 -- 172.21.15.138:0/1672185071 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e2c0074e0 con 0x7f5e3c06c300 2024-04-26T20:58:50.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.503+0000 7f5e38c00640 1 -- 172.21.15.138:0/1672185071 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c004a10 con 0x7f5e3c06c300 2024-04-26T20:58:50.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.503+0000 7f5e43200640 1 -- 172.21.15.138:0/1672185071 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e3c15eb40 con 0x7f5e3c06c300 2024-04-26T20:58:50.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.503+0000 7f5e43200640 1 -- 172.21.15.138:0/1672185071 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e3c15f100 con 0x7f5e3c06c300 2024-04-26T20:58:50.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.503+0000 7f5e43200640 1 -- 172.21.15.138:0/1672185071 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e3c069510 con 0x7f5e3c06c300 2024-04-26T20:58:50.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.507+0000 7f5e38c00640 1 -- 172.21.15.138:0/1672185071 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5e2c01b070 con 0x7f5e3c06c300 2024-04-26T20:58:50.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.507+0000 7f5e38c00640 1 --2- 172.21.15.138:0/1672185071 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5e18068380 0x7f5e1806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:50.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.507+0000 7f5e38c00640 1 -- 172.21.15.138:0/1672185071 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5421+0+0 (secure 0 0 0) 0x7f5e2c085bd0 con 0x7f5e3c06c300 2024-04-26T20:58:50.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.507+0000 7f5e33400640 1 --2- 172.21.15.138:0/1672185071 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5e18068380 0x7f5e1806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:50.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.507+0000 7f5e33400640 1 --2- 172.21.15.138:0/1672185071 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5e18068380 0x7f5e1806a840 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5e240af000 tx=0x7f5e240a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:50.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.511+0000 7f5e38c00640 1 -- 172.21.15.138:0/1672185071 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5e3c0708b0 con 0x7f5e3c06c300 2024-04-26T20:58:50.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.667+0000 7f5e43200640 1 -- 172.21.15.138:0/1672185071 --> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f5e3c0d1070 con 0x7f5e18068380 2024-04-26T20:58:50.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.667+0000 7f5e38c00640 1 -- 172.21.15.138:0/1672185071 <== mgr.4100 v2:172.21.15.143:6832/4275464198 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5e3c0d1070 con 0x7f5e18068380 2024-04-26T20:58:50.669 INFO:teuthology.orchestra.run.smithi138.stderr:instructed osd(s) 0 to deep-scrub 2024-04-26T20:58:50.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.671+0000 7f5e43200640 1 -- 172.21.15.138:0/1672185071 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5e18068380 msgr2=0x7f5e1806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:50.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.671+0000 7f5e43200640 1 --2- 172.21.15.138:0/1672185071 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5e18068380 0x7f5e1806a840 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5e240af000 tx=0x7f5e240a7070 comp rx=0 tx=0).stop 2024-04-26T20:58:50.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.671+0000 7f5e43200640 1 -- 172.21.15.138:0/1672185071 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e3c06c300 msgr2=0x7f5e3c0c7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:50.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.671+0000 7f5e43200640 1 --2- 172.21.15.138:0/1672185071 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e3c06c300 0x7f5e3c0c7df0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c00c440 tx=0x7f5e2c00c900 comp rx=0 tx=0).stop 2024-04-26T20:58:50.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.671+0000 7f5e43200640 1 -- 172.21.15.138:0/1672185071 shutdown_connections 2024-04-26T20:58:50.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.671+0000 7f5e43200640 1 --2- 172.21.15.138:0/1672185071 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f5e18068380 0x7f5e1806a840 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:50.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.671+0000 7f5e43200640 1 --2- 172.21.15.138:0/1672185071 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5e3c0b4c90 0x7f5e3c15f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:50.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.671+0000 7f5e43200640 1 --2- 172.21.15.138:0/1672185071 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5e3c070ab0 0x7f5e3c0c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:50.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.671+0000 7f5e43200640 1 --2- 172.21.15.138:0/1672185071 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e3c06c300 0x7f5e3c0c7df0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:50.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.671+0000 7f5e43200640 1 -- 172.21.15.138:0/1672185071 >> 172.21.15.138:0/1672185071 conn(0x7f5e3c0d1c30 msgr2=0x7f5e3c06f990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:50.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.671+0000 7f5e43200640 1 -- 172.21.15.138:0/1672185071 shutdown_connections 2024-04-26T20:58:50.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.671+0000 7f5e43200640 1 -- 172.21.15.138:0/1672185071 wait complete. 2024-04-26T20:58:50.691 INFO:tasks.ceph:Scrubbing osd.1 2024-04-26T20:58:50.691 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-26T20:58:50.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.827+0000 7f8ad9c00640 1 Processor -- start 2024-04-26T20:58:50.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.827+0000 7f8ad9c00640 1 -- start start 2024-04-26T20:58:50.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.831+0000 7f8ad9c00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f8ad415cd70 0x7f8ad40cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:50.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.831+0000 7f8ad9c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ad4071ec0 0x7f8ad40cb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:50.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.831+0000 7f8ad9c00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8ad40cbc20 0x7f8ad4160a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:50.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.831+0000 7f8ad9c00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f8ad40cccd0 con 0x7f8ad415cd70 2024-04-26T20:58:50.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.831+0000 7f8ad9c00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f8ad40ccf20 con 0x7f8ad40cbc20 2024-04-26T20:58:50.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.831+0000 7f8ad9c00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f8ad40cd200 con 0x7f8ad4071ec0 2024-04-26T20:58:50.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.831+0000 7f8ad2a00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f8ad415cd70 0x7f8ad40cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:50.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.831+0000 7f8ad2a00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f8ad415cd70 0x7f8ad40cb1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:47948/0 (socket says 172.21.15.138:47948) 2024-04-26T20:58:50.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.831+0000 7f8ad2a00640 1 -- 172.21.15.138:0/4251416943 learned_addr learned my addr 172.21.15.138:0/4251416943 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:50.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.831+0000 7f8ad3400640 1 --2- 172.21.15.138:0/4251416943 >> v2:172.21.15.143:3300/0 conn(0x7f8ad40cbc20 0x7f8ad4160a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:50.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.831+0000 7f8aca000640 1 --2- 172.21.15.138:0/4251416943 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ad4071ec0 0x7f8ad40cb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:50.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.831+0000 7f8ad2a00640 1 -- 172.21.15.138:0/4251416943 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ad4071ec0 msgr2=0x7f8ad40cb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:50.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.831+0000 7f8ad2a00640 1 --2- 172.21.15.138:0/4251416943 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ad4071ec0 0x7f8ad40cb6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:50.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.831+0000 7f8ad2a00640 1 -- 172.21.15.138:0/4251416943 >> v2:172.21.15.143:3300/0 conn(0x7f8ad40cbc20 msgr2=0x7f8ad4160a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:50.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.831+0000 7f8ad2a00640 1 --2- 172.21.15.138:0/4251416943 >> v2:172.21.15.143:3300/0 conn(0x7f8ad40cbc20 0x7f8ad4160a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:50.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.831+0000 7f8ad2a00640 1 -- 172.21.15.138:0/4251416943 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ad4073c90 con 0x7f8ad415cd70 2024-04-26T20:58:50.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.831+0000 7f8ad3400640 1 --2- 172.21.15.138:0/4251416943 >> v2:172.21.15.143:3300/0 conn(0x7f8ad40cbc20 0x7f8ad4160a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:58:50.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.835+0000 7f8ad2a00640 1 --2- 172.21.15.138:0/4251416943 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ad415cd70 0x7f8ad40cb1a0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f8ad40b6ca0 tx=0x7f8ac401c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8560af8f07ff4f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:50.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.835+0000 7f8ad2000640 1 -- 172.21.15.138:0/4251416943 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac40ac020 con 0x7f8ad415cd70 2024-04-26T20:58:50.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.835+0000 7f8ad2000640 1 -- 172.21.15.138:0/4251416943 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ac40a6440 con 0x7f8ad415cd70 2024-04-26T20:58:50.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.835+0000 7f8ad2000640 1 -- 172.21.15.138:0/4251416943 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac40a6810 con 0x7f8ad415cd70 2024-04-26T20:58:50.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.835+0000 7f8ad9c00640 1 -- 172.21.15.138:0/4251416943 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ad415cd70 msgr2=0x7f8ad40cb1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:50.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.835+0000 7f8ad9c00640 1 --2- 172.21.15.138:0/4251416943 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ad415cd70 0x7f8ad40cb1a0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f8ad40b6ca0 tx=0x7f8ac401c6a0 comp rx=0 tx=0).stop 2024-04-26T20:58:50.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.835+0000 7f8ad9c00640 1 -- 172.21.15.138:0/4251416943 shutdown_connections 2024-04-26T20:58:50.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.835+0000 7f8ad9c00640 1 --2- 172.21.15.138:0/4251416943 >> v2:172.21.15.143:3300/0 conn(0x7f8ad40cbc20 0x7f8ad4160a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:50.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.835+0000 7f8ad9c00640 1 --2- 172.21.15.138:0/4251416943 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ad4071ec0 0x7f8ad40cb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:50.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.835+0000 7f8ad9c00640 1 --2- 172.21.15.138:0/4251416943 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ad415cd70 0x7f8ad40cb1a0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:50.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.835+0000 7f8ad9c00640 1 -- 172.21.15.138:0/4251416943 >> 172.21.15.138:0/4251416943 conn(0x7f8ad40d0b50 msgr2=0x7f8ad40d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:50.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.835+0000 7f8ad9c00640 1 -- 172.21.15.138:0/4251416943 shutdown_connections 2024-04-26T20:58:50.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.835+0000 7f8ad9c00640 1 -- 172.21.15.138:0/4251416943 wait complete. 2024-04-26T20:58:50.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.835+0000 7f8ad9c00640 1 Processor -- start 2024-04-26T20:58:50.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.835+0000 7f8ad9c00640 1 -- start start 2024-04-26T20:58:50.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.835+0000 7f8ad9c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ad4071ec0 0x7f8ad41525b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:50.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.835+0000 7f8ad9c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ad40cbc20 0x7f8ad415b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:50.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.835+0000 7f8ad9c00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ad415cd70 0x7f8ad4153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:50.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.835+0000 7f8ad9c00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad40b3b20 con 0x7f8ad415cd70 2024-04-26T20:58:50.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.835+0000 7f8ad9c00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad40b39a0 con 0x7f8ad4071ec0 2024-04-26T20:58:50.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.835+0000 7f8ad9c00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f8ad406e940 con 0x7f8ad40cbc20 2024-04-26T20:58:50.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.839+0000 7f8ad3400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ad415cd70 0x7f8ad4153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:50.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.839+0000 7f8ad3400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ad415cd70 0x7f8ad4153a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:47958/0 (socket says 172.21.15.138:47958) 2024-04-26T20:58:50.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.839+0000 7f8ad3400640 1 -- 172.21.15.138:0/3723999172 learned_addr learned my addr 172.21.15.138:0/3723999172 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:50.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.839+0000 7f8aca000640 1 --2- 172.21.15.138:0/3723999172 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ad40cbc20 0x7f8ad415b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:50.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.839+0000 7f8ad2a00640 1 --2- 172.21.15.138:0/3723999172 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ad4071ec0 0x7f8ad41525b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:50.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.839+0000 7f8ad3400640 1 -- 172.21.15.138:0/3723999172 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ad40cbc20 msgr2=0x7f8ad415b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:50.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.839+0000 7f8ad3400640 1 --2- 172.21.15.138:0/3723999172 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ad40cbc20 0x7f8ad415b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:50.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.839+0000 7f8ad3400640 1 -- 172.21.15.138:0/3723999172 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ad4071ec0 msgr2=0x7f8ad41525b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:50.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.839+0000 7f8ad3400640 1 --2- 172.21.15.138:0/3723999172 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ad4071ec0 0x7f8ad41525b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:50.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.839+0000 7f8ad3400640 1 -- 172.21.15.138:0/3723999172 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ad415bbb0 con 0x7f8ad415cd70 2024-04-26T20:58:50.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.839+0000 7f8ad2a00640 1 --2- 172.21.15.138:0/3723999172 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ad4071ec0 0x7f8ad41525b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:58:50.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.839+0000 7f8aca000640 1 --2- 172.21.15.138:0/3723999172 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ad40cbc20 0x7f8ad415b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:58:50.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.839+0000 7f8ad3400640 1 --2- 172.21.15.138:0/3723999172 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ad415cd70 0x7f8ad4153a70 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f8acc00e810 tx=0x7f8acc00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:50.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.839+0000 7f8acb400640 1 -- 172.21.15.138:0/3723999172 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8acc017070 con 0x7f8ad415cd70 2024-04-26T20:58:50.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.839+0000 7f8acb400640 1 -- 172.21.15.138:0/3723999172 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8acc00c8d0 con 0x7f8ad415cd70 2024-04-26T20:58:50.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.839+0000 7f8ad9c00640 1 -- 172.21.15.138:0/3723999172 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ad4152f90 con 0x7f8ad415cd70 2024-04-26T20:58:50.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.839+0000 7f8acb400640 1 -- 172.21.15.138:0/3723999172 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8acc00f040 con 0x7f8ad415cd70 2024-04-26T20:58:50.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.839+0000 7f8ad9c00640 1 -- 172.21.15.138:0/3723999172 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ad4153550 con 0x7f8ad415cd70 2024-04-26T20:58:50.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.839+0000 7f8ad9c00640 1 -- 172.21.15.138:0/3723999172 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8ad4069510 con 0x7f8ad415cd70 2024-04-26T20:58:50.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.839+0000 7f8acb400640 1 -- 172.21.15.138:0/3723999172 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8acc01a070 con 0x7f8ad415cd70 2024-04-26T20:58:50.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.839+0000 7f8acb400640 1 --2- 172.21.15.138:0/3723999172 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f8ab0068380 0x7f8ab006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:50.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.839+0000 7f8acb400640 1 -- 172.21.15.138:0/3723999172 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5421+0+0 (secure 0 0 0) 0x7f8acc0865b0 con 0x7f8ad415cd70 2024-04-26T20:58:50.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.843+0000 7f8acb400640 1 --2- 172.21.15.138:0/3723999172 >> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] conn(0x7f8ab006e8c0 0x7f8ab0070d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:50.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.843+0000 7f8acb400640 1 -- 172.21.15.138:0/3723999172 --> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8ab00713d0 con 0x7f8ab006e8c0 2024-04-26T20:58:50.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.843+0000 7f8acb400640 1 -- 172.21.15.138:0/3723999172 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f8acc08d050 con 0x7f8ad415cd70 2024-04-26T20:58:50.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.843+0000 7f8ad2a00640 1 --2- 172.21.15.138:0/3723999172 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f8ab0068380 0x7f8ab006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:50.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.843+0000 7f8aca000640 1 --2- 172.21.15.138:0/3723999172 >> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] conn(0x7f8ab006e8c0 0x7f8ab0070d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:50.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.843+0000 7f8aca000640 1 --2- 172.21.15.138:0/3723999172 >> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] conn(0x7f8ab006e8c0 0x7f8ab0070d00 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:50.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.843+0000 7f8ad2a00640 1 --2- 172.21.15.138:0/3723999172 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f8ab0068380 0x7f8ab006a840 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8ac40ad000 tx=0x7f8ac40b3040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:50.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.843+0000 7f8acb400640 1 -- 172.21.15.138:0/3723999172 <== osd.1 v2:172.21.15.138:6816/1427635773 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8ab00713d0 con 0x7f8ab006e8c0 2024-04-26T20:58:50.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.855+0000 7f8ad9c00640 1 -- 172.21.15.138:0/3723999172 --> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8ad4167bb0 con 0x7f8ab006e8c0 2024-04-26T20:58:50.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.855+0000 7f8acb400640 1 -- 172.21.15.138:0/3723999172 <== osd.1 v2:172.21.15.138:6816/1427635773 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f8ad4167bb0 con 0x7f8ab006e8c0 2024-04-26T20:58:50.858 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-26T20:58:50.858 INFO:teuthology.orchestra.run.smithi138.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T20:58:50.858 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-26T20:58:50.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.855+0000 7f8ad9c00640 1 -- 172.21.15.138:0/3723999172 >> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] conn(0x7f8ab006e8c0 msgr2=0x7f8ab0070d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:50.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.855+0000 7f8ad9c00640 1 --2- 172.21.15.138:0/3723999172 >> [v2:172.21.15.138:6816/1427635773,v1:172.21.15.138:6817/1427635773] conn(0x7f8ab006e8c0 0x7f8ab0070d00 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:50.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.855+0000 7f8ad9c00640 1 -- 172.21.15.138:0/3723999172 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f8ab0068380 msgr2=0x7f8ab006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:50.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.855+0000 7f8ad9c00640 1 --2- 172.21.15.138:0/3723999172 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f8ab0068380 0x7f8ab006a840 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8ac40ad000 tx=0x7f8ac40b3040 comp rx=0 tx=0).stop 2024-04-26T20:58:50.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.855+0000 7f8ad9c00640 1 -- 172.21.15.138:0/3723999172 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ad415cd70 msgr2=0x7f8ad4153a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:50.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.855+0000 7f8ad9c00640 1 --2- 172.21.15.138:0/3723999172 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ad415cd70 0x7f8ad4153a70 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f8acc00e810 tx=0x7f8acc00ecd0 comp rx=0 tx=0).stop 2024-04-26T20:58:50.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.855+0000 7f8ad3400640 1 -- 172.21.15.138:0/3723999172 reap_dead start 2024-04-26T20:58:50.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.855+0000 7f8ad9c00640 1 -- 172.21.15.138:0/3723999172 shutdown_connections 2024-04-26T20:58:50.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.855+0000 7f8ad9c00640 1 -- 172.21.15.138:0/3723999172 >> 172.21.15.138:0/3723999172 conn(0x7f8ad40d0b50 msgr2=0x7f8ad406ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:50.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.855+0000 7f8ad9c00640 1 -- 172.21.15.138:0/3723999172 shutdown_connections 2024-04-26T20:58:50.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:50.855+0000 7f8ad9c00640 1 -- 172.21.15.138:0/3723999172 wait complete. 2024-04-26T20:58:50.878 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-26T20:58:51.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.011+0000 7f1892800640 1 Processor -- start 2024-04-26T20:58:51.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.011+0000 7f1892800640 1 -- start start 2024-04-26T20:58:51.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.015+0000 7f1892800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f188c0cc390 0x7f188c06df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:51.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.015+0000 7f1892800640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f188c0cba30 con 0x7f188c073d20 2024-04-26T20:58:51.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.015+0000 7f1892800640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f188c06f6b0 con 0x7f188c15c0b0 2024-04-26T20:58:51.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.015+0000 7f1892800640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f188c073890 con 0x7f188c0cc390 2024-04-26T20:58:51.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.015+0000 7f1890a00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f188c0cc390 0x7f188c06df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:51.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.015+0000 7f1891e00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f188c073d20 0x7f188c0ce640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:60050/0 (socket says 172.21.15.138:60050) 2024-04-26T20:58:51.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.015+0000 7f1891e00640 1 -- 172.21.15.138:0/3615693024 learned_addr learned my addr 172.21.15.138:0/3615693024 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:51.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.015+0000 7f1890a00640 1 -- 172.21.15.138:0/3615693024 >> v1:172.21.15.143:6789/0 conn(0x7f188c15c0b0 legacy=0x7f188c0cbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:51.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.015+0000 7f1890a00640 1 -- 172.21.15.138:0/3615693024 >> v1:172.21.15.138:6789/0 conn(0x7f188c073d20 legacy=0x7f188c0ce640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:51.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.015+0000 7f1890a00640 1 -- 172.21.15.138:0/3615693024 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f188c06f990 con 0x7f188c0cc390 2024-04-26T20:58:51.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.015+0000 7f188be00640 1 -- 172.21.15.138:0/3615693024 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2834518458 0 0) 0x7f1884001120 con 0x7f188c073d20 2024-04-26T20:58:51.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.019+0000 7f1890a00640 1 --2- 172.21.15.138:0/3615693024 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f188c0cc390 0x7f188c06df20 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f18780097c0 tx=0x7f187801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dded7160a7abe3d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:51.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.019+0000 7f188be00640 1 -- 172.21.15.138:0/3615693024 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18780b0070 con 0x7f188c0cc390 2024-04-26T20:58:51.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.019+0000 7f188be00640 1 -- 172.21.15.138:0/3615693024 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18780ab600 con 0x7f188c0cc390 2024-04-26T20:58:51.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.019+0000 7f188be00640 1 -- 172.21.15.138:0/3615693024 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18780ab9d0 con 0x7f188c0cc390 2024-04-26T20:58:51.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.019+0000 7f1892800640 1 -- 172.21.15.138:0/3615693024 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f188c0cc390 msgr2=0x7f188c06df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:51.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.019+0000 7f1892800640 1 --2- 172.21.15.138:0/3615693024 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f188c0cc390 0x7f188c06df20 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f18780097c0 tx=0x7f187801c3d0 comp rx=0 tx=0).stop 2024-04-26T20:58:51.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.019+0000 7f1892800640 1 -- 172.21.15.138:0/3615693024 shutdown_connections 2024-04-26T20:58:51.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.019+0000 7f1892800640 1 --2- 172.21.15.138:0/3615693024 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f188c0cc390 0x7f188c06df20 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:51.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.019+0000 7f1892800640 1 -- 172.21.15.138:0/3615693024 >> 172.21.15.138:0/3615693024 conn(0x7f188c0d0a70 msgr2=0x7f188c0d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:51.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.019+0000 7f1892800640 1 -- 172.21.15.138:0/3615693024 shutdown_connections 2024-04-26T20:58:51.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.019+0000 7f1892800640 1 -- 172.21.15.138:0/3615693024 wait complete. 2024-04-26T20:58:51.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.019+0000 7f1892800640 1 Processor -- start 2024-04-26T20:58:51.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.019+0000 7f1892800640 1 -- start start 2024-04-26T20:58:51.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.023+0000 7f1892800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f188c073d20 0x7f188c153c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:51.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.023+0000 7f1892800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f188c0cc390 0x7f188c1435e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:51.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.023+0000 7f1892800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f188c15c0b0 0x7f188c06e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:51.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.023+0000 7f1892800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f188c16a330 con 0x7f188c073d20 2024-04-26T20:58:51.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.023+0000 7f1892800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f188c16a1b0 con 0x7f188c0cc390 2024-04-26T20:58:51.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.023+0000 7f1892800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f188c16a4b0 con 0x7f188c15c0b0 2024-04-26T20:58:51.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.023+0000 7f1891400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f188c073d20 0x7f188c153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:51.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.023+0000 7f1891400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f188c073d20 0x7f188c153c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:47970/0 (socket says 172.21.15.138:47970) 2024-04-26T20:58:51.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.023+0000 7f1891400640 1 -- 172.21.15.138:0/2294837006 learned_addr learned my addr 172.21.15.138:0/2294837006 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:51.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.023+0000 7f1890a00640 1 --2- 172.21.15.138:0/2294837006 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f188c0cc390 0x7f188c1435e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:51.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.023+0000 7f1891e00640 1 --2- 172.21.15.138:0/2294837006 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f188c15c0b0 0x7f188c06e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:51.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.023+0000 7f1891400640 1 -- 172.21.15.138:0/2294837006 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f188c15c0b0 msgr2=0x7f188c06e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:51.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.023+0000 7f1891400640 1 --2- 172.21.15.138:0/2294837006 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f188c15c0b0 0x7f188c06e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:51.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.023+0000 7f1891400640 1 -- 172.21.15.138:0/2294837006 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f188c0cc390 msgr2=0x7f188c1435e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:51.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.023+0000 7f1891400640 1 --2- 172.21.15.138:0/2294837006 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f188c0cc390 0x7f188c1435e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:51.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.023+0000 7f1891400640 1 -- 172.21.15.138:0/2294837006 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f188c143b20 con 0x7f188c073d20 2024-04-26T20:58:51.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.023+0000 7f1891e00640 1 --2- 172.21.15.138:0/2294837006 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f188c15c0b0 0x7f188c06e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:58:51.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.023+0000 7f1891400640 1 --2- 172.21.15.138:0/2294837006 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f188c073d20 0x7f188c153c90 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f188000ba50 tx=0x7f188000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:51.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.023+0000 7f1889600640 1 -- 172.21.15.138:0/2294837006 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1880019070 con 0x7f188c073d20 2024-04-26T20:58:51.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.023+0000 7f1889600640 1 -- 172.21.15.138:0/2294837006 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f188000cc20 con 0x7f188c073d20 2024-04-26T20:58:51.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.023+0000 7f1892800640 1 -- 172.21.15.138:0/2294837006 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f188c0ca310 con 0x7f188c073d20 2024-04-26T20:58:51.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.023+0000 7f1889600640 1 -- 172.21.15.138:0/2294837006 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1880014680 con 0x7f188c073d20 2024-04-26T20:58:51.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.023+0000 7f1892800640 1 -- 172.21.15.138:0/2294837006 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f188c0ca8d0 con 0x7f188c073d20 2024-04-26T20:58:51.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.023+0000 7f1892800640 1 -- 172.21.15.138:0/2294837006 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f188c069430 con 0x7f188c073d20 2024-04-26T20:58:51.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.023+0000 7f1889600640 1 -- 172.21.15.138:0/2294837006 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f188001c070 con 0x7f188c073d20 2024-04-26T20:58:51.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.027+0000 7f1889600640 1 --2- 172.21.15.138:0/2294837006 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f186c068380 0x7f186c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:51.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.027+0000 7f1889600640 1 -- 172.21.15.138:0/2294837006 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5421+0+0 (secure 0 0 0) 0x7f1880086510 con 0x7f188c073d20 2024-04-26T20:58:51.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.027+0000 7f1890a00640 1 --2- 172.21.15.138:0/2294837006 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f186c068380 0x7f186c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:51.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.027+0000 7f1890a00640 1 --2- 172.21.15.138:0/2294837006 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f186c068380 0x7f186c06a840 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f18780ad000 tx=0x7f18780a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:51.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.031+0000 7f1889600640 1 -- 172.21.15.138:0/2294837006 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f18800565a0 con 0x7f188c073d20 2024-04-26T20:58:51.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.187+0000 7f1892800640 1 -- 172.21.15.138:0/2294837006 --> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f188c0d1980 con 0x7f186c068380 2024-04-26T20:58:51.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.187+0000 7f1889600640 1 -- 172.21.15.138:0/2294837006 <== mgr.4100 v2:172.21.15.143:6832/4275464198 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f188c0d1980 con 0x7f186c068380 2024-04-26T20:58:51.190 INFO:teuthology.orchestra.run.smithi138.stderr:instructed osd(s) 1 to deep-scrub 2024-04-26T20:58:51.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.191+0000 7f1892800640 1 -- 172.21.15.138:0/2294837006 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f186c068380 msgr2=0x7f186c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:51.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.191+0000 7f1892800640 1 --2- 172.21.15.138:0/2294837006 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f186c068380 0x7f186c06a840 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f18780ad000 tx=0x7f18780a6000 comp rx=0 tx=0).stop 2024-04-26T20:58:51.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.191+0000 7f1892800640 1 -- 172.21.15.138:0/2294837006 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f188c073d20 msgr2=0x7f188c153c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:51.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.191+0000 7f1892800640 1 --2- 172.21.15.138:0/2294837006 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f188c073d20 0x7f188c153c90 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f188000ba50 tx=0x7f188000bf10 comp rx=0 tx=0).stop 2024-04-26T20:58:51.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.191+0000 7f1892800640 1 -- 172.21.15.138:0/2294837006 shutdown_connections 2024-04-26T20:58:51.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.191+0000 7f1892800640 1 --2- 172.21.15.138:0/2294837006 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f186c068380 0x7f186c06a840 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:51.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.191+0000 7f1892800640 1 --2- 172.21.15.138:0/2294837006 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f188c15c0b0 0x7f188c06e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:51.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.191+0000 7f1892800640 1 --2- 172.21.15.138:0/2294837006 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f188c0cc390 0x7f188c1435e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:51.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.191+0000 7f1892800640 1 --2- 172.21.15.138:0/2294837006 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f188c073d20 0x7f188c153c90 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:51.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.191+0000 7f1892800640 1 -- 172.21.15.138:0/2294837006 >> 172.21.15.138:0/2294837006 conn(0x7f188c0d0a70 msgr2=0x7f188c165270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:51.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.191+0000 7f1892800640 1 -- 172.21.15.138:0/2294837006 shutdown_connections 2024-04-26T20:58:51.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.191+0000 7f1892800640 1 -- 172.21.15.138:0/2294837006 wait complete. 2024-04-26T20:58:51.211 INFO:tasks.ceph:Scrubbing osd.2 2024-04-26T20:58:51.211 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-26T20:58:51.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.351+0000 7fb354200640 1 Processor -- start 2024-04-26T20:58:51.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.351+0000 7fb354200640 1 -- start start 2024-04-26T20:58:51.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.351+0000 7fb354200640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb34c165dc0 0x7fb34c1681b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:51.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.351+0000 7fb354200640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb34c0cbfc0 con 0x7fb34c15cd70 2024-04-26T20:58:51.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.351+0000 7fb354200640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb34c0ccf20 con 0x7fb34c071ec0 2024-04-26T20:58:51.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.351+0000 7fb354200640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fb34c0cccd0 con 0x7fb34c165dc0 2024-04-26T20:58:51.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.351+0000 7fb351800640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fb34c15cd70 0x7fb34c0cb1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:60062/0 (socket says 172.21.15.138:60062) 2024-04-26T20:58:51.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.351+0000 7fb351800640 1 -- 172.21.15.138:0/471230441 learned_addr learned my addr 172.21.15.138:0/471230441 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:51.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.351+0000 7fb352200640 1 --2- 172.21.15.138:0/471230441 >> v2:172.21.15.138:3300/0 conn(0x7fb34c165dc0 0x7fb34c1681b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:51.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.351+0000 7fb34be00640 1 -- 172.21.15.138:0/471230441 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 336923104 0 0) 0x7fb34c0cbfc0 con 0x7fb34c15cd70 2024-04-26T20:58:51.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.351+0000 7fb34be00640 1 -- 172.21.15.138:0/471230441 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb334003530 con 0x7fb34c15cd70 2024-04-26T20:58:51.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.351+0000 7fb352200640 1 -- 172.21.15.138:0/471230441 >> v1:172.21.15.143:6789/0 conn(0x7fb34c071ec0 legacy=0x7fb34c0cb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:51.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.351+0000 7fb352200640 1 -- 172.21.15.138:0/471230441 >> v1:172.21.15.138:6789/0 conn(0x7fb34c15cd70 legacy=0x7fb34c0cb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:51.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.351+0000 7fb352200640 1 -- 172.21.15.138:0/471230441 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb34c0cd200 con 0x7fb34c165dc0 2024-04-26T20:58:51.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.355+0000 7fb352200640 1 --2- 172.21.15.138:0/471230441 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb34c165dc0 0x7fb34c1681b0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fb344009d90 tx=0x7fb34401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9e537fe07ecfbe3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:51.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.355+0000 7fb34be00640 1 -- 172.21.15.138:0/471230441 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3440b2070 con 0x7fb34c165dc0 2024-04-26T20:58:51.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.355+0000 7fb34be00640 1 -- 172.21.15.138:0/471230441 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3440a59c0 con 0x7fb34c165dc0 2024-04-26T20:58:51.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.355+0000 7fb34be00640 1 -- 172.21.15.138:0/471230441 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3440a5d90 con 0x7fb34c165dc0 2024-04-26T20:58:51.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.355+0000 7fb354200640 1 -- 172.21.15.138:0/471230441 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb34c165dc0 msgr2=0x7fb34c1681b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:51.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.355+0000 7fb354200640 1 --2- 172.21.15.138:0/471230441 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb34c165dc0 0x7fb34c1681b0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fb344009d90 tx=0x7fb34401c8e0 comp rx=0 tx=0).stop 2024-04-26T20:58:51.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.355+0000 7fb354200640 1 -- 172.21.15.138:0/471230441 shutdown_connections 2024-04-26T20:58:51.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.355+0000 7fb354200640 1 --2- 172.21.15.138:0/471230441 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb34c165dc0 0x7fb34c1681b0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:51.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.355+0000 7fb354200640 1 -- 172.21.15.138:0/471230441 >> 172.21.15.138:0/471230441 conn(0x7fb34c0d0b50 msgr2=0x7fb34c0d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:51.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.355+0000 7fb354200640 1 -- 172.21.15.138:0/471230441 shutdown_connections 2024-04-26T20:58:51.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.355+0000 7fb354200640 1 -- 172.21.15.138:0/471230441 wait complete. 2024-04-26T20:58:51.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.359+0000 7fb354200640 1 Processor -- start 2024-04-26T20:58:51.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.359+0000 7fb354200640 1 -- start start 2024-04-26T20:58:51.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.359+0000 7fb354200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb34c071ec0 0x7fb34c0cff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:51.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.359+0000 7fb354200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb34c15cd70 0x7fb34c15b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:51.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.359+0000 7fb354200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb34c165dc0 0x7fb34c14e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:51.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.359+0000 7fb354200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fb34c15d2d0 con 0x7fb34c165dc0 2024-04-26T20:58:51.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.359+0000 7fb354200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fb34c15d150 con 0x7fb34c071ec0 2024-04-26T20:58:51.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.359+0000 7fb354200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb34c0b39a0 con 0x7fb34c15cd70 2024-04-26T20:58:51.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.359+0000 7fb352200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb34c165dc0 0x7fb34c14e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:51.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.359+0000 7fb351800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb34c071ec0 0x7fb34c0cff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:51.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.359+0000 7fb350e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb34c15cd70 0x7fb34c15b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:51.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.359+0000 7fb352200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb34c165dc0 0x7fb34c14e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:47982/0 (socket says 172.21.15.138:47982) 2024-04-26T20:58:51.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.359+0000 7fb352200640 1 -- 172.21.15.138:0/3482011779 learned_addr learned my addr 172.21.15.138:0/3482011779 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:51.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.359+0000 7fb351800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb34c071ec0 0x7fb34c0cff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.138:41046/0 (socket says 172.21.15.138:41046) 2024-04-26T20:58:51.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.359+0000 7fb352200640 1 -- 172.21.15.138:0/3482011779 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb34c15cd70 msgr2=0x7fb34c15b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:51.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.359+0000 7fb352200640 1 --2- 172.21.15.138:0/3482011779 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb34c15cd70 0x7fb34c15b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:51.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.359+0000 7fb352200640 1 -- 172.21.15.138:0/3482011779 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb34c071ec0 msgr2=0x7fb34c0cff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:51.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.359+0000 7fb352200640 1 --2- 172.21.15.138:0/3482011779 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb34c071ec0 0x7fb34c0cff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:51.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.359+0000 7fb352200640 1 -- 172.21.15.138:0/3482011779 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb34c0ceea0 con 0x7fb34c165dc0 2024-04-26T20:58:51.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.359+0000 7fb352200640 1 --2- 172.21.15.138:0/3482011779 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb34c165dc0 0x7fb34c14e020 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fb3440b0040 tx=0x7fb344019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:51.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.359+0000 7fb349600640 1 -- 172.21.15.138:0/3482011779 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3440bd020 con 0x7fb34c165dc0 2024-04-26T20:58:51.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.359+0000 7fb349600640 1 -- 172.21.15.138:0/3482011779 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3440b8670 con 0x7fb34c165dc0 2024-04-26T20:58:51.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.359+0000 7fb354200640 1 -- 172.21.15.138:0/3482011779 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb34c0cf180 con 0x7fb34c165dc0 2024-04-26T20:58:51.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.359+0000 7fb349600640 1 -- 172.21.15.138:0/3482011779 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3440b2040 con 0x7fb34c165dc0 2024-04-26T20:58:51.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.359+0000 7fb354200640 1 -- 172.21.15.138:0/3482011779 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb34c0cf740 con 0x7fb34c165dc0 2024-04-26T20:58:51.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.359+0000 7fb354200640 1 -- 172.21.15.138:0/3482011779 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb34c14e560 con 0x7fb34c165dc0 2024-04-26T20:58:51.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.363+0000 7fb349600640 1 -- 172.21.15.138:0/3482011779 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb3440c0020 con 0x7fb34c165dc0 2024-04-26T20:58:51.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.363+0000 7fb349600640 1 --2- 172.21.15.138:0/3482011779 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb32c068380 0x7fb32c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:51.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.363+0000 7fb349600640 1 -- 172.21.15.138:0/3482011779 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5421+0+0 (secure 0 0 0) 0x7fb344121540 con 0x7fb34c165dc0 2024-04-26T20:58:51.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.363+0000 7fb349600640 1 --2- 172.21.15.138:0/3482011779 >> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] conn(0x7fb32c06e8c0 0x7fb32c070d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:51.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.363+0000 7fb349600640 1 -- 172.21.15.138:0/3482011779 --> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb3440aee50 con 0x7fb32c06e8c0 2024-04-26T20:58:51.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.363+0000 7fb349600640 1 -- 172.21.15.138:0/3482011779 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7fb344128050 con 0x7fb34c165dc0 2024-04-26T20:58:51.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.363+0000 7fb351800640 1 --2- 172.21.15.138:0/3482011779 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb32c068380 0x7fb32c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:51.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.363+0000 7fb350e00640 1 --2- 172.21.15.138:0/3482011779 >> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] conn(0x7fb32c06e8c0 0x7fb32c070d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:51.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.363+0000 7fb350e00640 1 --2- 172.21.15.138:0/3482011779 >> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] conn(0x7fb32c06e8c0 0x7fb32c070d00 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:51.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.363+0000 7fb351800640 1 --2- 172.21.15.138:0/3482011779 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb32c068380 0x7fb32c06a840 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb3400011f0 tx=0x7fb340007d40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:51.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.363+0000 7fb349600640 1 -- 172.21.15.138:0/3482011779 <== osd.2 v2:172.21.15.138:6808/4273721573 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb3440aee50 con 0x7fb32c06e8c0 2024-04-26T20:58:51.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.379+0000 7fb354200640 1 -- 172.21.15.138:0/3482011779 --> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb34c069510 con 0x7fb32c06e8c0 2024-04-26T20:58:51.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.379+0000 7fb349600640 1 -- 172.21.15.138:0/3482011779 <== osd.2 v2:172.21.15.138:6808/4273721573 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb34c069510 con 0x7fb32c06e8c0 2024-04-26T20:58:51.379 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-26T20:58:51.380 INFO:teuthology.orchestra.run.smithi138.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T20:58:51.380 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-26T20:58:51.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.379+0000 7fb354200640 1 -- 172.21.15.138:0/3482011779 >> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] conn(0x7fb32c06e8c0 msgr2=0x7fb32c070d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:51.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.379+0000 7fb354200640 1 --2- 172.21.15.138:0/3482011779 >> [v2:172.21.15.138:6808/4273721573,v1:172.21.15.138:6809/4273721573] conn(0x7fb32c06e8c0 0x7fb32c070d00 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:51.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.379+0000 7fb354200640 1 -- 172.21.15.138:0/3482011779 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb32c068380 msgr2=0x7fb32c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:51.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.379+0000 7fb354200640 1 --2- 172.21.15.138:0/3482011779 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb32c068380 0x7fb32c06a840 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb3400011f0 tx=0x7fb340007d40 comp rx=0 tx=0).stop 2024-04-26T20:58:51.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.379+0000 7fb354200640 1 -- 172.21.15.138:0/3482011779 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb34c165dc0 msgr2=0x7fb34c14e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:51.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.379+0000 7fb354200640 1 --2- 172.21.15.138:0/3482011779 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb34c165dc0 0x7fb34c14e020 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fb3440b0040 tx=0x7fb344019680 comp rx=0 tx=0).stop 2024-04-26T20:58:51.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.379+0000 7fb352200640 1 -- 172.21.15.138:0/3482011779 reap_dead start 2024-04-26T20:58:51.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.379+0000 7fb354200640 1 -- 172.21.15.138:0/3482011779 shutdown_connections 2024-04-26T20:58:51.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.379+0000 7fb354200640 1 -- 172.21.15.138:0/3482011779 >> 172.21.15.138:0/3482011779 conn(0x7fb34c0d0b50 msgr2=0x7fb34c0cd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:51.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.379+0000 7fb354200640 1 -- 172.21.15.138:0/3482011779 shutdown_connections 2024-04-26T20:58:51.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.379+0000 7fb354200640 1 -- 172.21.15.138:0/3482011779 wait complete. 2024-04-26T20:58:51.398 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-26T20:58:51.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.535+0000 7f0061c00640 1 Processor -- start 2024-04-26T20:58:51.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.535+0000 7f0061c00640 1 -- start start 2024-04-26T20:58:51.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.535+0000 7f0061c00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f005c15cf80 0x7f005c073b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:51.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.535+0000 7f0061c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f005c0cc1e0 0x7f005c0ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:51.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.535+0000 7f0061c00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f005c0727f0 con 0x7f005c0cbe00 2024-04-26T20:58:51.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.535+0000 7f0061c00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f005c073680 con 0x7f005c15cf80 2024-04-26T20:58:51.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.535+0000 7f0061c00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f005c072a70 con 0x7f005c0cc1e0 2024-04-26T20:58:51.537 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.535+0000 7f005a000640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f005c15cf80 0x7f005c073b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:51.537 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.535+0000 7f005b400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f005c0cc1e0 0x7f005c0ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:51.537 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.535+0000 7f005b400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f005c0cc1e0 0x7f005c0ce6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.138:57488/0 (socket says 172.21.15.138:57488) 2024-04-26T20:58:51.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.535+0000 7f005b400640 1 -- 172.21.15.138:0/3073559122 learned_addr learned my addr 172.21.15.138:0/3073559122 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:51.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.535+0000 7f005a000640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f005c15cf80 0x7f005c073b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.138:41056/0 (socket says 172.21.15.138:41056) 2024-04-26T20:58:51.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.535+0000 7f005b400640 1 -- 172.21.15.138:0/3073559122 >> v2:172.21.15.143:3300/0 conn(0x7f005c15cf80 msgr2=0x7f005c073b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:51.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.535+0000 7f005b400640 1 --2- 172.21.15.138:0/3073559122 >> v2:172.21.15.143:3300/0 conn(0x7f005c15cf80 0x7f005c073b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:51.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.535+0000 7f005b400640 1 -- 172.21.15.138:0/3073559122 >> v1:172.21.15.143:6789/0 conn(0x7f005c0cbe00 legacy=0x7f005c06de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:51.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.535+0000 7f005b400640 1 -- 172.21.15.138:0/3073559122 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f005c072d50 con 0x7f005c0cc1e0 2024-04-26T20:58:51.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.539+0000 7f005b400640 1 --2- 172.21.15.138:0/3073559122 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f005c0cc1e0 0x7f005c0ce6f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0054009e50 tx=0x7f005401ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3581169185ddb4bd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:51.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.539+0000 7f0059600640 1 -- 172.21.15.138:0/3073559122 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00540a5600 con 0x7f005c0cc1e0 2024-04-26T20:58:51.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.539+0000 7f0059600640 1 -- 172.21.15.138:0/3073559122 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00540a57a0 con 0x7f005c0cc1e0 2024-04-26T20:58:51.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.539+0000 7f0059600640 1 -- 172.21.15.138:0/3073559122 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00540a5b70 con 0x7f005c0cc1e0 2024-04-26T20:58:51.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.539+0000 7f0061c00640 1 -- 172.21.15.138:0/3073559122 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f005c0cc1e0 msgr2=0x7f005c0ce6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:51.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.539+0000 7f0061c00640 1 --2- 172.21.15.138:0/3073559122 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f005c0cc1e0 0x7f005c0ce6f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0054009e50 tx=0x7f005401ca30 comp rx=0 tx=0).stop 2024-04-26T20:58:51.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.539+0000 7f0061c00640 1 -- 172.21.15.138:0/3073559122 shutdown_connections 2024-04-26T20:58:51.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.539+0000 7f0061c00640 1 --2- 172.21.15.138:0/3073559122 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f005c0cc1e0 0x7f005c0ce6f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:51.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.539+0000 7f0061c00640 1 --2- 172.21.15.138:0/3073559122 >> v2:172.21.15.143:3300/0 conn(0x7f005c15cf80 0x7f005c073b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:51.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.539+0000 7f0061c00640 1 -- 172.21.15.138:0/3073559122 >> 172.21.15.138:0/3073559122 conn(0x7f005c0d0b20 msgr2=0x7f005c0d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:51.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.539+0000 7f0061c00640 1 -- 172.21.15.138:0/3073559122 shutdown_connections 2024-04-26T20:58:51.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.539+0000 7f0061c00640 1 -- 172.21.15.138:0/3073559122 wait complete. 2024-04-26T20:58:51.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.539+0000 7f0061c00640 1 Processor -- start 2024-04-26T20:58:51.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.543+0000 7f0061c00640 1 -- start start 2024-04-26T20:58:51.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.543+0000 7f0061c00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f005c0cbe00 0x7f005c1f7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:51.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.543+0000 7f0061c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f005c0cc1e0 0x7f005c0c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:51.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.543+0000 7f0061c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f005c15cf80 0x7f005c0c98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:51.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.543+0000 7f0061c00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f005c0741d0 con 0x7f005c0cbe00 2024-04-26T20:58:51.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.543+0000 7f0061c00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f005c074050 con 0x7f005c15cf80 2024-04-26T20:58:51.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.543+0000 7f0061c00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f005c0d0780 con 0x7f005c0cc1e0 2024-04-26T20:58:51.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.543+0000 7f005aa00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f005c0cbe00 0x7f005c1f7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:51.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.543+0000 7f005b400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f005c15cf80 0x7f005c0c98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:51.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.543+0000 7f005aa00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f005c0cbe00 0x7f005c1f7ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:47986/0 (socket says 172.21.15.138:47986) 2024-04-26T20:58:51.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.543+0000 7f005aa00640 1 -- 172.21.15.138:0/264655903 learned_addr learned my addr 172.21.15.138:0/264655903 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:51.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.543+0000 7f005a000640 1 --2- 172.21.15.138:0/264655903 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f005c0cc1e0 0x7f005c0c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:51.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.543+0000 7f005aa00640 1 -- 172.21.15.138:0/264655903 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f005c0cc1e0 msgr2=0x7f005c0c8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:51.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.543+0000 7f005aa00640 1 --2- 172.21.15.138:0/264655903 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f005c0cc1e0 0x7f005c0c8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:51.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.543+0000 7f005aa00640 1 -- 172.21.15.138:0/264655903 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f005c15cf80 msgr2=0x7f005c0c98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:51.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.543+0000 7f005aa00640 1 --2- 172.21.15.138:0/264655903 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f005c15cf80 0x7f005c0c98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:51.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.543+0000 7f005aa00640 1 -- 172.21.15.138:0/264655903 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f005c0b4830 con 0x7f005c0cbe00 2024-04-26T20:58:51.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.543+0000 7f005b400640 1 --2- 172.21.15.138:0/264655903 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f005c15cf80 0x7f005c0c98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:58:51.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.543+0000 7f005aa00640 1 --2- 172.21.15.138:0/264655903 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f005c0cbe00 0x7f005c1f7ec0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f004c00c420 tx=0x7f004c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:51.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.543+0000 7f0052a00640 1 -- 172.21.15.138:0/264655903 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c0052d0 con 0x7f005c0cbe00 2024-04-26T20:58:51.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.543+0000 7f0052a00640 1 -- 172.21.15.138:0/264655903 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f004c005470 con 0x7f005c0cbe00 2024-04-26T20:58:51.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.543+0000 7f0052a00640 1 -- 172.21.15.138:0/264655903 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c007260 con 0x7f005c0cbe00 2024-04-26T20:58:51.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.543+0000 7f0061c00640 1 -- 172.21.15.138:0/264655903 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f005c0b4ad0 con 0x7f005c0cbe00 2024-04-26T20:58:51.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.543+0000 7f0061c00640 1 -- 172.21.15.138:0/264655903 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f005c0b5090 con 0x7f005c0cbe00 2024-04-26T20:58:51.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.543+0000 7f0061c00640 1 -- 172.21.15.138:0/264655903 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f005c069510 con 0x7f005c0cbe00 2024-04-26T20:58:51.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.547+0000 7f0052a00640 1 -- 172.21.15.138:0/264655903 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f004c007400 con 0x7f005c0cbe00 2024-04-26T20:58:51.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.547+0000 7f0052a00640 1 --2- 172.21.15.138:0/264655903 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f003c0683b0 0x7f003c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:51.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.547+0000 7f0052a00640 1 -- 172.21.15.138:0/264655903 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5421+0+0 (secure 0 0 0) 0x7f004c085cc0 con 0x7f005c0cbe00 2024-04-26T20:58:51.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.547+0000 7f005a000640 1 --2- 172.21.15.138:0/264655903 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f003c0683b0 0x7f003c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:51.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.547+0000 7f005a000640 1 --2- 172.21.15.138:0/264655903 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f003c0683b0 0x7f003c06a870 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f004800b240 tx=0x7f004800b3a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:51.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.551+0000 7f0052a00640 1 -- 172.21.15.138:0/264655903 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f004c08c080 con 0x7f005c0cbe00 2024-04-26T20:58:51.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.707+0000 7f0061c00640 1 -- 172.21.15.138:0/264655903 --> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f005c0c7140 con 0x7f003c0683b0 2024-04-26T20:58:51.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.707+0000 7f0052a00640 1 -- 172.21.15.138:0/264655903 <== mgr.4100 v2:172.21.15.143:6832/4275464198 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f005c0c7140 con 0x7f003c0683b0 2024-04-26T20:58:51.710 INFO:teuthology.orchestra.run.smithi138.stderr:instructed osd(s) 2 to deep-scrub 2024-04-26T20:58:51.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.711+0000 7f0061c00640 1 -- 172.21.15.138:0/264655903 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f003c0683b0 msgr2=0x7f003c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:51.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.711+0000 7f0061c00640 1 --2- 172.21.15.138:0/264655903 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f003c0683b0 0x7f003c06a870 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f004800b240 tx=0x7f004800b3a0 comp rx=0 tx=0).stop 2024-04-26T20:58:51.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.711+0000 7f0061c00640 1 -- 172.21.15.138:0/264655903 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f005c0cbe00 msgr2=0x7f005c1f7ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:51.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.711+0000 7f0061c00640 1 --2- 172.21.15.138:0/264655903 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f005c0cbe00 0x7f005c1f7ec0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f004c00c420 tx=0x7f004c00c8e0 comp rx=0 tx=0).stop 2024-04-26T20:58:51.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.711+0000 7f0061c00640 1 -- 172.21.15.138:0/264655903 shutdown_connections 2024-04-26T20:58:51.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.711+0000 7f0061c00640 1 --2- 172.21.15.138:0/264655903 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f003c0683b0 0x7f003c06a870 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:51.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.711+0000 7f0061c00640 1 --2- 172.21.15.138:0/264655903 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f005c15cf80 0x7f005c0c98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:51.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.711+0000 7f0061c00640 1 --2- 172.21.15.138:0/264655903 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f005c0cc1e0 0x7f005c0c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:51.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.711+0000 7f0061c00640 1 --2- 172.21.15.138:0/264655903 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f005c0cbe00 0x7f005c1f7ec0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:51.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.711+0000 7f0061c00640 1 -- 172.21.15.138:0/264655903 >> 172.21.15.138:0/264655903 conn(0x7f005c0d0b20 msgr2=0x7f005c0ae8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:51.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.711+0000 7f0061c00640 1 -- 172.21.15.138:0/264655903 shutdown_connections 2024-04-26T20:58:51.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.711+0000 7f0061c00640 1 -- 172.21.15.138:0/264655903 wait complete. 2024-04-26T20:58:51.732 INFO:tasks.ceph:Scrubbing osd.3 2024-04-26T20:58:51.732 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-26T20:58:51.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.871+0000 7f372d800640 1 Processor -- start 2024-04-26T20:58:51.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.871+0000 7f372d800640 1 -- start start 2024-04-26T20:58:51.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.871+0000 7f372d800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f37280d3570 0x7f37280d2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:51.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.871+0000 7f372d800640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37280d0ee0 con 0x7f37280b3f00 2024-04-26T20:58:51.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.871+0000 7f372d800640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37280d0640 con 0x7f37280b2460 2024-04-26T20:58:51.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.871+0000 7f372d800640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f37280b1fd0 con 0x7f37280d3570 2024-04-26T20:58:51.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.871+0000 7f3726a00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f37280d3570 0x7f37280d2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:51.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.871+0000 7f3726000640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f37280b3f00 0x7f37280d3950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:60074/0 (socket says 172.21.15.138:60074) 2024-04-26T20:58:51.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.871+0000 7f3726000640 1 -- 172.21.15.138:0/935641687 learned_addr learned my addr 172.21.15.138:0/935641687 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:51.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.871+0000 7f3726a00640 1 -- 172.21.15.138:0/935641687 >> v1:172.21.15.143:6789/0 conn(0x7f37280b2460 legacy=0x7f37280b2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:51.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.871+0000 7f3726a00640 1 -- 172.21.15.138:0/935641687 >> v1:172.21.15.138:6789/0 conn(0x7f37280b3f00 legacy=0x7f37280d3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:51.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.871+0000 7f3726a00640 1 -- 172.21.15.138:0/935641687 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37280d0920 con 0x7f37280d3570 2024-04-26T20:58:51.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.871+0000 7f3725600640 1 -- 172.21.15.138:0/935641687 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 555599343 0 0) 0x7f37280d0ee0 con 0x7f37280b3f00 2024-04-26T20:58:51.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.875+0000 7f3726a00640 1 --2- 172.21.15.138:0/935641687 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f37280d3570 0x7f37280d2d70 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f37180097c0 tx=0x7f371801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b2cdcdd0ffdaee1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:51.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.875+0000 7f3725600640 1 -- 172.21.15.138:0/935641687 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37180b0070 con 0x7f37280d3570 2024-04-26T20:58:51.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.875+0000 7f3725600640 1 -- 172.21.15.138:0/935641687 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37180ab600 con 0x7f37280d3570 2024-04-26T20:58:51.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.875+0000 7f3725600640 1 -- 172.21.15.138:0/935641687 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37180ab9d0 con 0x7f37280d3570 2024-04-26T20:58:51.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.875+0000 7f372d800640 1 -- 172.21.15.138:0/935641687 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f37280d3570 msgr2=0x7f37280d2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:51.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.875+0000 7f372d800640 1 --2- 172.21.15.138:0/935641687 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f37280d3570 0x7f37280d2d70 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f37180097c0 tx=0x7f371801c3e0 comp rx=0 tx=0).stop 2024-04-26T20:58:51.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.875+0000 7f372d800640 1 -- 172.21.15.138:0/935641687 shutdown_connections 2024-04-26T20:58:51.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.875+0000 7f372d800640 1 --2- 172.21.15.138:0/935641687 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f37280d3570 0x7f37280d2d70 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:51.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.875+0000 7f372d800640 1 -- 172.21.15.138:0/935641687 >> 172.21.15.138:0/935641687 conn(0x7f37280d4f90 msgr2=0x7f37280d53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:51.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.875+0000 7f372d800640 1 -- 172.21.15.138:0/935641687 shutdown_connections 2024-04-26T20:58:51.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.875+0000 7f372d800640 1 -- 172.21.15.138:0/935641687 wait complete. 2024-04-26T20:58:51.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.879+0000 7f372d800640 1 Processor -- start 2024-04-26T20:58:51.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.879+0000 7f372d800640 1 -- start start 2024-04-26T20:58:51.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.879+0000 7f372d800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f37280b2460 0x7f372814e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:51.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.879+0000 7f372d800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f37280b3f00 0x7f3728157490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:51.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.879+0000 7f372d800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f37280d3570 0x7f372806d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:51.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.879+0000 7f372d800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f372816d0c0 con 0x7f37280b3f00 2024-04-26T20:58:51.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.879+0000 7f372d800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f372816cf40 con 0x7f37280b2460 2024-04-26T20:58:51.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.879+0000 7f372d800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f372816d240 con 0x7f37280d3570 2024-04-26T20:58:51.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.879+0000 7f3726000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f37280b3f00 0x7f3728157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:51.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.879+0000 7f3726000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f37280b3f00 0x7f3728157490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:48002/0 (socket says 172.21.15.138:48002) 2024-04-26T20:58:51.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.879+0000 7f3726000640 1 -- 172.21.15.138:0/1211806838 learned_addr learned my addr 172.21.15.138:0/1211806838 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:51.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.879+0000 7f3726a00640 1 --2- 172.21.15.138:0/1211806838 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f37280b2460 0x7f372814e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:51.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.879+0000 7f3727400640 1 --2- 172.21.15.138:0/1211806838 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f37280d3570 0x7f372806d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:51.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.879+0000 7f3726000640 1 -- 172.21.15.138:0/1211806838 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f37280d3570 msgr2=0x7f372806d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:51.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.879+0000 7f3726000640 1 --2- 172.21.15.138:0/1211806838 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f37280d3570 0x7f372806d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:51.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.879+0000 7f3726000640 1 -- 172.21.15.138:0/1211806838 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f37280b2460 msgr2=0x7f372814e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:51.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.879+0000 7f3726000640 1 --2- 172.21.15.138:0/1211806838 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f37280b2460 0x7f372814e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:51.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.879+0000 7f3726000640 1 -- 172.21.15.138:0/1211806838 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37280cb8c0 con 0x7f37280b3f00 2024-04-26T20:58:51.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.879+0000 7f3726000640 1 --2- 172.21.15.138:0/1211806838 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f37280b3f00 0x7f3728157490 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f371400c410 tx=0x7f371400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:51.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.879+0000 7f371ea00640 1 -- 172.21.15.138:0/1211806838 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37140074e0 con 0x7f37280b3f00 2024-04-26T20:58:51.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.879+0000 7f371ea00640 1 -- 172.21.15.138:0/1211806838 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37140047f0 con 0x7f37280b3f00 2024-04-26T20:58:51.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.879+0000 7f372d800640 1 -- 172.21.15.138:0/1211806838 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f372814efc0 con 0x7f37280b3f00 2024-04-26T20:58:51.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.879+0000 7f371ea00640 1 -- 172.21.15.138:0/1211806838 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3714007680 con 0x7f37280b3f00 2024-04-26T20:58:51.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.879+0000 7f372d800640 1 -- 172.21.15.138:0/1211806838 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f372814f580 con 0x7f37280b3f00 2024-04-26T20:58:51.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.879+0000 7f372d800640 1 -- 172.21.15.138:0/1211806838 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f372814ff20 con 0x7f37280b3f00 2024-04-26T20:58:51.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.883+0000 7f371ea00640 1 -- 172.21.15.138:0/1211806838 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3714011070 con 0x7f37280b3f00 2024-04-26T20:58:51.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.883+0000 7f371ea00640 1 --2- 172.21.15.138:0/1211806838 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f3708068380 0x7f370806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:51.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.883+0000 7f371ea00640 1 -- 172.21.15.138:0/1211806838 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5421+0+0 (secure 0 0 0) 0x7f37140862c0 con 0x7f37280b3f00 2024-04-26T20:58:51.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.883+0000 7f371ea00640 1 --2- 172.21.15.138:0/1211806838 >> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] conn(0x7f370806e8c0 0x7f3708070d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:51.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.883+0000 7f371ea00640 1 -- 172.21.15.138:0/1211806838 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f371401fe50 con 0x7f370806e8c0 2024-04-26T20:58:51.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.883+0000 7f371ea00640 1 -- 172.21.15.138:0/1211806838 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f371408d050 con 0x7f37280b3f00 2024-04-26T20:58:51.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.883+0000 7f3726a00640 1 --2- 172.21.15.138:0/1211806838 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f3708068380 0x7f370806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:51.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.883+0000 7f3727400640 1 --2- 172.21.15.138:0/1211806838 >> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] conn(0x7f370806e8c0 0x7f3708070d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:51.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.883+0000 7f3727400640 1 --2- 172.21.15.138:0/1211806838 >> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] conn(0x7f370806e8c0 0x7f3708070d00 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:51.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.883+0000 7f3726a00640 1 --2- 172.21.15.138:0/1211806838 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f3708068380 0x7f370806a840 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f37180ad000 tx=0x7f37180a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:51.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.883+0000 7f371ea00640 1 -- 172.21.15.138:0/1211806838 <== osd.3 v2:172.21.15.138:6824/3098242154 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f371401fe50 con 0x7f370806e8c0 2024-04-26T20:58:51.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.899+0000 7f372d800640 1 -- 172.21.15.138:0/1211806838 --> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3728069510 con 0x7f370806e8c0 2024-04-26T20:58:51.900 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.899+0000 7f371ea00640 1 -- 172.21.15.138:0/1211806838 <== osd.3 v2:172.21.15.138:6824/3098242154 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3728069510 con 0x7f370806e8c0 2024-04-26T20:58:51.900 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-26T20:58:51.900 INFO:teuthology.orchestra.run.smithi138.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T20:58:51.900 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-26T20:58:51.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.899+0000 7f372d800640 1 -- 172.21.15.138:0/1211806838 >> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] conn(0x7f370806e8c0 msgr2=0x7f3708070d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:51.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.899+0000 7f372d800640 1 --2- 172.21.15.138:0/1211806838 >> [v2:172.21.15.138:6824/3098242154,v1:172.21.15.138:6825/3098242154] conn(0x7f370806e8c0 0x7f3708070d00 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:51.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.899+0000 7f372d800640 1 -- 172.21.15.138:0/1211806838 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f3708068380 msgr2=0x7f370806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:51.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.899+0000 7f372d800640 1 --2- 172.21.15.138:0/1211806838 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f3708068380 0x7f370806a840 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f37180ad000 tx=0x7f37180a6000 comp rx=0 tx=0).stop 2024-04-26T20:58:51.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.899+0000 7f372d800640 1 -- 172.21.15.138:0/1211806838 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f37280b3f00 msgr2=0x7f3728157490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:51.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.899+0000 7f372d800640 1 --2- 172.21.15.138:0/1211806838 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f37280b3f00 0x7f3728157490 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f371400c410 tx=0x7f371400c8d0 comp rx=0 tx=0).stop 2024-04-26T20:58:51.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.899+0000 7f3727400640 1 -- 172.21.15.138:0/1211806838 reap_dead start 2024-04-26T20:58:51.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.899+0000 7f372d800640 1 -- 172.21.15.138:0/1211806838 shutdown_connections 2024-04-26T20:58:51.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.899+0000 7f372d800640 1 -- 172.21.15.138:0/1211806838 >> 172.21.15.138:0/1211806838 conn(0x7f37280d4f90 msgr2=0x7f37280b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:51.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.899+0000 7f372d800640 1 -- 172.21.15.138:0/1211806838 shutdown_connections 2024-04-26T20:58:51.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:51.899+0000 7f372d800640 1 -- 172.21.15.138:0/1211806838 wait complete. 2024-04-26T20:58:51.918 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-26T20:58:52.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.055+0000 7f76c2600640 1 Processor -- start 2024-04-26T20:58:52.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.055+0000 7f76c2600640 1 -- start start 2024-04-26T20:58:52.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.055+0000 7f76c2600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f76bc0d37d0 0x7f76bc070860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:52.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.055+0000 7f76c2600640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76bc0cd2c0 con 0x7f76bc0cda50 2024-04-26T20:58:52.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.055+0000 7f76c2600640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76bc15f690 con 0x7f76bc15f2b0 2024-04-26T20:58:52.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.055+0000 7f76c2600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f76bc0d1870 con 0x7f76bc0d37d0 2024-04-26T20:58:52.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.055+0000 7f76c1c00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f76bc0cda50 0x7f76bc0cdee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:60080/0 (socket says 172.21.15.138:60080) 2024-04-26T20:58:52.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.055+0000 7f76c1c00640 1 -- 172.21.15.138:0/1683615680 learned_addr learned my addr 172.21.15.138:0/1683615680 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:52.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.055+0000 7f76bbe00640 1 --2- 172.21.15.138:0/1683615680 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f76bc0d37d0 0x7f76bc070860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:52.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.055+0000 7f76bb400640 1 -- 172.21.15.138:0/1683615680 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2342488724 0 0) 0x7f76bc0cd2c0 con 0x7f76bc0cda50 2024-04-26T20:58:52.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.055+0000 7f76bb400640 1 -- 172.21.15.138:0/1683615680 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76a4003530 con 0x7f76bc0cda50 2024-04-26T20:58:52.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.055+0000 7f76bb400640 1 -- 172.21.15.138:0/1683615680 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2979496886 0 0) 0x7f76bc15f690 con 0x7f76bc15f2b0 2024-04-26T20:58:52.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.055+0000 7f76bb400640 1 -- 172.21.15.138:0/1683615680 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76bc0cd2c0 con 0x7f76bc15f2b0 2024-04-26T20:58:52.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.055+0000 7f76bbe00640 1 -- 172.21.15.138:0/1683615680 >> v1:172.21.15.143:6789/0 conn(0x7f76bc15f2b0 legacy=0x7f76bc070150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:52.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.055+0000 7f76bb400640 1 -- 172.21.15.138:0/1683615680 <== mon.0 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1218632280 0 0) 0x7f76a4003530 con 0x7f76bc0cda50 2024-04-26T20:58:52.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.055+0000 7f76bbe00640 1 -- 172.21.15.138:0/1683615680 >> v1:172.21.15.138:6789/0 conn(0x7f76bc0cda50 legacy=0x7f76bc0cdee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:52.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.055+0000 7f76bbe00640 1 -- 172.21.15.138:0/1683615680 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76bc0d1ac0 con 0x7f76bc0d37d0 2024-04-26T20:58:52.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.059+0000 7f76bbe00640 1 --2- 172.21.15.138:0/1683615680 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f76bc0d37d0 0x7f76bc070860 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f76a80097f0 tx=0x7f76a801c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6bebf7b2f1f7e9b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:52.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.059+0000 7f76bb400640 1 -- 172.21.15.138:0/1683615680 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a80b0070 con 0x7f76bc0d37d0 2024-04-26T20:58:52.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.059+0000 7f76bb400640 1 -- 172.21.15.138:0/1683615680 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76a80ab400 con 0x7f76bc0d37d0 2024-04-26T20:58:52.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.059+0000 7f76bb400640 1 -- 172.21.15.138:0/1683615680 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b4001a00 con 0x7f76bc0d37d0 2024-04-26T20:58:52.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.059+0000 7f76c2600640 1 -- 172.21.15.138:0/1683615680 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f76bc0d37d0 msgr2=0x7f76bc070860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:52.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.059+0000 7f76c2600640 1 --2- 172.21.15.138:0/1683615680 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f76bc0d37d0 0x7f76bc070860 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f76a80097f0 tx=0x7f76a801c400 comp rx=0 tx=0).stop 2024-04-26T20:58:52.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.059+0000 7f76c2600640 1 -- 172.21.15.138:0/1683615680 shutdown_connections 2024-04-26T20:58:52.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.059+0000 7f76c2600640 1 --2- 172.21.15.138:0/1683615680 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f76bc0d37d0 0x7f76bc070860 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:52.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.059+0000 7f76c2600640 1 -- 172.21.15.138:0/1683615680 >> 172.21.15.138:0/1683615680 conn(0x7f76bc0d2bd0 msgr2=0x7f76bc0d2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:52.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.059+0000 7f76c2600640 1 -- 172.21.15.138:0/1683615680 shutdown_connections 2024-04-26T20:58:52.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.059+0000 7f76c2600640 1 -- 172.21.15.138:0/1683615680 wait complete. 2024-04-26T20:58:52.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.063+0000 7f76c2600640 1 Processor -- start 2024-04-26T20:58:52.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.063+0000 7f76c2600640 1 -- start start 2024-04-26T20:58:52.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.063+0000 7f76c2600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f76bc0cda50 0x7f76bc14e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:52.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.063+0000 7f76c2600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f76bc0d37d0 0x7f76bc06e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:52.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.063+0000 7f76c2600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f76bc15f2b0 0x7f76bc0c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:52.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.063+0000 7f76c2600640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f76bc070f20 con 0x7f76bc15f2b0 2024-04-26T20:58:52.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.063+0000 7f76c2600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f76bc070da0 con 0x7f76bc0d37d0 2024-04-26T20:58:52.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.063+0000 7f76c2600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f76bc16cdf0 con 0x7f76bc0cda50 2024-04-26T20:58:52.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.063+0000 7f76c1c00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f76bc15f2b0 0x7f76bc0c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:52.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.063+0000 7f76c1c00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f76bc15f2b0 0x7f76bc0c87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:48010/0 (socket says 172.21.15.138:48010) 2024-04-26T20:58:52.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.063+0000 7f76c1c00640 1 -- 172.21.15.138:0/512538638 learned_addr learned my addr 172.21.15.138:0/512538638 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:52.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.063+0000 7f76bbe00640 1 --2- 172.21.15.138:0/512538638 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f76bc0d37d0 0x7f76bc06e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:52.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.063+0000 7f76c1200640 1 --2- 172.21.15.138:0/512538638 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f76bc0cda50 0x7f76bc14e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:52.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.063+0000 7f76c1c00640 1 -- 172.21.15.138:0/512538638 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f76bc0cda50 msgr2=0x7f76bc14e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:52.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.063+0000 7f76c1c00640 1 --2- 172.21.15.138:0/512538638 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f76bc0cda50 0x7f76bc14e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:52.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.063+0000 7f76c1c00640 1 -- 172.21.15.138:0/512538638 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f76bc0d37d0 msgr2=0x7f76bc06e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:52.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.063+0000 7f76c1c00640 1 --2- 172.21.15.138:0/512538638 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f76bc0d37d0 0x7f76bc06e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:52.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.063+0000 7f76c1c00640 1 -- 172.21.15.138:0/512538638 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76bc14e7a0 con 0x7f76bc15f2b0 2024-04-26T20:58:52.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.063+0000 7f76c1c00640 1 --2- 172.21.15.138:0/512538638 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f76bc15f2b0 0x7f76bc0c87c0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f76b400cc30 tx=0x7f76b400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:52.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.063+0000 7f76b8c00640 1 -- 172.21.15.138:0/512538638 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b4017070 con 0x7f76bc15f2b0 2024-04-26T20:58:52.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.063+0000 7f76b8c00640 1 -- 172.21.15.138:0/512538638 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76b400ce40 con 0x7f76bc15f2b0 2024-04-26T20:58:52.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.063+0000 7f76b8c00640 1 -- 172.21.15.138:0/512538638 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b4012620 con 0x7f76bc15f2b0 2024-04-26T20:58:52.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.063+0000 7f76c2600640 1 -- 172.21.15.138:0/512538638 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76bc0c7720 con 0x7f76bc15f2b0 2024-04-26T20:58:52.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.063+0000 7f76c2600640 1 -- 172.21.15.138:0/512538638 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76bc0c7ce0 con 0x7f76bc15f2b0 2024-04-26T20:58:52.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.063+0000 7f76c2600640 1 -- 172.21.15.138:0/512538638 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76bc069430 con 0x7f76bc15f2b0 2024-04-26T20:58:52.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.067+0000 7f76b8c00640 1 -- 172.21.15.138:0/512538638 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f76b401a070 con 0x7f76bc15f2b0 2024-04-26T20:58:52.068 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.067+0000 7f76b8c00640 1 --2- 172.21.15.138:0/512538638 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f769c0683b0 0x7f769c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:52.068 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.067+0000 7f76b8c00640 1 -- 172.21.15.138:0/512538638 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5421+0+0 (secure 0 0 0) 0x7f76b40866a0 con 0x7f76bc15f2b0 2024-04-26T20:58:52.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.067+0000 7f76c1200640 1 --2- 172.21.15.138:0/512538638 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f769c0683b0 0x7f769c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:52.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.067+0000 7f76c1200640 1 --2- 172.21.15.138:0/512538638 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f769c0683b0 0x7f769c06a870 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f76b00011f0 tx=0x7f76b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:52.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.071+0000 7f76b8c00640 1 -- 172.21.15.138:0/512538638 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f76b4056720 con 0x7f76bc15f2b0 2024-04-26T20:58:52.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.231+0000 7f76c2600640 1 -- 172.21.15.138:0/512538638 --> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f76bc0c8450 con 0x7f769c0683b0 2024-04-26T20:58:52.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.231+0000 7f76b8c00640 1 -- 172.21.15.138:0/512538638 <== mgr.4100 v2:172.21.15.143:6832/4275464198 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f76bc0c8450 con 0x7f769c0683b0 2024-04-26T20:58:52.232 INFO:teuthology.orchestra.run.smithi138.stderr:instructed osd(s) 3 to deep-scrub 2024-04-26T20:58:52.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.231+0000 7f76c2600640 1 -- 172.21.15.138:0/512538638 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f769c0683b0 msgr2=0x7f769c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:52.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.231+0000 7f76c2600640 1 --2- 172.21.15.138:0/512538638 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f769c0683b0 0x7f769c06a870 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f76b00011f0 tx=0x7f76b0009040 comp rx=0 tx=0).stop 2024-04-26T20:58:52.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.231+0000 7f76c2600640 1 -- 172.21.15.138:0/512538638 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f76bc15f2b0 msgr2=0x7f76bc0c87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:52.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.231+0000 7f76c2600640 1 --2- 172.21.15.138:0/512538638 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f76bc15f2b0 0x7f76bc0c87c0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f76b400cc30 tx=0x7f76b400a430 comp rx=0 tx=0).stop 2024-04-26T20:58:52.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.231+0000 7f76c2600640 1 -- 172.21.15.138:0/512538638 shutdown_connections 2024-04-26T20:58:52.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.231+0000 7f76c2600640 1 --2- 172.21.15.138:0/512538638 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f769c0683b0 0x7f769c06a870 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:52.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.231+0000 7f76c2600640 1 --2- 172.21.15.138:0/512538638 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f76bc15f2b0 0x7f76bc0c87c0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:52.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.231+0000 7f76c2600640 1 --2- 172.21.15.138:0/512538638 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f76bc0d37d0 0x7f76bc06e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:52.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.231+0000 7f76c2600640 1 --2- 172.21.15.138:0/512538638 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f76bc0cda50 0x7f76bc14e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:52.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.231+0000 7f76c2600640 1 -- 172.21.15.138:0/512538638 >> 172.21.15.138:0/512538638 conn(0x7f76bc0d2bd0 msgr2=0x7f76bc1572b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:52.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.231+0000 7f76c2600640 1 -- 172.21.15.138:0/512538638 shutdown_connections 2024-04-26T20:58:52.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.231+0000 7f76c2600640 1 -- 172.21.15.138:0/512538638 wait complete. 2024-04-26T20:58:52.254 INFO:tasks.ceph:Scrubbing osd.4 2024-04-26T20:58:52.254 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-26T20:58:52.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.391+0000 7f8568800640 1 Processor -- start 2024-04-26T20:58:52.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.391+0000 7f8568800640 1 -- start start 2024-04-26T20:58:52.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.391+0000 7f8568800640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f85600cc2e0 0x7f8560073e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:52.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.395+0000 7f8568800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f856015c020 0x7f85600ce720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:52.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.395+0000 7f8568800640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f856006e1a0 con 0x7f856015bc40 2024-04-26T20:58:52.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.395+0000 7f8568800640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f856006e480 con 0x7f856015c020 2024-04-26T20:58:52.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.395+0000 7f8568800640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f8560073380 con 0x7f85600cc2e0 2024-04-26T20:58:52.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.395+0000 7f8566800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f856015c020 0x7f85600ce720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:52.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.395+0000 7f8565e00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f856015bc40 0x7f85600cbbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:60092/0 (socket says 172.21.15.138:60092) 2024-04-26T20:58:52.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.395+0000 7f8566800640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f856015c020 0x7f85600ce720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:48024/0 (socket says 172.21.15.138:48024) 2024-04-26T20:58:52.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.395+0000 7f8565e00640 1 -- 172.21.15.138:0/1944918791 learned_addr learned my addr 172.21.15.138:0/1944918791 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:52.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.395+0000 7f8565400640 1 --2- 172.21.15.138:0/1944918791 >> v2:172.21.15.143:3300/0 conn(0x7f85600cc2e0 0x7f8560073e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:52.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.395+0000 7f8566800640 1 -- 172.21.15.138:0/1944918791 >> v2:172.21.15.143:3300/0 conn(0x7f85600cc2e0 msgr2=0x7f8560073e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:52.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.395+0000 7f8566800640 1 --2- 172.21.15.138:0/1944918791 >> v2:172.21.15.143:3300/0 conn(0x7f85600cc2e0 0x7f8560073e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:52.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.395+0000 7f8566800640 1 -- 172.21.15.138:0/1944918791 >> v1:172.21.15.138:6789/0 conn(0x7f856015bc40 legacy=0x7f85600cbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:52.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.395+0000 7f8566800640 1 -- 172.21.15.138:0/1944918791 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8560073660 con 0x7f856015c020 2024-04-26T20:58:52.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.395+0000 7f8564a00640 1 -- 172.21.15.138:0/1944918791 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2313984536 0 0) 0x7f856006e1a0 con 0x7f856015bc40 2024-04-26T20:58:52.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.395+0000 7f8565400640 1 --2- 172.21.15.138:0/1944918791 >> v2:172.21.15.143:3300/0 conn(0x7f85600cc2e0 0x7f8560073e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:58:52.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.395+0000 7f8566800640 1 --2- 172.21.15.138:0/1944918791 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f856015c020 0x7f85600ce720 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f856006d790 tx=0x7f855c01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1570ea17fa6e4a95 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:52.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.395+0000 7f8564a00640 1 -- 172.21.15.138:0/1944918791 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855c0b2070 con 0x7f856015c020 2024-04-26T20:58:52.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.395+0000 7f8564a00640 1 -- 172.21.15.138:0/1944918791 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f855c0a5900 con 0x7f856015c020 2024-04-26T20:58:52.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.395+0000 7f8564a00640 1 -- 172.21.15.138:0/1944918791 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855c0a5cd0 con 0x7f856015c020 2024-04-26T20:58:52.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.399+0000 7f8568800640 1 -- 172.21.15.138:0/1944918791 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f856015c020 msgr2=0x7f85600ce720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:52.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.399+0000 7f8568800640 1 --2- 172.21.15.138:0/1944918791 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f856015c020 0x7f85600ce720 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f856006d790 tx=0x7f855c01c930 comp rx=0 tx=0).stop 2024-04-26T20:58:52.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.399+0000 7f8568800640 1 -- 172.21.15.138:0/1944918791 shutdown_connections 2024-04-26T20:58:52.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.399+0000 7f8568800640 1 --2- 172.21.15.138:0/1944918791 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f856015c020 0x7f85600ce720 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:52.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.399+0000 7f8568800640 1 --2- 172.21.15.138:0/1944918791 >> v2:172.21.15.143:3300/0 conn(0x7f85600cc2e0 0x7f8560073e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:52.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.399+0000 7f8568800640 1 -- 172.21.15.138:0/1944918791 >> 172.21.15.138:0/1944918791 conn(0x7f85600d0b50 msgr2=0x7f85600d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:52.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.399+0000 7f8568800640 1 -- 172.21.15.138:0/1944918791 shutdown_connections 2024-04-26T20:58:52.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.399+0000 7f8568800640 1 -- 172.21.15.138:0/1944918791 wait complete. 2024-04-26T20:58:52.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.399+0000 7f8568800640 1 Processor -- start 2024-04-26T20:58:52.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.399+0000 7f8568800640 1 -- start start 2024-04-26T20:58:52.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.399+0000 7f8568800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85600cc2e0 0x7f85600c9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:52.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.399+0000 7f8568800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f856015bc40 0x7f856015acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:52.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.399+0000 7f8568800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f856015c020 0x7f8560153090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:52.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.399+0000 7f8568800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f856006e860 con 0x7f85600cc2e0 2024-04-26T20:58:52.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.399+0000 7f8568800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f856006e6e0 con 0x7f856015c020 2024-04-26T20:58:52.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.399+0000 7f8568800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f856006e9e0 con 0x7f856015bc40 2024-04-26T20:58:52.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.399+0000 7f8565e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85600cc2e0 0x7f85600c9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:52.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.399+0000 7f8565e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85600cc2e0 0x7f85600c9510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:48026/0 (socket says 172.21.15.138:48026) 2024-04-26T20:58:52.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.399+0000 7f8565e00640 1 -- 172.21.15.138:0/2444383965 learned_addr learned my addr 172.21.15.138:0/2444383965 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:52.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.399+0000 7f8566800640 1 --2- 172.21.15.138:0/2444383965 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f856015c020 0x7f8560153090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:52.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.399+0000 7f8565400640 1 --2- 172.21.15.138:0/2444383965 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f856015bc40 0x7f856015acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:52.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.399+0000 7f8565e00640 1 -- 172.21.15.138:0/2444383965 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f856015bc40 msgr2=0x7f856015acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:52.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.399+0000 7f8565e00640 1 --2- 172.21.15.138:0/2444383965 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f856015bc40 0x7f856015acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:52.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.399+0000 7f8565e00640 1 -- 172.21.15.138:0/2444383965 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f856015c020 msgr2=0x7f8560153090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:52.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.399+0000 7f8565e00640 1 --2- 172.21.15.138:0/2444383965 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f856015c020 0x7f8560153090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:52.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.399+0000 7f8565e00640 1 -- 172.21.15.138:0/2444383965 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f856015b1f0 con 0x7f85600cc2e0 2024-04-26T20:58:52.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.399+0000 7f8565400640 1 --2- 172.21.15.138:0/2444383965 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f856015bc40 0x7f856015acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:58:52.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.403+0000 7f8565e00640 1 --2- 172.21.15.138:0/2444383965 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85600cc2e0 0x7f85600c9510 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f85540011f0 tx=0x7f855400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:52.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.403+0000 7f855a000640 1 -- 172.21.15.138:0/2444383965 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8554018070 con 0x7f85600cc2e0 2024-04-26T20:58:52.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.403+0000 7f855a000640 1 -- 172.21.15.138:0/2444383965 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85540074e0 con 0x7f85600cc2e0 2024-04-26T20:58:52.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.403+0000 7f8568800640 1 -- 172.21.15.138:0/2444383965 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85601fbd30 con 0x7f85600cc2e0 2024-04-26T20:58:52.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.403+0000 7f855a000640 1 -- 172.21.15.138:0/2444383965 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8554004a10 con 0x7f85600cc2e0 2024-04-26T20:58:52.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.403+0000 7f8568800640 1 -- 172.21.15.138:0/2444383965 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85601fbff0 con 0x7f85600cc2e0 2024-04-26T20:58:52.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.403+0000 7f8568800640 1 -- 172.21.15.138:0/2444383965 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8560069510 con 0x7f85600cc2e0 2024-04-26T20:58:52.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.403+0000 7f855a000640 1 -- 172.21.15.138:0/2444383965 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f855401b070 con 0x7f85600cc2e0 2024-04-26T20:58:52.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.403+0000 7f855a000640 1 --2- 172.21.15.138:0/2444383965 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f85440683b0 0x7f854406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:52.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.403+0000 7f855a000640 1 -- 172.21.15.138:0/2444383965 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5421+0+0 (secure 0 0 0) 0x7f8554085b70 con 0x7f85600cc2e0 2024-04-26T20:58:52.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.403+0000 7f855a000640 1 --2- 172.21.15.138:0/2444383965 >> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] conn(0x7f854406e8f0 0x7f8544070d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:52.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.403+0000 7f855a000640 1 -- 172.21.15.138:0/2444383965 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8544071400 con 0x7f854406e8f0 2024-04-26T20:58:52.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.403+0000 7f855a000640 1 -- 172.21.15.138:0/2444383965 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f855408a2a0 con 0x7f85600cc2e0 2024-04-26T20:58:52.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.403+0000 7f8565400640 1 --2- 172.21.15.138:0/2444383965 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f85440683b0 0x7f854406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:52.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.403+0000 7f8566800640 1 --2- 172.21.15.138:0/2444383965 >> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] conn(0x7f854406e8f0 0x7f8544070d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:52.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.407+0000 7f8565400640 1 --2- 172.21.15.138:0/2444383965 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f85440683b0 0x7f854406a870 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f85601fbc90 tx=0x7f8550008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:52.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.407+0000 7f8566800640 1 --2- 172.21.15.138:0/2444383965 >> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] conn(0x7f854406e8f0 0x7f8544070d30 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:52.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.407+0000 7f855a000640 1 -- 172.21.15.138:0/2444383965 <== osd.4 v2:172.21.15.143:6800/2942056312 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8544071400 con 0x7f854406e8f0 2024-04-26T20:58:52.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.419+0000 7f8568800640 1 -- 172.21.15.138:0/2444383965 --> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8560073e60 con 0x7f854406e8f0 2024-04-26T20:58:52.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.419+0000 7f855a000640 1 -- 172.21.15.138:0/2444383965 <== osd.4 v2:172.21.15.143:6800/2942056312 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f8560073e60 con 0x7f854406e8f0 2024-04-26T20:58:52.422 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-26T20:58:52.422 INFO:teuthology.orchestra.run.smithi138.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T20:58:52.422 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-26T20:58:52.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.419+0000 7f8568800640 1 -- 172.21.15.138:0/2444383965 >> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] conn(0x7f854406e8f0 msgr2=0x7f8544070d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:52.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.419+0000 7f8568800640 1 --2- 172.21.15.138:0/2444383965 >> [v2:172.21.15.143:6800/2942056312,v1:172.21.15.143:6801/2942056312] conn(0x7f854406e8f0 0x7f8544070d30 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:52.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.419+0000 7f8568800640 1 -- 172.21.15.138:0/2444383965 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f85440683b0 msgr2=0x7f854406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:52.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.419+0000 7f8568800640 1 --2- 172.21.15.138:0/2444383965 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f85440683b0 0x7f854406a870 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f85601fbc90 tx=0x7f8550008040 comp rx=0 tx=0).stop 2024-04-26T20:58:52.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.419+0000 7f8568800640 1 -- 172.21.15.138:0/2444383965 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85600cc2e0 msgr2=0x7f85600c9510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:52.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.419+0000 7f8568800640 1 --2- 172.21.15.138:0/2444383965 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85600cc2e0 0x7f85600c9510 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f85540011f0 tx=0x7f855400c9b0 comp rx=0 tx=0).stop 2024-04-26T20:58:52.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.419+0000 7f8566800640 1 -- 172.21.15.138:0/2444383965 reap_dead start 2024-04-26T20:58:52.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.419+0000 7f8568800640 1 -- 172.21.15.138:0/2444383965 shutdown_connections 2024-04-26T20:58:52.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.419+0000 7f8568800640 1 -- 172.21.15.138:0/2444383965 >> 172.21.15.138:0/2444383965 conn(0x7f85600d0b50 msgr2=0x7f85600d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:52.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.419+0000 7f8568800640 1 -- 172.21.15.138:0/2444383965 shutdown_connections 2024-04-26T20:58:52.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.419+0000 7f8568800640 1 -- 172.21.15.138:0/2444383965 wait complete. 2024-04-26T20:58:52.440 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-26T20:58:52.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.575+0000 7f1f4c200640 1 Processor -- start 2024-04-26T20:58:52.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.575+0000 7f1f4c200640 1 -- start start 2024-04-26T20:58:52.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.575+0000 7f1f4c200640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1f440cbe00 0x7f1f4406de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:52.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.575+0000 7f1f4c200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1f440cc1e0 0x7f1f44073b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:52.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.575+0000 7f1f4c200640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f1f440ce6f0 0x7f1f440ceb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:52.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.575+0000 7f1f4c200640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f1f44073680 con 0x7f1f440ce6f0 2024-04-26T20:58:52.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.575+0000 7f1f4c200640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f1f440727f0 con 0x7f1f440cbe00 2024-04-26T20:58:52.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.575+0000 7f1f4c200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f1f44072a70 con 0x7f1f440cc1e0 2024-04-26T20:58:52.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.575+0000 7f1f4a200640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f1f440ce6f0 0x7f1f440ceb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:52.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.575+0000 7f1f4a200640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f1f440ce6f0 0x7f1f440ceb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:48040/0 (socket says 172.21.15.138:48040) 2024-04-26T20:58:52.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.575+0000 7f1f4a200640 1 -- 172.21.15.138:0/1367858935 learned_addr learned my addr 172.21.15.138:0/1367858935 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:52.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.575+0000 7f1f49800640 1 --2- 172.21.15.138:0/1367858935 >> v2:172.21.15.143:3300/0 conn(0x7f1f440cbe00 0x7f1f4406de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:52.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.575+0000 7f1f48e00640 1 --2- 172.21.15.138:0/1367858935 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1f440cc1e0 0x7f1f44073b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:52.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.575+0000 7f1f4a200640 1 -- 172.21.15.138:0/1367858935 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1f440cc1e0 msgr2=0x7f1f44073b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:52.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.575+0000 7f1f4a200640 1 --2- 172.21.15.138:0/1367858935 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1f440cc1e0 0x7f1f44073b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:52.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.575+0000 7f1f4a200640 1 -- 172.21.15.138:0/1367858935 >> v2:172.21.15.143:3300/0 conn(0x7f1f440cbe00 msgr2=0x7f1f4406de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:52.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.575+0000 7f1f4a200640 1 --2- 172.21.15.138:0/1367858935 >> v2:172.21.15.143:3300/0 conn(0x7f1f440cbe00 0x7f1f4406de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:52.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.575+0000 7f1f4a200640 1 -- 172.21.15.138:0/1367858935 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f44072d50 con 0x7f1f440ce6f0 2024-04-26T20:58:52.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.579+0000 7f1f4a200640 1 --2- 172.21.15.138:0/1367858935 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1f440ce6f0 0x7f1f440ceb80 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f1f44074a70 tx=0x7f1f3c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eda6cde30dbc24e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:52.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.579+0000 7f1f43e00640 1 -- 172.21.15.138:0/1367858935 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c0b0070 con 0x7f1f440ce6f0 2024-04-26T20:58:52.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.579+0000 7f1f43e00640 1 -- 172.21.15.138:0/1367858935 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f3c0ab600 con 0x7f1f440ce6f0 2024-04-26T20:58:52.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.579+0000 7f1f43e00640 1 -- 172.21.15.138:0/1367858935 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c0ab9d0 con 0x7f1f440ce6f0 2024-04-26T20:58:52.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.579+0000 7f1f4c200640 1 -- 172.21.15.138:0/1367858935 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1f440ce6f0 msgr2=0x7f1f440ceb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:52.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.579+0000 7f1f4c200640 1 --2- 172.21.15.138:0/1367858935 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1f440ce6f0 0x7f1f440ceb80 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f1f44074a70 tx=0x7f1f3c01c520 comp rx=0 tx=0).stop 2024-04-26T20:58:52.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.579+0000 7f1f4c200640 1 -- 172.21.15.138:0/1367858935 shutdown_connections 2024-04-26T20:58:52.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.579+0000 7f1f4c200640 1 --2- 172.21.15.138:0/1367858935 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1f440ce6f0 0x7f1f440ceb80 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:52.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.579+0000 7f1f4c200640 1 --2- 172.21.15.138:0/1367858935 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1f440cc1e0 0x7f1f44073b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:52.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.579+0000 7f1f4c200640 1 --2- 172.21.15.138:0/1367858935 >> v2:172.21.15.143:3300/0 conn(0x7f1f440cbe00 0x7f1f4406de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:52.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.579+0000 7f1f4c200640 1 -- 172.21.15.138:0/1367858935 >> 172.21.15.138:0/1367858935 conn(0x7f1f440d0b20 msgr2=0x7f1f440d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:52.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.579+0000 7f1f4c200640 1 -- 172.21.15.138:0/1367858935 shutdown_connections 2024-04-26T20:58:52.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.579+0000 7f1f4c200640 1 -- 172.21.15.138:0/1367858935 wait complete. 2024-04-26T20:58:52.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.583+0000 7f1f4c200640 1 Processor -- start 2024-04-26T20:58:52.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.583+0000 7f1f4c200640 1 -- start start 2024-04-26T20:58:52.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.583+0000 7f1f4c200640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1f440cbe00 0x7f1f440c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:52.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.583+0000 7f1f4c200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f440cc1e0 0x7f1f44156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:52.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.583+0000 7f1f4c200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1f440ce6f0 0x7f1f440c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:52.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.583+0000 7f1f4c200640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f1f4406e530 con 0x7f1f440cbe00 2024-04-26T20:58:52.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.583+0000 7f1f4c200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f1f4406e3b0 con 0x7f1f440cc1e0 2024-04-26T20:58:52.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.583+0000 7f1f4c200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f1f44074050 con 0x7f1f440ce6f0 2024-04-26T20:58:52.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.583+0000 7f1f49800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1f440cbe00 0x7f1f440c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:52.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.583+0000 7f1f49800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1f440cbe00 0x7f1f440c91c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:48048/0 (socket says 172.21.15.138:48048) 2024-04-26T20:58:52.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.583+0000 7f1f49800640 1 -- 172.21.15.138:0/3740866675 learned_addr learned my addr 172.21.15.138:0/3740866675 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:52.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.583+0000 7f1f48e00640 1 --2- 172.21.15.138:0/3740866675 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f440cc1e0 0x7f1f44156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:52.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.583+0000 7f1f4a200640 1 --2- 172.21.15.138:0/3740866675 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1f440ce6f0 0x7f1f440c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:52.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.583+0000 7f1f49800640 1 -- 172.21.15.138:0/3740866675 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1f440ce6f0 msgr2=0x7f1f440c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:52.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.583+0000 7f1f49800640 1 --2- 172.21.15.138:0/3740866675 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1f440ce6f0 0x7f1f440c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:52.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.583+0000 7f1f49800640 1 -- 172.21.15.138:0/3740866675 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f440cc1e0 msgr2=0x7f1f44156170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:52.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.583+0000 7f1f49800640 1 --2- 172.21.15.138:0/3740866675 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f440cc1e0 0x7f1f44156170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:52.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.583+0000 7f1f49800640 1 -- 172.21.15.138:0/3740866675 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f440c8120 con 0x7f1f440cbe00 2024-04-26T20:58:52.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.583+0000 7f1f48e00640 1 --2- 172.21.15.138:0/3740866675 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f440cc1e0 0x7f1f44156170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:58:52.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.583+0000 7f1f49800640 1 --2- 172.21.15.138:0/3740866675 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1f440cbe00 0x7f1f440c91c0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f1f38007e60 tx=0x7f1f3800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:52.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.583+0000 7f1f41600640 1 -- 172.21.15.138:0/3740866675 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f38014620 con 0x7f1f440cbe00 2024-04-26T20:58:52.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.583+0000 7f1f41600640 1 -- 172.21.15.138:0/3740866675 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f38019070 con 0x7f1f440cbe00 2024-04-26T20:58:52.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.583+0000 7f1f41600640 1 -- 172.21.15.138:0/3740866675 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f38014a00 con 0x7f1f440cbe00 2024-04-26T20:58:52.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.583+0000 7f1f4c200640 1 -- 172.21.15.138:0/3740866675 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f440c8400 con 0x7f1f440cbe00 2024-04-26T20:58:52.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.583+0000 7f1f4c200640 1 -- 172.21.15.138:0/3740866675 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f440c89c0 con 0x7f1f440cbe00 2024-04-26T20:58:52.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.583+0000 7f1f4c200640 1 -- 172.21.15.138:0/3740866675 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f44069510 con 0x7f1f440cbe00 2024-04-26T20:58:52.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.587+0000 7f1f41600640 1 -- 172.21.15.138:0/3740866675 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1f38014ba0 con 0x7f1f440cbe00 2024-04-26T20:58:52.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.587+0000 7f1f41600640 1 --2- 172.21.15.138:0/3740866675 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1f24068380 0x7f1f2406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:52.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.587+0000 7f1f41600640 1 -- 172.21.15.138:0/3740866675 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5421+0+0 (secure 0 0 0) 0x7f1f380871d0 con 0x7f1f440cbe00 2024-04-26T20:58:52.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.587+0000 7f1f48e00640 1 --2- 172.21.15.138:0/3740866675 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1f24068380 0x7f1f2406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:52.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.587+0000 7f1f48e00640 1 --2- 172.21.15.138:0/3740866675 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1f24068380 0x7f1f2406a840 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1f440ca170 tx=0x7f1f30008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:52.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.591+0000 7f1f41600640 1 -- 172.21.15.138:0/3740866675 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1f38057810 con 0x7f1f440cbe00 2024-04-26T20:58:52.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.747+0000 7f1f4c200640 1 -- 172.21.15.138:0/3740866675 --> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f1f441566b0 con 0x7f1f24068380 2024-04-26T20:58:52.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.747+0000 7f1f41600640 1 -- 172.21.15.138:0/3740866675 <== mgr.4100 v2:172.21.15.143:6832/4275464198 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f1f441566b0 con 0x7f1f24068380 2024-04-26T20:58:52.749 INFO:teuthology.orchestra.run.smithi138.stderr:instructed osd(s) 4 to deep-scrub 2024-04-26T20:58:52.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.751+0000 7f1f4c200640 1 -- 172.21.15.138:0/3740866675 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1f24068380 msgr2=0x7f1f2406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:52.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.751+0000 7f1f4c200640 1 --2- 172.21.15.138:0/3740866675 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1f24068380 0x7f1f2406a840 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1f440ca170 tx=0x7f1f30008040 comp rx=0 tx=0).stop 2024-04-26T20:58:52.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.751+0000 7f1f4c200640 1 -- 172.21.15.138:0/3740866675 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1f440cbe00 msgr2=0x7f1f440c91c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:52.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.751+0000 7f1f4c200640 1 --2- 172.21.15.138:0/3740866675 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1f440cbe00 0x7f1f440c91c0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f1f38007e60 tx=0x7f1f3800e4b0 comp rx=0 tx=0).stop 2024-04-26T20:58:52.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.751+0000 7f1f4c200640 1 -- 172.21.15.138:0/3740866675 shutdown_connections 2024-04-26T20:58:52.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.751+0000 7f1f4c200640 1 --2- 172.21.15.138:0/3740866675 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1f24068380 0x7f1f2406a840 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:52.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.751+0000 7f1f4c200640 1 --2- 172.21.15.138:0/3740866675 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1f440ce6f0 0x7f1f440c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:52.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.751+0000 7f1f4c200640 1 --2- 172.21.15.138:0/3740866675 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f440cc1e0 0x7f1f44156170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:52.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.751+0000 7f1f4c200640 1 --2- 172.21.15.138:0/3740866675 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1f440cbe00 0x7f1f440c91c0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:52.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.751+0000 7f1f4c200640 1 -- 172.21.15.138:0/3740866675 >> 172.21.15.138:0/3740866675 conn(0x7f1f440d0b20 msgr2=0x7f1f44158950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:52.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.751+0000 7f1f4c200640 1 -- 172.21.15.138:0/3740866675 shutdown_connections 2024-04-26T20:58:52.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.751+0000 7f1f4c200640 1 -- 172.21.15.138:0/3740866675 wait complete. 2024-04-26T20:58:52.770 INFO:tasks.ceph:Scrubbing osd.5 2024-04-26T20:58:52.770 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-26T20:58:52.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.907+0000 7f191dc00640 1 Processor -- start 2024-04-26T20:58:52.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.907+0000 7f191dc00640 1 -- start start 2024-04-26T20:58:52.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.911+0000 7f191dc00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f191815bc40 0x7f1918073e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:52.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.911+0000 7f191dc00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f191815c020 0x7f19180cbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:52.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.911+0000 7f191dc00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f191806e1a0 con 0x7f19180cb1a0 2024-04-26T20:58:52.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.911+0000 7f191dc00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f191806e480 con 0x7f191815bc40 2024-04-26T20:58:52.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.911+0000 7f191dc00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f1918073380 con 0x7f191815c020 2024-04-26T20:58:52.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.911+0000 7f1916a00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f191815bc40 0x7f1918073e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:52.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.911+0000 7f1916a00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f191815bc40 0x7f1918073e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:48052/0 (socket says 172.21.15.138:48052) 2024-04-26T20:58:52.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.911+0000 7f1916a00640 1 -- 172.21.15.138:0/1019016325 learned_addr learned my addr 172.21.15.138:0/1019016325 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:52.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.911+0000 7f190e000640 1 --2- 172.21.15.138:0/1019016325 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f191815c020 0x7f19180cbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:52.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.911+0000 7f1916a00640 1 -- 172.21.15.138:0/1019016325 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f191815c020 msgr2=0x7f19180cbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:52.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.911+0000 7f1916a00640 1 --2- 172.21.15.138:0/1019016325 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f191815c020 0x7f19180cbbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:52.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.911+0000 7f1916a00640 1 -- 172.21.15.138:0/1019016325 >> v1:172.21.15.143:6789/0 conn(0x7f19180cb1a0 legacy=0x7f19180ce720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:52.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.911+0000 7f1916a00640 1 -- 172.21.15.138:0/1019016325 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1918073660 con 0x7f191815bc40 2024-04-26T20:58:52.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.915+0000 7f1916a00640 1 --2- 172.21.15.138:0/1019016325 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f191815bc40 0x7f1918073e60 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f1908009870 tx=0x7f190801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f40b3bdbcae4ae0f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:52.916 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.915+0000 7f1916000640 1 -- 172.21.15.138:0/1019016325 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19080ab5f0 con 0x7f191815bc40 2024-04-26T20:58:52.916 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.915+0000 7f1916000640 1 -- 172.21.15.138:0/1019016325 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19080b0070 con 0x7f191815bc40 2024-04-26T20:58:52.916 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.915+0000 7f1916000640 1 -- 172.21.15.138:0/1019016325 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19080ab9b0 con 0x7f191815bc40 2024-04-26T20:58:52.916 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.915+0000 7f191dc00640 1 -- 172.21.15.138:0/1019016325 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f191815bc40 msgr2=0x7f1918073e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:52.916 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.915+0000 7f191dc00640 1 --2- 172.21.15.138:0/1019016325 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f191815bc40 0x7f1918073e60 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f1908009870 tx=0x7f190801c520 comp rx=0 tx=0).stop 2024-04-26T20:58:52.916 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.915+0000 7f191dc00640 1 -- 172.21.15.138:0/1019016325 shutdown_connections 2024-04-26T20:58:52.916 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.915+0000 7f191dc00640 1 --2- 172.21.15.138:0/1019016325 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f191815c020 0x7f19180cbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:52.916 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.915+0000 7f191dc00640 1 --2- 172.21.15.138:0/1019016325 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f191815bc40 0x7f1918073e60 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:52.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.915+0000 7f191dc00640 1 -- 172.21.15.138:0/1019016325 >> 172.21.15.138:0/1019016325 conn(0x7f19180d0b50 msgr2=0x7f19180d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:52.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.915+0000 7f191dc00640 1 -- 172.21.15.138:0/1019016325 shutdown_connections 2024-04-26T20:58:52.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.915+0000 7f191dc00640 1 -- 172.21.15.138:0/1019016325 wait complete. 2024-04-26T20:58:52.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.915+0000 7f191dc00640 1 Processor -- start 2024-04-26T20:58:52.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.915+0000 7f191dc00640 1 -- start start 2024-04-26T20:58:52.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.915+0000 7f191dc00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19180cb1a0 0x7f1918151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:52.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.915+0000 7f191dc00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f191815bc40 0x7f19181579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:52.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.915+0000 7f191dc00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f191815c020 0x7f1918157f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:52.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.915+0000 7f191dc00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f1918168f30 con 0x7f19180cb1a0 2024-04-26T20:58:52.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.915+0000 7f191dc00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f19180cc520 con 0x7f191815bc40 2024-04-26T20:58:52.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.915+0000 7f191dc00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f19181690b0 con 0x7f191815c020 2024-04-26T20:58:52.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.915+0000 7f1916a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19180cb1a0 0x7f1918151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:52.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.919+0000 7f1916a00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19180cb1a0 0x7f1918151ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:48058/0 (socket says 172.21.15.138:48058) 2024-04-26T20:58:52.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.919+0000 7f1916a00640 1 -- 172.21.15.138:0/4057476801 learned_addr learned my addr 172.21.15.138:0/4057476801 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:52.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.919+0000 7f190e000640 1 --2- 172.21.15.138:0/4057476801 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f191815bc40 0x7f19181579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:52.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.919+0000 7f1917400640 1 --2- 172.21.15.138:0/4057476801 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f191815c020 0x7f1918157f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:52.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.919+0000 7f1916a00640 1 -- 172.21.15.138:0/4057476801 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f191815c020 msgr2=0x7f1918157f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:52.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.919+0000 7f1916a00640 1 --2- 172.21.15.138:0/4057476801 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f191815c020 0x7f1918157f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:52.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.919+0000 7f1916a00640 1 -- 172.21.15.138:0/4057476801 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f191815bc40 msgr2=0x7f19181579c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:52.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.919+0000 7f1916a00640 1 --2- 172.21.15.138:0/4057476801 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f191815bc40 0x7f19181579c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:52.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.919+0000 7f1916a00640 1 -- 172.21.15.138:0/4057476801 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1918152400 con 0x7f19180cb1a0 2024-04-26T20:58:52.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.919+0000 7f1916a00640 1 --2- 172.21.15.138:0/4057476801 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19180cb1a0 0x7f1918151ec0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f190801abd0 tx=0x7f190801ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:52.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.919+0000 7f190f400640 1 -- 172.21.15.138:0/4057476801 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19080abe60 con 0x7f19180cb1a0 2024-04-26T20:58:52.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.919+0000 7f190f400640 1 -- 172.21.15.138:0/4057476801 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19080be610 con 0x7f19180cb1a0 2024-04-26T20:58:52.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.919+0000 7f190f400640 1 -- 172.21.15.138:0/4057476801 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19080bea00 con 0x7f19180cb1a0 2024-04-26T20:58:52.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.919+0000 7f191dc00640 1 -- 172.21.15.138:0/4057476801 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1918158580 con 0x7f19180cb1a0 2024-04-26T20:58:52.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.919+0000 7f191dc00640 1 -- 172.21.15.138:0/4057476801 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1918158b40 con 0x7f19180cb1a0 2024-04-26T20:58:52.922 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.919+0000 7f191dc00640 1 -- 172.21.15.138:0/4057476801 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1918069510 con 0x7f19180cb1a0 2024-04-26T20:58:52.922 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.919+0000 7f190f400640 1 -- 172.21.15.138:0/4057476801 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f19080b43f0 con 0x7f19180cb1a0 2024-04-26T20:58:52.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.919+0000 7f190f400640 1 --2- 172.21.15.138:0/4057476801 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f18f4068380 0x7f18f406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:52.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.923+0000 7f190f400640 1 -- 172.21.15.138:0/4057476801 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5421+0+0 (secure 0 0 0) 0x7f1908120f70 con 0x7f19180cb1a0 2024-04-26T20:58:52.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.923+0000 7f190f400640 1 --2- 172.21.15.138:0/4057476801 >> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] conn(0x7f18f406e8c0 0x7f18f4070d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:52.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.923+0000 7f190f400640 1 -- 172.21.15.138:0/4057476801 --> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f18f40713d0 con 0x7f18f406e8c0 2024-04-26T20:58:52.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.923+0000 7f190f400640 1 -- 172.21.15.138:0/4057476801 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f1908121320 con 0x7f19180cb1a0 2024-04-26T20:58:52.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.923+0000 7f190e000640 1 --2- 172.21.15.138:0/4057476801 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f18f4068380 0x7f18f406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:52.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.923+0000 7f1917400640 1 --2- 172.21.15.138:0/4057476801 >> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] conn(0x7f18f406e8c0 0x7f18f4070d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:52.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.923+0000 7f190e000640 1 --2- 172.21.15.138:0/4057476801 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f18f4068380 0x7f18f406a840 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f19180c4530 tx=0x7f1900008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:52.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.923+0000 7f1917400640 1 --2- 172.21.15.138:0/4057476801 >> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] conn(0x7f18f406e8c0 0x7f18f4070d00 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:52.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.923+0000 7f190f400640 1 -- 172.21.15.138:0/4057476801 <== osd.5 v2:172.21.15.143:6808/1910222887 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f18f40713d0 con 0x7f18f406e8c0 2024-04-26T20:58:52.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.935+0000 7f191dc00640 1 -- 172.21.15.138:0/4057476801 --> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f19180d1910 con 0x7f18f406e8c0 2024-04-26T20:58:52.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.935+0000 7f190f400640 1 -- 172.21.15.138:0/4057476801 <== osd.5 v2:172.21.15.143:6808/1910222887 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f19180d1910 con 0x7f18f406e8c0 2024-04-26T20:58:52.938 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-26T20:58:52.939 INFO:teuthology.orchestra.run.smithi138.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T20:58:52.939 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-26T20:58:52.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.935+0000 7f191dc00640 1 -- 172.21.15.138:0/4057476801 >> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] conn(0x7f18f406e8c0 msgr2=0x7f18f4070d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:52.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.935+0000 7f191dc00640 1 --2- 172.21.15.138:0/4057476801 >> [v2:172.21.15.143:6808/1910222887,v1:172.21.15.143:6809/1910222887] conn(0x7f18f406e8c0 0x7f18f4070d00 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:52.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.935+0000 7f191dc00640 1 -- 172.21.15.138:0/4057476801 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f18f4068380 msgr2=0x7f18f406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:52.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.935+0000 7f191dc00640 1 --2- 172.21.15.138:0/4057476801 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f18f4068380 0x7f18f406a840 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f19180c4530 tx=0x7f1900008040 comp rx=0 tx=0).stop 2024-04-26T20:58:52.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.935+0000 7f191dc00640 1 -- 172.21.15.138:0/4057476801 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19180cb1a0 msgr2=0x7f1918151ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:52.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.935+0000 7f191dc00640 1 --2- 172.21.15.138:0/4057476801 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19180cb1a0 0x7f1918151ec0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f190801abd0 tx=0x7f190801ad60 comp rx=0 tx=0).stop 2024-04-26T20:58:52.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.935+0000 7f1917400640 1 -- 172.21.15.138:0/4057476801 reap_dead start 2024-04-26T20:58:52.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.935+0000 7f191dc00640 1 -- 172.21.15.138:0/4057476801 shutdown_connections 2024-04-26T20:58:52.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.935+0000 7f191dc00640 1 -- 172.21.15.138:0/4057476801 >> 172.21.15.138:0/4057476801 conn(0x7f19180d0b50 msgr2=0x7f19180c6890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:52.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.939+0000 7f191dc00640 1 -- 172.21.15.138:0/4057476801 shutdown_connections 2024-04-26T20:58:52.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:52.939+0000 7f191dc00640 1 -- 172.21.15.138:0/4057476801 wait complete. 2024-04-26T20:58:52.956 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-26T20:58:53.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.091+0000 7fb46f000640 1 Processor -- start 2024-04-26T20:58:53.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.091+0000 7fb46f000640 1 -- start start 2024-04-26T20:58:53.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.091+0000 7fb46f000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb4680cbe00 0x7fb46806de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:53.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.091+0000 7fb46f000640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4680727f0 con 0x7fb4680cc1e0 2024-04-26T20:58:53.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.091+0000 7fb46f000640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb468072a70 con 0x7fb46815cf80 2024-04-26T20:58:53.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.091+0000 7fb46f000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb468074220 con 0x7fb4680cbe00 2024-04-26T20:58:53.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.091+0000 7fb467400640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fb4680cc1e0 0x7fb468073b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:60100/0 (socket says 172.21.15.138:60100) 2024-04-26T20:58:53.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.091+0000 7fb467400640 1 -- 172.21.15.138:0/1769746140 learned_addr learned my addr 172.21.15.138:0/1769746140 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:53.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.091+0000 7fb467e00640 1 --2- 172.21.15.138:0/1769746140 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb4680cbe00 0x7fb46806de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:53.095 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.091+0000 7fb466a00640 1 -- 172.21.15.138:0/1769746140 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3094312848 0 0) 0x7fb454001120 con 0x7fb4680cc1e0 2024-04-26T20:58:53.095 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.091+0000 7fb466a00640 1 -- 172.21.15.138:0/1769746140 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb44c003530 con 0x7fb4680cc1e0 2024-04-26T20:58:53.095 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.091+0000 7fb466a00640 1 -- 172.21.15.138:0/1769746140 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1895250475 0 0) 0x7fb468072a70 con 0x7fb46815cf80 2024-04-26T20:58:53.095 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.091+0000 7fb467e00640 1 -- 172.21.15.138:0/1769746140 >> v1:172.21.15.143:6789/0 conn(0x7fb46815cf80 legacy=0x7fb4680ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:53.096 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.091+0000 7fb467e00640 1 -- 172.21.15.138:0/1769746140 >> v1:172.21.15.138:6789/0 conn(0x7fb4680cc1e0 legacy=0x7fb468073b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:53.096 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.091+0000 7fb467e00640 1 -- 172.21.15.138:0/1769746140 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb468072d50 con 0x7fb4680cbe00 2024-04-26T20:58:53.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.095+0000 7fb467e00640 1 --2- 172.21.15.138:0/1769746140 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb4680cbe00 0x7fb46806de70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb458009dc0 tx=0x7fb45801c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9dbccbe6b4ec931e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:53.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.095+0000 7fb466a00640 1 -- 172.21.15.138:0/1769746140 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4580b2070 con 0x7fb4680cbe00 2024-04-26T20:58:53.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.095+0000 7fb466a00640 1 -- 172.21.15.138:0/1769746140 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4580a5960 con 0x7fb4680cbe00 2024-04-26T20:58:53.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.095+0000 7fb466a00640 1 -- 172.21.15.138:0/1769746140 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4580a5d10 con 0x7fb4680cbe00 2024-04-26T20:58:53.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.095+0000 7fb46f000640 1 -- 172.21.15.138:0/1769746140 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb4680cbe00 msgr2=0x7fb46806de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:53.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.095+0000 7fb46f000640 1 --2- 172.21.15.138:0/1769746140 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb4680cbe00 0x7fb46806de70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb458009dc0 tx=0x7fb45801c990 comp rx=0 tx=0).stop 2024-04-26T20:58:53.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.095+0000 7fb46f000640 1 -- 172.21.15.138:0/1769746140 shutdown_connections 2024-04-26T20:58:53.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.095+0000 7fb46f000640 1 --2- 172.21.15.138:0/1769746140 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb4680cbe00 0x7fb46806de70 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:53.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.095+0000 7fb46f000640 1 -- 172.21.15.138:0/1769746140 >> 172.21.15.138:0/1769746140 conn(0x7fb4680d0b20 msgr2=0x7fb4680d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:53.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.095+0000 7fb46f000640 1 -- 172.21.15.138:0/1769746140 shutdown_connections 2024-04-26T20:58:53.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.095+0000 7fb46f000640 1 -- 172.21.15.138:0/1769746140 wait complete. 2024-04-26T20:58:53.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.099+0000 7fb46f000640 1 Processor -- start 2024-04-26T20:58:53.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.099+0000 7fb46f000640 1 -- start start 2024-04-26T20:58:53.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.099+0000 7fb46f000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4680cbe00 0x7fb4680aef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:53.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.099+0000 7fb46f000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb4680cc1e0 0x7fb4680b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:53.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.099+0000 7fb46f000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb46815cf80 0x7fb4680cdd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:53.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.099+0000 7fb46f000640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fb4680d0780 con 0x7fb46815cf80 2024-04-26T20:58:53.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.099+0000 7fb46f000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fb468073680 con 0x7fb4680cbe00 2024-04-26T20:58:53.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.099+0000 7fb46f000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb4680d0900 con 0x7fb4680cc1e0 2024-04-26T20:58:53.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.099+0000 7fb46d000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb46815cf80 0x7fb4680cdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:53.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.099+0000 7fb46d000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb46815cf80 0x7fb4680cdd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:48060/0 (socket says 172.21.15.138:48060) 2024-04-26T20:58:53.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.099+0000 7fb46d000640 1 -- 172.21.15.138:0/427949274 learned_addr learned my addr 172.21.15.138:0/427949274 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:53.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.099+0000 7fb467e00640 1 --2- 172.21.15.138:0/427949274 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4680cbe00 0x7fb4680aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:53.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.099+0000 7fb467400640 1 --2- 172.21.15.138:0/427949274 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb4680cc1e0 0x7fb4680b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:53.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.099+0000 7fb46d000640 1 -- 172.21.15.138:0/427949274 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb4680cc1e0 msgr2=0x7fb4680b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:53.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.099+0000 7fb46d000640 1 --2- 172.21.15.138:0/427949274 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb4680cc1e0 0x7fb4680b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:53.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.099+0000 7fb46d000640 1 -- 172.21.15.138:0/427949274 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4680cbe00 msgr2=0x7fb4680aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:53.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.099+0000 7fb46d000640 1 --2- 172.21.15.138:0/427949274 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4680cbe00 0x7fb4680aef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:53.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.099+0000 7fb46d000640 1 -- 172.21.15.138:0/427949274 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4680c7fb0 con 0x7fb46815cf80 2024-04-26T20:58:53.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.099+0000 7fb46d000640 1 --2- 172.21.15.138:0/427949274 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb46815cf80 0x7fb4680cdd70 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fb46000c3e0 tx=0x7fb46000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:53.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.099+0000 7fb45fe00640 1 -- 172.21.15.138:0/427949274 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb460017070 con 0x7fb46815cf80 2024-04-26T20:58:53.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.103+0000 7fb45fe00640 1 -- 172.21.15.138:0/427949274 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb460003600 con 0x7fb46815cf80 2024-04-26T20:58:53.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.103+0000 7fb46f000640 1 -- 172.21.15.138:0/427949274 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4680c8290 con 0x7fb46815cf80 2024-04-26T20:58:53.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.103+0000 7fb45fe00640 1 -- 172.21.15.138:0/427949274 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4600039d0 con 0x7fb46815cf80 2024-04-26T20:58:53.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.103+0000 7fb46f000640 1 -- 172.21.15.138:0/427949274 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4680c8850 con 0x7fb46815cf80 2024-04-26T20:58:53.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.103+0000 7fb46f000640 1 -- 172.21.15.138:0/427949274 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4680b6b10 con 0x7fb46815cf80 2024-04-26T20:58:53.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.103+0000 7fb45fe00640 1 -- 172.21.15.138:0/427949274 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb46001a070 con 0x7fb46815cf80 2024-04-26T20:58:53.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.103+0000 7fb45fe00640 1 --2- 172.21.15.138:0/427949274 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb448068380 0x7fb44806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:53.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.103+0000 7fb45fe00640 1 -- 172.21.15.138:0/427949274 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5421+0+0 (secure 0 0 0) 0x7fb460085ac0 con 0x7fb46815cf80 2024-04-26T20:58:53.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.103+0000 7fb467e00640 1 --2- 172.21.15.138:0/427949274 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb448068380 0x7fb44806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:53.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.107+0000 7fb467e00640 1 --2- 172.21.15.138:0/427949274 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb448068380 0x7fb44806a840 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb4580af000 tx=0x7fb4580a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:53.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.107+0000 7fb45fe00640 1 -- 172.21.15.138:0/427949274 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb460055b40 con 0x7fb46815cf80 2024-04-26T20:58:53.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.263+0000 7fb46f000640 1 -- 172.21.15.138:0/427949274 --> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fb468069510 con 0x7fb448068380 2024-04-26T20:58:53.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.263+0000 7fb45fe00640 1 -- 172.21.15.138:0/427949274 <== mgr.4100 v2:172.21.15.143:6832/4275464198 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb468069510 con 0x7fb448068380 2024-04-26T20:58:53.267 INFO:teuthology.orchestra.run.smithi138.stderr:instructed osd(s) 5 to deep-scrub 2024-04-26T20:58:53.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.267+0000 7fb46f000640 1 -- 172.21.15.138:0/427949274 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb448068380 msgr2=0x7fb44806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:53.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.267+0000 7fb46f000640 1 --2- 172.21.15.138:0/427949274 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb448068380 0x7fb44806a840 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb4580af000 tx=0x7fb4580a7070 comp rx=0 tx=0).stop 2024-04-26T20:58:53.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.267+0000 7fb46f000640 1 -- 172.21.15.138:0/427949274 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb46815cf80 msgr2=0x7fb4680cdd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:53.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.267+0000 7fb46f000640 1 --2- 172.21.15.138:0/427949274 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb46815cf80 0x7fb4680cdd70 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fb46000c3e0 tx=0x7fb46000c7e0 comp rx=0 tx=0).stop 2024-04-26T20:58:53.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.267+0000 7fb46f000640 1 -- 172.21.15.138:0/427949274 shutdown_connections 2024-04-26T20:58:53.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.267+0000 7fb46f000640 1 --2- 172.21.15.138:0/427949274 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fb448068380 0x7fb44806a840 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:53.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.267+0000 7fb46f000640 1 --2- 172.21.15.138:0/427949274 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb46815cf80 0x7fb4680cdd70 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:53.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.267+0000 7fb46f000640 1 --2- 172.21.15.138:0/427949274 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb4680cc1e0 0x7fb4680b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:53.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.267+0000 7fb46f000640 1 --2- 172.21.15.138:0/427949274 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4680cbe00 0x7fb4680aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:53.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.267+0000 7fb46f000640 1 -- 172.21.15.138:0/427949274 >> 172.21.15.138:0/427949274 conn(0x7fb4680d0b20 msgr2=0x7fb468154780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:53.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.267+0000 7fb46f000640 1 -- 172.21.15.138:0/427949274 shutdown_connections 2024-04-26T20:58:53.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.267+0000 7fb46f000640 1 -- 172.21.15.138:0/427949274 wait complete. 2024-04-26T20:58:53.288 INFO:tasks.ceph:Scrubbing osd.6 2024-04-26T20:58:53.289 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-26T20:58:53.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.427+0000 7f45b4c00640 1 Processor -- start 2024-04-26T20:58:53.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.427+0000 7f45b4c00640 1 -- start start 2024-04-26T20:58:53.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.427+0000 7f45b4c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f45b015bc40 0x7f45b0073e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:53.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.427+0000 7f45b4c00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f45b015c020 0x7f45b00cbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:53.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.427+0000 7f45b4c00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45b006e1a0 con 0x7f45b00cb1a0 2024-04-26T20:58:53.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.427+0000 7f45b4c00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f45b006e480 con 0x7f45b015c020 2024-04-26T20:58:53.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.427+0000 7f45b4c00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f45b0073380 con 0x7f45b015bc40 2024-04-26T20:58:53.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.427+0000 7f45ae800640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f45b00cb1a0 0x7f45b00ce720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:60112/0 (socket says 172.21.15.138:60112) 2024-04-26T20:58:53.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.427+0000 7f45ae800640 1 -- 172.21.15.138:0/1253279501 learned_addr learned my addr 172.21.15.138:0/1253279501 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:53.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.427+0000 7f45a5400640 1 --2- 172.21.15.138:0/1253279501 >> v2:172.21.15.138:3300/0 conn(0x7f45b015c020 0x7f45b00cbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:53.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.427+0000 7f45ade00640 1 --2- 172.21.15.138:0/1253279501 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f45b015bc40 0x7f45b0073e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:53.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.427+0000 7f45a5400640 1 -- 172.21.15.138:0/1253279501 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f45b015bc40 msgr2=0x7f45b0073e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:53.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.427+0000 7f45a5400640 1 --2- 172.21.15.138:0/1253279501 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f45b015bc40 0x7f45b0073e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:53.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.427+0000 7f45a5400640 1 -- 172.21.15.138:0/1253279501 >> v1:172.21.15.138:6789/0 conn(0x7f45b00cb1a0 legacy=0x7f45b00ce720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:53.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.427+0000 7f45a5400640 1 -- 172.21.15.138:0/1253279501 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45b0073660 con 0x7f45b015c020 2024-04-26T20:58:53.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.427+0000 7f45ad400640 1 -- 172.21.15.138:0/1253279501 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3722708287 0 0) 0x7f45b006e1a0 con 0x7f45b00cb1a0 2024-04-26T20:58:53.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.431+0000 7f45a5400640 1 --2- 172.21.15.138:0/1253279501 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f45b015c020 0x7f45b00cbbd0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f45980097c0 tx=0x7f459801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=202a16f2d5e95de3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:53.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.431+0000 7f45ad400640 1 -- 172.21.15.138:0/1253279501 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45980b1070 con 0x7f45b015c020 2024-04-26T20:58:53.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.431+0000 7f45ad400640 1 -- 172.21.15.138:0/1253279501 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45980ac410 con 0x7f45b015c020 2024-04-26T20:58:53.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.431+0000 7f45ad400640 1 -- 172.21.15.138:0/1253279501 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45980ac7e0 con 0x7f45b015c020 2024-04-26T20:58:53.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.431+0000 7f45b4c00640 1 -- 172.21.15.138:0/1253279501 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f45b015c020 msgr2=0x7f45b00cbbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:53.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.431+0000 7f45b4c00640 1 --2- 172.21.15.138:0/1253279501 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f45b015c020 0x7f45b00cbbd0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f45980097c0 tx=0x7f459801c4a0 comp rx=0 tx=0).stop 2024-04-26T20:58:53.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.431+0000 7f45b4c00640 1 -- 172.21.15.138:0/1253279501 shutdown_connections 2024-04-26T20:58:53.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.431+0000 7f45b4c00640 1 --2- 172.21.15.138:0/1253279501 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f45b015c020 0x7f45b00cbbd0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:53.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.431+0000 7f45b4c00640 1 --2- 172.21.15.138:0/1253279501 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f45b015bc40 0x7f45b0073e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:53.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.431+0000 7f45b4c00640 1 -- 172.21.15.138:0/1253279501 >> 172.21.15.138:0/1253279501 conn(0x7f45b00d0b50 msgr2=0x7f45b00d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:53.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.431+0000 7f45b4c00640 1 -- 172.21.15.138:0/1253279501 shutdown_connections 2024-04-26T20:58:53.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.431+0000 7f45b4c00640 1 -- 172.21.15.138:0/1253279501 wait complete. 2024-04-26T20:58:53.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.435+0000 7f45b4c00640 1 Processor -- start 2024-04-26T20:58:53.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.435+0000 7f45b4c00640 1 -- start start 2024-04-26T20:58:53.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.435+0000 7f45b4c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f45b00cb1a0 0x7f45b00c9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:53.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.435+0000 7f45b4c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45b015bc40 0x7f45b01488b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:53.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.435+0000 7f45b4c00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f45b015c020 0x7f45b01560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:53.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.435+0000 7f45b4c00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f45b006eab0 con 0x7f45b015c020 2024-04-26T20:58:53.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.435+0000 7f45b4c00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f45b006e930 con 0x7f45b015bc40 2024-04-26T20:58:53.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.435+0000 7f45b4c00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f45b006ec30 con 0x7f45b00cb1a0 2024-04-26T20:58:53.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.435+0000 7f45ae800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f45b015c020 0x7f45b01560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:53.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.435+0000 7f45ae800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f45b015c020 0x7f45b01560e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:48078/0 (socket says 172.21.15.138:48078) 2024-04-26T20:58:53.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.435+0000 7f45ae800640 1 -- 172.21.15.138:0/3382417659 learned_addr learned my addr 172.21.15.138:0/3382417659 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:53.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.435+0000 7f45ade00640 1 --2- 172.21.15.138:0/3382417659 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f45b00cb1a0 0x7f45b00c9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:53.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.435+0000 7f45a5400640 1 --2- 172.21.15.138:0/3382417659 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45b015bc40 0x7f45b01488b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:53.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.435+0000 7f45ae800640 1 -- 172.21.15.138:0/3382417659 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f45b00cb1a0 msgr2=0x7f45b00c9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:53.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.435+0000 7f45ae800640 1 --2- 172.21.15.138:0/3382417659 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f45b00cb1a0 0x7f45b00c9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:53.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.435+0000 7f45ae800640 1 -- 172.21.15.138:0/3382417659 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45b015bc40 msgr2=0x7f45b01488b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:53.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.435+0000 7f45ae800640 1 --2- 172.21.15.138:0/3382417659 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45b015bc40 0x7f45b01488b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:53.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.435+0000 7f45ae800640 1 -- 172.21.15.138:0/3382417659 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45b00c7fc0 con 0x7f45b015c020 2024-04-26T20:58:53.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.435+0000 7f45ae800640 1 --2- 172.21.15.138:0/3382417659 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f45b015c020 0x7f45b01560e0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f45a800c4b0 tx=0x7f45a800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:53.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.435+0000 7f45a6a00640 1 -- 172.21.15.138:0/3382417659 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a8018070 con 0x7f45b015c020 2024-04-26T20:58:53.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.435+0000 7f45a6a00640 1 -- 172.21.15.138:0/3382417659 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45a80074e0 con 0x7f45b015c020 2024-04-26T20:58:53.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.435+0000 7f45a6a00640 1 -- 172.21.15.138:0/3382417659 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a8004a30 con 0x7f45b015c020 2024-04-26T20:58:53.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.435+0000 7f45b4c00640 1 -- 172.21.15.138:0/3382417659 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45b00c82a0 con 0x7f45b015c020 2024-04-26T20:58:53.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.435+0000 7f45b4c00640 1 -- 172.21.15.138:0/3382417659 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45b00c8860 con 0x7f45b015c020 2024-04-26T20:58:53.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.435+0000 7f45b4c00640 1 -- 172.21.15.138:0/3382417659 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f45b0069510 con 0x7f45b015c020 2024-04-26T20:58:53.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.439+0000 7f45a6a00640 1 -- 172.21.15.138:0/3382417659 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f45a801b360 con 0x7f45b015c020 2024-04-26T20:58:53.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.439+0000 7f45a6a00640 1 --2- 172.21.15.138:0/3382417659 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f458c068380 0x7f458c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:53.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.439+0000 7f45a6a00640 1 -- 172.21.15.138:0/3382417659 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5421+0+0 (secure 0 0 0) 0x7f45a8086200 con 0x7f45b015c020 2024-04-26T20:58:53.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.439+0000 7f45a6a00640 1 --2- 172.21.15.138:0/3382417659 >> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] conn(0x7f458c06e8c0 0x7f458c070d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:53.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.439+0000 7f45a6a00640 1 -- 172.21.15.138:0/3382417659 --> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f458c0713d0 con 0x7f458c06e8c0 2024-04-26T20:58:53.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.439+0000 7f45a6a00640 1 -- 172.21.15.138:0/3382417659 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f45a8086690 con 0x7f45b015c020 2024-04-26T20:58:53.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.439+0000 7f45ade00640 1 --2- 172.21.15.138:0/3382417659 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f458c068380 0x7f458c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:53.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.439+0000 7f45a5400640 1 --2- 172.21.15.138:0/3382417659 >> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] conn(0x7f458c06e8c0 0x7f458c070d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:53.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.439+0000 7f45ade00640 1 --2- 172.21.15.138:0/3382417659 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f458c068380 0x7f458c06a840 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f45a0003fd0 tx=0x7f45a00039a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:53.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.439+0000 7f45a5400640 1 --2- 172.21.15.138:0/3382417659 >> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] conn(0x7f458c06e8c0 0x7f458c070d00 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:53.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.439+0000 7f45a6a00640 1 -- 172.21.15.138:0/3382417659 <== osd.6 v2:172.21.15.143:6816/1082239825 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f458c0713d0 con 0x7f458c06e8c0 2024-04-26T20:58:53.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.455+0000 7f45b4c00640 1 -- 172.21.15.138:0/3382417659 --> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f45b00d1910 con 0x7f458c06e8c0 2024-04-26T20:58:53.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.455+0000 7f45a6a00640 1 -- 172.21.15.138:0/3382417659 <== osd.6 v2:172.21.15.143:6816/1082239825 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f45b00d1910 con 0x7f458c06e8c0 2024-04-26T20:58:53.456 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-26T20:58:53.456 INFO:teuthology.orchestra.run.smithi138.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T20:58:53.456 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-26T20:58:53.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.455+0000 7f45b4c00640 1 -- 172.21.15.138:0/3382417659 >> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] conn(0x7f458c06e8c0 msgr2=0x7f458c070d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:53.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.455+0000 7f45b4c00640 1 --2- 172.21.15.138:0/3382417659 >> [v2:172.21.15.143:6816/1082239825,v1:172.21.15.143:6817/1082239825] conn(0x7f458c06e8c0 0x7f458c070d00 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:53.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.455+0000 7f45b4c00640 1 -- 172.21.15.138:0/3382417659 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f458c068380 msgr2=0x7f458c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:53.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.455+0000 7f45b4c00640 1 --2- 172.21.15.138:0/3382417659 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f458c068380 0x7f458c06a840 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f45a0003fd0 tx=0x7f45a00039a0 comp rx=0 tx=0).stop 2024-04-26T20:58:53.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.455+0000 7f45b4c00640 1 -- 172.21.15.138:0/3382417659 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f45b015c020 msgr2=0x7f45b01560e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:53.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.455+0000 7f45b4c00640 1 --2- 172.21.15.138:0/3382417659 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f45b015c020 0x7f45b01560e0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f45a800c4b0 tx=0x7f45a800c970 comp rx=0 tx=0).stop 2024-04-26T20:58:53.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.455+0000 7f45ae800640 1 -- 172.21.15.138:0/3382417659 reap_dead start 2024-04-26T20:58:53.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.455+0000 7f45b4c00640 1 -- 172.21.15.138:0/3382417659 shutdown_connections 2024-04-26T20:58:53.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.455+0000 7f45b4c00640 1 -- 172.21.15.138:0/3382417659 >> 172.21.15.138:0/3382417659 conn(0x7f45b00d0b50 msgr2=0x7f45b006f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:53.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.455+0000 7f45b4c00640 1 -- 172.21.15.138:0/3382417659 shutdown_connections 2024-04-26T20:58:53.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.455+0000 7f45b4c00640 1 -- 172.21.15.138:0/3382417659 wait complete. 2024-04-26T20:58:53.475 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-26T20:58:53.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.611+0000 7f25be400640 1 Processor -- start 2024-04-26T20:58:53.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.611+0000 7f25be400640 1 -- start start 2024-04-26T20:58:53.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.611+0000 7f25be400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f25b80cbe00 0x7f25b806de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:53.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.611+0000 7f25be400640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25b80727f0 con 0x7f25b80cc1e0 2024-04-26T20:58:53.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.611+0000 7f25be400640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25b8072a70 con 0x7f25b815cf80 2024-04-26T20:58:53.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.611+0000 7f25be400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f25b8074220 con 0x7f25b80cbe00 2024-04-26T20:58:53.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.611+0000 7f25aea00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f25b80cc1e0 0x7f25b8073b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:58508/0 (socket says 172.21.15.138:58508) 2024-04-26T20:58:53.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.611+0000 7f25aea00640 1 -- 172.21.15.138:0/1648873675 learned_addr learned my addr 172.21.15.138:0/1648873675 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:53.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.611+0000 7f25b7400640 1 --2- 172.21.15.138:0/1648873675 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f25b80cbe00 0x7f25b806de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:53.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.611+0000 7f25b6a00640 1 -- 172.21.15.138:0/1648873675 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3135708857 0 0) 0x7f25a0001120 con 0x7f25b80cc1e0 2024-04-26T20:58:53.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.611+0000 7f25b6a00640 1 -- 172.21.15.138:0/1648873675 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f259c005740 con 0x7f25b80cc1e0 2024-04-26T20:58:53.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.611+0000 7f25b7400640 1 -- 172.21.15.138:0/1648873675 >> v1:172.21.15.143:6789/0 conn(0x7f25b815cf80 legacy=0x7f25b80ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:53.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.611+0000 7f25b7400640 1 -- 172.21.15.138:0/1648873675 >> v1:172.21.15.138:6789/0 conn(0x7f25b80cc1e0 legacy=0x7f25b8073b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:53.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.611+0000 7f25b7400640 1 -- 172.21.15.138:0/1648873675 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25b8072d50 con 0x7f25b80cbe00 2024-04-26T20:58:53.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.615+0000 7f25b7400640 1 --2- 172.21.15.138:0/1648873675 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f25b80cbe00 0x7f25b806de70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f25a8009dc0 tx=0x7f25a801c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4c3f00d847d1303 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:53.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.615+0000 7f25b6a00640 1 -- 172.21.15.138:0/1648873675 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a80b2070 con 0x7f25b80cbe00 2024-04-26T20:58:53.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.615+0000 7f25b6a00640 1 -- 172.21.15.138:0/1648873675 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25a80a5860 con 0x7f25b80cbe00 2024-04-26T20:58:53.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.615+0000 7f25b6a00640 1 -- 172.21.15.138:0/1648873675 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a80a5c30 con 0x7f25b80cbe00 2024-04-26T20:58:53.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.615+0000 7f25be400640 1 -- 172.21.15.138:0/1648873675 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f25b80cbe00 msgr2=0x7f25b806de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:53.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.615+0000 7f25be400640 1 --2- 172.21.15.138:0/1648873675 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f25b80cbe00 0x7f25b806de70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f25a8009dc0 tx=0x7f25a801c990 comp rx=0 tx=0).stop 2024-04-26T20:58:53.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.615+0000 7f25be400640 1 -- 172.21.15.138:0/1648873675 shutdown_connections 2024-04-26T20:58:53.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.615+0000 7f25be400640 1 --2- 172.21.15.138:0/1648873675 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f25b80cbe00 0x7f25b806de70 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:53.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.615+0000 7f25be400640 1 -- 172.21.15.138:0/1648873675 >> 172.21.15.138:0/1648873675 conn(0x7f25b80d0b20 msgr2=0x7f25b80d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:53.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.615+0000 7f25be400640 1 -- 172.21.15.138:0/1648873675 shutdown_connections 2024-04-26T20:58:53.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.615+0000 7f25be400640 1 -- 172.21.15.138:0/1648873675 wait complete. 2024-04-26T20:58:53.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.619+0000 7f25be400640 1 Processor -- start 2024-04-26T20:58:53.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.619+0000 7f25be400640 1 -- start start 2024-04-26T20:58:53.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.619+0000 7f25be400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f25b80cbe00 0x7f25b80aea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:53.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.619+0000 7f25be400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f25b80cc1e0 0x7f25b81fc480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:53.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.619+0000 7f25be400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f25b815cf80 0x7f25b81f7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:53.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.619+0000 7f25be400640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f25b80d0780 con 0x7f25b80cc1e0 2024-04-26T20:58:53.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.619+0000 7f25be400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f25b8073680 con 0x7f25b815cf80 2024-04-26T20:58:53.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.619+0000 7f25be400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f25b80d0900 con 0x7f25b80cbe00 2024-04-26T20:58:53.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.619+0000 7f25aea00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f25b80cc1e0 0x7f25b81fc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:53.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.619+0000 7f25aea00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f25b80cc1e0 0x7f25b81fc480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:39702/0 (socket says 172.21.15.138:39702) 2024-04-26T20:58:53.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.619+0000 7f25aea00640 1 -- 172.21.15.138:0/264577882 learned_addr learned my addr 172.21.15.138:0/264577882 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:53.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.619+0000 7f25b7400640 1 --2- 172.21.15.138:0/264577882 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f25b80cbe00 0x7f25b80aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:53.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.619+0000 7f25b7e00640 1 --2- 172.21.15.138:0/264577882 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f25b815cf80 0x7f25b81f7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:53.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.619+0000 7f25aea00640 1 -- 172.21.15.138:0/264577882 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f25b80cbe00 msgr2=0x7f25b80aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:53.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.619+0000 7f25aea00640 1 --2- 172.21.15.138:0/264577882 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f25b80cbe00 0x7f25b80aea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:53.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.619+0000 7f25aea00640 1 -- 172.21.15.138:0/264577882 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f25b815cf80 msgr2=0x7f25b81f7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:53.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.619+0000 7f25aea00640 1 --2- 172.21.15.138:0/264577882 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f25b815cf80 0x7f25b81f7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:53.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.619+0000 7f25aea00640 1 -- 172.21.15.138:0/264577882 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25b80aefc0 con 0x7f25b80cc1e0 2024-04-26T20:58:53.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.619+0000 7f25aea00640 1 --2- 172.21.15.138:0/264577882 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f25b80cc1e0 0x7f25b81fc480 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f25a000c730 tx=0x7f25a000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:53.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.619+0000 7f25afe00640 1 -- 172.21.15.138:0/264577882 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a0017070 con 0x7f25b80cc1e0 2024-04-26T20:58:53.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.619+0000 7f25afe00640 1 -- 172.21.15.138:0/264577882 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25a0005ae0 con 0x7f25b80cc1e0 2024-04-26T20:58:53.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.619+0000 7f25afe00640 1 -- 172.21.15.138:0/264577882 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a0007e30 con 0x7f25b80cc1e0 2024-04-26T20:58:53.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.619+0000 7f25be400640 1 -- 172.21.15.138:0/264577882 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25b80afde0 con 0x7f25b80cc1e0 2024-04-26T20:58:53.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.619+0000 7f25be400640 1 -- 172.21.15.138:0/264577882 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25b80af820 con 0x7f25b80cc1e0 2024-04-26T20:58:53.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.619+0000 7f25be400640 1 -- 172.21.15.138:0/264577882 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25b8069510 con 0x7f25b80cc1e0 2024-04-26T20:58:53.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.623+0000 7f25afe00640 1 -- 172.21.15.138:0/264577882 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f25a001a070 con 0x7f25b80cc1e0 2024-04-26T20:58:53.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.623+0000 7f25afe00640 1 --2- 172.21.15.138:0/264577882 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f2594068380 0x7f259406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:53.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.623+0000 7f25afe00640 1 -- 172.21.15.138:0/264577882 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5421+0+0 (secure 0 0 0) 0x7f25a0085bf0 con 0x7f25b80cc1e0 2024-04-26T20:58:53.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.623+0000 7f25b7400640 1 --2- 172.21.15.138:0/264577882 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f2594068380 0x7f259406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:53.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.623+0000 7f25b7400640 1 --2- 172.21.15.138:0/264577882 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f2594068380 0x7f259406a840 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f25a80af000 tx=0x7f25a80a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:53.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.627+0000 7f25afe00640 1 -- 172.21.15.138:0/264577882 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f25b80727f0 con 0x7f25b80cc1e0 2024-04-26T20:58:53.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.783+0000 7f25be400640 1 -- 172.21.15.138:0/264577882 --> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f25b80c7480 con 0x7f2594068380 2024-04-26T20:58:53.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.783+0000 7f25afe00640 1 -- 172.21.15.138:0/264577882 <== mgr.4100 v2:172.21.15.143:6832/4275464198 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f25b80c7480 con 0x7f2594068380 2024-04-26T20:58:53.787 INFO:teuthology.orchestra.run.smithi138.stderr:instructed osd(s) 6 to deep-scrub 2024-04-26T20:58:53.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.787+0000 7f25be400640 1 -- 172.21.15.138:0/264577882 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f2594068380 msgr2=0x7f259406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:53.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.787+0000 7f25be400640 1 --2- 172.21.15.138:0/264577882 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f2594068380 0x7f259406a840 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f25a80af000 tx=0x7f25a80a7070 comp rx=0 tx=0).stop 2024-04-26T20:58:53.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.787+0000 7f25be400640 1 -- 172.21.15.138:0/264577882 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f25b80cc1e0 msgr2=0x7f25b81fc480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:53.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.787+0000 7f25be400640 1 --2- 172.21.15.138:0/264577882 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f25b80cc1e0 0x7f25b81fc480 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f25a000c730 tx=0x7f25a000cbf0 comp rx=0 tx=0).stop 2024-04-26T20:58:53.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.787+0000 7f25be400640 1 -- 172.21.15.138:0/264577882 shutdown_connections 2024-04-26T20:58:53.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.787+0000 7f25be400640 1 --2- 172.21.15.138:0/264577882 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f2594068380 0x7f259406a840 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:53.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.787+0000 7f25be400640 1 --2- 172.21.15.138:0/264577882 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f25b815cf80 0x7f25b81f7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:53.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.787+0000 7f25be400640 1 --2- 172.21.15.138:0/264577882 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f25b80cc1e0 0x7f25b81fc480 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:53.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.787+0000 7f25be400640 1 --2- 172.21.15.138:0/264577882 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f25b80cbe00 0x7f25b80aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:53.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.787+0000 7f25be400640 1 -- 172.21.15.138:0/264577882 >> 172.21.15.138:0/264577882 conn(0x7f25b80d0b20 msgr2=0x7f25b815b130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:53.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.787+0000 7f25be400640 1 -- 172.21.15.138:0/264577882 shutdown_connections 2024-04-26T20:58:53.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.787+0000 7f25be400640 1 -- 172.21.15.138:0/264577882 wait complete. 2024-04-26T20:58:53.807 INFO:tasks.ceph:Scrubbing osd.7 2024-04-26T20:58:53.807 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-26T20:58:53.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.947+0000 7f1bc0600640 1 Processor -- start 2024-04-26T20:58:53.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.947+0000 7f1bc0600640 1 -- start start 2024-04-26T20:58:53.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.947+0000 7f1bc0600640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f1bb815f2e0 0x7f1bb81636e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:53.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.947+0000 7f1bc0600640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1bb806f9d0 0x7f1bb80ce720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:53.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.947+0000 7f1bc0600640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bb815fa80 con 0x7f1bb80cec60 2024-04-26T20:58:53.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.947+0000 7f1bc0600640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f1bb80cf090 con 0x7f1bb815f2e0 2024-04-26T20:58:53.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.947+0000 7f1bc0600640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f1bb815fd60 con 0x7f1bb806f9d0 2024-04-26T20:58:53.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.947+0000 7f1bbdc00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f1bb815f2e0 0x7f1bb81636e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:53.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.947+0000 7f1bbe600640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f1bb80cec60 0x7f1bb806e360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:58514/0 (socket says 172.21.15.138:58514) 2024-04-26T20:58:53.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.947+0000 7f1bbe600640 1 -- 172.21.15.138:0/3341215261 learned_addr learned my addr 172.21.15.138:0/3341215261 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:53.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.947+0000 7f1bbd200640 1 --2- 172.21.15.138:0/3341215261 >> v2:172.21.15.143:3300/0 conn(0x7f1bb806f9d0 0x7f1bb80ce720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:53.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.947+0000 7f1bbdc00640 1 -- 172.21.15.138:0/3341215261 >> v2:172.21.15.143:3300/0 conn(0x7f1bb806f9d0 msgr2=0x7f1bb80ce720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:53.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.947+0000 7f1bbdc00640 1 --2- 172.21.15.138:0/3341215261 >> v2:172.21.15.143:3300/0 conn(0x7f1bb806f9d0 0x7f1bb80ce720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:53.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.947+0000 7f1bbdc00640 1 -- 172.21.15.138:0/3341215261 >> v1:172.21.15.138:6789/0 conn(0x7f1bb80cec60 legacy=0x7f1bb806e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:53.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.947+0000 7f1bbdc00640 1 -- 172.21.15.138:0/3341215261 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bb8160040 con 0x7f1bb815f2e0 2024-04-26T20:58:53.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.947+0000 7f1bb7e00640 1 -- 172.21.15.138:0/3341215261 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1210538719 0 0) 0x7f1bb815fa80 con 0x7f1bb80cec60 2024-04-26T20:58:53.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.951+0000 7f1bbdc00640 1 --2- 172.21.15.138:0/3341215261 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1bb815f2e0 0x7f1bb81636e0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f1bb806d790 tx=0x7f1bac01c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d165ba1195be9bd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:53.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.951+0000 7f1bb7e00640 1 -- 172.21.15.138:0/3341215261 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bac0a66f0 con 0x7f1bb815f2e0 2024-04-26T20:58:53.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.951+0000 7f1bb7e00640 1 -- 172.21.15.138:0/3341215261 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bac0a6890 con 0x7f1bb815f2e0 2024-04-26T20:58:53.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.951+0000 7f1bb7e00640 1 -- 172.21.15.138:0/3341215261 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bac0a6c60 con 0x7f1bb815f2e0 2024-04-26T20:58:53.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.951+0000 7f1bc0600640 1 -- 172.21.15.138:0/3341215261 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1bb815f2e0 msgr2=0x7f1bb81636e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:53.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.951+0000 7f1bc0600640 1 --2- 172.21.15.138:0/3341215261 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1bb815f2e0 0x7f1bb81636e0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f1bb806d790 tx=0x7f1bac01c7e0 comp rx=0 tx=0).stop 2024-04-26T20:58:53.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.951+0000 7f1bc0600640 1 -- 172.21.15.138:0/3341215261 shutdown_connections 2024-04-26T20:58:53.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.951+0000 7f1bc0600640 1 --2- 172.21.15.138:0/3341215261 >> v2:172.21.15.143:3300/0 conn(0x7f1bb806f9d0 0x7f1bb80ce720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:53.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.951+0000 7f1bc0600640 1 --2- 172.21.15.138:0/3341215261 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1bb815f2e0 0x7f1bb81636e0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:53.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.951+0000 7f1bc0600640 1 -- 172.21.15.138:0/3341215261 >> 172.21.15.138:0/3341215261 conn(0x7f1bb80d0b50 msgr2=0x7f1bb80d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:53.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.951+0000 7f1bc0600640 1 -- 172.21.15.138:0/3341215261 shutdown_connections 2024-04-26T20:58:53.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.951+0000 7f1bc0600640 1 -- 172.21.15.138:0/3341215261 wait complete. 2024-04-26T20:58:53.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.955+0000 7f1bc0600640 1 Processor -- start 2024-04-26T20:58:53.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.955+0000 7f1bc0600640 1 -- start start 2024-04-26T20:58:53.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.955+0000 7f1bc0600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1bb806f9d0 0x7f1bb815c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:53.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.955+0000 7f1bc0600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1bb80cec60 0x7f1bb8162270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:53.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.955+0000 7f1bc0600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1bb815f2e0 0x7f1bb81570d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:53.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.955+0000 7f1bc0600640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb80afa50 con 0x7f1bb815f2e0 2024-04-26T20:58:53.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.955+0000 7f1bc0600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb80af8d0 con 0x7f1bb80cec60 2024-04-26T20:58:53.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.955+0000 7f1bc0600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f1bb816c070 con 0x7f1bb806f9d0 2024-04-26T20:58:53.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.955+0000 7f1bbe600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1bb815f2e0 0x7f1bb81570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:53.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.955+0000 7f1bbe600640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1bb815f2e0 0x7f1bb81570d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:39724/0 (socket says 172.21.15.138:39724) 2024-04-26T20:58:53.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.955+0000 7f1bbe600640 1 -- 172.21.15.138:0/3219525737 learned_addr learned my addr 172.21.15.138:0/3219525737 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:53.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.955+0000 7f1bbd200640 1 --2- 172.21.15.138:0/3219525737 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1bb80cec60 0x7f1bb8162270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:53.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.955+0000 7f1bbdc00640 1 --2- 172.21.15.138:0/3219525737 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1bb806f9d0 0x7f1bb815c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:53.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.955+0000 7f1bbe600640 1 -- 172.21.15.138:0/3219525737 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1bb806f9d0 msgr2=0x7f1bb815c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:53.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.955+0000 7f1bbe600640 1 --2- 172.21.15.138:0/3219525737 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1bb806f9d0 0x7f1bb815c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:53.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.955+0000 7f1bbe600640 1 -- 172.21.15.138:0/3219525737 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1bb80cec60 msgr2=0x7f1bb8162270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:53.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.955+0000 7f1bbe600640 1 --2- 172.21.15.138:0/3219525737 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1bb80cec60 0x7f1bb8162270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:53.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.955+0000 7f1bbe600640 1 -- 172.21.15.138:0/3219525737 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bb815db50 con 0x7f1bb815f2e0 2024-04-26T20:58:53.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.955+0000 7f1bbe600640 1 --2- 172.21.15.138:0/3219525737 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1bb815f2e0 0x7f1bb81570d0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f1bb000c480 tx=0x7f1bb000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:53.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.955+0000 7f1bb5600640 1 -- 172.21.15.138:0/3219525737 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb0018070 con 0x7f1bb815f2e0 2024-04-26T20:58:53.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.955+0000 7f1bb5600640 1 -- 172.21.15.138:0/3219525737 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bb00074e0 con 0x7f1bb815f2e0 2024-04-26T20:58:53.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.955+0000 7f1bb5600640 1 -- 172.21.15.138:0/3219525737 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb0004a30 con 0x7f1bb815f2e0 2024-04-26T20:58:53.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.955+0000 7f1bc0600640 1 -- 172.21.15.138:0/3219525737 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bb815cfd0 con 0x7f1bb815f2e0 2024-04-26T20:58:53.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.955+0000 7f1bc0600640 1 -- 172.21.15.138:0/3219525737 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bb815d590 con 0x7f1bb815f2e0 2024-04-26T20:58:53.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.959+0000 7f1bc0600640 1 -- 172.21.15.138:0/3219525737 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1bb81627b0 con 0x7f1bb815f2e0 2024-04-26T20:58:53.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.959+0000 7f1bb5600640 1 -- 172.21.15.138:0/3219525737 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1bb0004bd0 con 0x7f1bb815f2e0 2024-04-26T20:58:53.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.959+0000 7f1bb5600640 1 --2- 172.21.15.138:0/3219525737 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1b98068380 0x7f1b9806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:53.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.959+0000 7f1bb5600640 1 -- 172.21.15.138:0/3219525737 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5421+0+0 (secure 0 0 0) 0x7f1bb0085b90 con 0x7f1bb815f2e0 2024-04-26T20:58:53.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.959+0000 7f1bb5600640 1 --2- 172.21.15.138:0/3219525737 >> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] conn(0x7f1b9806e8c0 0x7f1b98070d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:53.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.959+0000 7f1bb5600640 1 -- 172.21.15.138:0/3219525737 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1b980713d0 con 0x7f1b9806e8c0 2024-04-26T20:58:53.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.959+0000 7f1bb5600640 1 -- 172.21.15.138:0/3219525737 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f1bb008a2a0 con 0x7f1bb815f2e0 2024-04-26T20:58:53.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.959+0000 7f1bbdc00640 1 --2- 172.21.15.138:0/3219525737 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1b98068380 0x7f1b9806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:53.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.959+0000 7f1bbd200640 1 --2- 172.21.15.138:0/3219525737 >> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] conn(0x7f1b9806e8c0 0x7f1b98070d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:53.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.959+0000 7f1bbd200640 1 --2- 172.21.15.138:0/3219525737 >> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] conn(0x7f1b9806e8c0 0x7f1b98070d00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:53.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.959+0000 7f1bbdc00640 1 --2- 172.21.15.138:0/3219525737 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1b98068380 0x7f1b9806a840 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1bac0af000 tx=0x7f1bac0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:53.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.963+0000 7f1bb5600640 1 -- 172.21.15.138:0/3219525737 <== osd.7 v2:172.21.15.143:6824/3295508495 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1b980713d0 con 0x7f1b9806e8c0 2024-04-26T20:58:53.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.975+0000 7f1bc0600640 1 -- 172.21.15.138:0/3219525737 --> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1bb8069510 con 0x7f1b9806e8c0 2024-04-26T20:58:53.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.975+0000 7f1bb5600640 1 -- 172.21.15.138:0/3219525737 <== osd.7 v2:172.21.15.143:6824/3295508495 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1bb8069510 con 0x7f1b9806e8c0 2024-04-26T20:58:53.977 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-26T20:58:53.977 INFO:teuthology.orchestra.run.smithi138.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T20:58:53.977 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-26T20:58:53.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.975+0000 7f1bc0600640 1 -- 172.21.15.138:0/3219525737 >> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] conn(0x7f1b9806e8c0 msgr2=0x7f1b98070d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:53.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.975+0000 7f1bc0600640 1 --2- 172.21.15.138:0/3219525737 >> [v2:172.21.15.143:6824/3295508495,v1:172.21.15.143:6825/3295508495] conn(0x7f1b9806e8c0 0x7f1b98070d00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:53.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.975+0000 7f1bc0600640 1 -- 172.21.15.138:0/3219525737 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1b98068380 msgr2=0x7f1b9806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:53.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.975+0000 7f1bc0600640 1 --2- 172.21.15.138:0/3219525737 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1b98068380 0x7f1b9806a840 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1bac0af000 tx=0x7f1bac0a7000 comp rx=0 tx=0).stop 2024-04-26T20:58:53.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.975+0000 7f1bc0600640 1 -- 172.21.15.138:0/3219525737 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1bb815f2e0 msgr2=0x7f1bb81570d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:53.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.975+0000 7f1bc0600640 1 --2- 172.21.15.138:0/3219525737 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1bb815f2e0 0x7f1bb81570d0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f1bb000c480 tx=0x7f1bb000c940 comp rx=0 tx=0).stop 2024-04-26T20:58:53.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.975+0000 7f1bbe600640 1 -- 172.21.15.138:0/3219525737 reap_dead start 2024-04-26T20:58:53.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.975+0000 7f1bc0600640 1 -- 172.21.15.138:0/3219525737 shutdown_connections 2024-04-26T20:58:53.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.975+0000 7f1bc0600640 1 -- 172.21.15.138:0/3219525737 >> 172.21.15.138:0/3219525737 conn(0x7f1bb80d0b50 msgr2=0x7f1bb80cc520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:53.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.975+0000 7f1bc0600640 1 -- 172.21.15.138:0/3219525737 shutdown_connections 2024-04-26T20:58:53.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:53.975+0000 7f1bc0600640 1 -- 172.21.15.138:0/3219525737 wait complete. 2024-04-26T20:58:53.996 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-26T20:58:54.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.131+0000 7f4534400640 1 Processor -- start 2024-04-26T20:58:54.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.131+0000 7f4534400640 1 -- start start 2024-04-26T20:58:54.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.131+0000 7f4534400640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f452c0b2280 0x7f452c0b2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:54.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.131+0000 7f4534400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f452c0d1720 0x7f452c0b30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:54.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.131+0000 7f4534400640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f452c0ce540 con 0x7f452c15d0f0 2024-04-26T20:58:54.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.131+0000 7f4534400640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f452c0d0e50 con 0x7f452c0b2280 2024-04-26T20:58:54.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.131+0000 7f4534400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f452c0b26e0 con 0x7f452c0d1720 2024-04-26T20:58:54.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.131+0000 7f4531a00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f452c15d0f0 0x7f452c0d1010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:58518/0 (socket says 172.21.15.138:58518) 2024-04-26T20:58:54.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.131+0000 7f4531a00640 1 -- 172.21.15.138:0/3624358825 learned_addr learned my addr 172.21.15.138:0/3624358825 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:54.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.131+0000 7f4531000640 1 --2- 172.21.15.138:0/3624358825 >> v2:172.21.15.143:3300/0 conn(0x7f452c0b2280 0x7f452c0b2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:54.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.131+0000 7f452be00640 1 -- 172.21.15.138:0/3624358825 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2722124319 0 0) 0x7f452c0ce540 con 0x7f452c15d0f0 2024-04-26T20:58:54.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.131+0000 7f4532400640 1 --2- 172.21.15.138:0/3624358825 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f452c0d1720 0x7f452c0b30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:54.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.131+0000 7f452be00640 1 -- 172.21.15.138:0/3624358825 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4514003530 con 0x7f452c15d0f0 2024-04-26T20:58:54.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.131+0000 7f452be00640 1 -- 172.21.15.138:0/3624358825 <== mon.0 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2867285055 0 0) 0x7f4514003530 con 0x7f452c15d0f0 2024-04-26T20:58:54.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.131+0000 7f452be00640 1 -- 172.21.15.138:0/3624358825 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f452c0d1720 msgr2=0x7f452c0b30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:54.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.131+0000 7f452be00640 1 --2- 172.21.15.138:0/3624358825 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f452c0d1720 0x7f452c0b30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:54.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.131+0000 7f452be00640 1 -- 172.21.15.138:0/3624358825 >> v2:172.21.15.143:3300/0 conn(0x7f452c0b2280 msgr2=0x7f452c0b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:54.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.131+0000 7f452be00640 1 --2- 172.21.15.138:0/3624358825 >> v2:172.21.15.143:3300/0 conn(0x7f452c0b2280 0x7f452c0b2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:54.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.131+0000 7f452be00640 1 -- 172.21.15.138:0/3624358825 --> v1:172.21.15.138:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f452c0ce820 con 0x7f452c15d0f0 2024-04-26T20:58:54.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.131+0000 7f452be00640 1 -- 172.21.15.138:0/3624358825 <== mon.0 v1:172.21.15.138:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2715389689 0 0) 0x7f4520001a00 con 0x7f452c15d0f0 2024-04-26T20:58:54.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.131+0000 7f452be00640 1 -- 172.21.15.138:0/3624358825 >> v1:172.21.15.138:6789/0 conn(0x7f452c15d0f0 legacy=0x7f452c0d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:54.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.131+0000 7f452be00640 1 --2- 172.21.15.138:0/3624358825 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f452c0d1720 0x7f45140039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:54.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.131+0000 7f452be00640 1 --2- 172.21.15.138:0/3624358825 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4514003f40 0x7f4514004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:54.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.131+0000 7f452be00640 1 --2- 172.21.15.138:0/3624358825 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4514004d50 0x7f45140051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:54.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.131+0000 7f452be00640 1 -- 172.21.15.138:0/3624358825 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f452c0d0e50 con 0x7f4514003f40 2024-04-26T20:58:54.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.131+0000 7f452be00640 1 -- 172.21.15.138:0/3624358825 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f452c0b26e0 con 0x7f4514004d50 2024-04-26T20:58:54.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.131+0000 7f452be00640 1 -- 172.21.15.138:0/3624358825 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f451400b9d0 con 0x7f452c0d1720 2024-04-26T20:58:54.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.131+0000 7f4531000640 1 --2- 172.21.15.138:0/3624358825 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4514003f40 0x7f4514004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:54.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.135+0000 7f4531a00640 1 --2- 172.21.15.138:0/3624358825 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f452c0d1720 0x7f45140039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:54.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.135+0000 7f4532400640 1 --2- 172.21.15.138:0/3624358825 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4514004d50 0x7f45140051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:54.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.135+0000 7f4531000640 1 -- 172.21.15.138:0/3624358825 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f452c0d1720 msgr2=0x7f45140039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:54.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.135+0000 7f4531000640 1 --2- 172.21.15.138:0/3624358825 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f452c0d1720 0x7f45140039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:54.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.135+0000 7f4531000640 1 -- 172.21.15.138:0/3624358825 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4514004d50 msgr2=0x7f45140051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:54.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.135+0000 7f4531000640 1 --2- 172.21.15.138:0/3624358825 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4514004d50 0x7f45140051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:54.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.135+0000 7f4531000640 1 -- 172.21.15.138:0/3624358825 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4514003530 con 0x7f4514003f40 2024-04-26T20:58:54.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.135+0000 7f4532400640 1 --2- 172.21.15.138:0/3624358825 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4514004d50 0x7f45140051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:58:54.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.135+0000 7f4531000640 1 --2- 172.21.15.138:0/3624358825 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4514003f40 0x7f4514004810 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f4518009ae0 tx=0x7f451801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e76a3bb441610aa server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:54.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.135+0000 7f452be00640 1 -- 172.21.15.138:0/3624358825 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45180b2070 con 0x7f4514003f40 2024-04-26T20:58:54.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.135+0000 7f452be00640 1 -- 172.21.15.138:0/3624358825 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45180a5590 con 0x7f4514003f40 2024-04-26T20:58:54.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.135+0000 7f452be00640 1 -- 172.21.15.138:0/3624358825 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45180096b0 con 0x7f4514003f40 2024-04-26T20:58:54.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.139+0000 7f4534400640 1 -- 172.21.15.138:0/3624358825 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4514003f40 msgr2=0x7f4514004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:54.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.139+0000 7f4534400640 1 --2- 172.21.15.138:0/3624358825 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4514003f40 0x7f4514004810 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f4518009ae0 tx=0x7f451801ca50 comp rx=0 tx=0).stop 2024-04-26T20:58:54.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.139+0000 7f4532400640 1 -- 172.21.15.138:0/3624358825 reap_dead start 2024-04-26T20:58:54.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.139+0000 7f4534400640 1 -- 172.21.15.138:0/3624358825 shutdown_connections 2024-04-26T20:58:54.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.139+0000 7f4534400640 1 -- 172.21.15.138:0/3624358825 >> 172.21.15.138:0/3624358825 conn(0x7f452c0d2d80 msgr2=0x7f452c0d3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:54.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.139+0000 7f4534400640 1 -- 172.21.15.138:0/3624358825 shutdown_connections 2024-04-26T20:58:54.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.139+0000 7f4534400640 1 -- 172.21.15.138:0/3624358825 wait complete. 2024-04-26T20:58:54.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.139+0000 7f4534400640 1 Processor -- start 2024-04-26T20:58:54.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.139+0000 7f4534400640 1 -- start start 2024-04-26T20:58:54.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.139+0000 7f4534400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4514003f40 0x7f452c14d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:54.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.139+0000 7f4534400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f452c15b720 0x7f452c09e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:54.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.139+0000 7f4534400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f452c1e26b0 0x7f452c0cc020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:54.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.139+0000 7f4534400640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f452c0d0950 con 0x7f452c1e26b0 2024-04-26T20:58:54.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.139+0000 7f4534400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f452c15d4d0 con 0x7f4514003f40 2024-04-26T20:58:54.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.139+0000 7f4534400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f452c0d0ad0 con 0x7f452c15b720 2024-04-26T20:58:54.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.139+0000 7f4532400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f452c1e26b0 0x7f452c0cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:54.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.139+0000 7f4531a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4514003f40 0x7f452c14d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:54.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.139+0000 7f4531a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4514003f40 0x7f452c14d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.138:56178/0 (socket says 172.21.15.138:56178) 2024-04-26T20:58:54.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.139+0000 7f4532400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f452c1e26b0 0x7f452c0cc020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:39750/0 (socket says 172.21.15.138:39750) 2024-04-26T20:58:54.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.139+0000 7f4531a00640 1 -- 172.21.15.138:0/817025662 learned_addr learned my addr 172.21.15.138:0/817025662 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:54.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.139+0000 7f4531000640 1 --2- 172.21.15.138:0/817025662 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f452c15b720 0x7f452c09e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:54.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.139+0000 7f4532400640 1 -- 172.21.15.138:0/817025662 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f452c15b720 msgr2=0x7f452c09e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:54.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.139+0000 7f4532400640 1 --2- 172.21.15.138:0/817025662 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f452c15b720 0x7f452c09e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:54.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.139+0000 7f4532400640 1 -- 172.21.15.138:0/817025662 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4514003f40 msgr2=0x7f452c14d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:54.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.139+0000 7f4532400640 1 --2- 172.21.15.138:0/817025662 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4514003f40 0x7f452c14d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:54.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.139+0000 7f4532400640 1 -- 172.21.15.138:0/817025662 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f452c14e140 con 0x7f452c1e26b0 2024-04-26T20:58:54.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.139+0000 7f4532400640 1 --2- 172.21.15.138:0/817025662 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f452c1e26b0 0x7f452c0cc020 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f452c073740 tx=0x7f4524011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:54.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.143+0000 7f4529600640 1 -- 172.21.15.138:0/817025662 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4524019070 con 0x7f452c1e26b0 2024-04-26T20:58:54.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.143+0000 7f4529600640 1 -- 172.21.15.138:0/817025662 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4524004020 con 0x7f452c1e26b0 2024-04-26T20:58:54.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.143+0000 7f4534400640 1 -- 172.21.15.138:0/817025662 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f452c14e420 con 0x7f452c1e26b0 2024-04-26T20:58:54.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.143+0000 7f4529600640 1 -- 172.21.15.138:0/817025662 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45240096b0 con 0x7f452c1e26b0 2024-04-26T20:58:54.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.143+0000 7f4534400640 1 -- 172.21.15.138:0/817025662 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f452c14e9e0 con 0x7f452c1e26b0 2024-04-26T20:58:54.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.143+0000 7f4534400640 1 -- 172.21.15.138:0/817025662 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f452c069510 con 0x7f452c1e26b0 2024-04-26T20:58:54.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.143+0000 7f4529600640 1 -- 172.21.15.138:0/817025662 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4524012040 con 0x7f452c1e26b0 2024-04-26T20:58:54.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.143+0000 7f4529600640 1 --2- 172.21.15.138:0/817025662 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f450c068380 0x7f450c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:54.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.143+0000 7f4529600640 1 -- 172.21.15.138:0/817025662 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5421+0+0 (secure 0 0 0) 0x7f45240864b0 con 0x7f452c1e26b0 2024-04-26T20:58:54.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.143+0000 7f4531a00640 1 --2- 172.21.15.138:0/817025662 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f450c068380 0x7f450c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:54.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.147+0000 7f4531a00640 1 --2- 172.21.15.138:0/817025662 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f450c068380 0x7f450c06a840 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f4520005f20 tx=0x7f452000a060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:54.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.147+0000 7f4529600640 1 -- 172.21.15.138:0/817025662 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4524056530 con 0x7f452c1e26b0 2024-04-26T20:58:54.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.307+0000 7f4534400640 1 -- 172.21.15.138:0/817025662 --> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f452c0d05e0 con 0x7f450c068380 2024-04-26T20:58:54.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.307+0000 7f4529600640 1 -- 172.21.15.138:0/817025662 <== mgr.4100 v2:172.21.15.143:6832/4275464198 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f452c0d05e0 con 0x7f450c068380 2024-04-26T20:58:54.309 INFO:teuthology.orchestra.run.smithi138.stderr:instructed osd(s) 7 to deep-scrub 2024-04-26T20:58:54.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.311+0000 7f4534400640 1 -- 172.21.15.138:0/817025662 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f450c068380 msgr2=0x7f450c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:54.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.311+0000 7f4534400640 1 --2- 172.21.15.138:0/817025662 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f450c068380 0x7f450c06a840 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f4520005f20 tx=0x7f452000a060 comp rx=0 tx=0).stop 2024-04-26T20:58:54.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.311+0000 7f4534400640 1 -- 172.21.15.138:0/817025662 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f452c1e26b0 msgr2=0x7f452c0cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:54.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.311+0000 7f4534400640 1 --2- 172.21.15.138:0/817025662 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f452c1e26b0 0x7f452c0cc020 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f452c073740 tx=0x7f4524011d60 comp rx=0 tx=0).stop 2024-04-26T20:58:54.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.311+0000 7f4534400640 1 -- 172.21.15.138:0/817025662 shutdown_connections 2024-04-26T20:58:54.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.311+0000 7f4534400640 1 --2- 172.21.15.138:0/817025662 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f450c068380 0x7f450c06a840 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:54.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.311+0000 7f4534400640 1 --2- 172.21.15.138:0/817025662 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f452c1e26b0 0x7f452c0cc020 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:54.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.311+0000 7f4534400640 1 --2- 172.21.15.138:0/817025662 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f452c15b720 0x7f452c09e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:54.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.311+0000 7f4534400640 1 --2- 172.21.15.138:0/817025662 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4514003f40 0x7f452c14d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:54.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.311+0000 7f4534400640 1 -- 172.21.15.138:0/817025662 >> 172.21.15.138:0/817025662 conn(0x7f452c0d2d80 msgr2=0x7f452c06d780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:54.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.311+0000 7f4534400640 1 -- 172.21.15.138:0/817025662 shutdown_connections 2024-04-26T20:58:54.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.311+0000 7f4534400640 1 -- 172.21.15.138:0/817025662 wait complete. 2024-04-26T20:58:54.331 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T20:58:54.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.467+0000 7f1ce6c00640 1 Processor -- start 2024-04-26T20:58:54.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.467+0000 7f1ce6c00640 1 -- start start 2024-04-26T20:58:54.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.467+0000 7f1ce6c00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f1ce00d3760 0x7f1ce0070680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:54.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.467+0000 7f1ce6c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1ce0071340 0x7f1ce00b13d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:54.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.467+0000 7f1ce6c00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ce0070cf0 con 0x7f1ce0160530 2024-04-26T20:58:54.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.467+0000 7f1ce6c00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f1ce00d1220 con 0x7f1ce00d3760 2024-04-26T20:58:54.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.467+0000 7f1ce6c00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f1ce0070fd0 con 0x7f1ce0071340 2024-04-26T20:58:54.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.467+0000 7f1ce4e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f1ce00d3760 0x7f1ce0070680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:54.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.467+0000 7f1ce5800640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f1ce0160530 0x7f1ce006ff70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:58520/0 (socket says 172.21.15.138:58520) 2024-04-26T20:58:54.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.467+0000 7f1ce5800640 1 -- 172.21.15.138:0/2935367711 learned_addr learned my addr 172.21.15.138:0/2935367711 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:58:54.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.467+0000 7f1ce6200640 1 --2- 172.21.15.138:0/2935367711 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1ce0071340 0x7f1ce00b13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:54.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.467+0000 7f1ce4e00640 1 -- 172.21.15.138:0/2935367711 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1ce0071340 msgr2=0x7f1ce00b13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:58:54.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.467+0000 7f1ce4e00640 1 --2- 172.21.15.138:0/2935367711 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1ce0071340 0x7f1ce00b13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:54.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.467+0000 7f1ce4e00640 1 -- 172.21.15.138:0/2935367711 >> v1:172.21.15.138:6789/0 conn(0x7f1ce0160530 legacy=0x7f1ce006ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:54.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.467+0000 7f1ce4e00640 1 -- 172.21.15.138:0/2935367711 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ce00d1470 con 0x7f1ce00d3760 2024-04-26T20:58:54.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.467+0000 7f1cdfe00640 1 -- 172.21.15.138:0/2935367711 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2050758536 0 0) 0x7f1ce0070cf0 con 0x7f1ce0160530 2024-04-26T20:58:54.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.471+0000 7f1ce4e00640 1 --2- 172.21.15.138:0/2935367711 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ce00d3760 0x7f1ce0070680 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc0097c0 tx=0x7f1ccc01c2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c15a13a5fc1af6ce server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:54.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.471+0000 7f1cdfe00640 1 -- 172.21.15.138:0/2935367711 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc0b0070 con 0x7f1ce00d3760 2024-04-26T20:58:54.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.471+0000 7f1cdfe00640 1 -- 172.21.15.138:0/2935367711 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ccc0ab600 con 0x7f1ce00d3760 2024-04-26T20:58:54.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.471+0000 7f1cdfe00640 1 -- 172.21.15.138:0/2935367711 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc0ab9d0 con 0x7f1ce00d3760 2024-04-26T20:58:54.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.471+0000 7f1ce6c00640 1 -- 172.21.15.138:0/2935367711 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ce00d3760 msgr2=0x7f1ce0070680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:54.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.471+0000 7f1ce6c00640 1 --2- 172.21.15.138:0/2935367711 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ce00d3760 0x7f1ce0070680 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc0097c0 tx=0x7f1ccc01c2c0 comp rx=0 tx=0).stop 2024-04-26T20:58:54.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.471+0000 7f1ce6c00640 1 -- 172.21.15.138:0/2935367711 shutdown_connections 2024-04-26T20:58:54.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.471+0000 7f1ce6c00640 1 --2- 172.21.15.138:0/2935367711 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1ce0071340 0x7f1ce00b13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:54.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.471+0000 7f1ce6c00640 1 --2- 172.21.15.138:0/2935367711 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ce00d3760 0x7f1ce0070680 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:54.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.471+0000 7f1ce6c00640 1 -- 172.21.15.138:0/2935367711 >> 172.21.15.138:0/2935367711 conn(0x7f1ce00d2c40 msgr2=0x7f1ce00d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:54.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.471+0000 7f1ce6c00640 1 -- 172.21.15.138:0/2935367711 shutdown_connections 2024-04-26T20:58:54.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.471+0000 7f1ce6c00640 1 -- 172.21.15.138:0/2935367711 wait complete. 2024-04-26T20:58:54.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.471+0000 7f1ce6c00640 1 Processor -- start 2024-04-26T20:58:54.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.471+0000 7f1ce6c00640 1 -- start start 2024-04-26T20:58:54.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.475+0000 7f1ce6c00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ce0071340 0x7f1ce0153df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:54.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.475+0000 7f1ce6c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1ce00d3760 0x7f1ce00c5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:54.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.475+0000 7f1ce6c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1ce0160530 0x7f1ce00ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:54.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.475+0000 7f1ce6c00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce00b22a0 con 0x7f1ce0071340 2024-04-26T20:58:54.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.475+0000 7f1ce6c00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce00b2120 con 0x7f1ce0160530 2024-04-26T20:58:54.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.475+0000 7f1ce6c00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f1ce00b2420 con 0x7f1ce00d3760 2024-04-26T20:58:54.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.475+0000 7f1ce5800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ce0071340 0x7f1ce0153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:54.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.475+0000 7f1ce5800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ce0071340 0x7f1ce0153df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:39766/0 (socket says 172.21.15.138:39766) 2024-04-26T20:58:54.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.475+0000 7f1ce5800640 1 -- 172.21.15.138:0/3263834847 learned_addr learned my addr 172.21.15.138:0/3263834847 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:58:54.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.475+0000 7f1ce4e00640 1 --2- 172.21.15.138:0/3263834847 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1ce00d3760 0x7f1ce00c5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:54.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.475+0000 7f1ce6200640 1 --2- 172.21.15.138:0/3263834847 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1ce0160530 0x7f1ce00ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:54.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.475+0000 7f1ce5800640 1 -- 172.21.15.138:0/3263834847 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1ce00d3760 msgr2=0x7f1ce00c5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:54.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.475+0000 7f1ce5800640 1 --2- 172.21.15.138:0/3263834847 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1ce00d3760 0x7f1ce00c5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:54.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.475+0000 7f1ce5800640 1 -- 172.21.15.138:0/3263834847 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1ce0160530 msgr2=0x7f1ce00ce3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:54.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.475+0000 7f1ce5800640 1 --2- 172.21.15.138:0/3263834847 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1ce0160530 0x7f1ce00ce3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:54.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.475+0000 7f1ce5800640 1 -- 172.21.15.138:0/3263834847 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ce00cf100 con 0x7f1ce0071340 2024-04-26T20:58:54.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.475+0000 7f1ce6200640 1 --2- 172.21.15.138:0/3263834847 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1ce0160530 0x7f1ce00ce3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:58:54.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.475+0000 7f1ce5800640 1 --2- 172.21.15.138:0/3263834847 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ce0071340 0x7f1ce0153df0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f1cd400c480 tx=0x7f1cd400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:54.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.475+0000 7f1cdd600640 1 -- 172.21.15.138:0/3263834847 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd4018070 con 0x7f1ce0071340 2024-04-26T20:58:54.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.475+0000 7f1cdd600640 1 -- 172.21.15.138:0/3263834847 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cd4007500 con 0x7f1ce0071340 2024-04-26T20:58:54.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.475+0000 7f1cdd600640 1 -- 172.21.15.138:0/3263834847 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd4004a30 con 0x7f1ce0071340 2024-04-26T20:58:54.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.475+0000 7f1ce6c00640 1 -- 172.21.15.138:0/3263834847 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ce00cf3e0 con 0x7f1ce0071340 2024-04-26T20:58:54.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.475+0000 7f1ce6c00640 1 -- 172.21.15.138:0/3263834847 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ce00cf9a0 con 0x7f1ce0071340 2024-04-26T20:58:54.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.475+0000 7f1ce6c00640 1 -- 172.21.15.138:0/3263834847 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ce0069430 con 0x7f1ce0071340 2024-04-26T20:58:54.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.475+0000 7f1cdd600640 1 -- 172.21.15.138:0/3263834847 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1cd401b070 con 0x7f1ce0071340 2024-04-26T20:58:54.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.479+0000 7f1cdd600640 1 --2- 172.21.15.138:0/3263834847 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1cc00683d0 0x7f1cc006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:54.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.479+0000 7f1cdd600640 1 -- 172.21.15.138:0/3263834847 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5421+0+0 (secure 0 0 0) 0x7f1cd4085c30 con 0x7f1ce0071340 2024-04-26T20:58:54.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.479+0000 7f1ce4e00640 1 --2- 172.21.15.138:0/3263834847 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1cc00683d0 0x7f1cc006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:54.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.479+0000 7f1ce4e00640 1 --2- 172.21.15.138:0/3263834847 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1cc00683d0 0x7f1cc006a890 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc0ad000 tx=0x7f1ccc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:54.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.483+0000 7f1cdd600640 1 -- 172.21.15.138:0/3263834847 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1cd4055d30 con 0x7f1ce0071340 2024-04-26T20:58:54.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.635+0000 7f1ce6c00640 1 -- 172.21.15.138:0/3263834847 --> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1ce0154480 con 0x7f1cc00683d0 2024-04-26T20:58:54.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.639+0000 7f1cdd600640 1 -- 172.21.15.138:0/3263834847 <== mgr.4100 v2:172.21.15.143:6832/4275464198 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13381 (secure 0 0 0) 0x7f1ccc0b1040 con 0x7f1cc00683d0 2024-04-26T20:58:54.640 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:58:54.640 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-04-26T20:58:54.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.639+0000 7f1ce6c00640 1 -- 172.21.15.138:0/3263834847 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1cc00683d0 msgr2=0x7f1cc006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:54.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.639+0000 7f1ce6c00640 1 --2- 172.21.15.138:0/3263834847 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1cc00683d0 0x7f1cc006a890 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc0ad000 tx=0x7f1ccc0a6000 comp rx=0 tx=0).stop 2024-04-26T20:58:54.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.639+0000 7f1ce6c00640 1 -- 172.21.15.138:0/3263834847 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ce0071340 msgr2=0x7f1ce0153df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:54.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.639+0000 7f1ce6c00640 1 --2- 172.21.15.138:0/3263834847 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ce0071340 0x7f1ce0153df0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f1cd400c480 tx=0x7f1cd400c940 comp rx=0 tx=0).stop 2024-04-26T20:58:54.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.639+0000 7f1ce6c00640 1 -- 172.21.15.138:0/3263834847 shutdown_connections 2024-04-26T20:58:54.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.639+0000 7f1ce6c00640 1 --2- 172.21.15.138:0/3263834847 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f1cc00683d0 0x7f1cc006a890 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:54.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.639+0000 7f1ce6c00640 1 --2- 172.21.15.138:0/3263834847 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1ce0160530 0x7f1ce00ce3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:54.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.639+0000 7f1ce6c00640 1 --2- 172.21.15.138:0/3263834847 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1ce00d3760 0x7f1ce00c5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:54.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.639+0000 7f1ce6c00640 1 --2- 172.21.15.138:0/3263834847 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ce0071340 0x7f1ce0153df0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:54.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.639+0000 7f1ce6c00640 1 -- 172.21.15.138:0/3263834847 >> 172.21.15.138:0/3263834847 conn(0x7f1ce00d2c40 msgr2=0x7f1ce014ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:54.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.639+0000 7f1ce6c00640 1 -- 172.21.15.138:0/3263834847 shutdown_connections 2024-04-26T20:58:54.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:58:54.639+0000 7f1ce6c00640 1 -- 172.21.15.138:0/3263834847 wait complete. 2024-04-26T20:58:54.660 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":123,"stamp":"2024-04-26T20:58:53.272900+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":226584,"kb_used_data":6248,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748136,"statfs":{"total":773094113280,"available":772862091264,"internally_reserved":0,"allocated":6397952,"data_stored":3534392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":225496627},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6291456,"num_objects":-2,"num_object_clones":0,"num_object_copies":-4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2,"num_whiteouts":0,"num_read":-16,"num_read_kb":-9,"num_write":-8,"num_write_kb":-6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.439630"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":231,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-26T20:58:44.837429+0000","last_change":"2024-04-26T20:56:29.347462+0000","last_active":"2024-04-26T20:58:44.837429+0000","last_peered":"2024-04-26T20:58:44.837429+0000","last_clean":"2024-04-26T20:58:44.837429+0000","last_became_active":"2024-04-26T20:56:29.346224+0000","last_became_peered":"2024-04-26T20:56:29.346224+0000","last_unstale":"2024-04-26T20:58:44.837429+0000","last_undegraded":"2024-04-26T20:58:44.837429+0000","last_fullsized":"2024-04-26T20:58:44.837429+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:56:28.079105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:56:28.079105+0000","last_clean_scrub_stamp":"2024-04-26T20:56:28.079105+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509473,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27660,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":651264,"data_stored":294207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509472,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27656,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":651264,"data_stored":294207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509473,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28240,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343600,"statfs":{"total":96636764160,"available":96607846400,"internally_reserved":0,"allocated":1245184,"data_stored":884575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509473,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27656,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":651264,"data_stored":294207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509473,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27660,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":651264,"data_stored":294207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509472,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32400,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339440,"statfs":{"total":96636764160,"available":96603586560,"internally_reserved":0,"allocated":1245184,"data_stored":884575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509471,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27656,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":651264,"data_stored":294207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27656,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":651264,"data_stored":294207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T20:58:54.663 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T20:56:28.079105+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=56, tm_sec=28, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=58, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:58:54.663 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T20:59:07.942 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:59:07.946 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:59:14.664 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T20:59:14.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.807+0000 7f0f2cc00640 1 Processor -- start 2024-04-26T20:59:14.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.807+0000 7f0f2cc00640 1 -- start start 2024-04-26T20:59:14.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.811+0000 7f0f2cc00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f0f280cbe00 0x7f0f2806de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:59:14.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.811+0000 7f0f2cc00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f280727f0 con 0x7f0f2815cf80 2024-04-26T20:59:14.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.811+0000 7f0f2cc00640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f28072a70 con 0x7f0f280cc1e0 2024-04-26T20:59:14.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.811+0000 7f0f2cc00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7f0f28074220 con 0x7f0f280cbe00 2024-04-26T20:59:14.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.811+0000 7f0f25e00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f0f280cbe00 0x7f0f2806de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:59:14.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.811+0000 7f0f26800640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f0f2815cf80 0x7f0f280ce6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:37100/0 (socket says 172.21.15.138:37100) 2024-04-26T20:59:14.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.811+0000 7f0f26800640 1 -- 172.21.15.138:0/3436595229 learned_addr learned my addr 172.21.15.138:0/3436595229 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:59:14.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.811+0000 7f0f25e00640 1 -- 172.21.15.138:0/3436595229 >> v1:172.21.15.143:6789/0 conn(0x7f0f280cc1e0 legacy=0x7f0f28073b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:59:14.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.811+0000 7f0f25e00640 1 -- 172.21.15.138:0/3436595229 >> v1:172.21.15.138:6789/0 conn(0x7f0f2815cf80 legacy=0x7f0f280ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:59:14.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.811+0000 7f0f25e00640 1 -- 172.21.15.138:0/3436595229 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f28072d50 con 0x7f0f280cbe00 2024-04-26T20:59:14.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.811+0000 7f0f24a00640 1 -- 172.21.15.138:0/3436595229 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3286981852 0 0) 0x7f0f200014a0 con 0x7f0f2815cf80 2024-04-26T20:59:14.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.815+0000 7f0f25e00640 1 --2- 172.21.15.138:0/3436595229 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f280cbe00 0x7f0f2806de70 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f0f180097c0 tx=0x7f0f1801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c3e25e9775dd09e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:59:14.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.815+0000 7f0f24a00640 1 -- 172.21.15.138:0/3436595229 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f180b0070 con 0x7f0f280cbe00 2024-04-26T20:59:14.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.815+0000 7f0f24a00640 1 -- 172.21.15.138:0/3436595229 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f180ab600 con 0x7f0f280cbe00 2024-04-26T20:59:14.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.815+0000 7f0f24a00640 1 -- 172.21.15.138:0/3436595229 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f180ab9d0 con 0x7f0f280cbe00 2024-04-26T20:59:14.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.815+0000 7f0f2cc00640 1 -- 172.21.15.138:0/3436595229 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f280cbe00 msgr2=0x7f0f2806de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:59:14.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.815+0000 7f0f2cc00640 1 --2- 172.21.15.138:0/3436595229 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f280cbe00 0x7f0f2806de70 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f0f180097c0 tx=0x7f0f1801c460 comp rx=0 tx=0).stop 2024-04-26T20:59:14.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.815+0000 7f0f2cc00640 1 -- 172.21.15.138:0/3436595229 shutdown_connections 2024-04-26T20:59:14.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.815+0000 7f0f2cc00640 1 --2- 172.21.15.138:0/3436595229 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f280cbe00 0x7f0f2806de70 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:59:14.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.815+0000 7f0f2cc00640 1 -- 172.21.15.138:0/3436595229 >> 172.21.15.138:0/3436595229 conn(0x7f0f280d0b20 msgr2=0x7f0f280d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:59:14.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.815+0000 7f0f2cc00640 1 -- 172.21.15.138:0/3436595229 shutdown_connections 2024-04-26T20:59:14.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.815+0000 7f0f2cc00640 1 -- 172.21.15.138:0/3436595229 wait complete. 2024-04-26T20:59:14.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.815+0000 7f0f2cc00640 1 Processor -- start 2024-04-26T20:59:14.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.815+0000 7f0f2cc00640 1 -- start start 2024-04-26T20:59:14.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.819+0000 7f0f2cc00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f280cbe00 0x7f0f28146e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:59:14.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.819+0000 7f0f2cc00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0f280cc1e0 0x7f0f2815bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:59:14.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.819+0000 7f0f2cc00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0f2815cf80 0x7f0f2815c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:59:14.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.819+0000 7f0f2cc00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f0f280d0780 con 0x7f0f280cbe00 2024-04-26T20:59:14.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.819+0000 7f0f2cc00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f0f28073680 con 0x7f0f2815cf80 2024-04-26T20:59:14.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.819+0000 7f0f2cc00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f0f280d0900 con 0x7f0f280cc1e0 2024-04-26T20:59:14.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.819+0000 7f0f25e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f280cbe00 0x7f0f28146e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:59:14.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.819+0000 7f0f25e00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f280cbe00 0x7f0f28146e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:53918/0 (socket says 172.21.15.138:53918) 2024-04-26T20:59:14.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.819+0000 7f0f25e00640 1 -- 172.21.15.138:0/3616329159 learned_addr learned my addr 172.21.15.138:0/3616329159 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:59:14.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.819+0000 7f0f25400640 1 --2- 172.21.15.138:0/3616329159 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0f280cc1e0 0x7f0f2815bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:59:14.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.819+0000 7f0f26800640 1 --2- 172.21.15.138:0/3616329159 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0f2815cf80 0x7f0f2815c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:59:14.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.819+0000 7f0f25e00640 1 -- 172.21.15.138:0/3616329159 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0f280cc1e0 msgr2=0x7f0f2815bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:59:14.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.819+0000 7f0f25e00640 1 --2- 172.21.15.138:0/3616329159 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0f280cc1e0 0x7f0f2815bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:59:14.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.819+0000 7f0f25e00640 1 -- 172.21.15.138:0/3616329159 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0f2815cf80 msgr2=0x7f0f2815c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:59:14.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.819+0000 7f0f25e00640 1 --2- 172.21.15.138:0/3616329159 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0f2815cf80 0x7f0f2815c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:59:14.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.819+0000 7f0f25e00640 1 -- 172.21.15.138:0/3616329159 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f28147350 con 0x7f0f280cbe00 2024-04-26T20:59:14.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.819+0000 7f0f25e00640 1 --2- 172.21.15.138:0/3616329159 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f280cbe00 0x7f0f28146e10 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f0f180ae040 tx=0x7f0f1801aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:59:14.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.819+0000 7f0f1e000640 1 -- 172.21.15.138:0/3616329159 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f180bb070 con 0x7f0f280cbe00 2024-04-26T20:59:14.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.819+0000 7f0f1e000640 1 -- 172.21.15.138:0/3616329159 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f18004020 con 0x7f0f280cbe00 2024-04-26T20:59:14.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.819+0000 7f0f1e000640 1 -- 172.21.15.138:0/3616329159 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f180b0040 con 0x7f0f280cbe00 2024-04-26T20:59:14.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.819+0000 7f0f2cc00640 1 -- 172.21.15.138:0/3616329159 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f280b3a30 con 0x7f0f280cbe00 2024-04-26T20:59:14.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.819+0000 7f0f2cc00640 1 -- 172.21.15.138:0/3616329159 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f280b3ff0 con 0x7f0f280cbe00 2024-04-26T20:59:14.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.819+0000 7f0f2cc00640 1 -- 172.21.15.138:0/3616329159 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f28069510 con 0x7f0f280cbe00 2024-04-26T20:59:14.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.819+0000 7f0f1e000640 1 -- 172.21.15.138:0/3616329159 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0f18003620 con 0x7f0f280cbe00 2024-04-26T20:59:14.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.823+0000 7f0f1e000640 1 --2- 172.21.15.138:0/3616329159 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0f04068380 0x7f0f0406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:59:14.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.823+0000 7f0f1e000640 1 -- 172.21.15.138:0/3616329159 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5421+0+0 (secure 0 0 0) 0x7f0f18120e40 con 0x7f0f280cbe00 2024-04-26T20:59:14.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.823+0000 7f0f25400640 1 --2- 172.21.15.138:0/3616329159 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0f04068380 0x7f0f0406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:59:14.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.823+0000 7f0f25400640 1 --2- 172.21.15.138:0/3616329159 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0f04068380 0x7f0f0406a840 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0f28157dd0 tx=0x7f0f10009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:59:14.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.827+0000 7f0f1e000640 1 -- 172.21.15.138:0/3616329159 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0f18016050 con 0x7f0f280cbe00 2024-04-26T20:59:14.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.979+0000 7f0f2cc00640 1 -- 172.21.15.138:0/3616329159 --> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0f280b37e0 con 0x7f0f04068380 2024-04-26T20:59:14.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.979+0000 7f0f1e000640 1 -- 172.21.15.138:0/3616329159 <== mgr.4100 v2:172.21.15.143:6832/4275464198 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13359 (secure 0 0 0) 0x7f0f280b37e0 con 0x7f0f04068380 2024-04-26T20:59:14.983 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:59:14.983 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-04-26T20:59:14.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.983+0000 7f0f2cc00640 1 -- 172.21.15.138:0/3616329159 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0f04068380 msgr2=0x7f0f0406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:59:14.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.983+0000 7f0f2cc00640 1 --2- 172.21.15.138:0/3616329159 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0f04068380 0x7f0f0406a840 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0f28157dd0 tx=0x7f0f10009040 comp rx=0 tx=0).stop 2024-04-26T20:59:14.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.983+0000 7f0f2cc00640 1 -- 172.21.15.138:0/3616329159 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f280cbe00 msgr2=0x7f0f28146e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:59:14.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.983+0000 7f0f2cc00640 1 --2- 172.21.15.138:0/3616329159 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f280cbe00 0x7f0f28146e10 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f0f180ae040 tx=0x7f0f1801aca0 comp rx=0 tx=0).stop 2024-04-26T20:59:14.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.983+0000 7f0f2cc00640 1 -- 172.21.15.138:0/3616329159 shutdown_connections 2024-04-26T20:59:14.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.983+0000 7f0f2cc00640 1 --2- 172.21.15.138:0/3616329159 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f0f04068380 0x7f0f0406a840 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:59:14.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.983+0000 7f0f2cc00640 1 --2- 172.21.15.138:0/3616329159 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0f2815cf80 0x7f0f2815c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:59:14.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.983+0000 7f0f2cc00640 1 --2- 172.21.15.138:0/3616329159 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0f280cc1e0 0x7f0f2815bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:59:14.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.983+0000 7f0f2cc00640 1 --2- 172.21.15.138:0/3616329159 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f280cbe00 0x7f0f28146e10 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:59:14.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.983+0000 7f0f2cc00640 1 -- 172.21.15.138:0/3616329159 >> 172.21.15.138:0/3616329159 conn(0x7f0f280d0b20 msgr2=0x7f0f281552b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:59:14.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.983+0000 7f0f2cc00640 1 -- 172.21.15.138:0/3616329159 shutdown_connections 2024-04-26T20:59:14.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:14.983+0000 7f0f2cc00640 1 -- 172.21.15.138:0/3616329159 wait complete. 2024-04-26T20:59:15.004 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":133,"stamp":"2024-04-26T20:59:13.277540+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":226568,"kb_used_data":6248,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748152,"statfs":{"total":773094113280,"available":772862107648,"internally_reserved":0,"allocated":6397952,"data_stored":3534392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":225496627},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002938"},"pg_stats":[{"pgid":"1.0","version":"55'119","reported_seq":241,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-26T20:58:52.104419+0000","last_change":"2024-04-26T20:58:52.104446+0000","last_active":"2024-04-26T20:58:52.104419+0000","last_peered":"2024-04-26T20:58:52.104419+0000","last_clean":"2024-04-26T20:58:52.104419+0000","last_became_active":"2024-04-26T20:56:29.346224+0000","last_became_peered":"2024-04-26T20:56:29.346224+0000","last_unstale":"2024-04-26T20:58:52.104419+0000","last_undegraded":"2024-04-26T20:58:52.104419+0000","last_fullsized":"2024-04-26T20:58:52.104419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'119","last_scrub_stamp":"2024-04-26T20:58:52.104359+0000","last_deep_scrub":"55'119","last_deep_scrub_stamp":"2024-04-26T20:58:52.104359+0000","last_clean_scrub_stamp":"2024-04-26T20:58:52.104359+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:03.960066+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509477,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27660,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":651264,"data_stored":294207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509476,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27656,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":651264,"data_stored":294207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509477,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28232,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343608,"statfs":{"total":96636764160,"available":96607854592,"internally_reserved":0,"allocated":1245184,"data_stored":884575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509477,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27656,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":651264,"data_stored":294207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509477,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27660,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":651264,"data_stored":294207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509476,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32392,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339448,"statfs":{"total":96636764160,"available":96603594752,"internally_reserved":0,"allocated":1245184,"data_stored":884575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509475,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27656,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":651264,"data_stored":294207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27656,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":651264,"data_stored":294207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T20:59:15.005 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-26T20:59:15.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.135+0000 7f86efe00640 1 Processor -- start 2024-04-26T20:59:15.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.139+0000 7f86efe00640 1 -- start start 2024-04-26T20:59:15.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.139+0000 7f86efe00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f86f015d190 0x7f86f00d3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:59:15.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.139+0000 7f86efe00640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f86f00d18e0 0x7f86f00aff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:59:15.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.139+0000 7f86efe00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86f00cfc30 con 0x7f86f00b1c10 2024-04-26T20:59:15.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.139+0000 7f86efe00640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f86f015d570 con 0x7f86f00d18e0 2024-04-26T20:59:15.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.139+0000 7f86efe00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f86f00cff10 con 0x7f86f015d190 2024-04-26T20:59:15.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.139+0000 7f86ee000640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f86f00b1c10 0x7f86f00d11d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:37102/0 (socket says 172.21.15.138:37102) 2024-04-26T20:59:15.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.139+0000 7f86ee000640 1 -- 172.21.15.138:0/2639770382 learned_addr learned my addr 172.21.15.138:0/2639770382 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:59:15.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.139+0000 7f86eea00640 1 --2- 172.21.15.138:0/2639770382 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f86f015d190 0x7f86f00d3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:59:15.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.139+0000 7f86ef400640 1 --2- 172.21.15.138:0/2639770382 >> v2:172.21.15.143:3300/0 conn(0x7f86f00d18e0 0x7f86f00aff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:59:15.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.139+0000 7f86ed600640 1 -- 172.21.15.138:0/2639770382 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1899190850 0 0) 0x7f86f00cfc30 con 0x7f86f00b1c10 2024-04-26T20:59:15.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.139+0000 7f86ed600640 1 -- 172.21.15.138:0/2639770382 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86d4003530 con 0x7f86f00b1c10 2024-04-26T20:59:15.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.139+0000 7f86eea00640 1 -- 172.21.15.138:0/2639770382 >> v2:172.21.15.143:3300/0 conn(0x7f86f00d18e0 msgr2=0x7f86f00aff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:59:15.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.139+0000 7f86eea00640 1 --2- 172.21.15.138:0/2639770382 >> v2:172.21.15.143:3300/0 conn(0x7f86f00d18e0 0x7f86f00aff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:59:15.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.139+0000 7f86eea00640 1 -- 172.21.15.138:0/2639770382 >> v1:172.21.15.138:6789/0 conn(0x7f86f00b1c10 legacy=0x7f86f00d11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:59:15.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.139+0000 7f86eea00640 1 -- 172.21.15.138:0/2639770382 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86f00d01f0 con 0x7f86f015d190 2024-04-26T20:59:15.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.143+0000 7f86eea00640 1 --2- 172.21.15.138:0/2639770382 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f86f015d190 0x7f86f00d3710 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f86e0009d90 tx=0x7f86e001c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82d1bbaea3acddac server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:59:15.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.143+0000 7f86ed600640 1 -- 172.21.15.138:0/2639770382 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e00b2070 con 0x7f86f015d190 2024-04-26T20:59:15.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.143+0000 7f86ed600640 1 -- 172.21.15.138:0/2639770382 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86e00a5910 con 0x7f86f015d190 2024-04-26T20:59:15.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.143+0000 7f86ed600640 1 -- 172.21.15.138:0/2639770382 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e00a5ce0 con 0x7f86f015d190 2024-04-26T20:59:15.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.143+0000 7f86efe00640 1 -- 172.21.15.138:0/2639770382 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f86f015d190 msgr2=0x7f86f00d3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:59:15.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.143+0000 7f86efe00640 1 --2- 172.21.15.138:0/2639770382 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f86f015d190 0x7f86f00d3710 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f86e0009d90 tx=0x7f86e001c940 comp rx=0 tx=0).stop 2024-04-26T20:59:15.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.143+0000 7f86efe00640 1 -- 172.21.15.138:0/2639770382 shutdown_connections 2024-04-26T20:59:15.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.143+0000 7f86efe00640 1 --2- 172.21.15.138:0/2639770382 >> v2:172.21.15.143:3300/0 conn(0x7f86f00d18e0 0x7f86f00aff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:59:15.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.143+0000 7f86efe00640 1 --2- 172.21.15.138:0/2639770382 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f86f015d190 0x7f86f00d3710 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:59:15.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.143+0000 7f86efe00640 1 -- 172.21.15.138:0/2639770382 >> 172.21.15.138:0/2639770382 conn(0x7f86f00d2bf0 msgr2=0x7f86f00d3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:59:15.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.143+0000 7f86efe00640 1 -- 172.21.15.138:0/2639770382 shutdown_connections 2024-04-26T20:59:15.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.143+0000 7f86efe00640 1 -- 172.21.15.138:0/2639770382 wait complete. 2024-04-26T20:59:15.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.147+0000 7f86efe00640 1 Processor -- start 2024-04-26T20:59:15.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.147+0000 7f86efe00640 1 -- start start 2024-04-26T20:59:15.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.147+0000 7f86efe00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f86f00b1c10 0x7f86f00c9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:59:15.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.147+0000 7f86efe00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f86f00d18e0 0x7f86f00cb690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:59:15.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.147+0000 7f86efe00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f86f015d190 0x7f86f015a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:59:15.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.147+0000 7f86efe00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f86f00b0dd0 con 0x7f86f00d18e0 2024-04-26T20:59:15.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.147+0000 7f86efe00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f86f00b0c50 con 0x7f86f015d190 2024-04-26T20:59:15.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.147+0000 7f86efe00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f86f00b0f50 con 0x7f86f00b1c10 2024-04-26T20:59:15.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.147+0000 7f86ee000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f86f00d18e0 0x7f86f00cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:59:15.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.147+0000 7f86ee000640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f86f00d18e0 0x7f86f00cb690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:53924/0 (socket says 172.21.15.138:53924) 2024-04-26T20:59:15.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.147+0000 7f86ee000640 1 -- 172.21.15.138:0/1600304764 learned_addr learned my addr 172.21.15.138:0/1600304764 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:59:15.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.147+0000 7f86eea00640 1 --2- 172.21.15.138:0/1600304764 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f86f00b1c10 0x7f86f00c9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:59:15.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.147+0000 7f86ef400640 1 --2- 172.21.15.138:0/1600304764 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f86f015d190 0x7f86f015a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:59:15.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.147+0000 7f86ee000640 1 -- 172.21.15.138:0/1600304764 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f86f00b1c10 msgr2=0x7f86f00c9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:59:15.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.147+0000 7f86ee000640 1 --2- 172.21.15.138:0/1600304764 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f86f00b1c10 0x7f86f00c9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:59:15.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.147+0000 7f86ee000640 1 -- 172.21.15.138:0/1600304764 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f86f015d190 msgr2=0x7f86f015a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:59:15.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.147+0000 7f86ee000640 1 --2- 172.21.15.138:0/1600304764 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f86f015d190 0x7f86f015a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:59:15.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.147+0000 7f86ee000640 1 -- 172.21.15.138:0/1600304764 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86f00cbbd0 con 0x7f86f00d18e0 2024-04-26T20:59:15.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.147+0000 7f86ee000640 1 --2- 172.21.15.138:0/1600304764 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f86f00d18e0 0x7f86f00cb690 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f86dc00c450 tx=0x7f86dc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:59:15.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.147+0000 7f86e6a00640 1 -- 172.21.15.138:0/1600304764 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86dc017070 con 0x7f86f00d18e0 2024-04-26T20:59:15.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.147+0000 7f86e6a00640 1 -- 172.21.15.138:0/1600304764 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86dc005cf0 con 0x7f86f00d18e0 2024-04-26T20:59:15.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.147+0000 7f86efe00640 1 -- 172.21.15.138:0/1600304764 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86f00cbe90 con 0x7f86f00d18e0 2024-04-26T20:59:15.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.147+0000 7f86e6a00640 1 -- 172.21.15.138:0/1600304764 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86dc007290 con 0x7f86f00d18e0 2024-04-26T20:59:15.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.147+0000 7f86efe00640 1 -- 172.21.15.138:0/1600304764 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86f00cc450 con 0x7f86f00d18e0 2024-04-26T20:59:15.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.147+0000 7f86efe00640 1 -- 172.21.15.138:0/1600304764 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86f0069430 con 0x7f86f00d18e0 2024-04-26T20:59:15.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.151+0000 7f86e6a00640 1 -- 172.21.15.138:0/1600304764 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f86dc01a070 con 0x7f86f00d18e0 2024-04-26T20:59:15.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.151+0000 7f86e6a00640 1 --2- 172.21.15.138:0/1600304764 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f86d0068380 0x7f86d006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:59:15.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.151+0000 7f86e6a00640 1 -- 172.21.15.138:0/1600304764 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5421+0+0 (secure 0 0 0) 0x7f86dc085c80 con 0x7f86f00d18e0 2024-04-26T20:59:15.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.151+0000 7f86eea00640 1 --2- 172.21.15.138:0/1600304764 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f86d0068380 0x7f86d006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:59:15.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.151+0000 7f86eea00640 1 --2- 172.21.15.138:0/1600304764 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f86d0068380 0x7f86d006a840 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f86e00af000 tx=0x7f86e00a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:59:15.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.155+0000 7f86e6a00640 1 -- 172.21.15.138:0/1600304764 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f86dc056350 con 0x7f86f00d18e0 2024-04-26T20:59:15.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.311+0000 7f86efe00640 1 -- 172.21.15.138:0/1600304764 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f86f00cf3b0 con 0x7f86f00d18e0 2024-04-26T20:59:15.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.319+0000 7f86e6a00640 1 -- 172.21.15.138:0/1600304764 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v14)=0 v14) ==== 123+0+0 (secure 0 0 0) 0x7f86dc055c50 con 0x7f86f00d18e0 2024-04-26T20:59:15.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.319+0000 7f86e6a00640 1 -- 172.21.15.138:0/1600304764 <== mon.0 v2:172.21.15.138:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f86dc05a000 con 0x7f86f00d18e0 2024-04-26T20:59:15.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.319+0000 7f86efe00640 1 -- 172.21.15.138:0/1600304764 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f86d0068380 msgr2=0x7f86d006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:59:15.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.319+0000 7f86efe00640 1 --2- 172.21.15.138:0/1600304764 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f86d0068380 0x7f86d006a840 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f86e00af000 tx=0x7f86e00a7070 comp rx=0 tx=0).stop 2024-04-26T20:59:15.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.319+0000 7f86efe00640 1 -- 172.21.15.138:0/1600304764 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f86f00d18e0 msgr2=0x7f86f00cb690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:59:15.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.319+0000 7f86efe00640 1 --2- 172.21.15.138:0/1600304764 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f86f00d18e0 0x7f86f00cb690 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f86dc00c450 tx=0x7f86dc00c910 comp rx=0 tx=0).stop 2024-04-26T20:59:15.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.319+0000 7f86efe00640 1 -- 172.21.15.138:0/1600304764 shutdown_connections 2024-04-26T20:59:15.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.319+0000 7f86efe00640 1 --2- 172.21.15.138:0/1600304764 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7f86d0068380 0x7f86d006a840 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:59:15.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.319+0000 7f86efe00640 1 --2- 172.21.15.138:0/1600304764 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f86f015d190 0x7f86f015a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:59:15.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.319+0000 7f86efe00640 1 --2- 172.21.15.138:0/1600304764 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f86f00d18e0 0x7f86f00cb690 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:59:15.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.319+0000 7f86efe00640 1 --2- 172.21.15.138:0/1600304764 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f86f00b1c10 0x7f86f00c9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:59:15.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.319+0000 7f86efe00640 1 -- 172.21.15.138:0/1600304764 >> 172.21.15.138:0/1600304764 conn(0x7f86f00d2bf0 msgr2=0x7f86f00d2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:59:15.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.319+0000 7f86efe00640 1 -- 172.21.15.138:0/1600304764 shutdown_connections 2024-04-26T20:59:15.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.319+0000 7f86efe00640 1 -- 172.21.15.138:0/1600304764 wait complete. 2024-04-26T20:59:15.341 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-26T20:59:15.342 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:59:15.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.475+0000 7fa96cc00640 1 Processor -- start 2024-04-26T20:59:15.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.475+0000 7fa96cc00640 1 -- start start 2024-04-26T20:59:15.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.479+0000 7fa96cc00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa96815cf80 0x7fa968073b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:59:15.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.479+0000 7fa96cc00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa9680cc1e0 0x7fa9680ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:59:15.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.479+0000 7fa96cc00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9680727f0 con 0x7fa9680cbe00 2024-04-26T20:59:15.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.479+0000 7fa96cc00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 -- 0x7fa968073680 con 0x7fa9680cc1e0 2024-04-26T20:59:15.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.479+0000 7fa96cc00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fa968072a70 con 0x7fa96815cf80 2024-04-26T20:59:15.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.479+0000 7fa965e00640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fa9680cbe00 0x7fa96806de70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:37106/0 (socket says 172.21.15.138:37106) 2024-04-26T20:59:15.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.479+0000 7fa965e00640 1 -- 172.21.15.138:0/1785754422 learned_addr learned my addr 172.21.15.138:0/1785754422 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-04-26T20:59:15.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.479+0000 7fa966800640 1 --2- 172.21.15.138:0/1785754422 >> v2:172.21.15.138:3300/0 conn(0x7fa9680cc1e0 0x7fa9680ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:59:15.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.479+0000 7fa965400640 1 -- 172.21.15.138:0/1785754422 <== mon.0 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3720897666 0 0) 0x7fa958001120 con 0x7fa9680cbe00 2024-04-26T20:59:15.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.479+0000 7fa965400640 1 -- 172.21.15.138:0/1785754422 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa94c005740 con 0x7fa9680cbe00 2024-04-26T20:59:15.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.479+0000 7fa95d400640 1 --2- 172.21.15.138:0/1785754422 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa96815cf80 0x7fa968073b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:59:15.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.479+0000 7fa966800640 1 -- 172.21.15.138:0/1785754422 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa96815cf80 msgr2=0x7fa968073b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:59:15.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.479+0000 7fa966800640 1 --2- 172.21.15.138:0/1785754422 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa96815cf80 0x7fa968073b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:59:15.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.479+0000 7fa966800640 1 -- 172.21.15.138:0/1785754422 >> v1:172.21.15.138:6789/0 conn(0x7fa9680cbe00 legacy=0x7fa96806de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:59:15.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.479+0000 7fa966800640 1 -- 172.21.15.138:0/1785754422 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa968072d50 con 0x7fa9680cc1e0 2024-04-26T20:59:15.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.479+0000 7fa95d400640 1 --2- 172.21.15.138:0/1785754422 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa96815cf80 0x7fa968073b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:59:15.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.483+0000 7fa966800640 1 --2- 172.21.15.138:0/1785754422 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9680cc1e0 0x7fa9680ce6f0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fa960009d90 tx=0x7fa96001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=855ec40e0bba2a65 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:59:15.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.483+0000 7fa965400640 1 -- 172.21.15.138:0/1785754422 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9600b2070 con 0x7fa9680cc1e0 2024-04-26T20:59:15.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.483+0000 7fa965400640 1 -- 172.21.15.138:0/1785754422 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa9600a5730 con 0x7fa9680cc1e0 2024-04-26T20:59:15.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.483+0000 7fa965400640 1 -- 172.21.15.138:0/1785754422 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9600a5ae0 con 0x7fa9680cc1e0 2024-04-26T20:59:15.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.483+0000 7fa96cc00640 1 -- 172.21.15.138:0/1785754422 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9680cc1e0 msgr2=0x7fa9680ce6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:59:15.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.483+0000 7fa96cc00640 1 --2- 172.21.15.138:0/1785754422 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9680cc1e0 0x7fa9680ce6f0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fa960009d90 tx=0x7fa96001c970 comp rx=0 tx=0).stop 2024-04-26T20:59:15.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.483+0000 7fa96cc00640 1 -- 172.21.15.138:0/1785754422 shutdown_connections 2024-04-26T20:59:15.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.483+0000 7fa96cc00640 1 --2- 172.21.15.138:0/1785754422 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9680cc1e0 0x7fa9680ce6f0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:59:15.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.483+0000 7fa96cc00640 1 --2- 172.21.15.138:0/1785754422 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa96815cf80 0x7fa968073b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:59:15.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.483+0000 7fa96cc00640 1 -- 172.21.15.138:0/1785754422 >> 172.21.15.138:0/1785754422 conn(0x7fa9680d0b20 msgr2=0x7fa9680d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:59:15.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.483+0000 7fa96cc00640 1 -- 172.21.15.138:0/1785754422 shutdown_connections 2024-04-26T20:59:15.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.483+0000 7fa96cc00640 1 -- 172.21.15.138:0/1785754422 wait complete. 2024-04-26T20:59:15.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.483+0000 7fa96cc00640 1 Processor -- start 2024-04-26T20:59:15.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.483+0000 7fa96cc00640 1 -- start start 2024-04-26T20:59:15.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.483+0000 7fa96cc00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa9680cbe00 0x7fa9681543e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:59:15.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.483+0000 7fa96cc00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9680cc1e0 0x7fa9680c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:59:15.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.483+0000 7fa96cc00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa96815cf80 0x7fa9681fc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:59:15.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.483+0000 7fa96cc00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fa9680741d0 con 0x7fa9680cc1e0 2024-04-26T20:59:15.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.483+0000 7fa96cc00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fa968074050 con 0x7fa96815cf80 2024-04-26T20:59:15.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.483+0000 7fa96cc00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fa9680d0780 con 0x7fa9680cbe00 2024-04-26T20:59:15.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.483+0000 7fa95d400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9680cc1e0 0x7fa9680c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:59:15.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.483+0000 7fa95d400640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9680cc1e0 0x7fa9680c8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:53940/0 (socket says 172.21.15.138:53940) 2024-04-26T20:59:15.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.483+0000 7fa95d400640 1 -- 172.21.15.138:0/2882400381 learned_addr learned my addr 172.21.15.138:0/2882400381 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-04-26T20:59:15.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.487+0000 7fa965e00640 1 --2- 172.21.15.138:0/2882400381 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa9680cbe00 0x7fa9681543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:59:15.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.487+0000 7fa966800640 1 --2- 172.21.15.138:0/2882400381 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa96815cf80 0x7fa9681fc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:59:15.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.487+0000 7fa95d400640 1 -- 172.21.15.138:0/2882400381 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa9680cbe00 msgr2=0x7fa9681543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:59:15.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.487+0000 7fa95d400640 1 --2- 172.21.15.138:0/2882400381 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa9680cbe00 0x7fa9681543e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:59:15.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.487+0000 7fa95d400640 1 -- 172.21.15.138:0/2882400381 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa96815cf80 msgr2=0x7fa9681fc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:59:15.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.487+0000 7fa95d400640 1 --2- 172.21.15.138:0/2882400381 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa96815cf80 0x7fa9681fc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:59:15.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.487+0000 7fa95d400640 1 -- 172.21.15.138:0/2882400381 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9681fc800 con 0x7fa9680cc1e0 2024-04-26T20:59:15.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.487+0000 7fa95d400640 1 --2- 172.21.15.138:0/2882400381 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9680cc1e0 0x7fa9680c8250 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fa95000c7c0 tx=0x7fa95000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:59:15.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.487+0000 7fa95ea00640 1 -- 172.21.15.138:0/2882400381 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa950007a30 con 0x7fa9680cc1e0 2024-04-26T20:59:15.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.487+0000 7fa95ea00640 1 -- 172.21.15.138:0/2882400381 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa950007bd0 con 0x7fa9680cc1e0 2024-04-26T20:59:15.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.487+0000 7fa95ea00640 1 -- 172.21.15.138:0/2882400381 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9500113f0 con 0x7fa9680cc1e0 2024-04-26T20:59:15.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.487+0000 7fa96cc00640 1 -- 172.21.15.138:0/2882400381 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9681549c0 con 0x7fa9680cc1e0 2024-04-26T20:59:15.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.487+0000 7fa96cc00640 1 -- 172.21.15.138:0/2882400381 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa968154f80 con 0x7fa9680cc1e0 2024-04-26T20:59:15.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.487+0000 7fa96cc00640 1 -- 172.21.15.138:0/2882400381 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa968069510 con 0x7fa9680cc1e0 2024-04-26T20:59:15.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.487+0000 7fa95ea00640 1 -- 172.21.15.138:0/2882400381 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa9500115b0 con 0x7fa9680cc1e0 2024-04-26T20:59:15.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.487+0000 7fa95ea00640 1 --2- 172.21.15.138:0/2882400381 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fa944068380 0x7fa94406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:59:15.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.487+0000 7fa95ea00640 1 -- 172.21.15.138:0/2882400381 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5421+0+0 (secure 0 0 0) 0x7fa950086b30 con 0x7fa9680cc1e0 2024-04-26T20:59:15.491 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.491+0000 7fa965e00640 1 --2- 172.21.15.138:0/2882400381 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fa944068380 0x7fa94406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:59:15.491 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.491+0000 7fa965e00640 1 --2- 172.21.15.138:0/2882400381 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fa944068380 0x7fa94406a840 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa958005890 tx=0x7fa958009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:59:15.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.491+0000 7fa95ea00640 1 -- 172.21.15.138:0/2882400381 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa9681fc800 con 0x7fa9680cc1e0 2024-04-26T20:59:15.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.683+0000 7fa96cc00640 1 -- 172.21.15.138:0/2882400381 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa96815a3f0 con 0x7fa9680cc1e0 2024-04-26T20:59:15.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.683+0000 7fa95ea00640 1 -- 172.21.15.138:0/2882400381 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+3869 (secure 0 0 0) 0x7fa950015020 con 0x7fa9680cc1e0 2024-04-26T20:59:15.683 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-26T20:59:15.684 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":32,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5048,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/255610168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":255610168},{"type":"v1","addr":"172.21.15.143:6836","nonce":255610168}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5051,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/799063831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":799063831},{"type":"v1","addr":"172.21.15.143:6837","nonce":799063831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5410,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/976248149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":976248149},{"type":"v1","addr":"172.21.15.138:6835","nonce":976248149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":6153,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/689777916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":689777916},{"type":"v1","addr":"172.21.15.138:6834","nonce":689777916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[]} 2024-04-26T20:59:15.684 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 32 2024-04-26T20:59:15.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.683+0000 7fa96cc00640 1 -- 172.21.15.138:0/2882400381 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fa944068380 msgr2=0x7fa94406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:59:15.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.683+0000 7fa96cc00640 1 --2- 172.21.15.138:0/2882400381 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fa944068380 0x7fa94406a840 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa958005890 tx=0x7fa958009040 comp rx=0 tx=0).stop 2024-04-26T20:59:15.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.683+0000 7fa96cc00640 1 -- 172.21.15.138:0/2882400381 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9680cc1e0 msgr2=0x7fa9680c8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:59:15.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.683+0000 7fa96cc00640 1 --2- 172.21.15.138:0/2882400381 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9680cc1e0 0x7fa9680c8250 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fa95000c7c0 tx=0x7fa95000cc80 comp rx=0 tx=0).stop 2024-04-26T20:59:15.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.683+0000 7fa96cc00640 1 -- 172.21.15.138:0/2882400381 shutdown_connections 2024-04-26T20:59:15.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.683+0000 7fa96cc00640 1 --2- 172.21.15.138:0/2882400381 >> [v2:172.21.15.143:6832/4275464198,v1:172.21.15.143:6833/4275464198] conn(0x7fa944068380 0x7fa94406a840 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:59:15.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.683+0000 7fa96cc00640 1 --2- 172.21.15.138:0/2882400381 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa96815cf80 0x7fa9681fc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:59:15.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.683+0000 7fa96cc00640 1 --2- 172.21.15.138:0/2882400381 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9680cc1e0 0x7fa9680c8250 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:59:15.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.683+0000 7fa96cc00640 1 --2- 172.21.15.138:0/2882400381 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa9680cbe00 0x7fa9681543e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:59:15.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.683+0000 7fa96cc00640 1 -- 172.21.15.138:0/2882400381 >> 172.21.15.138:0/2882400381 conn(0x7fa9680d0b20 msgr2=0x7fa9680b1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:59:15.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.683+0000 7fa96cc00640 1 -- 172.21.15.138:0/2882400381 shutdown_connections 2024-04-26T20:59:15.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-26T20:59:15.683+0000 7fa96cc00640 1 -- 172.21.15.138:0/2882400381 wait complete. 2024-04-26T20:59:15.704 DEBUG:tasks.cephfs.filesystem:already dead... 2024-04-26T20:59:15.705 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-26T20:59:15.705 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-26T20:59:15.705 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T20:59:15.717 INFO:tasks.ceph.mds.a:Stopped 2024-04-26T20:59:15.718 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-26T20:59:15.718 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T20:59:15.770 INFO:tasks.ceph.mds.c:Stopped 2024-04-26T20:59:15.770 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-26T20:59:15.770 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T20:59:15.786 INFO:tasks.ceph.mds.b:Stopped 2024-04-26T20:59:15.786 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-26T20:59:15.786 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T20:59:15.844 INFO:tasks.ceph.mds.d:Stopped 2024-04-26T20:59:15.844 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-26T20:59:15.844 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-26T20:59:15.844 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T20:59:15.909 INFO:tasks.ceph.osd.0:Stopped 2024-04-26T20:59:15.909 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-26T20:59:15.909 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T20:59:15.988 INFO:tasks.ceph.osd.1:Stopped 2024-04-26T20:59:15.989 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-26T20:59:15.989 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T20:59:16.081 INFO:tasks.ceph.osd.2:Stopped 2024-04-26T20:59:16.081 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-26T20:59:16.081 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T20:59:16.164 INFO:tasks.ceph.osd.3:Stopped 2024-04-26T20:59:16.164 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-26T20:59:16.164 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T20:59:16.242 INFO:tasks.ceph.osd.4:Stopped 2024-04-26T20:59:16.242 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-26T20:59:16.242 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T20:59:16.329 INFO:tasks.ceph.osd.5:Stopped 2024-04-26T20:59:16.330 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-26T20:59:16.330 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T20:59:19.717 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-04-26T20:59:19.715+0000 7f3d07c00640 -1 calc_pg_upmaps abort due to max <= 0 2024-04-26T20:59:21.375 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-04-26T20:59:22.431 INFO:tasks.ceph.osd.6:Stopped 2024-04-26T20:59:22.432 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-26T20:59:22.432 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T20:59:22.521 INFO:tasks.ceph.osd.7:Stopped 2024-04-26T20:59:22.521 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-26T20:59:22.522 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-26T20:59:22.522 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T20:59:22.578 INFO:tasks.ceph.mgr.y:Stopped 2024-04-26T20:59:22.578 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-26T20:59:22.578 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T20:59:22.637 INFO:tasks.ceph.mgr.x:Stopped 2024-04-26T20:59:22.637 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-26T20:59:22.638 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-26T20:59:22.638 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T20:59:22.657 INFO:tasks.ceph.mon.a:Stopped 2024-04-26T20:59:22.657 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-26T20:59:22.657 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T20:59:22.674 INFO:tasks.ceph.mon.b:Stopped 2024-04-26T20:59:22.674 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-26T20:59:22.674 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T20:59:22.737 INFO:tasks.ceph.mon.c:Stopped 2024-04-26T20:59:22.737 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-26T20:59:22.738 DEBUG:teuthology.orchestra.run.smithi138:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'bad backtrace' | egrep -v 'object missing on disk' | egrep -v 'error reading table object' | egrep -v 'error reading sessionmap' | egrep -v 'unmatched fragstat' | egrep -v 'unmatched rstat' | egrep -v 'was unreadable, recreating it now' | egrep -v 'Scrub error on inode' | egrep -v 'Metadata damage detected' | egrep -v MDS_FAILED | egrep -v MDS_DAMAGE | head -n 1 2024-04-26T20:59:22.775 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi138.front.sepia.ceph.com 2024-04-26T20:59:22.775 DEBUG:teuthology.orchestra.run.smithi138:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-26T20:59:23.164 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi138.front.sepia.ceph.com 2024-04-26T20:59:23.164 DEBUG:teuthology.orchestra.run.smithi138:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-26T20:59:23.352 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi138.front.sepia.ceph.com 2024-04-26T20:59:23.353 DEBUG:teuthology.orchestra.run.smithi138:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-26T20:59:23.526 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi138.front.sepia.ceph.com 2024-04-26T20:59:23.527 DEBUG:teuthology.orchestra.run.smithi138:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-26T20:59:23.693 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi143.front.sepia.ceph.com 2024-04-26T20:59:23.693 DEBUG:teuthology.orchestra.run.smithi143:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-26T20:59:23.900 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi143.front.sepia.ceph.com 2024-04-26T20:59:23.901 DEBUG:teuthology.orchestra.run.smithi143:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-26T20:59:24.072 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi143.front.sepia.ceph.com 2024-04-26T20:59:24.072 DEBUG:teuthology.orchestra.run.smithi143:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-26T20:59:24.297 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi143.front.sepia.ceph.com 2024-04-26T20:59:24.298 DEBUG:teuthology.orchestra.run.smithi143:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-26T20:59:24.482 INFO:tasks.ceph:Archiving mon data... 2024-04-26T20:59:24.483 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675178/data/mon.a.tgz 2024-04-26T20:59:24.483 DEBUG:teuthology.orchestra.run.smithi138:> mktemp 2024-04-26T20:59:24.492 INFO:teuthology.orchestra.run.smithi138.stdout:/tmp/tmp.NUVS15xZy4 2024-04-26T20:59:24.493 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.NUVS15xZy4 2024-04-26T20:59:24.622 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0666 /tmp/tmp.NUVS15xZy4 2024-04-26T20:59:24.695 DEBUG:teuthology.orchestra.remote:smithi138:/tmp/tmp.NUVS15xZy4 is 347KB 2024-04-26T20:59:24.761 DEBUG:teuthology.orchestra.run.smithi138:> rm -fr /tmp/tmp.NUVS15xZy4 2024-04-26T20:59:24.769 DEBUG:teuthology.misc:Transferring archived files from smithi143:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675178/data/mon.b.tgz 2024-04-26T20:59:24.769 DEBUG:teuthology.orchestra.run.smithi143:> mktemp 2024-04-26T20:59:24.778 INFO:teuthology.orchestra.run.smithi143.stdout:/tmp/tmp.4mRpnn4Nrr 2024-04-26T20:59:24.778 DEBUG:teuthology.orchestra.run.smithi143:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.4mRpnn4Nrr 2024-04-26T20:59:24.934 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 0666 /tmp/tmp.4mRpnn4Nrr 2024-04-26T20:59:25.013 DEBUG:teuthology.orchestra.remote:smithi143:/tmp/tmp.4mRpnn4Nrr is 458KB 2024-04-26T20:59:25.080 DEBUG:teuthology.orchestra.run.smithi143:> rm -fr /tmp/tmp.4mRpnn4Nrr 2024-04-26T20:59:25.088 DEBUG:teuthology.misc:Transferring archived files from smithi143:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675178/data/mon.c.tgz 2024-04-26T20:59:25.088 DEBUG:teuthology.orchestra.run.smithi143:> mktemp 2024-04-26T20:59:25.136 INFO:teuthology.orchestra.run.smithi143.stdout:/tmp/tmp.4Dgx0iPugm 2024-04-26T20:59:25.137 DEBUG:teuthology.orchestra.run.smithi143:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.4Dgx0iPugm 2024-04-26T20:59:25.283 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 0666 /tmp/tmp.4Dgx0iPugm 2024-04-26T20:59:25.361 DEBUG:teuthology.orchestra.remote:smithi143:/tmp/tmp.4Dgx0iPugm is 458KB 2024-04-26T20:59:25.424 DEBUG:teuthology.orchestra.run.smithi143:> rm -fr /tmp/tmp.4Dgx0iPugm 2024-04-26T20:59:25.432 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-26T20:59:25.432 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T20:59:25.435 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T20:59:25.503 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-26T20:59:25.541 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-26T20:59:25.541 INFO:tasks.ceph:Archiving crash dumps... 2024-04-26T20:59:25.542 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675178/remote/smithi138/crash 2024-04-26T20:59:25.543 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T20:59:25.567 DEBUG:teuthology.misc:Transferring archived files from smithi143:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675178/remote/smithi143/crash 2024-04-26T20:59:25.568 DEBUG:teuthology.orchestra.run.smithi143:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T20:59:25.599 INFO:tasks.ceph:Shutting down logrotate 2024-04-26T20:59:25.599 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:59:25.613 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:59:25.680 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-26T20:59:25.700 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-26T20:59:25.743 INFO:tasks.ceph:Compressing logs... 2024-04-26T20:59:25.743 DEBUG:teuthology.orchestra.run.smithi138:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T20:59:25.746 DEBUG:teuthology.orchestra.run.smithi143:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T20:59:25.770 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35084.log 2024-04-26T20:59:25.771 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40554.log 2024-04-26T20:59:25.772 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.35084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35240.log 2024-04-26T20:59:25.772 INFO:teuthology.orchestra.run.smithi138.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35084.log.gz 2024-04-26T20:59:25.773 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.40554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39067.log 2024-04-26T20:59:25.773 INFO:teuthology.orchestra.run.smithi138.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40554.log.gz 2024-04-26T20:59:25.774 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.35240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37422.log 2024-04-26T20:59:25.774 INFO:teuthology.orchestra.run.smithi138.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.35240.log.gz 2024-04-26T20:59:25.774 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.39067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34091.log 2024-04-26T20:59:25.775 INFO:teuthology.orchestra.run.smithi138.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39067.log.gz 2024-04-26T20:59:25.775 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.37422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37056.log 2024-04-26T20:59:25.776 INFO:teuthology.orchestra.run.smithi138.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37422.log.gz 2024-04-26T20:59:25.776 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36658.log 2024-04-26T20:59:25.776 INFO:teuthology.orchestra.run.smithi138.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.34091.log.gz 2024-04-26T20:59:25.777 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.37056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36255.log 2024-04-26T20:59:25.777 INFO:teuthology.orchestra.run.smithi138.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37056.log.gz 2024-04-26T20:59:25.778 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.36658.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-26T20:59:25.778 INFO:teuthology.orchestra.run.smithi138.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36658.log.gz 2024-04-26T20:59:25.778 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.36255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38200.log 2024-04-26T20:59:25.779 INFO:teuthology.orchestra.run.smithi138.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36255.log.gz 2024-04-26T20:59:25.779 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37966.log 2024-04-26T20:59:25.780 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.38200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34552.log 2024-04-26T20:59:25.780 INFO:teuthology.orchestra.run.smithi138.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38200.log.gz 2024-04-26T20:59:25.781 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.37966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35943.log 2024-04-26T20:59:25.781 INFO:teuthology.orchestra.run.smithi138.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37966.log.gz 2024-04-26T20:59:25.782 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35188.log 2024-04-26T20:59:25.782 INFO:teuthology.orchestra.run.smithi138.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34552.log.gz 2024-04-26T20:59:25.783 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.35943.log: 93.1% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-26T20:59:25.783 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39145.log 2024-04-26T20:59:25.783 INFO:teuthology.orchestra.run.smithi138.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35943.log.gz 2024-04-26T20:59:25.784 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.35188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36385.log 2024-04-26T20:59:25.784 INFO:teuthology.orchestra.run.smithi138.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.35188.log.gz 2024-04-26T20:59:25.784 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.39145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34064.log 2024-04-26T20:59:25.785 INFO:teuthology.orchestra.run.smithi138.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39145.log.gz 2024-04-26T20:59:25.785 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.36385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38751.log 2024-04-26T20:59:25.785 INFO:teuthology.orchestra.run.smithi138.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36385.log.gz 2024-04-26T20:59:25.786 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34486.log 2024-04-26T20:59:25.787 INFO:teuthology.orchestra.run.smithi138.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34064.log.gz 2024-04-26T20:59:25.787 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.38751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36549.log 2024-04-26T20:59:25.787 INFO:teuthology.orchestra.run.smithi138.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38751.log.gz 2024-04-26T20:59:25.788 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34486.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-26T20:59:25.788 INFO:teuthology.orchestra.run.smithi138.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34486.log.gz 2024-04-26T20:59:25.788 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.36549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41279.log 2024-04-26T20:59:25.789 INFO:teuthology.orchestra.run.smithi138.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36549.log.gz 2024-04-26T20:59:25.789 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34330.log 2024-04-26T20:59:25.790 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.41279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39355.log 2024-04-26T20:59:25.791 INFO:teuthology.orchestra.run.smithi138.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41279.log.gz 2024-04-26T20:59:25.791 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41019.log 2024-04-26T20:59:25.791 INFO:teuthology.orchestra.run.smithi138.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34330.log.gz 2024-04-26T20:59:25.793 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.39355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37728.log 2024-04-26T20:59:25.793 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.41019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36125.log 2024-04-26T20:59:25.793 INFO:teuthology.orchestra.run.smithi138.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.41019.log.gz 2024-04-26T20:59:25.794 INFO:teuthology.orchestra.run.smithi138.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.39355.log.gz 2024-04-26T20:59:25.794 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.37728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39924.log 2024-04-26T20:59:25.795 INFO:teuthology.orchestra.run.smithi138.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37728.log.gz 2024-04-26T20:59:25.795 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.36125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36151.log 2024-04-26T20:59:25.795 INFO:teuthology.orchestra.run.smithi138.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36125.log.gz 2024-04-26T20:59:25.795 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.39924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41175.log 2024-04-26T20:59:25.796 INFO:teuthology.orchestra.run.smithi138.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39924.log.gz 2024-04-26T20:59:25.796 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.36151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39328.log 2024-04-26T20:59:25.796 INFO:teuthology.orchestra.run.smithi138.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36151.log.gz 2024-04-26T20:59:25.797 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.41175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39171.log 2024-04-26T20:59:25.797 INFO:teuthology.orchestra.run.smithi138.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41175.log.gz 2024-04-26T20:59:25.798 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.39328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38226.log 2024-04-26T20:59:25.799 INFO:teuthology.orchestra.run.smithi138.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.39328.log.gz 2024-04-26T20:59:25.799 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.39171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39198.log 2024-04-26T20:59:25.799 INFO:teuthology.orchestra.run.smithi138.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.39171.log.gz 2024-04-26T20:59:25.800 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.38226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36203.log 2024-04-26T20:59:25.800 INFO:teuthology.orchestra.run.smithi138.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38226.log.gz 2024-04-26T20:59:25.801 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.39198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39592.log 2024-04-26T20:59:25.802 INFO:teuthology.orchestra.run.smithi138.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39198.log.gz 2024-04-26T20:59:25.802 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.36203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34768.log 2024-04-26T20:59:25.802 INFO:teuthology.orchestra.run.smithi138.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36203.log.gz 2024-04-26T20:59:25.803 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.39592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35622.log 2024-04-26T20:59:25.803 INFO:teuthology.orchestra.run.smithi138.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39592.log.gz 2024-04-26T20:59:25.803 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36497.log 2024-04-26T20:59:25.804 INFO:teuthology.orchestra.run.smithi138.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34768.log.gz 2024-04-26T20:59:25.804 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.35622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37108.log 2024-04-26T20:59:25.804 INFO:teuthology.orchestra.run.smithi138.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35622.log.gz 2024-04-26T20:59:25.805 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.36497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36229.log 2024-04-26T20:59:25.805 INFO:teuthology.orchestra.run.smithi138.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36497.log.gz 2024-04-26T20:59:25.806 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.37108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34304.log 2024-04-26T20:59:25.806 INFO:teuthology.orchestra.run.smithi138.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37108.log.gz 2024-04-26T20:59:25.807 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.36229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36869.log 2024-04-26T20:59:25.807 INFO:teuthology.orchestra.run.smithi138.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36229.log.gz 2024-04-26T20:59:25.808 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36307.log 2024-04-26T20:59:25.808 INFO:teuthology.orchestra.run.smithi138.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34304.log.gz 2024-04-26T20:59:25.809 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.36869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40163.log 2024-04-26T20:59:25.809 INFO:teuthology.orchestra.run.smithi138.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36869.log.gz 2024-04-26T20:59:25.810 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.36307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39950.log 2024-04-26T20:59:25.810 INFO:teuthology.orchestra.run.smithi138.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36307.log.gz 2024-04-26T20:59:25.810 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.40163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33488.log 2024-04-26T20:59:25.810 INFO:teuthology.orchestra.run.smithi138.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40163.log.gz 2024-04-26T20:59:25.811 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.39950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39846.log 2024-04-26T20:59:25.811 INFO:teuthology.orchestra.run.smithi138.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39950.log.gz 2024-04-26T20:59:25.813 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.33488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36627.log 2024-04-26T20:59:25.813 INFO:teuthology.orchestra.run.smithi138.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33488.log.gz 2024-04-26T20:59:25.813 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.39846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37649.log 2024-04-26T20:59:25.813 INFO:teuthology.orchestra.run.smithi138.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.39846.log.gz 2024-04-26T20:59:25.814 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.36627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40783.log 2024-04-26T20:59:25.814 INFO:teuthology.orchestra.run.smithi138.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36627.log.gz 2024-04-26T20:59:25.815 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.37649.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37649.log.gz 2024-04-26T20:59:25.815 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39872.log 2024-04-26T20:59:25.816 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.40783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40967.log 2024-04-26T20:59:25.816 INFO:teuthology.orchestra.run.smithi138.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40783.log.gz 2024-04-26T20:59:25.817 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.39872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37238.log 2024-04-26T20:59:25.817 INFO:teuthology.orchestra.run.smithi138.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39872.log.gz 2024-04-26T20:59:25.818 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.40967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37992.log 2024-04-26T20:59:25.818 INFO:teuthology.orchestra.run.smithi138.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40967.log.gz 2024-04-26T20:59:25.819 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.37238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35110.log 2024-04-26T20:59:25.819 INFO:teuthology.orchestra.run.smithi138.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37238.log.gz 2024-04-26T20:59:25.819 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.37992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34278.log 2024-04-26T20:59:25.819 INFO:teuthology.orchestra.run.smithi138.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37992.log.gz 2024-04-26T20:59:25.820 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.33405.log 2024-04-26T20:59:25.820 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.33507.log 2024-04-26T20:59:25.821 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.35110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37264.log 2024-04-26T20:59:25.821 INFO:teuthology.orchestra.run.smithi138.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35110.log.gz 2024-04-26T20:59:25.823 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.1.33405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27809.log 2024-04-26T20:59:25.823 INFO:teuthology.orchestra.run.smithi143.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.33405.log.gz 2024-04-26T20:59:25.823 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.3.33507.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-26T20:59:25.823 INFO:teuthology.orchestra.run.smithi143.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.33507.log.gz 2024-04-26T20:59:25.824 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.27809.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-26T20:59:25.824 INFO:teuthology.orchestra.run.smithi143.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.27809.log.gz 2024-04-26T20:59:25.824 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27713.log 2024-04-26T20:59:25.824 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34356.log 2024-04-26T20:59:25.824 INFO:teuthology.orchestra.run.smithi138.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34278.log.gz 2024-04-26T20:59:25.824 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.37264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37832.log 2024-04-26T20:59:25.824 INFO:teuthology.orchestra.run.smithi138.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37264.log.gz 2024-04-26T20:59:25.824 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36947.log 2024-04-26T20:59:25.824 INFO:teuthology.orchestra.run.smithi138.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34356.log.gz 2024-04-26T20:59:25.827 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27833.log 2024-04-26T20:59:25.827 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.27713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27785.log 2024-04-26T20:59:25.827 INFO:teuthology.orchestra.run.smithi143.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.27713.log.gz 2024-04-26T20:59:25.827 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.27833.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-26T20:59:25.827 INFO:teuthology.orchestra.run.smithi143.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.27833.log.gz 2024-04-26T20:59:25.827 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.27785.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.27785.log.gz 2024-04-26T20:59:25.827 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27665.log 2024-04-26T20:59:25.828 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.37832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34561.log 2024-04-26T20:59:25.828 INFO:teuthology.orchestra.run.smithi138.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37832.log.gz 2024-04-26T20:59:25.828 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.36947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38885.log 2024-04-26T20:59:25.829 INFO:teuthology.orchestra.run.smithi138.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36947.log.gz 2024-04-26T20:59:25.829 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37082.log 2024-04-26T20:59:25.829 INFO:teuthology.orchestra.run.smithi138.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34561.log.gz 2024-04-26T20:59:25.829 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.38885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37754.log 2024-04-26T20:59:25.829 INFO:teuthology.orchestra.run.smithi138.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38885.log.gz 2024-04-26T20:59:25.829 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.37082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38304.log 2024-04-26T20:59:25.829 INFO:teuthology.orchestra.run.smithi138.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37082.log.gz 2024-04-26T20:59:25.829 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.37754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37134.log 2024-04-26T20:59:25.829 INFO:teuthology.orchestra.run.smithi138.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37754.log.gz 2024-04-26T20:59:25.832 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-26T20:59:25.832 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.27665.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.27665.log.gz 2024-04-26T20:59:25.832 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-26T20:59:25.832 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-26T20:59:25.832 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27737.log 2024-04-26T20:59:25.832 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-mon.c.log: 91.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-26T20:59:25.833 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.38304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34773.log 2024-04-26T20:59:25.833 INFO:teuthology.orchestra.run.smithi138.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38304.log.gz 2024-04-26T20:59:25.833 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.37134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36411.log 2024-04-26T20:59:25.833 INFO:teuthology.orchestra.run.smithi138.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37134.log.gz 2024-04-26T20:59:25.833 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36099.log 2024-04-26T20:59:25.833 INFO:teuthology.orchestra.run.smithi138.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34773.log.gz 2024-04-26T20:59:25.833 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.36411.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-26T20:59:25.833 INFO:teuthology.orchestra.run.smithi138.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.36411.log.gz 2024-04-26T20:59:25.833 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.36099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36575.log 2024-04-26T20:59:25.833 INFO:teuthology.orchestra.run.smithi138.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36099.log.gz 2024-04-26T20:59:25.835 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-26T20:59:25.835 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.27737.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-26T20:59:25.835 INFO:teuthology.orchestra.run.smithi143.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.27737.log.gz 2024-04-26T20:59:25.835 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27689.log 2024-04-26T20:59:25.836 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40915.log 2024-04-26T20:59:25.836 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.36575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38044.log 2024-04-26T20:59:25.836 INFO:teuthology.orchestra.run.smithi138.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36575.log.gz 2024-04-26T20:59:25.836 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.40915.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.22748.log 2024-04-26T20:59:25.836 INFO:teuthology.orchestra.run.smithi138.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40915.log.gz 2024-04-26T20:59:25.836 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.38044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37884.log 2024-04-26T20:59:25.836 INFO:teuthology.orchestra.run.smithi138.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38044.log.gz 2024-04-26T20:59:25.837 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-client.admin.27689.log: 93.8% 87.8% -- replaced with /var/log/ceph/ceph.audit.log.gz -- replaced with /var/log/ceph/ceph-client.admin.27689.log.gz 2024-04-26T20:59:25.838 INFO:teuthology.orchestra.run.smithi143.stderr: 2024-04-26T20:59:25.838 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-26T20:59:25.838 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph.tmp-client.admin.22748.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.22748.log.gz 2024-04-26T20:59:25.839 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38656.log 2024-04-26T20:59:25.839 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.37884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34143.log 2024-04-26T20:59:25.839 INFO:teuthology.orchestra.run.smithi138.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37884.log.gz 2024-04-26T20:59:25.839 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.38656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39015.log 2024-04-26T20:59:25.839 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-26T20:59:25.840 INFO:teuthology.orchestra.run.smithi138.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.38656.log.gz 2024-04-26T20:59:25.840 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36788.log 2024-04-26T20:59:25.840 INFO:teuthology.orchestra.run.smithi138.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34143.log.gz 2024-04-26T20:59:25.841 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.39015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34549.log 2024-04-26T20:59:25.841 INFO:teuthology.orchestra.run.smithi138.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39015.log.gz 2024-04-26T20:59:25.841 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.36788.log: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.36788.log.gz 2024-04-26T20:59:25.841 INFO:teuthology.orchestra.run.smithi138.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.34038.log 2024-04-26T20:59:25.842 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40241.log 2024-04-26T20:59:25.842 INFO:teuthology.orchestra.run.smithi138.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34549.log.gz 2024-04-26T20:59:25.843 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40293.log 2024-04-26T20:59:25.843 INFO:teuthology.orchestra.run.smithi138.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34038.log.gz 2024-04-26T20:59:25.844 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.40241.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40241.log.gz 2024-04-26T20:59:25.844 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35786.log 2024-04-26T20:59:25.845 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-mds.b.log: /var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-26T20:59:25.845 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27761.log 2024-04-26T20:59:25.846 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.40293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35864.log 2024-04-26T20:59:25.846 INFO:teuthology.orchestra.run.smithi138.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40293.log.gz 2024-04-26T20:59:25.846 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.35786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39463.log 2024-04-26T20:59:25.846 INFO:teuthology.orchestra.run.smithi138.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35786.log.gz 2024-04-26T20:59:25.847 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.35864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41331.log 2024-04-26T20:59:25.847 INFO:teuthology.orchestra.run.smithi138.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35864.log.gz 2024-04-26T20:59:25.848 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.admin.27761.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.27761.log.gz 2024-04-26T20:59:25.848 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.39463.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-26T20:59:25.848 INFO:teuthology.orchestra.run.smithi138.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.39463.log.gz 2024-04-26T20:59:25.849 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.41331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37318.log 2024-04-26T20:59:25.849 INFO:teuthology.orchestra.run.smithi138.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41331.log.gz 2024-04-26T20:59:25.850 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40398.log 2024-04-26T20:59:25.851 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.37318.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37318.log.gz 2024-04-26T20:59:25.851 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40705.log 2024-04-26T20:59:25.852 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.40398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35812.log 2024-04-26T20:59:25.852 INFO:teuthology.orchestra.run.smithi138.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.40398.log.gz 2024-04-26T20:59:25.853 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.40705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41305.log 2024-04-26T20:59:25.853 INFO:teuthology.orchestra.run.smithi138.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40705.log.gz 2024-04-26T20:59:25.854 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.35812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35760.log 2024-04-26T20:59:25.854 INFO:teuthology.orchestra.run.smithi138.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35812.log.gz 2024-04-26T20:59:25.855 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33123.log 2024-04-26T20:59:25.855 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.41305.log: /var/log/ceph/ceph-client.admin.35760.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41305.log.gz 2024-04-26T20:59:25.856 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40450.log 2024-04-26T20:59:25.856 INFO:teuthology.orchestra.run.smithi138.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35760.log.gz 2024-04-26T20:59:25.857 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.33123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34460.log 2024-04-26T20:59:25.857 INFO:teuthology.orchestra.run.smithi138.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.33123.log.gz 2024-04-26T20:59:25.858 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.40450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34767.log 2024-04-26T20:59:25.859 INFO:teuthology.orchestra.run.smithi138.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40450.log.gz 2024-04-26T20:59:25.859 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41411.log 2024-04-26T20:59:25.859 INFO:teuthology.orchestra.run.smithi138.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34460.log.gz 2024-04-26T20:59:25.860 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40371.log 2024-04-26T20:59:25.860 INFO:teuthology.orchestra.run.smithi138.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34767.log.gz 2024-04-26T20:59:25.861 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.41411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33274.log 2024-04-26T20:59:25.862 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.40371.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41411.log.gz 2024-04-26T20:59:25.862 INFO:teuthology.orchestra.run.smithi138.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40371.log.gz 2024-04-26T20:59:25.863 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39817.log 2024-04-26T20:59:25.863 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.33274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39562.log 2024-04-26T20:59:25.864 INFO:teuthology.orchestra.run.smithi138.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33274.log.gz 2024-04-26T20:59:25.864 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.39817.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.39817.log.gz 2024-04-26T20:59:25.864 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34553.log 2024-04-26T20:59:25.865 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33378.log 2024-04-26T20:59:25.866 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.39562.log: /var/log/ceph/ceph-client.admin.34553.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39562.log.gz 2024-04-26T20:59:25.866 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34382.log 2024-04-26T20:59:25.866 INFO:teuthology.orchestra.run.smithi138.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34553.log.gz 2024-04-26T20:59:25.867 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37858.log 2024-04-26T20:59:25.868 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.33378.log: /var/log/ceph/ceph-client.admin.34382.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33378.log.gz 2024-04-26T20:59:25.868 INFO:teuthology.orchestra.run.smithi138.stderr:gzip 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34382.log.gz -5 2024-04-26T20:59:25.868 INFO:teuthology.orchestra.run.smithi138.stderr: --verbose -- /var/log/ceph/ceph-client.admin.39301.log 2024-04-26T20:59:25.869 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.37858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38174.log 2024-04-26T20:59:25.870 INFO:teuthology.orchestra.run.smithi138.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37858.log.gz 2024-04-26T20:59:25.870 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.39301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38018.log 2024-04-26T20:59:25.871 INFO:teuthology.orchestra.run.smithi138.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.39301.log.gz 2024-04-26T20:59:25.871 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.38174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40345.log 2024-04-26T20:59:25.872 INFO:teuthology.orchestra.run.smithi138.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38174.log.gz 2024-04-26T20:59:25.873 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.38018.log: gzip 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38018.log.gz -5 2024-04-26T20:59:25.873 INFO:teuthology.orchestra.run.smithi138.stderr: --verbose -- /var/log/ceph/ceph-client.admin.36762.log 2024-04-26T20:59:25.873 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.40345.log: -- /var/log/ceph/ceph-client.admin.37396.log 2024-04-26T20:59:25.874 INFO:teuthology.orchestra.run.smithi138.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40345.log.gz 2024-04-26T20:59:25.875 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.36762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33156.log 2024-04-26T20:59:25.875 INFO:teuthology.orchestra.run.smithi138.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36762.log.gz 2024-04-26T20:59:25.875 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.37396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34512.log 2024-04-26T20:59:25.876 INFO:teuthology.orchestra.run.smithi138.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37396.log.gz 2024-04-26T20:59:25.877 INFO:teuthology.orchestra.run.smithi143.stderr: 93.1% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-26T20:59:25.877 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.33156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35318.log 2024-04-26T20:59:25.877 INFO:teuthology.orchestra.run.smithi138.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33156.log.gz 2024-04-26T20:59:25.878 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33672.log 2024-04-26T20:59:25.878 INFO:teuthology.orchestra.run.smithi138.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34512.log.gz 2024-04-26T20:59:25.879 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.35318.log: 89.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.35318.log.gz 2024-04-26T20:59:25.879 INFO:teuthology.orchestra.run.smithi138.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.37292.log 2024-04-26T20:59:25.880 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.33672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40863.log 2024-04-26T20:59:25.880 INFO:teuthology.orchestra.run.smithi138.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33672.log.gz 2024-04-26T20:59:25.881 INFO:teuthology.orchestra.run.smithi143.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-26T20:59:25.881 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.37292.log: gzip 87.8% -5 -- replaced with /var/log/ceph/ceph-client.admin.37292.log.gz --verbose 2024-04-26T20:59:25.881 INFO:teuthology.orchestra.run.smithi138.stderr: -- /var/log/ceph/ceph-client.admin.38613.log 2024-04-26T20:59:25.882 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.40863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40033.log 2024-04-26T20:59:25.883 INFO:teuthology.orchestra.run.smithi138.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40863.log.gz 2024-04-26T20:59:25.883 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.38613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33300.log 2024-04-26T20:59:25.884 INFO:teuthology.orchestra.run.smithi138.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38613.log.gz 2024-04-26T20:59:25.884 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.40033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38805.log 2024-04-26T20:59:25.885 INFO:teuthology.orchestra.run.smithi138.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40033.log.gz 2024-04-26T20:59:25.886 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.33300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40809.log 2024-04-26T20:59:25.886 INFO:teuthology.orchestra.run.smithi138.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33300.log.gz 2024-04-26T20:59:25.886 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.38805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35398.log 2024-04-26T20:59:25.887 INFO:teuthology.orchestra.run.smithi138.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38805.log.gz 2024-04-26T20:59:25.888 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.40809.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40809.log.gz 2024-04-26T20:59:25.888 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40757.log 2024-04-26T20:59:25.889 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.35398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36437.log 2024-04-26T20:59:25.889 INFO:teuthology.orchestra.run.smithi143.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-26T20:59:25.890 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.40757.log: gzip -5 91.2% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.35398.log.gz /var/log/ceph/ceph-client.admin.39093.log 2024-04-26T20:59:25.890 INFO:teuthology.orchestra.run.smithi138.stderr: 2024-04-26T20:59:25.890 INFO:teuthology.orchestra.run.smithi138.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40757.log.gz 2024-04-26T20:59:25.891 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.36437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36281.log 2024-04-26T20:59:25.891 INFO:teuthology.orchestra.run.smithi138.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36437.log.gz 2024-04-26T20:59:25.892 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.39093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38380.log 2024-04-26T20:59:25.892 INFO:teuthology.orchestra.run.smithi138.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39093.log.gz 2024-04-26T20:59:25.893 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.36281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40189.log 2024-04-26T20:59:25.893 INFO:teuthology.orchestra.run.smithi138.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36281.log.gz 2024-04-26T20:59:25.894 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.38380.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38380.log.gz 2024-04-26T20:59:25.894 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33876.log 2024-04-26T20:59:25.895 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34761.log 2024-04-26T20:59:25.895 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.40189.log: /var/log/ceph/ceph-client.admin.33876.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40189.log.gz 2024-04-26T20:59:25.896 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40267.log 2024-04-26T20:59:25.897 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34761.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-26T20:59:25.897 INFO:teuthology.orchestra.run.smithi138.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34761.log.gz 2024-04-26T20:59:25.897 INFO:teuthology.orchestra.run.smithi138.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.33876.log.gz 2024-04-26T20:59:25.898 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.40267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39744.log 2024-04-26T20:59:25.898 INFO:teuthology.orchestra.run.smithi138.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40267.log.gz 2024-04-26T20:59:25.899 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34566.log 2024-04-26T20:59:25.900 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.39744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34765.log 2024-04-26T20:59:25.900 INFO:teuthology.orchestra.run.smithi138.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39744.log.gz 2024-04-26T20:59:25.901 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35058.log 2024-04-26T20:59:25.902 INFO:teuthology.orchestra.run.smithi138.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34566.log.gz 2024-04-26T20:59:25.903 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38937.log 2024-04-26T20:59:25.903 INFO:teuthology.orchestra.run.smithi138.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34765.log.gz 2024-04-26T20:59:25.904 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.35058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33594.log 2024-04-26T20:59:25.904 INFO:teuthology.orchestra.run.smithi138.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35058.log.gz 2024-04-26T20:59:25.905 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.38937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38505.log 2024-04-26T20:59:25.905 INFO:teuthology.orchestra.run.smithi138.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38937.log.gz 2024-04-26T20:59:25.906 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.33594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40606.log 2024-04-26T20:59:25.906 INFO:teuthology.orchestra.run.smithi138.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33594.log.gz 2024-04-26T20:59:25.907 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.38505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36463.log 2024-04-26T20:59:25.907 INFO:teuthology.orchestra.run.smithi138.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38505.log.gz 2024-04-26T20:59:25.908 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.40606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33408.log 2024-04-26T20:59:25.908 INFO:teuthology.orchestra.run.smithi138.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40606.log.gz 2024-04-26T20:59:25.909 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.36463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41097.log 2024-04-26T20:59:25.910 INFO:teuthology.orchestra.run.smithi138.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36463.log.gz 2024-04-26T20:59:25.910 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.33408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40059.log 2024-04-26T20:59:25.911 INFO:teuthology.orchestra.run.smithi138.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33408.log.gz 2024-04-26T20:59:25.911 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.41097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38963.log 2024-04-26T20:59:25.912 INFO:teuthology.orchestra.run.smithi138.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41097.log.gz 2024-04-26T20:59:25.912 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.40059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34754.log 2024-04-26T20:59:25.913 INFO:teuthology.orchestra.run.smithi138.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40059.log.gz 2024-04-26T20:59:25.914 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.38963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39436.log 2024-04-26T20:59:25.914 INFO:teuthology.orchestra.run.smithi138.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38963.log.gz 2024-04-26T20:59:25.915 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41045.log 2024-04-26T20:59:25.915 INFO:teuthology.orchestra.run.smithi138.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34754.log.gz 2024-04-26T20:59:25.916 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.39436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40424.log 2024-04-26T20:59:25.916 INFO:teuthology.orchestra.run.smithi138.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.39436.log.gz 2024-04-26T20:59:25.917 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.41045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35464.log 2024-04-26T20:59:25.917 INFO:teuthology.orchestra.run.smithi138.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41045.log.gz 2024-04-26T20:59:25.918 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.40424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39898.log 2024-04-26T20:59:25.918 INFO:teuthology.orchestra.run.smithi138.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40424.log.gz 2024-04-26T20:59:25.919 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.35464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39382.log 2024-04-26T20:59:25.919 INFO:teuthology.orchestra.run.smithi138.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35464.log.gz 2024-04-26T20:59:25.920 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.39898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33462.log 2024-04-26T20:59:25.920 INFO:teuthology.orchestra.run.smithi138.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39898.log.gz 2024-04-26T20:59:25.923 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.39382.log: /var/log/ceph/ceph-client.admin.33462.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33462.log.gz 2024-04-26T20:59:25.923 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- 92.5% /var/log/ceph/ceph-client.admin.38587.log 2024-04-26T20:59:25.923 INFO:teuthology.orchestra.run.smithi138.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39382.log.gz 2024-04-26T20:59:25.924 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35162.log 2024-04-26T20:59:25.925 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.38587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33748.log 2024-04-26T20:59:25.925 INFO:teuthology.orchestra.run.smithi138.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38587.log.gz 2024-04-26T20:59:25.927 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.35162.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-26T20:59:25.927 INFO:teuthology.orchestra.run.smithi138.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35162.log.gz 2024-04-26T20:59:25.928 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.33748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36684.log 2024-04-26T20:59:25.928 INFO:teuthology.orchestra.run.smithi138.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33748.log.gz 2024-04-26T20:59:25.929 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37212.log 2024-04-26T20:59:25.930 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.36684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38096.log 2024-04-26T20:59:25.930 INFO:teuthology.orchestra.run.smithi138.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36684.log.gz 2024-04-26T20:59:25.931 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.37212.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37212.log.gz 2024-04-26T20:59:25.931 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38859.log 2024-04-26T20:59:25.932 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.38096.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38096.log.gz 2024-04-26T20:59:25.932 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37702.log 2024-04-26T20:59:25.934 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.38859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36177.log 2024-04-26T20:59:25.934 INFO:teuthology.orchestra.run.smithi138.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38859.log.gz 2024-04-26T20:59:25.935 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.37702.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37702.log.gz 2024-04-26T20:59:25.936 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.36177.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36177.log.gz 2024-04-26T20:59:25.936 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27671.log 2024-04-26T20:59:25.938 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33436.log 2024-04-26T20:59:25.939 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.27671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38453.log 2024-04-26T20:59:25.939 INFO:teuthology.orchestra.run.smithi138.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.27671.log.gz 2024-04-26T20:59:25.940 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.33436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35734.log 2024-04-26T20:59:25.940 INFO:teuthology.orchestra.run.smithi138.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33436.log.gz 2024-04-26T20:59:25.941 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.38453.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.38453.log.gz 2024-04-26T20:59:25.942 INFO:teuthology.orchestra.run.smithi138.stderr:gzip/var/log/ceph/ceph-client.admin.35734.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.38989.log 2024-04-26T20:59:25.942 INFO:teuthology.orchestra.run.smithi138.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35734.log.gz 2024-04-26T20:59:25.943 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35370.log 2024-04-26T20:59:25.944 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.38989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39976.log 2024-04-26T20:59:25.944 INFO:teuthology.orchestra.run.smithi138.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38989.log.gz 2024-04-26T20:59:25.946 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.35370.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35370.log.gz 2024-04-26T20:59:25.947 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.39976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39499.log 2024-04-26T20:59:25.947 INFO:teuthology.orchestra.run.smithi138.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39976.log.gz 2024-04-26T20:59:25.947 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40476.log 2024-04-26T20:59:25.949 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.39499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39694.log 2024-04-26T20:59:25.949 INFO:teuthology.orchestra.run.smithi138.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39499.log.gz 2024-04-26T20:59:25.950 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.40476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37912.log 2024-04-26T20:59:25.950 INFO:teuthology.orchestra.run.smithi138.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40476.log.gz 2024-04-26T20:59:25.952 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.39694.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.39694.log.gz 2024-04-26T20:59:25.952 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.37912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41201.log 2024-04-26T20:59:25.952 INFO:teuthology.orchestra.run.smithi138.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37912.log.gz 2024-04-26T20:59:25.953 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40215.log 2024-04-26T20:59:25.955 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.41201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38427.log 2024-04-26T20:59:25.955 INFO:teuthology.orchestra.run.smithi138.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41201.log.gz 2024-04-26T20:59:25.956 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.40215.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40215.log.gz 2024-04-26T20:59:25.956 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35006.log 2024-04-26T20:59:25.956 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.38427.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.38427.log.gz 2024-04-26T20:59:25.957 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38531.log 2024-04-26T20:59:25.958 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.35006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34252.log 2024-04-26T20:59:25.958 INFO:teuthology.orchestra.run.smithi138.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35006.log.gz 2024-04-26T20:59:25.959 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.38531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33326.log 2024-04-26T20:59:25.959 INFO:teuthology.orchestra.run.smithi138.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.38531.log.gz 2024-04-26T20:59:25.960 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34252.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34252.log.gz 2024-04-26T20:59:25.961 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41383.log 2024-04-26T20:59:25.962 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.33326.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33326.log.gz 2024-04-26T20:59:25.962 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36073.log 2024-04-26T20:59:25.964 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.41383.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-26T20:59:25.964 INFO:teuthology.orchestra.run.smithi138.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41383.log.gz 2024-04-26T20:59:25.965 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.36073.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36073.log.gz 2024-04-26T20:59:25.965 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33986.log 2024-04-26T20:59:25.967 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27773.log 2024-04-26T20:59:25.967 INFO:teuthology.orchestra.run.smithi138.stderr: 85.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-26T20:59:25.968 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.33986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41253.log 2024-04-26T20:59:25.968 INFO:teuthology.orchestra.run.smithi138.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33986.log.gz 2024-04-26T20:59:25.969 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.27773.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.27773.log.gz 2024-04-26T20:59:25.969 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39668.log 2024-04-26T20:59:25.970 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.41253.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41253.log.gz 2024-04-26T20:59:25.970 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37344.log 2024-04-26T20:59:25.972 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.39668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35838.log 2024-04-26T20:59:25.972 INFO:teuthology.orchestra.run.smithi138.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.39668.log.gz 2024-04-26T20:59:25.973 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.37344.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37344.log.gz 2024-04-26T20:59:25.973 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37004.log 2024-04-26T20:59:25.974 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.35838.log: 88.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.35838.log.gz 2024-04-26T20:59:25.974 INFO:teuthology.orchestra.run.smithi138.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.35266.log 2024-04-26T20:59:25.975 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.37004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40731.log 2024-04-26T20:59:25.975 INFO:teuthology.orchestra.run.smithi138.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37004.log.gz 2024-04-26T20:59:25.977 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.35266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37780.log 2024-04-26T20:59:25.977 INFO:teuthology.orchestra.run.smithi138.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35266.log.gz 2024-04-26T20:59:25.978 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.40731.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.40731.log.gz 2024-04-26T20:59:25.979 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.37780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39618.log 2024-04-26T20:59:25.979 INFO:teuthology.orchestra.run.smithi138.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37780.log.gz 2024-04-26T20:59:25.979 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36843.log 2024-04-26T20:59:25.981 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.39618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33247.log 2024-04-26T20:59:25.982 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.36843.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.39618.log.gz 2024-04-26T20:59:25.982 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40634.log 2024-04-26T20:59:25.985 INFO:teuthology.orchestra.run.smithi138.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.36843.log.gz 2024-04-26T20:59:25.987 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.33247.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33247.log.gz 2024-04-26T20:59:25.987 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33960.log 2024-04-26T20:59:25.987 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.40634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40889.log 2024-04-26T20:59:25.987 INFO:teuthology.orchestra.run.smithi138.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40634.log.gz 2024-04-26T20:59:25.987 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.33960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37186.log 2024-04-26T20:59:25.987 INFO:teuthology.orchestra.run.smithi138.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33960.log.gz 2024-04-26T20:59:25.988 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.40889.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40889.log.gz 2024-04-26T20:59:25.988 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36021.log 2024-04-26T20:59:25.988 INFO:teuthology.orchestra.run.smithi143.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-26T20:59:25.988 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.37186.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37186.log.gz 2024-04-26T20:59:25.989 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38252.log 2024-04-26T20:59:25.990 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.36021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34221.log 2024-04-26T20:59:25.990 INFO:teuthology.orchestra.run.smithi138.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36021.log.gz 2024-04-26T20:59:25.991 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.38252.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38252.log.gz 2024-04-26T20:59:25.991 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36921.log 2024-04-26T20:59:25.992 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34221.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34221.log.gz 2024-04-26T20:59:25.992 INFO:teuthology.orchestra.run.smithi143.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-26T20:59:25.993 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39409.log 2024-04-26T20:59:25.994 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.36921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37675.log 2024-04-26T20:59:25.994 INFO:teuthology.orchestra.run.smithi138.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36921.log.gz 2024-04-26T20:59:25.996 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.39409.log: /var/log/ceph/ceph-client.admin.37675.log: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.39409.log.gz 2024-04-26T20:59:25.996 INFO:teuthology.orchestra.run.smithi138.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37675.log.gz 2024-04-26T20:59:25.996 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34408.log 2024-04-26T20:59:25.997 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38479.log 2024-04-26T20:59:25.999 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41357.log 2024-04-26T20:59:25.999 INFO:teuthology.orchestra.run.smithi138.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34408.log.gz 2024-04-26T20:59:26.000 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.38479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35890.log 2024-04-26T20:59:26.001 INFO:teuthology.orchestra.run.smithi138.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38479.log.gz 2024-04-26T20:59:26.001 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.41357.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41357.log.gz 2024-04-26T20:59:26.002 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.35890.log: /var/log/ceph/ceph-client.admin.39041.log 2024-04-26T20:59:26.003 INFO:teuthology.orchestra.run.smithi138.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35890.log.gz 2024-04-26T20:59:26.003 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35292.log 2024-04-26T20:59:26.005 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.39041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34434.log 2024-04-26T20:59:26.005 INFO:teuthology.orchestra.run.smithi138.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39041.log.gz 2024-04-26T20:59:26.007 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.35292.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35292.log.gz 2024-04-26T20:59:26.007 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38831.log 2024-04-26T20:59:26.007 INFO:teuthology.orchestra.run.smithi138.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34434.log.gz 2024-04-26T20:59:26.007 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36359.log 2024-04-26T20:59:26.009 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.38831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37370.log 2024-04-26T20:59:26.009 INFO:teuthology.orchestra.run.smithi138.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38831.log.gz 2024-04-26T20:59:26.010 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.36359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37940.log 2024-04-26T20:59:26.010 INFO:teuthology.orchestra.run.smithi138.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36359.log.gz 2024-04-26T20:59:26.011 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.37370.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37370.log.gz 2024-04-26T20:59:26.012 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33934.log 2024-04-26T20:59:26.013 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.37940.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37940.log.gz 2024-04-26T20:59:26.013 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37500.log 2024-04-26T20:59:26.014 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.33934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37474.log 2024-04-26T20:59:26.014 INFO:teuthology.orchestra.run.smithi138.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33934.log.gz 2024-04-26T20:59:26.016 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.37500.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37500.log.gz 2024-04-26T20:59:26.016 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.37474.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37474.log.gz 2024-04-26T20:59:26.017 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34560.log 2024-04-26T20:59:26.018 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36736.log 2024-04-26T20:59:26.019 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39770.log 2024-04-26T20:59:26.020 INFO:teuthology.orchestra.run.smithi138.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34560.log.gz 2024-04-26T20:59:26.020 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.36736.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36736.log.gz 2024-04-26T20:59:26.021 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38557.log 2024-04-26T20:59:26.022 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.39770.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39770.log.gz 2024-04-26T20:59:26.022 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41435.log 2024-04-26T20:59:26.023 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.38557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35917.log 2024-04-26T20:59:26.023 INFO:teuthology.orchestra.run.smithi138.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38557.log.gz 2024-04-26T20:59:26.024 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.41435.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41435.log.gz 2024-04-26T20:59:26.026 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.35917.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35917.log.gz 2024-04-26T20:59:26.026 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-26T20:59:26.027 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-26T20:59:26.030 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37030.log 2024-04-26T20:59:26.030 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-mds.c.log: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-26T20:59:26.031 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.37030.log: 92.1% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-26T20:59:26.031 INFO:teuthology.orchestra.run.smithi138.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37030.log.gz 2024-04-26T20:59:26.031 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-26T20:59:26.033 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40137.log 2024-04-26T20:59:26.037 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39224.log 2024-04-26T20:59:26.037 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.40137.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40137.log.gz 2024-04-26T20:59:26.037 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.39224.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39224.log.gz 2024-04-26T20:59:26.037 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41149.log 2024-04-26T20:59:26.037 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34766.log 2024-04-26T20:59:26.039 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.41149.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41149.log.gz 2024-04-26T20:59:26.040 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34766.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34766.log.gz 2024-04-26T20:59:26.040 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35995.log 2024-04-26T20:59:26.042 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38330.log 2024-04-26T20:59:26.043 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.35995.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35995.log.gz 2024-04-26T20:59:26.044 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.38330.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.38330.log.gz 2024-04-26T20:59:26.045 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36895.log 2024-04-26T20:59:26.046 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40993.log 2024-04-26T20:59:26.047 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.36895.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36895.log.gz 2024-04-26T20:59:26.048 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.40993.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40993.log.gz 2024-04-26T20:59:26.049 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37160.log 2024-04-26T20:59:26.050 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39536.log 2024-04-26T20:59:26.052 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.37160.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37160.log.gz 2024-04-26T20:59:26.052 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.39536.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39536.log.gz 2024-04-26T20:59:26.053 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37448.log 2024-04-26T20:59:26.054 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37623.log 2024-04-26T20:59:26.056 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.37448.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37448.log.gz 2024-04-26T20:59:26.057 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.37623.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.37623.log.gz 2024-04-26T20:59:26.057 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33221.log 2024-04-26T20:59:26.058 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34564.log 2024-04-26T20:59:26.060 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.33221.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33221.log.gz 2024-04-26T20:59:26.061 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34564.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34564.log.gz 2024-04-26T20:59:26.061 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33698.log 2024-04-26T20:59:26.062 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38070.log 2024-04-26T20:59:26.065 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.33698.log: /var/log/ceph/ceph-client.admin.38070.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.33698.log.gz 2024-04-26T20:59:26.065 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34980.log 2024-04-26T20:59:26.065 INFO:teuthology.orchestra.run.smithi138.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38070.log.gz 2024-04-26T20:59:26.066 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35969.log 2024-04-26T20:59:26.067 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34980.log: 93.3% 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34980.log.gz 2024-04-26T20:59:26.068 INFO:teuthology.orchestra.run.smithi138.stderr: -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-26T20:59:26.068 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.35969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35344.log 2024-04-26T20:59:26.068 INFO:teuthology.orchestra.run.smithi138.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35969.log.gz 2024-04-26T20:59:26.069 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33568.log 2024-04-26T20:59:26.071 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.35344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34117.log 2024-04-26T20:59:26.071 INFO:teuthology.orchestra.run.smithi138.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35344.log.gz 2024-04-26T20:59:26.072 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.33568.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33568.log.gz 2024-04-26T20:59:26.073 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34117.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34117.log.gz 2024-04-26T20:59:26.073 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38911.log 2024-04-26T20:59:26.074 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33516.log 2024-04-26T20:59:26.076 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.38911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38779.log 2024-04-26T20:59:26.076 INFO:teuthology.orchestra.run.smithi138.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38911.log.gz 2024-04-26T20:59:26.077 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.33516.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33516.log.gz 2024-04-26T20:59:26.078 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.38779.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38779.log.gz 2024-04-26T20:59:26.079 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38278.log 2024-04-26T20:59:26.080 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33067.log 2024-04-26T20:59:26.081 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.38278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38148.log 2024-04-26T20:59:26.081 INFO:teuthology.orchestra.run.smithi138.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38278.log.gz 2024-04-26T20:59:26.082 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.33067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40319.log 2024-04-26T20:59:26.082 INFO:teuthology.orchestra.run.smithi138.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33067.log.gz 2024-04-26T20:59:26.083 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.38148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38122.log 2024-04-26T20:59:26.083 INFO:teuthology.orchestra.run.smithi138.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38148.log.gz 2024-04-26T20:59:26.085 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.40319.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40319.log.gz 2024-04-26T20:59:26.085 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.38122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35136.log 2024-04-26T20:59:26.085 INFO:teuthology.orchestra.run.smithi138.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38122.log.gz 2024-04-26T20:59:26.086 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33542.log 2024-04-26T20:59:26.087 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.35136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40660.log 2024-04-26T20:59:26.087 INFO:teuthology.orchestra.run.smithi138.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35136.log.gz 2024-04-26T20:59:26.089 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.33542.log: /var/log/ceph/ceph-client.admin.40660.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33542.log.gz 2024-04-26T20:59:26.090 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36523.log 89.5% 2024-04-26T20:59:26.090 INFO:teuthology.orchestra.run.smithi138.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40660.log.gz 2024-04-26T20:59:26.091 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40085.log 2024-04-26T20:59:26.092 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.36523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40007.log 2024-04-26T20:59:26.092 INFO:teuthology.orchestra.run.smithi138.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36523.log.gz 2024-04-26T20:59:26.094 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.40085.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.40085.log.gz 2024-04-26T20:59:26.095 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.40007.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40007.log.gz 2024-04-26T20:59:26.095 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33646.log 2024-04-26T20:59:26.096 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40528.log 2024-04-26T20:59:26.097 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.33646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34954.log 2024-04-26T20:59:26.097 INFO:teuthology.orchestra.run.smithi138.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.33646.log.gz 2024-04-26T20:59:26.098 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.40528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33352.log 2024-04-26T20:59:26.098 INFO:teuthology.orchestra.run.smithi138.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40528.log.gz 2024-04-26T20:59:26.099 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34954.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34954.log.gz 2024-04-26T20:59:26.100 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41461.log 2024-04-26T20:59:26.100 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.33352.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.33352.log.gz 2024-04-26T20:59:26.101 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35580.log 2024-04-26T20:59:26.102 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.41461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36601.log 2024-04-26T20:59:26.103 INFO:teuthology.orchestra.run.smithi138.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41461.log.gz 2024-04-26T20:59:26.103 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.35580.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.35580.log.gz 2024-04-26T20:59:26.104 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.36601.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36601.log.gz 2024-04-26T20:59:26.105 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37526.log 2024-04-26T20:59:26.106 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27554.log 2024-04-26T20:59:26.108 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.37526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39247.log 2024-04-26T20:59:26.108 INFO:teuthology.orchestra.run.smithi138.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37526.log.gz 2024-04-26T20:59:26.109 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.27554.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.27554.log.gz 2024-04-26T20:59:26.110 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.39247.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.39247.log.gz 2024-04-26T20:59:26.110 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33620.log 2024-04-26T20:59:26.111 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36333.log 2024-04-26T20:59:26.113 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.33620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41071.log 2024-04-26T20:59:26.113 INFO:teuthology.orchestra.run.smithi138.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33620.log.gz 2024-04-26T20:59:26.114 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.36333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41123.log 2024-04-26T20:59:26.114 INFO:teuthology.orchestra.run.smithi138.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36333.log.gz 2024-04-26T20:59:26.115 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.41071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34195.log 2024-04-26T20:59:26.115 INFO:teuthology.orchestra.run.smithi138.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41071.log.gz 2024-04-26T20:59:26.117 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.41123.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41123.log.gz 2024-04-26T20:59:26.117 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36047.log 2024-04-26T20:59:26.117 INFO:teuthology.orchestra.run.smithi138.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34195.log.gz 2024-04-26T20:59:26.118 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36978.log 2024-04-26T20:59:26.120 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.36047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34774.log 2024-04-26T20:59:26.120 INFO:teuthology.orchestra.run.smithi138.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36047.log.gz 2024-04-26T20:59:26.120 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.36978.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36978.log.gz 2024-04-26T20:59:26.121 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41227.log 2024-04-26T20:59:26.122 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34774.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34774.log.gz 2024-04-26T20:59:26.122 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.35708.log 2024-04-26T20:59:26.123 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.41227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38723.log 2024-04-26T20:59:26.123 INFO:teuthology.orchestra.run.smithi138.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41227.log.gz 2024-04-26T20:59:26.124 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.2.35708.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.35708.log.gz 2024-04-26T20:59:26.126 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.38723.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38723.log.gz 2024-04-26T20:59:26.126 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40502.log 2024-04-26T20:59:26.127 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37558.log 2024-04-26T20:59:26.129 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.40502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40941.log 2024-04-26T20:59:26.129 INFO:teuthology.orchestra.run.smithi138.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40502.log.gz 2024-04-26T20:59:26.130 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.37558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36817.log 2024-04-26T20:59:26.130 INFO:teuthology.orchestra.run.smithi138.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37558.log.gz 2024-04-26T20:59:26.131 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.40941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40580.log 2024-04-26T20:59:26.131 INFO:teuthology.orchestra.run.smithi138.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40941.log.gz 2024-04-26T20:59:26.132 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.36817.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36817.log.gz 2024-04-26T20:59:26.133 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39119.log 2024-04-26T20:59:26.134 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.40580.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40580.log.gz 2024-04-26T20:59:26.134 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34012.log 2024-04-26T20:59:26.135 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.39119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35214.log 2024-04-26T20:59:26.135 INFO:teuthology.orchestra.run.smithi138.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39119.log.gz 2024-04-26T20:59:26.136 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34012.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34012.log.gz 2024-04-26T20:59:26.137 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34562.log 2024-04-26T20:59:26.138 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.35214.log: gzip -5 89.2% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.35214.log.gz /var/log/ceph/ceph-client.admin.36710.log 2024-04-26T20:59:26.138 INFO:teuthology.orchestra.run.smithi138.stderr: 2024-04-26T20:59:26.139 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39274.log 2024-04-26T20:59:26.139 INFO:teuthology.orchestra.run.smithi138.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34562.log.gz 2024-04-26T20:59:26.140 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.36710.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36710.log.gz 2024-04-26T20:59:26.142 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.39274.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.39274.log.gz 2024-04-26T20:59:26.142 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35032.log 2024-04-26T20:59:26.143 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40111.log 2024-04-26T20:59:26.145 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.35032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34169.log 2024-04-26T20:59:26.145 INFO:teuthology.orchestra.run.smithi138.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35032.log.gz 2024-04-26T20:59:26.145 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.40111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37806.log 2024-04-26T20:59:26.145 INFO:teuthology.orchestra.run.smithi138.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40111.log.gz 2024-04-26T20:59:26.146 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34169.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34169.log.gz 2024-04-26T20:59:26.148 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.37806.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37806.log.gz 2024-04-26T20:59:26.172 INFO:teuthology.orchestra.run.smithi138.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-26T20:59:26.376 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-04-26T20:59:26.510 INFO:teuthology.orchestra.run.smithi143.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-26T20:59:26.531 INFO:teuthology.orchestra.run.smithi143.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-26T20:59:26.551 INFO:teuthology.orchestra.run.smithi138.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-26T20:59:26.572 INFO:teuthology.orchestra.run.smithi138.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-26T20:59:26.575 INFO:teuthology.orchestra.run.smithi143.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-26T20:59:26.595 INFO:teuthology.orchestra.run.smithi143.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-26T20:59:26.597 INFO:teuthology.orchestra.run.smithi143.stderr: 2024-04-26T20:59:26.597 INFO:teuthology.orchestra.run.smithi143.stderr:real 0m0.802s 2024-04-26T20:59:26.597 INFO:teuthology.orchestra.run.smithi143.stderr:user 0m3.116s 2024-04-26T20:59:26.597 INFO:teuthology.orchestra.run.smithi143.stderr:sys 0m0.263s 2024-04-26T20:59:26.677 INFO:teuthology.orchestra.run.smithi138.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-26T20:59:26.737 INFO:teuthology.orchestra.run.smithi138.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-26T20:59:26.739 INFO:teuthology.orchestra.run.smithi138.stderr: 2024-04-26T20:59:26.739 INFO:teuthology.orchestra.run.smithi138.stderr:real 0m0.989s 2024-04-26T20:59:26.739 INFO:teuthology.orchestra.run.smithi138.stderr:user 0m3.554s 2024-04-26T20:59:26.739 INFO:teuthology.orchestra.run.smithi138.stderr:sys 0m0.751s 2024-04-26T20:59:26.740 INFO:tasks.ceph:Archiving logs... 2024-04-26T20:59:26.740 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675178/remote/smithi138/log 2024-04-26T20:59:26.742 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T20:59:27.424 DEBUG:teuthology.misc:Transferring archived files from smithi143:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675178/remote/smithi143/log 2024-04-26T20:59:27.425 DEBUG:teuthology.orchestra.run.smithi143:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T20:59:27.800 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-26T20:59:27.810 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-26T20:59:27.810 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T20:59:27.813 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T20:59:27.902 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-26T20:59:27.914 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-26T20:59:27.914 DEBUG:teuthology.orchestra.run.smithi138:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T20:59:27.917 DEBUG:teuthology.orchestra.run.smithi143:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T20:59:27.929 INFO:teuthology.orchestra.run.smithi138.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T20:59:27.929 INFO:teuthology.orchestra.run.smithi138.stdout:============================================================================== 2024-04-26T20:59:27.929 INFO:teuthology.orchestra.run.smithi138.stdout:+hv01.front.sepi 67.205.162.81 3 u 65 64 177 0.109 -1.783 1.504 2024-04-26T20:59:27.929 INFO:teuthology.orchestra.run.smithi138.stdout:*hv02.front.sepi 63.231.80.2 3 u 1 64 377 0.100 +0.441 1.443 2024-04-26T20:59:27.929 INFO:teuthology.orchestra.run.smithi138.stdout:+hv03.front.sepi 74.6.168.72 3 u 1 64 377 0.111 -0.124 1.367 2024-04-26T20:59:27.929 INFO:teuthology.orchestra.run.smithi138.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T20:59:27.931 INFO:teuthology.orchestra.run.smithi143.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T20:59:27.931 INFO:teuthology.orchestra.run.smithi143.stdout:============================================================================== 2024-04-26T20:59:27.931 INFO:teuthology.orchestra.run.smithi143.stdout:+hv01.front.sepi 67.205.162.81 3 u 58 64 177 0.145 -2.538 1.659 2024-04-26T20:59:27.932 INFO:teuthology.orchestra.run.smithi143.stdout:+hv02.front.sepi 63.231.80.2 3 u 59 64 177 0.106 -0.289 1.674 2024-04-26T20:59:27.932 INFO:teuthology.orchestra.run.smithi143.stdout:*hv03.front.sepi 74.6.168.72 3 u 60 64 177 0.114 -0.747 1.645 2024-04-26T20:59:27.932 INFO:teuthology.orchestra.run.smithi143.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T20:59:27.932 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-26T20:59:27.941 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-26T20:59:27.942 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-26T20:59:27.953 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-26T20:59:27.962 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-26T20:59:27.970 INFO:teuthology.task.internal:Duration was 937.669454 seconds 2024-04-26T20:59:27.970 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-26T20:59:27.979 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-26T20:59:27.979 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T20:59:27.983 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T20:59:28.067 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-26T20:59:28.067 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi138.front.sepia.ceph.com 2024-04-26T20:59:28.067 DEBUG:teuthology.orchestra.run.smithi138:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T20:59:28.087 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi143.front.sepia.ceph.com 2024-04-26T20:59:28.087 DEBUG:teuthology.orchestra.run.smithi143:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T20:59:28.107 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-26T20:59:28.107 DEBUG:teuthology.orchestra.run.smithi138:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T20:59:28.137 DEBUG:teuthology.orchestra.run.smithi143:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T20:59:28.184 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-26T20:59:28.185 DEBUG:teuthology.orchestra.run.smithi138:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T20:59:28.216 DEBUG:teuthology.orchestra.run.smithi143:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T20:59:28.292 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-26T20:59:28.302 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-26T20:59:28.302 DEBUG:teuthology.orchestra.run.smithi138:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T20:59:28.322 DEBUG:teuthology.orchestra.run.smithi143:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T20:59:28.341 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-26T20:59:28.351 DEBUG:teuthology.orchestra.run.smithi138:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T20:59:28.368 DEBUG:teuthology.orchestra.run.smithi143:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T20:59:28.383 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern = core 2024-04-26T20:59:28.401 INFO:teuthology.orchestra.run.smithi143.stdout:kernel.core_pattern = core 2024-04-26T20:59:28.419 DEBUG:teuthology.orchestra.run.smithi138:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T20:59:28.453 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:59:28.453 DEBUG:teuthology.orchestra.run.smithi143:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T20:59:28.467 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:59:28.467 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-26T20:59:28.478 INFO:teuthology.task.internal:Transferring archived files... 2024-04-26T20:59:28.479 DEBUG:teuthology.misc:Transferring archived files from smithi138:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675178/remote/smithi138 2024-04-26T20:59:28.479 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T20:59:28.521 DEBUG:teuthology.misc:Transferring archived files from smithi143:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675178/remote/smithi143 2024-04-26T20:59:28.521 DEBUG:teuthology.orchestra.run.smithi143:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T20:59:28.545 INFO:teuthology.task.internal:Removing archive directory... 2024-04-26T20:59:28.545 DEBUG:teuthology.orchestra.run.smithi138:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T20:59:28.561 DEBUG:teuthology.orchestra.run.smithi143:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T20:59:28.597 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-26T20:59:28.608 INFO:teuthology.task.internal:Not uploading archives. 2024-04-26T20:59:28.609 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-26T20:59:28.619 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-26T20:59:28.619 DEBUG:teuthology.orchestra.run.smithi138:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T20:59:28.622 DEBUG:teuthology.orchestra.run.smithi143:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T20:59:28.628 INFO:teuthology.orchestra.run.smithi138.stdout: 655429 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 20:59 /home/ubuntu/cephtest 2024-04-26T20:59:28.648 INFO:teuthology.orchestra.run.smithi143.stdout: 655428 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 20:59 /home/ubuntu/cephtest 2024-04-26T20:59:28.650 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-26T20:59:28.661 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-26T20:59:28.686 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 client.1-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/alternate-pool} duration: 937.6694536209106 flavor: default owner: scheduled_rishabh@teuthology success: true 2024-04-26T20:59:28.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T20:59:28.771 INFO:teuthology.run:pass